2024-09-13T14:46:27.832 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T14:46:27.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T14:46:27.966 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903700 branch: wip-rishabh-testing-20240910.095512-reef description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} email: null first_in_suite: false job_id: '7903700' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-testing-20240910.095512-reef ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - Replacing daemon mds - SLOW_OPS - slow request sha1: 50bbe7f395997dcd871813949c49addbbf630361 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 50bbe7f395997dcd871813949c49addbbf630361 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.095512-reef sha1: 50bbe7f395997dcd871813949c49addbbf630361 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 1152 sha1: 50bbe7f395997dcd871813949c49addbbf630361 sleep_before_teardown: 0 subset: 984/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.095512-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 50bbe7f395997dcd871813949c49addbbf630361 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN5/NnWmvbW3K1Sj/jLNKLHQhPpEAkoU6Y68ryEoTdsxRCMh2g7mrZKze/Opfv4waBlTMoiMS7GWlTWv75k/aKc= smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAuaAfEcWFOkysiW/Iw/WQLDfhKR2j/XyidpJkiAHg2SJem5zkCxw6uug/iSV55S66efvpHPiUPDn6I6GyrPMew= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - mds_thrash: null - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:36:41 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T14:46:27.966 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa; will attempt to use it 2024-09-13T14:46:27.967 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa/tasks 2024-09-13T14:46:27.967 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T14:46:27.969 INFO:teuthology.task.internal:Checking packages... 2024-09-13T14:46:27.987 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '50bbe7f395997dcd871813949c49addbbf630361' 2024-09-13T14:46:27.988 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T14:46:27.988 INFO:teuthology.packaging:ref: None 2024-09-13T14:46:27.988 INFO:teuthology.packaging:tag: None 2024-09-13T14:46:27.988 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.095512-reef 2024-09-13T14:46:27.988 INFO:teuthology.packaging:sha1: 50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T14:46:27.988 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-testing-20240910.095512-reef 2024-09-13T14:46:28.138 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-850-g50bbe7f3-1jammy 2024-09-13T14:46:28.140 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T14:46:28.147 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T14:46:28.147 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T14:46:28.170 INFO:teuthology.task.internal:Saving configuration 2024-09-13T14:46:28.190 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T14:46:28.196 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T14:46:28.229 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903700', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 14:40:52.382849', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJmg717BrnRqvrCOqd+wFxqacZ5hHm5DEFKSTf02SS1X'} 2024-09-13T14:46:28.263 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903700', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 14:40:52.381219', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJXgwOTuKS3lVKcVy3Hq5SdgKdHwxnRLlLBoIl50Zyv2'} 2024-09-13T14:46:28.263 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T14:46:28.269 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-13T14:46:28.270 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-09-13T14:46:28.270 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T14:46:28.341 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd0a143fbe0>, signals=[15]) 2024-09-13T14:46:28.341 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T14:46:28.347 INFO:teuthology.task.internal:Opening connections... 2024-09-13T14:46:28.347 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T14:46:28.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T14:46:28.435 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2024-09-13T14:46:28.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T14:46:28.521 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T14:46:28.528 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-09-13T14:46:28.533 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-09-13T14:46:28.533 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-09-13T14:46:28.582 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T14:46:28.582 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Ubuntu" 2024-09-13T14:46:28.582 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="22.04" 2024-09-13T14:46:28.582 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T14:46:28.582 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_CODENAME=jammy 2024-09-13T14:46:28.582 INFO:teuthology.orchestra.run.smithi007.stdout:ID=ubuntu 2024-09-13T14:46:28.582 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE=debian 2024-09-13T14:46:28.582 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T14:46:28.582 INFO:teuthology.orchestra.run.smithi007.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T14:46:28.582 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T14:46:28.582 INFO:teuthology.orchestra.run.smithi007.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T14:46:28.583 INFO:teuthology.orchestra.run.smithi007.stdout:UBUNTU_CODENAME=jammy 2024-09-13T14:46:28.583 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-09-13T14:46:28.609 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-09-13T14:46:28.613 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-09-13T14:46:28.613 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-09-13T14:46:28.658 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-13T14:46:28.658 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Ubuntu" 2024-09-13T14:46:28.658 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="22.04" 2024-09-13T14:46:28.658 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-13T14:46:28.658 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_CODENAME=jammy 2024-09-13T14:46:28.658 INFO:teuthology.orchestra.run.smithi077.stdout:ID=ubuntu 2024-09-13T14:46:28.658 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE=debian 2024-09-13T14:46:28.658 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T14:46:28.658 INFO:teuthology.orchestra.run.smithi077.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T14:46:28.658 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T14:46:28.658 INFO:teuthology.orchestra.run.smithi077.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T14:46:28.658 INFO:teuthology.orchestra.run.smithi077.stdout:UBUNTU_CODENAME=jammy 2024-09-13T14:46:28.659 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-09-13T14:46:28.684 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T14:46:28.694 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T14:46:28.700 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T14:46:28.700 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2024-09-13T14:46:28.702 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2024-09-13T14:46:28.707 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T14:46:28.712 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T14:46:28.713 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2024-09-13T14:46:28.747 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2024-09-13T14:46:28.908 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T14:46:28.980 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T14:46:28.995 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-13T14:46:28.995 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-13T14:46:28.995 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-13T14:46:28.996 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T14:46:29.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T14:46:29.001 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-09-13T14:46:29.177 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T14:46:29.177 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T14:46:29.177 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-13T14:46:29.183 INFO:teuthology.orchestra.run.smithi007.stdout:5.15.0-56-generic 2024-09-13T14:46:29.183 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T14:46:29.183 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T14:46:29.184 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-09-13T14:46:29.184 DEBUG:teuthology.orchestra.run.smithi007:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-13T14:46:29.261 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-13T14:46:29.398 INFO:teuthology.orchestra.run.smithi007.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-13T14:46:29.398 INFO:teuthology.orchestra.run.smithi007.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-13T14:46:29.398 INFO:teuthology.orchestra.run.smithi007.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-13T14:46:29.398 INFO:teuthology.orchestra.run.smithi007.stderr:hint: 2024-09-13T14:46:29.398 INFO:teuthology.orchestra.run.smithi007.stderr:hint: git config --global init.defaultBranch 2024-09-13T14:46:29.398 INFO:teuthology.orchestra.run.smithi007.stderr:hint: 2024-09-13T14:46:29.398 INFO:teuthology.orchestra.run.smithi007.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-13T14:46:29.398 INFO:teuthology.orchestra.run.smithi007.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-13T14:46:29.398 INFO:teuthology.orchestra.run.smithi007.stderr:hint: 2024-09-13T14:46:29.398 INFO:teuthology.orchestra.run.smithi007.stderr:hint: git branch -m 2024-09-13T14:46:29.399 INFO:teuthology.orchestra.run.smithi007.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-13T14:46:29.402 DEBUG:teuthology.orchestra.run.smithi007:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-13T14:46:29.471 DEBUG:teuthology.orchestra.run.smithi007:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-13T14:46:29.526 DEBUG:teuthology.orchestra.run.smithi007:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-13T14:47:10.153 INFO:teuthology.orchestra.run.smithi007.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-13T14:47:10.153 INFO:teuthology.orchestra.run.smithi007.stderr: * [new branch] main -> origin/main 2024-09-13T14:47:10.192 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20190312 -> 20190312 2024-09-13T14:47:10.192 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20190416 -> 20190416 2024-09-13T14:47:10.192 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20190514 -> 20190514 2024-09-13T14:47:10.192 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20190618 -> 20190618 2024-09-13T14:47:10.192 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20190717 -> 20190717 2024-09-13T14:47:10.192 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20190815 -> 20190815 2024-09-13T14:47:10.193 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20190923 -> 20190923 2024-09-13T14:47:10.194 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20191022 -> 20191022 2024-09-13T14:47:10.194 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20191215 -> 20191215 2024-09-13T14:47:10.194 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20200122 -> 20200122 2024-09-13T14:47:10.194 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20200316 -> 20200316 2024-09-13T14:47:10.194 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20200421 -> 20200421 2024-09-13T14:47:10.194 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20200519 -> 20200519 2024-09-13T14:47:10.194 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20200619 -> 20200619 2024-09-13T14:47:10.194 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20200721 -> 20200721 2024-09-13T14:47:10.194 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20200817 -> 20200817 2024-09-13T14:47:10.194 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20200918 -> 20200918 2024-09-13T14:47:10.194 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20201022 -> 20201022 2024-09-13T14:47:10.194 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20201118 -> 20201118 2024-09-13T14:47:10.197 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20201218 -> 20201218 2024-09-13T14:47:10.197 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20210208 -> 20210208 2024-09-13T14:47:10.197 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20210315 -> 20210315 2024-09-13T14:47:10.197 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20210511 -> 20210511 2024-09-13T14:47:10.197 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20210716 -> 20210716 2024-09-13T14:47:10.197 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20210818 -> 20210818 2024-09-13T14:47:10.197 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20210919 -> 20210919 2024-09-13T14:47:10.197 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20211027 -> 20211027 2024-09-13T14:47:10.197 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20211216 -> 20211216 2024-09-13T14:47:10.197 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20220209 -> 20220209 2024-09-13T14:47:10.197 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20220310 -> 20220310 2024-09-13T14:47:10.197 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20220411 -> 20220411 2024-09-13T14:47:10.198 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20220509 -> 20220509 2024-09-13T14:47:10.198 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20220610 -> 20220610 2024-09-13T14:47:10.198 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20220708 -> 20220708 2024-09-13T14:47:10.198 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20220815 -> 20220815 2024-09-13T14:47:10.198 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20220913 -> 20220913 2024-09-13T14:47:10.198 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20221012 -> 20221012 2024-09-13T14:47:10.198 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20221109 -> 20221109 2024-09-13T14:47:10.198 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20221214 -> 20221214 2024-09-13T14:47:10.200 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20230117 -> 20230117 2024-09-13T14:47:10.200 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20230210 -> 20230210 2024-09-13T14:47:10.200 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20230310 -> 20230310 2024-09-13T14:47:10.200 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20230404 -> 20230404 2024-09-13T14:47:10.201 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20230515 -> 20230515 2024-09-13T14:47:10.201 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20230625 -> 20230625 2024-09-13T14:47:10.201 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20230804 -> 20230804 2024-09-13T14:47:10.201 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20230919 -> 20230919 2024-09-13T14:47:10.201 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20231030 -> 20231030 2024-09-13T14:47:10.201 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20231111 -> 20231111 2024-09-13T14:47:10.201 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20231211 -> 20231211 2024-09-13T14:47:10.201 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20240115 -> 20240115 2024-09-13T14:47:10.201 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20240220 -> 20240220 2024-09-13T14:47:10.201 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20240312 -> 20240312 2024-09-13T14:47:10.201 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20240410 -> 20240410 2024-09-13T14:47:10.201 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20240513 -> 20240513 2024-09-13T14:47:10.201 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20240610 -> 20240610 2024-09-13T14:47:10.202 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20240709 -> 20240709 2024-09-13T14:47:10.202 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20240811 -> 20240811 2024-09-13T14:47:10.202 INFO:teuthology.orchestra.run.smithi007.stderr: * [new tag] 20240909 -> 20240909 2024-09-13T14:47:15.060 INFO:teuthology.orchestra.run.smithi007.stderr:Updating files: 28% (1004/3520) Updating files: 29% (1021/3520) Updating files: 30% (1056/3520) Updating files: 31% (1092/3520) Updating files: 32% (1127/3520) Updating files: 33% (1162/3520) Updating files: 34% (1197/3520) Updating files: 35% (1232/3520) Updating files: 36% (1268/3520) Updating files: 37% (1303/3520) Updating files: 38% (1338/3520) Updating files: 39% (1373/3520) Updating files: 40% (1408/3520) Updating files: 41% (1444/3520) Updating files: 42% (1479/3520) Updating files: 43% (1514/3520) Updating files: 44% (1549/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 58% (2055/3520) Updating files: 59% (2077/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 68% (2426/3520) Updating files: 69% (2429/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 81% (2884/3520) Updating files: 82% (2887/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-13T14:47:15.065 INFO:teuthology.orchestra.run.smithi007.stdout:HEAD is now at a34e7a5f Merge branch 'fix-rawfile-links' into 'main' 2024-09-13T14:47:15.089 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T14:47:15.090 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T14:47:15.244 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T14:47:15.245 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-13T14:47:15.247 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi007.front.sepia.ceph.com to complete... 2024-09-13T14:47:16.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13 14:47:17 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-13T14:47:16.790 INFO:teuthology.orchestra.run.smithi007.stderr:FINISHED --2024-09-13 14:47:17-- 2024-09-13T14:47:16.790 INFO:teuthology.orchestra.run.smithi007.stderr:Total wall clock time: 1.5s 2024-09-13T14:47:16.790 INFO:teuthology.orchestra.run.smithi007.stderr:Downloaded: 1 files, 43M in 1.4s (31.1 MB/s) 2024-09-13T14:47:16.794 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T14:47:16.794 DEBUG:teuthology.orchestra.run.smithi007:> sudo dpkg -i /tmp/linux-image.deb 2024-09-13T14:47:17.088 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-13T14:47:19.130 INFO:teuthology.orchestra.run.smithi007.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-13T14:47:19.134 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-13T14:47:19.289 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T14:47:23.524 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-13T14:47:23.643 INFO:teuthology.orchestra.run.smithi007.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:47:47.631 INFO:teuthology.orchestra.run.smithi007.stderr:Sourcing file `/etc/default/grub' 2024-09-13T14:47:47.642 INFO:teuthology.orchestra.run.smithi007.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T14:47:47.662 INFO:teuthology.orchestra.run.smithi007.stderr:Generating grub configuration file ... 2024-09-13T14:47:48.032 INFO:teuthology.orchestra.run.smithi007.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:47:48.057 INFO:teuthology.orchestra.run.smithi007.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:47:48.404 INFO:teuthology.orchestra.run.smithi007.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T14:47:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T14:47:48.486 INFO:teuthology.orchestra.run.smithi007.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T14:47:48.492 INFO:teuthology.orchestra.run.smithi007.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T14:47:48.639 INFO:teuthology.orchestra.run.smithi007.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T14:47:48.640 INFO:teuthology.orchestra.run.smithi007.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T14:47:48.640 INFO:teuthology.orchestra.run.smithi007.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T14:47:48.680 INFO:teuthology.orchestra.run.smithi007.stderr:done 2024-09-13T14:47:48.875 DEBUG:teuthology.orchestra.run.smithi007:> dpkg-deb -c /tmp/linux-image.deb 2024-09-13T14:47:48.883 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-13T14:47:48.883 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-13T14:47:48.884 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:47:48.903 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:47:48.904 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:47:48.926 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-13T14:47:48.926 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-13T14:47:48.926 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-13T14:47:48.926 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-13T14:47:48.926 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-13T14:47:48.926 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-13T14:47:48.926 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-13T14:47:48.926 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-13T14:47:48.926 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T14:47:48.926 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-13T14:47:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-13T14:47:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-13T14:47:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-13T14:47:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-13T14:47:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T14:47:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T14:47:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T14:47:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T14:47:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T14:47:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T14:47:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T14:47:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T14:47:48.927 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T14:47:48.928 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T14:47:48.929 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T14:47:48.929 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T14:47:48.929 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T14:47:48.929 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T14:47:48.929 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T14:47:48.930 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T14:47:48.930 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T14:47:48.930 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T14:47:48.930 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T14:47:48.930 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-13T14:47:48.930 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-13T14:47:48.930 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-13T14:47:48.930 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T14:47:48.930 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-13T14:47:48.930 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-13T14:47:48.930 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-13T14:47:48.930 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T14:47:48.930 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T14:47:48.931 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T14:47:48.945 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-13T14:47:48.945 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-13T14:47:48.945 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-13T14:47:48.945 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-13T14:47:48.945 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T14:47:48.945 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T14:47:48.945 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T14:47:48.945 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-13T14:47:48.946 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-13T14:47:48.946 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-13T14:47:48.946 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T14:47:48.946 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T14:47:48.946 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T14:47:48.946 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T14:47:48.946 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T14:47:48.946 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T14:47:48.946 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T14:47:48.946 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T14:47:48.946 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T14:47:48.946 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T14:47:48.946 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T14:47:48.947 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T14:47:48.947 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T14:47:48.947 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T14:47:48.947 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T14:47:48.947 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T14:47:48.947 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T14:47:48.947 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T14:47:48.947 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-13T14:47:48.947 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T14:47:48.947 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-13T14:47:48.947 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T14:47:48.947 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T14:47:48.948 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T14:47:48.948 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T14:47:48.948 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T14:47:48.948 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T14:47:48.948 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T14:47:48.948 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T14:47:48.948 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-13T14:47:48.948 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T14:47:48.948 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T14:47:48.948 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T14:47:48.948 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T14:47:48.948 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T14:47:48.948 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T14:47:48.949 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T14:47:48.949 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T14:47:48.949 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T14:47:48.949 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T14:47:48.949 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T14:47:48.949 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T14:47:48.949 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T14:47:48.949 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T14:47:48.949 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T14:47:48.949 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T14:47:48.949 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T14:47:48.949 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-13T14:47:48.949 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T14:47:48.950 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-13T14:47:48.950 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-13T14:47:48.950 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-13T14:47:48.950 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T14:47:48.950 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T14:47:48.950 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-13T14:47:48.950 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-13T14:47:48.950 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T14:47:48.950 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T14:47:48.951 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T14:47:48.951 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T14:47:48.951 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T14:47:48.951 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-13T14:47:48.951 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T14:47:48.951 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-13T14:47:48.951 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T14:47:48.951 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-13T14:47:48.951 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T14:47:48.951 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T14:47:48.951 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T14:47:48.951 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T14:47:48.952 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T14:47:48.952 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T14:47:48.952 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T14:47:48.952 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T14:47:48.952 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T14:47:48.952 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T14:47:48.952 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T14:47:48.952 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T14:47:48.952 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T14:47:48.952 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T14:47:48.952 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T14:47:48.952 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T14:47:48.953 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T14:47:48.953 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T14:47:48.953 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-13T14:47:48.953 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T14:47:48.953 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T14:47:48.953 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T14:47:48.953 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T14:47:48.953 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T14:47:48.953 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T14:47:48.953 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T14:47:48.953 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T14:47:48.953 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T14:47:48.953 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T14:47:48.954 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T14:47:48.954 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T14:47:48.954 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T14:47:48.954 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-13T14:47:48.954 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T14:47:48.954 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-13T14:47:48.954 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T14:47:48.954 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T14:47:48.954 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T14:47:48.954 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T14:47:48.954 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T14:47:48.954 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T14:47:48.954 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T14:47:48.955 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T14:47:48.955 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T14:47:48.955 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T14:47:48.955 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T14:47:48.955 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T14:47:48.955 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T14:47:48.955 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T14:47:48.955 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T14:47:48.955 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T14:47:48.955 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T14:47:48.955 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T14:47:48.955 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T14:47:48.955 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T14:47:48.956 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-13T14:47:48.956 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T14:47:48.956 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-13T14:47:48.956 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T14:47:48.956 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-13T14:47:48.956 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-13T14:47:48.956 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T14:47:48.956 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-13T14:47:48.956 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T14:47:48.990 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T14:47:48.990 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-13T14:47:48.990 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T14:47:48.990 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T14:47:48.990 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-13T14:47:48.991 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T14:47:48.991 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T14:47:48.991 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T14:47:48.991 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-13T14:47:48.991 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T14:47:48.991 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-13T14:47:48.991 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T14:47:48.991 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-13T14:47:48.991 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-13T14:47:48.991 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T14:47:48.991 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-13T14:47:48.991 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T14:47:48.991 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T14:47:48.992 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T14:47:48.992 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T14:47:48.992 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T14:47:48.992 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-13T14:47:48.992 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T14:47:48.992 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T14:47:48.992 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T14:47:48.992 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T14:47:48.992 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T14:47:48.992 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T14:47:48.992 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T14:47:48.992 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-13T14:47:48.992 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T14:47:48.993 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-13T14:47:48.993 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T14:47:48.993 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T14:47:48.993 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-13T14:47:48.993 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T14:47:48.993 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-13T14:47:48.993 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-13T14:47:48.993 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-13T14:47:48.993 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T14:47:48.993 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T14:47:48.993 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-13T14:47:48.993 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-13T14:47:48.994 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-13T14:47:48.994 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-13T14:47:48.994 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-13T14:47:48.994 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-13T14:47:48.994 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-13T14:47:48.994 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-13T14:47:48.994 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-13T14:47:48.994 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-13T14:47:48.994 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-13T14:47:48.994 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T14:47:48.994 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T14:47:48.994 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T14:47:48.994 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-13T14:47:48.995 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-13T14:47:48.995 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T14:47:48.995 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T14:47:48.995 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-13T14:47:48.995 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-13T14:47:48.995 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-13T14:47:48.995 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T14:47:48.995 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-13T14:47:48.995 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T14:47:48.995 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T14:47:48.995 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T14:47:48.995 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-13T14:47:48.995 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T14:47:48.996 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-13T14:47:48.996 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T14:47:48.996 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-13T14:47:48.996 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-13T14:47:48.996 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T14:47:48.996 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-13T14:47:48.996 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T14:47:48.996 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-13T14:47:48.996 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T14:47:48.996 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T14:47:48.996 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T14:47:48.996 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T14:47:48.996 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T14:47:48.996 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T14:47:48.997 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T14:47:48.997 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T14:47:48.997 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T14:47:48.997 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T14:47:48.997 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T14:47:48.997 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T14:47:48.997 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T14:47:48.997 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-13T14:47:48.997 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-13T14:47:48.997 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-13T14:47:48.997 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-13T14:47:48.997 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-13T14:47:48.997 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-13T14:47:48.997 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-13T14:47:48.998 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-13T14:47:48.998 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-13T14:47:48.998 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-13T14:47:48.998 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-13T14:47:48.998 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-13T14:47:48.998 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T14:47:48.998 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-13T14:47:48.998 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-13T14:47:48.998 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-13T14:47:48.998 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-13T14:47:48.998 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-13T14:47:48.998 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-13T14:47:48.998 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-13T14:47:48.998 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-13T14:47:48.999 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-13T14:47:48.999 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T14:47:48.999 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-13T14:47:48.999 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-13T14:47:48.999 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-13T14:47:48.999 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-13T14:47:48.999 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-13T14:47:48.999 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-13T14:47:48.999 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-13T14:47:48.999 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-13T14:47:48.999 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-13T14:47:48.999 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-13T14:47:48.999 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-13T14:47:49.000 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-13T14:47:49.000 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-13T14:47:49.000 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-13T14:47:49.000 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-13T14:47:49.000 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T14:47:49.000 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-13T14:47:49.000 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-13T14:47:49.000 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-13T14:47:49.000 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-13T14:47:49.000 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-13T14:47:49.000 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-13T14:47:49.000 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-13T14:47:49.000 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T14:47:49.001 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T14:47:49.001 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T14:47:49.001 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-13T14:47:49.001 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-13T14:47:49.001 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-13T14:47:49.001 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-13T14:47:49.001 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-13T14:47:49.001 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T14:47:49.001 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T14:47:49.001 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T14:47:49.001 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T14:47:49.001 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-13T14:47:49.002 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T14:47:49.002 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-13T14:47:49.002 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T14:47:49.002 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T14:47:49.002 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T14:47:49.002 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T14:47:49.002 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T14:47:49.002 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T14:47:49.002 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T14:47:49.002 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-13T14:47:49.002 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T14:47:49.002 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T14:47:49.002 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T14:47:49.002 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T14:47:49.003 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T14:47:49.003 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-13T14:47:49.003 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T14:47:49.003 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T14:47:49.003 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-13T14:47:49.003 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-13T14:47:49.003 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-13T14:47:49.003 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-13T14:47:49.003 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T14:47:49.003 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-13T14:47:49.003 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T14:47:49.003 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T14:47:49.003 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T14:47:49.004 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T14:47:49.004 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T14:47:49.004 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T14:47:49.004 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T14:47:49.004 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T14:47:49.004 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T14:47:49.004 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T14:47:49.004 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T14:47:49.004 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T14:47:49.004 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T14:47:49.004 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T14:47:49.004 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T14:47:49.005 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T14:47:49.005 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T14:47:49.005 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T14:47:49.005 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T14:47:49.005 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T14:47:49.005 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T14:47:49.005 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T14:47:49.005 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T14:47:49.005 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T14:47:49.005 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T14:47:49.005 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T14:47:49.005 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T14:47:49.005 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T14:47:49.005 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T14:47:49.006 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T14:47:49.006 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T14:47:49.006 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T14:47:49.006 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T14:47:49.006 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T14:47:49.006 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T14:47:49.006 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T14:47:49.006 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T14:47:49.006 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T14:47:49.006 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T14:47:49.006 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-13T14:47:49.006 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T14:47:49.006 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-13T14:47:49.006 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-13T14:47:49.007 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-13T14:47:49.007 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-13T14:47:49.007 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T14:47:49.007 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-13T14:47:49.007 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T14:47:49.007 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T14:47:49.007 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T14:47:49.007 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-13T14:47:49.007 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T14:47:49.007 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T14:47:49.007 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T14:47:49.007 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T14:47:49.007 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T14:47:49.008 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T14:47:49.008 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T14:47:49.008 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T14:47:49.008 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T14:47:49.008 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T14:47:49.008 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T14:47:49.008 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T14:47:49.008 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T14:47:49.008 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T14:47:49.008 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T14:47:49.008 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T14:47:49.008 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T14:47:49.008 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T14:47:49.008 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T14:47:49.009 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T14:47:49.009 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T14:47:49.009 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T14:47:49.009 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T14:47:49.009 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T14:47:49.009 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T14:47:49.009 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-13T14:47:49.009 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-13T14:47:49.009 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-13T14:47:49.009 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T14:47:49.009 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T14:47:49.009 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T14:47:49.009 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T14:47:49.010 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T14:47:49.010 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-13T14:47:49.010 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T14:47:49.010 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T14:47:49.010 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T14:47:49.010 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T14:47:49.010 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T14:47:49.010 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T14:47:49.010 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T14:47:49.010 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T14:47:49.010 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T14:47:49.010 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T14:47:49.010 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-13T14:47:49.011 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T14:47:49.011 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T14:47:49.011 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T14:47:49.011 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T14:47:49.011 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T14:47:49.011 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T14:47:49.011 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T14:47:49.011 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T14:47:49.011 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-13T14:47:49.011 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T14:47:49.011 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T14:47:49.011 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T14:47:49.011 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T14:47:49.012 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T14:47:49.012 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T14:47:49.012 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T14:47:49.012 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T14:47:49.012 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T14:47:49.012 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T14:47:49.012 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T14:47:49.012 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T14:47:49.012 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T14:47:49.012 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T14:47:49.012 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T14:47:49.012 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T14:47:49.012 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T14:47:49.013 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T14:47:49.013 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T14:47:49.013 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T14:47:49.013 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T14:47:49.013 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T14:47:49.013 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T14:47:49.013 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T14:47:49.013 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T14:47:49.013 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T14:47:49.013 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T14:47:49.013 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T14:47:49.013 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T14:47:49.013 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T14:47:49.013 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T14:47:49.014 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T14:47:49.014 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-13T14:47:49.014 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T14:47:49.014 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-13T14:47:49.014 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T14:47:49.014 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T14:47:49.014 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T14:47:49.014 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T14:47:49.014 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T14:47:49.014 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T14:47:49.014 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T14:47:49.014 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-13T14:47:49.014 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T14:47:49.015 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T14:47:49.015 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T14:47:49.015 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T14:47:49.015 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T14:47:49.015 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T14:47:49.015 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T14:47:49.015 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T14:47:49.015 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T14:47:49.015 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T14:47:49.015 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T14:47:49.015 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T14:47:49.015 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T14:47:49.015 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T14:47:49.015 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T14:47:49.016 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T14:47:49.016 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T14:47:49.016 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T14:47:49.016 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T14:47:49.016 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T14:47:49.016 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T14:47:49.016 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T14:47:49.016 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T14:47:49.016 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T14:47:49.016 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T14:47:49.016 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T14:47:49.016 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T14:47:49.016 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T14:47:49.017 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T14:47:49.017 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T14:47:49.017 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T14:47:49.017 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T14:47:49.017 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T14:47:49.017 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T14:47:49.017 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T14:47:49.017 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T14:47:49.017 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T14:47:49.017 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T14:47:49.017 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T14:47:49.017 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T14:47:49.017 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T14:47:49.018 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-13T14:47:49.018 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-13T14:47:49.018 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-13T14:47:49.018 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-13T14:47:49.018 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T14:47:49.018 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T14:47:49.018 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-13T14:47:49.018 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-13T14:47:49.018 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-13T14:47:49.018 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-13T14:47:49.018 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T14:47:49.018 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T14:47:49.018 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T14:47:49.019 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-13T14:47:49.019 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T14:47:49.019 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-13T14:47:49.019 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T14:47:49.019 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T14:47:49.019 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T14:47:49.019 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T14:47:49.019 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-13T14:47:49.019 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-13T14:47:49.019 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T14:47:49.019 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T14:47:49.019 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T14:47:49.019 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-13T14:47:49.019 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T14:47:49.020 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T14:47:49.020 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-13T14:47:49.020 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T14:47:49.020 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T14:47:49.020 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T14:47:49.020 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-13T14:47:49.020 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T14:47:49.020 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T14:47:49.020 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-13T14:47:49.020 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-13T14:47:49.020 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T14:47:49.020 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-13T14:47:49.020 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T14:47:49.020 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T14:47:49.021 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T14:47:49.021 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T14:47:49.021 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-13T14:47:49.021 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T14:47:49.021 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T14:47:49.021 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T14:47:49.021 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-13T14:47:49.021 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-13T14:47:49.021 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-13T14:47:49.021 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-13T14:47:49.021 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-13T14:47:49.021 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-13T14:47:49.021 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T14:47:49.022 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T14:47:49.022 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T14:47:49.022 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T14:47:49.022 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T14:47:49.022 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T14:47:49.022 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T14:47:49.022 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-13T14:47:49.022 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-13T14:47:49.022 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T14:47:49.022 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-13T14:47:49.022 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T14:47:49.022 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-13T14:47:49.022 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T14:47:49.047 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-13T14:47:49.047 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T14:47:49.047 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-13T14:47:49.047 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-13T14:47:49.047 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-13T14:47:49.047 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-13T14:47:49.047 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-13T14:47:49.047 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-13T14:47:49.047 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T14:47:49.047 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-13T14:47:49.047 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T14:47:49.047 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-13T14:47:49.047 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T14:47:49.048 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-13T14:47:49.048 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T14:47:49.048 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-13T14:47:49.048 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T14:47:49.048 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-13T14:47:49.048 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-13T14:47:49.048 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-13T14:47:49.048 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-13T14:47:49.048 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T14:47:49.048 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T14:47:49.048 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T14:47:49.048 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T14:47:49.048 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-13T14:47:49.049 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-13T14:47:49.049 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-13T14:47:49.049 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-13T14:47:49.049 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-13T14:47:49.049 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T14:47:49.049 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-13T14:47:49.049 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-13T14:47:49.049 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-13T14:47:49.049 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-13T14:47:49.049 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-13T14:47:49.049 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-13T14:47:49.049 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-13T14:47:49.049 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-13T14:47:49.049 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-13T14:47:49.050 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-13T14:47:49.050 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-13T14:47:49.050 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-13T14:47:49.050 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-13T14:47:49.050 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-13T14:47:49.050 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-13T14:47:49.050 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-13T14:47:49.050 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-13T14:47:49.050 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-13T14:47:49.051 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-13T14:47:49.051 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-13T14:47:49.051 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-13T14:47:49.051 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T14:47:49.051 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T14:47:49.051 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T14:47:49.051 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T14:47:49.051 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-13T14:47:49.051 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-13T14:47:49.051 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T14:47:49.051 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T14:47:49.051 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T14:47:49.051 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T14:47:49.052 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-13T14:47:49.052 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T14:47:49.052 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-13T14:47:49.052 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T14:47:49.052 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T14:47:49.052 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-13T14:47:49.052 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T14:47:49.052 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-13T14:47:49.052 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-13T14:47:49.052 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-13T14:47:49.052 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T14:47:49.052 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-13T14:47:49.052 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T14:47:49.053 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-13T14:47:49.053 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-13T14:47:49.053 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-13T14:47:49.053 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-13T14:47:49.053 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T14:47:49.053 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-13T14:47:49.053 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-13T14:47:49.053 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-13T14:47:49.053 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T14:47:49.053 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-13T14:47:49.053 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-13T14:47:49.053 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-13T14:47:49.053 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T14:47:49.053 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-13T14:47:49.054 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-13T14:47:49.054 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-13T14:47:49.054 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-13T14:47:49.054 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-13T14:47:49.054 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-13T14:47:49.054 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-13T14:47:49.054 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T14:47:49.054 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-13T14:47:49.054 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-13T14:47:49.054 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-13T14:47:49.054 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-13T14:47:49.054 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T14:47:49.054 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T14:47:49.055 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T14:47:49.055 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T14:47:49.055 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T14:47:49.055 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T14:47:49.055 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T14:47:49.055 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T14:47:49.055 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-13T14:47:49.055 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-13T14:47:49.055 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T14:47:49.055 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T14:47:49.055 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-13T14:47:49.055 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T14:47:49.055 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T14:47:49.056 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T14:47:49.056 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T14:47:49.056 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-13T14:47:49.056 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T14:47:49.056 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T14:47:49.056 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-13T14:47:49.056 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-13T14:47:49.056 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T14:47:49.056 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T14:47:49.056 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T14:47:49.056 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-13T14:47:49.056 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T14:47:49.056 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T14:47:49.056 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-13T14:47:49.057 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T14:47:49.057 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T14:47:49.057 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T14:47:49.057 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-13T14:47:49.057 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-13T14:47:49.057 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T14:47:49.057 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T14:47:49.057 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T14:47:49.057 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T14:47:49.057 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T14:47:49.057 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-13T14:47:49.057 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-13T14:47:49.057 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T14:47:49.057 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T14:47:49.058 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T14:47:49.058 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T14:47:49.058 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T14:47:49.058 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T14:47:49.058 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T14:47:49.058 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-13T14:47:49.058 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-13T14:47:49.058 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-13T14:47:49.058 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-13T14:47:49.058 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-13T14:47:49.058 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-13T14:47:49.058 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-13T14:47:49.058 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-13T14:47:49.058 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-13T14:47:49.059 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-13T14:47:49.059 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-13T14:47:49.059 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-13T14:47:49.059 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-13T14:47:49.059 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-13T14:47:49.059 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T14:47:49.059 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T14:47:49.059 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-13T14:47:49.059 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-13T14:47:49.059 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-13T14:47:49.059 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-13T14:47:49.059 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-13T14:47:49.059 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-13T14:47:49.059 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-13T14:47:49.060 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-13T14:47:49.060 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-13T14:47:49.060 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-13T14:47:49.060 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T14:47:49.060 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-13T14:47:49.060 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-13T14:47:49.060 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T14:47:49.060 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T14:47:49.060 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T14:47:49.060 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-13T14:47:49.060 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-13T14:47:49.060 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-13T14:47:49.060 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-13T14:47:49.061 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-13T14:47:49.061 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T14:47:49.061 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T14:47:49.061 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T14:47:49.061 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T14:47:49.061 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-13T14:47:49.061 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-13T14:47:49.061 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-13T14:47:49.061 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-13T14:47:49.061 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T14:47:49.061 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-13T14:47:49.061 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-13T14:47:49.061 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-13T14:47:49.061 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-13T14:47:49.061 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-13T14:47:49.062 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T14:47:49.062 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T14:47:49.062 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T14:47:49.062 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T14:47:49.062 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-13T14:47:49.062 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-13T14:47:49.062 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-13T14:47:49.062 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T14:47:49.062 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-13T14:47:49.062 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-13T14:47:49.062 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-13T14:47:49.062 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T14:47:49.062 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T14:47:49.062 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-13T14:47:49.063 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T14:47:49.063 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T14:47:49.063 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-13T14:47:49.063 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T14:47:49.063 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T14:47:49.063 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T14:47:49.063 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-13T14:47:49.063 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-13T14:47:49.063 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-13T14:47:49.063 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T14:47:49.063 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T14:47:49.063 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T14:47:49.064 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T14:47:49.064 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-13T14:47:49.064 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T14:47:49.064 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-13T14:47:49.064 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-13T14:47:49.064 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T14:47:49.064 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-13T14:47:49.064 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-13T14:47:49.064 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T14:47:49.064 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T14:47:49.064 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T14:47:49.064 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-13T14:47:49.064 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T14:47:49.064 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T14:47:49.065 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T14:47:49.065 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-13T14:47:49.065 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-13T14:47:49.065 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T14:47:49.065 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T14:47:49.065 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T14:47:49.065 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T14:47:49.065 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-13T14:47:49.065 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T14:47:49.065 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T14:47:49.065 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T14:47:49.065 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T14:47:49.065 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-13T14:47:49.066 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T14:47:49.066 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-13T14:47:49.066 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T14:47:49.066 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-13T14:47:49.066 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T14:47:49.066 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-13T14:47:49.066 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T14:47:49.066 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-13T14:47:49.066 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T14:47:49.066 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T14:47:49.066 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T14:47:49.066 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-13T14:47:49.066 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-13T14:47:49.067 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T14:47:49.067 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-13T14:47:49.067 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T14:47:49.067 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-13T14:47:49.067 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T14:47:49.067 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-13T14:47:49.067 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T14:47:49.067 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T14:47:49.067 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-13T14:47:49.067 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T14:47:49.067 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T14:47:49.067 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-13T14:47:49.068 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T14:47:49.068 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T14:47:49.068 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-13T14:47:49.068 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T14:47:49.068 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T14:47:49.068 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-13T14:47:49.068 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-13T14:47:49.068 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T14:47:49.068 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-13T14:47:49.068 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-13T14:47:49.068 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T14:47:49.068 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-13T14:47:49.068 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T14:47:49.069 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-13T14:47:49.069 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T14:47:49.069 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-13T14:47:49.069 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T14:47:49.069 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-13T14:47:49.069 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T14:47:49.069 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-13T14:47:49.069 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-13T14:47:49.069 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T14:47:49.069 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-13T14:47:49.069 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-13T14:47:49.069 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T14:47:49.069 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T14:47:49.070 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T14:47:49.070 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T14:47:49.070 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T14:47:49.070 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T14:47:49.070 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-13T14:47:49.070 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T14:47:49.070 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T14:47:49.070 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T14:47:49.070 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-13T14:47:49.070 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-13T14:47:49.070 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-13T14:47:49.070 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T14:47:49.070 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T14:47:49.070 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T14:47:49.071 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-13T14:47:49.071 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-13T14:47:49.071 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-13T14:47:49.071 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T14:47:49.071 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-13T14:47:49.071 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T14:47:49.071 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-13T14:47:49.071 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T14:47:49.071 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-13T14:47:49.071 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T14:47:49.071 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-13T14:47:49.071 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T14:47:49.071 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-13T14:47:49.072 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T14:47:49.072 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-13T14:47:49.072 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T14:47:49.072 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-13T14:47:49.072 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T14:47:49.072 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-13T14:47:49.072 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T14:47:49.100 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-13T14:47:49.101 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T14:47:49.101 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-13T14:47:49.101 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T14:47:49.101 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-13T14:47:49.101 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T14:47:49.101 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T14:47:49.101 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-13T14:47:49.101 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T14:47:49.101 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T14:47:49.101 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T14:47:49.102 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-13T14:47:49.102 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-13T14:47:49.102 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T14:47:49.102 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T14:47:49.102 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-13T14:47:49.102 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-13T14:47:49.102 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T14:47:49.102 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-13T14:47:49.102 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-13T14:47:49.102 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-13T14:47:49.102 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-13T14:47:49.102 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T14:47:49.102 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-13T14:47:49.103 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-13T14:47:49.103 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T14:47:49.103 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-13T14:47:49.103 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T14:47:49.103 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T14:47:49.103 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-13T14:47:49.103 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T14:47:49.103 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-13T14:47:49.103 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T14:47:49.103 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-13T14:47:49.103 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T14:47:49.103 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T14:47:49.103 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-13T14:47:49.103 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-13T14:47:49.104 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T14:47:49.104 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T14:47:49.104 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-13T14:47:49.104 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T14:47:49.104 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-13T14:47:49.104 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T14:47:49.104 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-13T14:47:49.104 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T14:47:49.104 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T14:47:49.104 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T14:47:49.104 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T14:47:49.104 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-13T14:47:49.105 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-13T14:47:49.105 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-13T14:47:49.105 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-13T14:47:49.105 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T14:47:49.105 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-13T14:47:49.105 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T14:47:49.105 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-13T14:47:49.105 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T14:47:49.105 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T14:47:49.105 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-13T14:47:49.105 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T14:47:49.105 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T14:47:49.106 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T14:47:49.106 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T14:47:49.106 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-13T14:47:49.106 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-13T14:47:49.106 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-13T14:47:49.106 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T14:47:49.106 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-13T14:47:49.106 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T14:47:49.106 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-13T14:47:49.106 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T14:47:49.106 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T14:47:49.106 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T14:47:49.107 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T14:47:49.107 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-13T14:47:49.107 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T14:47:49.107 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-13T14:47:49.107 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T14:47:49.107 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-13T14:47:49.107 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T14:47:49.107 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T14:47:49.107 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-13T14:47:49.107 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T14:47:49.107 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T14:47:49.108 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-13T14:47:49.108 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T14:47:49.108 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-13T14:47:49.108 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-13T14:47:49.108 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-13T14:47:49.108 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-13T14:47:49.108 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T14:47:49.108 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-13T14:47:49.108 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T14:47:49.108 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-13T14:47:49.108 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T14:47:49.108 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T14:47:49.108 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-13T14:47:49.109 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T14:47:49.109 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T14:47:49.109 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T14:47:49.109 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-13T14:47:49.109 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T14:47:49.109 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T14:47:49.109 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-13T14:47:49.109 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T14:47:49.109 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T14:47:49.109 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T14:47:49.109 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T14:47:49.109 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T14:47:49.110 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-13T14:47:49.110 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T14:47:49.110 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T14:47:49.110 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-13T14:47:49.110 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T14:47:49.110 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T14:47:49.110 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T14:47:49.110 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T14:47:49.110 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T14:47:49.110 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T14:47:49.110 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T14:47:49.110 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T14:47:49.110 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T14:47:49.110 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T14:47:49.110 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T14:47:49.111 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T14:47:49.111 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T14:47:49.111 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T14:47:49.111 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T14:47:49.111 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T14:47:49.111 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T14:47:49.111 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T14:47:49.111 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T14:47:49.111 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-13T14:47:49.111 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-13T14:47:49.111 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-13T14:47:49.111 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T14:47:49.111 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T14:47:49.112 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T14:47:49.112 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T14:47:49.112 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T14:47:49.112 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T14:47:49.112 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T14:47:49.112 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T14:47:49.112 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-13T14:47:49.112 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T14:47:49.112 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T14:47:49.112 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T14:47:49.112 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-13T14:47:49.112 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T14:47:49.112 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T14:47:49.113 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T14:47:49.113 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T14:47:49.113 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T14:47:49.113 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T14:47:49.113 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T14:47:49.113 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-13T14:47:49.113 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T14:47:49.113 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-13T14:47:49.113 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T14:47:49.113 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-13T14:47:49.113 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T14:47:49.113 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-13T14:47:49.113 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T14:47:49.113 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-13T14:47:49.114 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-13T14:47:49.114 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T14:47:49.114 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T14:47:49.114 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-13T14:47:49.114 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T14:47:49.114 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T14:47:49.114 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T14:47:49.114 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T14:47:49.114 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-13T14:47:49.114 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-13T14:47:49.114 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T14:47:49.114 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-13T14:47:49.114 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-13T14:47:49.115 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-13T14:47:49.115 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T14:47:49.115 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-13T14:47:49.115 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T14:47:49.115 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-13T14:47:49.115 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-13T14:47:49.115 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-13T14:47:49.115 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T14:47:49.115 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T14:47:49.115 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-13T14:47:49.115 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-13T14:47:49.115 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-13T14:47:49.115 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-13T14:47:49.115 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-13T14:47:49.116 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-13T14:47:49.116 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-13T14:47:49.116 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T14:47:49.116 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-13T14:47:49.116 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-13T14:47:49.116 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-13T14:47:49.116 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-13T14:47:49.116 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-13T14:47:49.116 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-13T14:47:49.116 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-13T14:47:49.116 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-13T14:47:49.116 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-13T14:47:49.116 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-13T14:47:49.117 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T14:47:49.117 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T14:47:49.117 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T14:47:49.117 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T14:47:49.117 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T14:47:49.117 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T14:47:49.117 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T14:47:49.117 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T14:47:49.117 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T14:47:49.117 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T14:47:49.117 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T14:47:49.117 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T14:47:49.117 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-13T14:47:49.118 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-13T14:47:49.118 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T14:47:49.118 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-13T14:47:49.118 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T14:47:49.118 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T14:47:49.118 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T14:47:49.118 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T14:47:49.118 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T14:47:49.118 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T14:47:49.118 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T14:47:49.118 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T14:47:49.118 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T14:47:49.118 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T14:47:49.119 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T14:47:49.119 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-13T14:47:49.119 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-13T14:47:49.119 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-13T14:47:49.119 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-13T14:47:49.119 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-13T14:47:49.119 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-13T14:47:49.119 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-13T14:47:49.119 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-13T14:47:49.119 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-13T14:47:49.119 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-13T14:47:49.119 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-13T14:47:49.119 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-13T14:47:49.119 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-13T14:47:49.120 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-13T14:47:49.120 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-13T14:47:49.120 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-13T14:47:49.120 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-13T14:47:49.120 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-13T14:47:49.120 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-13T14:47:49.120 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-13T14:47:49.120 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-13T14:47:49.120 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-13T14:47:49.120 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-13T14:47:49.120 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-13T14:47:49.120 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-13T14:47:49.120 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-13T14:47:49.121 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-13T14:47:49.121 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-13T14:47:49.121 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-13T14:47:49.121 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-13T14:47:49.121 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T14:47:49.121 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T14:47:49.121 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-13T14:47:49.121 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-13T14:47:49.121 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T14:47:49.121 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T14:47:49.121 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T14:47:49.121 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T14:47:49.121 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-13T14:47:49.121 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T14:47:49.122 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T14:47:49.122 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-13T14:47:49.122 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-13T14:47:49.122 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-13T14:47:49.122 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T14:47:49.122 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T14:47:49.122 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-13T14:47:49.122 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-13T14:47:49.122 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-13T14:47:49.122 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T14:47:49.122 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-13T14:47:49.122 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-13T14:47:49.122 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-13T14:47:49.123 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T14:47:49.123 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T14:47:49.123 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T14:47:49.123 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T14:47:49.123 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T14:47:49.123 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T14:47:49.123 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T14:47:49.123 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T14:47:49.123 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T14:47:49.123 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T14:47:49.123 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T14:47:49.123 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T14:47:49.123 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T14:47:49.123 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-13T14:47:49.124 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T14:47:49.124 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T14:47:49.124 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T14:47:49.124 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-13T14:47:49.124 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T14:47:49.124 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-13T14:47:49.124 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-13T14:47:49.124 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-13T14:47:49.124 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-13T14:47:49.124 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-13T14:47:49.124 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T14:47:49.124 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-13T14:47:49.124 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T14:47:49.124 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-13T14:47:49.125 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T14:47:49.125 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T14:47:49.125 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T14:47:49.125 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T14:47:49.125 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-13T14:47:49.125 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T14:47:49.125 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T14:47:49.125 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T14:47:49.125 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T14:47:49.125 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T14:47:49.125 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-13T14:47:49.125 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T14:47:49.125 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-13T14:47:49.126 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-13T14:47:49.126 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-13T14:47:49.126 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-13T14:47:49.126 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T14:47:49.126 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-13T14:47:49.126 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T14:47:49.126 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T14:47:49.126 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T14:47:49.126 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T14:47:49.126 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T14:47:49.126 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-13T14:47:49.126 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T14:47:49.126 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T14:47:49.127 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-13T14:47:49.127 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T14:47:49.127 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T14:47:49.127 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-13T14:47:49.127 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-13T14:47:49.127 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T14:47:49.127 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-13T14:47:49.127 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T14:47:49.127 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T14:47:49.127 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-13T14:47:49.127 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T14:47:49.127 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-13T14:47:49.127 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T14:47:49.128 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-13T14:47:49.128 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T14:47:49.128 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-13T14:47:49.128 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T14:47:49.128 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T14:47:49.128 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-13T14:47:49.128 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T14:47:49.128 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-13T14:47:49.128 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-13T14:47:49.128 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T14:47:49.128 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-13T14:47:49.128 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T14:47:49.128 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T14:47:49.128 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T14:47:49.129 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T14:47:49.129 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-13T14:47:49.129 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T14:47:49.129 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T14:47:49.129 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-13T14:47:49.129 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T14:47:49.129 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T14:47:49.129 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-13T14:47:49.129 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-13T14:47:49.129 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T14:47:49.129 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T14:47:49.129 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T14:47:49.129 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T14:47:49.129 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-13T14:47:49.130 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T14:47:49.130 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T14:47:49.130 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T14:47:49.130 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-13T14:47:49.130 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T14:47:49.130 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T14:47:49.130 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T14:47:49.130 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-13T14:47:49.130 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T14:47:49.130 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T14:47:49.130 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T14:47:49.130 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-13T14:47:49.130 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T14:47:49.161 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-13T14:47:49.162 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T14:47:49.162 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-13T14:47:49.162 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T14:47:49.162 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T14:47:49.162 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T14:47:49.162 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T14:47:49.162 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-13T14:47:49.162 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T14:47:49.162 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-13T14:47:49.162 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T14:47:49.162 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T14:47:49.162 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-13T14:47:49.162 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-13T14:47:49.163 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-13T14:47:49.163 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-13T14:47:49.163 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-13T14:47:49.163 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-13T14:47:49.163 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T14:47:49.163 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T14:47:49.163 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-13T14:47:49.163 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T14:47:49.163 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-13T14:47:49.163 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T14:47:49.163 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T14:47:49.163 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-13T14:47:49.163 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T14:47:49.163 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-13T14:47:49.164 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T14:47:49.164 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T14:47:49.164 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T14:47:49.164 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T14:47:49.164 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T14:47:49.164 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T14:47:49.164 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T14:47:49.164 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T14:47:49.164 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T14:47:49.164 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T14:47:49.164 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-13T14:47:49.164 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T14:47:49.164 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T14:47:49.165 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T14:47:49.165 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T14:47:49.165 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-13T14:47:49.165 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-13T14:47:49.165 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T14:47:49.165 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-13T14:47:49.165 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-13T14:47:49.165 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T14:47:49.165 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-13T14:47:49.165 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T14:47:49.165 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T14:47:49.165 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T14:47:49.165 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T14:47:49.166 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T14:47:49.166 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T14:47:49.166 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-13T14:47:49.166 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T14:47:49.166 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-13T14:47:49.166 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-13T14:47:49.166 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-13T14:47:49.166 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T14:47:49.166 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T14:47:49.166 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T14:47:49.166 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T14:47:49.166 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T14:47:49.166 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T14:47:49.166 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T14:47:49.167 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T14:47:49.167 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T14:47:49.167 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T14:47:49.167 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T14:47:49.167 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T14:47:49.167 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T14:47:49.167 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T14:47:49.167 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T14:47:49.167 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-13T14:47:49.167 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T14:47:49.167 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T14:47:49.167 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T14:47:49.167 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-13T14:47:49.167 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-13T14:47:49.168 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T14:47:49.168 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-13T14:47:49.168 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-13T14:47:49.168 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T14:47:49.168 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T14:47:49.168 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T14:47:49.168 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-13T14:47:49.168 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-13T14:47:49.168 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-13T14:47:49.168 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T14:47:49.168 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-13T14:47:49.168 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-13T14:47:49.168 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T14:47:49.169 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-13T14:47:49.169 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-13T14:47:49.169 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T14:47:49.169 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-13T14:47:49.169 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-13T14:47:49.169 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-13T14:47:49.169 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-13T14:47:49.169 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-13T14:47:49.169 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T14:47:49.169 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-13T14:47:49.169 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T14:47:49.169 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-13T14:47:49.169 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-13T14:47:49.169 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T14:47:49.170 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T14:47:49.170 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T14:47:49.170 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-13T14:47:49.170 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-13T14:47:49.170 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-13T14:47:49.170 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T14:47:49.170 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-13T14:47:49.170 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T14:47:49.170 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-13T14:47:49.170 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-13T14:47:49.170 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-13T14:47:49.170 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-13T14:47:49.170 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-13T14:47:49.171 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-13T14:47:49.171 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-13T14:47:49.171 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-13T14:47:49.171 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-13T14:47:49.171 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-13T14:47:49.171 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T14:47:49.171 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T14:47:49.171 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T14:47:49.171 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T14:47:49.171 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-13T14:47:49.171 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-13T14:47:49.171 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-13T14:47:49.171 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-13T14:47:49.172 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-13T14:47:49.172 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-13T14:47:49.172 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-13T14:47:49.172 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-13T14:47:49.172 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-13T14:47:49.172 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-13T14:47:49.172 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-13T14:47:49.172 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-13T14:47:49.172 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-13T14:47:49.172 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-13T14:47:49.172 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-13T14:47:49.172 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-13T14:47:49.172 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-13T14:47:49.173 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-13T14:47:49.173 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-13T14:47:49.173 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-13T14:47:49.173 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-13T14:47:49.173 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-13T14:47:49.173 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-13T14:47:49.173 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-13T14:47:49.173 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-13T14:47:49.173 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-13T14:47:49.173 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-13T14:47:49.173 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-13T14:47:49.173 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-13T14:47:49.173 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-13T14:47:49.174 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-13T14:47:49.174 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-13T14:47:49.174 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-13T14:47:49.174 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-13T14:47:49.174 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-13T14:47:49.174 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-13T14:47:49.174 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-13T14:47:49.174 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-13T14:47:49.174 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-13T14:47:49.174 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-13T14:47:49.174 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-13T14:47:49.174 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-13T14:47:49.174 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-13T14:47:49.174 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-13T14:47:49.175 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-13T14:47:49.175 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-13T14:47:49.175 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-13T14:47:49.175 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-13T14:47:49.175 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-13T14:47:49.175 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-13T14:47:49.175 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-13T14:47:49.175 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-13T14:47:49.175 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-13T14:47:49.175 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-13T14:47:49.175 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-13T14:47:49.175 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-13T14:47:49.175 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-13T14:47:49.176 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-13T14:47:49.176 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-13T14:47:49.176 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-13T14:47:49.176 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-13T14:47:49.176 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-13T14:47:49.176 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-13T14:47:49.176 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T14:47:49.176 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-13T14:47:49.176 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-13T14:47:49.176 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-13T14:47:49.176 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-13T14:47:49.176 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T14:47:49.176 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T14:47:49.176 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-13T14:47:49.177 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T14:47:49.177 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T14:47:49.177 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-13T14:47:49.177 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-13T14:47:49.177 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-13T14:47:49.177 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T14:47:49.177 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T14:47:49.177 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T14:47:49.177 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T14:47:49.177 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T14:47:49.177 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T14:47:49.177 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T14:47:49.177 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T14:47:49.177 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-13T14:47:49.178 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-13T14:47:49.178 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T14:47:49.178 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T14:47:49.178 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T14:47:49.178 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T14:47:49.178 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T14:47:49.178 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-13T14:47:49.178 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T14:47:49.178 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T14:47:49.178 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-13T14:47:49.178 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-13T14:47:49.178 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-13T14:47:49.178 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-13T14:47:49.179 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-13T14:47:49.179 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T14:47:49.179 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-13T14:47:49.179 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-13T14:47:49.179 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-13T14:47:49.179 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-13T14:47:49.179 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T14:47:49.179 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T14:47:49.179 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T14:47:49.179 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T14:47:49.179 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T14:47:49.179 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T14:47:49.179 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T14:47:49.180 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T14:47:49.180 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T14:47:49.180 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-13T14:47:49.180 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T14:47:49.180 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T14:47:49.180 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T14:47:49.180 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T14:47:49.180 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T14:47:49.180 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T14:47:49.180 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T14:47:49.180 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T14:47:49.180 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T14:47:49.180 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T14:47:49.181 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T14:47:49.181 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T14:47:49.181 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T14:47:49.181 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-13T14:47:49.181 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T14:47:49.181 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T14:47:49.181 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-13T14:47:49.181 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T14:47:49.181 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T14:47:49.181 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T14:47:49.181 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T14:47:49.181 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T14:47:49.181 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T14:47:49.182 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T14:47:49.182 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T14:47:49.182 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T14:47:49.182 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T14:47:49.182 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T14:47:49.182 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T14:47:49.182 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T14:47:49.182 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T14:47:49.182 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T14:47:49.182 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T14:47:49.182 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T14:47:49.182 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T14:47:49.182 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-13T14:47:49.183 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T14:47:49.183 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T14:47:49.183 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-13T14:47:49.183 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T14:47:49.183 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-13T14:47:49.183 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T14:47:49.183 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T14:47:49.183 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T14:47:49.183 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T14:47:49.183 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T14:47:49.183 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T14:47:49.183 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T14:47:49.183 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T14:47:49.183 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T14:47:49.184 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T14:47:49.184 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T14:47:49.184 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T14:47:49.184 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T14:47:49.184 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T14:47:49.184 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T14:47:49.184 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-13T14:47:49.184 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T14:47:49.184 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T14:47:49.184 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T14:47:49.184 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-13T14:47:49.184 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-13T14:47:49.184 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T14:47:49.185 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T14:47:49.185 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T14:47:49.185 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T14:47:49.185 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-13T14:47:49.185 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T14:47:49.185 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T14:47:49.185 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T14:47:49.185 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T14:47:49.185 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-13T14:47:49.185 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-13T14:47:49.185 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-13T14:47:49.185 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-13T14:47:49.185 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-13T14:47:49.185 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-13T14:47:49.186 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-13T14:47:49.186 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T14:47:49.186 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-13T14:47:49.186 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-13T14:47:49.186 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-13T14:47:49.186 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-13T14:47:49.186 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-13T14:47:49.186 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-13T14:47:49.186 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T14:47:49.186 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-13T14:47:49.186 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-13T14:47:49.186 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-13T14:47:49.187 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-13T14:47:49.187 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-13T14:47:49.187 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-13T14:47:49.187 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T14:47:49.187 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-13T14:47:49.187 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-13T14:47:49.187 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-13T14:47:49.187 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T14:47:49.187 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T14:47:49.187 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-13T14:47:49.187 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-13T14:47:49.187 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-13T14:47:49.187 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T14:47:49.187 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T14:47:49.187 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T14:47:49.188 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T14:47:49.188 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T14:47:49.188 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T14:47:49.188 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T14:47:49.188 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T14:47:49.188 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T14:47:49.188 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T14:47:49.188 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T14:47:49.188 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T14:47:49.188 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-13T14:47:49.188 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-13T14:47:49.188 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-13T14:47:49.189 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T14:47:49.189 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T14:47:49.189 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-13T14:47:49.189 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-13T14:47:49.189 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-13T14:47:49.189 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-13T14:47:49.189 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-13T14:47:49.189 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-13T14:47:49.189 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T14:47:49.189 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T14:47:49.189 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T14:47:49.189 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T14:47:49.189 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T14:47:49.190 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T14:47:49.190 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T14:47:49.190 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T14:47:49.190 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T14:47:49.190 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T14:47:49.190 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-13T14:47:49.190 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T14:47:49.190 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-13T14:47:49.190 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-13T14:47:49.190 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T14:47:49.190 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-13T14:47:49.190 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-13T14:47:49.190 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T14:47:49.190 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T14:47:49.191 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-13T14:47:49.191 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-13T14:47:49.191 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-13T14:47:49.191 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T14:47:49.191 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-13T14:47:49.191 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T14:47:49.191 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-13T14:47:49.191 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T14:47:49.191 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T14:47:49.191 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-13T14:47:49.191 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T14:47:49.191 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T14:47:49.191 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T14:47:49.191 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T14:47:49.192 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-13T14:47:49.192 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T14:47:49.192 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-13T14:47:49.192 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-13T14:47:49.192 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T14:47:49.192 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-13T14:47:49.192 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T14:47:49.192 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T14:47:49.192 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T14:47:49.192 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-13T14:47:49.192 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T14:47:49.192 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T14:47:49.192 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-13T14:47:49.193 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-13T14:47:49.193 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T14:47:49.193 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-13T14:47:49.193 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-13T14:47:49.193 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T14:47:49.193 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-13T14:47:49.193 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-13T14:47:49.193 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-13T14:47:49.193 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T14:47:49.193 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-13T14:47:49.193 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-13T14:47:49.193 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-13T14:47:49.193 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-13T14:47:49.194 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-13T14:47:49.194 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T14:47:49.194 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-13T14:47:49.194 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-13T14:47:49.194 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T14:47:49.194 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-13T14:47:49.194 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T14:47:49.202 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-13T14:47:49.202 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T14:47:49.202 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-13T14:47:49.202 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T14:47:49.202 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-13T14:47:49.202 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T14:47:49.202 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-13T14:47:49.202 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-13T14:47:49.202 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-13T14:47:49.202 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T14:47:49.202 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-13T14:47:49.203 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T14:47:49.203 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-13T14:47:49.203 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-13T14:47:49.203 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-13T14:47:49.203 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T14:47:49.203 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-13T14:47:49.203 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T14:47:49.203 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-13T14:47:49.203 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-13T14:47:49.203 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-13T14:47:49.203 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T14:47:49.203 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-13T14:47:49.204 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T14:47:49.204 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-13T14:47:49.204 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T14:47:49.204 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-13T14:47:49.204 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T14:47:49.204 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-13T14:47:49.204 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-13T14:47:49.204 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-13T14:47:49.204 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T14:47:49.204 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-13T14:47:49.204 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T14:47:49.204 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-13T14:47:49.204 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T14:47:49.204 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-13T14:47:49.205 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T14:47:49.205 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-13T14:47:49.205 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T14:47:49.205 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-13T14:47:49.205 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-13T14:47:49.205 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T14:47:49.205 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-13T14:47:49.205 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T14:47:49.205 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-13T14:47:49.205 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T14:47:49.205 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T14:47:49.205 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-13T14:47:49.205 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T14:47:49.206 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T14:47:49.206 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-13T14:47:49.206 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T14:47:49.206 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T14:47:49.206 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-13T14:47:49.206 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T14:47:49.206 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-13T14:47:49.206 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T14:47:49.206 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-13T14:47:49.206 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T14:47:49.206 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T14:47:49.206 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T14:47:49.206 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T14:47:49.206 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T14:47:49.206 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T14:47:49.207 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T14:47:49.207 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T14:47:49.207 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T14:47:49.207 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T14:47:49.207 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T14:47:49.207 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-13T14:47:49.207 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T14:47:49.207 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T14:47:49.207 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T14:47:49.207 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T14:47:49.207 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T14:47:49.207 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T14:47:49.207 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T14:47:49.207 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T14:47:49.207 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T14:47:49.208 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T14:47:49.208 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T14:47:49.208 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T14:47:49.208 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T14:47:49.208 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T14:47:49.208 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T14:47:49.208 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T14:47:49.208 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T14:47:49.208 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T14:47:49.208 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T14:47:49.208 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T14:47:49.208 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T14:47:49.208 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T14:47:49.208 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T14:47:49.209 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T14:47:49.209 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T14:47:49.209 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T14:47:49.209 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T14:47:49.209 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T14:47:49.209 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T14:47:49.209 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T14:47:49.209 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T14:47:49.209 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T14:47:49.209 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T14:47:49.209 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T14:47:49.209 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T14:47:49.209 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T14:47:49.209 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T14:47:49.210 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T14:47:49.210 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T14:47:49.210 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-13T14:47:49.210 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-13T14:47:49.210 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-13T14:47:49.210 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-13T14:47:49.210 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T14:47:49.210 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-13T14:47:49.210 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T14:47:49.210 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-13T14:47:49.210 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T14:47:49.210 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T14:47:49.210 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T14:47:49.210 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T14:47:49.211 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T14:47:49.211 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-13T14:47:49.211 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-13T14:47:49.211 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-13T14:47:49.211 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T14:47:49.211 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-13T14:47:49.211 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T14:47:49.211 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-13T14:47:49.211 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-13T14:47:49.211 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-13T14:47:49.211 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-13T14:47:49.211 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-13T14:47:49.211 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-13T14:47:49.211 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-13T14:47:49.211 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-13T14:47:49.212 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-13T14:47:49.212 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T14:47:49.213 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-13T14:47:49.213 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T14:47:49.213 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-13T14:47:49.213 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-13T14:47:49.213 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T14:47:49.213 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-13T14:47:49.213 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T14:47:49.213 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T14:47:49.213 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-13T14:47:49.213 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T14:47:49.213 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-13T14:47:49.213 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T14:47:49.213 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-13T14:47:49.214 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T14:47:49.214 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-13T14:47:49.214 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T14:47:49.214 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-13T14:47:49.214 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T14:47:49.219 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-13T14:47:49.219 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-13T14:47:49.219 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-13T14:47:49.220 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-13T14:47:49.220 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-13T14:47:49.220 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T14:47:49.220 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-13T14:47:49.220 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T14:47:49.220 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-13T14:47:49.220 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T14:47:49.220 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-13T14:47:49.220 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T14:47:49.220 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T14:47:49.220 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-13T14:47:49.220 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T14:47:49.220 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T14:47:49.220 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-13T14:47:49.221 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T14:47:49.221 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T14:47:49.221 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-13T14:47:49.221 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T14:47:49.221 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-13T14:47:49.221 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-13T14:47:49.221 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-13T14:47:49.221 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-13T14:47:49.221 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-13T14:47:49.221 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T14:47:49.221 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-13T14:47:49.221 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-13T14:47:49.221 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T14:47:49.221 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-13T14:47:49.222 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-13T14:47:49.224 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-13T14:47:49.224 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-13T14:47:49.224 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T14:47:49.225 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T14:47:49.225 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T14:47:49.225 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-13T14:47:49.225 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-13T14:47:49.225 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-13T14:47:49.225 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T14:47:49.225 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-13T14:47:49.225 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-13T14:47:49.225 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T14:47:49.225 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T14:47:49.225 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T14:47:49.225 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T14:47:49.225 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T14:47:49.225 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T14:47:49.226 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T14:47:49.226 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T14:47:49.226 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-13T14:47:49.226 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T14:47:49.226 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T14:47:49.226 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T14:47:49.226 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T14:47:49.226 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T14:47:49.226 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-13T14:47:49.226 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T14:47:49.226 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-13T14:47:49.226 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T14:47:49.226 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T14:47:49.226 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T14:47:49.226 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T14:47:49.227 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-13T14:47:49.227 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T14:47:49.229 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-13T14:47:49.229 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T14:47:49.229 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T14:47:49.229 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-13T14:47:49.229 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T14:47:49.229 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T14:47:49.229 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T14:47:49.229 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T14:47:49.229 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T14:47:49.229 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T14:47:49.229 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T14:47:49.229 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T14:47:49.229 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T14:47:49.230 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T14:47:49.230 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T14:47:49.230 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T14:47:49.230 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T14:47:49.230 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T14:47:49.230 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T14:47:49.230 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T14:47:49.230 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T14:47:49.230 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T14:47:49.230 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T14:47:49.230 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T14:47:49.230 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T14:47:49.230 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T14:47:49.231 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T14:47:49.231 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-13T14:47:49.231 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T14:47:49.241 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-13T14:47:49.241 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T14:47:49.241 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-13T14:47:49.241 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T14:47:49.241 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T14:47:49.241 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T14:47:49.241 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T14:47:49.241 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-13T14:47:49.241 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T14:47:49.241 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T14:47:49.241 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T14:47:49.241 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T14:47:49.242 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T14:47:49.242 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-13T14:47:49.242 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-13T14:47:49.242 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-13T14:47:49.242 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-13T14:47:49.242 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T14:47:49.242 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T14:47:49.242 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T14:47:49.242 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-13T14:47:49.242 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T14:47:49.242 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T14:47:49.242 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T14:47:49.242 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T14:47:49.242 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T14:47:49.243 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T14:47:49.243 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T14:47:49.243 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T14:47:49.243 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T14:47:49.243 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T14:47:49.243 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-13T14:47:49.243 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T14:47:49.243 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T14:47:49.243 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T14:47:49.243 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-13T14:47:49.243 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T14:47:49.243 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-13T14:47:49.244 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T14:47:49.244 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T14:47:49.244 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T14:47:49.244 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-13T14:47:49.244 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T14:47:49.244 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T14:47:49.244 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T14:47:49.244 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T14:47:49.244 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T14:47:49.244 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T14:47:49.244 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T14:47:49.244 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T14:47:49.244 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T14:47:49.245 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-13T14:47:49.245 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T14:47:49.245 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T14:47:49.245 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T14:47:49.245 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T14:47:49.245 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T14:47:49.245 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T14:47:49.245 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T14:47:49.245 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T14:47:49.245 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T14:47:49.245 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T14:47:49.245 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T14:47:49.246 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T14:47:49.246 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T14:47:49.246 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T14:47:49.246 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T14:47:49.246 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T14:47:49.246 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T14:47:49.246 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T14:47:49.246 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T14:47:49.246 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T14:47:49.246 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T14:47:49.246 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T14:47:49.246 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-13T14:47:49.246 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T14:47:49.246 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T14:47:49.247 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T14:47:49.247 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-13T14:47:49.247 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T14:47:49.247 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T14:47:49.247 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T14:47:49.247 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T14:47:49.247 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-13T14:47:49.247 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-13T14:47:49.247 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T14:47:49.247 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-13T14:47:49.247 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T14:47:49.247 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T14:47:49.247 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T14:47:49.247 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T14:47:49.248 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T14:47:49.248 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T14:47:49.248 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T14:47:49.248 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T14:47:49.248 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T14:47:49.248 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T14:47:49.248 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T14:47:49.248 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T14:47:49.248 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T14:47:49.248 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T14:47:49.248 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T14:47:49.248 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T14:47:49.248 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T14:47:49.248 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T14:47:49.249 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T14:47:49.249 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T14:47:49.249 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T14:47:49.249 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T14:47:49.249 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T14:47:49.249 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T14:47:49.249 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T14:47:49.249 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T14:47:49.249 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-13T14:47:49.249 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T14:47:49.249 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-13T14:47:49.249 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T14:47:49.249 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T14:47:49.250 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T14:47:49.250 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T14:47:49.250 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T14:47:49.250 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T14:47:49.250 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T14:47:49.250 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-13T14:47:49.250 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-13T14:47:49.250 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-13T14:47:49.250 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T14:47:49.250 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-13T14:47:49.250 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-13T14:47:49.250 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T14:47:49.250 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-13T14:47:49.250 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T14:47:49.251 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-13T14:47:49.251 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-13T14:47:49.251 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T14:47:49.251 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T14:47:49.251 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T14:47:49.251 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T14:47:49.251 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T14:47:49.251 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T14:47:49.251 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T14:47:49.251 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T14:47:49.251 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T14:47:49.252 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T14:47:49.252 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T14:47:49.252 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T14:47:49.252 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T14:47:49.252 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T14:47:49.252 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T14:47:49.267 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T14:47:49.267 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-13T14:47:49.267 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T14:47:49.267 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T14:47:49.267 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T14:47:49.267 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T14:47:49.268 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T14:47:49.268 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T14:47:49.268 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T14:47:49.268 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T14:47:49.268 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T14:47:49.268 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T14:47:49.268 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T14:47:49.268 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T14:47:49.268 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T14:47:49.268 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T14:47:49.268 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T14:47:49.268 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T14:47:49.268 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T14:47:49.269 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T14:47:49.269 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T14:47:49.269 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T14:47:49.269 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T14:47:49.269 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T14:47:49.269 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T14:47:49.269 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T14:47:49.269 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T14:47:49.269 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T14:47:49.269 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T14:47:49.269 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T14:47:49.270 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T14:47:49.270 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T14:47:49.270 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T14:47:49.270 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T14:47:49.270 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T14:47:49.270 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T14:47:49.270 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T14:47:49.270 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T14:47:49.270 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T14:47:49.270 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T14:47:49.270 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T14:47:49.270 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T14:47:49.270 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T14:47:49.271 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T14:47:49.271 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-13T14:47:49.271 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T14:47:49.271 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T14:47:49.271 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T14:47:49.271 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T14:47:49.271 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T14:47:49.271 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T14:47:49.271 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T14:47:49.271 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T14:47:49.271 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T14:47:49.271 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T14:47:49.271 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T14:47:49.272 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T14:47:49.272 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T14:47:49.272 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T14:47:49.272 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T14:47:49.272 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-13T14:47:49.272 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T14:47:49.272 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T14:47:49.272 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T14:47:49.272 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T14:47:49.272 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T14:47:49.272 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-13T14:47:49.272 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-13T14:47:49.272 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-13T14:47:49.273 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T14:47:49.273 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T14:47:49.273 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T14:47:49.273 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T14:47:49.273 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T14:47:49.273 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T14:47:49.273 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T14:47:49.273 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T14:47:49.273 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T14:47:49.273 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T14:47:49.273 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T14:47:49.273 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T14:47:49.273 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T14:47:49.274 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T14:47:49.274 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T14:47:49.274 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T14:47:49.274 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T14:47:49.274 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T14:47:49.274 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T14:47:49.274 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T14:47:49.274 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T14:47:49.274 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T14:47:49.274 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T14:47:49.274 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T14:47:49.274 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T14:47:49.274 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T14:47:49.274 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T14:47:49.275 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T14:47:49.275 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T14:47:49.275 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T14:47:49.275 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T14:47:49.275 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T14:47:49.275 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T14:47:49.275 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T14:47:49.275 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T14:47:49.275 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T14:47:49.275 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T14:47:49.275 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T14:47:49.275 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T14:47:49.275 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T14:47:49.275 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T14:47:49.276 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T14:47:49.276 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T14:47:49.276 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T14:47:49.276 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T14:47:49.276 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T14:47:49.276 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T14:47:49.276 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T14:47:49.276 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T14:47:49.276 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T14:47:49.276 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T14:47:49.276 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T14:47:49.276 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T14:47:49.276 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T14:47:49.276 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T14:47:49.277 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T14:47:49.277 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T14:47:49.277 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T14:47:49.277 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T14:47:49.277 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T14:47:49.277 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T14:47:49.277 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T14:47:49.277 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T14:47:49.277 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T14:47:49.277 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T14:47:49.277 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T14:47:49.277 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T14:47:49.277 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T14:47:49.278 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T14:47:49.278 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-13T14:47:49.278 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T14:47:49.278 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T14:47:49.278 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-13T14:47:49.278 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T14:47:49.278 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-13T14:47:49.278 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T14:47:49.278 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-13T14:47:49.278 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T14:47:49.278 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T14:47:49.278 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T14:47:49.278 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T14:47:49.278 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-13T14:47:49.279 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T14:47:49.279 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-13T14:47:49.279 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-13T14:47:49.279 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-13T14:47:49.279 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-13T14:47:49.279 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T14:47:49.279 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T14:47:49.279 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T14:47:49.279 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-13T14:47:49.279 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-13T14:47:49.279 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-13T14:47:49.279 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T14:47:49.279 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T14:47:49.280 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T14:47:49.280 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T14:47:49.280 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T14:47:49.280 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T14:47:49.280 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T14:47:49.280 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T14:47:49.280 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T14:47:49.280 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T14:47:49.280 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T14:47:49.280 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-13T14:47:49.280 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T14:47:49.280 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T14:47:49.280 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T14:47:49.280 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T14:47:49.281 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T14:47:49.281 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T14:47:49.281 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T14:47:49.281 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T14:47:49.281 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T14:47:49.281 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T14:47:49.281 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T14:47:49.281 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T14:47:49.281 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T14:47:49.281 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T14:47:49.281 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-13T14:47:49.281 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T14:47:49.282 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T14:47:49.282 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T14:47:49.282 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T14:47:49.282 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T14:47:49.282 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T14:47:49.282 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T14:47:49.282 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T14:47:49.282 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T14:47:49.282 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T14:47:49.283 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T14:47:49.284 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T14:47:49.284 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T14:47:49.284 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T14:47:49.284 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T14:47:49.284 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T14:47:49.284 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T14:47:49.284 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T14:47:49.284 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-13T14:47:49.284 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T14:47:49.284 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T14:47:49.284 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-13T14:47:49.285 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-13T14:47:49.285 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T14:47:49.285 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T14:47:49.285 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T14:47:49.285 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-13T14:47:49.285 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T14:47:49.285 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-13T14:47:49.285 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T14:47:49.285 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T14:47:49.285 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-13T14:47:49.285 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T14:47:49.285 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-13T14:47:49.285 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T14:47:49.285 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T14:47:49.286 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T14:47:49.286 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T14:47:49.286 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T14:47:49.286 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-13T14:47:49.286 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-13T14:47:49.286 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-13T14:47:49.286 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-13T14:47:49.286 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T14:47:49.286 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-13T14:47:49.286 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T14:47:49.288 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T14:47:49.288 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T14:47:49.288 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T14:47:49.288 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T14:47:49.288 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T14:47:49.288 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T14:47:49.288 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T14:47:49.288 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T14:47:49.289 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T14:47:49.289 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T14:47:49.289 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T14:47:49.289 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T14:47:49.289 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-13T14:47:49.289 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-13T14:47:49.289 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-13T14:47:49.289 INFO:teuthology.orchestra.run.smithi007.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-13T14:47:49.289 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-13T14:47:49.289 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-13T14:47:49.295 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:47:49.295 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:47:49.295 DEBUG:teuthology.orchestra.run.smithi007:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-13T14:47:49.335 INFO:teuthology.orchestra.run.smithi007.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-13T14:47:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-13T14:47:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-13T14:47:49.336 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-13T14:47:49.336 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:47:49.336 DEBUG:teuthology.orchestra.run.smithi007:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-13T14:47:49.379 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi007.front.sepia.ceph.com to complete... 2024-09-13T14:47:49.843 INFO:teuthology.orchestra.run.smithi007.stderr:Sourcing file `/etc/default/grub' 2024-09-13T14:47:49.843 INFO:teuthology.orchestra.run.smithi007.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T14:47:49.847 INFO:teuthology.orchestra.run.smithi007.stderr:Generating grub configuration file ... 2024-09-13T14:47:50.011 INFO:teuthology.orchestra.run.smithi007.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:47:50.017 INFO:teuthology.orchestra.run.smithi007.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:47:50.300 INFO:teuthology.orchestra.run.smithi007.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-13T14:47:50.305 INFO:teuthology.orchestra.run.smithi007.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-13T14:47:50.351 INFO:teuthology.orchestra.run.smithi007.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-13T14:47:50.356 INFO:teuthology.orchestra.run.smithi007.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-13T14:47:50.541 INFO:teuthology.orchestra.run.smithi007.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-13T14:47:50.542 INFO:teuthology.orchestra.run.smithi007.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-13T14:47:50.542 INFO:teuthology.orchestra.run.smithi007.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-13T14:47:50.556 INFO:teuthology.orchestra.run.smithi007.stderr:done 2024-09-13T14:48:21.689 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-13T14:48:21.690 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-13T14:48:21.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T14:48:40.253 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-09-13T14:48:49.254 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-13T14:48:49.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T14:48:52.317 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-09-13T14:49:04.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-13T14:49:04.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T14:49:36.103 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-13T14:49:36.850 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-13T14:49:36.850 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T14:49:36.850 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-13T14:49:36.898 INFO:teuthology.orchestra.run.smithi007.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:49:36.899 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T14:49:36.899 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T14:49:36.899 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T14:49:37.900 DEBUG:teuthology.parallel:result is None 2024-09-13T14:49:37.900 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T14:49:37.908 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T14:49:37.908 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T14:49:37.911 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T14:49:37.918 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T14:49:37.924 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T14:49:37.934 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T14:49:37.934 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T14:49:37.961 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T14:49:37.987 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T14:49:37.993 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T14:49:37.993 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T14:49:38.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T14:49:38.020 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T14:49:38.025 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T14:49:38.083 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T14:49:38.100 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T14:49:38.115 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T14:49:38.133 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T14:49:38.136 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T14:49:38.143 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T14:49:38.143 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T14:49:38.146 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T14:49:38.165 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T14:49:38.174 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T14:49:38.174 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T14:49:38.214 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T14:49:38.220 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T14:49:38.276 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T14:49:38.328 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T14:49:38.329 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T14:49:38.414 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T14:49:38.420 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T14:49:38.469 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T14:49:38.469 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T14:49:38.542 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2024-09-13T14:49:38.546 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2024-09-13T14:49:38.671 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T14:49:38.679 INFO:teuthology.task.internal:Starting timer... 2024-09-13T14:49:38.679 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T14:49:38.692 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T14:49:38.704 DEBUG:teuthology.task.selinux:Excluding smithi007: OS 'ubuntu' does not support SELinux 2024-09-13T14:49:38.705 DEBUG:teuthology.task.selinux:Excluding smithi077: OS 'ubuntu' does not support SELinux 2024-09-13T14:49:38.705 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T14:49:38.705 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T14:49:38.705 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T14:49:38.705 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T14:49:38.714 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T14:49:38.726 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T14:49:38.727 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi077.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T14:58:01.729 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi077.front.sepia.ceph.com')] 2024-09-13T14:58:01.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-13T14:58:01.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T14:58:01.837 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-13T14:58:01.979 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-13T14:58:01.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-13T14:58:01.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T14:58:02.083 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-09-13T14:58:02.189 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-13T14:58:02.189 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T14:58:02.200 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T14:58:02.200 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T14:58:02.200 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T14:58:02.204 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T14:58:02.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T14:58:02.242 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T14:58:02.243 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: Command line: ntpd -gq 2024-09-13T14:58:02.243 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: ---------------------------------------------------- 2024-09-13T14:58:02.243 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T14:58:02.243 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T14:58:02.244 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: corporation. Support and training for ntp-4 are 2024-09-13T14:58:02.244 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: available at https://www.nwtime.org/support 2024-09-13T14:58:02.244 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: ---------------------------------------------------- 2024-09-13T14:58:02.244 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: proto: precision = 0.044 usec (-24) 2024-09-13T14:58:02.245 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: basedate set to 2022-02-04 2024-09-13T14:58:02.245 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: gps base set to 2022-02-06 (week 2196) 2024-09-13T14:58:02.245 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T14:58:02.245 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T14:58:02.246 INFO:teuthology.orchestra.run.smithi007.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T14:58:02.246 INFO:teuthology.orchestra.run.smithi007.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T14:58:02.248 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T14:58:02.248 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T14:58:02.248 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T14:58:02.248 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: Listen normally on 3 ens1f0 172.21.15.7:123 2024-09-13T14:58:02.248 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: Listen normally on 4 lo [::1]:123 2024-09-13T14:58:02.248 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:15ea%4]:123 2024-09-13T14:58:02.248 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:02 ntpd[18386]: Listening on routing socket on fd #22 for interface updates 2024-09-13T14:58:02.260 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-13T14:58:02.260 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: Command line: ntpd -gq 2024-09-13T14:58:02.261 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: ---------------------------------------------------- 2024-09-13T14:58:02.261 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: ntp-4 is maintained by Network Time Foundation, 2024-09-13T14:58:02.261 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-13T14:58:02.261 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: corporation. Support and training for ntp-4 are 2024-09-13T14:58:02.261 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: available at https://www.nwtime.org/support 2024-09-13T14:58:02.261 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: ---------------------------------------------------- 2024-09-13T14:58:02.262 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: proto: precision = 0.044 usec (-24) 2024-09-13T14:58:02.262 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: basedate set to 2022-02-04 2024-09-13T14:58:02.262 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: gps base set to 2022-02-06 (week 2196) 2024-09-13T14:58:02.262 INFO:teuthology.orchestra.run.smithi077.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T14:58:02.263 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T14:58:02.263 INFO:teuthology.orchestra.run.smithi077.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T14:58:02.264 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T14:58:02.265 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T14:58:02.265 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T14:58:02.265 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T14:58:02.265 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: Listen normally on 3 enp3s0f1 172.21.15.77:123 2024-09-13T14:58:02.265 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: Listen normally on 4 lo [::1]:123 2024-09-13T14:58:02.265 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3d3%5]:123 2024-09-13T14:58:02.265 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:02 ntpd[18905]: Listening on routing socket on fd #22 for interface updates 2024-09-13T14:58:03.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:03 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:03.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:03 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:03.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:03 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:03.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:03 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:03.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:03 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:03.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:03 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:03.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:03 ntpd[18386]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T14:58:03.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:03 ntpd[18386]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T14:58:03.261 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:03 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:03.261 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:03 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:03.261 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:03 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:03.261 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:03 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:03.261 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:03 ntpd[18905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T14:58:03.261 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:03 ntpd[18905]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T14:58:05.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:05.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:05.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:05.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:05.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:05.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:05.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:05.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:05.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T14:58:05.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T14:58:05.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:05.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:05.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T14:58:05.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T14:58:05.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:05.243 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:05.243 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T14:58:05.243 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:05 ntpd[18386]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T14:58:05.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:05 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:05.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:05 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:05.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:05 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:05.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:05 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:05.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:05 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:05.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:05 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:05.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:05 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:05.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:05 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:05.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:05 ntpd[18905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T14:58:05.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:05 ntpd[18905]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T14:58:05.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:05 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:05.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:05 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:05.263 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:05 ntpd[18905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T14:58:05.263 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:05 ntpd[18905]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T14:58:07.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:07.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:07.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:07.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:07.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:07.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T14:58:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T14:58:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T14:58:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T14:58:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T14:58:07.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:07 ntpd[18386]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T14:58:07.265 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:07.265 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:07.265 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:07.265 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:07.265 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:07.266 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:07.266 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:07.266 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:07.266 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T14:58:07.266 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T14:58:07.266 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:07.266 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:07.266 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T14:58:07.266 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T14:58:07.266 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:07.266 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:07.266 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T14:58:07.266 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:07 ntpd[18905]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T14:58:09.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:09 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:09.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:09 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:09.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:09 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:09.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:09 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:09.241 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:09 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:09.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:09 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:09.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:09 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:09.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:09 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:09.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:09 ntpd[18386]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T14:58:09.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:09 ntpd[18386]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T14:58:09.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:09 ntpd[18386]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:09.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:09 ntpd[18386]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:09.242 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:09 ntpd[18386]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T14:58:09.242 INFO:teuthology.orchestra.run.smithi007.stdout:13 Sep 14:58:09 ntpd[18386]: ntpd: time slew -0.000570 s 2024-09-13T14:58:09.243 INFO:teuthology.orchestra.run.smithi007.stdout:ntpd: time slew -0.000570s 2024-09-13T14:58:09.243 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:09 ntpd[18386]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T14:58:09.243 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:09 ntpd[18386]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T14:58:09.243 INFO:teuthology.orchestra.run.smithi007.stderr:13 Sep 14:58:09 ntpd[18386]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T14:58:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:09 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:09 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:09 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:09 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:09 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:09 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:09 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:09 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:09.262 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:09 ntpd[18905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T14:58:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:09 ntpd[18905]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T14:58:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:09 ntpd[18905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T14:58:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:09 ntpd[18905]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T14:58:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:09 ntpd[18905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T14:58:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:09 ntpd[18905]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T14:58:09.263 INFO:teuthology.orchestra.run.smithi077.stdout:13 Sep 14:58:09 ntpd[18905]: ntpd: time slew -0.002229 s 2024-09-13T14:58:09.263 INFO:teuthology.orchestra.run.smithi077.stdout:ntpd: time slew -0.002229s 2024-09-13T14:58:09.263 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:09 ntpd[18905]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T14:58:09.264 INFO:teuthology.orchestra.run.smithi077.stderr:13 Sep 14:58:09 ntpd[18905]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T14:58:09.330 INFO:teuthology.orchestra.run.smithi007.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T14:58:09.331 INFO:teuthology.orchestra.run.smithi007.stdout:============================================================================== 2024-09-13T14:58:09.331 INFO:teuthology.orchestra.run.smithi007.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T14:58:09.331 INFO:teuthology.orchestra.run.smithi007.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T14:58:09.331 INFO:teuthology.orchestra.run.smithi007.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T14:58:09.331 INFO:teuthology.orchestra.run.smithi007.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T14:58:09.352 INFO:teuthology.orchestra.run.smithi077.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T14:58:09.352 INFO:teuthology.orchestra.run.smithi077.stdout:============================================================================== 2024-09-13T14:58:09.353 INFO:teuthology.orchestra.run.smithi077.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T14:58:09.353 INFO:teuthology.orchestra.run.smithi077.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T14:58:09.353 INFO:teuthology.orchestra.run.smithi077.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T14:58:09.353 INFO:teuthology.orchestra.run.smithi077.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-13T14:58:09.354 INFO:teuthology.run_tasks:Running task install... 2024-09-13T14:58:09.363 DEBUG:teuthology.task.install:project ceph 2024-09-13T14:58:09.363 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}} 2024-09-13T14:58:09.363 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'} 2024-09-13T14:58:09.363 INFO:teuthology.task.install:Using flavor: default 2024-09-13T14:58:09.369 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T14:58:09.369 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T14:58:09.370 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-key list | grep Ceph 2024-09-13T14:58:09.370 DEBUG:teuthology.orchestra.run.smithi077:> sudo apt-key list | grep Ceph 2024-09-13T14:58:09.456 INFO:teuthology.orchestra.run.smithi077.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T14:58:09.480 INFO:teuthology.orchestra.run.smithi007.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-13T14:58:09.484 INFO:teuthology.orchestra.run.smithi077.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T14:58:09.484 INFO:teuthology.orchestra.run.smithi077.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T14:58:09.485 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T14:58:09.485 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T14:58:09.486 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T14:58:09.531 INFO:teuthology.orchestra.run.smithi007.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T14:58:09.532 INFO:teuthology.orchestra.run.smithi007.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T14:58:09.533 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T14:58:09.533 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T14:58:09.533 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T14:58:09.641 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default/ 2024-09-13T14:58:09.642 INFO:teuthology.task.install.deb:Package version is 18.2.4-850-g50bbe7f3-1jammy 2024-09-13T14:58:09.694 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default/ 2024-09-13T14:58:09.694 INFO:teuthology.task.install.deb:Package version is 18.2.4-850-g50bbe7f3-1jammy 2024-09-13T14:58:09.775 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T14:58:09.775 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T14:58:09.788 DEBUG:teuthology.orchestra.run.smithi077:> sudo apt-get update 2024-09-13T14:58:09.815 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T14:58:09.815 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T14:58:09.834 DEBUG:teuthology.orchestra.run.smithi007:> sudo apt-get update 2024-09-13T14:58:09.956 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T14:58:09.965 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T14:58:09.966 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T14:58:09.982 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T14:58:10.008 INFO:teuthology.orchestra.run.smithi077.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T14:58:10.029 INFO:teuthology.orchestra.run.smithi077.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T14:58:10.051 INFO:teuthology.orchestra.run.smithi077.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T14:58:10.072 INFO:teuthology.orchestra.run.smithi077.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-09-13T14:58:10.074 INFO:teuthology.orchestra.run.smithi007.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy InRelease 2024-09-13T14:58:10.096 INFO:teuthology.orchestra.run.smithi007.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-13T14:58:10.102 INFO:teuthology.orchestra.run.smithi077.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,423 B] 2024-09-13T14:58:10.117 INFO:teuthology.orchestra.run.smithi007.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-13T14:58:10.141 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.7 kB] 2024-09-13T14:58:10.161 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-13T14:58:10.161 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-13T14:58:10.182 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,423 B] 2024-09-13T14:58:10.223 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-13T14:58:10.305 INFO:teuthology.orchestra.run.smithi007.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-13T14:58:10.309 INFO:teuthology.orchestra.run.smithi077.stdout:Fetched 28.8 kB in 0s (83.8 kB/s) 2024-09-13T14:58:10.778 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 28.8 kB in 1s (40.7 kB/s) 2024-09-13T14:58:11.287 INFO:teuthology.orchestra.run.smithi077.stdout:Reading package lists... 2024-09-13T14:58:11.303 DEBUG:teuthology.orchestra.run.smithi077:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-850-g50bbe7f3-1jammy cephadm=18.2.4-850-g50bbe7f3-1jammy ceph-mds=18.2.4-850-g50bbe7f3-1jammy ceph-mgr=18.2.4-850-g50bbe7f3-1jammy ceph-common=18.2.4-850-g50bbe7f3-1jammy ceph-fuse=18.2.4-850-g50bbe7f3-1jammy ceph-test=18.2.4-850-g50bbe7f3-1jammy ceph-volume=18.2.4-850-g50bbe7f3-1jammy radosgw=18.2.4-850-g50bbe7f3-1jammy python3-rados=18.2.4-850-g50bbe7f3-1jammy python3-rgw=18.2.4-850-g50bbe7f3-1jammy python3-cephfs=18.2.4-850-g50bbe7f3-1jammy python3-rbd=18.2.4-850-g50bbe7f3-1jammy libcephfs2=18.2.4-850-g50bbe7f3-1jammy libcephfs-dev=18.2.4-850-g50bbe7f3-1jammy librados2=18.2.4-850-g50bbe7f3-1jammy librbd1=18.2.4-850-g50bbe7f3-1jammy rbd-fuse=18.2.4-850-g50bbe7f3-1jammy python3-cephfs=18.2.4-850-g50bbe7f3-1jammy cephfs-shell=18.2.4-850-g50bbe7f3-1jammy cephfs-top=18.2.4-850-g50bbe7f3-1jammy cephfs-mirror=18.2.4-850-g50bbe7f3-1jammy 2024-09-13T14:58:11.365 INFO:teuthology.orchestra.run.smithi077.stdout:Reading package lists... 2024-09-13T14:58:11.575 INFO:teuthology.orchestra.run.smithi077.stdout:Building dependency tree... 2024-09-13T14:58:11.575 INFO:teuthology.orchestra.run.smithi077.stdout:Reading state information... 2024-09-13T14:58:11.771 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T14:58:11.771 INFO:teuthology.orchestra.run.smithi077.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T14:58:11.771 INFO:teuthology.orchestra.run.smithi077.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T14:58:11.772 INFO:teuthology.orchestra.run.smithi077.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T14:58:11.772 INFO:teuthology.orchestra.run.smithi077.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T14:58:11.772 INFO:teuthology.orchestra.run.smithi077.stdout: python2.7-minimal 2024-09-13T14:58:11.772 INFO:teuthology.orchestra.run.smithi077.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T14:58:11.773 INFO:teuthology.orchestra.run.smithi077.stdout:The following additional packages will be installed: 2024-09-13T14:58:11.773 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T14:58:11.776 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T14:58:11.776 INFO:teuthology.orchestra.run.smithi077.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T14:58:11.776 INFO:teuthology.orchestra.run.smithi077.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T14:58:11.777 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-13T14:58:11.777 INFO:teuthology.orchestra.run.smithi077.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T14:58:11.777 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T14:58:11.777 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T14:58:11.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-13T14:58:11.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-13T14:58:11.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-13T14:58:11.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-13T14:58:11.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-13T14:58:11.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T14:58:11.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-13T14:58:11.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-13T14:58:11.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-13T14:58:11.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-13T14:58:11.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-13T14:58:11.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-13T14:58:11.778 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-13T14:58:11.779 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-13T14:58:11.779 INFO:teuthology.orchestra.run.smithi077.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T14:58:11.779 INFO:teuthology.orchestra.run.smithi077.stdout:Suggested packages: 2024-09-13T14:58:11.779 INFO:teuthology.orchestra.run.smithi077.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-13T14:58:11.779 INFO:teuthology.orchestra.run.smithi077.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-13T14:58:11.779 INFO:teuthology.orchestra.run.smithi077.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-13T14:58:11.779 INFO:teuthology.orchestra.run.smithi077.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-13T14:58:11.779 INFO:teuthology.orchestra.run.smithi077.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-13T14:58:11.779 INFO:teuthology.orchestra.run.smithi077.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-13T14:58:11.779 INFO:teuthology.orchestra.run.smithi077.stdout: python3-watchdog 2024-09-13T14:58:11.779 INFO:teuthology.orchestra.run.smithi077.stdout:Recommended packages: 2024-09-13T14:58:11.779 INFO:teuthology.orchestra.run.smithi077.stdout: btrfs-tools 2024-09-13T14:58:11.847 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-09-13T14:58:11.862 DEBUG:teuthology.orchestra.run.smithi007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-850-g50bbe7f3-1jammy cephadm=18.2.4-850-g50bbe7f3-1jammy ceph-mds=18.2.4-850-g50bbe7f3-1jammy ceph-mgr=18.2.4-850-g50bbe7f3-1jammy ceph-common=18.2.4-850-g50bbe7f3-1jammy ceph-fuse=18.2.4-850-g50bbe7f3-1jammy ceph-test=18.2.4-850-g50bbe7f3-1jammy ceph-volume=18.2.4-850-g50bbe7f3-1jammy radosgw=18.2.4-850-g50bbe7f3-1jammy python3-rados=18.2.4-850-g50bbe7f3-1jammy python3-rgw=18.2.4-850-g50bbe7f3-1jammy python3-cephfs=18.2.4-850-g50bbe7f3-1jammy python3-rbd=18.2.4-850-g50bbe7f3-1jammy libcephfs2=18.2.4-850-g50bbe7f3-1jammy libcephfs-dev=18.2.4-850-g50bbe7f3-1jammy librados2=18.2.4-850-g50bbe7f3-1jammy librbd1=18.2.4-850-g50bbe7f3-1jammy rbd-fuse=18.2.4-850-g50bbe7f3-1jammy python3-cephfs=18.2.4-850-g50bbe7f3-1jammy cephfs-shell=18.2.4-850-g50bbe7f3-1jammy cephfs-top=18.2.4-850-g50bbe7f3-1jammy cephfs-mirror=18.2.4-850-g50bbe7f3-1jammy 2024-09-13T14:58:11.882 INFO:teuthology.orchestra.run.smithi077.stdout:The following NEW packages will be installed: 2024-09-13T14:58:11.882 INFO:teuthology.orchestra.run.smithi077.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T14:58:11.882 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T14:58:11.882 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T14:58:11.882 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-13T14:58:11.884 INFO:teuthology.orchestra.run.smithi077.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T14:58:11.884 INFO:teuthology.orchestra.run.smithi077.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-13T14:58:11.884 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-13T14:58:11.884 INFO:teuthology.orchestra.run.smithi077.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-13T14:58:11.884 INFO:teuthology.orchestra.run.smithi077.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-13T14:58:11.884 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-13T14:58:11.884 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-13T14:58:11.884 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-13T14:58:11.884 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T14:58:11.885 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T14:58:11.885 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T14:58:11.885 INFO:teuthology.orchestra.run.smithi077.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T14:58:11.885 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T14:58:11.885 INFO:teuthology.orchestra.run.smithi077.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T14:58:11.885 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T14:58:11.885 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-13T14:58:11.885 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T14:58:11.885 INFO:teuthology.orchestra.run.smithi077.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T14:58:11.885 INFO:teuthology.orchestra.run.smithi077.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T14:58:11.885 INFO:teuthology.orchestra.run.smithi077.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T14:58:11.885 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T14:58:11.885 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-13T14:58:11.885 INFO:teuthology.orchestra.run.smithi077.stdout: socat xmlstarlet 2024-09-13T14:58:11.941 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-09-13T14:58:11.996 INFO:teuthology.orchestra.run.smithi077.stdout:0 upgraded, 115 newly installed, 0 to remove and 334 not upgraded. 2024-09-13T14:58:11.996 INFO:teuthology.orchestra.run.smithi077.stdout:Need to get 163 MB of archives. 2024-09-13T14:58:11.997 INFO:teuthology.orchestra.run.smithi077.stdout:After this operation, 747 MB of additional disk space will be used. 2024-09-13T14:58:11.997 INFO:teuthology.orchestra.run.smithi077.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-13T14:58:11.997 INFO:teuthology.orchestra.run.smithi077.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T14:58:11.997 INFO:teuthology.orchestra.run.smithi077.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-13T14:58:12.012 INFO:teuthology.orchestra.run.smithi077.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-13T14:58:12.021 INFO:teuthology.orchestra.run.smithi077.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T14:58:12.022 INFO:teuthology.orchestra.run.smithi077.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-850-g50bbe7f3-1jammy [3,451 kB] 2024-09-13T14:58:12.038 INFO:teuthology.orchestra.run.smithi077.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T14:58:12.041 INFO:teuthology.orchestra.run.smithi077.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T14:58:12.050 INFO:teuthology.orchestra.run.smithi077.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T14:58:12.096 INFO:teuthology.orchestra.run.smithi077.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T14:58:12.099 INFO:teuthology.orchestra.run.smithi077.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T14:58:12.110 INFO:teuthology.orchestra.run.smithi077.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T14:58:12.114 INFO:teuthology.orchestra.run.smithi077.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T14:58:12.114 INFO:teuthology.orchestra.run.smithi077.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T14:58:12.122 INFO:teuthology.orchestra.run.smithi077.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T14:58:12.123 INFO:teuthology.orchestra.run.smithi077.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T14:58:12.123 INFO:teuthology.orchestra.run.smithi077.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T14:58:12.124 INFO:teuthology.orchestra.run.smithi077.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T14:58:12.125 INFO:teuthology.orchestra.run.smithi077.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T14:58:12.127 INFO:teuthology.orchestra.run.smithi007.stdout:Building dependency tree... 2024-09-13T14:58:12.128 INFO:teuthology.orchestra.run.smithi007.stdout:Reading state information... 2024-09-13T14:58:12.134 INFO:teuthology.orchestra.run.smithi077.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T14:58:12.134 INFO:teuthology.orchestra.run.smithi077.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T14:58:12.135 INFO:teuthology.orchestra.run.smithi077.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T14:58:12.151 INFO:teuthology.orchestra.run.smithi077.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T14:58:12.151 INFO:teuthology.orchestra.run.smithi077.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T14:58:12.154 INFO:teuthology.orchestra.run.smithi077.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T14:58:12.154 INFO:teuthology.orchestra.run.smithi077.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T14:58:12.155 INFO:teuthology.orchestra.run.smithi077.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T14:58:12.155 INFO:teuthology.orchestra.run.smithi077.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T14:58:12.156 INFO:teuthology.orchestra.run.smithi077.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T14:58:12.168 INFO:teuthology.orchestra.run.smithi077.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T14:58:12.169 INFO:teuthology.orchestra.run.smithi077.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T14:58:12.170 INFO:teuthology.orchestra.run.smithi077.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T14:58:12.190 INFO:teuthology.orchestra.run.smithi077.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T14:58:12.191 INFO:teuthology.orchestra.run.smithi077.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T14:58:12.191 INFO:teuthology.orchestra.run.smithi077.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T14:58:12.192 INFO:teuthology.orchestra.run.smithi077.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T14:58:12.192 INFO:teuthology.orchestra.run.smithi077.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T14:58:12.192 INFO:teuthology.orchestra.run.smithi077.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T14:58:12.194 INFO:teuthology.orchestra.run.smithi077.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T14:58:12.203 INFO:teuthology.orchestra.run.smithi077.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T14:58:12.204 INFO:teuthology.orchestra.run.smithi077.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T14:58:12.205 INFO:teuthology.orchestra.run.smithi077.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T14:58:12.208 INFO:teuthology.orchestra.run.smithi077.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-850-g50bbe7f3-1jammy [3,108 kB] 2024-09-13T14:58:12.220 INFO:teuthology.orchestra.run.smithi077.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T14:58:12.222 INFO:teuthology.orchestra.run.smithi077.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T14:58:12.223 INFO:teuthology.orchestra.run.smithi077.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T14:58:12.224 INFO:teuthology.orchestra.run.smithi077.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T14:58:12.226 INFO:teuthology.orchestra.run.smithi077.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T14:58:12.256 INFO:teuthology.orchestra.run.smithi077.stdout:Get:49 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-850-g50bbe7f3-1jammy [684 kB] 2024-09-13T14:58:12.264 INFO:teuthology.orchestra.run.smithi077.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-850-g50bbe7f3-1jammy [356 kB] 2024-09-13T14:58:12.268 INFO:teuthology.orchestra.run.smithi077.stdout:Get:51 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-850-g50bbe7f3-1jammy [32.8 kB] 2024-09-13T14:58:12.269 INFO:teuthology.orchestra.run.smithi077.stdout:Get:52 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-850-g50bbe7f3-1jammy [180 kB] 2024-09-13T14:58:12.271 INFO:teuthology.orchestra.run.smithi077.stdout:Get:53 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-850-g50bbe7f3-1jammy [63.8 kB] 2024-09-13T14:58:12.272 INFO:teuthology.orchestra.run.smithi077.stdout:Get:54 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-850-g50bbe7f3-1jammy [334 kB] 2024-09-13T14:58:12.277 INFO:teuthology.orchestra.run.smithi077.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T14:58:12.277 INFO:teuthology.orchestra.run.smithi077.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-850-g50bbe7f3-1jammy [5,933 kB] 2024-09-13T14:58:12.278 INFO:teuthology.orchestra.run.smithi077.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T14:58:12.279 INFO:teuthology.orchestra.run.smithi077.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T14:58:12.279 INFO:teuthology.orchestra.run.smithi077.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T14:58:12.280 INFO:teuthology.orchestra.run.smithi077.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T14:58:12.281 INFO:teuthology.orchestra.run.smithi077.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T14:58:12.281 INFO:teuthology.orchestra.run.smithi077.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T14:58:12.283 INFO:teuthology.orchestra.run.smithi077.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T14:58:12.283 INFO:teuthology.orchestra.run.smithi077.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T14:58:12.296 INFO:teuthology.orchestra.run.smithi077.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T14:58:12.313 INFO:teuthology.orchestra.run.smithi077.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T14:58:12.315 INFO:teuthology.orchestra.run.smithi077.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T14:58:12.315 INFO:teuthology.orchestra.run.smithi077.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T14:58:12.325 INFO:teuthology.orchestra.run.smithi007.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T14:58:12.325 INFO:teuthology.orchestra.run.smithi007.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T14:58:12.325 INFO:teuthology.orchestra.run.smithi007.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T14:58:12.325 INFO:teuthology.orchestra.run.smithi007.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T14:58:12.326 INFO:teuthology.orchestra.run.smithi007.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T14:58:12.326 INFO:teuthology.orchestra.run.smithi007.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T14:58:12.326 INFO:teuthology.orchestra.run.smithi007.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T14:58:12.327 INFO:teuthology.orchestra.run.smithi007.stdout:The following additional packages will be installed: 2024-09-13T14:58:12.327 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T14:58:12.327 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-13T14:58:12.327 INFO:teuthology.orchestra.run.smithi007.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T14:58:12.328 INFO:teuthology.orchestra.run.smithi007.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-13T14:58:12.328 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-09-13T14:58:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-13T14:58:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-13T14:58:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-13T14:58:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-13T14:58:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-13T14:58:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-13T14:58:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-13T14:58:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-13T14:58:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T14:58:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-13T14:58:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-13T14:58:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-13T14:58:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-13T14:58:12.330 INFO:teuthology.orchestra.run.smithi007.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-13T14:58:12.330 INFO:teuthology.orchestra.run.smithi007.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-13T14:58:12.330 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-13T14:58:12.330 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-13T14:58:12.330 INFO:teuthology.orchestra.run.smithi007.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T14:58:12.331 INFO:teuthology.orchestra.run.smithi007.stdout:Suggested packages: 2024-09-13T14:58:12.331 INFO:teuthology.orchestra.run.smithi007.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-09-13T14:58:12.331 INFO:teuthology.orchestra.run.smithi007.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-09-13T14:58:12.331 INFO:teuthology.orchestra.run.smithi007.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-09-13T14:58:12.331 INFO:teuthology.orchestra.run.smithi007.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-09-13T14:58:12.331 INFO:teuthology.orchestra.run.smithi007.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-09-13T14:58:12.331 INFO:teuthology.orchestra.run.smithi007.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-09-13T14:58:12.331 INFO:teuthology.orchestra.run.smithi007.stdout: python3-watchdog 2024-09-13T14:58:12.331 INFO:teuthology.orchestra.run.smithi007.stdout:Recommended packages: 2024-09-13T14:58:12.331 INFO:teuthology.orchestra.run.smithi007.stdout: btrfs-tools 2024-09-13T14:58:12.331 INFO:teuthology.orchestra.run.smithi077.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T14:58:12.332 INFO:teuthology.orchestra.run.smithi077.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T14:58:12.332 INFO:teuthology.orchestra.run.smithi077.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T14:58:12.332 INFO:teuthology.orchestra.run.smithi077.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T14:58:12.332 INFO:teuthology.orchestra.run.smithi077.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T14:58:12.333 INFO:teuthology.orchestra.run.smithi077.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T14:58:12.333 INFO:teuthology.orchestra.run.smithi077.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T14:58:12.349 INFO:teuthology.orchestra.run.smithi077.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T14:58:12.353 INFO:teuthology.orchestra.run.smithi077.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T14:58:12.354 INFO:teuthology.orchestra.run.smithi077.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T14:58:12.356 INFO:teuthology.orchestra.run.smithi077.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T14:58:12.357 INFO:teuthology.orchestra.run.smithi077.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T14:58:12.367 INFO:teuthology.orchestra.run.smithi077.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T14:58:12.369 INFO:teuthology.orchestra.run.smithi077.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-13T14:58:12.370 INFO:teuthology.orchestra.run.smithi077.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T14:58:12.373 INFO:teuthology.orchestra.run.smithi077.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T14:58:12.375 INFO:teuthology.orchestra.run.smithi077.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-850-g50bbe7f3-1jammy [112 kB] 2024-09-13T14:58:12.376 INFO:teuthology.orchestra.run.smithi077.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T14:58:12.377 INFO:teuthology.orchestra.run.smithi077.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-850-g50bbe7f3-1jammy [445 kB] 2024-09-13T14:58:12.383 INFO:teuthology.orchestra.run.smithi077.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-850-g50bbe7f3-1jammy [22.1 MB] 2024-09-13T14:58:12.384 INFO:teuthology.orchestra.run.smithi077.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T14:58:12.385 INFO:teuthology.orchestra.run.smithi077.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T14:58:12.392 INFO:teuthology.orchestra.run.smithi077.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T14:58:12.393 INFO:teuthology.orchestra.run.smithi077.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T14:58:12.393 INFO:teuthology.orchestra.run.smithi077.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T14:58:12.490 INFO:teuthology.orchestra.run.smithi007.stdout:The following NEW packages will be installed: 2024-09-13T14:58:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T14:58:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T14:58:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T14:58:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-13T14:58:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-09-13T14:58:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-13T14:58:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-09-13T14:58:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-09-13T14:58:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-13T14:58:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-13T14:58:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-13T14:58:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-13T14:58:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-13T14:58:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-13T14:58:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-13T14:58:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-13T14:58:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-13T14:58:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-13T14:58:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T14:58:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-13T14:58:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T14:58:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-13T14:58:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-13T14:58:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-13T14:58:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-13T14:58:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-13T14:58:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: socat xmlstarlet 2024-09-13T14:58:12.690 INFO:teuthology.orchestra.run.smithi007.stdout:0 upgraded, 115 newly installed, 0 to remove and 334 not upgraded. 2024-09-13T14:58:12.690 INFO:teuthology.orchestra.run.smithi007.stdout:Need to get 163 MB of archives. 2024-09-13T14:58:12.690 INFO:teuthology.orchestra.run.smithi007.stdout:After this operation, 747 MB of additional disk space will be used. 2024-09-13T14:58:12.690 INFO:teuthology.orchestra.run.smithi007.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-13T14:58:12.772 INFO:teuthology.orchestra.run.smithi007.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-13T14:58:12.781 INFO:teuthology.orchestra.run.smithi007.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.4-850-g50bbe7f3-1jammy [3,451 kB] 2024-09-13T14:58:12.809 INFO:teuthology.orchestra.run.smithi077.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-850-g50bbe7f3-1jammy [5,005 kB] 2024-09-13T14:58:12.818 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-13T14:58:12.861 INFO:teuthology.orchestra.run.smithi077.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-850-g50bbe7f3-1jammy [241 kB] 2024-09-13T14:58:12.864 INFO:teuthology.orchestra.run.smithi077.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-850-g50bbe7f3-1jammy [130 kB] 2024-09-13T14:58:12.865 INFO:teuthology.orchestra.run.smithi077.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-850-g50bbe7f3-1jammy [1,495 kB] 2024-09-13T14:58:12.885 INFO:teuthology.orchestra.run.smithi077.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-850-g50bbe7f3-1jammy [6,085 kB] 2024-09-13T14:58:13.002 INFO:teuthology.orchestra.run.smithi077.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-850-g50bbe7f3-1jammy [22.4 MB] 2024-09-13T14:58:13.012 INFO:teuthology.orchestra.run.smithi007.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-09-13T14:58:13.050 INFO:teuthology.orchestra.run.smithi007.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-13T14:58:13.123 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-13T14:58:13.134 INFO:teuthology.orchestra.run.smithi007.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-13T14:58:13.178 INFO:teuthology.orchestra.run.smithi007.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-13T14:58:13.222 INFO:teuthology.orchestra.run.smithi007.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.4-850-g50bbe7f3-1jammy [3,108 kB] 2024-09-13T14:58:13.342 INFO:teuthology.orchestra.run.smithi007.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-13T14:58:13.349 INFO:teuthology.orchestra.run.smithi007.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-13T14:58:13.377 INFO:teuthology.orchestra.run.smithi007.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-13T14:58:13.385 INFO:teuthology.orchestra.run.smithi007.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-13T14:58:13.386 INFO:teuthology.orchestra.run.smithi007.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-13T14:58:13.404 INFO:teuthology.orchestra.run.smithi007.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-13T14:58:13.405 INFO:teuthology.orchestra.run.smithi007.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-13T14:58:13.405 INFO:teuthology.orchestra.run.smithi007.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-13T14:58:13.407 INFO:teuthology.orchestra.run.smithi007.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-13T14:58:13.423 INFO:teuthology.orchestra.run.smithi007.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-13T14:58:13.476 INFO:teuthology.orchestra.run.smithi007.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.4-850-g50bbe7f3-1jammy [684 kB] 2024-09-13T14:58:13.486 INFO:teuthology.orchestra.run.smithi007.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.4-850-g50bbe7f3-1jammy [356 kB] 2024-09-13T14:58:13.489 INFO:teuthology.orchestra.run.smithi007.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-13T14:58:13.489 INFO:teuthology.orchestra.run.smithi007.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-13T14:58:13.490 INFO:teuthology.orchestra.run.smithi007.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-13T14:58:13.490 INFO:teuthology.orchestra.run.smithi007.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-13T14:58:13.490 INFO:teuthology.orchestra.run.smithi007.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-13T14:58:13.493 INFO:teuthology.orchestra.run.smithi007.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-13T14:58:13.493 INFO:teuthology.orchestra.run.smithi007.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-13T14:58:13.505 INFO:teuthology.orchestra.run.smithi007.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-13T14:58:13.506 INFO:teuthology.orchestra.run.smithi007.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-13T14:58:13.514 INFO:teuthology.orchestra.run.smithi007.stdout:Get:32 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.4-850-g50bbe7f3-1jammy [32.8 kB] 2024-09-13T14:58:13.515 INFO:teuthology.orchestra.run.smithi007.stdout:Get:33 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.4-850-g50bbe7f3-1jammy [180 kB] 2024-09-13T14:58:13.517 INFO:teuthology.orchestra.run.smithi007.stdout:Get:34 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.4-850-g50bbe7f3-1jammy [63.8 kB] 2024-09-13T14:58:13.519 INFO:teuthology.orchestra.run.smithi007.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.4-850-g50bbe7f3-1jammy [334 kB] 2024-09-13T14:58:13.524 INFO:teuthology.orchestra.run.smithi007.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.4-850-g50bbe7f3-1jammy [5,933 kB] 2024-09-13T14:58:13.527 INFO:teuthology.orchestra.run.smithi077.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-850-g50bbe7f3-1jammy [14.2 kB] 2024-09-13T14:58:13.567 INFO:teuthology.orchestra.run.smithi077.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-850-g50bbe7f3-1jammy [835 kB] 2024-09-13T14:58:13.582 INFO:teuthology.orchestra.run.smithi077.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-850-g50bbe7f3-1jammy [2,159 kB] 2024-09-13T14:58:13.586 INFO:teuthology.orchestra.run.smithi007.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T14:58:13.586 INFO:teuthology.orchestra.run.smithi007.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-13T14:58:13.586 INFO:teuthology.orchestra.run.smithi007.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-13T14:58:13.588 INFO:teuthology.orchestra.run.smithi007.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-13T14:58:13.588 INFO:teuthology.orchestra.run.smithi007.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-13T14:58:13.589 INFO:teuthology.orchestra.run.smithi007.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-13T14:58:13.593 INFO:teuthology.orchestra.run.smithi007.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-13T14:58:13.618 INFO:teuthology.orchestra.run.smithi077.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-850-g50bbe7f3-1jammy [240 kB] 2024-09-13T14:58:13.622 INFO:teuthology.orchestra.run.smithi077.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-850-g50bbe7f3-1jammy [145 kB] 2024-09-13T14:58:13.624 INFO:teuthology.orchestra.run.smithi077.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-850-g50bbe7f3-1jammy [2,233 kB] 2024-09-13T14:58:13.648 INFO:teuthology.orchestra.run.smithi077.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-850-g50bbe7f3-1jammy [8,625 kB] 2024-09-13T14:58:13.667 INFO:teuthology.orchestra.run.smithi007.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-13T14:58:13.668 INFO:teuthology.orchestra.run.smithi007.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-13T14:58:13.668 INFO:teuthology.orchestra.run.smithi007.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-13T14:58:13.693 INFO:teuthology.orchestra.run.smithi007.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.4-850-g50bbe7f3-1jammy [112 kB] 2024-09-13T14:58:13.694 INFO:teuthology.orchestra.run.smithi007.stdout:Get:48 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.4-850-g50bbe7f3-1jammy [445 kB] 2024-09-13T14:58:13.749 INFO:teuthology.orchestra.run.smithi007.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-13T14:58:13.750 INFO:teuthology.orchestra.run.smithi007.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.4-850-g50bbe7f3-1jammy [22.1 MB] 2024-09-13T14:58:13.750 INFO:teuthology.orchestra.run.smithi007.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-13T14:58:13.751 INFO:teuthology.orchestra.run.smithi007.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-13T14:58:13.752 INFO:teuthology.orchestra.run.smithi007.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-13T14:58:13.753 INFO:teuthology.orchestra.run.smithi007.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-13T14:58:13.755 INFO:teuthology.orchestra.run.smithi007.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-13T14:58:13.756 INFO:teuthology.orchestra.run.smithi007.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-13T14:58:13.830 INFO:teuthology.orchestra.run.smithi007.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-13T14:58:13.832 INFO:teuthology.orchestra.run.smithi007.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-13T14:58:13.851 INFO:teuthology.orchestra.run.smithi077.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-850-g50bbe7f3-1jammy [14.3 kB] 2024-09-13T14:58:13.852 INFO:teuthology.orchestra.run.smithi077.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-850-g50bbe7f3-1jammy [42.8 MB] 2024-09-13T14:58:13.942 INFO:teuthology.orchestra.run.smithi007.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-13T14:58:13.942 INFO:teuthology.orchestra.run.smithi007.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-13T14:58:13.944 INFO:teuthology.orchestra.run.smithi007.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-13T14:58:13.944 INFO:teuthology.orchestra.run.smithi007.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-13T14:58:13.945 INFO:teuthology.orchestra.run.smithi007.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-13T14:58:13.945 INFO:teuthology.orchestra.run.smithi007.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-13T14:58:13.946 INFO:teuthology.orchestra.run.smithi007.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-13T14:58:13.994 INFO:teuthology.orchestra.run.smithi007.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T14:58:13.994 INFO:teuthology.orchestra.run.smithi007.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-13T14:58:14.075 INFO:teuthology.orchestra.run.smithi007.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-13T14:58:14.095 INFO:teuthology.orchestra.run.smithi007.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-13T14:58:14.097 INFO:teuthology.orchestra.run.smithi007.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-13T14:58:14.098 INFO:teuthology.orchestra.run.smithi007.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-13T14:58:14.169 INFO:teuthology.orchestra.run.smithi007.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-13T14:58:14.170 INFO:teuthology.orchestra.run.smithi007.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-13T14:58:14.170 INFO:teuthology.orchestra.run.smithi007.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-13T14:58:14.171 INFO:teuthology.orchestra.run.smithi007.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-13T14:58:14.171 INFO:teuthology.orchestra.run.smithi007.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-13T14:58:14.172 INFO:teuthology.orchestra.run.smithi007.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-13T14:58:14.241 INFO:teuthology.orchestra.run.smithi007.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-13T14:58:14.241 INFO:teuthology.orchestra.run.smithi007.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-13T14:58:14.242 INFO:teuthology.orchestra.run.smithi007.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-13T14:58:14.320 INFO:teuthology.orchestra.run.smithi007.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-13T14:58:14.321 INFO:teuthology.orchestra.run.smithi007.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-13T14:58:14.321 INFO:teuthology.orchestra.run.smithi007.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-13T14:58:14.325 INFO:teuthology.orchestra.run.smithi007.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-13T14:58:14.328 INFO:teuthology.orchestra.run.smithi007.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-13T14:58:14.328 INFO:teuthology.orchestra.run.smithi007.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-13T14:58:14.333 INFO:teuthology.orchestra.run.smithi007.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-13T14:58:14.401 INFO:teuthology.orchestra.run.smithi007.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T14:58:14.401 INFO:teuthology.orchestra.run.smithi007.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-13T14:58:14.403 INFO:teuthology.orchestra.run.smithi007.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-13T14:58:14.482 INFO:teuthology.orchestra.run.smithi007.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-13T14:58:14.482 INFO:teuthology.orchestra.run.smithi007.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-13T14:58:14.483 INFO:teuthology.orchestra.run.smithi007.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-13T14:58:14.895 INFO:teuthology.orchestra.run.smithi007.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.4-850-g50bbe7f3-1jammy [5,005 kB] 2024-09-13T14:58:15.028 INFO:teuthology.orchestra.run.smithi007.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.4-850-g50bbe7f3-1jammy [241 kB] 2024-09-13T14:58:15.030 INFO:teuthology.orchestra.run.smithi007.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.4-850-g50bbe7f3-1jammy [130 kB] 2024-09-13T14:58:15.034 INFO:teuthology.orchestra.run.smithi007.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.4-850-g50bbe7f3-1jammy [1,495 kB] 2024-09-13T14:58:15.059 INFO:teuthology.orchestra.run.smithi007.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.4-850-g50bbe7f3-1jammy [6,085 kB] 2024-09-13T14:58:15.069 INFO:teuthology.orchestra.run.smithi077.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-850-g50bbe7f3-1jammy [122 kB] 2024-09-13T14:58:15.071 INFO:teuthology.orchestra.run.smithi077.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.4-850-g50bbe7f3-1jammy [233 kB] 2024-09-13T14:58:15.076 INFO:teuthology.orchestra.run.smithi077.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.4-850-g50bbe7f3-1jammy [34.0 kB] 2024-09-13T14:58:15.077 INFO:teuthology.orchestra.run.smithi077.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.4-850-g50bbe7f3-1jammy [23.5 kB] 2024-09-13T14:58:15.078 INFO:teuthology.orchestra.run.smithi077.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-850-g50bbe7f3-1jammy [38.3 kB] 2024-09-13T14:58:15.079 INFO:teuthology.orchestra.run.smithi077.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-850-g50bbe7f3-1jammy [11.7 MB] 2024-09-13T14:58:15.239 INFO:teuthology.orchestra.run.smithi007.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.4-850-g50bbe7f3-1jammy [22.4 MB] 2024-09-13T14:58:15.319 INFO:teuthology.orchestra.run.smithi077.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-850-g50bbe7f3-1jammy [93.1 kB] 2024-09-13T14:58:15.666 INFO:teuthology.orchestra.run.smithi007.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.4-850-g50bbe7f3-1jammy [14.2 kB] 2024-09-13T14:58:15.666 INFO:teuthology.orchestra.run.smithi007.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.4-850-g50bbe7f3-1jammy [835 kB] 2024-09-13T14:58:15.673 INFO:teuthology.orchestra.run.smithi007.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.4-850-g50bbe7f3-1jammy [2,159 kB] 2024-09-13T14:58:15.708 INFO:teuthology.orchestra.run.smithi007.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.4-850-g50bbe7f3-1jammy [240 kB] 2024-09-13T14:58:15.711 INFO:teuthology.orchestra.run.smithi007.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.4-850-g50bbe7f3-1jammy [145 kB] 2024-09-13T14:58:15.713 INFO:teuthology.orchestra.run.smithi007.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.4-850-g50bbe7f3-1jammy [2,233 kB] 2024-09-13T14:58:15.751 INFO:teuthology.orchestra.run.smithi007.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.4-850-g50bbe7f3-1jammy [8,625 kB] 2024-09-13T14:58:15.889 INFO:teuthology.orchestra.run.smithi077.stdout:Fetched 163 MB in 3s (47.6 MB/s) 2024-09-13T14:58:15.894 INFO:teuthology.orchestra.run.smithi007.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.4-850-g50bbe7f3-1jammy [14.3 kB] 2024-09-13T14:58:15.894 INFO:teuthology.orchestra.run.smithi007.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.4-850-g50bbe7f3-1jammy [42.8 MB] 2024-09-13T14:58:16.028 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T14:58:16.102 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2024-09-13T14:58:16.106 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-13T14:58:16.151 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-13T14:58:16.487 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T14:58:16.508 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T14:58:16.546 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T14:58:16.608 INFO:teuthology.orchestra.run.smithi007.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.4-850-g50bbe7f3-1jammy [122 kB] 2024-09-13T14:58:16.609 INFO:teuthology.orchestra.run.smithi007.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.4-850-g50bbe7f3-1jammy [233 kB] 2024-09-13T14:58:16.611 INFO:teuthology.orchestra.run.smithi007.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.4-850-g50bbe7f3-1jammy [34.0 kB] 2024-09-13T14:58:16.611 INFO:teuthology.orchestra.run.smithi007.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.4-850-g50bbe7f3-1jammy [23.5 kB] 2024-09-13T14:58:16.611 INFO:teuthology.orchestra.run.smithi007.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.4-850-g50bbe7f3-1jammy [38.3 kB] 2024-09-13T14:58:16.612 INFO:teuthology.orchestra.run.smithi007.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.4-850-g50bbe7f3-1jammy [11.7 MB] 2024-09-13T14:58:16.798 INFO:teuthology.orchestra.run.smithi007.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.095512-reef/50bbe7f395997dcd871813949c49addbbf630361/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.4-850-g50bbe7f3-1jammy [93.1 kB] 2024-09-13T14:58:16.840 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T14:58:16.852 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-13T14:58:16.890 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-13T14:58:17.176 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-13T14:58:17.197 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-13T14:58:17.260 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T14:58:17.407 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 163 MB in 4s (38.0 MB/s) 2024-09-13T14:58:17.545 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T14:58:17.546 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T14:58:17.567 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T14:58:17.612 INFO:teuthology.orchestra.run.smithi007.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-13T14:58:17.612 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T14:58:17.615 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-13T14:58:17.686 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-13T14:58:17.949 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T14:58:17.970 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T14:58:17.972 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T14:58:17.986 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-13T14:58:18.007 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T14:58:18.030 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T14:58:18.345 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T14:58:18.358 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T14:58:18.364 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T14:58:18.373 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-13T14:58:18.402 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T14:58:18.416 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-13T14:58:18.770 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libfmt8:amd64. 2024-09-13T14:58:18.785 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-09-13T14:58:18.815 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T14:58:18.837 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T14:58:18.870 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T14:58:18.882 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T14:58:19.148 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-13T14:58:19.164 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-13T14:58:19.198 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T14:58:19.285 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T14:58:19.306 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T14:58:19.343 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T14:58:19.501 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T14:58:19.517 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-13T14:58:19.559 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T14:58:19.621 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T14:58:19.642 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T14:58:19.679 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T14:58:19.871 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T14:58:19.886 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-13T14:58:19.929 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T14:58:20.049 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T14:58:20.070 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T14:58:20.107 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T14:58:20.316 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T14:58:20.332 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T14:58:20.374 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T14:58:20.435 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package librados2. 2024-09-13T14:58:20.455 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../011-librados2_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:20.493 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking librados2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:20.728 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T14:58:20.744 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T14:58:20.786 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T14:58:20.962 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package librbd1. 2024-09-13T14:58:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../012-librbd1_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:21.021 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking librbd1 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:21.139 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T14:58:21.155 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-13T14:58:21.197 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T14:58:21.440 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T14:58:21.461 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../013-libcephfs2_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:21.499 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libcephfs2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:21.509 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-13T14:58:21.525 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-13T14:58:21.559 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T14:58:21.776 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-rados. 2024-09-13T14:58:21.796 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../014-python3-rados_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:21.834 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-rados (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:21.879 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librados2. 2024-09-13T14:58:21.894 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../011-librados2_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:21.937 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librados2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:22.153 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T14:58:22.174 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:58:22.212 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-ceph-argparse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:22.365 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librbd1. 2024-09-13T14:58:22.381 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../012-librbd1_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:22.423 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librbd1 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:22.440 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T14:58:22.451 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../016-python3-cephfs_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:22.489 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cephfs (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:22.775 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T14:58:22.795 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:58:22.833 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-ceph-common (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:22.843 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T14:58:22.858 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../013-libcephfs2_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:22.892 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libcephfs2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:23.156 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rados. 2024-09-13T14:58:23.161 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T14:58:23.171 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../014-python3-rados_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:23.181 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T14:58:23.214 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rados (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:23.219 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T14:58:23.550 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T14:58:23.565 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:58:23.608 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-ceph-argparse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:23.738 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T14:58:23.750 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../019-python3-rbd_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:23.788 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-rbd (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:23.860 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T14:58:23.876 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../016-python3-cephfs_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:23.918 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cephfs (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:24.141 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T14:58:24.162 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T14:58:24.208 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T14:58:24.255 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T14:58:24.270 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:58:24.313 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-ceph-common (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:24.494 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package librgw2. 2024-09-13T14:58:24.505 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../021-librgw2_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:24.535 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking librgw2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:24.624 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T14:58:24.640 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-09-13T14:58:24.674 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-13T14:58:24.918 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T14:58:24.934 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../019-python3-rbd_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:24.977 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rbd (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:25.021 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T14:58:25.041 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../022-python3-rgw_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:25.105 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-rgw (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:25.396 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T14:58:25.411 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-13T14:58:25.449 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T14:58:25.454 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T14:58:25.469 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T14:58:25.507 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T14:58:25.777 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T14:58:25.797 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../024-libradosstriper1_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:25.824 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package librgw2. 2024-09-13T14:58:25.835 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libradosstriper1 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:25.839 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../021-librgw2_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:25.882 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking librgw2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:26.230 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-common. 2024-09-13T14:58:26.250 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../025-ceph-common_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:26.287 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-common (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:26.318 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T14:58:26.332 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../022-python3-rgw_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:26.376 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rgw (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:26.679 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-13T14:58:26.693 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-13T14:58:26.737 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T14:58:27.082 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T14:58:27.095 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../024-libradosstriper1_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:27.140 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libradosstriper1 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:27.577 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-base. 2024-09-13T14:58:27.585 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-common. 2024-09-13T14:58:27.598 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../026-ceph-base_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:27.598 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../025-ceph-common_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:27.643 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-common (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:27.652 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-base (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:28.231 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T14:58:28.252 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T14:58:28.289 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T14:58:28.592 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T14:58:28.604 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T14:58:28.642 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T14:58:28.699 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-base. 2024-09-13T14:58:28.713 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../026-ceph-base_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:28.766 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-base (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:28.961 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T14:58:28.982 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T14:58:29.011 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T14:58:29.319 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-13T14:58:29.333 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-13T14:58:29.378 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-13T14:58:29.389 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T14:58:29.410 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T14:58:29.464 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T14:58:29.689 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cheroot. 2024-09-13T14:58:29.703 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-13T14:58:29.725 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T14:58:29.742 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T14:58:29.747 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T14:58:29.783 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T14:58:30.086 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T14:58:30.092 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-13T14:58:30.105 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-13T14:58:30.106 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T14:58:30.144 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T14:58:30.390 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-13T14:58:30.447 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-portend. 2024-09-13T14:58:30.467 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-09-13T14:58:30.496 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T14:58:30.670 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-13T14:58:30.686 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-13T14:58:30.736 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-13T14:58:30.783 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T14:58:30.803 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T14:58:30.841 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T14:58:31.014 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-13T14:58:31.029 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-13T14:58:31.072 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-13T14:58:31.144 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T14:58:31.164 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T14:58:31.202 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T14:58:31.358 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-tempora. 2024-09-13T14:58:31.373 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-09-13T14:58:31.417 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-13T14:58:31.555 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T14:58:31.576 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T14:58:31.613 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T14:58:31.753 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-portend. 2024-09-13T14:58:31.767 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-09-13T14:58:31.811 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-13T14:58:31.925 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T14:58:31.945 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T14:58:31.983 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T14:58:32.089 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-13T14:58:32.104 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-13T14:58:32.139 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-13T14:58:32.236 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T14:58:32.256 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T14:58:32.294 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T14:58:32.450 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T14:58:32.465 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-13T14:58:32.508 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-13T14:58:32.614 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-mako. 2024-09-13T14:58:32.634 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T14:58:32.672 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T14:58:32.853 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T14:58:32.868 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-09-13T14:58:32.903 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-13T14:58:33.017 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T14:58:33.037 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T14:58:33.075 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T14:58:33.198 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T14:58:33.213 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-09-13T14:58:33.256 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-13T14:58:33.361 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T14:58:33.381 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T14:58:33.419 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T14:58:33.542 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T14:58:33.557 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-13T14:58:33.600 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-13T14:58:33.680 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-webob. 2024-09-13T14:58:33.700 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T14:58:33.730 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T14:58:33.845 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-mako. 2024-09-13T14:58:33.860 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-13T14:58:33.920 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T14:58:34.240 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T14:58:34.255 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T14:58:34.266 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T14:58:34.287 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T14:58:34.298 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T14:58:34.327 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T14:58:34.559 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T14:58:34.574 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-13T14:58:34.609 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-13T14:58:34.635 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T14:58:34.656 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T14:58:34.694 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T14:58:34.920 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-webob. 2024-09-13T14:58:34.935 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-13T14:58:34.978 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T14:58:34.996 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-paste. 2024-09-13T14:58:35.017 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T14:58:35.054 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T14:58:35.366 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T14:58:35.377 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T14:58:35.416 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T14:58:35.473 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T14:58:35.486 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-13T14:58:35.542 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T14:58:35.694 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T14:58:35.715 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T14:58:35.752 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T14:58:35.850 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T14:58:35.866 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-13T14:58:35.909 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T14:58:36.005 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T14:58:36.025 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T14:58:36.063 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T14:58:36.220 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-paste. 2024-09-13T14:58:36.234 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-13T14:58:36.311 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T14:58:36.357 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T14:58:36.378 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T14:58:36.415 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T14:58:36.623 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T14:58:36.637 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-13T14:58:36.681 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T14:58:36.770 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T14:58:36.791 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T14:58:36.828 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T14:58:37.026 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T14:58:37.042 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-13T14:58:37.122 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-13T14:58:37.131 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-idna. 2024-09-13T14:58:37.151 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../051-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T14:58:37.189 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T14:58:37.428 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T14:58:37.443 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-09-13T14:58:37.486 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-13T14:58:37.509 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T14:58:37.529 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T14:58:37.567 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T14:58:37.806 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T14:58:37.821 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-13T14:58:37.856 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T14:58:37.887 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-requests. 2024-09-13T14:58:37.907 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T14:58:37.945 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T14:58:38.211 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-certifi. 2024-09-13T14:58:38.226 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-09-13T14:58:38.239 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T14:58:38.260 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T14:58:38.268 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-13T14:58:38.297 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T14:58:38.547 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-idna. 2024-09-13T14:58:38.562 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../051-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-13T14:58:38.600 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T14:58:38.605 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T14:58:38.621 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:58:38.659 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-modules-core (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:38.949 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-urllib3. 2024-09-13T14:58:38.964 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-13T14:58:39.007 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T14:58:39.038 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T14:58:39.059 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:39.096 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:39.311 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-requests. 2024-09-13T14:58:39.325 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-13T14:58:39.369 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T14:58:39.541 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T14:58:39.561 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../057-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T14:58:39.599 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T14:58:39.714 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T14:58:39.729 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-13T14:58:39.772 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T14:58:39.877 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T14:58:39.898 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../058-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T14:58:39.927 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T14:58:40.058 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T14:58:40.073 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:58:40.116 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-modules-core (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:40.305 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T14:58:40.325 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../059-ceph-mgr_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:40.363 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:40.529 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T14:58:40.544 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:40.579 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:40.692 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T14:58:40.711 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../060-ceph-mon_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:40.740 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mon (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:40.849 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T14:58:40.864 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../057-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-13T14:58:40.907 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-13T14:58:41.235 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T14:58:41.250 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../058-python3-openssl_21.0.0-1_all.deb ... 2024-09-13T14:58:41.293 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-13T14:58:41.369 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T14:58:41.391 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../061-ceph-osd_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:41.427 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-osd (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:41.629 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T14:58:41.644 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../059-ceph-mgr_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:41.687 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:42.040 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T14:58:42.054 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../060-ceph-mon_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:42.090 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mon (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:42.494 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph. 2024-09-13T14:58:42.515 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../062-ceph_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:42.555 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:42.635 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T14:58:42.743 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../061-ceph-osd_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:42.744 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-osd (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:42.875 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T14:58:42.895 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../063-ceph-fuse_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:42.941 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-fuse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:43.303 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T14:58:43.324 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../064-ceph-mds_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:43.361 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mds (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:43.456 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph. 2024-09-13T14:58:43.470 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../062-ceph_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:43.554 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:43.731 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package cephadm. 2024-09-13T14:58:43.751 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../065-cephadm_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:43.789 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking cephadm (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:43.883 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T14:58:43.898 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../063-ceph-fuse_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:43.933 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-fuse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:44.100 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T14:58:44.120 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../066-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T14:58:44.158 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T14:58:44.253 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T14:58:44.268 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../064-ceph-mds_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:44.332 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mds (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:44.444 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T14:58:44.456 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../067-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T14:58:44.494 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T14:58:44.706 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package cephadm. 2024-09-13T14:58:44.720 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../065-cephadm_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:44.764 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking cephadm (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:45.058 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T14:58:45.073 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../066-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-13T14:58:45.148 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-13T14:58:46.141 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-babel. 2024-09-13T14:58:46.162 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../068-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T14:58:46.191 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T14:58:46.411 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-13T14:58:46.426 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../067-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T14:58:46.469 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T14:58:46.502 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T14:58:46.523 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../069-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T14:58:46.561 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T14:58:46.931 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T14:58:46.951 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../070-ceph-mgr-cephadm_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:58:46.980 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-cephadm (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:47.317 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T14:58:47.338 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T14:58:47.367 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T14:58:47.441 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-babel. 2024-09-13T14:58:47.454 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../068-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-13T14:58:47.499 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T14:58:47.670 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-py. 2024-09-13T14:58:47.691 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-09-13T14:58:47.728 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T14:58:47.844 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T14:58:47.857 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../069-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-13T14:58:47.902 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T14:58:48.056 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T14:58:48.077 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T14:58:48.131 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T14:58:48.221 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T14:58:48.235 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../070-ceph-mgr-cephadm_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:58:48.280 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-cephadm (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:48.434 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-toml. 2024-09-13T14:58:48.455 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-09-13T14:58:48.492 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T14:58:48.625 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T14:58:48.638 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-13T14:58:48.683 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-13T14:58:48.779 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T14:58:48.799 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T14:58:48.837 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T14:58:48.928 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-py. 2024-09-13T14:58:48.942 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-09-13T14:58:48.986 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-13T14:58:49.182 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T14:58:49.203 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T14:58:49.240 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T14:58:49.298 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-13T14:58:49.313 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-13T14:58:49.364 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-13T14:58:49.568 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-routes. 2024-09-13T14:58:49.589 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T14:58:49.626 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T14:58:49.651 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-toml. 2024-09-13T14:58:49.665 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-09-13T14:58:49.709 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-13T14:58:50.011 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T14:58:50.026 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-13T14:58:50.069 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T14:58:50.196 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T14:58:50.208 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:58:50.246 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-dashboard (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:50.365 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T14:58:50.379 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T14:58:50.415 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T14:58:50.951 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-routes. 2024-09-13T14:58:50.966 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-13T14:58:51.009 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T14:58:51.338 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T14:58:51.352 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:58:51.396 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-dashboard (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:51.451 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T14:58:51.472 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T14:58:51.509 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T14:58:51.996 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T14:58:52.017 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T14:58:52.054 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T14:58:52.383 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T14:58:52.404 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T14:58:52.449 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T14:58:52.576 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-13T14:58:52.590 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-13T14:58:52.634 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T14:58:52.760 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T14:58:52.782 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T14:58:52.827 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T14:58:53.129 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T14:58:53.143 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-13T14:58:53.187 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T14:58:53.582 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-13T14:58:53.595 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T14:58:53.598 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-13T14:58:53.617 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:58:53.641 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-13T14:58:53.662 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:53.919 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T14:58:53.933 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-13T14:58:53.968 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T14:58:54.607 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T14:58:54.619 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T14:58:54.656 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T14:58:54.711 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T14:58:54.726 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:58:54.770 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:54.959 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T14:58:54.980 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T14:58:55.017 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T14:58:55.354 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T14:58:55.375 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T14:58:55.412 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T14:58:55.648 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T14:58:55.663 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-13T14:58:55.706 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-13T14:58:55.748 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T14:58:55.770 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-13T14:58:55.815 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T14:58:56.044 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T14:58:56.058 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-13T14:58:56.094 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T14:58:56.100 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-13T14:58:56.115 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T14:58:56.143 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T14:58:56.429 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T14:58:56.444 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-13T14:58:56.446 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T14:58:56.468 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T14:58:56.487 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T14:58:56.504 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T14:58:56.799 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T14:58:56.799 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T14:58:56.814 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-13T14:58:56.820 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T14:58:56.848 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-13T14:58:56.857 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T14:58:57.110 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T14:58:57.125 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-13T14:58:57.152 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T14:58:57.164 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T14:58:57.168 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-13T14:58:57.202 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T14:58:57.513 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T14:58:57.529 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-13T14:58:57.571 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T14:58:57.832 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T14:58:57.841 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T14:58:57.845 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:58:57.856 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-13T14:58:57.885 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:57.891 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-13T14:58:58.154 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T14:58:58.175 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T14:58:58.177 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T14:58:58.192 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-13T14:58:58.220 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T14:58:58.227 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T14:58:58.540 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T14:58:58.552 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T14:58:58.589 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T14:58:58.867 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package jq. 2024-09-13T14:58:58.888 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T14:58:58.908 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T14:58:58.921 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:58:58.933 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T14:58:58.999 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:59.152 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package socat. 2024-09-13T14:58:59.165 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T14:58:59.202 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T14:58:59.319 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T14:58:59.333 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-13T14:58:59.377 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T14:58:59.498 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T14:58:59.519 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T14:58:59.555 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T14:58:59.654 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T14:58:59.669 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T14:58:59.704 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T14:58:59.903 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-test. 2024-09-13T14:58:59.924 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../098-ceph-test_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:58:59.965 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package jq. 2024-09-13T14:58:59.967 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-test (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:58:59.980 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-13T14:59:00.024 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-13T14:59:00.260 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package socat. 2024-09-13T14:59:00.275 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-13T14:59:00.318 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-13T14:59:00.654 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T14:59:00.670 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-13T14:59:00.712 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-13T14:59:01.069 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-test. 2024-09-13T14:59:01.083 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../098-ceph-test_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:59:01.127 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-test (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:01.797 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T14:59:01.819 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../099-ceph-volume_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:59:01.863 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-volume (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:02.218 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T14:59:02.239 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:59:02.284 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking cephfs-mirror (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:02.587 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T14:59:02.607 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-09-13T14:59:02.645 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-13T14:59:02.781 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T14:59:02.797 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../099-ceph-volume_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:59:02.840 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ceph-volume (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:02.906 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T14:59:02.928 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../102-cephfs-shell_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:59:02.964 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking cephfs-shell (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:03.200 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T14:59:03.216 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../103-cephfs-top_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:59:03.221 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T14:59:03.235 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:59:03.243 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking cephfs-top (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:03.277 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking cephfs-mirror (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:03.494 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T14:59:03.507 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:59:03.544 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libcephfs-dev (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:03.614 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T14:59:03.629 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-09-13T14:59:03.672 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-13T14:59:03.892 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T14:59:03.907 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../102-cephfs-shell_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:59:03.922 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T14:59:03.942 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking cephfs-shell (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:03.944 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T14:59:03.989 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T14:59:04.219 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T14:59:04.235 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../103-cephfs-top_18.2.4-850-g50bbe7f3-1jammy_all.deb ... 2024-09-13T14:59:04.278 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking cephfs-top (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:04.352 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T14:59:04.365 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T14:59:04.401 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T14:59:04.530 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T14:59:04.546 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:59:04.588 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libcephfs-dev (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:04.830 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T14:59:04.851 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T14:59:04.896 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T14:59:05.009 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T14:59:05.024 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-13T14:59:05.058 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T14:59:05.233 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T14:59:05.255 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T14:59:05.397 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T14:59:05.411 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-13T14:59:05.455 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-13T14:59:05.541 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T14:59:05.869 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T14:59:05.890 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T14:59:05.908 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T14:59:05.923 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T14:59:05.926 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T14:59:05.966 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T14:59:06.414 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T14:59:06.436 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T14:59:06.481 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T14:59:06.626 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T14:59:06.641 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-13T14:59:06.686 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-13T14:59:06.909 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T14:59:06.930 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T14:59:06.975 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T14:59:07.006 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pygments. 2024-09-13T14:59:07.021 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-13T14:59:07.064 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T14:59:07.252 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T14:59:07.271 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T14:59:07.311 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T14:59:07.535 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T14:59:07.550 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-13T14:59:07.593 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-13T14:59:07.896 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T14:59:07.911 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-13T14:59:07.954 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-13T14:59:08.048 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package radosgw. 2024-09-13T14:59:08.071 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../113-radosgw_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:59:08.114 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking radosgw (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:08.249 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T14:59:08.264 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-13T14:59:08.307 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-13T14:59:08.834 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T14:59:08.856 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../114-rbd-fuse_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:59:08.900 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking rbd-fuse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:09.053 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package radosgw. 2024-09-13T14:59:09.068 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../113-radosgw_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:59:09.111 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking radosgw (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:09.202 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T14:59:09.472 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T14:59:09.598 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T14:59:09.681 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T14:59:09.695 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../114-rbd-fuse_18.2.4-850-g50bbe7f3-1jammy_amd64.deb ... 2024-09-13T14:59:09.739 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking rbd-fuse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:09.859 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T14:59:10.067 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-13T14:59:10.227 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T14:59:10.344 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-13T14:59:10.470 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-13T14:59:10.689 INFO:teuthology.orchestra.run.smithi077.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T14:59:10.736 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-13T14:59:10.783 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up cephadm (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:11.162 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-13T14:59:11.241 INFO:teuthology.orchestra.run.smithi077.stdout:Adding system user cephadm....done 2024-09-13T14:59:11.389 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T14:59:11.673 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T14:59:11.770 INFO:teuthology.orchestra.run.smithi007.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-13T14:59:11.806 INFO:teuthology.orchestra.run.smithi007.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-13T14:59:11.855 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up cephadm (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:11.916 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T14:59:12.042 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T14:59:12.293 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T14:59:12.399 INFO:teuthology.orchestra.run.smithi007.stdout:Adding system user cephadm....done 2024-09-13T14:59:12.544 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T14:59:12.578 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-13T14:59:12.670 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T14:59:12.854 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-13T14:59:12.997 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T14:59:13.106 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-13T14:59:13.232 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-13T14:59:13.357 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T14:59:13.508 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T14:59:13.608 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-13T14:59:13.785 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-13T14:59:13.859 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T14:59:13.935 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-13T14:59:14.135 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T14:59:14.254 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-13T14:59:14.386 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T14:59:14.631 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-13T14:59:14.671 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T14:59:14.922 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-ceph-argparse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:14.932 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-13T14:59:15.208 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-13T14:59:15.256 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T14:59:15.382 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-13T14:59:15.518 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-13T14:59:15.633 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T14:59:15.777 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-13T14:59:15.884 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T14:59:15.993 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T14:59:16.079 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-13T14:59:16.346 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-ceph-argparse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:16.370 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T14:59:16.504 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T14:59:16.606 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-13T14:59:16.732 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-13T14:59:16.772 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T14:59:17.008 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-13T14:59:17.039 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T14:59:17.309 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-13T14:59:17.357 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T14:59:17.435 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-13T14:59:17.811 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-13T14:59:17.937 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-13T14:59:18.034 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T14:59:18.205 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-13T14:59:18.302 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T14:59:18.428 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T14:59:18.481 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-13T14:59:18.562 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T14:59:18.791 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-13T14:59:18.864 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T14:59:19.240 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T14:59:19.491 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T14:59:19.543 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-13T14:59:19.819 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-13T14:59:19.867 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T14:59:19.921 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-13T14:59:20.021 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-13T14:59:20.152 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-13T14:59:20.348 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-13T14:59:20.461 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T14:59:20.741 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-13T14:59:20.805 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T14:59:21.009 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-13T14:59:21.056 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T14:59:21.165 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-ceph-common (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:21.483 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T14:59:21.652 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-13T14:59:21.817 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T14:59:21.961 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-13T14:59:22.264 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-13T14:59:22.606 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-13T14:59:22.857 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-13T14:59:22.991 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-ceph-common (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:23.014 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T14:59:23.140 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T14:59:23.301 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-13T14:59:23.400 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T14:59:23.526 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T14:59:23.652 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T14:59:23.660 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-13T14:59:23.945 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T14:59:24.204 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T14:59:24.455 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T14:59:24.581 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T14:59:24.707 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T14:59:24.933 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T14:59:25.009 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T14:59:25.067 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-13T14:59:25.268 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T14:59:25.369 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-13T14:59:25.495 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-13T14:59:25.527 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T14:59:25.621 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-13T14:59:25.779 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T14:59:25.955 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-13T14:59:26.124 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T14:59:26.207 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-13T14:59:26.525 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T14:59:26.572 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T14:59:26.650 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-09-13T14:59:26.698 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T14:59:26.801 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-13T14:59:26.975 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T14:59:27.100 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T14:59:27.128 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-13T14:59:27.393 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T14:59:27.396 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-13T14:59:27.647 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-13T14:59:27.694 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T14:59:27.923 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T14:59:27.945 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T14:59:28.191 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-13T14:59:28.414 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T14:59:28.476 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-13T14:59:28.601 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-13T14:59:28.682 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T14:59:28.808 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T14:59:28.903 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-13T14:59:29.012 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-13T14:59:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T14:59:29.297 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-13T14:59:29.452 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T14:59:29.589 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-13T14:59:29.711 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T14:59:29.837 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T14:59:29.857 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-13T14:59:30.163 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T14:59:30.272 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-13T14:59:30.490 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T14:59:30.527 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-13T14:59:30.653 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-13T14:59:30.766 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T14:59:30.892 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T14:59:31.080 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-13T14:59:31.176 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T14:59:31.339 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-13T14:59:31.444 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T14:59:31.607 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-13T14:59:31.687 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T14:59:31.733 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-13T14:59:32.063 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T14:59:32.067 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-13T14:59:32.356 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T14:59:32.419 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-13T14:59:32.708 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T14:59:32.711 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-13T14:59:32.834 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up librados2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:32.837 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-13T14:59:32.960 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up librgw2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:33.105 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-13T14:59:33.147 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libsqlite3-mod-ceph (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:33.265 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libcephfs2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:33.390 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libradosstriper1 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:33.398 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-13T14:59:33.517 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T14:59:33.683 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-13T14:59:33.793 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up librbd1 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:33.919 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-modules-core (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:34.028 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-fuse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:34.084 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T14:59:34.236 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T14:59:34.236 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T14:59:34.386 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-13T14:59:34.717 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libcephfs-dev (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:34.738 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-13T14:59:34.831 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-rados (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:34.881 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librados2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:34.957 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up cephfs-top (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:35.006 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librgw2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:35.100 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T14:59:35.210 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libsqlite3-mod-ceph (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:35.336 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libcephfs2 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:35.462 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libradosstriper1 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:35.596 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-13T14:59:35.881 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up librbd1 (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:36.016 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-modules-core (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:36.142 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-fuse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:36.312 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-rbd (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:36.363 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T14:59:36.363 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T14:59:36.413 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up rbd-fuse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:36.748 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-rgw (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:36.915 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cephfs (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:37.041 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up cephfs-shell (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:37.044 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libcephfs-dev (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:37.167 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-common (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:37.179 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rados (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:37.279 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up cephfs-top (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:37.389 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-13T14:59:37.685 INFO:teuthology.orchestra.run.smithi077.stdout:Adding group ceph....done 2024-09-13T14:59:38.053 INFO:teuthology.orchestra.run.smithi077.stdout:Adding system user ceph....done 2024-09-13T14:59:38.214 INFO:teuthology.orchestra.run.smithi077.stdout:Setting system user ceph properties....done 2024-09-13T14:59:38.229 INFO:teuthology.orchestra.run.smithi077.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T14:59:38.365 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T14:59:38.718 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rbd (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:38.747 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T14:59:38.895 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up rbd-fuse (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:38.996 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-rgw (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:39.097 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up python3-cephfs (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:39.223 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up cephfs-shell (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:39.276 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up cephfs-mirror (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:39.357 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-common (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:39.604 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T14:59:39.604 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T14:59:39.953 INFO:teuthology.orchestra.run.smithi007.stdout:Adding group ceph....done 2024-09-13T14:59:40.094 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-test (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:40.195 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up radosgw (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:40.320 INFO:teuthology.orchestra.run.smithi007.stdout:Adding system user ceph....done 2024-09-13T14:59:40.515 INFO:teuthology.orchestra.run.smithi007.stdout:Setting system user ceph properties....done 2024-09-13T14:59:40.534 INFO:teuthology.orchestra.run.smithi007.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T14:59:40.642 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T14:59:40.643 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T14:59:40.682 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T14:59:41.105 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T14:59:41.141 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-base (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:41.495 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T14:59:41.776 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up cephfs-mirror (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:41.999 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T14:59:41.999 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T14:59:42.008 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mds (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:42.230 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T14:59:42.230 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T14:59:42.644 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-test (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:42.726 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:42.803 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up radosgw (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:42.939 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T14:59:42.940 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T14:59:43.342 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T14:59:43.343 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T14:59:43.461 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-osd (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:43.747 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T14:59:43.747 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T14:59:43.955 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-base (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:44.288 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-k8sevents (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:44.328 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T14:59:44.414 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:44.565 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mon (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:44.778 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T14:59:44.778 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T14:59:44.974 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mds (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:45.203 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T14:59:45.203 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T14:59:45.291 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-cephadm (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:45.442 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:45.568 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-dashboard (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:45.703 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-volume (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:45.851 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:46.039 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T14:59:46.071 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T14:59:46.071 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T14:59:46.719 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-osd (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:47.071 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T14:59:47.072 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T14:59:47.215 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T14:59:47.691 INFO:teuthology.orchestra.run.smithi077.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T14:59:47.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T14:59:47.729 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-k8sevents (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:47.751 INFO:teuthology.orchestra.run.smithi077.stdout:Reading package lists... 2024-09-13T14:59:47.838 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:47.968 INFO:teuthology.orchestra.run.smithi077.stdout:Building dependency tree... 2024-09-13T14:59:47.968 INFO:teuthology.orchestra.run.smithi077.stdout:Reading state information... 2024-09-13T14:59:47.981 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mon (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:48.163 INFO:teuthology.orchestra.run.smithi077.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-13T14:59:48.163 INFO:teuthology.orchestra.run.smithi077.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-13T14:59:48.163 INFO:teuthology.orchestra.run.smithi077.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-13T14:59:48.163 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T14:59:48.164 INFO:teuthology.orchestra.run.smithi077.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T14:59:48.164 INFO:teuthology.orchestra.run.smithi077.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T14:59:48.164 INFO:teuthology.orchestra.run.smithi077.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T14:59:48.164 INFO:teuthology.orchestra.run.smithi077.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-13T14:59:48.164 INFO:teuthology.orchestra.run.smithi077.stdout: python2.7-minimal 2024-09-13T14:59:48.165 INFO:teuthology.orchestra.run.smithi077.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T14:59:48.165 INFO:teuthology.orchestra.run.smithi077.stdout:The following additional packages will be installed: 2024-09-13T14:59:48.165 INFO:teuthology.orchestra.run.smithi077.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-13T14:59:48.165 INFO:teuthology.orchestra.run.smithi077.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-13T14:59:48.166 INFO:teuthology.orchestra.run.smithi077.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-13T14:59:48.166 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-13T14:59:48.166 INFO:teuthology.orchestra.run.smithi077.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T14:59:48.167 INFO:teuthology.orchestra.run.smithi077.stdout:Suggested packages: 2024-09-13T14:59:48.167 INFO:teuthology.orchestra.run.smithi077.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-13T14:59:48.167 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-13T14:59:48.167 INFO:teuthology.orchestra.run.smithi077.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-13T14:59:48.208 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T14:59:48.208 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T14:59:48.208 INFO:teuthology.orchestra.run.smithi077.stdout:The following NEW packages will be installed: 2024-09-13T14:59:48.209 INFO:teuthology.orchestra.run.smithi077.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-13T14:59:48.209 INFO:teuthology.orchestra.run.smithi077.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-13T14:59:48.210 INFO:teuthology.orchestra.run.smithi077.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-13T14:59:48.210 INFO:teuthology.orchestra.run.smithi077.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-13T14:59:48.210 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-13T14:59:48.210 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-13T14:59:48.210 INFO:teuthology.orchestra.run.smithi077.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T14:59:48.212 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages will be upgraded: 2024-09-13T14:59:48.212 INFO:teuthology.orchestra.run.smithi077.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-13T14:59:48.263 INFO:teuthology.orchestra.run.smithi077.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-13T14:59:48.263 INFO:teuthology.orchestra.run.smithi077.stdout:Need to get 55.8 MB of archives. 2024-09-13T14:59:48.263 INFO:teuthology.orchestra.run.smithi077.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-13T14:59:48.263 INFO:teuthology.orchestra.run.smithi077.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-13T14:59:48.397 INFO:teuthology.orchestra.run.smithi077.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-13T14:59:48.403 INFO:teuthology.orchestra.run.smithi077.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-13T14:59:48.442 INFO:teuthology.orchestra.run.smithi077.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-13T14:59:48.443 INFO:teuthology.orchestra.run.smithi077.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-13T14:59:48.444 INFO:teuthology.orchestra.run.smithi077.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-13T14:59:48.454 INFO:teuthology.orchestra.run.smithi077.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-13T14:59:48.455 INFO:teuthology.orchestra.run.smithi077.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-13T14:59:48.457 INFO:teuthology.orchestra.run.smithi077.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-13T14:59:48.458 INFO:teuthology.orchestra.run.smithi077.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-13T14:59:48.459 INFO:teuthology.orchestra.run.smithi077.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-13T14:59:48.460 INFO:teuthology.orchestra.run.smithi077.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-13T14:59:48.461 INFO:teuthology.orchestra.run.smithi077.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-13T14:59:48.478 INFO:teuthology.orchestra.run.smithi077.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-13T14:59:48.478 INFO:teuthology.orchestra.run.smithi077.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-13T14:59:48.479 INFO:teuthology.orchestra.run.smithi077.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-13T14:59:48.807 INFO:teuthology.orchestra.run.smithi077.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-13T14:59:48.810 INFO:teuthology.orchestra.run.smithi077.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-13T14:59:48.810 INFO:teuthology.orchestra.run.smithi077.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-13T14:59:48.813 INFO:teuthology.orchestra.run.smithi077.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-13T14:59:48.813 INFO:teuthology.orchestra.run.smithi077.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-13T14:59:48.819 INFO:teuthology.orchestra.run.smithi077.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-13T14:59:48.821 INFO:teuthology.orchestra.run.smithi077.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-13T14:59:48.829 INFO:teuthology.orchestra.run.smithi077.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-13T14:59:48.829 INFO:teuthology.orchestra.run.smithi077.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-13T14:59:48.856 INFO:teuthology.orchestra.run.smithi077.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-13T14:59:48.856 INFO:teuthology.orchestra.run.smithi077.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-13T14:59:48.866 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-cephadm (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:48.867 INFO:teuthology.orchestra.run.smithi077.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-13T14:59:48.887 INFO:teuthology.orchestra.run.smithi077.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-13T14:59:48.890 INFO:teuthology.orchestra.run.smithi077.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-13T14:59:48.890 INFO:teuthology.orchestra.run.smithi077.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-13T14:59:48.890 INFO:teuthology.orchestra.run.smithi077.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-13T14:59:48.891 INFO:teuthology.orchestra.run.smithi077.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-13T14:59:48.901 INFO:teuthology.orchestra.run.smithi077.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-13T14:59:48.902 INFO:teuthology.orchestra.run.smithi077.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-13T14:59:49.009 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:49.103 INFO:teuthology.orchestra.run.smithi077.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-13T14:59:49.104 INFO:teuthology.orchestra.run.smithi077.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-13T14:59:49.104 INFO:teuthology.orchestra.run.smithi077.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-13T14:59:49.104 INFO:teuthology.orchestra.run.smithi077.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-13T14:59:49.104 INFO:teuthology.orchestra.run.smithi077.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-13T14:59:49.104 INFO:teuthology.orchestra.run.smithi077.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-13T14:59:49.115 INFO:teuthology.orchestra.run.smithi077.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-13T14:59:49.116 INFO:teuthology.orchestra.run.smithi077.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-13T14:59:49.135 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-mgr-dashboard (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:49.319 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ceph-volume (18.2.4-850-g50bbe7f3-1jammy) ... 2024-09-13T14:59:49.526 INFO:teuthology.orchestra.run.smithi077.stdout:Preconfiguring packages ... 2024-09-13T14:59:49.664 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T14:59:49.685 INFO:teuthology.orchestra.run.smithi077.stdout:Fetched 55.8 MB in 1s (62.2 MB/s) 2024-09-13T14:59:50.081 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137745 files and directories currently installed.) 2024-09-13T14:59:50.086 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T14:59:50.237 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T14:59:50.848 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-13T14:59:50.848 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T14:59:51.342 INFO:teuthology.orchestra.run.smithi007.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T14:59:51.347 DEBUG:teuthology.orchestra.run.smithi007:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T14:59:51.426 INFO:teuthology.orchestra.run.smithi007.stdout:Reading package lists... 2024-09-13T14:59:51.620 INFO:teuthology.orchestra.run.smithi007.stdout:Building dependency tree... 2024-09-13T14:59:51.621 INFO:teuthology.orchestra.run.smithi007.stdout:Reading state information... 2024-09-13T14:59:51.814 INFO:teuthology.orchestra.run.smithi007.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-13T14:59:51.814 INFO:teuthology.orchestra.run.smithi007.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-13T14:59:51.814 INFO:teuthology.orchestra.run.smithi007.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-13T14:59:51.814 INFO:teuthology.orchestra.run.smithi007.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T14:59:51.814 INFO:teuthology.orchestra.run.smithi007.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-13T14:59:51.814 INFO:teuthology.orchestra.run.smithi007.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-13T14:59:51.814 INFO:teuthology.orchestra.run.smithi007.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-13T14:59:51.815 INFO:teuthology.orchestra.run.smithi007.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-13T14:59:51.815 INFO:teuthology.orchestra.run.smithi007.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-13T14:59:51.815 INFO:teuthology.orchestra.run.smithi007.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T14:59:51.816 INFO:teuthology.orchestra.run.smithi007.stdout:The following additional packages will be installed: 2024-09-13T14:59:51.816 INFO:teuthology.orchestra.run.smithi007.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-13T14:59:51.816 INFO:teuthology.orchestra.run.smithi007.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-13T14:59:51.817 INFO:teuthology.orchestra.run.smithi077.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-13T14:59:51.817 INFO:teuthology.orchestra.run.smithi007.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-13T14:59:51.817 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-13T14:59:51.817 INFO:teuthology.orchestra.run.smithi007.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T14:59:51.818 INFO:teuthology.orchestra.run.smithi007.stdout:Suggested packages: 2024-09-13T14:59:51.818 INFO:teuthology.orchestra.run.smithi007.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-13T14:59:51.818 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-13T14:59:51.818 INFO:teuthology.orchestra.run.smithi007.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-13T14:59:51.877 INFO:teuthology.orchestra.run.smithi007.stdout:The following NEW packages will be installed: 2024-09-13T14:59:51.877 INFO:teuthology.orchestra.run.smithi007.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-13T14:59:51.877 INFO:teuthology.orchestra.run.smithi007.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-13T14:59:51.878 INFO:teuthology.orchestra.run.smithi007.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-13T14:59:51.878 INFO:teuthology.orchestra.run.smithi007.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-13T14:59:51.878 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-13T14:59:51.878 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-13T14:59:51.878 INFO:teuthology.orchestra.run.smithi007.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T14:59:51.879 INFO:teuthology.orchestra.run.smithi007.stdout:The following packages will be upgraded: 2024-09-13T14:59:51.880 INFO:teuthology.orchestra.run.smithi007.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-13T14:59:52.067 INFO:teuthology.orchestra.run.smithi007.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-13T14:59:52.067 INFO:teuthology.orchestra.run.smithi007.stdout:Need to get 55.8 MB of archives. 2024-09-13T14:59:52.067 INFO:teuthology.orchestra.run.smithi007.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-13T14:59:52.067 INFO:teuthology.orchestra.run.smithi007.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-13T14:59:52.077 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package flex. 2024-09-13T14:59:52.156 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137745 files and directories currently installed.) 2024-09-13T14:59:52.161 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-13T14:59:52.252 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-13T14:59:52.691 INFO:teuthology.orchestra.run.smithi007.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-13T14:59:52.707 INFO:teuthology.orchestra.run.smithi007.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-13T14:59:52.771 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T14:59:52.832 INFO:teuthology.orchestra.run.smithi007.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-13T14:59:52.832 INFO:teuthology.orchestra.run.smithi007.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-13T14:59:52.833 INFO:teuthology.orchestra.run.smithi007.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-13T14:59:52.862 INFO:teuthology.orchestra.run.smithi007.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-13T14:59:52.863 INFO:teuthology.orchestra.run.smithi007.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-13T14:59:52.866 INFO:teuthology.orchestra.run.smithi007.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-13T14:59:52.869 INFO:teuthology.orchestra.run.smithi007.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-13T14:59:52.870 INFO:teuthology.orchestra.run.smithi007.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-13T14:59:52.872 INFO:teuthology.orchestra.run.smithi007.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-13T14:59:52.938 INFO:teuthology.orchestra.run.smithi007.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-13T14:59:52.938 INFO:teuthology.orchestra.run.smithi007.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-13T14:59:52.938 INFO:teuthology.orchestra.run.smithi007.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-13T14:59:52.942 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-13T14:59:53.021 INFO:teuthology.orchestra.run.smithi007.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-13T14:59:53.341 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T14:59:53.702 INFO:teuthology.orchestra.run.smithi007.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-13T14:59:53.704 INFO:teuthology.orchestra.run.smithi007.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-13T14:59:53.704 INFO:teuthology.orchestra.run.smithi007.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-13T14:59:53.707 INFO:teuthology.orchestra.run.smithi007.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-13T14:59:53.708 INFO:teuthology.orchestra.run.smithi007.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-13T14:59:53.712 INFO:teuthology.orchestra.run.smithi007.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-13T14:59:53.714 INFO:teuthology.orchestra.run.smithi007.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-13T14:59:53.762 INFO:teuthology.orchestra.run.smithi007.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-13T14:59:53.762 INFO:teuthology.orchestra.run.smithi007.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-13T14:59:53.839 INFO:teuthology.orchestra.run.smithi007.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-13T14:59:53.844 INFO:teuthology.orchestra.run.smithi007.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-13T14:59:53.847 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137818 files and directories currently installed.) 2024-09-13T14:59:53.851 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T14:59:53.857 INFO:teuthology.orchestra.run.smithi007.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-13T14:59:53.931 INFO:teuthology.orchestra.run.smithi007.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-13T14:59:53.938 INFO:teuthology.orchestra.run.smithi007.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-13T14:59:53.939 INFO:teuthology.orchestra.run.smithi007.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-13T14:59:53.939 INFO:teuthology.orchestra.run.smithi007.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-13T14:59:53.940 INFO:teuthology.orchestra.run.smithi007.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-13T14:59:53.955 INFO:teuthology.orchestra.run.smithi007.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-13T14:59:53.956 INFO:teuthology.orchestra.run.smithi007.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-13T14:59:53.983 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T14:59:54.403 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T14:59:54.444 INFO:teuthology.orchestra.run.smithi007.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-13T14:59:54.445 INFO:teuthology.orchestra.run.smithi007.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-13T14:59:54.445 INFO:teuthology.orchestra.run.smithi007.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-13T14:59:54.445 INFO:teuthology.orchestra.run.smithi007.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-13T14:59:54.445 INFO:teuthology.orchestra.run.smithi007.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-13T14:59:54.445 INFO:teuthology.orchestra.run.smithi007.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-13T14:59:54.459 INFO:teuthology.orchestra.run.smithi007.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-13T14:59:54.459 INFO:teuthology.orchestra.run.smithi007.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-13T14:59:54.532 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T14:59:54.847 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T14:59:54.860 INFO:teuthology.orchestra.run.smithi007.stdout:Preconfiguring packages ... 2024-09-13T14:59:55.012 INFO:teuthology.orchestra.run.smithi007.stdout:Fetched 55.8 MB in 3s (21.7 MB/s) 2024-09-13T14:59:55.199 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package bison. 2024-09-13T14:59:55.251 INFO:teuthology.orchestra.run.smithi007.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140169 files and directories currently installed.) 2024-09-13T14:59:55.254 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T14:59:55.285 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137818 files and directories currently installed.) 2024-09-13T14:59:55.289 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-13T14:59:55.343 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T14:59:55.398 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T14:59:55.728 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T14:59:55.749 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-13T14:59:55.794 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T14:59:56.057 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-13T14:59:56.131 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package dump. 2024-09-13T14:59:56.152 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-13T14:59:56.197 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking dump (0.4b47-3) ... 2024-09-13T14:59:56.577 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package indent. 2024-09-13T14:59:56.599 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T14:59:56.643 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T14:59:56.879 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T14:59:56.892 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-13T14:59:56.929 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T14:59:57.189 INFO:teuthology.orchestra.run.smithi007.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-13T14:59:57.402 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T14:59:57.423 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-13T14:59:57.468 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T14:59:57.548 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package flex. 2024-09-13T14:59:57.621 INFO:teuthology.orchestra.run.smithi007.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140169 files and directories currently installed.) 2024-09-13T14:59:57.624 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-13T14:59:57.663 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-13T14:59:57.713 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T14:59:57.737 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-13T14:59:57.780 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T14:59:58.125 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-13T14:59:58.147 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-13T14:59:58.192 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T14:59:58.217 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T14:59:58.386 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-13T14:59:58.428 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-13T14:59:58.440 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-13T14:59:58.478 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T14:59:58.689 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libjson-perl. 2024-09-13T14:59:58.702 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-13T14:59:58.730 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-13T14:59:58.770 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T14:59:59.042 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-13T14:59:59.065 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-13T14:59:59.109 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T14:59:59.325 INFO:teuthology.orchestra.run.smithi007.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140242 files and directories currently installed.) 2024-09-13T14:59:59.329 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T14:59:59.461 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T14:59:59.874 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-13T14:59:59.992 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-13T15:00:00.309 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T15:00:00.677 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package bison. 2024-09-13T15:00:00.753 INFO:teuthology.orchestra.run.smithi007.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140242 files and directories currently installed.) 2024-09-13T15:00:00.757 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-13T15:00:00.762 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T15:00:00.784 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:00:00.813 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T15:00:00.854 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T15:00:01.107 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T15:00:01.119 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:00:01.148 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T15:00:01.230 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T15:00:01.246 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-13T15:00:01.288 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T15:00:01.443 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T15:00:01.465 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T15:00:01.510 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T15:00:01.650 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package dump. 2024-09-13T15:00:01.666 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-13T15:00:01.708 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking dump (0.4b47-3) ... 2024-09-13T15:00:01.854 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T15:00:01.877 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-13T15:00:01.921 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T15:00:01.988 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package indent. 2024-09-13T15:00:02.004 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T15:00:02.046 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T15:00:02.232 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T15:00:02.254 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T15:00:02.290 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T15:00:02.290 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T15:00:02.306 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-13T15:00:02.374 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T15:00:02.686 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T15:00:02.702 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-13T15:00:02.744 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T15:00:02.762 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T15:00:02.784 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T15:00:02.828 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:00:03.023 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T15:00:03.039 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-13T15:00:03.073 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T15:00:03.123 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T15:00:03.145 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T15:00:03.189 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T15:00:03.376 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-13T15:00:03.392 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-13T15:00:03.443 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T15:00:03.492 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T15:00:03.505 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T15:00:03.542 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T15:00:03.695 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-13T15:00:03.711 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-13T15:00:03.778 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T15:00:03.786 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T15:00:03.809 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T15:00:03.853 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T15:00:04.023 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libjson-perl. 2024-09-13T15:00:04.039 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-13T15:00:04.081 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-13T15:00:04.324 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T15:00:04.337 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-13T15:00:04.365 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T15:00:04.393 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-13T15:00:04.409 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-13T15:00:04.451 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T15:00:04.711 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package modemmanager. 2024-09-13T15:00:04.733 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T15:00:04.777 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T15:00:05.468 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package network-manager. 2024-09-13T15:00:05.489 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T15:00:05.547 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-13T15:00:05.854 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T15:00:05.871 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:00:05.912 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T15:00:06.132 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T15:00:06.142 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ppp. 2024-09-13T15:00:06.149 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T15:00:06.164 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-13T15:00:06.215 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T15:00:06.449 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T15:00:06.527 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T15:00:06.543 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T15:00:06.585 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T15:00:06.731 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T15:00:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-13T15:00:06.797 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-13T15:00:06.930 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T15:00:06.946 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-13T15:00:07.013 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T15:00:07.034 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T15:00:07.046 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-13T15:00:07.084 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-13T15:00:07.300 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T15:00:07.316 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T15:00:07.349 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T15:00:07.387 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T15:00:07.409 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-13T15:00:07.453 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-client-common (238) ... 2024-09-13T15:00:07.741 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-13T15:00:07.762 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T15:00:07.807 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:00:08.162 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T15:00:08.178 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T15:00:08.220 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:00:08.531 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T15:00:08.548 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T15:00:08.589 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T15:00:08.859 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T15:00:08.876 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-13T15:00:08.926 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T15:00:09.170 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T15:00:09.186 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-13T15:00:09.237 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T15:00:09.247 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T15:00:09.269 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-13T15:00:09.332 INFO:teuthology.orchestra.run.smithi077.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T15:00:09.362 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-common (238) ... 2024-09-13T15:00:09.766 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T15:00:09.782 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-13T15:00:09.824 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T15:00:09.830 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-14. 2024-09-13T15:00:09.852 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T15:00:09.891 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:00:10.152 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package modemmanager. 2024-09-13T15:00:10.169 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-13T15:00:10.210 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T15:00:10.967 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package network-manager. 2024-09-13T15:00:10.984 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-13T15:00:11.034 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-13T15:00:11.242 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql. 2024-09-13T15:00:11.265 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-13T15:00:11.308 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql (14+238) ... 2024-09-13T15:00:11.561 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T15:00:11.574 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-13T15:00:11.611 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-client (14+238) ... 2024-09-13T15:00:11.666 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package ppp. 2024-09-13T15:00:11.683 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-13T15:00:11.838 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T15:00:11.850 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-13T15:00:11.879 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-13T15:00:12.028 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T15:00:12.199 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package tcl8.6. 2024-09-13T15:00:12.221 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-13T15:00:12.265 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T15:00:12.372 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T15:00:12.387 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-13T15:00:12.430 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-13T15:00:12.552 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package tcl. 2024-09-13T15:00:12.574 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-13T15:00:12.623 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-13T15:00:12.708 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T15:00:12.723 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-13T15:00:12.766 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-13T15:00:12.971 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T15:00:12.993 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-13T15:00:13.029 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T15:00:13.230 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T15:00:13.246 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-13T15:00:13.287 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking postgresql-client-common (238) ... 2024-09-13T15:00:13.376 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T15:00:13.398 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-13T15:00:13.442 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-13T15:00:13.592 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-13T15:00:13.608 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T15:00:13.641 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:00:13.804 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T15:00:13.826 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-13T15:00:13.913 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T15:00:14.196 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-client-common (238) ... 2024-09-13T15:00:14.197 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T15:00:14.213 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-13T15:00:14.274 INFO:teuthology.orchestra.run.smithi007.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T15:00:14.321 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking postgresql-common (238) ... 2024-09-13T15:00:14.361 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-13T15:00:14.487 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T15:00:14.613 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:00:14.739 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T15:00:14.779 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package postgresql-14. 2024-09-13T15:00:14.795 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-13T15:00:14.840 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T15:00:14.841 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:00:14.966 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:00:15.477 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T15:00:15.555 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T15:00:15.908 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T15:00:15.909 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T15:00:15.966 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package postgresql. 2024-09-13T15:00:15.981 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-13T15:00:16.024 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking postgresql (14+238) ... 2024-09-13T15:00:16.268 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T15:00:16.283 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-13T15:00:16.326 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking postgresql-client (14+238) ... 2024-09-13T15:00:16.483 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T15:00:16.546 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T15:00:16.561 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-13T15:00:16.595 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-13T15:00:16.609 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T15:00:16.735 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T15:00:16.861 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-13T15:00:16.906 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package tcl8.6. 2024-09-13T15:00:16.923 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-13T15:00:16.964 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T15:00:16.987 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T15:00:17.113 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T15:00:17.239 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T15:00:17.251 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package tcl. 2024-09-13T15:00:17.267 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-13T15:00:17.330 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-13T15:00:17.365 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T15:00:17.645 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T15:00:17.662 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-13T15:00:17.695 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T15:00:17.946 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T15:00:18.008 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T15:00:18.024 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-13T15:00:18.066 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-13T15:00:18.072 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up dump (0.4b47-3) ... 2024-09-13T15:00:18.166 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T15:00:18.299 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T15:00:18.441 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T15:00:18.478 INFO:teuthology.orchestra.run.smithi007.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T15:00:18.494 INFO:teuthology.orchestra.run.smithi007.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-13T15:00:18.545 INFO:teuthology.orchestra.run.smithi007.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T15:00:18.551 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-13T15:00:18.660 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-13T15:00:18.761 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T15:00:18.813 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up postgresql-client-common (238) ... 2024-09-13T15:00:18.844 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-13T15:00:18.905 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T15:00:19.000 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-13T15:00:19.135 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-13T15:00:19.253 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:00:19.356 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T15:00:19.379 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-13T15:00:19.505 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-13T15:00:19.631 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:00:19.708 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T15:00:19.809 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T15:00:19.910 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-13T15:00:20.078 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-client (14+238) ... 2024-09-13T15:00:20.204 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-13T15:00:20.603 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T15:00:20.695 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:20.696 INFO:teuthology.orchestra.run.smithi077.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T15:00:20.696 INFO:teuthology.orchestra.run.smithi077.stdout:which means they are currently configured by ifupdown: 2024-09-13T15:00:20.696 INFO:teuthology.orchestra.run.smithi077.stdout:- enp3s0f1 2024-09-13T15:00:20.696 INFO:teuthology.orchestra.run.smithi077.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T15:00:20.696 INFO:teuthology.orchestra.run.smithi077.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T15:00:20.696 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:20.729 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-13T15:00:20.822 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T15:00:21.116 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T15:00:21.116 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T15:00:21.174 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T15:00:21.497 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T15:00:21.874 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-13T15:00:21.999 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-13T15:00:22.040 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T15:00:22.125 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-13T15:00:22.192 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T15:00:22.251 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-13T15:00:22.343 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-13T15:00:22.411 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-13T15:00:22.444 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-common (238) ... 2024-09-13T15:00:22.537 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-13T15:00:22.646 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-13T15:00:22.748 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-13T15:00:23.312 INFO:teuthology.orchestra.run.smithi077.stdout:Adding user postgres to group ssl-cert 2024-09-13T15:00:23.499 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:23.500 INFO:teuthology.orchestra.run.smithi077.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T15:00:23.671 INFO:teuthology.orchestra.run.smithi077.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T15:00:23.671 INFO:teuthology.orchestra.run.smithi077.stdout:Removing obsolete dictionary files: 2024-09-13T15:00:23.803 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-13T15:00:23.921 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up dump (0.4b47-3) ... 2024-09-13T15:00:24.000 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T15:00:24.048 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T15:00:24.166 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-13T15:00:24.240 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T15:00:24.325 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-13T15:00:24.451 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-13T15:00:24.585 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-13T15:00:24.613 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:00:24.676 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-13T15:00:24.745 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-13T15:00:24.863 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-13T15:00:24.925 INFO:teuthology.orchestra.run.smithi077.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-13T15:00:24.949 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-13T15:00:24.993 INFO:teuthology.orchestra.run.smithi077.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T15:00:24.993 INFO:teuthology.orchestra.run.smithi077.stdout:This user must also own the server process. 2024-09-13T15:00:24.994 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:24.994 INFO:teuthology.orchestra.run.smithi077.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T15:00:24.994 INFO:teuthology.orchestra.run.smithi077.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T15:00:24.994 INFO:teuthology.orchestra.run.smithi077.stdout:The default text search configuration will be set to "english". 2024-09-13T15:00:24.994 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:24.994 INFO:teuthology.orchestra.run.smithi077.stdout:Data page checksums are disabled. 2024-09-13T15:00:24.994 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:24.994 INFO:teuthology.orchestra.run.smithi077.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-13T15:00:24.994 INFO:teuthology.orchestra.run.smithi077.stdout:creating subdirectories ... ok 2024-09-13T15:00:24.994 INFO:teuthology.orchestra.run.smithi077.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T15:00:25.006 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-13T15:00:25.012 INFO:teuthology.orchestra.run.smithi077.stdout:selecting default max_connections ... 100 2024-09-13T15:00:25.025 INFO:teuthology.orchestra.run.smithi077.stdout:selecting default shared_buffers ... 128MB 2024-09-13T15:00:25.032 INFO:teuthology.orchestra.run.smithi077.stdout:selecting default time zone ... Etc/UTC 2024-09-13T15:00:25.033 INFO:teuthology.orchestra.run.smithi077.stdout:creating configuration files ... ok 2024-09-13T15:00:25.135 INFO:teuthology.orchestra.run.smithi077.stdout:running bootstrap script ... ok 2024-09-13T15:00:25.141 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T15:00:25.267 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-13T15:00:25.435 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up postgresql-client (14+238) ... 2024-09-13T15:00:25.569 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-13T15:00:25.815 INFO:teuthology.orchestra.run.smithi077.stdout:performing post-bootstrap initialization ... ok 2024-09-13T15:00:26.158 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:26.158 INFO:teuthology.orchestra.run.smithi007.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T15:00:26.158 INFO:teuthology.orchestra.run.smithi007.stdout:which means they are currently configured by ifupdown: 2024-09-13T15:00:26.158 INFO:teuthology.orchestra.run.smithi007.stdout:- ens1f0 2024-09-13T15:00:26.158 INFO:teuthology.orchestra.run.smithi007.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T15:00:26.158 INFO:teuthology.orchestra.run.smithi007.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T15:00:26.158 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:26.296 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T15:00:26.542 INFO:teuthology.orchestra.run.smithi077.stdout:syncing data to disk ... ok 2024-09-13T15:00:26.730 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T15:00:26.925 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T15:00:27.149 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T15:00:27.855 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-13T15:00:27.990 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-13T15:00:28.099 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-13T15:00:28.209 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up postgresql-common (238) ... 2024-09-13T15:00:29.173 INFO:teuthology.orchestra.run.smithi007.stdout:Adding user postgres to group ssl-cert 2024-09-13T15:00:29.418 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:29.419 INFO:teuthology.orchestra.run.smithi007.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T15:00:29.678 INFO:teuthology.orchestra.run.smithi007.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T15:00:29.678 INFO:teuthology.orchestra.run.smithi007.stdout:Removing obsolete dictionary files: 2024-09-13T15:00:29.770 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T15:00:29.880 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-13T15:00:30.006 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql (14+238) ... 2024-09-13T15:00:30.132 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T15:00:30.258 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T15:00:30.388 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T15:00:30.511 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T15:00:30.511 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T15:00:30.852 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-13T15:00:31.096 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T15:00:31.231 INFO:teuthology.orchestra.run.smithi007.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-13T15:00:31.246 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-13T15:00:31.300 INFO:teuthology.orchestra.run.smithi007.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T15:00:31.300 INFO:teuthology.orchestra.run.smithi007.stdout:This user must also own the server process. 2024-09-13T15:00:31.300 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:31.300 INFO:teuthology.orchestra.run.smithi007.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T15:00:31.300 INFO:teuthology.orchestra.run.smithi007.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T15:00:31.301 INFO:teuthology.orchestra.run.smithi007.stdout:The default text search configuration will be set to "english". 2024-09-13T15:00:31.301 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:31.301 INFO:teuthology.orchestra.run.smithi007.stdout:Data page checksums are disabled. 2024-09-13T15:00:31.301 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:31.301 INFO:teuthology.orchestra.run.smithi007.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-13T15:00:31.301 INFO:teuthology.orchestra.run.smithi007.stdout:creating subdirectories ... ok 2024-09-13T15:00:31.301 INFO:teuthology.orchestra.run.smithi007.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T15:00:31.326 INFO:teuthology.orchestra.run.smithi007.stdout:selecting default max_connections ... 100 2024-09-13T15:00:31.339 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T15:00:31.361 INFO:teuthology.orchestra.run.smithi007.stdout:selecting default shared_buffers ... 128MB 2024-09-13T15:00:31.375 INFO:teuthology.orchestra.run.smithi007.stdout:selecting default time zone ... Etc/UTC 2024-09-13T15:00:31.376 INFO:teuthology.orchestra.run.smithi007.stdout:creating configuration files ... ok 2024-09-13T15:00:31.547 INFO:teuthology.orchestra.run.smithi007.stdout:running bootstrap script ... ok 2024-09-13T15:00:31.625 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T15:00:31.768 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T15:00:32.179 INFO:teuthology.orchestra.run.smithi007.stdout:performing post-bootstrap initialization ... ok 2024-09-13T15:00:32.790 INFO:teuthology.orchestra.run.smithi007.stdout:syncing data to disk ... ok 2024-09-13T15:00:33.014 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-13T15:00:33.115 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T15:00:33.318 INFO:teuthology.orchestra.run.smithi007.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T15:00:33.746 INFO:teuthology.orchestra.run.smithi077.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T15:00:33.753 DEBUG:teuthology.parallel:result is None 2024-09-13T15:00:36.385 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T15:00:36.503 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-13T15:00:36.638 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up postgresql (14+238) ... 2024-09-13T15:00:36.764 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-13T15:00:36.889 INFO:teuthology.orchestra.run.smithi007.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-13T15:00:37.154 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T15:00:37.154 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T15:00:37.917 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-13T15:00:38.102 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T15:00:38.802 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-13T15:00:38.998 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-13T15:00:40.344 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-13T15:00:40.469 INFO:teuthology.orchestra.run.smithi007.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-13T15:00:41.186 INFO:teuthology.orchestra.run.smithi007.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T15:00:41.197 DEBUG:teuthology.parallel:result is None 2024-09-13T15:00:41.197 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:00:41.351 DEBUG:teuthology.orchestra.run.smithi007:> dpkg-query -W -f '${Version}' ceph 2024-09-13T15:00:41.373 INFO:teuthology.orchestra.run.smithi007.stdout:18.2.4-850-g50bbe7f3-1jammy 2024-09-13T15:00:41.374 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-850-g50bbe7f3-1jammy 2024-09-13T15:00:41.374 INFO:teuthology.task.install:The correct ceph version 18.2.4-850-g50bbe7f3-1jammy is installed. 2024-09-13T15:00:41.376 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:00:41.528 DEBUG:teuthology.orchestra.run.smithi077:> dpkg-query -W -f '${Version}' ceph 2024-09-13T15:00:41.548 INFO:teuthology.orchestra.run.smithi077.stdout:18.2.4-850-g50bbe7f3-1jammy 2024-09-13T15:00:41.548 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-850-g50bbe7f3-1jammy 2024-09-13T15:00:41.548 INFO:teuthology.task.install:The correct ceph version 18.2.4-850-g50bbe7f3-1jammy is installed. 2024-09-13T15:00:41.550 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T15:00:41.550 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:00:41.550 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T15:00:41.570 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:00:41.571 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T15:00:41.606 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T15:00:41.606 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:00:41.606 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T15:00:41.631 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T15:00:41.691 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:00:41.691 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T15:00:41.705 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T15:00:41.759 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T15:00:41.760 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:00:41.760 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T15:00:41.779 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T15:00:41.838 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:00:41.839 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T15:00:41.852 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T15:00:41.907 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T15:00:41.907 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:00:41.907 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T15:00:41.927 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T15:00:41.986 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:00:41.987 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T15:00:42.000 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T15:00:42.055 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T15:00:42.142 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T15:00:42.143 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /var/log/ceph 2024-09-13T15:00:42.147 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /var/log/ceph 2024-09-13T15:00:42.163 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T15:00:42.163 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T15:00:42.207 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T15:00:42.223 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T15:00:42.223 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T15:00:42.266 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T15:00:42.289 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T15:00:42.289 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T15:00:42.289 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T15:00:42.289 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:00:42.289 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T15:00:42.331 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T15:00:42.418 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:00:42.418 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T15:00:42.424 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T15:00:42.505 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T15:00:42.505 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'Replacing daemon mds', 'SLOW_OPS', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T15:00:42.505 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903700', 'branch': 'wip-rishabh-testing-20240910.095512-reef', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/ffsb}}', 'email': None, 'first_in_suite': False, 'job_id': '7903700', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.095512-reef'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'Replacing daemon mds', 'SLOW_OPS', 'slow request'], 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.095512-reef', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 1152, 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'sleep_before_teardown': 0, 'subset': '984/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.095512-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_50bbe7f395997dcd871813949c49addbbf630361/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi007.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN5/NnWmvbW3K1Sj/jLNKLHQhPpEAkoU6Y68ryEoTdsxRCMh2g7mrZKze/Opfv4waBlTMoiMS7GWlTWv75k/aKc=', 'smithi077.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAuaAfEcWFOkysiW/Iw/WQLDfhKR2j/XyidpJkiAHg2SJem5zkCxw6uug/iSV55S66efvpHPiUPDn6I6GyrPMew='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50bbe7f395997dcd871813949c49addbbf630361'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'Replacing daemon mds', 'SLOW_OPS', 'slow request'], 'sha1': '50bbe7f395997dcd871813949c49addbbf630361', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['suites/ffsb.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:36:41', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T15:00:42.506 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T15:00:42.509 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T15:00:42.549 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T15:00:42.558 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T15:00:42.604 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:00:42.604 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T15:00:42.624 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T15:00:42.624 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2024-09-13T15:00:42.676 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T15:00:42.676 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:00:42.676 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 881 Links: 1 2024-09-13T15:00:42.676 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:00:42.676 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-13 14:54:12.982044254 +0000 2024-09-13T15:00:42.676 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-13 14:54:12.710046684 +0000 2024-09-13T15:00:42.676 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-13 14:54:12.710046684 +0000 2024-09-13T15:00:42.676 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-13 14:54:12.710046684 +0000 2024-09-13T15:00:42.677 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T15:00:42.737 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-13T15:00:42.737 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-13T15:00:42.737 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000242976 s, 2.1 MB/s 2024-09-13T15:00:42.739 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T15:00:42.789 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2024-09-13T15:00:42.840 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T15:00:42.840 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:00:42.840 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 896 Links: 1 2024-09-13T15:00:42.840 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:00:42.840 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-13 14:54:13.570039002 +0000 2024-09-13T15:00:42.840 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-13 14:54:13.294041468 +0000 2024-09-13T15:00:42.840 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-13 14:54:13.294041468 +0000 2024-09-13T15:00:42.840 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-13 14:54:13.294041468 +0000 2024-09-13T15:00:42.840 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T15:00:42.902 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-13T15:00:42.902 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-13T15:00:42.902 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000234087 s, 2.2 MB/s 2024-09-13T15:00:42.903 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T15:00:42.953 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2024-09-13T15:00:43.004 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T15:00:43.004 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:00:43.004 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 915 Links: 1 2024-09-13T15:00:43.004 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:00:43.004 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-13 14:54:14.154033785 +0000 2024-09-13T15:00:43.004 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-13 14:54:13.894036107 +0000 2024-09-13T15:00:43.005 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-13 14:54:13.894036107 +0000 2024-09-13T15:00:43.005 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-13 14:54:13.894036107 +0000 2024-09-13T15:00:43.005 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T15:00:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-13T15:00:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-13T15:00:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000240482 s, 2.1 MB/s 2024-09-13T15:00:43.067 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T15:00:43.118 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2024-09-13T15:00:43.168 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T15:00:43.168 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:00:43.168 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 932 Links: 1 2024-09-13T15:00:43.168 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:00:43.168 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-13 14:54:14.726028677 +0000 2024-09-13T15:00:43.168 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-13 14:54:14.446031177 +0000 2024-09-13T15:00:43.169 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-13 14:54:14.446031177 +0000 2024-09-13T15:00:43.169 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-13 14:54:14.446031177 +0000 2024-09-13T15:00:43.169 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T15:00:43.234 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-13T15:00:43.234 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-13T15:00:43.234 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000255728 s, 2.0 MB/s 2024-09-13T15:00:43.236 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T15:00:43.290 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T15:00:43.290 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:00:43.290 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T15:00:43.296 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T15:00:43.296 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2024-09-13T15:00:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T15:00:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:00:43.348 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-09-13T15:00:43.348 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:00:43.348 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-13 14:53:41.102100220 +0000 2024-09-13T15:00:43.348 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-13 14:53:41.098100428 +0000 2024-09-13T15:00:43.348 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-13 14:53:41.098100428 +0000 2024-09-13T15:00:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: - 2024-09-13T15:00:43.348 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T15:00:43.402 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-13T15:00:43.402 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-13T15:00:43.402 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000576935 s, 887 kB/s 2024-09-13T15:00:43.403 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T15:00:43.453 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2024-09-13T15:00:43.499 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T15:00:43.500 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:00:43.500 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 899 Links: 1 2024-09-13T15:00:43.500 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:00:43.500 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-13 14:53:41.578075500 +0000 2024-09-13T15:00:43.500 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-13 14:53:41.574075708 +0000 2024-09-13T15:00:43.500 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-13 14:53:41.574075708 +0000 2024-09-13T15:00:43.500 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: - 2024-09-13T15:00:43.500 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T15:00:43.554 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-13T15:00:43.554 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-13T15:00:43.554 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000577028 s, 887 kB/s 2024-09-13T15:00:43.555 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T15:00:43.604 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2024-09-13T15:00:43.651 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T15:00:43.651 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:00:43.652 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-09-13T15:00:43.652 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:00:43.652 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-13 14:53:42.030052472 +0000 2024-09-13T15:00:43.652 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-13 14:53:42.026052607 +0000 2024-09-13T15:00:43.652 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-13 14:53:42.026052607 +0000 2024-09-13T15:00:43.652 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: - 2024-09-13T15:00:43.652 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T15:00:43.705 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-13T15:00:43.705 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-13T15:00:43.705 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000483676 s, 1.1 MB/s 2024-09-13T15:00:43.706 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T15:00:43.757 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2024-09-13T15:00:43.804 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T15:00:43.805 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T15:00:43.805 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 931 Links: 1 2024-09-13T15:00:43.805 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:00:43.805 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-13 14:53:42.802026276 +0000 2024-09-13T15:00:43.806 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-13 14:53:42.538035234 +0000 2024-09-13T15:00:43.806 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-13 14:53:42.538035234 +0000 2024-09-13T15:00:43.806 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: - 2024-09-13T15:00:43.806 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T15:00:43.857 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-13T15:00:43.857 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-13T15:00:43.857 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000481814 s, 1.1 MB/s 2024-09-13T15:00:43.858 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T15:00:43.909 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T15:00:43.909 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T15:00:43.909 INFO:tasks.ceph:Generating config... 2024-09-13T15:00:43.910 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T15:00:43.910 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-09-13T15:00:43.910 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T15:00:43.910 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T15:00:43.911 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T15:00:43.911 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T15:00:43.911 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-13T15:00:43.911 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T15:00:43.911 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T15:00:43.911 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T15:00:43.911 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-09-13T15:00:43.911 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-09-13T15:00:43.911 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-09-13T15:00:43.911 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-09-13T15:00:43.911 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T15:00:43.911 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T15:00:43.911 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-09-13T15:00:43.912 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T15:00:43.912 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T15:00:43.912 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-09-13T15:00:43.912 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-09-13T15:00:43.912 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-09-13T15:00:43.912 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-09-13T15:00:43.912 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-09-13T15:00:43.912 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-09-13T15:00:43.913 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-09-13T15:00:43.913 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T15:00:43.913 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T15:00:43.913 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T15:00:43.913 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T15:00:43.913 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T15:00:43.913 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T15:00:43.913 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T15:00:43.914 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T15:00:43.914 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T15:00:43.914 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T15:00:43.914 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T15:00:43.914 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T15:00:43.914 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T15:00:43.914 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-13T15:00:43.914 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-13T15:00:43.914 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T15:00:43.915 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T15:00:43.915 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-13T15:00:43.915 INFO:tasks.ceph:[osd] filestore flush min = 0 2024-09-13T15:00:43.915 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-09-13T15:00:43.916 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T15:00:43.916 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T15:00:43.916 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T15:00:43.916 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-09-13T15:00:43.916 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-09-13T15:00:43.916 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-09-13T15:00:43.916 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-09-13T15:00:43.916 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-13T15:00:43.917 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T15:00:43.917 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-13T15:00:43.917 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T15:00:43.917 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T15:00:43.917 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T15:00:43.917 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T15:00:43.965 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T15:00:43.982 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T15:00:44.030 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T15:00:44.050 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.7'), ('mon.b', '172.21.15.77'), ('mon.c', '[v2:172.21.15.77:3301,v1:172.21.15.77:6790]')] 2024-09-13T15:00:44.051 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.7,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T15:00:44.052 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:00:44.052 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T15:00:44.100 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.7 --add b 172.21.15.77 --addv c '[v2:172.21.15.77:3301,v1:172.21.15.77:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:00:44.191 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:00:44.192 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: generated fsid 92e6844f-41e8-44ce-a6e6-13b9cf520744 2024-09-13T15:00:44.192 INFO:teuthology.orchestra.run.smithi007.stdout:setting min_mon_release = pacific 2024-09-13T15:00:44.192 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 0 2024-09-13T15:00:44.192 INFO:teuthology.orchestra.run.smithi007.stdout:fsid 92e6844f-41e8-44ce-a6e6-13b9cf520744 2024-09-13T15:00:44.192 INFO:teuthology.orchestra.run.smithi007.stdout:last_changed 2024-09-13T15:00:44.192590+0000 2024-09-13T15:00:44.192 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-09-13T15:00:44.192590+0000 2024-09-13T15:00:44.193 INFO:teuthology.orchestra.run.smithi007.stdout:min_mon_release 16 (pacific) 2024-09-13T15:00:44.193 INFO:teuthology.orchestra.run.smithi007.stdout:election_strategy: 1 2024-09-13T15:00:44.193 INFO:teuthology.orchestra.run.smithi007.stdout:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-13T15:00:44.193 INFO:teuthology.orchestra.run.smithi007.stdout:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-13T15:00:44.193 INFO:teuthology.orchestra.run.smithi007.stdout:2: [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] mon.c 2024-09-13T15:00:44.193 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T15:00:44.195 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T15:00:44.205 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 92e6844f-41e8-44ce-a6e6-13b9cf520744... 2024-09-13T15:00:44.206 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T15:00:44.254 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T15:00:44.285 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-09-13T15:00:44.286 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2024-09-13T15:00:44.286 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T15:00:44.286 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2024-09-13T15:00:44.286 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.286 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2024-09-13T15:00:44.286 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.286 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2024-09-13T15:00:44.286 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.286 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2024-09-13T15:00:44.286 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2024-09-13T15:00:44.286 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.286 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2024-09-13T15:00:44.287 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2024-09-13T15:00:44.287 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.287 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T15:00:44.287 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2024-09-13T15:00:44.287 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.287 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T15:00:44.287 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T15:00:44.287 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.287 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2024-09-13T15:00:44.287 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.287 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2024-09-13T15:00:44.287 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2024-09-13T15:00:44.287 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2024-09-13T15:00:44.287 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2024-09-13T15:00:44.288 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2024-09-13T15:00:44.288 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2024-09-13T15:00:44.288 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2024-09-13T15:00:44.288 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T15:00:44.288 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T15:00:44.288 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2024-09-13T15:00:44.288 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.288 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T15:00:44.288 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.288 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2024-09-13T15:00:44.288 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.288 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2024-09-13T15:00:44.288 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.289 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2024-09-13T15:00:44.289 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2024-09-13T15:00:44.289 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2024-09-13T15:00:44.289 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.7,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-13T15:00:44.289 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on skipped message = False 2024-09-13T15:00:44.289 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = 92e6844f-41e8-44ce-a6e6-13b9cf520744 2024-09-13T15:00:44.289 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.289 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2024-09-13T15:00:44.289 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2024-09-13T15:00:44.289 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.289 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2024-09-13T15:00:44.289 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2024-09-13T15:00:44.289 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2024-09-13T15:00:44.289 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.290 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2024-09-13T15:00:44.290 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2024-09-13T15:00:44.290 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.290 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2024-09-13T15:00:44.290 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2024-09-13T15:00:44.290 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2024-09-13T15:00:44.290 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.290 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2024-09-13T15:00:44.290 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2024-09-13T15:00:44.290 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.290 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2024-09-13T15:00:44.290 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.290 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2024-09-13T15:00:44.291 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.291 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2024-09-13T15:00:44.291 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.291 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2024-09-13T15:00:44.291 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2024-09-13T15:00:44.291 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.291 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2024-09-13T15:00:44.291 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2024-09-13T15:00:44.291 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2024-09-13T15:00:44.291 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2024-09-13T15:00:44.291 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 20 2024-09-13T15:00:44.291 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 20 2024-09-13T15:00:44.291 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-13T15:00:44.291 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2024-09-13T15:00:44.292 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 10 2024-09-13T15:00:44.292 INFO:teuthology.orchestra.run.smithi077.stdout: filestore flush min = 0 2024-09-13T15:00:44.292 INFO:teuthology.orchestra.run.smithi077.stdout: mon client directed command retry = 5 2024-09-13T15:00:44.292 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T15:00:44.292 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2024-09-13T15:00:44.292 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2024-09-13T15:00:44.292 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject delay max = 1 2024-09-13T15:00:44.292 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject delay probability = 0.005 2024-09-13T15:00:44.292 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject delay type = client mds 2024-09-13T15:00:44.292 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject socket failures = 2500 2024-09-13T15:00:44.292 INFO:teuthology.orchestra.run.smithi077.stdout: osd blocked scrub grace period = 3600 2024-09-13T15:00:44.292 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2024-09-13T15:00:44.292 INFO:teuthology.orchestra.run.smithi077.stdout: osd max markdown count = 1000 2024-09-13T15:00:44.292 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2024-09-13T15:00:44.293 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2024-09-13T15:00:44.293 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.293 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2024-09-13T15:00:44.293 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-13T15:00:44.293 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2024-09-13T15:00:44.293 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-13T15:00:44.293 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-13T15:00:44.293 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:00:44.293 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:00:44.293 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2024-09-13T15:00:44.293 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-09-13T15:00:44.293 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.293 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2024-09-13T15:00:44.294 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-13T15:00:44.294 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-13T15:00:44.294 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2024-09-13T15:00:44.294 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-13T15:00:44.294 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2024-09-13T15:00:44.294 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2024-09-13T15:00:44.294 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:00:44.294 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2024-09-13T15:00:44.294 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2024-09-13T15:00:44.294 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:00:44.294 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.294 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T15:00:44.294 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T15:00:44.294 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T15:00:44.294 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.295 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T15:00:44.295 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T15:00:44.295 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T15:00:44.295 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.295 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2024-09-13T15:00:44.295 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2024-09-13T15:00:44.295 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.295 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2024-09-13T15:00:44.295 INFO:teuthology.orchestra.run.smithi077.stdout: mon op complaint time = 120 2024-09-13T15:00:44.295 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on pool no app = False 2024-09-13T15:00:44.295 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-13T15:00:44.295 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2024-09-13T15:00:44.295 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2024-09-13T15:00:44.295 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2024-09-13T15:00:44.296 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2024-09-13T15:00:44.296 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T15:00:44.296 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T15:00:44.296 INFO:teuthology.orchestra.run.smithi077.stdout: client mount timeout = 600 2024-09-13T15:00:44.296 INFO:teuthology.orchestra.run.smithi077.stdout: client_shutdown_timeout = 120 2024-09-13T15:00:44.296 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2024-09-13T15:00:44.296 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-13T15:00:44.296 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2024-09-13T15:00:44.296 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2024-09-13T15:00:44.296 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2024-09-13T15:00:44.296 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2024-09-13T15:00:44.296 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2024-09-13T15:00:44.296 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-09-13T15:00:44.296 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2024-09-13T15:00:44.297 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.e] 2024-09-13T15:00:44.297 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-09-13T15:00:44.297 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2024-09-13T15:00:44.297 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.f] 2024-09-13T15:00:44.297 INFO:teuthology.orchestra.run.smithi077.stdout:[mds] 2024-09-13T15:00:44.297 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds = 20 2024-09-13T15:00:44.297 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds balancer = 20 2024-09-13T15:00:44.297 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-13T15:00:44.297 INFO:teuthology.orchestra.run.smithi077.stdout: mds bal fragment size max = 10000 2024-09-13T15:00:44.297 INFO:teuthology.orchestra.run.smithi077.stdout: mds bal merge size = 5 2024-09-13T15:00:44.297 INFO:teuthology.orchestra.run.smithi077.stdout: mds bal split bits = 3 2024-09-13T15:00:44.297 INFO:teuthology.orchestra.run.smithi077.stdout: mds bal split size = 100 2024-09-13T15:00:44.297 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug frag = True 2024-09-13T15:00:44.297 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug scatterstat = True 2024-09-13T15:00:44.298 INFO:teuthology.orchestra.run.smithi077.stdout: mds oft prefetch dirfrags = True 2024-09-13T15:00:44.298 INFO:teuthology.orchestra.run.smithi077.stdout: mds op complaint time = 180 2024-09-13T15:00:44.298 INFO:teuthology.orchestra.run.smithi077.stdout: mds verify scatter = True 2024-09-13T15:00:44.298 INFO:teuthology.orchestra.run.smithi077.stdout: mds_dir_prefetch = True 2024-09-13T15:00:44.298 INFO:teuthology.orchestra.run.smithi077.stdout: mds_sleep_rank_change = 5000000.0 2024-09-13T15:00:44.298 INFO:teuthology.orchestra.run.smithi077.stdout: mon client directed command retry = 5 2024-09-13T15:00:44.298 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject delay max = 1 2024-09-13T15:00:44.298 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject delay probability = 0.005 2024-09-13T15:00:44.298 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject delay type = client mds osd 2024-09-13T15:00:44.298 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject socket failures = 2500 2024-09-13T15:00:44.298 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2024-09-13T15:00:44.298 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2024-09-13T15:00:44.298 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2024-09-13T15:00:44.299 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-09-13T15:00:44.299 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2024-09-13T15:00:44.299 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T15:00:44.299 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2024-09-13T15:00:44.299 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.299 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2024-09-13T15:00:44.300 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.300 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2024-09-13T15:00:44.300 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.300 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2024-09-13T15:00:44.300 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2024-09-13T15:00:44.300 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.300 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2024-09-13T15:00:44.300 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2024-09-13T15:00:44.300 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.300 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T15:00:44.300 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2024-09-13T15:00:44.300 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.300 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T15:00:44.300 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T15:00:44.301 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.301 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2024-09-13T15:00:44.301 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.301 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2024-09-13T15:00:44.301 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2024-09-13T15:00:44.301 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2024-09-13T15:00:44.301 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2024-09-13T15:00:44.301 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2024-09-13T15:00:44.301 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2024-09-13T15:00:44.301 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2024-09-13T15:00:44.301 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T15:00:44.301 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T15:00:44.301 INFO:teuthology.orchestra.run.smithi007.stdout: mon_allow_pool_size_one = true 2024-09-13T15:00:44.301 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.302 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T15:00:44.302 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.302 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2024-09-13T15:00:44.302 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.302 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2024-09-13T15:00:44.302 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.302 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2024-09-13T15:00:44.302 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2024-09-13T15:00:44.302 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2024-09-13T15:00:44.302 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "172.21.15.7,172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790]" 2024-09-13T15:00:44.302 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on skipped message = False 2024-09-13T15:00:44.302 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = 92e6844f-41e8-44ce-a6e6-13b9cf520744 2024-09-13T15:00:44.303 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.303 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2024-09-13T15:00:44.303 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2024-09-13T15:00:44.303 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.303 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2024-09-13T15:00:44.303 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2024-09-13T15:00:44.303 INFO:teuthology.orchestra.run.smithi007.stdout: osd mclock profile = high_recovery_ops 2024-09-13T15:00:44.303 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.303 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2024-09-13T15:00:44.303 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2024-09-13T15:00:44.303 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.303 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2024-09-13T15:00:44.303 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2024-09-13T15:00:44.303 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2024-09-13T15:00:44.304 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.304 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2024-09-13T15:00:44.304 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2024-09-13T15:00:44.304 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.304 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2024-09-13T15:00:44.304 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.304 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2024-09-13T15:00:44.304 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.304 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2024-09-13T15:00:44.304 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.304 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2024-09-13T15:00:44.304 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2024-09-13T15:00:44.304 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.305 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2024-09-13T15:00:44.305 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2024-09-13T15:00:44.305 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2024-09-13T15:00:44.305 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2024-09-13T15:00:44.305 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 20 2024-09-13T15:00:44.305 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 20 2024-09-13T15:00:44.305 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-09-13T15:00:44.305 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 20 2024-09-13T15:00:44.305 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 10 2024-09-13T15:00:44.305 INFO:teuthology.orchestra.run.smithi007.stdout: filestore flush min = 0 2024-09-13T15:00:44.305 INFO:teuthology.orchestra.run.smithi007.stdout: mon client directed command retry = 5 2024-09-13T15:00:44.305 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T15:00:44.305 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2024-09-13T15:00:44.306 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2024-09-13T15:00:44.306 INFO:teuthology.orchestra.run.smithi007.stdout: ms inject delay max = 1 2024-09-13T15:00:44.306 INFO:teuthology.orchestra.run.smithi007.stdout: ms inject delay probability = 0.005 2024-09-13T15:00:44.306 INFO:teuthology.orchestra.run.smithi007.stdout: ms inject delay type = client mds 2024-09-13T15:00:44.306 INFO:teuthology.orchestra.run.smithi007.stdout: ms inject socket failures = 2500 2024-09-13T15:00:44.306 INFO:teuthology.orchestra.run.smithi007.stdout: osd blocked scrub grace period = 3600 2024-09-13T15:00:44.306 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2024-09-13T15:00:44.306 INFO:teuthology.orchestra.run.smithi007.stdout: osd max markdown count = 1000 2024-09-13T15:00:44.306 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2024-09-13T15:00:44.306 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2024-09-13T15:00:44.306 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.306 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2024-09-13T15:00:44.306 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-09-13T15:00:44.306 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2024-09-13T15:00:44.307 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-09-13T15:00:44.307 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-09-13T15:00:44.307 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:00:44.307 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:00:44.307 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2024-09-13T15:00:44.307 INFO:teuthology.orchestra.run.smithi007.stdout: debug client = 20 2024-09-13T15:00:44.307 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.307 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2024-09-13T15:00:44.307 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-09-13T15:00:44.307 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2024-09-13T15:00:44.307 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2024-09-13T15:00:44.307 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2024-09-13T15:00:44.307 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2024-09-13T15:00:44.307 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2024-09-13T15:00:44.308 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2024-09-13T15:00:44.308 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2024-09-13T15:00:44.308 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2024-09-13T15:00:44.308 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2024-09-13T15:00:44.308 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.308 INFO:teuthology.orchestra.run.smithi007.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T15:00:44.308 INFO:teuthology.orchestra.run.smithi007.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T15:00:44.308 INFO:teuthology.orchestra.run.smithi007.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T15:00:44.308 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.308 INFO:teuthology.orchestra.run.smithi007.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T15:00:44.308 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T15:00:44.308 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T15:00:44.308 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.309 INFO:teuthology.orchestra.run.smithi007.stdout: # 1m isn't quite enough 2024-09-13T15:00:44.309 INFO:teuthology.orchestra.run.smithi007.stdout: mon_down_mkfs_grace = 2m 2024-09-13T15:00:44.309 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.309 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_filestore_osds = false 2024-09-13T15:00:44.309 INFO:teuthology.orchestra.run.smithi007.stdout: mon op complaint time = 120 2024-09-13T15:00:44.309 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on pool no app = False 2024-09-13T15:00:44.309 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:00:44.309 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2024-09-13T15:00:44.309 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2024-09-13T15:00:44.309 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = true 2024-09-13T15:00:44.309 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2024-09-13T15:00:44.309 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T15:00:44.309 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T15:00:44.309 INFO:teuthology.orchestra.run.smithi007.stdout: client mount timeout = 600 2024-09-13T15:00:44.309 INFO:teuthology.orchestra.run.smithi007.stdout: client_shutdown_timeout = 120 2024-09-13T15:00:44.310 INFO:teuthology.orchestra.run.smithi007.stdout: debug client = 20 2024-09-13T15:00:44.310 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-09-13T15:00:44.310 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2024-09-13T15:00:44.310 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2024-09-13T15:00:44.310 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2024-09-13T15:00:44.310 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2024-09-13T15:00:44.310 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2024-09-13T15:00:44.310 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2024-09-13T15:00:44.310 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c] 2024-09-13T15:00:44.310 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.e] 2024-09-13T15:00:44.310 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b] 2024-09-13T15:00:44.310 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d] 2024-09-13T15:00:44.310 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.f] 2024-09-13T15:00:44.310 INFO:teuthology.orchestra.run.smithi007.stdout:[mds] 2024-09-13T15:00:44.311 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds = 20 2024-09-13T15:00:44.311 INFO:teuthology.orchestra.run.smithi007.stdout: debug mds balancer = 20 2024-09-13T15:00:44.311 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2024-09-13T15:00:44.311 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal fragment size max = 10000 2024-09-13T15:00:44.311 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal merge size = 5 2024-09-13T15:00:44.311 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal split bits = 3 2024-09-13T15:00:44.311 INFO:teuthology.orchestra.run.smithi007.stdout: mds bal split size = 100 2024-09-13T15:00:44.311 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug frag = True 2024-09-13T15:00:44.311 INFO:teuthology.orchestra.run.smithi007.stdout: mds debug scatterstat = True 2024-09-13T15:00:44.311 INFO:teuthology.orchestra.run.smithi007.stdout: mds oft prefetch dirfrags = True 2024-09-13T15:00:44.311 INFO:teuthology.orchestra.run.smithi007.stdout: mds op complaint time = 180 2024-09-13T15:00:44.311 INFO:teuthology.orchestra.run.smithi007.stdout: mds verify scatter = True 2024-09-13T15:00:44.311 INFO:teuthology.orchestra.run.smithi007.stdout: mds_dir_prefetch = True 2024-09-13T15:00:44.311 INFO:teuthology.orchestra.run.smithi007.stdout: mds_sleep_rank_change = 5000000.0 2024-09-13T15:00:44.312 INFO:teuthology.orchestra.run.smithi007.stdout: mon client directed command retry = 5 2024-09-13T15:00:44.312 INFO:teuthology.orchestra.run.smithi007.stdout: ms inject delay max = 1 2024-09-13T15:00:44.312 INFO:teuthology.orchestra.run.smithi007.stdout: ms inject delay probability = 0.005 2024-09-13T15:00:44.312 INFO:teuthology.orchestra.run.smithi007.stdout: ms inject delay type = client mds osd 2024-09-13T15:00:44.312 INFO:teuthology.orchestra.run.smithi007.stdout: ms inject socket failures = 2500 2024-09-13T15:00:44.312 INFO:teuthology.orchestra.run.smithi007.stdout: osd op complaint time = 180 2024-09-13T15:00:44.312 INFO:teuthology.orchestra.run.smithi007.stdout: rados mon op timeout = 900 2024-09-13T15:00:44.312 INFO:teuthology.orchestra.run.smithi007.stdout: rados osd op timeout = 900 2024-09-13T15:00:44.313 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T15:00:44.314 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T15:00:44.412 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T15:00:44.413 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:00:44.413 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T15:00:44.421 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:00:44.421 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T15:00:44.471 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T15:00:44.471 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:00:44.471 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T15:00:44.471 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T15:00:44.547 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:00:44.547 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:00:44.599 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi077.front.sepia.ceph.com 2024-09-13T15:00:44.599 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:00:44.599 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T15:00:44.600 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T15:00:44.623 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:00:44.623 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:00:44.672 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T15:00:44.672 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T15:00:44.672 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T15:00:44.727 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T15:00:44.733 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T15:00:44.776 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T15:00:44.789 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T15:00:44.790 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T15:00:44.844 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T15:00:44.849 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T15:00:44.869 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T15:00:44.970 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T15:00:44.975 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-13T15:00:44.994 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-09-13T15:00:45.091 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-09-13T15:00:45.096 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-09-13T15:00:45.115 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T15:00:45.159 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T15:00:45.162 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T15:00:45.218 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T15:00:45.307 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T15:00:45.309 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-13T15:00:45.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-09-13T15:00:45.447 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-09-13T15:00:45.449 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-09-13T15:00:45.502 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T15:00:45.502 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T15:00:45.545 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T15:00:45.563 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T15:00:45.563 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T15:00:45.563 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T15:00:45.622 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T15:00:45.622 INFO:tasks.ceph:role: osd.0 2024-09-13T15:00:45.622 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T15:00:45.623 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T15:00:45.682 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:00:45.683 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:00:45.683 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:00:45.683 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T15:00:45.683 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:00:45.683 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:00:45.683 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:00:45.683 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:00:45.683 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:00:45.683 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:00:45.707 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-09-13T15:00:45.709 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-09-13T15:00:45.710 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T15:00:45.776 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T15:00:45.839 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:00:45.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:00:45.840 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T15:00:45.906 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T15:00:45.906 INFO:tasks.ceph:role: osd.1 2024-09-13T15:00:45.906 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T15:00:45.907 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T15:00:45.970 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:00:45.970 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:00:45.970 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:00:45.970 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T15:00:45.970 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:00:45.970 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:00:45.970 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:00:45.971 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:00:45.971 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:00:45.971 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:00:45.994 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-09-13T15:00:45.998 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-09-13T15:00:45.998 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T15:00:46.063 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T15:00:46.119 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:00:46.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:00:46.120 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T15:00:46.183 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T15:00:46.183 INFO:tasks.ceph:role: osd.2 2024-09-13T15:00:46.183 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T15:00:46.183 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T15:00:46.246 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:00:46.246 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:00:46.246 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:00:46.246 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T15:00:46.247 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:00:46.247 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:00:46.247 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:00:46.247 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:00:46.247 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:00:46.247 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:00:46.271 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-09-13T15:00:46.274 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-09-13T15:00:46.274 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T15:00:46.343 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T15:00:46.403 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:00:46.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:00:46.404 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T15:00:46.470 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T15:00:46.470 INFO:tasks.ceph:role: osd.3 2024-09-13T15:00:46.470 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T15:00:46.470 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T15:00:46.530 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:00:46.530 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:00:46.531 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:00:46.531 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T15:00:46.531 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:00:46.531 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:00:46.531 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:00:46.531 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:00:46.531 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:00:46.531 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:00:46.556 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2024-09-13T15:00:46.559 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2024-09-13T15:00:46.559 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T15:00:46.628 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T15:00:46.687 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:00:46.687 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:00:46.688 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:00:46.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:46.802+0000 7f7d725677c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T15:00:46.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:46.802+0000 7f7d725677c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T15:00:46.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:46.802+0000 7f7d725677c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T15:00:46.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:46.802+0000 7f7d725677c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T15:00:46.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:46.802+0000 7f7d725677c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T15:00:46.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:46.806+0000 7f7d725677c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T15:00:49.867 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T15:00:49.890 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:00:49.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:49.982+0000 7f4027e577c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T15:00:49.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:49.982+0000 7f4027e577c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T15:00:49.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:49.982+0000 7f4027e577c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T15:00:49.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:49.982+0000 7f4027e577c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T15:00:49.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:49.982+0000 7f4027e577c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T15:00:49.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:49.986+0000 7f4027e577c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T15:00:53.051 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T15:00:53.073 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:00:53.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:53.166+0000 7f884aea07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T15:00:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:53.166+0000 7f884aea07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T15:00:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:53.166+0000 7f884aea07c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T15:00:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:53.166+0000 7f884aea07c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T15:00:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:53.166+0000 7f884aea07c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T15:00:53.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:53.166+0000 7f884aea07c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T15:00:56.238 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T15:00:56.261 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:00:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:56.358+0000 7fe1a1dc67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T15:00:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:56.358+0000 7fe1a1dc67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T15:00:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:56.358+0000 7fe1a1dc67c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T15:00:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:56.358+0000 7fe1a1dc67c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T15:00:56.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:56.358+0000 7fe1a1dc67c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T15:00:56.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:00:56.362+0000 7fe1a1dc67c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T15:00:59.419 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T15:00:59.440 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T15:00:59.459 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T15:00:59.459 INFO:tasks.ceph:role: osd.4 2024-09-13T15:00:59.459 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-13T15:00:59.460 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T15:00:59.523 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:00:59.523 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:00:59.523 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:00:59.523 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T15:00:59.523 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:00:59.523 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:00:59.523 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:00:59.523 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:00:59.524 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:00:59.524 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:00:59.973 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-13T15:00:59.975 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-13T15:00:59.975 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T15:01:00.099 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T15:01:00.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:01:00.108 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:01:00.108 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T15:01:00.160 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T15:01:00.161 INFO:tasks.ceph:role: osd.5 2024-09-13T15:01:00.161 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-13T15:01:00.161 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T15:01:00.223 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:01:00.223 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:01:00.223 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:01:00.223 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T15:01:00.223 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:01:00.224 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:01:00.224 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:01:00.224 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:01:00.224 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:01:00.224 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:01:00.699 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-13T15:01:00.702 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-13T15:01:00.702 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T15:01:00.851 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T15:01:00.863 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:01:00.863 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:01:00.864 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T15:01:00.919 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T15:01:00.919 INFO:tasks.ceph:role: osd.6 2024-09-13T15:01:00.919 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-13T15:01:00.919 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T15:01:00.983 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:01:00.983 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:01:00.983 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:01:00.983 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T15:01:00.983 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:01:00.983 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:01:00.983 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:01:00.983 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:01:00.983 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:01:00.983 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:01:01.463 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-13T15:01:01.466 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-13T15:01:01.466 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T15:01:01.614 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T15:01:01.626 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:01:01.626 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:01:01.627 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T15:01:01.682 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T15:01:01.708 INFO:tasks.ceph:role: osd.7 2024-09-13T15:01:01.709 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-13T15:01:01.709 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T15:01:01.746 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T15:01:01.746 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T15:01:01.746 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T15:01:01.746 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-13T15:01:01.746 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T15:01:01.746 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-13T15:01:01.746 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T15:01:01.746 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T15:01:01.746 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T15:01:01.746 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T15:01:02.174 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-13T15:01:02.177 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-13T15:01:02.177 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T15:01:02.262 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T15:01:02.317 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T15:01:02.318 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:01:02.319 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:01:02.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:02.439+0000 7f778f1697c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T15:01:02.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:02.439+0000 7f778f1697c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T15:01:02.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:02.439+0000 7f778f1697c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T15:01:02.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:02.439+0000 7f778f1697c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T15:01:02.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:02.439+0000 7f778f1697c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T15:01:02.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:02.443+0000 7f778f1697c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T15:01:05.415 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T15:01:05.428 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:01:05.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:05.507+0000 7f624eb1f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T15:01:05.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:05.507+0000 7f624eb1f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T15:01:05.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:05.507+0000 7f624eb1f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T15:01:05.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:05.507+0000 7f624eb1f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T15:01:05.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:05.507+0000 7f624eb1f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T15:01:05.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:05.507+0000 7f624eb1f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T15:01:08.487 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T15:01:08.543 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:01:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:08.623+0000 7ff7c77a07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T15:01:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:08.623+0000 7ff7c77a07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T15:01:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:08.623+0000 7ff7c77a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T15:01:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:08.623+0000 7ff7c77a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T15:01:08.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:08.623+0000 7ff7c77a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T15:01:08.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:08.627+0000 7ff7c77a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T15:01:11.601 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T15:01:11.654 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:01:11.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:11.735+0000 7f56f2b867c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T15:01:11.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:11.735+0000 7f56f2b867c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T15:01:11.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:11.735+0000 7f56f2b867c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T15:01:11.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:11.735+0000 7f56f2b867c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T15:01:11.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:11.735+0000 7f56f2b867c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T15:01:11.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:11.735+0000 7f56f2b867c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T15:01:12.507 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:01:12.510 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:01:14.706 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T15:01:14.720 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T15:01:14.720 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:01:14.720 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T15:01:14.742 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:01:14.742 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T15:01:14.809 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:01:14.809 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-13T15:01:14.873 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:01:14.873 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-09-13T15:01:14.940 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:01:14.940 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T15:01:15.005 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:01:15.005 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T15:01:15.072 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:01:15.072 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T15:01:15.140 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:01:15.140 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T15:01:15.204 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:01:15.205 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T15:01:15.218 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:01:15.219 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T15:01:15.273 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:01:15.273 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-13T15:01:15.326 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:01:15.326 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-09-13T15:01:15.382 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:01:15.382 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T15:01:15.438 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:01:15.438 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T15:01:15.494 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:01:15.494 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T15:01:15.549 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:01:15.549 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T15:01:15.601 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:01:15.602 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T15:01:15.610 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T15:01:15.610 DEBUG:teuthology.orchestra.run.smithi007:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T15:01:15.658 DEBUG:teuthology.orchestra.run.smithi077:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T15:01:15.670 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.y] 2024-09-13T15:01:15.670 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQCcU+RmI2x4KxAA87lRMl1VmAdDOtebK0tBCw== 2024-09-13T15:01:15.670 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2024-09-13T15:01:15.670 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQCcU+RmnYpvMhAAmR/aUrTEsrvtapKDIC6uqA== 2024-09-13T15:01:15.670 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2024-09-13T15:01:15.670 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQCcU+RmLxHuORAArgC08wtbu361l6j341FsuQ== 2024-09-13T15:01:15.670 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.e] 2024-09-13T15:01:15.670 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQCdU+Rm4bGBBRAAF4jpvbi6AXwDko+U4r56Zg== 2024-09-13T15:01:15.670 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.0] 2024-09-13T15:01:15.670 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQCeU+RmfCI4MBAAHU7YCm2Pc07fAt5sDYqviQ== 2024-09-13T15:01:15.671 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.1] 2024-09-13T15:01:15.671 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQChU+Rml8vlOhAAmQMHl+UuQ9wB1I91Wj7cKQ== 2024-09-13T15:01:15.671 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.2] 2024-09-13T15:01:15.671 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQClU+RmqfwzChAAs1zfFy4TMUiO8K6nGlS1/g== 2024-09-13T15:01:15.671 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.3] 2024-09-13T15:01:15.671 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQCoU+Rmc668FRAAPaqUY3s1gq4ZXzd7Artq5A== 2024-09-13T15:01:15.671 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.x] 2024-09-13T15:01:15.671 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQCcU+RmvJBrLhAAxMVsPtlNx3AHutDfkuK4lg== 2024-09-13T15:01:15.671 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2024-09-13T15:01:15.671 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQCdU+RmW2WsCRAAcjJld3jfuDYBp2KxDywfmQ== 2024-09-13T15:01:15.671 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2024-09-13T15:01:15.671 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQCdU+RmqeByEhAAZ+oXttNKAKAQwDbHaw2rYQ== 2024-09-13T15:01:15.671 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.f] 2024-09-13T15:01:15.671 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQCdU+Rm9O3LGhAAKZdm5ykbCOyDXgBkzw6uog== 2024-09-13T15:01:15.672 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.4] 2024-09-13T15:01:15.672 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQCuU+RmDI5dGhAArdqExf/wgJA7uknhrDeCFw== 2024-09-13T15:01:15.672 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.5] 2024-09-13T15:01:15.672 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQCxU+RmD2JvHhAAyQy3RgYpPEK32caimqNsAw== 2024-09-13T15:01:15.672 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.6] 2024-09-13T15:01:15.672 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC0U+RmcyR2JRAAUBYTC7UO0p3PlZ3LyGcD5w== 2024-09-13T15:01:15.672 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.7] 2024-09-13T15:01:15.672 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQC3U+Rmv8oILBAAiNzWDi8MI+0gKh+OwDvZ3g== 2024-09-13T15:01:15.672 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2024-09-13T15:01:15.672 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQCdU+RmYYGZIBAA+m7gIsIKR8KOHasMS5LiwA== 2024-09-13T15:01:15.674 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.y] 2024-09-13T15:01:15.674 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQCcU+RmI2x4KxAA87lRMl1VmAdDOtebK0tBCw== 2024-09-13T15:01:15.674 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2024-09-13T15:01:15.675 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQCcU+RmnYpvMhAAmR/aUrTEsrvtapKDIC6uqA== 2024-09-13T15:01:15.675 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c] 2024-09-13T15:01:15.675 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQCcU+RmLxHuORAArgC08wtbu361l6j341FsuQ== 2024-09-13T15:01:15.675 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.e] 2024-09-13T15:01:15.675 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQCdU+Rm4bGBBRAAF4jpvbi6AXwDko+U4r56Zg== 2024-09-13T15:01:15.675 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.0] 2024-09-13T15:01:15.675 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQCeU+RmfCI4MBAAHU7YCm2Pc07fAt5sDYqviQ== 2024-09-13T15:01:15.675 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.1] 2024-09-13T15:01:15.675 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQChU+Rml8vlOhAAmQMHl+UuQ9wB1I91Wj7cKQ== 2024-09-13T15:01:15.675 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.2] 2024-09-13T15:01:15.675 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQClU+RmqfwzChAAs1zfFy4TMUiO8K6nGlS1/g== 2024-09-13T15:01:15.675 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.3] 2024-09-13T15:01:15.675 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQCoU+Rmc668FRAAPaqUY3s1gq4ZXzd7Artq5A== 2024-09-13T15:01:15.675 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.x] 2024-09-13T15:01:15.675 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQCcU+RmvJBrLhAAxMVsPtlNx3AHutDfkuK4lg== 2024-09-13T15:01:15.676 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b] 2024-09-13T15:01:15.676 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQCdU+RmW2WsCRAAcjJld3jfuDYBp2KxDywfmQ== 2024-09-13T15:01:15.676 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d] 2024-09-13T15:01:15.676 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQCdU+RmqeByEhAAZ+oXttNKAKAQwDbHaw2rYQ== 2024-09-13T15:01:15.676 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.f] 2024-09-13T15:01:15.676 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQCdU+Rm9O3LGhAAKZdm5ykbCOyDXgBkzw6uog== 2024-09-13T15:01:15.676 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.4] 2024-09-13T15:01:15.676 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQCuU+RmDI5dGhAArdqExf/wgJA7uknhrDeCFw== 2024-09-13T15:01:15.676 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.5] 2024-09-13T15:01:15.676 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQCxU+RmD2JvHhAAyQy3RgYpPEK32caimqNsAw== 2024-09-13T15:01:15.676 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.6] 2024-09-13T15:01:15.676 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQC0U+RmcyR2JRAAUBYTC7UO0p3PlZ3LyGcD5w== 2024-09-13T15:01:15.676 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.7] 2024-09-13T15:01:15.676 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQC3U+Rmv8oILBAAiNzWDi8MI+0gKh+OwDvZ3g== 2024-09-13T15:01:15.677 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-09-13T15:01:15.677 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQCdU+RmYYGZIBAA+m7gIsIKR8KOHasMS5LiwA== 2024-09-13T15:01:15.678 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T15:01:15.722 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T15:01:15.779 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:01:15.783 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:01:15.839 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:01:15.842 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:01:15.897 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:01:15.900 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:01:15.967 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:01:15.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:01:16.052 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:01:16.055 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:01:16.138 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:01:16.142 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:01:16.222 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:01:16.225 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:01:16.305 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T15:01:16.308 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T15:01:16.391 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:01:16.394 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:01:16.448 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:01:16.451 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:01:16.527 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:01:16.530 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T15:01:16.584 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:01:16.588 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:01:16.661 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:01:16.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:01:16.745 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:01:16.748 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:01:16.829 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:01:16.833 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T15:01:16.916 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T15:01:16.919 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T15:01:16.973 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T15:01:16.973 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T15:01:16.992 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T15:01:17.103 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T15:01:17.123 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T15:01:17.138 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T15:01:17.234 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T15:01:17.244 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T15:01:17.296 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T15:01:17.388 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T15:01:17.398 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:01:17.401 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T15:01:17.446 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T15:01:17.446 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T15:01:17.446 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T15:01:17.454 INFO:tasks.ceph.mon.a:Started 2024-09-13T15:01:17.454 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T15:01:17.454 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T15:01:17.492 INFO:tasks.ceph.mon.b:Started 2024-09-13T15:01:17.492 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T15:01:17.492 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T15:01:17.494 INFO:tasks.ceph.mon.c:Started 2024-09-13T15:01:17.494 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T15:01:17.494 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T15:01:17.494 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T15:01:17.497 INFO:tasks.ceph.mgr.y:Started 2024-09-13T15:01:17.497 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T15:01:17.497 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T15:01:17.499 INFO:tasks.ceph.mgr.x:Started 2024-09-13T15:01:17.500 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T15:01:17.500 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T15:01:17.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64ba800640 1 Processor -- start 2024-09-13T15:01:17.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64ba800640 1 -- start start 2024-09-13T15:01:17.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64ba800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 0x7f64b4157590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:17.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64ba800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64b40c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:17.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64ba800640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b4157100 con 0x7f64b40c5c30 2024-09-13T15:01:17.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64ba800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b4066b00 con 0x7f64b4150d90 2024-09-13T15:01:17.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64ba800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b415a3a0 con 0x7f64b4157ad0 2024-09-13T15:01:17.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64b2a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64b40c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:17.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64b2a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64b40c56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:57454/0 (socket says 172.21.15.7:57454) 2024-09-13T15:01:17.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 learned_addr learned my addr 172.21.15.7:0/3618074618 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:17.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 0x7f64b4157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:17.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64b40c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T15:01:17.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64b40c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:17.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64b40c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:17.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64b40c56f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T15:01:17.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64b3400640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 msgr2=0x7f64b4157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T15:01:17.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64b3400640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 msgr2=0x7f64b4157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:17.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 0x7f64b4157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:17.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.637+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 0x7f64b4157590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T15:01:17.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.841+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 0x7f64b4157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:17.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.841+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64b40c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:17.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.841+0000 7f64b3400640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 msgr2=0x7f64b4157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T15:01:17.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.841+0000 7f64b3400640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 msgr2=0x7f64b4157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:17.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.841+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 0x7f64b4157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:17.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.841+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 0x7f64b4157590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T15:01:17.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.841+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64b40c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T15:01:17.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.841+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64b40c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:17.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.841+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64b40c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:17.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:17.841+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64b40c56f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T15:01:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:18.245+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 0x7f64b4157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:18.245+0000 7f64b3400640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 msgr2=0x7f64b4157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T15:01:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:18.245+0000 7f64b3400640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 msgr2=0x7f64b4157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:18.245+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 0x7f64b4157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:18.245+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64b40c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:18.245+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 0x7f64b4157590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T15:01:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:18.245+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64b40c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T15:01:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:18.245+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64b40c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:18.245+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64b40c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:18.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:18.245+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64b40c56f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T15:01:19.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:19.049+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 0x7f64b4157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:19.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:19.049+0000 7f64b3400640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 msgr2=0x7f64b4157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T15:01:19.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:19.049+0000 7f64b3400640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 msgr2=0x7f64b4157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:19.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:19.049+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 0x7f64b4157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:19.049+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64b40c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:19.049+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 0x7f64b4157590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T15:01:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:19.049+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64b40c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T15:01:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:19.049+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64b40c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:19.049+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64b40c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:19.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:19.049+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64b40c56f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T15:01:20.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.637+0000 7f64b0c00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64b40c56f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:01:20.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.637+0000 7f64b0c00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64b40c56f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:20.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.637+0000 7f64b0c00640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 msgr2=0x7f64b4157590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:01:20.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.637+0000 7f64b0c00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64b4150d90 0x7f64b4157590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:20.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.637+0000 7f64b0c00640 1 -- 172.21.15.7:0/3618074618 >> v1:172.21.15.77:6789/0 conn(0x7f64b40c5c30 legacy=0x7f64b4071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:20.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.637+0000 7f64b0c00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 0x7f64940098b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.637+0000 7f64b0c00640 1 -- 172.21.15.7:0/3618074618 --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b4156db0 con 0x7f64940036f0 2024-09-13T15:01:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.637+0000 7f64b0c00640 1 -- 172.21.15.7:0/3618074618 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b415a3a0 con 0x7f6494007410 2024-09-13T15:01:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.637+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 0x7f64940098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.637+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T15:01:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.637+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.637+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 0x7f64940098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:20.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.637+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 0x7f64940098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T15:01:20.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.841+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 0x7f64940098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:20.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.841+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T15:01:20.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.841+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:20.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.841+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 0x7f64940098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:20.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:20.841+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 0x7f64940098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T15:01:21.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:21.245+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 0x7f64940098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:21.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:21.245+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T15:01:21.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:21.245+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:21.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:21.245+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 0x7f64940098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:21.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:21.245+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 0x7f64940098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T15:01:22.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:22.049+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 0x7f64940098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:22.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:22.049+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T15:01:22.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:22.049+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:22.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:22.049+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 0x7f64940098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:22.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:22.049+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 0x7f64940098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T15:01:23.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b0c00640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:01:23.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b0c00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f6494007410 0x7f64940098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:23.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b0c00640 1 -- 172.21.15.7:0/3618074618 >> v1:172.21.15.7:6789/0 conn(0x7f64940036f0 legacy=0x7f6494005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:23.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b0c00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 0x7f649400a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:23.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b3e00640 1 -- 172.21.15.7:0/3618074618 reap_dead start 2024-09-13T15:01:23.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b0c00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64940098b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:23.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b0c00640 1 -- 172.21.15.7:0/3618074618 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f649400b010 con 0x7f64b40c5c30 2024-09-13T15:01:23.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b0c00640 1 -- 172.21.15.7:0/3618074618 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b415a3a0 con 0x7f649400a080 2024-09-13T15:01:23.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b0c00640 1 -- 172.21.15.7:0/3618074618 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649400abf0 con 0x7f64b4157ad0 2024-09-13T15:01:23.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 0x7f649400a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:23.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b3e00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64940098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:23.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b3400640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 msgr2=0x7f649400a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T15:01:23.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b3400640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 msgr2=0x7f649400a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:23.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 0x7f649400a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:23.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 0x7f649400a4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T15:01:23.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b3e00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T15:01:23.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b3e00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:23.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b3e00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64940098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:23.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.641+0000 7f64b3e00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64940098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T15:01:23.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.845+0000 7f64b3e00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64940098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:23.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.845+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 0x7f649400a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:23.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.845+0000 7f64b3e00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T15:01:23.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.845+0000 7f64b3e00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:23.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.845+0000 7f64b3e00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64940098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:23.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.845+0000 7f64b3400640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 msgr2=0x7f649400a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T15:01:23.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.845+0000 7f64b3400640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 msgr2=0x7f649400a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:23.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.845+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 0x7f649400a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:23.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.845+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 0x7f649400a4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T15:01:23.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:23.845+0000 7f64b3e00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64940098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T15:01:24.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:24.249+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 0x7f649400a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:24.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:24.249+0000 7f64b3e00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64940098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:24.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:24.249+0000 7f64b3400640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 msgr2=0x7f649400a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T15:01:24.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:24.249+0000 7f64b3400640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 msgr2=0x7f649400a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:24.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:24.249+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 0x7f649400a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:24.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:24.249+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 0x7f649400a4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T15:01:24.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:24.249+0000 7f64b3e00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T15:01:24.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:24.249+0000 7f64b3e00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:24.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:24.249+0000 7f64b3e00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64940098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:24.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:24.249+0000 7f64b3e00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64940098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T15:01:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:25.053+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 0x7f649400a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:25.053+0000 7f64b3e00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64940098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:25.053+0000 7f64b3400640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 msgr2=0x7f649400a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T15:01:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:25.053+0000 7f64b3400640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 msgr2=0x7f649400a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:25.053+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 0x7f649400a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:25.053+0000 7f64b3e00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T15:01:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:25.053+0000 7f64b3e00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:25.053+0000 7f64b3e00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64940098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:25.053+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 0x7f649400a4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T15:01:25.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:25.053+0000 7f64b3e00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64940098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T15:01:26.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.637+0000 7f64b0c00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 msgr2=0x7f64940098b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:01:26.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.637+0000 7f64b0c00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64b4157ad0 0x7f64940098b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:26.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.637+0000 7f64b0c00640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 msgr2=0x7f649400a4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:01:26.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.637+0000 7f64b0c00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.77:3300/0 conn(0x7f649400a080 0x7f649400a4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:26.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.637+0000 7f64b0c00640 1 -- 172.21.15.7:0/3618074618 >> v1:172.21.15.77:6789/0 conn(0x7f64b40c5c30 legacy=0x7f649400d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:26.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.637+0000 7f64b0c00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 0x7f6494006d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:26.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.637+0000 7f64b0c00640 1 -- 172.21.15.7:0/3618074618 --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f649400ad80 con 0x7f6494003c60 2024-09-13T15:01:26.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.637+0000 7f64b0c00640 1 -- 172.21.15.7:0/3618074618 --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b415a3a0 con 0x7f64940068c0 2024-09-13T15:01:26.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.637+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 0x7f6494006d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:26.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.637+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 msgr2=0x7f6494006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T15:01:26.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.637+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 msgr2=0x7f6494006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:26.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.637+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 0x7f6494006d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:26.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.637+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 0x7f6494006d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T15:01:26.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.841+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 0x7f6494006d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:26.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.841+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 msgr2=0x7f6494006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T15:01:26.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.841+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 msgr2=0x7f6494006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:26.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.841+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 0x7f6494006d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:26.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:26.841+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 0x7f6494006d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T15:01:27.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.245+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 0x7f6494006d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:27.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.245+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 msgr2=0x7f6494006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T15:01:27.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.245+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 msgr2=0x7f6494006d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:27.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.245+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 0x7f6494006d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:27.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.245+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 0x7f6494006d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T15:01:27.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.833+0000 7f64b2000640 1 -- 172.21.15.7:0/3618074618 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135031590 0 0) 0x7f649400ad80 con 0x7f6494003c60 2024-09-13T15:01:27.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.833+0000 7f64b2000640 1 -- 172.21.15.7:0/3618074618 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6498003530 con 0x7f6494003c60 2024-09-13T15:01:27.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2000640 1 -- 172.21.15.7:0/3618074618 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3208132711 0 0) 0x7f6498003530 con 0x7f6494003c60 2024-09-13T15:01:27.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2000640 1 -- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 msgr2=0x7f6494006d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:01:27.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2000640 1 --2- 172.21.15.7:0/3618074618 >> v2:172.21.15.7:3300/0 conn(0x7f64940068c0 0x7f6494006d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:27.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2000640 1 -- 172.21.15.7:0/3618074618 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6494014bf0 con 0x7f6494003c60 2024-09-13T15:01:27.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2000640 1 -- 172.21.15.7:0/3618074618 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f64a4014690 con 0x7f6494003c60 2024-09-13T15:01:27.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2000640 1 -- 172.21.15.7:0/3618074618 >> v1:172.21.15.7:6789/0 conn(0x7f6494003c60 legacy=0x7f6494006080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:27.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b3e00640 1 -- 172.21.15.7:0/3618074618 reap_dead start 2024-09-13T15:01:27.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2000640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6498003980 0x7f6498003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:27.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2000640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64980047d0 0x7f6498004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:27.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2000640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64980052b0 0x7f649800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:27.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2000640 1 -- 172.21.15.7:0/3618074618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b415a3a0 con 0x7f64980047d0 2024-09-13T15:01:27.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2000640 1 -- 172.21.15.7:0/3618074618 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649800c160 con 0x7f6498003980 2024-09-13T15:01:27.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2000640 1 -- 172.21.15.7:0/3618074618 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649800c320 con 0x7f64980052b0 2024-09-13T15:01:27.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64980047d0 0x7f6498004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:27.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b3400640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6498003980 0x7f6498003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:27.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b3e00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64980052b0 0x7f649800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:27.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64980052b0 msgr2=0x7f649800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:27.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64980052b0 0x7f649800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:27.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6498003980 msgr2=0x7f6498003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:27.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6498003980 0x7f6498003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:27.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b2a00640 1 -- 172.21.15.7:0/3618074618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6498003530 con 0x7f64980047d0 2024-09-13T15:01:27.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.837+0000 7f64b3e00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64980052b0 0x7f649800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:27.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.841+0000 7f64b2a00640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64980047d0 0x7f6498004c50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f64a0006aa0 tx=0x7f64a00072f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc04c2b2c905b563 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:27.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.841+0000 7f64b2000640 1 -- 172.21.15.7:0/3618074618 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a0004230 con 0x7f64980047d0 2024-09-13T15:01:27.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.841+0000 7f64b2000640 1 -- 172.21.15.7:0/3618074618 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a00a9050 con 0x7f64980047d0 2024-09-13T15:01:27.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.841+0000 7f64b2000640 1 -- 172.21.15.7:0/3618074618 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a0003620 con 0x7f64980047d0 2024-09-13T15:01:27.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.841+0000 7f64ba800640 1 -- 172.21.15.7:0/3618074618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64980047d0 msgr2=0x7f6498004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:27.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.841+0000 7f64ba800640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64980047d0 0x7f6498004c50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f64a0006aa0 tx=0x7f64a00072f0 comp rx=0 tx=0).stop 2024-09-13T15:01:27.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.841+0000 7f64ba800640 1 -- 172.21.15.7:0/3618074618 shutdown_connections 2024-09-13T15:01:27.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.841+0000 7f64ba800640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64980052b0 0x7f649800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:27.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.841+0000 7f64ba800640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64980047d0 0x7f6498004c50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:27.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.841+0000 7f64ba800640 1 --2- 172.21.15.7:0/3618074618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6498003980 0x7f6498003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:27.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.841+0000 7f64ba800640 1 -- 172.21.15.7:0/3618074618 >> 172.21.15.7:0/3618074618 conn(0x7f64b4065d40 msgr2=0x7f64b4066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:27.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.841+0000 7f64ba800640 1 -- 172.21.15.7:0/3618074618 shutdown_connections 2024-09-13T15:01:27.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.841+0000 7f64ba800640 1 -- 172.21.15.7:0/3618074618 wait complete. 2024-09-13T15:01:27.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64ba800640 1 Processor -- start 2024-09-13T15:01:27.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64ba800640 1 -- start start 2024-09-13T15:01:27.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64ba800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6498003980 0x7f64b40c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:27.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64ba800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64980047d0 0x7f64b4158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:27.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64ba800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64980052b0 0x7f64b4070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:27.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64ba800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b415a070 con 0x7f6498003980 2024-09-13T15:01:27.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64ba800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b4144280 con 0x7f64980047d0 2024-09-13T15:01:27.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64ba800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b40c6600 con 0x7f64980052b0 2024-09-13T15:01:27.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64b3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6498003980 0x7f64b40c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64b3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6498003980 0x7f64b40c7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45574/0 (socket says 172.21.15.7:45574) 2024-09-13T15:01:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64b3400640 1 -- 172.21.15.7:0/2410571549 learned_addr learned my addr 172.21.15.7:0/2410571549 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64b2a00640 1 --2- 172.21.15.7:0/2410571549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64980047d0 0x7f64b4158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64b3e00640 1 --2- 172.21.15.7:0/2410571549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64980052b0 0x7f64b4070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64b3400640 1 -- 172.21.15.7:0/2410571549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64980052b0 msgr2=0x7f64b4070dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64b3400640 1 --2- 172.21.15.7:0/2410571549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64980052b0 0x7f64b4070dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64b3400640 1 -- 172.21.15.7:0/2410571549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64980047d0 msgr2=0x7f64b4158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64b3400640 1 --2- 172.21.15.7:0/2410571549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64980047d0 0x7f64b4158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64b3400640 1 -- 172.21.15.7:0/2410571549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b40c68e0 con 0x7f6498003980 2024-09-13T15:01:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64b2a00640 1 --2- 172.21.15.7:0/2410571549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64980047d0 0x7f64b4158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:27.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.845+0000 7f64b3e00640 1 --2- 172.21.15.7:0/2410571549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64980052b0 0x7f64b4070dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:01:27.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.849+0000 7f64b3400640 1 --2- 172.21.15.7:0/2410571549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6498003980 0x7f64b40c7e30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f64a4014fc0 tx=0x7f64a40167a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:27.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.849+0000 7f64ab400640 1 -- 172.21.15.7:0/2410571549 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a401f040 con 0x7f6498003980 2024-09-13T15:01:27.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.849+0000 7f64ab400640 1 -- 172.21.15.7:0/2410571549 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a400c040 con 0x7f6498003980 2024-09-13T15:01:27.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.849+0000 7f64ab400640 1 -- 172.21.15.7:0/2410571549 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4023860 con 0x7f6498003980 2024-09-13T15:01:27.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.849+0000 7f64ba800640 1 -- 172.21.15.7:0/2410571549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b41f21d0 con 0x7f6498003980 2024-09-13T15:01:27.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.849+0000 7f64ba800640 1 -- 172.21.15.7:0/2410571549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b41f2790 con 0x7f6498003980 2024-09-13T15:01:27.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.849+0000 7f64ab400640 1 -- 172.21.15.7:0/2410571549 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f64a4023cc0 con 0x7f6498003980 2024-09-13T15:01:27.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.849+0000 7f64ab400640 1 -- 172.21.15.7:0/2410571549 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f64a402c3b0 con 0x7f6498003980 2024-09-13T15:01:27.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.849+0000 7f64ba800640 1 -- 172.21.15.7:0/2410571549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b41f2030 con 0x7f6498003980 2024-09-13T15:01:27.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.865+0000 7f64ab400640 1 -- 172.21.15.7:0/2410571549 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f64b41f2030 con 0x7f6498003980 2024-09-13T15:01:27.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.929+0000 7f64ba800640 1 -- 172.21.15.7:0/2410571549 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f64b4151170 con 0x7f6498003980 2024-09-13T15:01:27.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.933+0000 7f64ab400640 1 -- 172.21.15.7:0/2410571549 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f64a4028070 con 0x7f6498003980 2024-09-13T15:01:27.939 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2024-09-13T15:01:27.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.937+0000 7f64ba800640 1 -- 172.21.15.7:0/2410571549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6498003980 msgr2=0x7f64b40c7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:27.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.937+0000 7f64ba800640 1 --2- 172.21.15.7:0/2410571549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6498003980 0x7f64b40c7e30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f64a4014fc0 tx=0x7f64a40167a0 comp rx=0 tx=0).stop 2024-09-13T15:01:27.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.937+0000 7f64ba800640 1 -- 172.21.15.7:0/2410571549 shutdown_connections 2024-09-13T15:01:27.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.937+0000 7f64ba800640 1 --2- 172.21.15.7:0/2410571549 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64980052b0 0x7f64b4070dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:27.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.937+0000 7f64ba800640 1 --2- 172.21.15.7:0/2410571549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64980047d0 0x7f64b4158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:27.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.937+0000 7f64ba800640 1 --2- 172.21.15.7:0/2410571549 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6498003980 0x7f64b40c7e30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:27.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.937+0000 7f64ba800640 1 -- 172.21.15.7:0/2410571549 >> 172.21.15.7:0/2410571549 conn(0x7f64b4065d40 msgr2=0x7f64b415a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:27.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.937+0000 7f64ba800640 1 -- 172.21.15.7:0/2410571549 shutdown_connections 2024-09-13T15:01:27.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:27.937+0000 7f64ba800640 1 -- 172.21.15.7:0/2410571549 wait complete. 2024-09-13T15:01:27.961 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T15:01:27.961 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T15:01:27.961 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:01:27.962 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T15:01:27.983 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:01:27.983 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T15:01:28.047 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:01:28.047 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T15:01:28.050 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:28.045+0000 7f2ea46d1180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T15:01:28.063 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:28.063+0000 7fbf3f106180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T15:01:28.070 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:01:28.070 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T15:01:28.132 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:01:28.132 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T15:01:28.145 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:01:28.145 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T15:01:28.198 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:01:28.198 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T15:01:28.254 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-13T15:01:28.254 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T15:01:28.305 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 060d28f6-42eb-4748-b9a9-8855924cf8ac 0 2024-09-13T15:01:28.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.462+0000 7fa523087640 1 Processor -- start 2024-09-13T15:01:28.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.462+0000 7fa523087640 1 -- start start 2024-09-13T15:01:28.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa523087640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa51c14cb60 0x7fa51c156800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:28.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa523087640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa51c0c7f80 0x7fa51c0cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:28.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa523087640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51c0c6900 con 0x7fa51c0cc080 2024-09-13T15:01:28.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa523087640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa51c156d40 con 0x7fa51c14cb60 2024-09-13T15:01:28.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa523087640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c0c10a0 con 0x7fa51c0c7f80 2024-09-13T15:01:28.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa51bfff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa51c0c7f80 0x7fa51c0cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:28.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa51bfff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa51c0c7f80 0x7fa51c0cbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.77:57276/0 (socket says 172.21.15.77:57276) 2024-09-13T15:01:28.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa51bfff640 1 -- 172.21.15.77:0/2827351190 learned_addr learned my addr 172.21.15.77:0/2827351190 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-13T15:01:28.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa520e23640 1 --2- 172.21.15.77:0/2827351190 >> v2:172.21.15.7:3300/0 conn(0x7fa51c14cb60 0x7fa51c156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:28.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa51bfff640 1 -- 172.21.15.77:0/2827351190 >> v2:172.21.15.7:3300/0 conn(0x7fa51c14cb60 msgr2=0x7fa51c156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:28.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa51bfff640 1 --2- 172.21.15.77:0/2827351190 >> v2:172.21.15.7:3300/0 conn(0x7fa51c14cb60 0x7fa51c156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa51bfff640 1 -- 172.21.15.77:0/2827351190 >> v1:172.21.15.7:6789/0 conn(0x7fa51c0cc080 legacy=0x7fa51c0c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:28.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa51bfff640 1 -- 172.21.15.77:0/2827351190 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51c159690 con 0x7fa51c0c7f80 2024-09-13T15:01:28.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa51bfff640 1 --2- 172.21.15.77:0/2827351190 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa51c0c7f80 0x7fa51c0cbb40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa51000bb10 tx=0x7fa5100213e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3765647365b6e002 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:28.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa51b7fe640 1 -- 172.21.15.77:0/2827351190 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5100aaea0 con 0x7fa51c0c7f80 2024-09-13T15:01:28.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa51b7fe640 1 -- 172.21.15.77:0/2827351190 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5100ad050 con 0x7fa51c0c7f80 2024-09-13T15:01:28.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa51b7fe640 1 -- 172.21.15.77:0/2827351190 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5100b1820 con 0x7fa51c0c7f80 2024-09-13T15:01:28.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa523087640 1 -- 172.21.15.77:0/2827351190 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa51c0c7f80 msgr2=0x7fa51c0cbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:28.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa523087640 1 --2- 172.21.15.77:0/2827351190 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa51c0c7f80 0x7fa51c0cbb40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa51000bb10 tx=0x7fa5100213e0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa523087640 1 -- 172.21.15.77:0/2827351190 shutdown_connections 2024-09-13T15:01:28.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa523087640 1 --2- 172.21.15.77:0/2827351190 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa51c0c7f80 0x7fa51c0cbb40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa523087640 1 --2- 172.21.15.77:0/2827351190 >> v2:172.21.15.7:3300/0 conn(0x7fa51c14cb60 0x7fa51c156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa523087640 1 -- 172.21.15.77:0/2827351190 >> 172.21.15.77:0/2827351190 conn(0x7fa51c069f30 msgr2=0x7fa51c06a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:28.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa523087640 1 -- 172.21.15.77:0/2827351190 shutdown_connections 2024-09-13T15:01:28.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.466+0000 7fa523087640 1 -- 172.21.15.77:0/2827351190 wait complete. 2024-09-13T15:01:28.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa523087640 1 Processor -- start 2024-09-13T15:01:28.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa523087640 1 -- start start 2024-09-13T15:01:28.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa523087640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51c0c7f80 0x7fa51c1579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:28.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa523087640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa51c0cc080 0x7fa51c157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:28.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa523087640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa51c14cb60 0x7fa51c1ee340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:28.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa523087640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c157540 con 0x7fa51c0c7f80 2024-09-13T15:01:28.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa523087640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c155040 con 0x7fa51c0cc080 2024-09-13T15:01:28.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa523087640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa51c1552a0 con 0x7fa51c14cb60 2024-09-13T15:01:28.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa521624640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa51c14cb60 0x7fa51c1ee340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:28.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa51bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa51c0cc080 0x7fa51c157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:28.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa521624640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa51c14cb60 0x7fa51c1ee340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.77:57292/0 (socket says 172.21.15.77:57292) 2024-09-13T15:01:28.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa521624640 1 -- 172.21.15.77:0/1217198164 learned_addr learned my addr 172.21.15.77:0/1217198164 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-13T15:01:28.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa520e23640 1 --2- 172.21.15.77:0/1217198164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51c0c7f80 0x7fa51c1579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:28.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa521624640 1 -- 172.21.15.77:0/1217198164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa51c0cc080 msgr2=0x7fa51c157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:28.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa521624640 1 --2- 172.21.15.77:0/1217198164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa51c0cc080 0x7fa51c157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa521624640 1 -- 172.21.15.77:0/1217198164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51c0c7f80 msgr2=0x7fa51c1579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:28.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa521624640 1 --2- 172.21.15.77:0/1217198164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51c0c7f80 0x7fa51c1579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa521624640 1 -- 172.21.15.77:0/1217198164 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51000b770 con 0x7fa51c14cb60 2024-09-13T15:01:28.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa51bfff640 1 --2- 172.21.15.77:0/1217198164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa51c0cc080 0x7fa51c157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:01:28.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa520e23640 1 --2- 172.21.15.77:0/1217198164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51c0c7f80 0x7fa51c1579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:28.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa521624640 1 --2- 172.21.15.77:0/1217198164 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa51c14cb60 0x7fa51c1ee340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00c3c0 tx=0x7fa50c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:28.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa5197fa640 1 -- 172.21.15.77:0/1217198164 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c011790 con 0x7fa51c14cb60 2024-09-13T15:01:28.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa5197fa640 1 -- 172.21.15.77:0/1217198164 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50c0118f0 con 0x7fa51c14cb60 2024-09-13T15:01:28.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa523087640 1 -- 172.21.15.77:0/1217198164 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa51c155580 con 0x7fa51c14cb60 2024-09-13T15:01:28.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa5197fa640 1 -- 172.21.15.77:0/1217198164 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c011ca0 con 0x7fa51c14cb60 2024-09-13T15:01:28.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa523087640 1 -- 172.21.15.77:0/1217198164 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51c155b40 con 0x7fa51c14cb60 2024-09-13T15:01:28.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa5197fa640 1 -- 172.21.15.77:0/1217198164 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa50c01c760 con 0x7fa51c14cb60 2024-09-13T15:01:28.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa5197fa640 1 -- 172.21.15.77:0/1217198164 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa50c012720 con 0x7fa51c14cb60 2024-09-13T15:01:28.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.470+0000 7fa523087640 1 -- 172.21.15.77:0/1217198164 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa51c1576b0 con 0x7fa51c14cb60 2024-09-13T15:01:28.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.486+0000 7fa5197fa640 1 -- 172.21.15.77:0/1217198164 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fa50c011e00 con 0x7fa51c14cb60 2024-09-13T15:01:28.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.554+0000 7fa523087640 1 -- 172.21.15.77:0/1217198164 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd new", "uuid": "060d28f6-42eb-4748-b9a9-8855924cf8ac", "id": 0} v 0) v1 -- 0x7fa51c0c6e20 con 0x7fa51c14cb60 2024-09-13T15:01:28.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.562+0000 7fa5197fa640 1 -- 172.21.15.77:0/1217198164 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "060d28f6-42eb-4748-b9a9-8855924cf8ac", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa50c01cbf0 con 0x7fa51c14cb60 2024-09-13T15:01:28.564 INFO:teuthology.orchestra.run.smithi077.stdout:0 2024-09-13T15:01:28.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.562+0000 7fa523087640 1 -- 172.21.15.77:0/1217198164 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa51c14cb60 msgr2=0x7fa51c1ee340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:28.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.562+0000 7fa523087640 1 --2- 172.21.15.77:0/1217198164 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa51c14cb60 0x7fa51c1ee340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00c3c0 tx=0x7fa50c00c880 comp rx=0 tx=0).stop 2024-09-13T15:01:28.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.562+0000 7fa523087640 1 -- 172.21.15.77:0/1217198164 shutdown_connections 2024-09-13T15:01:28.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.562+0000 7fa523087640 1 --2- 172.21.15.77:0/1217198164 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa51c14cb60 0x7fa51c1ee340 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.562+0000 7fa523087640 1 --2- 172.21.15.77:0/1217198164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa51c0cc080 0x7fa51c157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.562+0000 7fa523087640 1 --2- 172.21.15.77:0/1217198164 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa51c0c7f80 0x7fa51c1579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.562+0000 7fa523087640 1 -- 172.21.15.77:0/1217198164 >> 172.21.15.77:0/1217198164 conn(0x7fa51c069f30 msgr2=0x7fa51c065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:28.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.562+0000 7fa523087640 1 -- 172.21.15.77:0/1217198164 shutdown_connections 2024-09-13T15:01:28.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.562+0000 7fa523087640 1 -- 172.21.15.77:0/1217198164 wait complete. 2024-09-13T15:01:28.580 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 349eb66a-9c21-4e17-b6e0-ebd0741b1813 1 2024-09-13T15:01:28.585 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:28.581+0000 7f2ea46d1180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T15:01:28.591 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:28.590+0000 7fbf3f106180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T15:01:28.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.694+0000 7f2226c07640 1 Processor -- start 2024-09-13T15:01:28.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.694+0000 7f2226c07640 1 -- start start 2024-09-13T15:01:28.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.694+0000 7f2226c07640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f22200c80e0 0x7f22201568a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:28.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.694+0000 7f2226c07640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2220156de0 con 0x7f2220070930 2024-09-13T15:01:28.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.694+0000 7f2226c07640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2220070100 con 0x7f22200c84c0 2024-09-13T15:01:28.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.694+0000 7f2226c07640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22200c5df0 con 0x7f22200c80e0 2024-09-13T15:01:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.694+0000 7f22249a3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f22200c80e0 0x7f22201568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.694+0000 7f22249a3640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f22200c80e0 0x7f22201568a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44348/0 (socket says 172.21.15.77:44348) 2024-09-13T15:01:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.694+0000 7f22249a3640 1 -- 172.21.15.77:0/967732720 learned_addr learned my addr 172.21.15.77:0/967732720 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-13T15:01:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.698+0000 7f22249a3640 1 -- 172.21.15.77:0/967732720 >> v1:172.21.15.77:6789/0 conn(0x7f22200c84c0 legacy=0x7f2220071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.698+0000 7f22249a3640 1 -- 172.21.15.77:0/967732720 >> v1:172.21.15.7:6789/0 conn(0x7f2220070930 legacy=0x7f222014fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:28.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.698+0000 7f22249a3640 1 -- 172.21.15.77:0/967732720 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22200703c0 con 0x7f22200c80e0 2024-09-13T15:01:28.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.698+0000 7f22249a3640 1 --2- 172.21.15.77:0/967732720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22200c80e0 0x7f22201568a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2214009870 tx=0x7f221401ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a4c7b37bd29a2d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:28.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.698+0000 7f221f7fe640 1 -- 172.21.15.77:0/967732720 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140a8a50 con 0x7f22200c80e0 2024-09-13T15:01:28.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.698+0000 7f221f7fe640 1 -- 172.21.15.77:0/967732720 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22140a8bb0 con 0x7f22200c80e0 2024-09-13T15:01:28.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.698+0000 7f221f7fe640 1 -- 172.21.15.77:0/967732720 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140b0440 con 0x7f22200c80e0 2024-09-13T15:01:28.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.698+0000 7f2226c07640 1 -- 172.21.15.77:0/967732720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22200c80e0 msgr2=0x7f22201568a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:28.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.698+0000 7f2226c07640 1 --2- 172.21.15.77:0/967732720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22200c80e0 0x7f22201568a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2214009870 tx=0x7f221401ed50 comp rx=0 tx=0).stop 2024-09-13T15:01:28.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.698+0000 7f2226c07640 1 -- 172.21.15.77:0/967732720 shutdown_connections 2024-09-13T15:01:28.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.698+0000 7f2226c07640 1 --2- 172.21.15.77:0/967732720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22200c80e0 0x7f22201568a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.698+0000 7f2226c07640 1 -- 172.21.15.77:0/967732720 >> 172.21.15.77:0/967732720 conn(0x7f222006db00 msgr2=0x7f222006df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:28.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.698+0000 7f2226c07640 1 -- 172.21.15.77:0/967732720 shutdown_connections 2024-09-13T15:01:28.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.698+0000 7f2226c07640 1 -- 172.21.15.77:0/967732720 wait complete. 2024-09-13T15:01:28.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f2226c07640 1 Processor -- start 2024-09-13T15:01:28.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f2226c07640 1 -- start start 2024-09-13T15:01:28.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f2226c07640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2220070930 0x7f222014d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:28.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f2226c07640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22200c80e0 0x7f22200c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:28.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f2226c07640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22200c84c0 0x7f2220141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:28.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f2226c07640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2220143690 con 0x7f22200c80e0 2024-09-13T15:01:28.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f2226c07640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222014bca0 con 0x7f22200c84c0 2024-09-13T15:01:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f2226c07640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222014c540 con 0x7f2220070930 2024-09-13T15:01:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f22249a3640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2220070930 0x7f222014d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f22249a3640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2220070930 0x7f222014d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.77:57302/0 (socket says 172.21.15.77:57302) 2024-09-13T15:01:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f22249a3640 1 -- 172.21.15.77:0/1871331611 learned_addr learned my addr 172.21.15.77:0/1871331611 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-13T15:01:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f22251a4640 1 --2- 172.21.15.77:0/1871331611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22200c84c0 0x7f2220141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f221ffff640 1 --2- 172.21.15.77:0/1871331611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22200c80e0 0x7f22200c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f22249a3640 1 -- 172.21.15.77:0/1871331611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22200c84c0 msgr2=0x7f2220141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f22249a3640 1 --2- 172.21.15.77:0/1871331611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22200c84c0 0x7f2220141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f22249a3640 1 -- 172.21.15.77:0/1871331611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22200c80e0 msgr2=0x7f22200c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f22249a3640 1 --2- 172.21.15.77:0/1871331611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22200c80e0 0x7f22200c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f22249a3640 1 -- 172.21.15.77:0/1871331611 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22140094d0 con 0x7f2220070930 2024-09-13T15:01:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f221ffff640 1 --2- 172.21.15.77:0/1871331611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22200c80e0 0x7f22200c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:28.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f22249a3640 1 --2- 172.21.15.77:0/1871331611 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2220070930 0x7f222014d4c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f22140b3040 tx=0x7f221401baf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:28.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f221d7fa640 1 -- 172.21.15.77:0/1871331611 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140ba600 con 0x7f2220070930 2024-09-13T15:01:28.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f221d7fa640 1 -- 172.21.15.77:0/1871331611 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22140ba7a0 con 0x7f2220070930 2024-09-13T15:01:28.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f221d7fa640 1 -- 172.21.15.77:0/1871331611 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22140bab50 con 0x7f2220070930 2024-09-13T15:01:28.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f2226c07640 1 -- 172.21.15.77:0/1871331611 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22201f2c10 con 0x7f2220070930 2024-09-13T15:01:28.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f2226c07640 1 -- 172.21.15.77:0/1871331611 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22201f2e80 con 0x7f2220070930 2024-09-13T15:01:28.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f221d7fa640 1 -- 172.21.15.77:0/1871331611 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f22140c4460 con 0x7f2220070930 2024-09-13T15:01:28.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f221d7fa640 1 -- 172.21.15.77:0/1871331611 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f22140c3860 con 0x7f2220070930 2024-09-13T15:01:28.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.702+0000 7f2226c07640 1 -- 172.21.15.77:0/1871331611 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2220073bb0 con 0x7f2220070930 2024-09-13T15:01:28.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.706+0000 7f221d7fa640 1 -- 172.21.15.77:0/1871331611 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f22140b5070 con 0x7f2220070930 2024-09-13T15:01:28.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.774+0000 7f2226c07640 1 -- 172.21.15.77:0/1871331611 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd new", "uuid": "349eb66a-9c21-4e17-b6e0-ebd0741b1813", "id": 1} v 0) v1 -- 0x7f2220074130 con 0x7f2220070930 2024-09-13T15:01:28.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.778+0000 7f221d7fa640 1 -- 172.21.15.77:0/1871331611 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "349eb66a-9c21-4e17-b6e0-ebd0741b1813", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f22140c3b40 con 0x7f2220070930 2024-09-13T15:01:28.781 INFO:teuthology.orchestra.run.smithi077.stdout:1 2024-09-13T15:01:28.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.778+0000 7f2226c07640 1 -- 172.21.15.77:0/1871331611 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2220070930 msgr2=0x7f222014d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:28.782 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.778+0000 7f2226c07640 1 --2- 172.21.15.77:0/1871331611 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2220070930 0x7f222014d4c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f22140b3040 tx=0x7f221401baf0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.778+0000 7f2226c07640 1 -- 172.21.15.77:0/1871331611 shutdown_connections 2024-09-13T15:01:28.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.778+0000 7f2226c07640 1 --2- 172.21.15.77:0/1871331611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f22200c84c0 0x7f2220141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.778+0000 7f2226c07640 1 --2- 172.21.15.77:0/1871331611 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22200c80e0 0x7f22200c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.778+0000 7f2226c07640 1 --2- 172.21.15.77:0/1871331611 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2220070930 0x7f222014d4c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.778+0000 7f2226c07640 1 -- 172.21.15.77:0/1871331611 >> 172.21.15.77:0/1871331611 conn(0x7f222006db00 msgr2=0x7f22200c3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:28.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.782+0000 7f2226c07640 1 -- 172.21.15.77:0/1871331611 shutdown_connections 2024-09-13T15:01:28.783 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.782+0000 7f2226c07640 1 -- 172.21.15.77:0/1871331611 wait complete. 2024-09-13T15:01:28.796 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:28.794+0000 7fbf3f106180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T15:01:28.798 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb 2 2024-09-13T15:01:28.809 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:28.805+0000 7f2ea46d1180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T15:01:28.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.950+0000 7fb1ec48d640 1 Processor -- start 2024-09-13T15:01:28.953 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.950+0000 7fb1ec48d640 1 -- start start 2024-09-13T15:01:28.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.950+0000 7fb1ec48d640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1e40cae60 0x7fb1e40c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:28.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.950+0000 7fb1ec48d640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb1e415c810 0x7fb1e4159b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:28.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.950+0000 7fb1ec48d640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e415cd50 con 0x7fb1e40c9e50 2024-09-13T15:01:28.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.950+0000 7fb1ec48d640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e415d030 con 0x7fb1e415c810 2024-09-13T15:01:28.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.950+0000 7fb1ec48d640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e415d310 con 0x7fb1e40cae60 2024-09-13T15:01:28.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1ea229640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1e40cae60 0x7fb1e40c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:28.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1eaa2a640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb1e40c9e50 0x7fb1e40cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45488/0 (socket says 172.21.15.77:45488) 2024-09-13T15:01:28.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1eaa2a640 1 -- 172.21.15.77:0/2647025065 learned_addr learned my addr 172.21.15.77:0/2647025065 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-09-13T15:01:28.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1e9a28640 1 --2- 172.21.15.77:0/2647025065 >> v2:172.21.15.7:3300/0 conn(0x7fb1e415c810 0x7fb1e4159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:28.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1ea229640 1 -- 172.21.15.77:0/2647025065 >> v2:172.21.15.7:3300/0 conn(0x7fb1e415c810 msgr2=0x7fb1e4159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:28.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1ea229640 1 --2- 172.21.15.77:0/2647025065 >> v2:172.21.15.7:3300/0 conn(0x7fb1e415c810 0x7fb1e4159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1ea229640 1 -- 172.21.15.77:0/2647025065 >> v1:172.21.15.77:6789/0 conn(0x7fb1e40c9e50 legacy=0x7fb1e40cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:28.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1ea229640 1 -- 172.21.15.77:0/2647025065 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e415d5f0 con 0x7fb1e40cae60 2024-09-13T15:01:28.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1ea229640 1 --2- 172.21.15.77:0/2647025065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e40cae60 0x7fb1e40c9820 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40724e0 tx=0x7fb1e001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d69ea854ba039435 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:28.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1e9227640 1 -- 172.21.15.77:0/2647025065 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e00ac640 con 0x7fb1e40cae60 2024-09-13T15:01:28.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1e9227640 1 -- 172.21.15.77:0/2647025065 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e00ac7a0 con 0x7fb1e40cae60 2024-09-13T15:01:28.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1e9227640 1 -- 172.21.15.77:0/2647025065 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e00acb30 con 0x7fb1e40cae60 2024-09-13T15:01:28.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1ec48d640 1 -- 172.21.15.77:0/2647025065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e40cae60 msgr2=0x7fb1e40c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:28.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1ec48d640 1 --2- 172.21.15.77:0/2647025065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e40cae60 0x7fb1e40c9820 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb1e40724e0 tx=0x7fb1e001c3c0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1ec48d640 1 -- 172.21.15.77:0/2647025065 shutdown_connections 2024-09-13T15:01:28.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1ec48d640 1 --2- 172.21.15.77:0/2647025065 >> v2:172.21.15.7:3300/0 conn(0x7fb1e415c810 0x7fb1e4159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1ec48d640 1 --2- 172.21.15.77:0/2647025065 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e40cae60 0x7fb1e40c9820 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1ec48d640 1 -- 172.21.15.77:0/2647025065 >> 172.21.15.77:0/2647025065 conn(0x7fb1e4065f10 msgr2=0x7fb1e4066320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:28.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1ec48d640 1 -- 172.21.15.77:0/2647025065 shutdown_connections 2024-09-13T15:01:28.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.954+0000 7fb1ec48d640 1 -- 172.21.15.77:0/2647025065 wait complete. 2024-09-13T15:01:28.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ec48d640 1 Processor -- start 2024-09-13T15:01:28.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ec48d640 1 -- start start 2024-09-13T15:01:28.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ec48d640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1e40c9e50 0x7fb1e41531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:28.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ec48d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e40cae60 0x7fb1e41471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:28.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ec48d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e415c810 0x7fb1e4147710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:28.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ec48d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e4148190 con 0x7fb1e415c810 2024-09-13T15:01:28.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ec48d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e41f58d0 con 0x7fb1e40cae60 2024-09-13T15:01:28.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ec48d640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e414c850 con 0x7fb1e40c9e50 2024-09-13T15:01:28.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1e9a28640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e40cae60 0x7fb1e41471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ea229640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1e40c9e50 0x7fb1e41531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1e9a28640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e40cae60 0x7fb1e41471d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44368/0 (socket says 172.21.15.77:44368) 2024-09-13T15:01:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1e9a28640 1 -- 172.21.15.77:0/3883544897 learned_addr learned my addr 172.21.15.77:0/3883544897 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-13T15:01:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1eaa2a640 1 --2- 172.21.15.77:0/3883544897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e415c810 0x7fb1e4147710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ea229640 1 -- 172.21.15.77:0/3883544897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e40cae60 msgr2=0x7fb1e41471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ea229640 1 --2- 172.21.15.77:0/3883544897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e40cae60 0x7fb1e41471d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ea229640 1 -- 172.21.15.77:0/3883544897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e415c810 msgr2=0x7fb1e4147710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ea229640 1 --2- 172.21.15.77:0/3883544897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e415c810 0x7fb1e4147710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ea229640 1 -- 172.21.15.77:0/3883544897 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e0009420 con 0x7fb1e40c9e50 2024-09-13T15:01:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1e9a28640 1 --2- 172.21.15.77:0/3883544897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e40cae60 0x7fb1e41471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:01:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ea229640 1 --2- 172.21.15.77:0/3883544897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1e40c9e50 0x7fb1e41531a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00ac000 tx=0x7fb1e001ac00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1daffd640 1 -- 172.21.15.77:0/3883544897 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e00bd070 con 0x7fb1e40c9e50 2024-09-13T15:01:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1daffd640 1 -- 172.21.15.77:0/3883544897 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e00b8450 con 0x7fb1e40c9e50 2024-09-13T15:01:28.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1daffd640 1 -- 172.21.15.77:0/3883544897 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e00b8800 con 0x7fb1e40c9e50 2024-09-13T15:01:28.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ec48d640 1 -- 172.21.15.77:0/3883544897 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e414cb10 con 0x7fb1e40c9e50 2024-09-13T15:01:28.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ec48d640 1 -- 172.21.15.77:0/3883544897 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e414d0d0 con 0x7fb1e40c9e50 2024-09-13T15:01:28.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1daffd640 1 -- 172.21.15.77:0/3883544897 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb1e00c2410 con 0x7fb1e40c9e50 2024-09-13T15:01:28.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1daffd640 1 -- 172.21.15.77:0/3883544897 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fb1e00b6820 con 0x7fb1e40c9e50 2024-09-13T15:01:28.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.958+0000 7fb1ec48d640 1 -- 172.21.15.77:0/3883544897 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e4067650 con 0x7fb1e40c9e50 2024-09-13T15:01:28.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:28.962+0000 7fb1daffd640 1 -- 172.21.15.77:0/3883544897 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fb1e00b1070 con 0x7fb1e40c9e50 2024-09-13T15:01:29.031 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.030+0000 7fb1ec48d640 1 -- 172.21.15.77:0/3883544897 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb", "id": 2} v 0) v1 -- 0x7fb1e4159b10 con 0x7fb1e40c9e50 2024-09-13T15:01:29.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.034+0000 7fb1daffd640 1 -- 172.21.15.77:0/3883544897 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb1e00d00b0 con 0x7fb1e40c9e50 2024-09-13T15:01:29.037 INFO:teuthology.orchestra.run.smithi077.stdout:2 2024-09-13T15:01:29.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.034+0000 7fb1ec48d640 1 -- 172.21.15.77:0/3883544897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1e40c9e50 msgr2=0x7fb1e41531a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.034+0000 7fb1ec48d640 1 --2- 172.21.15.77:0/3883544897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1e40c9e50 0x7fb1e41531a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00ac000 tx=0x7fb1e001ac00 comp rx=0 tx=0).stop 2024-09-13T15:01:29.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.034+0000 7fb1ec48d640 1 -- 172.21.15.77:0/3883544897 shutdown_connections 2024-09-13T15:01:29.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.034+0000 7fb1ec48d640 1 --2- 172.21.15.77:0/3883544897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1e415c810 0x7fb1e4147710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.034+0000 7fb1ec48d640 1 --2- 172.21.15.77:0/3883544897 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1e40cae60 0x7fb1e41471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.034+0000 7fb1ec48d640 1 --2- 172.21.15.77:0/3883544897 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1e40c9e50 0x7fb1e41531a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.034+0000 7fb1ec48d640 1 -- 172.21.15.77:0/3883544897 >> 172.21.15.77:0/3883544897 conn(0x7fb1e4065f10 msgr2=0x7fb1e40cd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:29.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.034+0000 7fb1ec48d640 1 -- 172.21.15.77:0/3883544897 shutdown_connections 2024-09-13T15:01:29.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.038+0000 7fb1ec48d640 1 -- 172.21.15.77:0/3883544897 wait complete. 2024-09-13T15:01:29.053 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 62a53e35-fdf1-4244-877a-5b751d689d3a 3 2024-09-13T15:01:29.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.162+0000 7f4979a36640 1 Processor -- start 2024-09-13T15:01:29.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.162+0000 7f4979a36640 1 -- start start 2024-09-13T15:01:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f4979a36640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f49740c86c0 0x7f49740c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f4979a36640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49740c6230 0x7f49740c3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f4979a36640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4974157e10 con 0x7f497413fae0 2024-09-13T15:01:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f4979a36640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49740c8aa0 con 0x7f49740c86c0 2024-09-13T15:01:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f4979a36640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4974140530 con 0x7f49740c6230 2024-09-13T15:01:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f496bfff640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f497413fae0 0x7f49740c4df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45492/0 (socket says 172.21.15.77:45492) 2024-09-13T15:01:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f49737fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49740c6230 0x7f49740c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f496bfff640 1 -- 172.21.15.77:0/3296494484 learned_addr learned my addr 172.21.15.77:0/3296494484 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-09-13T15:01:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f4972ffd640 1 --2- 172.21.15.77:0/3296494484 >> v2:172.21.15.7:3300/0 conn(0x7f49740c86c0 0x7f49740c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f49737fe640 1 -- 172.21.15.77:0/3296494484 >> v2:172.21.15.7:3300/0 conn(0x7f49740c86c0 msgr2=0x7f49740c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f49737fe640 1 --2- 172.21.15.77:0/3296494484 >> v2:172.21.15.7:3300/0 conn(0x7f49740c86c0 0x7f49740c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f49737fe640 1 -- 172.21.15.77:0/3296494484 >> v1:172.21.15.77:6789/0 conn(0x7f497413fae0 legacy=0x7f49740c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f49737fe640 1 -- 172.21.15.77:0/3296494484 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497413ff70 con 0x7f49740c6230 2024-09-13T15:01:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f49727fc640 1 -- 172.21.15.77:0/3296494484 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4145091179 0 0) 0x7f4974157e10 con 0x7f497413fae0 2024-09-13T15:01:29.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f49737fe640 1 --2- 172.21.15.77:0/3296494484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49740c6230 0x7f49740c3480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f496c009d90 tx=0x7f496c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54f4393387df4120 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:29.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f49727fc640 1 -- 172.21.15.77:0/3296494484 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c0a5a00 con 0x7f49740c6230 2024-09-13T15:01:29.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f49727fc640 1 -- 172.21.15.77:0/3296494484 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c0a5b60 con 0x7f49740c6230 2024-09-13T15:01:29.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.166+0000 7f49727fc640 1 -- 172.21.15.77:0/3296494484 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c0ad440 con 0x7f49740c6230 2024-09-13T15:01:29.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 -- 172.21.15.77:0/3296494484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49740c6230 msgr2=0x7f49740c3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 --2- 172.21.15.77:0/3296494484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49740c6230 0x7f49740c3480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f496c009d90 tx=0x7f496c01c940 comp rx=0 tx=0).stop 2024-09-13T15:01:29.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 -- 172.21.15.77:0/3296494484 shutdown_connections 2024-09-13T15:01:29.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 --2- 172.21.15.77:0/3296494484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49740c6230 0x7f49740c3480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 --2- 172.21.15.77:0/3296494484 >> v2:172.21.15.7:3300/0 conn(0x7f49740c86c0 0x7f49740c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 -- 172.21.15.77:0/3296494484 >> 172.21.15.77:0/3296494484 conn(0x7f497406d990 msgr2=0x7f497406dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:29.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 -- 172.21.15.77:0/3296494484 shutdown_connections 2024-09-13T15:01:29.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 -- 172.21.15.77:0/3296494484 wait complete. 2024-09-13T15:01:29.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 Processor -- start 2024-09-13T15:01:29.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 -- start start 2024-09-13T15:01:29.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49740c6230 0x7f497413ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49740c86c0 0x7f497413e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497413ea30 0x7f4974134e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49741f3b90 con 0x7f49740c86c0 2024-09-13T15:01:29.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497413d360 con 0x7f49740c6230 2024-09-13T15:01:29.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49741f4020 con 0x7f497413ea30 2024-09-13T15:01:29.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4972ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49740c6230 0x7f497413ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f49737fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497413ea30 0x7f4974134e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4972ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49740c6230 0x7f497413ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44378/0 (socket says 172.21.15.77:44378) 2024-09-13T15:01:29.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4972ffd640 1 -- 172.21.15.77:0/3996163144 learned_addr learned my addr 172.21.15.77:0/3996163144 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-13T15:01:29.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f496bfff640 1 --2- 172.21.15.77:0/3996163144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49740c86c0 0x7f497413e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f49737fe640 1 -- 172.21.15.77:0/3996163144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49740c6230 msgr2=0x7f497413ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f49737fe640 1 --2- 172.21.15.77:0/3996163144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49740c6230 0x7f497413ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f49737fe640 1 -- 172.21.15.77:0/3996163144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49740c86c0 msgr2=0x7f497413e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f49737fe640 1 --2- 172.21.15.77:0/3996163144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49740c86c0 0x7f497413e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f49737fe640 1 -- 172.21.15.77:0/3996163144 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c009a70 con 0x7f497413ea30 2024-09-13T15:01:29.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4972ffd640 1 --2- 172.21.15.77:0/3996163144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49740c6230 0x7f497413ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:01:29.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f49737fe640 1 --2- 172.21.15.77:0/3996163144 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497413ea30 0x7f4974134e80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f496c0ac000 tx=0x7f496c0196e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:29.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4970ff9640 1 -- 172.21.15.77:0/3996163144 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c0addd0 con 0x7f497413ea30 2024-09-13T15:01:29.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4970ff9640 1 -- 172.21.15.77:0/3996163144 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496c009450 con 0x7f497413ea30 2024-09-13T15:01:29.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 -- 172.21.15.77:0/3996163144 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497413d0c0 con 0x7f497413ea30 2024-09-13T15:01:29.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4970ff9640 1 -- 172.21.15.77:0/3996163144 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496c0b9690 con 0x7f497413ea30 2024-09-13T15:01:29.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4979a36640 1 -- 172.21.15.77:0/3996163144 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49741f3540 con 0x7f497413ea30 2024-09-13T15:01:29.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4970ff9640 1 -- 172.21.15.77:0/3996163144 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f496c0b9af0 con 0x7f497413ea30 2024-09-13T15:01:29.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.170+0000 7f4970ff9640 1 -- 172.21.15.77:0/3996163144 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f496c0b7890 con 0x7f497413ea30 2024-09-13T15:01:29.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.174+0000 7f4979a36640 1 -- 172.21.15.77:0/3996163144 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49741f3d00 con 0x7f497413ea30 2024-09-13T15:01:29.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.174+0000 7f4970ff9640 1 -- 172.21.15.77:0/3996163144 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f496c0be020 con 0x7f497413ea30 2024-09-13T15:01:29.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.242+0000 7f4979a36640 1 -- 172.21.15.77:0/3996163144 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd new", "uuid": "62a53e35-fdf1-4244-877a-5b751d689d3a", "id": 3} v 0) v1 -- 0x7f49740c4df0 con 0x7f497413ea30 2024-09-13T15:01:29.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.246+0000 7f4970ff9640 1 -- 172.21.15.77:0/3996163144 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "62a53e35-fdf1-4244-877a-5b751d689d3a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f496c0b2070 con 0x7f497413ea30 2024-09-13T15:01:29.250 INFO:teuthology.orchestra.run.smithi077.stdout:3 2024-09-13T15:01:29.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.250+0000 7f4979a36640 1 -- 172.21.15.77:0/3996163144 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497413ea30 msgr2=0x7f4974134e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.250+0000 7f4979a36640 1 --2- 172.21.15.77:0/3996163144 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497413ea30 0x7f4974134e80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f496c0ac000 tx=0x7f496c0196e0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.250+0000 7f4979a36640 1 -- 172.21.15.77:0/3996163144 shutdown_connections 2024-09-13T15:01:29.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.250+0000 7f4979a36640 1 --2- 172.21.15.77:0/3996163144 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f497413ea30 0x7f4974134e80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.250+0000 7f4979a36640 1 --2- 172.21.15.77:0/3996163144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49740c86c0 0x7f497413e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.250+0000 7f4979a36640 1 --2- 172.21.15.77:0/3996163144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49740c6230 0x7f497413ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.250+0000 7f4979a36640 1 -- 172.21.15.77:0/3996163144 >> 172.21.15.77:0/3996163144 conn(0x7f497406d990 msgr2=0x7f4974139010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:29.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.250+0000 7f4979a36640 1 -- 172.21.15.77:0/3996163144 shutdown_connections 2024-09-13T15:01:29.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.250+0000 7f4979a36640 1 -- 172.21.15.77:0/3996163144 wait complete. 2024-09-13T15:01:29.267 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new edba7b1c-b326-4dfa-af20-8b7c4cb576a1 4 2024-09-13T15:01:29.369 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:29.366+0000 7fbf3f106180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T15:01:29.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.374+0000 7f96fac25640 1 Processor -- start 2024-09-13T15:01:29.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.374+0000 7f96fac25640 1 -- start start 2024-09-13T15:01:29.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.378+0000 7f96fac25640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f96f4157a90 0x7f96f406ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.378+0000 7f96fac25640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f40c7a20 con 0x7f96f41510c0 2024-09-13T15:01:29.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.378+0000 7f96fac25640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f40c2480 con 0x7f96f40c1eb0 2024-09-13T15:01:29.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.378+0000 7f96fac25640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f40c3750 con 0x7f96f4157a90 2024-09-13T15:01:29.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.378+0000 7f96f3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f96f4157a90 0x7f96f406ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.378+0000 7f96f3fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f96f4157a90 0x7f96f406ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44384/0 (socket says 172.21.15.77:44384) 2024-09-13T15:01:29.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.378+0000 7f96f3fff640 1 -- 172.21.15.77:0/420713861 learned_addr learned my addr 172.21.15.77:0/420713861 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-13T15:01:29.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.378+0000 7f96f3fff640 1 -- 172.21.15.77:0/420713861 >> v1:172.21.15.77:6789/0 conn(0x7f96f40c1eb0 legacy=0x7f96f406d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.378+0000 7f96f3fff640 1 -- 172.21.15.77:0/420713861 >> v1:172.21.15.7:6789/0 conn(0x7f96f41510c0 legacy=0x7f96f40c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:29.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.378+0000 7f96f3fff640 1 -- 172.21.15.77:0/420713861 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f40c2760 con 0x7f96f4157a90 2024-09-13T15:01:29.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.378+0000 7f96f3fff640 1 --2- 172.21.15.77:0/420713861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96f4157a90 0x7f96f406ef10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009870 tx=0x7f96e001ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d63988655d946f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:29.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.378+0000 7f96f37fe640 1 -- 172.21.15.77:0/420713861 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00a8a10 con 0x7f96f4157a90 2024-09-13T15:01:29.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.378+0000 7f96f37fe640 1 -- 172.21.15.77:0/420713861 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e00a8b70 con 0x7f96f4157a90 2024-09-13T15:01:29.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.378+0000 7f96f37fe640 1 -- 172.21.15.77:0/420713861 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00b0440 con 0x7f96f4157a90 2024-09-13T15:01:29.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96fac25640 1 -- 172.21.15.77:0/420713861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96f4157a90 msgr2=0x7f96f406ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96fac25640 1 --2- 172.21.15.77:0/420713861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96f4157a90 0x7f96f406ef10 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009870 tx=0x7f96e001ed10 comp rx=0 tx=0).stop 2024-09-13T15:01:29.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96fac25640 1 -- 172.21.15.77:0/420713861 shutdown_connections 2024-09-13T15:01:29.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96fac25640 1 --2- 172.21.15.77:0/420713861 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96f4157a90 0x7f96f406ef10 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96fac25640 1 -- 172.21.15.77:0/420713861 >> 172.21.15.77:0/420713861 conn(0x7f96f4071730 msgr2=0x7f96f4071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:29.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96fac25640 1 -- 172.21.15.77:0/420713861 shutdown_connections 2024-09-13T15:01:29.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96fac25640 1 -- 172.21.15.77:0/420713861 wait complete. 2024-09-13T15:01:29.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96fac25640 1 Processor -- start 2024-09-13T15:01:29.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96fac25640 1 -- start start 2024-09-13T15:01:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96fac25640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f40c1eb0 0x7f96f41dd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96fac25640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96f41510c0 0x7f96f41ed170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96fac25640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96f4157a90 0x7f96f40c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96fac25640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f41ecce0 con 0x7f96f40c1eb0 2024-09-13T15:01:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96fac25640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f40c6710 con 0x7f96f4157a90 2024-09-13T15:01:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96fac25640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f40c69d0 con 0x7f96f41510c0 2024-09-13T15:01:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96f3fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96f41510c0 0x7f96f41ed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96f3fff640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96f41510c0 0x7f96f41ed170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.77:57338/0 (socket says 172.21.15.77:57338) 2024-09-13T15:01:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96f3fff640 1 -- 172.21.15.77:0/3730643174 learned_addr learned my addr 172.21.15.77:0/3730643174 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-13T15:01:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96f91c2640 1 --2- 172.21.15.77:0/3730643174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96f4157a90 0x7f96f40c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96f89c1640 1 --2- 172.21.15.77:0/3730643174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f40c1eb0 0x7f96f41dd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96f3fff640 1 -- 172.21.15.77:0/3730643174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96f4157a90 msgr2=0x7f96f40c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96f3fff640 1 --2- 172.21.15.77:0/3730643174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96f4157a90 0x7f96f40c59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96f3fff640 1 -- 172.21.15.77:0/3730643174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f40c1eb0 msgr2=0x7f96f41dd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96f3fff640 1 --2- 172.21.15.77:0/3730643174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f40c1eb0 0x7f96f41dd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96f3fff640 1 -- 172.21.15.77:0/3730643174 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e00094d0 con 0x7f96f41510c0 2024-09-13T15:01:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96f3fff640 1 --2- 172.21.15.77:0/3730643174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96f41510c0 0x7f96f41ed170 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f96e00b3040 tx=0x7f96e001bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96f17fa640 1 -- 172.21.15.77:0/3730643174 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00b0e40 con 0x7f96f41510c0 2024-09-13T15:01:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96f17fa640 1 -- 172.21.15.77:0/3730643174 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e00bb470 con 0x7f96f41510c0 2024-09-13T15:01:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96fac25640 1 -- 172.21.15.77:0/3730643174 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f40c6cb0 con 0x7f96f41510c0 2024-09-13T15:01:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96f17fa640 1 -- 172.21.15.77:0/3730643174 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00bb820 con 0x7f96f41510c0 2024-09-13T15:01:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96fac25640 1 -- 172.21.15.77:0/3730643174 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f4156660 con 0x7f96f41510c0 2024-09-13T15:01:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96f17fa640 1 -- 172.21.15.77:0/3730643174 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f96e00b7070 con 0x7f96f41510c0 2024-09-13T15:01:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.382+0000 7f96f17fa640 1 -- 172.21.15.77:0/3730643174 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f96e00c5dd0 con 0x7f96f41510c0 2024-09-13T15:01:29.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.386+0000 7f96fac25640 1 -- 172.21.15.77:0/3730643174 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f41ece50 con 0x7f96f41510c0 2024-09-13T15:01:29.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.386+0000 7f96f17fa640 1 -- 172.21.15.77:0/3730643174 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f96e00b5070 con 0x7f96f41510c0 2024-09-13T15:01:29.425 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:29.422+0000 7fbf3f106180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T15:01:29.443 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:29.437+0000 7f2ea46d1180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T15:01:29.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.450+0000 7f96fac25640 1 -- 172.21.15.77:0/3730643174 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd new", "uuid": "edba7b1c-b326-4dfa-af20-8b7c4cb576a1", "id": 4} v 0) v1 -- 0x7f96f41ece50 con 0x7f96f41510c0 2024-09-13T15:01:29.456 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.454+0000 7f96f17fa640 1 -- 172.21.15.77:0/3730643174 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "edba7b1c-b326-4dfa-af20-8b7c4cb576a1", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f96e00bbd70 con 0x7f96f41510c0 2024-09-13T15:01:29.456 INFO:teuthology.orchestra.run.smithi077.stdout:4 2024-09-13T15:01:29.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.454+0000 7f96fac25640 1 -- 172.21.15.77:0/3730643174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96f41510c0 msgr2=0x7f96f41ed170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.454+0000 7f96fac25640 1 --2- 172.21.15.77:0/3730643174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96f41510c0 0x7f96f41ed170 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f96e00b3040 tx=0x7f96e001bab0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.454+0000 7f96fac25640 1 -- 172.21.15.77:0/3730643174 shutdown_connections 2024-09-13T15:01:29.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.454+0000 7f96fac25640 1 --2- 172.21.15.77:0/3730643174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96f4157a90 0x7f96f40c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.454+0000 7f96fac25640 1 --2- 172.21.15.77:0/3730643174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f96f41510c0 0x7f96f41ed170 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.454+0000 7f96fac25640 1 --2- 172.21.15.77:0/3730643174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96f40c1eb0 0x7f96f41dd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.454+0000 7f96fac25640 1 -- 172.21.15.77:0/3730643174 >> 172.21.15.77:0/3730643174 conn(0x7f96f4071730 msgr2=0x7f96f414b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:29.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.454+0000 7f96fac25640 1 -- 172.21.15.77:0/3730643174 shutdown_connections 2024-09-13T15:01:29.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.454+0000 7f96fac25640 1 -- 172.21.15.77:0/3730643174 wait complete. 2024-09-13T15:01:29.478 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 0915849d-f8c3-4966-afd5-0ef25772528a 5 2024-09-13T15:01:29.487 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:29.486+0000 7fbf3f106180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T15:01:29.509 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:29.505+0000 7f2ea46d1180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T15:01:29.567 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:29.566+0000 7fbf3f106180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T15:01:29.573 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:29.569+0000 7f2ea46d1180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T15:01:29.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf3a9f8640 1 Processor -- start 2024-09-13T15:01:29.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf3a9f8640 1 -- start start 2024-09-13T15:01:29.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf3a9f8640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faf3406a190 0x7faf3406d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf3a9f8640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faf3406db70 0x7faf3406ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf3a9f8640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf34159d90 con 0x7faf3406a570 2024-09-13T15:01:29.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf3a9f8640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3406aba0 con 0x7faf3406db70 2024-09-13T15:01:29.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf3a9f8640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3406e0e0 con 0x7faf3406a190 2024-09-13T15:01:29.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf33fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faf3406a190 0x7faf3406d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf33fff640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faf3406a190 0x7faf3406d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44394/0 (socket says 172.21.15.77:44394) 2024-09-13T15:01:29.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf33fff640 1 -- 172.21.15.77:0/130402433 learned_addr learned my addr 172.21.15.77:0/130402433 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-13T15:01:29.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf38f95640 1 --2- 172.21.15.77:0/130402433 >> v2:172.21.15.7:3300/0 conn(0x7faf3406db70 0x7faf3406ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf33fff640 1 -- 172.21.15.77:0/130402433 >> v2:172.21.15.7:3300/0 conn(0x7faf3406db70 msgr2=0x7faf3406ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:29.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf33fff640 1 --2- 172.21.15.77:0/130402433 >> v2:172.21.15.7:3300/0 conn(0x7faf3406db70 0x7faf3406ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf33fff640 1 -- 172.21.15.77:0/130402433 >> v1:172.21.15.77:6789/0 conn(0x7faf3406a570 legacy=0x7faf34152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf33fff640 1 -- 172.21.15.77:0/130402433 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf34159460 con 0x7faf3406a190 2024-09-13T15:01:29.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf38f95640 1 --2- 172.21.15.77:0/130402433 >> v2:172.21.15.7:3300/0 conn(0x7faf3406db70 0x7faf3406ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:01:29.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf33fff640 1 --2- 172.21.15.77:0/130402433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf3406a190 0x7faf3406d630 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faf340cdea0 tx=0x7faf2401ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef9f806662d3590f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:29.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf32ffd640 1 -- 172.21.15.77:0/130402433 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf240a8a10 con 0x7faf3406a190 2024-09-13T15:01:29.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf32ffd640 1 -- 172.21.15.77:0/130402433 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf240a8b70 con 0x7faf3406a190 2024-09-13T15:01:29.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.586+0000 7faf32ffd640 1 -- 172.21.15.77:0/130402433 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf240b0440 con 0x7faf3406a190 2024-09-13T15:01:29.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 -- 172.21.15.77:0/130402433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf3406a190 msgr2=0x7faf3406d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 --2- 172.21.15.77:0/130402433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf3406a190 0x7faf3406d630 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faf340cdea0 tx=0x7faf2401ed10 comp rx=0 tx=0).stop 2024-09-13T15:01:29.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 -- 172.21.15.77:0/130402433 shutdown_connections 2024-09-13T15:01:29.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 --2- 172.21.15.77:0/130402433 >> v2:172.21.15.7:3300/0 conn(0x7faf3406db70 0x7faf3406ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 --2- 172.21.15.77:0/130402433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf3406a190 0x7faf3406d630 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 -- 172.21.15.77:0/130402433 >> 172.21.15.77:0/130402433 conn(0x7faf34071730 msgr2=0x7faf34071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:29.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 -- 172.21.15.77:0/130402433 shutdown_connections 2024-09-13T15:01:29.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 -- 172.21.15.77:0/130402433 wait complete. 2024-09-13T15:01:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 Processor -- start 2024-09-13T15:01:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 -- start start 2024-09-13T15:01:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf3406a190 0x7faf34150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf3406a570 0x7faf34148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3406db70 0x7faf34155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf34145500 con 0x7faf3406db70 2024-09-13T15:01:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf34145da0 con 0x7faf3406a190 2024-09-13T15:01:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf34150f70 con 0x7faf3406a570 2024-09-13T15:01:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf33fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf3406a190 0x7faf34150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf33fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf3406a190 0x7faf34150a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44396/0 (socket says 172.21.15.77:44396) 2024-09-13T15:01:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf337fe640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf3406a570 0x7faf34148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf33fff640 1 -- 172.21.15.77:0/1864765928 learned_addr learned my addr 172.21.15.77:0/1864765928 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-13T15:01:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf38f95640 1 --2- 172.21.15.77:0/1864765928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3406db70 0x7faf34155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf33fff640 1 -- 172.21.15.77:0/1864765928 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf3406a570 msgr2=0x7faf34148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf33fff640 1 --2- 172.21.15.77:0/1864765928 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf3406a570 0x7faf34148a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf33fff640 1 -- 172.21.15.77:0/1864765928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3406db70 msgr2=0x7faf34155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf33fff640 1 --2- 172.21.15.77:0/1864765928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3406db70 0x7faf34155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf33fff640 1 -- 172.21.15.77:0/1864765928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf240094d0 con 0x7faf3406a190 2024-09-13T15:01:29.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf337fe640 1 --2- 172.21.15.77:0/1864765928 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf3406a570 0x7faf34148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:01:29.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf38f95640 1 --2- 172.21.15.77:0/1864765928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3406db70 0x7faf34155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:29.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf33fff640 1 --2- 172.21.15.77:0/1864765928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf3406a190 0x7faf34150a30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faf2401b920 tx=0x7faf2401bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:29.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf30ff9640 1 -- 172.21.15.77:0/1864765928 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf240ba600 con 0x7faf3406a190 2024-09-13T15:01:29.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf30ff9640 1 -- 172.21.15.77:0/1864765928 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf240ba780 con 0x7faf3406a190 2024-09-13T15:01:29.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf30ff9640 1 -- 172.21.15.77:0/1864765928 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf240bab30 con 0x7faf3406a190 2024-09-13T15:01:29.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 -- 172.21.15.77:0/1864765928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf340cb220 con 0x7faf3406a190 2024-09-13T15:01:29.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf3a9f8640 1 -- 172.21.15.77:0/1864765928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf34145750 con 0x7faf3406a190 2024-09-13T15:01:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf30ff9640 1 -- 172.21.15.77:0/1864765928 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7faf240c4460 con 0x7faf3406a190 2024-09-13T15:01:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.590+0000 7faf30ff9640 1 -- 172.21.15.77:0/1864765928 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7faf240c39e0 con 0x7faf3406a190 2024-09-13T15:01:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.594+0000 7faf3a9f8640 1 -- 172.21.15.77:0/1864765928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf34157d60 con 0x7faf3406a190 2024-09-13T15:01:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.594+0000 7faf30ff9640 1 -- 172.21.15.77:0/1864765928 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7faf240b5070 con 0x7faf3406a190 2024-09-13T15:01:29.621 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:29.618+0000 7fbf3f106180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T15:01:29.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.658+0000 7faf3a9f8640 1 -- 172.21.15.77:0/1864765928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0915849d-f8c3-4966-afd5-0ef25772528a", "id": 5} v 0) v1 -- 0x7faf340c7c50 con 0x7faf3406a190 2024-09-13T15:01:29.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.662+0000 7faf30ff9640 1 -- 172.21.15.77:0/1864765928 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0915849d-f8c3-4966-afd5-0ef25772528a", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7faf240c3d20 con 0x7faf3406a190 2024-09-13T15:01:29.664 INFO:teuthology.orchestra.run.smithi077.stdout:5 2024-09-13T15:01:29.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.662+0000 7faf3a9f8640 1 -- 172.21.15.77:0/1864765928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf3406a190 msgr2=0x7faf34150a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.662+0000 7faf3a9f8640 1 --2- 172.21.15.77:0/1864765928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf3406a190 0x7faf34150a30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7faf2401b920 tx=0x7faf2401bab0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.662+0000 7faf3a9f8640 1 -- 172.21.15.77:0/1864765928 shutdown_connections 2024-09-13T15:01:29.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.662+0000 7faf3a9f8640 1 --2- 172.21.15.77:0/1864765928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faf3406db70 0x7faf34155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.662+0000 7faf3a9f8640 1 --2- 172.21.15.77:0/1864765928 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faf3406a570 0x7faf34148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.662+0000 7faf3a9f8640 1 --2- 172.21.15.77:0/1864765928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf3406a190 0x7faf34150a30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.662+0000 7faf3a9f8640 1 -- 172.21.15.77:0/1864765928 >> 172.21.15.77:0/1864765928 conn(0x7faf34071730 msgr2=0x7faf340c96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:29.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.662+0000 7faf3a9f8640 1 -- 172.21.15.77:0/1864765928 shutdown_connections 2024-09-13T15:01:29.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.662+0000 7faf3a9f8640 1 -- 172.21.15.77:0/1864765928 wait complete. 2024-09-13T15:01:29.667 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:29.661+0000 7f2ea46d1180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T15:01:29.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 705b7938-2616-4ce7-862e-6c1f8f3236f3 6 2024-09-13T15:01:29.701 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:29.698+0000 7fbf3f106180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T15:01:29.730 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:29.725+0000 7f2ea46d1180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T15:01:29.754 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:29.750+0000 7fbf3f106180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T15:01:29.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.818+0000 7f050bca1640 1 Processor -- start 2024-09-13T15:01:29.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.818+0000 7f050bca1640 1 -- start start 2024-09-13T15:01:29.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.818+0000 7f050bca1640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0504153570 0x7f05040735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.818+0000 7f050bca1640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050415d170 con 0x7f05040c79f0 2024-09-13T15:01:29.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.818+0000 7f050bca1640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f050415d410 con 0x7f05040c80e0 2024-09-13T15:01:29.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.818+0000 7f050bca1640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05040c5f70 con 0x7f0504153570 2024-09-13T15:01:29.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0509a3d640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f05040c80e0 0x7f0504152e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:45512/0 (socket says 172.21.15.77:45512) 2024-09-13T15:01:29.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0509a3d640 1 -- 172.21.15.77:0/4125331013 learned_addr learned my addr 172.21.15.77:0/4125331013 (peer_addr_for_me v1:172.21.15.77:0/0) 2024-09-13T15:01:29.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f050a23e640 1 --2- 172.21.15.77:0/4125331013 >> v2:172.21.15.7:3300/0 conn(0x7f0504153570 0x7f05040735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 -- 172.21.15.77:0/4125331013 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482022652 0 0) 0x7f050415d410 con 0x7f05040c80e0 2024-09-13T15:01:29.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 -- 172.21.15.77:0/4125331013 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04f0003530 con 0x7f05040c80e0 2024-09-13T15:01:29.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 -- 172.21.15.77:0/4125331013 <== mon.1 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2084912589 0 0) 0x7f04f0003530 con 0x7f05040c80e0 2024-09-13T15:01:29.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 -- 172.21.15.77:0/4125331013 >> v2:172.21.15.7:3300/0 conn(0x7f0504153570 msgr2=0x7f05040735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:29.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 --2- 172.21.15.77:0/4125331013 >> v2:172.21.15.7:3300/0 conn(0x7f0504153570 0x7f05040735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 -- 172.21.15.77:0/4125331013 >> v1:172.21.15.7:6789/0 conn(0x7f05040c79f0 legacy=0x7f05041593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 -- 172.21.15.77:0/4125331013 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05040c6250 con 0x7f05040c80e0 2024-09-13T15:01:29.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 -- 172.21.15.77:0/4125331013 <== mon.1 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f0500001a00 con 0x7f05040c80e0 2024-09-13T15:01:29.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 -- 172.21.15.77:0/4125331013 >> v1:172.21.15.77:6789/0 conn(0x7f05040c80e0 legacy=0x7f0504152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 --2- 172.21.15.77:0/4125331013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04f0003980 0x7f04f0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 --2- 172.21.15.77:0/4125331013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04f00047d0 0x7f04f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 --2- 172.21.15.77:0/4125331013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f0005190 0x7f04f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 -- 172.21.15.77:0/4125331013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05040c5f70 con 0x7f04f0003980 2024-09-13T15:01:29.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 -- 172.21.15.77:0/4125331013 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f000c040 con 0x7f04f0005190 2024-09-13T15:01:29.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 -- 172.21.15.77:0/4125331013 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f000c200 con 0x7f04f00047d0 2024-09-13T15:01:29.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f050923c640 1 --2- 172.21.15.77:0/4125331013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04f00047d0 0x7f04f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f050a23e640 1 --2- 172.21.15.77:0/4125331013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f0005190 0x7f04f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0509a3d640 1 --2- 172.21.15.77:0/4125331013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04f0003980 0x7f04f0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f050a23e640 1 -- 172.21.15.77:0/4125331013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04f00047d0 msgr2=0x7f04f0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:29.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f050a23e640 1 --2- 172.21.15.77:0/4125331013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04f00047d0 0x7f04f0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f050a23e640 1 -- 172.21.15.77:0/4125331013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04f0003980 msgr2=0x7f04f0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:29.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f050a23e640 1 --2- 172.21.15.77:0/4125331013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f04f0003980 0x7f04f0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f050a23e640 1 -- 172.21.15.77:0/4125331013 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f0003530 con 0x7f04f0005190 2024-09-13T15:01:29.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f050923c640 1 --2- 172.21.15.77:0/4125331013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f04f00047d0 0x7f04f0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:01:29.828 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:29.821+0000 7f2ea46d1180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T15:01:29.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f050a23e640 1 -- 172.21.15.77:0/4125331013 reap_dead start 2024-09-13T15:01:29.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f050a23e640 1 --2- 172.21.15.77:0/4125331013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f0005190 0x7f04f000b990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009ae0 tx=0x7f04fc01cab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=837bdf52e51817c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:29.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 -- 172.21.15.77:0/4125331013 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc004020 con 0x7f04f0005190 2024-09-13T15:01:29.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 -- 172.21.15.77:0/4125331013 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04fc004180 con 0x7f04f0005190 2024-09-13T15:01:29.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.822+0000 7f0508a3b640 1 -- 172.21.15.77:0/4125331013 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc0a56a0 con 0x7f04f0005190 2024-09-13T15:01:29.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050bca1640 1 -- 172.21.15.77:0/4125331013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f0005190 msgr2=0x7f04f000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050bca1640 1 --2- 172.21.15.77:0/4125331013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f0005190 0x7f04f000b990 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f04fc009ae0 tx=0x7f04fc01cab0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050bca1640 1 -- 172.21.15.77:0/4125331013 shutdown_connections 2024-09-13T15:01:29.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050bca1640 1 --2- 172.21.15.77:0/4125331013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f0005190 0x7f04f000b990 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050bca1640 1 -- 172.21.15.77:0/4125331013 >> 172.21.15.77:0/4125331013 conn(0x7f050406db00 msgr2=0x7f050406df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:29.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050bca1640 1 -- 172.21.15.77:0/4125331013 shutdown_connections 2024-09-13T15:01:29.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050bca1640 1 -- 172.21.15.77:0/4125331013 wait complete. 2024-09-13T15:01:29.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050bca1640 1 Processor -- start 2024-09-13T15:01:29.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050bca1640 1 -- start start 2024-09-13T15:01:29.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050bca1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f0005190 0x7f05041f2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050bca1640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050415a630 0x7f05041ee320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050bca1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050415b540 0x7f0504159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:29.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050bca1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05041f18d0 con 0x7f050415b540 2024-09-13T15:01:29.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050bca1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05041f1e90 con 0x7f04f0005190 2024-09-13T15:01:29.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050bca1640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05041f2860 con 0x7f050415a630 2024-09-13T15:01:29.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050923c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050415a630 0x7f05041ee320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f0509a3d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f0005190 0x7f05041f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050923c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050415a630 0x7f05041ee320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.77:57346/0 (socket says 172.21.15.77:57346) 2024-09-13T15:01:29.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f0509a3d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f0005190 0x7f05041f2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44410/0 (socket says 172.21.15.77:44410) 2024-09-13T15:01:29.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050923c640 1 -- 172.21.15.77:0/368860255 learned_addr learned my addr 172.21.15.77:0/368860255 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-13T15:01:29.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050a23e640 1 --2- 172.21.15.77:0/368860255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050415b540 0x7f0504159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:29.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050923c640 1 -- 172.21.15.77:0/368860255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f0005190 msgr2=0x7f05041f2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050923c640 1 --2- 172.21.15.77:0/368860255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f0005190 0x7f05041f2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050923c640 1 -- 172.21.15.77:0/368860255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050415b540 msgr2=0x7f0504159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050923c640 1 --2- 172.21.15.77:0/368860255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050415b540 0x7f0504159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050923c640 1 -- 172.21.15.77:0/368860255 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05041ee860 con 0x7f050415a630 2024-09-13T15:01:29.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f0509a3d640 1 --2- 172.21.15.77:0/368860255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f0005190 0x7f05041f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:01:29.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.826+0000 7f050923c640 1 --2- 172.21.15.77:0/368860255 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050415a630 0x7f05041ee320 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f04f400f820 tx=0x7f04f400fc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:29.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.830+0000 7f04fa7fc640 1 -- 172.21.15.77:0/368860255 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f40050d0 con 0x7f050415a630 2024-09-13T15:01:29.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.830+0000 7f04fa7fc640 1 -- 172.21.15.77:0/368860255 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f4005230 con 0x7f050415a630 2024-09-13T15:01:29.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.830+0000 7f050bca1640 1 -- 172.21.15.77:0/368860255 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05041eeaf0 con 0x7f050415a630 2024-09-13T15:01:29.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.830+0000 7f04fa7fc640 1 -- 172.21.15.77:0/368860255 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f400d730 con 0x7f050415a630 2024-09-13T15:01:29.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.830+0000 7f050bca1640 1 -- 172.21.15.77:0/368860255 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05041ef0b0 con 0x7f050415a630 2024-09-13T15:01:29.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.830+0000 7f04fa7fc640 1 -- 172.21.15.77:0/368860255 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f04f400db90 con 0x7f050415a630 2024-09-13T15:01:29.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.830+0000 7f04fa7fc640 1 -- 172.21.15.77:0/368860255 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f04f4003c90 con 0x7f050415a630 2024-09-13T15:01:29.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.830+0000 7f050bca1640 1 -- 172.21.15.77:0/368860255 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0504073bb0 con 0x7f050415a630 2024-09-13T15:01:29.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.830+0000 7f04fa7fc640 1 -- 172.21.15.77:0/368860255 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f04f4003e50 con 0x7f050415a630 2024-09-13T15:01:29.888 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:29.885+0000 7f2ea46d1180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T15:01:29.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.898+0000 7f050bca1640 1 -- 172.21.15.77:0/368860255 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd new", "uuid": "705b7938-2616-4ce7-862e-6c1f8f3236f3", "id": 6} v 0) v1 -- 0x7f0504074130 con 0x7f050415a630 2024-09-13T15:01:29.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.902+0000 7f04fa7fc640 1 -- 172.21.15.77:0/368860255 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "705b7938-2616-4ce7-862e-6c1f8f3236f3", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f04f4003600 con 0x7f050415a630 2024-09-13T15:01:29.906 INFO:teuthology.orchestra.run.smithi077.stdout:6 2024-09-13T15:01:29.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.906+0000 7f050bca1640 1 -- 172.21.15.77:0/368860255 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050415a630 msgr2=0x7f05041ee320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:29.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.906+0000 7f050bca1640 1 --2- 172.21.15.77:0/368860255 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050415a630 0x7f05041ee320 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f04f400f820 tx=0x7f04f400fc20 comp rx=0 tx=0).stop 2024-09-13T15:01:29.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.906+0000 7f050bca1640 1 -- 172.21.15.77:0/368860255 shutdown_connections 2024-09-13T15:01:29.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.906+0000 7f050bca1640 1 --2- 172.21.15.77:0/368860255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050415b540 0x7f0504159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.906+0000 7f050bca1640 1 --2- 172.21.15.77:0/368860255 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f050415a630 0x7f05041ee320 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.906+0000 7f050bca1640 1 --2- 172.21.15.77:0/368860255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04f0005190 0x7f05041f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:29.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.906+0000 7f050bca1640 1 -- 172.21.15.77:0/368860255 >> 172.21.15.77:0/368860255 conn(0x7f050406db00 msgr2=0x7f05040cbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:29.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.906+0000 7f050bca1640 1 -- 172.21.15.77:0/368860255 shutdown_connections 2024-09-13T15:01:29.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:29.906+0000 7f050bca1640 1 -- 172.21.15.77:0/368860255 wait complete. 2024-09-13T15:01:29.912 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:29.910+0000 7fbf3f106180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T15:01:29.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new ceb01c37-fe33-4ee2-b11f-07fadc39a96b 7 2024-09-13T15:01:29.975 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:29.974+0000 7fbf3f106180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T15:01:30.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.030+0000 7f2bb1a4c640 1 Processor -- start 2024-09-13T15:01:30.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.030+0000 7f2bb1a4c640 1 -- start start 2024-09-13T15:01:30.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2bb1a4c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac1510c0 0x7f2bac06ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:30.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2bb1a4c640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2bac157a90 0x7f2bac0c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:30.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2bb1a4c640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2bac0c86e0 0x7f2bac06d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:30.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2bb1a4c640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bac0c3750 con 0x7f2bac157a90 2024-09-13T15:01:30.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2bb1a4c640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bac0c7a20 con 0x7f2bac0c86e0 2024-09-13T15:01:30.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2bb1a4c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0c2480 con 0x7f2bac1510c0 2024-09-13T15:01:30.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2baaffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac1510c0 0x7f2bac06ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:30.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2bab7fe640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2bac0c86e0 0x7f2bac06d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:30.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2baaffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac1510c0 0x7f2bac06ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.77:57358/0 (socket says 172.21.15.77:57358) 2024-09-13T15:01:30.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2baaffd640 1 -- 172.21.15.77:0/693557445 learned_addr learned my addr 172.21.15.77:0/693557445 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-13T15:01:30.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2baa7fc640 1 --2- 172.21.15.77:0/693557445 >> v2:172.21.15.7:3300/0 conn(0x7f2bac157a90 0x7f2bac0c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:30.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2baaffd640 1 -- 172.21.15.77:0/693557445 >> v2:172.21.15.77:3300/0 conn(0x7f2bac0c86e0 msgr2=0x7f2bac06d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:30.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2baaffd640 1 --2- 172.21.15.77:0/693557445 >> v2:172.21.15.77:3300/0 conn(0x7f2bac0c86e0 0x7f2bac06d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2baaffd640 1 -- 172.21.15.77:0/693557445 >> v2:172.21.15.7:3300/0 conn(0x7f2bac157a90 msgr2=0x7f2bac0c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:30.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2baaffd640 1 --2- 172.21.15.77:0/693557445 >> v2:172.21.15.7:3300/0 conn(0x7f2bac157a90 0x7f2bac0c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2baaffd640 1 -- 172.21.15.77:0/693557445 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac0c2760 con 0x7f2bac1510c0 2024-09-13T15:01:30.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2baa7fc640 1 --2- 172.21.15.77:0/693557445 >> v2:172.21.15.7:3300/0 conn(0x7f2bac157a90 0x7f2bac0c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:01:30.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2bab7fe640 1 --2- 172.21.15.77:0/693557445 >> v2:172.21.15.77:3300/0 conn(0x7f2bac0c86e0 0x7f2bac06d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:01:30.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2baaffd640 1 --2- 172.21.15.77:0/693557445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac1510c0 0x7f2bac06ef10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0ca990 tx=0x7f2b9c01ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c39704bed12aec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:30.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2ba9ffb640 1 -- 172.21.15.77:0/693557445 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0a89d0 con 0x7f2bac1510c0 2024-09-13T15:01:30.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2ba9ffb640 1 -- 172.21.15.77:0/693557445 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c0a8b30 con 0x7f2bac1510c0 2024-09-13T15:01:30.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2ba9ffb640 1 -- 172.21.15.77:0/693557445 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0b0440 con 0x7f2bac1510c0 2024-09-13T15:01:30.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2bb1a4c640 1 -- 172.21.15.77:0/693557445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac1510c0 msgr2=0x7f2bac06ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:30.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2bb1a4c640 1 --2- 172.21.15.77:0/693557445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac1510c0 0x7f2bac06ef10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0ca990 tx=0x7f2b9c01ed10 comp rx=0 tx=0).stop 2024-09-13T15:01:30.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2bb1a4c640 1 -- 172.21.15.77:0/693557445 shutdown_connections 2024-09-13T15:01:30.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2bb1a4c640 1 --2- 172.21.15.77:0/693557445 >> v2:172.21.15.77:3300/0 conn(0x7f2bac0c86e0 0x7f2bac06d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2bb1a4c640 1 --2- 172.21.15.77:0/693557445 >> v2:172.21.15.7:3300/0 conn(0x7f2bac157a90 0x7f2bac0c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2bb1a4c640 1 --2- 172.21.15.77:0/693557445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac1510c0 0x7f2bac06ef10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.034+0000 7f2bb1a4c640 1 -- 172.21.15.77:0/693557445 >> 172.21.15.77:0/693557445 conn(0x7f2bac071730 msgr2=0x7f2bac071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:30.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2bb1a4c640 1 -- 172.21.15.77:0/693557445 shutdown_connections 2024-09-13T15:01:30.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2bb1a4c640 1 -- 172.21.15.77:0/693557445 wait complete. 2024-09-13T15:01:30.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2bb1a4c640 1 Processor -- start 2024-09-13T15:01:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2bb1a4c640 1 -- start start 2024-09-13T15:01:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2bb1a4c640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac0c86e0 0x7f2bac1f0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2bb1a4c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac1510c0 0x7f2bac14a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2bb1a4c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac157a90 0x7f2bac14adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2bb1a4c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac1dfe10 con 0x7f2bac1510c0 2024-09-13T15:01:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2bb1a4c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac1f09e0 con 0x7f2bac157a90 2024-09-13T15:01:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2bb1a4c640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac1f0cc0 con 0x7f2bac0c86e0 2024-09-13T15:01:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2baaffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac0c86e0 0x7f2bac1f0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2baaffd640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac0c86e0 0x7f2bac1f0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.77:57368/0 (socket says 172.21.15.77:57368) 2024-09-13T15:01:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2baaffd640 1 -- 172.21.15.77:0/383923679 learned_addr learned my addr 172.21.15.77:0/383923679 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-13T15:01:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2bab7fe640 1 --2- 172.21.15.77:0/383923679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac157a90 0x7f2bac14adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:30.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2baa7fc640 1 --2- 172.21.15.77:0/383923679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac1510c0 0x7f2bac14a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2baaffd640 1 -- 172.21.15.77:0/383923679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac157a90 msgr2=0x7f2bac14adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2baaffd640 1 --2- 172.21.15.77:0/383923679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac157a90 0x7f2bac14adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2baaffd640 1 -- 172.21.15.77:0/383923679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac1510c0 msgr2=0x7f2bac14a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2baaffd640 1 --2- 172.21.15.77:0/383923679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac1510c0 0x7f2bac14a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2baaffd640 1 -- 172.21.15.77:0/383923679 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4009a70 con 0x7f2bac0c86e0 2024-09-13T15:01:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2baaffd640 1 --2- 172.21.15.77:0/383923679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac0c86e0 0x7f2bac1f0110 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c01d3c0 tx=0x7f2b9c01bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2b93fff640 1 -- 172.21.15.77:0/383923679 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0ba600 con 0x7f2bac0c86e0 2024-09-13T15:01:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2b93fff640 1 -- 172.21.15.77:0/383923679 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c0ba780 con 0x7f2bac0c86e0 2024-09-13T15:01:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2bb1a4c640 1 -- 172.21.15.77:0/383923679 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9c0094d0 con 0x7f2bac0c86e0 2024-09-13T15:01:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2b93fff640 1 -- 172.21.15.77:0/383923679 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c0bab30 con 0x7f2bac0c86e0 2024-09-13T15:01:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2bb1a4c640 1 -- 172.21.15.77:0/383923679 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac0c6dc0 con 0x7f2bac0c86e0 2024-09-13T15:01:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2b93fff640 1 -- 172.21.15.77:0/383923679 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f2b9c0c4460 con 0x7f2bac0c86e0 2024-09-13T15:01:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2b93fff640 1 -- 172.21.15.77:0/383923679 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f2b9c0c3a20 con 0x7f2bac0c86e0 2024-09-13T15:01:30.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.038+0000 7f2bb1a4c640 1 -- 172.21.15.77:0/383923679 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bac1514a0 con 0x7f2bac0c86e0 2024-09-13T15:01:30.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.042+0000 7f2b93fff640 1 -- 172.21.15.77:0/383923679 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f2b9c0b5070 con 0x7f2bac0c86e0 2024-09-13T15:01:30.066 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:30.061+0000 7f2ea46d1180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T15:01:30.112 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.110+0000 7f2bb1a4c640 1 -- 172.21.15.77:0/383923679 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ceb01c37-fe33-4ee2-b11f-07fadc39a96b", "id": 7} v 0) v1 -- 0x7f2bac0c98a0 con 0x7f2bac0c86e0 2024-09-13T15:01:30.117 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.114+0000 7f2b93fff640 1 -- 172.21.15.77:0/383923679 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ceb01c37-fe33-4ee2-b11f-07fadc39a96b", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2b9c0c3d50 con 0x7f2bac0c86e0 2024-09-13T15:01:30.117 INFO:teuthology.orchestra.run.smithi077.stdout:7 2024-09-13T15:01:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.114+0000 7f2bb1a4c640 1 -- 172.21.15.77:0/383923679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac0c86e0 msgr2=0x7f2bac1f0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.114+0000 7f2bb1a4c640 1 --2- 172.21.15.77:0/383923679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac0c86e0 0x7f2bac1f0110 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c01d3c0 tx=0x7f2b9c01bab0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.114+0000 7f2bb1a4c640 1 -- 172.21.15.77:0/383923679 shutdown_connections 2024-09-13T15:01:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.114+0000 7f2bb1a4c640 1 --2- 172.21.15.77:0/383923679 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac157a90 0x7f2bac14adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.114+0000 7f2bb1a4c640 1 --2- 172.21.15.77:0/383923679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac1510c0 0x7f2bac14a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.114+0000 7f2bb1a4c640 1 --2- 172.21.15.77:0/383923679 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac0c86e0 0x7f2bac1f0110 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.114+0000 7f2bb1a4c640 1 -- 172.21.15.77:0/383923679 >> 172.21.15.77:0/383923679 conn(0x7f2bac071730 msgr2=0x7f2bac06d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:30.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.114+0000 7f2bb1a4c640 1 -- 172.21.15.77:0/383923679 shutdown_connections 2024-09-13T15:01:30.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-13T15:01:30.114+0000 7f2bb1a4c640 1 -- 172.21.15.77:0/383923679 wait complete. 2024-09-13T15:01:30.132 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T15:01:30.132 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T15:01:30.135 INFO:tasks.ceph.osd.0:Started 2024-09-13T15:01:30.136 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T15:01:30.136 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T15:01:30.139 INFO:tasks.ceph.osd.1:Started 2024-09-13T15:01:30.139 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T15:01:30.139 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T15:01:30.140 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:30.133+0000 7f2ea46d1180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T15:01:30.142 INFO:tasks.ceph.osd.2:Started 2024-09-13T15:01:30.142 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T15:01:30.142 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T15:01:30.146 INFO:tasks.ceph.osd.3:Started 2024-09-13T15:01:30.146 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T15:01:30.147 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T15:01:30.149 INFO:tasks.ceph.osd.4:Started 2024-09-13T15:01:30.149 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T15:01:30.149 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T15:01:30.151 INFO:tasks.ceph.osd.5:Started 2024-09-13T15:01:30.151 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T15:01:30.152 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T15:01:30.154 INFO:tasks.ceph.osd.6:Started 2024-09-13T15:01:30.154 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T15:01:30.154 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T15:01:30.156 INFO:tasks.ceph.osd.7:Started 2024-09-13T15:01:30.157 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:01:30.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.325+0000 7f47ed000640 1 Processor -- start 2024-09-13T15:01:30.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.325+0000 7f47ed000640 1 -- start start 2024-09-13T15:01:30.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.329+0000 7f47ed000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47e81513c0 0x7f47e8156e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:30.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.329+0000 7f47ed000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f47e80c8780 0x7f47e8157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:30.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.329+0000 7f47ed000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e80c20e0 con 0x7f47e8150fe0 2024-09-13T15:01:30.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.329+0000 7f47ed000640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e815af50 con 0x7f47e80c8780 2024-09-13T15:01:30.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.329+0000 7f47ed000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e815b230 con 0x7f47e81513c0 2024-09-13T15:01:30.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.329+0000 7f47e5400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47e81513c0 0x7f47e8156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:30.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.329+0000 7f47e5400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47e81513c0 0x7f47e8156e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:33968/0 (socket says 172.21.15.7:33968) 2024-09-13T15:01:30.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.329+0000 7f47e5400640 1 -- 172.21.15.7:0/830900930 learned_addr learned my addr 172.21.15.7:0/830900930 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:30.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.329+0000 7f47e6800640 1 --2- 172.21.15.7:0/830900930 >> v2:172.21.15.77:3300/0 conn(0x7f47e80c8780 0x7f47e8157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:30.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.329+0000 7f47e5400640 1 -- 172.21.15.7:0/830900930 >> v2:172.21.15.77:3300/0 conn(0x7f47e80c8780 msgr2=0x7f47e8157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:30.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.329+0000 7f47e5400640 1 --2- 172.21.15.7:0/830900930 >> v2:172.21.15.77:3300/0 conn(0x7f47e80c8780 0x7f47e8157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.329+0000 7f47e5400640 1 -- 172.21.15.7:0/830900930 >> v1:172.21.15.77:6789/0 conn(0x7f47e8150fe0 legacy=0x7f47e80c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:30.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.329+0000 7f47e5400640 1 -- 172.21.15.7:0/830900930 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e80c3b70 con 0x7f47e81513c0 2024-09-13T15:01:30.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.333+0000 7f47e5400640 1 --2- 172.21.15.7:0/830900930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47e81513c0 0x7f47e8156e30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009870 tx=0x7f47d401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d0c90219393c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:30.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.333+0000 7f47e4a00640 1 -- 172.21.15.7:0/830900930 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4004230 con 0x7f47e81513c0 2024-09-13T15:01:30.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.333+0000 7f47e4a00640 1 -- 172.21.15.7:0/830900930 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d40a7050 con 0x7f47e81513c0 2024-09-13T15:01:30.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.333+0000 7f47e4a00640 1 -- 172.21.15.7:0/830900930 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4003620 con 0x7f47e81513c0 2024-09-13T15:01:30.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.333+0000 7f47ed000640 1 -- 172.21.15.7:0/830900930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47e81513c0 msgr2=0x7f47e8156e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:30.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.333+0000 7f47ed000640 1 --2- 172.21.15.7:0/830900930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47e81513c0 0x7f47e8156e30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009870 tx=0x7f47d401c4d0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.333+0000 7f47ed000640 1 -- 172.21.15.7:0/830900930 shutdown_connections 2024-09-13T15:01:30.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.333+0000 7f47ed000640 1 --2- 172.21.15.7:0/830900930 >> v2:172.21.15.77:3300/0 conn(0x7f47e80c8780 0x7f47e8157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.333+0000 7f47ed000640 1 --2- 172.21.15.7:0/830900930 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47e81513c0 0x7f47e8156e30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.333+0000 7f47ed000640 1 -- 172.21.15.7:0/830900930 >> 172.21.15.7:0/830900930 conn(0x7f47e8071730 msgr2=0x7f47e8071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:30.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.333+0000 7f47ed000640 1 -- 172.21.15.7:0/830900930 shutdown_connections 2024-09-13T15:01:30.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.333+0000 7f47ed000640 1 -- 172.21.15.7:0/830900930 wait complete. 2024-09-13T15:01:30.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.333+0000 7f47ed000640 1 Processor -- start 2024-09-13T15:01:30.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.333+0000 7f47ed000640 1 -- start start 2024-09-13T15:01:30.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47ed000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47e80c8780 0x7f47e80c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:30.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47ed000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47e8150fe0 0x7f47e8148890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:30.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47ed000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47e81513c0 0x7f47e81f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:30.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47ed000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e81f5690 con 0x7f47e80c8780 2024-09-13T15:01:30.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47ed000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e8069f30 con 0x7f47e81513c0 2024-09-13T15:01:30.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47ed000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e81f5900 con 0x7f47e8150fe0 2024-09-13T15:01:30.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47e5400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47e8150fe0 0x7f47e8148890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:30.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47e5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47e80c8780 0x7f47e80c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:30.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47e5400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47e8150fe0 0x7f47e8148890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:33976/0 (socket says 172.21.15.7:33976) 2024-09-13T15:01:30.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47e5400640 1 -- 172.21.15.7:0/2414533669 learned_addr learned my addr 172.21.15.7:0/2414533669 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:30.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47e6800640 1 --2- 172.21.15.7:0/2414533669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47e81513c0 0x7f47e81f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:30.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47e5e00640 1 -- 172.21.15.7:0/2414533669 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47e8150fe0 msgr2=0x7f47e8148890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:30.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47e5e00640 1 --2- 172.21.15.7:0/2414533669 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47e8150fe0 0x7f47e8148890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47e5e00640 1 -- 172.21.15.7:0/2414533669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47e81513c0 msgr2=0x7f47e81f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:30.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47e5e00640 1 --2- 172.21.15.7:0/2414533669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47e81513c0 0x7f47e81f5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47e5e00640 1 -- 172.21.15.7:0/2414533669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d40094d0 con 0x7f47e80c8780 2024-09-13T15:01:30.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47e5e00640 1 --2- 172.21.15.7:0/2414533669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47e80c8780 0x7f47e80c9e40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f47d8000f70 tx=0x7f47d800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:30.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47de000640 1 -- 172.21.15.7:0/2414533669 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d80052d0 con 0x7f47e80c8780 2024-09-13T15:01:30.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47de000640 1 -- 172.21.15.7:0/2414533669 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d8005430 con 0x7f47e80c8780 2024-09-13T15:01:30.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47ed000640 1 -- 172.21.15.7:0/2414533669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e80cc650 con 0x7f47e80c8780 2024-09-13T15:01:30.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47de000640 1 -- 172.21.15.7:0/2414533669 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8003840 con 0x7f47e80c8780 2024-09-13T15:01:30.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47ed000640 1 -- 172.21.15.7:0/2414533669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e80cc8f0 con 0x7f47e80c8780 2024-09-13T15:01:30.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47de000640 1 -- 172.21.15.7:0/2414533669 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f47d8003ca0 con 0x7f47e80c8780 2024-09-13T15:01:30.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47de000640 1 -- 172.21.15.7:0/2414533669 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f47d8012420 con 0x7f47e80c8780 2024-09-13T15:01:30.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.337+0000 7f47ed000640 1 -- 172.21.15.7:0/2414533669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e8067650 con 0x7f47e80c8780 2024-09-13T15:01:30.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.341+0000 7f47de000640 1 -- 172.21.15.7:0/2414533669 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f47d8017070 con 0x7f47e80c8780 2024-09-13T15:01:30.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.405+0000 7f47ed000640 1 -- 172.21.15.7:0/2414533669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47e80ccae0 con 0x7f47e80c8780 2024-09-13T15:01:30.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.405+0000 7f47de000640 1 -- 172.21.15.7:0/2414533669 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f47d8011590 con 0x7f47e80c8780 2024-09-13T15:01:30.410 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:01:30.410 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":10,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:01:30.114559+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:01:30.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.405+0000 7f47ed000640 1 -- 172.21.15.7:0/2414533669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47e80c8780 msgr2=0x7f47e80c9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:30.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.405+0000 7f47ed000640 1 --2- 172.21.15.7:0/2414533669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47e80c8780 0x7f47e80c9e40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f47d8000f70 tx=0x7f47d800c890 comp rx=0 tx=0).stop 2024-09-13T15:01:30.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.405+0000 7f47ed000640 1 -- 172.21.15.7:0/2414533669 shutdown_connections 2024-09-13T15:01:30.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.405+0000 7f47ed000640 1 --2- 172.21.15.7:0/2414533669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47e81513c0 0x7f47e81f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.405+0000 7f47ed000640 1 --2- 172.21.15.7:0/2414533669 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f47e8150fe0 0x7f47e8148890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.405+0000 7f47ed000640 1 --2- 172.21.15.7:0/2414533669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f47e80c8780 0x7f47e80c9e40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:30.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.405+0000 7f47ed000640 1 -- 172.21.15.7:0/2414533669 >> 172.21.15.7:0/2414533669 conn(0x7f47e8071730 msgr2=0x7f47e8160060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:30.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.405+0000 7f47ed000640 1 -- 172.21.15.7:0/2414533669 shutdown_connections 2024-09-13T15:01:30.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:30.405+0000 7f47ed000640 1 -- 172.21.15.7:0/2414533669 wait complete. 2024-09-13T15:01:30.429 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T15:01:30.429 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T15:01:30.577 INFO:tasks.ceph.mgr.x.smithi077.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T15:01:30.577 INFO:tasks.ceph.mgr.x.smithi077.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T15:01:30.577 INFO:tasks.ceph.mgr.x.smithi077.stderr: from numpy import show_config as show_numpy_config 2024-09-13T15:01:30.606 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:30.606+0000 7fbf3f106180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T15:01:30.740 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:30.738+0000 7fbf3f106180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:01:30.747 INFO:tasks.ceph.osd.4.smithi077.stderr:2024-09-13T15:01:30.746+0000 7f43c69837c0 -1 Falling back to public interface 2024-09-13T15:01:30.748 INFO:tasks.ceph.osd.6.smithi077.stderr:2024-09-13T15:01:30.746+0000 7fb7caefe7c0 -1 Falling back to public interface 2024-09-13T15:01:30.767 INFO:tasks.ceph.osd.5.smithi077.stderr:2024-09-13T15:01:30.766+0000 7fb24d25f7c0 -1 Falling back to public interface 2024-09-13T15:01:30.771 INFO:tasks.ceph.osd.7.smithi077.stderr:2024-09-13T15:01:30.770+0000 7f326cc2c7c0 -1 Falling back to public interface 2024-09-13T15:01:30.793 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-13T15:01:30.793+0000 7f3e733577c0 -1 Falling back to public interface 2024-09-13T15:01:30.801 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-13T15:01:30.801+0000 7f30785ad7c0 -1 Falling back to public interface 2024-09-13T15:01:30.810 INFO:tasks.ceph.mgr.y.smithi007.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-13T15:01:30.810 INFO:tasks.ceph.mgr.y.smithi007.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-13T15:01:30.810 INFO:tasks.ceph.mgr.y.smithi007.stderr: from numpy import show_config as show_numpy_config 2024-09-13T15:01:30.813 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-13T15:01:30.813+0000 7f10643a27c0 -1 Falling back to public interface 2024-09-13T15:01:30.845 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-13T15:01:30.845+0000 7f1461f9f7c0 -1 Falling back to public interface 2024-09-13T15:01:30.860 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:30.861+0000 7f2ea46d1180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T15:01:30.892 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:30.890+0000 7fbf3f106180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T15:01:30.955 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:30.954+0000 7fbf3f106180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T15:01:31.017 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:31.017+0000 7f2ea46d1180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:01:31.089 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:31.086+0000 7fbf3f106180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:01:31.207 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:31.205+0000 7f2ea46d1180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T15:01:31.234 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T15:01:31.295 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:31.293+0000 7f2ea46d1180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T15:01:31.364 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.361+0000 7f5bd5a00640 1 Processor -- start 2024-09-13T15:01:31.364 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bd5a00640 1 -- start start 2024-09-13T15:01:31.367 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bd5a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5bd006c660 0x7f5bd0156db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:31.367 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bd5a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd00c5b40 0x7f5bd0150c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:31.367 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bd5a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bd00c5fd0 con 0x7f5bd0070310 2024-09-13T15:01:31.367 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bd5a00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bd006b300 con 0x7f5bd006c660 2024-09-13T15:01:31.367 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bd5a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd006b5c0 con 0x7f5bd00c5b40 2024-09-13T15:01:31.367 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcfe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5bd0070310 0x7f5bd00706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41708/0 (socket says 172.21.15.7:41708) 2024-09-13T15:01:31.367 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcfe00640 1 -- 172.21.15.7:0/2425654452 learned_addr learned my addr 172.21.15.7:0/2425654452 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:01:31.368 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bd5000640 1 --2- 172.21.15.7:0/2425654452 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd00c5b40 0x7f5bd0150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:31.368 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bc7e00640 1 --2- 172.21.15.7:0/2425654452 >> v2:172.21.15.77:3300/0 conn(0x7f5bd006c660 0x7f5bd0156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:31.368 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcf400640 1 -- 172.21.15.7:0/2425654452 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131585019 0 0) 0x7f5bd00c5fd0 con 0x7f5bd0070310 2024-09-13T15:01:31.368 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcf400640 1 -- 172.21.15.7:0/2425654452 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bb4003530 con 0x7f5bd0070310 2024-09-13T15:01:31.368 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcf400640 1 -- 172.21.15.7:0/2425654452 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3644287508 0 0) 0x7f5bb4003530 con 0x7f5bd0070310 2024-09-13T15:01:31.368 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcf400640 1 -- 172.21.15.7:0/2425654452 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd00c5b40 msgr2=0x7f5bd0150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:31.368 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcf400640 1 --2- 172.21.15.7:0/2425654452 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd00c5b40 0x7f5bd0150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:31.368 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcf400640 1 -- 172.21.15.7:0/2425654452 >> v2:172.21.15.77:3300/0 conn(0x7f5bd006c660 msgr2=0x7f5bd0156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:31.368 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcf400640 1 --2- 172.21.15.7:0/2425654452 >> v2:172.21.15.77:3300/0 conn(0x7f5bd006c660 0x7f5bd0156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:31.368 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcf400640 1 -- 172.21.15.7:0/2425654452 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd006b8a0 con 0x7f5bd0070310 2024-09-13T15:01:31.368 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcf400640 1 -- 172.21.15.7:0/2425654452 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f5bc0001680 con 0x7f5bd0070310 2024-09-13T15:01:31.368 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bc7e00640 1 --2- 172.21.15.7:0/2425654452 >> v2:172.21.15.77:3300/0 conn(0x7f5bd006c660 0x7f5bd0156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:01:31.369 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcf400640 1 -- 172.21.15.7:0/2425654452 >> v1:172.21.15.7:6789/0 conn(0x7f5bd0070310 legacy=0x7f5bd00706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:31.369 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcf400640 1 --2- 172.21.15.7:0/2425654452 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd00c5b40 0x7f5bb4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:31.369 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcf400640 1 --2- 172.21.15.7:0/2425654452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb4003f00 0x7f5bb40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:31.369 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcf400640 1 --2- 172.21.15.7:0/2425654452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb4004d10 0x7f5bb4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:31.369 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcf400640 1 -- 172.21.15.7:0/2425654452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd006b300 con 0x7f5bb4003f00 2024-09-13T15:01:31.369 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcf400640 1 -- 172.21.15.7:0/2425654452 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd006b5c0 con 0x7f5bb4004d10 2024-09-13T15:01:31.369 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcf400640 1 -- 172.21.15.7:0/2425654452 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb400b9c0 con 0x7f5bd00c5b40 2024-09-13T15:01:31.369 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bc7e00640 1 --2- 172.21.15.7:0/2425654452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb4003f00 0x7f5bb40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:31.369 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bd5000640 1 --2- 172.21.15.7:0/2425654452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb4004d10 0x7f5bb4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:31.369 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bcfe00640 1 --2- 172.21.15.7:0/2425654452 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd00c5b40 0x7f5bb4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:31.369 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bc7e00640 1 -- 172.21.15.7:0/2425654452 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd00c5b40 msgr2=0x7f5bb4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:31.372 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bc7e00640 1 --2- 172.21.15.7:0/2425654452 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd00c5b40 0x7f5bb4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:31.372 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bc7e00640 1 -- 172.21.15.7:0/2425654452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb4004d10 msgr2=0x7f5bb4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:31.372 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bc7e00640 1 --2- 172.21.15.7:0/2425654452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb4004d10 0x7f5bb4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:31.373 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.365+0000 7f5bc7e00640 1 -- 172.21.15.7:0/2425654452 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb4003530 con 0x7f5bb4003f00 2024-09-13T15:01:31.374 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.369+0000 7f5bc7e00640 1 --2- 172.21.15.7:0/2425654452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb4003f00 0x7f5bb40047d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8009cb0 tx=0x7f5bb801cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c79f4cca3870fb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:31.374 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.369+0000 7f5bcf400640 1 -- 172.21.15.7:0/2425654452 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb80a5950 con 0x7f5bb4003f00 2024-09-13T15:01:31.374 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.369+0000 7f5bcf400640 1 -- 172.21.15.7:0/2425654452 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb80a5ab0 con 0x7f5bb4003f00 2024-09-13T15:01:31.374 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.369+0000 7f5bcf400640 1 -- 172.21.15.7:0/2425654452 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb80a5ea0 con 0x7f5bb4003f00 2024-09-13T15:01:31.374 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.369+0000 7f5bd5a00640 1 -- 172.21.15.7:0/2425654452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb4003f00 msgr2=0x7f5bb40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:31.374 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.369+0000 7f5bd5a00640 1 --2- 172.21.15.7:0/2425654452 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bb4003f00 0x7f5bb40047d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8009cb0 tx=0x7f5bb801cc90 comp rx=0 tx=0).stop 2024-09-13T15:01:31.374 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.369+0000 7f5bd5000640 1 -- 172.21.15.7:0/2425654452 reap_dead start 2024-09-13T15:01:31.375 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.369+0000 7f5bd5a00640 1 -- 172.21.15.7:0/2425654452 shutdown_connections 2024-09-13T15:01:31.375 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.369+0000 7f5bd5a00640 1 -- 172.21.15.7:0/2425654452 >> 172.21.15.7:0/2425654452 conn(0x7f5bd00c7970 msgr2=0x7f5bd00c7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:31.375 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.369+0000 7f5bd5a00640 1 -- 172.21.15.7:0/2425654452 shutdown_connections 2024-09-13T15:01:31.375 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.369+0000 7f5bd5a00640 1 -- 172.21.15.7:0/2425654452 wait complete. 2024-09-13T15:01:31.375 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.373+0000 7f5bd5a00640 1 Processor -- start 2024-09-13T15:01:31.375 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.373+0000 7f5bd5a00640 1 -- start start 2024-09-13T15:01:31.377 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.373+0000 7f5bd5a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb4003f00 0x7f5bd01e2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:31.377 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.373+0000 7f5bd5a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bd00c4f60 0x7f5bd014e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:31.377 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.373+0000 7f5bd5a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd006dac0 0x7f5bd014ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:31.377 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.373+0000 7f5bd5a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd01e2890 con 0x7f5bd00c4f60 2024-09-13T15:01:31.378 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.373+0000 7f5bd5a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd01f2200 con 0x7f5bb4003f00 2024-09-13T15:01:31.378 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.373+0000 7f5bd5a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd00c2230 con 0x7f5bd006dac0 2024-09-13T15:01:31.378 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.373+0000 7f5bc7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bd00c4f60 0x7f5bd014e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:31.378 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.373+0000 7f5bc7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bd00c4f60 0x7f5bd014e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55490/0 (socket says 172.21.15.7:55490) 2024-09-13T15:01:31.378 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.373+0000 7f5bc7e00640 1 -- 172.21.15.7:0/2632956940 learned_addr learned my addr 172.21.15.7:0/2632956940 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:31.378 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.373+0000 7f5bcfe00640 1 --2- 172.21.15.7:0/2632956940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb4003f00 0x7f5bd01e2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:31.378 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.377+0000 7f5bd5000640 1 --2- 172.21.15.7:0/2632956940 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd006dac0 0x7f5bd014ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:31.378 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.377+0000 7f5bc7e00640 1 -- 172.21.15.7:0/2632956940 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd006dac0 msgr2=0x7f5bd014ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:31.378 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.377+0000 7f5bc7e00640 1 --2- 172.21.15.7:0/2632956940 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd006dac0 0x7f5bd014ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:31.378 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.377+0000 7f5bc7e00640 1 -- 172.21.15.7:0/2632956940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb4003f00 msgr2=0x7f5bd01e2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:31.378 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.377+0000 7f5bc7e00640 1 --2- 172.21.15.7:0/2632956940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb4003f00 0x7f5bd01e2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:31.378 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.377+0000 7f5bc7e00640 1 -- 172.21.15.7:0/2632956940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd00c2510 con 0x7f5bd00c4f60 2024-09-13T15:01:31.379 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.377+0000 7f5bc7e00640 1 --2- 172.21.15.7:0/2632956940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bd00c4f60 0x7f5bd014e6e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80b0040 tx=0x7f5bb4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:31.379 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.377+0000 7f5bccc00640 1 -- 172.21.15.7:0/2632956940 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb80be070 con 0x7f5bd00c4f60 2024-09-13T15:01:31.379 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.377+0000 7f5bccc00640 1 -- 172.21.15.7:0/2632956940 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb8006e40 con 0x7f5bd00c4f60 2024-09-13T15:01:31.379 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.377+0000 7f5bccc00640 1 -- 172.21.15.7:0/2632956940 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb80a5950 con 0x7f5bd00c4f60 2024-09-13T15:01:31.379 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.377+0000 7f5bd5a00640 1 -- 172.21.15.7:0/2632956940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd00c27f0 con 0x7f5bd00c4f60 2024-09-13T15:01:31.379 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.377+0000 7f5bd5a00640 1 -- 172.21.15.7:0/2632956940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd00c2db0 con 0x7f5bd00c4f60 2024-09-13T15:01:31.379 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.377+0000 7f5bccc00640 1 -- 172.21.15.7:0/2632956940 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f5bb80b4040 con 0x7f5bd00c4f60 2024-09-13T15:01:31.379 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.377+0000 7f5bccc00640 1 -- 172.21.15.7:0/2632956940 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5bb8003cf0 con 0x7f5bd00c4f60 2024-09-13T15:01:31.379 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.377+0000 7f5bd5a00640 1 -- 172.21.15.7:0/2632956940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd00c88d0 con 0x7f5bd00c4f60 2024-09-13T15:01:31.380 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.381+0000 7f5bccc00640 1 -- 172.21.15.7:0/2632956940 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f5bb80b2070 con 0x7f5bd00c4f60 2024-09-13T15:01:31.454 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.453+0000 7f5bd5a00640 1 -- 172.21.15.7:0/2632956940 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bd00c2f40 con 0x7f5bd00c4f60 2024-09-13T15:01:31.454 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.453+0000 7f5bccc00640 1 -- 172.21.15.7:0/2632956940 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5bb8009880 con 0x7f5bd00c4f60 2024-09-13T15:01:31.455 INFO:teuthology.misc.health.smithi007.stdout: 2024-09-13T15:01:31.455 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":10,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:01:30.114559+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:01:31.456 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.453+0000 7f5bd5a00640 1 -- 172.21.15.7:0/2632956940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bd00c4f60 msgr2=0x7f5bd014e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:31.456 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.453+0000 7f5bd5a00640 1 --2- 172.21.15.7:0/2632956940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bd00c4f60 0x7f5bd014e6e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80b0040 tx=0x7f5bb4005800 comp rx=0 tx=0).stop 2024-09-13T15:01:31.456 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.453+0000 7f5bd5a00640 1 -- 172.21.15.7:0/2632956940 shutdown_connections 2024-09-13T15:01:31.456 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.453+0000 7f5bd5a00640 1 --2- 172.21.15.7:0/2632956940 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd006dac0 0x7f5bd014ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:31.456 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.453+0000 7f5bd5a00640 1 --2- 172.21.15.7:0/2632956940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bd00c4f60 0x7f5bd014e6e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:31.456 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.457+0000 7f5bd5a00640 1 --2- 172.21.15.7:0/2632956940 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb4003f00 0x7f5bd01e2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:31.456 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.457+0000 7f5bd5a00640 1 -- 172.21.15.7:0/2632956940 >> 172.21.15.7:0/2632956940 conn(0x7f5bd00c7970 msgr2=0x7f5bd014fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:31.456 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.457+0000 7f5bd5a00640 1 -- 172.21.15.7:0/2632956940 shutdown_connections 2024-09-13T15:01:31.456 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:31.457+0000 7f5bd5a00640 1 -- 172.21.15.7:0/2632956940 wait complete. 2024-09-13T15:01:31.473 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T15:01:31.473 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:31.473+0000 7f2ea46d1180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T15:01:31.917 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:31.914+0000 7fbf3f106180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T15:01:31.992 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:31.990+0000 7fbf3f106180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T15:01:32.170 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:32.166+0000 7fbf3f106180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T15:01:32.209 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:32.209+0000 7f2ea46d1180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T15:01:32.243 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:32.242+0000 7fbf3f106180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T15:01:32.301 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:32.301+0000 7f2ea46d1180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T15:01:32.516 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:32.513+0000 7f2ea46d1180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T15:01:32.532 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:32.530+0000 7fbf3f106180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T15:01:32.594 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:32.590+0000 7fbf3f106180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T15:01:32.602 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:32.601+0000 7f2ea46d1180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T15:01:32.955 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:32.953+0000 7f2ea46d1180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T15:01:33.030 INFO:tasks.ceph.mgr.y.smithi007.stderr:2024-09-13T15:01:33.029+0000 7f2ea46d1180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T15:01:33.628 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:33.626+0000 7fbee66ba640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T15:01:33.630 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-13T15:01:33.626+0000 7fbee66ba640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T15:01:34.394 INFO:tasks.ceph.osd.7.smithi077.stderr:2024-09-13T15:01:34.390+0000 7f326cc2c7c0 -1 osd.7 0 log_to_monitors true 2024-09-13T15:01:34.394 INFO:tasks.ceph.osd.4.smithi077.stderr:2024-09-13T15:01:34.390+0000 7f43c69837c0 -1 osd.4 0 log_to_monitors true 2024-09-13T15:01:34.569 INFO:tasks.ceph.osd.5.smithi077.stderr:2024-09-13T15:01:34.566+0000 7fb24d25f7c0 -1 osd.5 0 log_to_monitors true 2024-09-13T15:01:34.654 INFO:tasks.ceph.osd.6.smithi077.stderr:2024-09-13T15:01:34.650+0000 7fb7caefe7c0 -1 osd.6 0 log_to_monitors true 2024-09-13T15:01:34.761 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-13T15:01:34.761+0000 7f3e733577c0 -1 osd.0 0 log_to_monitors true 2024-09-13T15:01:34.768 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-13T15:01:34.769+0000 7f10643a27c0 -1 osd.2 0 log_to_monitors true 2024-09-13T15:01:34.825 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-13T15:01:34.825+0000 7f30785ad7c0 -1 osd.1 0 log_to_monitors true 2024-09-13T15:01:34.913 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-13T15:01:34.913+0000 7f1461f9f7c0 -1 osd.3 0 log_to_monitors true 2024-09-13T15:01:37.247 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-13T15:01:37.245+0000 7f3073400640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T15:01:37.286 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-13T15:01:37.285+0000 7f3069400640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:01:37.315 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-13T15:01:37.313+0000 7f3e6ec00640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T15:01:37.349 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-13T15:01:37.349+0000 7f105f200640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T15:01:37.350 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-13T15:01:37.349+0000 7f3e64200640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:01:37.401 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-13T15:01:37.401+0000 7f1055200640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:01:37.933 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-13T15:01:37.933+0000 7f145ce00640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T15:01:37.961 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-13T15:01:37.961+0000 7f1452e00640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:01:38.066 INFO:tasks.ceph.osd.7.smithi077.stderr:2024-09-13T15:01:38.061+0000 7f3268bd1640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T15:01:38.074 INFO:tasks.ceph.osd.6.smithi077.stderr:2024-09-13T15:01:38.069+0000 7fb7c6ea3640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T15:01:38.096 INFO:tasks.ceph.osd.7.smithi077.stderr:2024-09-13T15:01:38.093+0000 7f3260a04640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:01:38.098 INFO:tasks.ceph.osd.5.smithi077.stderr:2024-09-13T15:01:38.093+0000 7fb249204640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T15:01:38.108 INFO:tasks.ceph.osd.6.smithi077.stderr:2024-09-13T15:01:38.105+0000 7fb7becd6640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:01:38.119 INFO:tasks.ceph.osd.5.smithi077.stderr:2024-09-13T15:01:38.117+0000 7fb241037640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:01:38.151 INFO:tasks.ceph.osd.4.smithi077.stderr:2024-09-13T15:01:38.149+0000 7f43c2928640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T15:01:38.180 INFO:tasks.ceph.osd.4.smithi077.stderr:2024-09-13T15:01:38.177+0000 7f43ba75b640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T15:01:38.279 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T15:01:38.410 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.409+0000 7f9ed2000640 1 Processor -- start 2024-09-13T15:01:38.410 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.409+0000 7f9ed2000640 1 -- start start 2024-09-13T15:01:38.411 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.409+0000 7f9ed2000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9ecc06f860 0x7f9ecc0c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:38.411 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.409+0000 7f9ed2000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ecc0c04b0 con 0x7f9ecc06fc40 2024-09-13T15:01:38.411 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.409+0000 7f9ed2000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ecc156000 con 0x7f9ecc0c1020 2024-09-13T15:01:38.412 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.409+0000 7f9ed2000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ecc0c01d0 con 0x7f9ecc06f860 2024-09-13T15:01:38.412 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.409+0000 7f9ecb400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9ecc06f860 0x7f9ecc0c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:38.412 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.409+0000 7f9ecb400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9ecc06f860 0x7f9ecc0c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44758/0 (socket says 172.21.15.7:44758) 2024-09-13T15:01:38.412 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.409+0000 7f9ec2a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9ecc06fc40 0x7f9ecc14fd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44130/0 (socket says 172.21.15.7:44130) 2024-09-13T15:01:38.412 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.409+0000 7f9ecb400640 1 -- 172.21.15.7:0/2695824514 learned_addr learned my addr 172.21.15.7:0/2695824514 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:38.413 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.409+0000 7f9ecb400640 1 -- 172.21.15.7:0/2695824514 >> v1:172.21.15.77:6789/0 conn(0x7f9ecc0c1020 legacy=0x7f9ecc1608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:38.413 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.409+0000 7f9ecb400640 1 -- 172.21.15.7:0/2695824514 >> v1:172.21.15.7:6789/0 conn(0x7f9ecc06fc40 legacy=0x7f9ecc14fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:38.413 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.409+0000 7f9ecaa00640 1 -- 172.21.15.7:0/2695824514 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146489682 0 0) 0x7f9eb4001120 con 0x7f9ecc06fc40 2024-09-13T15:01:38.413 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.409+0000 7f9ecb400640 1 -- 172.21.15.7:0/2695824514 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0b0bd0 con 0x7f9ecc06f860 2024-09-13T15:01:38.415 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.413+0000 7f9ecb400640 1 --2- 172.21.15.7:0/2695824514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc06f860 0x7f9ecc0c6eb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009870 tx=0x7f9ebc01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843265af009c44bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:38.415 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.413+0000 7f9ecaa00640 1 -- 172.21.15.7:0/2695824514 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0a8a50 con 0x7f9ecc06f860 2024-09-13T15:01:38.415 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.413+0000 7f9ecaa00640 1 -- 172.21.15.7:0/2695824514 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc0a8bb0 con 0x7f9ecc06f860 2024-09-13T15:01:38.415 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.413+0000 7f9ecaa00640 1 -- 172.21.15.7:0/2695824514 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0b0440 con 0x7f9ecc06f860 2024-09-13T15:01:38.416 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.413+0000 7f9ed2000640 1 -- 172.21.15.7:0/2695824514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc06f860 msgr2=0x7f9ecc0c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:38.416 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.413+0000 7f9ed2000640 1 --2- 172.21.15.7:0/2695824514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc06f860 0x7f9ecc0c6eb0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009870 tx=0x7f9ebc01ed50 comp rx=0 tx=0).stop 2024-09-13T15:01:38.416 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.413+0000 7f9ed2000640 1 -- 172.21.15.7:0/2695824514 shutdown_connections 2024-09-13T15:01:38.416 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.413+0000 7f9ed2000640 1 --2- 172.21.15.7:0/2695824514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc06f860 0x7f9ecc0c6eb0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.416 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.413+0000 7f9ed2000640 1 -- 172.21.15.7:0/2695824514 >> 172.21.15.7:0/2695824514 conn(0x7f9ecc0c78e0 msgr2=0x7f9ecc0c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:38.416 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.413+0000 7f9ed2000640 1 -- 172.21.15.7:0/2695824514 shutdown_connections 2024-09-13T15:01:38.416 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.413+0000 7f9ed2000640 1 -- 172.21.15.7:0/2695824514 wait complete. 2024-09-13T15:01:38.417 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ed2000640 1 Processor -- start 2024-09-13T15:01:38.417 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ed2000640 1 -- start start 2024-09-13T15:01:38.419 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ed2000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ecc06f860 0x7f9ecc14d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:38.420 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ed2000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ecc06fc40 0x7f9ecc1f0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:38.420 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ed2000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc0c1020 0x7f9ecc140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:38.420 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ed2000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc155dc0 con 0x7f9ecc0c1020 2024-09-13T15:01:38.420 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ed2000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc155760 con 0x7f9ecc06fc40 2024-09-13T15:01:38.420 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ed2000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc1f0ef0 con 0x7f9ecc06f860 2024-09-13T15:01:38.420 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ecbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc0c1020 0x7f9ecc140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:38.420 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ecbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc0c1020 0x7f9ecc140bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44770/0 (socket says 172.21.15.7:44770) 2024-09-13T15:01:38.420 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ecbe00640 1 -- 172.21.15.7:0/2085267226 learned_addr learned my addr 172.21.15.7:0/2085267226 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:38.421 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ec2a00640 1 --2- 172.21.15.7:0/2085267226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ecc06fc40 0x7f9ecc1f0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:38.421 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ecb400640 1 --2- 172.21.15.7:0/2085267226 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ecc06f860 0x7f9ecc14d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:38.421 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ecbe00640 1 -- 172.21.15.7:0/2085267226 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ecc06f860 msgr2=0x7f9ecc14d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:38.421 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ecbe00640 1 --2- 172.21.15.7:0/2085267226 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ecc06f860 0x7f9ecc14d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.421 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ecbe00640 1 -- 172.21.15.7:0/2085267226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ecc06fc40 msgr2=0x7f9ecc1f0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:38.421 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ecbe00640 1 --2- 172.21.15.7:0/2085267226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ecc06fc40 0x7f9ecc1f0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.421 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ecbe00640 1 -- 172.21.15.7:0/2085267226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc0094d0 con 0x7f9ecc0c1020 2024-09-13T15:01:38.421 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ecbe00640 1 --2- 172.21.15.7:0/2085267226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc0c1020 0x7f9ecc140bc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400c730 tx=0x7f9ec400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:38.421 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ec3e00640 1 -- 172.21.15.7:0/2085267226 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4003b80 con 0x7f9ecc0c1020 2024-09-13T15:01:38.421 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ec3e00640 1 -- 172.21.15.7:0/2085267226 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec4003ce0 con 0x7f9ecc0c1020 2024-09-13T15:01:38.422 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ec3e00640 1 -- 172.21.15.7:0/2085267226 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec400aa30 con 0x7f9ecc0c1020 2024-09-13T15:01:38.422 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ed2000640 1 -- 172.21.15.7:0/2085267226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ecc153e20 con 0x7f9ecc0c1020 2024-09-13T15:01:38.422 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.417+0000 7f9ed2000640 1 -- 172.21.15.7:0/2085267226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ecc1f0c10 con 0x7f9ecc0c1020 2024-09-13T15:01:38.422 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.421+0000 7f9ed2000640 1 -- 172.21.15.7:0/2085267226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ecc153fb0 con 0x7f9ecc0c1020 2024-09-13T15:01:38.423 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.421+0000 7f9ec3e00640 1 -- 172.21.15.7:0/2085267226 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7f9ec400ab90 con 0x7f9ecc0c1020 2024-09-13T15:01:38.423 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.421+0000 7f9ec3e00640 1 --2- 172.21.15.7:0/2085267226 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9ea8066600 0x7f9ea8068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:38.423 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.421+0000 7f9ec3e00640 1 -- 172.21.15.7:0/2085267226 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f9ec4083910 con 0x7f9ecc0c1020 2024-09-13T15:01:38.423 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.421+0000 7f9ecb400640 1 --2- 172.21.15.7:0/2085267226 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9ea8066600 0x7f9ea8068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:38.423 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.421+0000 7f9ecb400640 1 --2- 172.21.15.7:0/2085267226 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9ea8066600 0x7f9ea8068ac0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0b2000 tx=0x7f9ebc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:38.428 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.425+0000 7f9ec3e00640 1 -- 172.21.15.7:0/2085267226 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9ec4051240 con 0x7f9ecc0c1020 2024-09-13T15:01:38.590 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.589+0000 7f9ed2000640 1 -- 172.21.15.7:0/2085267226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ecc0c8400 con 0x7f9ecc0c1020 2024-09-13T15:01:38.591 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.589+0000 7f9ec3e00640 1 -- 172.21.15.7:0/2085267226 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10788 (secure 0 0 0) 0x7f9ec4054860 con 0x7f9ecc0c1020 2024-09-13T15:01:38.591 INFO:teuthology.misc.health.smithi007.stdout: 2024-09-13T15:01:38.591 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":14,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:01:38.262262+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:01:38.593 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.593+0000 7f9ed2000640 1 -- 172.21.15.7:0/2085267226 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9ea8066600 msgr2=0x7f9ea8068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:38.594 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.593+0000 7f9ed2000640 1 --2- 172.21.15.7:0/2085267226 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9ea8066600 0x7f9ea8068ac0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0b2000 tx=0x7f9ebc009040 comp rx=0 tx=0).stop 2024-09-13T15:01:38.594 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.593+0000 7f9ed2000640 1 -- 172.21.15.7:0/2085267226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc0c1020 msgr2=0x7f9ecc140bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:38.594 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.593+0000 7f9ed2000640 1 --2- 172.21.15.7:0/2085267226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc0c1020 0x7f9ecc140bc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400c730 tx=0x7f9ec400cbf0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.594 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.593+0000 7f9ed2000640 1 -- 172.21.15.7:0/2085267226 shutdown_connections 2024-09-13T15:01:38.594 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.593+0000 7f9ed2000640 1 --2- 172.21.15.7:0/2085267226 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9ea8066600 0x7f9ea8068ac0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.594 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.593+0000 7f9ed2000640 1 --2- 172.21.15.7:0/2085267226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ecc0c1020 0x7f9ecc140bc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.594 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.593+0000 7f9ed2000640 1 --2- 172.21.15.7:0/2085267226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ecc06fc40 0x7f9ecc1f0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.594 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.593+0000 7f9ed2000640 1 --2- 172.21.15.7:0/2085267226 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ecc06f860 0x7f9ecc14d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.594 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.593+0000 7f9ed2000640 1 -- 172.21.15.7:0/2085267226 >> 172.21.15.7:0/2085267226 conn(0x7f9ecc0c78e0 msgr2=0x7f9ecc06bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:38.594 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.593+0000 7f9ed2000640 1 -- 172.21.15.7:0/2085267226 shutdown_connections 2024-09-13T15:01:38.594 INFO:teuthology.misc.health.smithi007.stderr:2024-09-13T15:01:38.593+0000 7f9ed2000640 1 -- 172.21.15.7:0/2085267226 wait complete. 2024-09-13T15:01:38.610 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T15:01:38.610 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T15:01:38.611 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T15:01:38.611 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T15:01:38.614 INFO:tasks.ceph.mds.a:Started 2024-09-13T15:01:38.614 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T15:01:38.614 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T15:01:38.617 INFO:tasks.ceph.mds.c:Started 2024-09-13T15:01:38.617 INFO:tasks.ceph.mds.e:Restarting daemon 2024-09-13T15:01:38.617 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-09-13T15:01:38.620 INFO:tasks.ceph.mds.e:Started 2024-09-13T15:01:38.620 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T15:01:38.621 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T15:01:38.623 INFO:tasks.ceph.mds.b:Started 2024-09-13T15:01:38.623 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T15:01:38.623 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T15:01:38.626 INFO:tasks.ceph.mds.d:Started 2024-09-13T15:01:38.626 INFO:tasks.ceph.mds.f:Restarting daemon 2024-09-13T15:01:38.626 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-09-13T15:01:38.629 INFO:tasks.ceph.mds.f:Started 2024-09-13T15:01:38.629 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T15:01:38.629 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:01:38.696 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-13T15:01:38.705 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-13T15:01:38.705 INFO:tasks.ceph.mds.f.smithi077.stdout:starting mds.f at 2024-09-13T15:01:38.723 INFO:tasks.ceph.mds.e.smithi007.stdout:starting mds.e at 2024-09-13T15:01:38.732 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-09-13T15:01:38.732 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-09-13T15:01:38.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.781+0000 7f7ed9200640 1 Processor -- start 2024-09-13T15:01:38.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.781+0000 7f7ed9200640 1 -- start start 2024-09-13T15:01:38.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.781+0000 7f7ed9200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ed41513c0 0x7f7ed4156e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:38.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.781+0000 7f7ed9200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7ed40c8780 0x7f7ed4157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:38.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.781+0000 7f7ed9200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed40c20e0 con 0x7f7ed4150fe0 2024-09-13T15:01:38.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.781+0000 7f7ed9200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed415af50 con 0x7f7ed40c8780 2024-09-13T15:01:38.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.781+0000 7f7ed9200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed415b230 con 0x7f7ed41513c0 2024-09-13T15:01:38.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.781+0000 7f7ed2800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7ed40c8780 0x7f7ed4157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:38.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.781+0000 7f7ed2800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7ed40c8780 0x7f7ed4157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44814/0 (socket says 172.21.15.7:44814) 2024-09-13T15:01:38.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.781+0000 7f7ed1e00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7ed4150fe0 0x7f7ed40c6b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:39650/0 (socket says 172.21.15.7:39650) 2024-09-13T15:01:38.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.781+0000 7f7ec9400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ed41513c0 0x7f7ed4156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:38.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.781+0000 7f7ed2800640 1 -- 172.21.15.7:0/4263943551 learned_addr learned my addr 172.21.15.7:0/4263943551 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:38.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.781+0000 7f7ed2800640 1 -- 172.21.15.7:0/4263943551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ed41513c0 msgr2=0x7f7ed4156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:38.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.781+0000 7f7ed2800640 1 --2- 172.21.15.7:0/4263943551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ed41513c0 0x7f7ed4156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.781+0000 7f7ed2800640 1 -- 172.21.15.7:0/4263943551 >> v1:172.21.15.77:6789/0 conn(0x7f7ed4150fe0 legacy=0x7f7ed40c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:38.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.781+0000 7f7ed2800640 1 -- 172.21.15.7:0/4263943551 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed40c3b70 con 0x7f7ed40c8780 2024-09-13T15:01:38.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.785+0000 7f7ed2800640 1 --2- 172.21.15.7:0/4263943551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed40c8780 0x7f7ed4157370 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009e50 tx=0x7f7ecc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91464812f534ef0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:38.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.785+0000 7f7ed1400640 1 -- 172.21.15.7:0/4263943551 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0a56e0 con 0x7f7ed40c8780 2024-09-13T15:01:38.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.785+0000 7f7ed1400640 1 -- 172.21.15.7:0/4263943551 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc0a5840 con 0x7f7ed40c8780 2024-09-13T15:01:38.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.785+0000 7f7ed1400640 1 -- 172.21.15.7:0/4263943551 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0a5bd0 con 0x7f7ed40c8780 2024-09-13T15:01:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.785+0000 7f7ed9200640 1 -- 172.21.15.7:0/4263943551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed40c8780 msgr2=0x7f7ed4157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.785+0000 7f7ed9200640 1 --2- 172.21.15.7:0/4263943551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed40c8780 0x7f7ed4157370 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009e50 tx=0x7f7ecc01c9a0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.785+0000 7f7ed9200640 1 -- 172.21.15.7:0/4263943551 shutdown_connections 2024-09-13T15:01:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.785+0000 7f7ed9200640 1 --2- 172.21.15.7:0/4263943551 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed40c8780 0x7f7ed4157370 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.785+0000 7f7ed9200640 1 --2- 172.21.15.7:0/4263943551 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ed41513c0 0x7f7ed4156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.785+0000 7f7ed9200640 1 -- 172.21.15.7:0/4263943551 >> 172.21.15.7:0/4263943551 conn(0x7f7ed4071730 msgr2=0x7f7ed4071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.785+0000 7f7ed9200640 1 -- 172.21.15.7:0/4263943551 shutdown_connections 2024-09-13T15:01:38.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.785+0000 7f7ed9200640 1 -- 172.21.15.7:0/4263943551 wait complete. 2024-09-13T15:01:38.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed9200640 1 Processor -- start 2024-09-13T15:01:38.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed9200640 1 -- start start 2024-09-13T15:01:38.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed9200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ed40c8780 0x7f7ed4149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:38.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed9200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed4150fe0 0x7f7ed40c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:38.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed41513c0 0x7f7ed406ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:38.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed9200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed41f5b80 con 0x7f7ed41513c0 2024-09-13T15:01:38.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed9200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed414a0f0 con 0x7f7ed4150fe0 2024-09-13T15:01:38.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed9200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed414c260 con 0x7f7ed40c8780 2024-09-13T15:01:38.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed41513c0 0x7f7ed406ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:38.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed41513c0 0x7f7ed406ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44818/0 (socket says 172.21.15.7:44818) 2024-09-13T15:01:38.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed2800640 1 -- 172.21.15.7:0/3548432851 learned_addr learned my addr 172.21.15.7:0/3548432851 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:38.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ec9400640 1 --2- 172.21.15.7:0/3548432851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed4150fe0 0x7f7ed40c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:38.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed1e00640 1 --2- 172.21.15.7:0/3548432851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ed40c8780 0x7f7ed4149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:38.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed2800640 1 -- 172.21.15.7:0/3548432851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ed40c8780 msgr2=0x7f7ed4149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:38.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed2800640 1 --2- 172.21.15.7:0/3548432851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ed40c8780 0x7f7ed4149bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed2800640 1 -- 172.21.15.7:0/3548432851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed4150fe0 msgr2=0x7f7ed40c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:38.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed2800640 1 --2- 172.21.15.7:0/3548432851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed4150fe0 0x7f7ed40c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed2800640 1 -- 172.21.15.7:0/3548432851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc009b30 con 0x7f7ed41513c0 2024-09-13T15:01:38.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed2800640 1 --2- 172.21.15.7:0/3548432851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed41513c0 0x7f7ed406ef10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc01a5d0 tx=0x7f7ecc019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:38.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ecaa00640 1 -- 172.21.15.7:0/3548432851 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0b8670 con 0x7f7ed41513c0 2024-09-13T15:01:38.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ecaa00640 1 -- 172.21.15.7:0/3548432851 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc0b87f0 con 0x7f7ed41513c0 2024-09-13T15:01:38.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ecaa00640 1 -- 172.21.15.7:0/3548432851 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0b8ba0 con 0x7f7ed41513c0 2024-09-13T15:01:38.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed9200640 1 -- 172.21.15.7:0/3548432851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed414c500 con 0x7f7ed41513c0 2024-09-13T15:01:38.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed9200640 1 -- 172.21.15.7:0/3548432851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed41f5530 con 0x7f7ed41513c0 2024-09-13T15:01:38.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.789+0000 7f7ed9200640 1 -- 172.21.15.7:0/3548432851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed4067650 con 0x7f7ed41513c0 2024-09-13T15:01:38.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.793+0000 7f7ecaa00640 1 -- 172.21.15.7:0/3548432851 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7f7ecc0b8d00 con 0x7f7ed41513c0 2024-09-13T15:01:38.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.793+0000 7f7ecaa00640 1 --2- 172.21.15.7:0/3548432851 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7eb0066630 0x7f7eb0068af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:38.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.793+0000 7f7ecaa00640 1 -- 172.21.15.7:0/3548432851 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f7ecc11ef60 con 0x7f7ed41513c0 2024-09-13T15:01:38.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.793+0000 7f7ed1e00640 1 --2- 172.21.15.7:0/3548432851 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7eb0066630 0x7f7eb0068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:38.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.793+0000 7f7ed1e00640 1 --2- 172.21.15.7:0/3548432851 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7eb0066630 0x7f7eb0068af0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4000f70 tx=0x7f7ec4007e50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:38.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.797+0000 7f7ecaa00640 1 -- 172.21.15.7:0/3548432851 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ecc0ec950 con 0x7f7ed41513c0 2024-09-13T15:01:38.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.961+0000 7f7ed9200640 1 -- 172.21.15.7:0/3548432851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ed40c6b10 con 0x7f7ed41513c0 2024-09-13T15:01:38.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.961+0000 7f7ecaa00640 1 -- 172.21.15.7:0/3548432851 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10788 (secure 0 0 0) 0x7f7ecc0bc090 con 0x7f7ed41513c0 2024-09-13T15:01:38.963 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:01:38.963 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":14,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:01:38.262262+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:01:38.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.965+0000 7f7ed9200640 1 -- 172.21.15.7:0/3548432851 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7eb0066630 msgr2=0x7f7eb0068af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:38.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.965+0000 7f7ed9200640 1 --2- 172.21.15.7:0/3548432851 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7eb0066630 0x7f7eb0068af0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4000f70 tx=0x7f7ec4007e50 comp rx=0 tx=0).stop 2024-09-13T15:01:38.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.965+0000 7f7ed9200640 1 -- 172.21.15.7:0/3548432851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed41513c0 msgr2=0x7f7ed406ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:38.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.965+0000 7f7ed9200640 1 --2- 172.21.15.7:0/3548432851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed41513c0 0x7f7ed406ef10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc01a5d0 tx=0x7f7ecc019740 comp rx=0 tx=0).stop 2024-09-13T15:01:38.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.965+0000 7f7ed9200640 1 -- 172.21.15.7:0/3548432851 shutdown_connections 2024-09-13T15:01:38.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.965+0000 7f7ed9200640 1 --2- 172.21.15.7:0/3548432851 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7eb0066630 0x7f7eb0068af0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.965+0000 7f7ed9200640 1 --2- 172.21.15.7:0/3548432851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ed41513c0 0x7f7ed406ef10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.965+0000 7f7ed9200640 1 --2- 172.21.15.7:0/3548432851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ed4150fe0 0x7f7ed40c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.965+0000 7f7ed9200640 1 --2- 172.21.15.7:0/3548432851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ed40c8780 0x7f7ed4149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:38.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.965+0000 7f7ed9200640 1 -- 172.21.15.7:0/3548432851 >> 172.21.15.7:0/3548432851 conn(0x7f7ed4071730 msgr2=0x7f7ed415fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:38.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.965+0000 7f7ed9200640 1 -- 172.21.15.7:0/3548432851 shutdown_connections 2024-09-13T15:01:38.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:38.965+0000 7f7ed9200640 1 -- 172.21.15.7:0/3548432851 wait complete. 2024-09-13T15:01:38.983 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-09-13T15:01:38.984 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:01:39.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.125+0000 7f5c08a00640 1 Processor -- start 2024-09-13T15:01:39.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.125+0000 7f5c08a00640 1 -- start start 2024-09-13T15:01:39.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.125+0000 7f5c08a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5c040c5ab0 0x7f5c0406cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.125+0000 7f5c08a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c04161ab0 con 0x7f5c040c6890 2024-09-13T15:01:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.125+0000 7f5c08a00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c0406dbc0 con 0x7f5c040c5e90 2024-09-13T15:01:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.125+0000 7f5c08a00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c04160f80 con 0x7f5c040c5ab0 2024-09-13T15:01:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.125+0000 7f5c01400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5c040c6890 0x7f5c041613a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44158/0 (socket says 172.21.15.7:44158) 2024-09-13T15:01:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.125+0000 7f5c01400640 1 -- 172.21.15.7:0/1217232270 learned_addr learned my addr 172.21.15.7:0/1217232270 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:01:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.125+0000 7f5c01e00640 1 --2- 172.21.15.7:0/1217232270 >> v2:172.21.15.77:3300/0 conn(0x7f5c040c5ab0 0x7f5c0406cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.125+0000 7f5c00a00640 1 -- 172.21.15.7:0/1217232270 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335700626 0 0) 0x7f5bf0001120 con 0x7f5c040c6890 2024-09-13T15:01:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.125+0000 7f5c00a00640 1 -- 172.21.15.7:0/1217232270 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5be8003530 con 0x7f5c040c6890 2024-09-13T15:01:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.125+0000 7f5c01e00640 1 -- 172.21.15.7:0/1217232270 >> v1:172.21.15.77:6789/0 conn(0x7f5c040c5e90 legacy=0x7f5c04157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.125+0000 7f5c01e00640 1 -- 172.21.15.7:0/1217232270 >> v1:172.21.15.7:6789/0 conn(0x7f5c040c6890 legacy=0x7f5c041613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.125+0000 7f5c00a00640 1 -- 172.21.15.7:0/1217232270 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3140236809 0 0) 0x7f5be8003530 con 0x7f5c040c6890 2024-09-13T15:01:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.125+0000 7f5c01e00640 1 -- 172.21.15.7:0/1217232270 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0406d320 con 0x7f5c040c5ab0 2024-09-13T15:01:39.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.129+0000 7f5c01e00640 1 --2- 172.21.15.7:0/1217232270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c040c5ab0 0x7f5c0406cce0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40097f0 tx=0x7f5bf401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d246168e25d09739 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:39.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.129+0000 7f5c00a00640 1 -- 172.21.15.7:0/1217232270 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf40a8990 con 0x7f5c040c5ab0 2024-09-13T15:01:39.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.129+0000 7f5c00a00640 1 -- 172.21.15.7:0/1217232270 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf40a8af0 con 0x7f5c040c5ab0 2024-09-13T15:01:39.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.129+0000 7f5c00a00640 1 -- 172.21.15.7:0/1217232270 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf40a8e60 con 0x7f5c040c5ab0 2024-09-13T15:01:39.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.129+0000 7f5c08a00640 1 -- 172.21.15.7:0/1217232270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c040c5ab0 msgr2=0x7f5c0406cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:39.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.129+0000 7f5c08a00640 1 --2- 172.21.15.7:0/1217232270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c040c5ab0 0x7f5c0406cce0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40097f0 tx=0x7f5bf401ec90 comp rx=0 tx=0).stop 2024-09-13T15:01:39.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.129+0000 7f5c08a00640 1 -- 172.21.15.7:0/1217232270 shutdown_connections 2024-09-13T15:01:39.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.129+0000 7f5c08a00640 1 --2- 172.21.15.7:0/1217232270 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c040c5ab0 0x7f5c0406cce0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:39.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.129+0000 7f5c08a00640 1 -- 172.21.15.7:0/1217232270 >> 172.21.15.7:0/1217232270 conn(0x7f5c04065d40 msgr2=0x7f5c04066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:39.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.129+0000 7f5c08a00640 1 -- 172.21.15.7:0/1217232270 shutdown_connections 2024-09-13T15:01:39.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.129+0000 7f5c08a00640 1 -- 172.21.15.7:0/1217232270 wait complete. 2024-09-13T15:01:39.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c08a00640 1 Processor -- start 2024-09-13T15:01:39.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c08a00640 1 -- start start 2024-09-13T15:01:39.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c08a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c040c5ab0 0x7f5c041f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:39.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c08a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c040c5e90 0x7f5c04151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:39.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c08a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c040c6890 0x7f5c04151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:39.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c08a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c041530c0 con 0x7f5c040c5e90 2024-09-13T15:01:39.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c08a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c04154240 con 0x7f5c040c6890 2024-09-13T15:01:39.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c08a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c041f75f0 con 0x7f5c040c5ab0 2024-09-13T15:01:39.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c01400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c040c5e90 0x7f5c04151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:39.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c01400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c040c5e90 0x7f5c04151890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44830/0 (socket says 172.21.15.7:44830) 2024-09-13T15:01:39.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c01400640 1 -- 172.21.15.7:0/2776107335 learned_addr learned my addr 172.21.15.7:0/2776107335 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:39.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c02800640 1 --2- 172.21.15.7:0/2776107335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c040c6890 0x7f5c04151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:39.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c01e00640 1 --2- 172.21.15.7:0/2776107335 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c040c5ab0 0x7f5c041f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:39.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c01400640 1 -- 172.21.15.7:0/2776107335 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c040c5ab0 msgr2=0x7f5c041f6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:39.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c01400640 1 --2- 172.21.15.7:0/2776107335 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c040c5ab0 0x7f5c041f6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:39.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c01400640 1 -- 172.21.15.7:0/2776107335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c040c6890 msgr2=0x7f5c04151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:39.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c01400640 1 --2- 172.21.15.7:0/2776107335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c040c6890 0x7f5c04151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c01400640 1 -- 172.21.15.7:0/2776107335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf4009420 con 0x7f5c040c5e90 2024-09-13T15:01:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c02800640 1 --2- 172.21.15.7:0/2776107335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c040c6890 0x7f5c04151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c01400640 1 --2- 172.21.15.7:0/2776107335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c040c5e90 0x7f5c04151890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000c410 tx=0x7f5bf000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5bfa000640 1 -- 172.21.15.7:0/2776107335 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0005cf0 con 0x7f5c040c5e90 2024-09-13T15:01:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5bfa000640 1 -- 172.21.15.7:0/2776107335 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf0005e50 con 0x7f5c040c5e90 2024-09-13T15:01:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c08a00640 1 -- 172.21.15.7:0/2776107335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c04152de0 con 0x7f5c040c5e90 2024-09-13T15:01:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5bfa000640 1 -- 172.21.15.7:0/2776107335 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0007310 con 0x7f5c040c5e90 2024-09-13T15:01:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c08a00640 1 -- 172.21.15.7:0/2776107335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c04153ed0 con 0x7f5c040c5e90 2024-09-13T15:01:39.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.133+0000 7f5c08a00640 1 -- 172.21.15.7:0/2776107335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c04067650 con 0x7f5c040c5e90 2024-09-13T15:01:39.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.137+0000 7f5bfa000640 1 -- 172.21.15.7:0/2776107335 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7f5bf0007470 con 0x7f5c040c5e90 2024-09-13T15:01:39.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.137+0000 7f5bfa000640 1 --2- 172.21.15.7:0/2776107335 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5be4066600 0x7f5be4068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.137+0000 7f5bfa000640 1 -- 172.21.15.7:0/2776107335 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f5bf0082ff0 con 0x7f5c040c5e90 2024-09-13T15:01:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.137+0000 7f5c01e00640 1 --2- 172.21.15.7:0/2776107335 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5be4066600 0x7f5be4068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.137+0000 7f5c01e00640 1 --2- 172.21.15.7:0/2776107335 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5be4066600 0x7f5be4068ac0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40b2000 tx=0x7f5bf40aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.141+0000 7f5bfa000640 1 -- 172.21.15.7:0/2776107335 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5bf0050940 con 0x7f5c040c5e90 2024-09-13T15:01:39.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.333+0000 7f5c08a00640 1 -- 172.21.15.7:0/2776107335 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c04161ab0 con 0x7f5c040c5e90 2024-09-13T15:01:39.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.333+0000 7f5bfa000640 1 -- 172.21.15.7:0/2776107335 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f5c04161ab0 con 0x7f5c040c5e90 2024-09-13T15:01:39.336 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:01:39.336 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T15:01:39.336 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 2 2024-09-13T15:01:39.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.337+0000 7f5c08a00640 1 -- 172.21.15.7:0/2776107335 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5be4066600 msgr2=0x7f5be4068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:39.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.337+0000 7f5c08a00640 1 --2- 172.21.15.7:0/2776107335 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5be4066600 0x7f5be4068ac0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40b2000 tx=0x7f5bf40aa070 comp rx=0 tx=0).stop 2024-09-13T15:01:39.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.337+0000 7f5c08a00640 1 -- 172.21.15.7:0/2776107335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c040c5e90 msgr2=0x7f5c04151890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:39.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.337+0000 7f5c08a00640 1 --2- 172.21.15.7:0/2776107335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c040c5e90 0x7f5c04151890 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5bf000c410 tx=0x7f5bf000c8d0 comp rx=0 tx=0).stop 2024-09-13T15:01:39.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.337+0000 7f5c08a00640 1 -- 172.21.15.7:0/2776107335 shutdown_connections 2024-09-13T15:01:39.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.337+0000 7f5c08a00640 1 --2- 172.21.15.7:0/2776107335 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5be4066600 0x7f5be4068ac0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:39.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.337+0000 7f5c08a00640 1 --2- 172.21.15.7:0/2776107335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c040c6890 0x7f5c04151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:39.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.337+0000 7f5c08a00640 1 --2- 172.21.15.7:0/2776107335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c040c5e90 0x7f5c04151890 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:39.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.337+0000 7f5c08a00640 1 --2- 172.21.15.7:0/2776107335 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c040c5ab0 0x7f5c041f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:39.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.337+0000 7f5c08a00640 1 -- 172.21.15.7:0/2776107335 >> 172.21.15.7:0/2776107335 conn(0x7f5c04065d40 msgr2=0x7f5c04160030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:39.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.337+0000 7f5c08a00640 1 -- 172.21.15.7:0/2776107335 shutdown_connections 2024-09-13T15:01:39.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:39.337+0000 7f5c08a00640 1 -- 172.21.15.7:0/2776107335 wait complete. 2024-09-13T15:01:41.359 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:01:41.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.500+0000 7efdc0000640 1 Processor -- start 2024-09-13T15:01:41.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.500+0000 7efdc0000640 1 -- start start 2024-09-13T15:01:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.504+0000 7efdc0000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efdb80c00f0 0x7efdb80c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.504+0000 7efdc0000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb806fd10 con 0x7efdb80c04d0 2024-09-13T15:01:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.504+0000 7efdc0000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb8155ec0 con 0x7efdb80b0cb0 2024-09-13T15:01:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.504+0000 7efdc0000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb8071000 con 0x7efdb80c00f0 2024-09-13T15:01:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.504+0000 7efdbd600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efdb80c00f0 0x7efdb80c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.504+0000 7efdbcc00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7efdb80c04d0 0x7efdb806f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44170/0 (socket says 172.21.15.7:44170) 2024-09-13T15:01:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.504+0000 7efdbcc00640 1 -- 172.21.15.7:0/1330986586 learned_addr learned my addr 172.21.15.7:0/1330986586 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:01:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.504+0000 7efdbd600640 1 -- 172.21.15.7:0/1330986586 >> v1:172.21.15.77:6789/0 conn(0x7efdb80b0cb0 legacy=0x7efdb814f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.504+0000 7efdbd600640 1 -- 172.21.15.7:0/1330986586 >> v1:172.21.15.7:6789/0 conn(0x7efdb80c04d0 legacy=0x7efdb806f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.504+0000 7efdbd600640 1 -- 172.21.15.7:0/1330986586 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb806ff60 con 0x7efdb80c00f0 2024-09-13T15:01:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.504+0000 7efdb7e00640 1 -- 172.21.15.7:0/1330986586 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238983838 0 0) 0x7efdb806fd10 con 0x7efdb80c04d0 2024-09-13T15:01:41.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.504+0000 7efdbd600640 1 --2- 172.21.15.7:0/1330986586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdb80c00f0 0x7efdb80c5530 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efdac0097c0 tx=0x7efdac01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9152a9b34f4426 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:41.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.504+0000 7efdb7e00640 1 -- 172.21.15.7:0/1330986586 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac0a8990 con 0x7efdb80c00f0 2024-09-13T15:01:41.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.504+0000 7efdb7e00640 1 -- 172.21.15.7:0/1330986586 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdac0a8af0 con 0x7efdb80c00f0 2024-09-13T15:01:41.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.504+0000 7efdb7e00640 1 -- 172.21.15.7:0/1330986586 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdac0a8e80 con 0x7efdb80c00f0 2024-09-13T15:01:41.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdc0000640 1 -- 172.21.15.7:0/1330986586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdb80c00f0 msgr2=0x7efdb80c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:41.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdc0000640 1 --2- 172.21.15.7:0/1330986586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdb80c00f0 0x7efdb80c5530 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efdac0097c0 tx=0x7efdac01ec90 comp rx=0 tx=0).stop 2024-09-13T15:01:41.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdc0000640 1 -- 172.21.15.7:0/1330986586 shutdown_connections 2024-09-13T15:01:41.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdc0000640 1 --2- 172.21.15.7:0/1330986586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdb80c00f0 0x7efdb80c5530 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:41.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdc0000640 1 -- 172.21.15.7:0/1330986586 >> 172.21.15.7:0/1330986586 conn(0x7efdb8065d40 msgr2=0x7efdb8066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:41.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdc0000640 1 -- 172.21.15.7:0/1330986586 shutdown_connections 2024-09-13T15:01:41.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdc0000640 1 -- 172.21.15.7:0/1330986586 wait complete. 2024-09-13T15:01:41.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdc0000640 1 Processor -- start 2024-09-13T15:01:41.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdc0000640 1 -- start start 2024-09-13T15:01:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdc0000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdb80b0cb0 0x7efdb8152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdc0000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efdb80c00f0 0x7efdb8142990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdc0000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdb80c04d0 0x7efdb8146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdc0000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb81ef720 con 0x7efdb80c04d0 2024-09-13T15:01:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdc0000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8150e70 con 0x7efdb80b0cb0 2024-09-13T15:01:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdc0000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb814da90 con 0x7efdb80c00f0 2024-09-13T15:01:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdbe000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdb80c04d0 0x7efdb8146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:41.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdbe000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdb80c04d0 0x7efdb8146ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44846/0 (socket says 172.21.15.7:44846) 2024-09-13T15:01:41.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdbe000640 1 -- 172.21.15.7:0/3989107384 learned_addr learned my addr 172.21.15.7:0/3989107384 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:41.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdbd600640 1 --2- 172.21.15.7:0/3989107384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdb80b0cb0 0x7efdb8152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:41.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdbcc00640 1 --2- 172.21.15.7:0/3989107384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efdb80c00f0 0x7efdb8142990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:41.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.508+0000 7efdbe000640 1 -- 172.21.15.7:0/3989107384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efdb80c00f0 msgr2=0x7efdb8142990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:41.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.512+0000 7efdbe000640 1 --2- 172.21.15.7:0/3989107384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efdb80c00f0 0x7efdb8142990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:41.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.512+0000 7efdbe000640 1 -- 172.21.15.7:0/3989107384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdb80b0cb0 msgr2=0x7efdb8152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:41.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.512+0000 7efdbe000640 1 --2- 172.21.15.7:0/3989107384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdb80b0cb0 0x7efdb8152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:41.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.512+0000 7efdbe000640 1 -- 172.21.15.7:0/3989107384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac009420 con 0x7efdb80c04d0 2024-09-13T15:01:41.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.512+0000 7efdbd600640 1 --2- 172.21.15.7:0/3989107384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdb80b0cb0 0x7efdb8152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:41.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.512+0000 7efdbcc00640 1 --2- 172.21.15.7:0/3989107384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efdb80c00f0 0x7efdb8142990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:41.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.512+0000 7efdbe000640 1 --2- 172.21.15.7:0/3989107384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdb80c04d0 0x7efdb8146ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efdb000c770 tx=0x7efdb000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:41.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.512+0000 7efdb5600640 1 -- 172.21.15.7:0/3989107384 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb0003b80 con 0x7efdb80c04d0 2024-09-13T15:01:41.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.512+0000 7efdb5600640 1 -- 172.21.15.7:0/3989107384 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb0003ce0 con 0x7efdb80c04d0 2024-09-13T15:01:41.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.512+0000 7efdb5600640 1 -- 172.21.15.7:0/3989107384 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb000aa30 con 0x7efdb80c04d0 2024-09-13T15:01:41.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.512+0000 7efdc0000640 1 -- 172.21.15.7:0/3989107384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb81ef180 con 0x7efdb80c04d0 2024-09-13T15:01:41.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.512+0000 7efdc0000640 1 -- 172.21.15.7:0/3989107384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb8150820 con 0x7efdb80c04d0 2024-09-13T15:01:41.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.512+0000 7efdc0000640 1 -- 172.21.15.7:0/3989107384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb8067650 con 0x7efdb80c04d0 2024-09-13T15:01:41.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.512+0000 7efdb5600640 1 -- 172.21.15.7:0/3989107384 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7efdb000ab90 con 0x7efdb80c04d0 2024-09-13T15:01:41.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.512+0000 7efdb5600640 1 --2- 172.21.15.7:0/3989107384 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efd98066600 0x7efd98068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:41.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.512+0000 7efdb5600640 1 -- 172.21.15.7:0/3989107384 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efdb0083bd0 con 0x7efdb80c04d0 2024-09-13T15:01:41.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.516+0000 7efdb5600640 1 -- 172.21.15.7:0/3989107384 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efdb0051360 con 0x7efdb80c04d0 2024-09-13T15:01:41.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.548+0000 7efdbd600640 1 --2- 172.21.15.7:0/3989107384 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efd98066600 0x7efd98068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:41.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.552+0000 7efdbd600640 1 --2- 172.21.15.7:0/3989107384 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efd98066600 0x7efd98068ac0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efdac0b2000 tx=0x7efdac0aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:41.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.720+0000 7efdc0000640 1 -- 172.21.15.7:0/3989107384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdb8150680 con 0x7efdb80c04d0 2024-09-13T15:01:41.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.720+0000 7efdb5600640 1 -- 172.21.15.7:0/3989107384 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5027 (secure 0 0 0) 0x7efdb8150680 con 0x7efdb80c04d0 2024-09-13T15:01:41.723 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:01:41.723 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T15:01:41.724 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 3 2024-09-13T15:01:41.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.724+0000 7efdc0000640 1 -- 172.21.15.7:0/3989107384 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efd98066600 msgr2=0x7efd98068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:41.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.724+0000 7efdc0000640 1 --2- 172.21.15.7:0/3989107384 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efd98066600 0x7efd98068ac0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efdac0b2000 tx=0x7efdac0aa070 comp rx=0 tx=0).stop 2024-09-13T15:01:41.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.724+0000 7efdc0000640 1 -- 172.21.15.7:0/3989107384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdb80c04d0 msgr2=0x7efdb8146ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:41.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.724+0000 7efdc0000640 1 --2- 172.21.15.7:0/3989107384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdb80c04d0 0x7efdb8146ab0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7efdb000c770 tx=0x7efdb000cc30 comp rx=0 tx=0).stop 2024-09-13T15:01:41.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.724+0000 7efdc0000640 1 -- 172.21.15.7:0/3989107384 shutdown_connections 2024-09-13T15:01:41.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.724+0000 7efdc0000640 1 --2- 172.21.15.7:0/3989107384 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efd98066600 0x7efd98068ac0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:41.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.724+0000 7efdc0000640 1 --2- 172.21.15.7:0/3989107384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efdb80c04d0 0x7efdb8146ab0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:41.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.724+0000 7efdc0000640 1 --2- 172.21.15.7:0/3989107384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efdb80c00f0 0x7efdb8142990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:41.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.724+0000 7efdc0000640 1 --2- 172.21.15.7:0/3989107384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdb80b0cb0 0x7efdb8152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:41.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.724+0000 7efdc0000640 1 -- 172.21.15.7:0/3989107384 >> 172.21.15.7:0/3989107384 conn(0x7efdb8065d40 msgr2=0x7efdb806f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:41.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.724+0000 7efdc0000640 1 -- 172.21.15.7:0/3989107384 shutdown_connections 2024-09-13T15:01:41.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.724+0000 7efdc0000640 1 -- 172.21.15.7:0/3989107384 wait complete. 2024-09-13T15:01:41.747 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:01:41.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.888+0000 7faab3a00640 1 Processor -- start 2024-09-13T15:01:41.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.888+0000 7faab3a00640 1 -- start start 2024-09-13T15:01:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.892+0000 7faab3a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faaac150fe0 0x7faaac0c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.892+0000 7faab3a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaac1513c0 0x7faaac06ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.892+0000 7faab3a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faaac0c8780 0x7faaac06f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.892+0000 7faab3a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaac0c20e0 con 0x7faaac0c8780 2024-09-13T15:01:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.892+0000 7faab3a00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaac15af50 con 0x7faaac150fe0 2024-09-13T15:01:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.892+0000 7faab3a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac15b230 con 0x7faaac1513c0 2024-09-13T15:01:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.892+0000 7faab1a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faaac0c8780 0x7faaac06f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.892+0000 7faab1a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7faaac0c8780 0x7faaac06f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44858/0 (socket says 172.21.15.7:44858) 2024-09-13T15:01:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.892+0000 7faab1a00640 1 -- 172.21.15.7:0/863278223 learned_addr learned my addr 172.21.15.7:0/863278223 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.892+0000 7faaa3e00640 1 --2- 172.21.15.7:0/863278223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaac1513c0 0x7faaac06ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:41.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.892+0000 7faab1000640 1 --2- 172.21.15.7:0/863278223 >> v2:172.21.15.77:3300/0 conn(0x7faaac150fe0 0x7faaac0c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:41.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.892+0000 7faab1a00640 1 -- 172.21.15.7:0/863278223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaac1513c0 msgr2=0x7faaac06ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:41.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.892+0000 7faab1a00640 1 --2- 172.21.15.7:0/863278223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaac1513c0 0x7faaac06ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:41.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.892+0000 7faab1a00640 1 -- 172.21.15.7:0/863278223 >> v2:172.21.15.77:3300/0 conn(0x7faaac150fe0 msgr2=0x7faaac0c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:41.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.892+0000 7faab1a00640 1 --2- 172.21.15.7:0/863278223 >> v2:172.21.15.77:3300/0 conn(0x7faaac150fe0 0x7faaac0c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:41.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.892+0000 7faab1a00640 1 -- 172.21.15.7:0/863278223 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0c3b70 con 0x7faaac0c8780 2024-09-13T15:01:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.892+0000 7faab1a00640 1 --2- 172.21.15.7:0/863278223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faaac0c8780 0x7faaac06f450 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faaac0725d0 tx=0x7faaa401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db27fb254f163aa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:41.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faaabe00640 1 -- 172.21.15.7:0/863278223 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa40a56f0 con 0x7faaac0c8780 2024-09-13T15:01:41.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faaabe00640 1 -- 172.21.15.7:0/863278223 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa40a5850 con 0x7faaac0c8780 2024-09-13T15:01:41.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faaabe00640 1 -- 172.21.15.7:0/863278223 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa40a5be0 con 0x7faaac0c8780 2024-09-13T15:01:41.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab3a00640 1 -- 172.21.15.7:0/863278223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faaac0c8780 msgr2=0x7faaac06f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:41.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab3a00640 1 --2- 172.21.15.7:0/863278223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faaac0c8780 0x7faaac06f450 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faaac0725d0 tx=0x7faaa401c960 comp rx=0 tx=0).stop 2024-09-13T15:01:41.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab3a00640 1 -- 172.21.15.7:0/863278223 shutdown_connections 2024-09-13T15:01:41.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab3a00640 1 --2- 172.21.15.7:0/863278223 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faaac0c8780 0x7faaac06f450 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:41.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab3a00640 1 --2- 172.21.15.7:0/863278223 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaac1513c0 0x7faaac06ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:41.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab3a00640 1 --2- 172.21.15.7:0/863278223 >> v2:172.21.15.77:3300/0 conn(0x7faaac150fe0 0x7faaac0c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:41.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab3a00640 1 -- 172.21.15.7:0/863278223 >> 172.21.15.7:0/863278223 conn(0x7faaac071730 msgr2=0x7faaac071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:41.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab3a00640 1 -- 172.21.15.7:0/863278223 shutdown_connections 2024-09-13T15:01:41.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab3a00640 1 -- 172.21.15.7:0/863278223 wait complete. 2024-09-13T15:01:41.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab3a00640 1 Processor -- start 2024-09-13T15:01:41.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab3a00640 1 -- start start 2024-09-13T15:01:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab3a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faaac0c8780 0x7faaac147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab3a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaac150fe0 0x7faaac069f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab3a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaac1513c0 0x7faaac0c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab3a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac1f28b0 con 0x7faaac0c8780 2024-09-13T15:01:41.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab3a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac15a2d0 con 0x7faaac150fe0 2024-09-13T15:01:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab3a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac1606c0 con 0x7faaac1513c0 2024-09-13T15:01:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faaac0c8780 0x7faaac147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.896+0000 7faab1000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faaac0c8780 0x7faaac147a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44864/0 (socket says 172.21.15.7:44864) 2024-09-13T15:01:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faab1000640 1 -- 172.21.15.7:0/2267408012 learned_addr learned my addr 172.21.15.7:0/2267408012 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faaa3e00640 1 --2- 172.21.15.7:0/2267408012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaac150fe0 0x7faaac069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faab1a00640 1 --2- 172.21.15.7:0/2267408012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaac1513c0 0x7faaac0c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faab1000640 1 -- 172.21.15.7:0/2267408012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaac1513c0 msgr2=0x7faaac0c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faab1000640 1 --2- 172.21.15.7:0/2267408012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaac1513c0 0x7faaac0c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faab1000640 1 -- 172.21.15.7:0/2267408012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaac150fe0 msgr2=0x7faaac069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faab1000640 1 --2- 172.21.15.7:0/2267408012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaac150fe0 0x7faaac069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faab1000640 1 -- 172.21.15.7:0/2267408012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa4009b30 con 0x7faaac0c8780 2024-09-13T15:01:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faab1a00640 1 --2- 172.21.15.7:0/2267408012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaac1513c0 0x7faaac0c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:41.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faaa3e00640 1 --2- 172.21.15.7:0/2267408012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaac150fe0 0x7faaac069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faab1000640 1 --2- 172.21.15.7:0/2267408012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faaac0c8780 0x7faaac147a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00e8b0 tx=0x7faa9c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faaa9600640 1 -- 172.21.15.7:0/2267408012 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00c940 con 0x7faaac0c8780 2024-09-13T15:01:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faaa9600640 1 -- 172.21.15.7:0/2267408012 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c00caa0 con 0x7faaac0c8780 2024-09-13T15:01:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faaa9600640 1 -- 172.21.15.7:0/2267408012 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00ce30 con 0x7faaac0c8780 2024-09-13T15:01:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faab3a00640 1 -- 172.21.15.7:0/2267408012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaac1f2b00 con 0x7faaac0c8780 2024-09-13T15:01:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faab3a00640 1 -- 172.21.15.7:0/2267408012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac06a470 con 0x7faaac0c8780 2024-09-13T15:01:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faab3a00640 1 -- 172.21.15.7:0/2267408012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaac067650 con 0x7faaac0c8780 2024-09-13T15:01:41.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.900+0000 7faaa9600640 1 -- 172.21.15.7:0/2267408012 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7faa9c013470 con 0x7faaac0c8780 2024-09-13T15:01:41.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.904+0000 7faaa9600640 1 --2- 172.21.15.7:0/2267408012 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faa88066600 0x7faa88068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.904+0000 7faaa9600640 1 -- 172.21.15.7:0/2267408012 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faa9c083ef0 con 0x7faaac0c8780 2024-09-13T15:01:41.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.904+0000 7faaa3e00640 1 --2- 172.21.15.7:0/2267408012 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faa88066600 0x7faa88068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:41.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.904+0000 7faaa3e00640 1 --2- 172.21.15.7:0/2267408012 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faa88066600 0x7faa88068ac0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faaac0ca850 tx=0x7faa94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:41.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:41.908+0000 7faaa9600640 1 -- 172.21.15.7:0/2267408012 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faa9c051680 con 0x7faaac0c8780 2024-09-13T15:01:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.080+0000 7faab3a00640 1 -- 172.21.15.7:0/2267408012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faaac0c6b10 con 0x7faaac0c8780 2024-09-13T15:01:42.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.080+0000 7faaa9600640 1 -- 172.21.15.7:0/2267408012 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12730 (secure 0 0 0) 0x7faa9c017090 con 0x7faaac0c8780 2024-09-13T15:01:42.082 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:01:42.082 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":17,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:01:41.275998+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:01:42.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.080+0000 7faab3a00640 1 -- 172.21.15.7:0/2267408012 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faa88066600 msgr2=0x7faa88068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.080+0000 7faab3a00640 1 --2- 172.21.15.7:0/2267408012 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faa88066600 0x7faa88068ac0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faaac0ca850 tx=0x7faa94008040 comp rx=0 tx=0).stop 2024-09-13T15:01:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.080+0000 7faab3a00640 1 -- 172.21.15.7:0/2267408012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faaac0c8780 msgr2=0x7faaac147a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.080+0000 7faab3a00640 1 --2- 172.21.15.7:0/2267408012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faaac0c8780 0x7faaac147a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00e8b0 tx=0x7faa9c00ed70 comp rx=0 tx=0).stop 2024-09-13T15:01:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.080+0000 7faab3a00640 1 -- 172.21.15.7:0/2267408012 shutdown_connections 2024-09-13T15:01:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.080+0000 7faab3a00640 1 --2- 172.21.15.7:0/2267408012 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faa88066600 0x7faa88068ac0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.080+0000 7faab3a00640 1 --2- 172.21.15.7:0/2267408012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faaac1513c0 0x7faaac0c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.080+0000 7faab3a00640 1 --2- 172.21.15.7:0/2267408012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faaac150fe0 0x7faaac069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.080+0000 7faab3a00640 1 --2- 172.21.15.7:0/2267408012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faaac0c8780 0x7faaac147a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.080+0000 7faab3a00640 1 -- 172.21.15.7:0/2267408012 >> 172.21.15.7:0/2267408012 conn(0x7faaac071730 msgr2=0x7faaac06d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.080+0000 7faab3a00640 1 -- 172.21.15.7:0/2267408012 shutdown_connections 2024-09-13T15:01:42.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.080+0000 7faab3a00640 1 -- 172.21.15.7:0/2267408012 wait complete. 2024-09-13T15:01:42.104 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:01:38.710958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T15:01:42.104 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:01:42.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.252+0000 7f2a71400640 1 Processor -- start 2024-09-13T15:01:42.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.252+0000 7f2a71400640 1 -- start start 2024-09-13T15:01:42.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.252+0000 7f2a71400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a6c0c7c40 0x7f2a6c159220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:42.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.252+0000 7f2a71400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a6c15c760 con 0x7f2a6c06fe40 2024-09-13T15:01:42.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.252+0000 7f2a71400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a6c15ca40 con 0x7f2a6c153380 2024-09-13T15:01:42.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.252+0000 7f2a71400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c15d3e0 con 0x7f2a6c0c7c40 2024-09-13T15:01:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.252+0000 7f2a6b200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2a6c06fe40 0x7f2a6c163910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44180/0 (socket says 172.21.15.7:44180) 2024-09-13T15:01:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.252+0000 7f2a6b200640 1 -- 172.21.15.7:0/561070359 learned_addr learned my addr 172.21.15.7:0/561070359 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:01:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.252+0000 7f2a61e00640 1 --2- 172.21.15.7:0/561070359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a6c0c7c40 0x7f2a6c159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.252+0000 7f2a69e00640 1 -- 172.21.15.7:0/561070359 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571031103 0 0) 0x7f2a6c15c760 con 0x7f2a6c06fe40 2024-09-13T15:01:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.252+0000 7f2a69e00640 1 -- 172.21.15.7:0/561070359 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a50003530 con 0x7f2a6c06fe40 2024-09-13T15:01:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.252+0000 7f2a69e00640 1 -- 172.21.15.7:0/561070359 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1732653036 0 0) 0x7f2a6c15ca40 con 0x7f2a6c153380 2024-09-13T15:01:42.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.252+0000 7f2a69e00640 1 -- 172.21.15.7:0/561070359 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a6c15c760 con 0x7f2a6c153380 2024-09-13T15:01:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.252+0000 7f2a61e00640 1 -- 172.21.15.7:0/561070359 >> v1:172.21.15.77:6789/0 conn(0x7f2a6c153380 legacy=0x7f2a6c0cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.252+0000 7f2a61e00640 1 -- 172.21.15.7:0/561070359 >> v1:172.21.15.7:6789/0 conn(0x7f2a6c06fe40 legacy=0x7f2a6c163910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.252+0000 7f2a69e00640 1 -- 172.21.15.7:0/561070359 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2659677867 0 0) 0x7f2a50003530 con 0x7f2a6c06fe40 2024-09-13T15:01:42.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.252+0000 7f2a61e00640 1 -- 172.21.15.7:0/561070359 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6c15cd20 con 0x7f2a6c0c7c40 2024-09-13T15:01:42.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.256+0000 7f2a61e00640 1 --2- 172.21.15.7:0/561070359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a6c0c7c40 0x7f2a6c159220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2a540097f0 tx=0x7f2a5401ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c762e1953c2175f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:42.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.256+0000 7f2a69e00640 1 -- 172.21.15.7:0/561070359 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64001a00 con 0x7f2a6c0c7c40 2024-09-13T15:01:42.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.256+0000 7f2a69e00640 1 -- 172.21.15.7:0/561070359 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a540a7050 con 0x7f2a6c0c7c40 2024-09-13T15:01:42.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.256+0000 7f2a69e00640 1 -- 172.21.15.7:0/561070359 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a540ab620 con 0x7f2a6c0c7c40 2024-09-13T15:01:42.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.256+0000 7f2a71400640 1 -- 172.21.15.7:0/561070359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a6c0c7c40 msgr2=0x7f2a6c159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.256+0000 7f2a71400640 1 --2- 172.21.15.7:0/561070359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a6c0c7c40 0x7f2a6c159220 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2a540097f0 tx=0x7f2a5401ce60 comp rx=0 tx=0).stop 2024-09-13T15:01:42.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.256+0000 7f2a71400640 1 -- 172.21.15.7:0/561070359 shutdown_connections 2024-09-13T15:01:42.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.256+0000 7f2a71400640 1 --2- 172.21.15.7:0/561070359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a6c0c7c40 0x7f2a6c159220 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.256+0000 7f2a71400640 1 -- 172.21.15.7:0/561070359 >> 172.21.15.7:0/561070359 conn(0x7f2a6c065d40 msgr2=0x7f2a6c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:42.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.256+0000 7f2a71400640 1 -- 172.21.15.7:0/561070359 shutdown_connections 2024-09-13T15:01:42.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.256+0000 7f2a71400640 1 -- 172.21.15.7:0/561070359 wait complete. 2024-09-13T15:01:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a71400640 1 Processor -- start 2024-09-13T15:01:42.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a71400640 1 -- start start 2024-09-13T15:01:42.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a71400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a6c06fe40 0x7f2a6c157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:42.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a71400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a6c0c7c40 0x7f2a6c157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:42.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a71400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c153380 0x7f2a6c0cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a71400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c157630 con 0x7f2a6c06fe40 2024-09-13T15:01:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a71400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c069fe0 con 0x7f2a6c153380 2024-09-13T15:01:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a71400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c158ef0 con 0x7f2a6c0c7c40 2024-09-13T15:01:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a6a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a6c06fe40 0x7f2a6c157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a6a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a6c06fe40 0x7f2a6c157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44870/0 (socket says 172.21.15.7:44870) 2024-09-13T15:01:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a6a800640 1 -- 172.21.15.7:0/3405544130 learned_addr learned my addr 172.21.15.7:0/3405544130 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a61e00640 1 --2- 172.21.15.7:0/3405544130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a6c0c7c40 0x7f2a6c157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:42.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a6b200640 1 --2- 172.21.15.7:0/3405544130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c153380 0x7f2a6c0cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:42.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a6a800640 1 -- 172.21.15.7:0/3405544130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a6c0c7c40 msgr2=0x7f2a6c157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a6a800640 1 --2- 172.21.15.7:0/3405544130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a6c0c7c40 0x7f2a6c157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a6a800640 1 -- 172.21.15.7:0/3405544130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c153380 msgr2=0x7f2a6c0cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a6a800640 1 --2- 172.21.15.7:0/3405544130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c153380 0x7f2a6c0cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a6a800640 1 -- 172.21.15.7:0/3405544130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a54009420 con 0x7f2a6c06fe40 2024-09-13T15:01:42.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a6a800640 1 --2- 172.21.15.7:0/3405544130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a6c06fe40 0x7f2a6c157a50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00c480 tx=0x7f2a5c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:42.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a63400640 1 -- 172.21.15.7:0/3405544130 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c0052d0 con 0x7f2a6c06fe40 2024-09-13T15:01:42.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a63400640 1 -- 172.21.15.7:0/3405544130 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c005430 con 0x7f2a6c06fe40 2024-09-13T15:01:42.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a71400640 1 -- 172.21.15.7:0/3405544130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6c06f810 con 0x7f2a6c06fe40 2024-09-13T15:01:42.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a63400640 1 -- 172.21.15.7:0/3405544130 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c012870 con 0x7f2a6c06fe40 2024-09-13T15:01:42.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a71400640 1 -- 172.21.15.7:0/3405544130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6c15b600 con 0x7f2a6c06fe40 2024-09-13T15:01:42.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.260+0000 7f2a71400640 1 -- 172.21.15.7:0/3405544130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6c159220 con 0x7f2a6c06fe40 2024-09-13T15:01:42.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.264+0000 7f2a63400640 1 -- 172.21.15.7:0/3405544130 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7f2a5c0129d0 con 0x7f2a6c06fe40 2024-09-13T15:01:42.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.264+0000 7f2a63400640 1 --2- 172.21.15.7:0/3405544130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2a48066600 0x7f2a48068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:42.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.264+0000 7f2a63400640 1 -- 172.21.15.7:0/3405544130 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2a5c083760 con 0x7f2a6c06fe40 2024-09-13T15:01:42.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.264+0000 7f2a61e00640 1 --2- 172.21.15.7:0/3405544130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2a48066600 0x7f2a48068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:42.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.264+0000 7f2a61e00640 1 --2- 172.21.15.7:0/3405544130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2a48066600 0x7f2a48068ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2a540ad000 tx=0x7f2a54008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:42.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.268+0000 7f2a63400640 1 -- 172.21.15.7:0/3405544130 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2a5c051020 con 0x7f2a6c06fe40 2024-09-13T15:01:42.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.436+0000 7f2a71400640 1 -- 172.21.15.7:0/3405544130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a6c0c9db0 con 0x7f2a6c06fe40 2024-09-13T15:01:42.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.436+0000 7f2a63400640 1 -- 172.21.15.7:0/3405544130 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a5c054640 con 0x7f2a6c06fe40 2024-09-13T15:01:42.437 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T15:01:42.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.436+0000 7f2a71400640 1 -- 172.21.15.7:0/3405544130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2a48066600 msgr2=0x7f2a48068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.436+0000 7f2a71400640 1 --2- 172.21.15.7:0/3405544130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2a48066600 0x7f2a48068ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2a540ad000 tx=0x7f2a54008040 comp rx=0 tx=0).stop 2024-09-13T15:01:42.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.436+0000 7f2a71400640 1 -- 172.21.15.7:0/3405544130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a6c06fe40 msgr2=0x7f2a6c157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.436+0000 7f2a71400640 1 --2- 172.21.15.7:0/3405544130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a6c06fe40 0x7f2a6c157a50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00c480 tx=0x7f2a5c00c940 comp rx=0 tx=0).stop 2024-09-13T15:01:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.436+0000 7f2a71400640 1 -- 172.21.15.7:0/3405544130 shutdown_connections 2024-09-13T15:01:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.436+0000 7f2a71400640 1 --2- 172.21.15.7:0/3405544130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2a48066600 0x7f2a48068ac0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.436+0000 7f2a71400640 1 --2- 172.21.15.7:0/3405544130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a6c153380 0x7f2a6c0cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.436+0000 7f2a71400640 1 --2- 172.21.15.7:0/3405544130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a6c0c7c40 0x7f2a6c157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.436+0000 7f2a71400640 1 --2- 172.21.15.7:0/3405544130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a6c06fe40 0x7f2a6c157a50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.436+0000 7f2a71400640 1 -- 172.21.15.7:0/3405544130 >> 172.21.15.7:0/3405544130 conn(0x7f2a6c065d40 msgr2=0x7f2a6c150e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.436+0000 7f2a71400640 1 -- 172.21.15.7:0/3405544130 shutdown_connections 2024-09-13T15:01:42.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.436+0000 7f2a71400640 1 -- 172.21.15.7:0/3405544130 wait complete. 2024-09-13T15:01:42.458 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T15:01:42.580 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:01:42.584 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:01:42.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.596+0000 7f918e200640 1 Processor -- start 2024-09-13T15:01:42.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.596+0000 7f918e200640 1 -- start start 2024-09-13T15:01:42.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.596+0000 7f918e200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91880c3b30 0x7f918815c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:42.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.596+0000 7f918e200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91880c79c0 con 0x7f91880c9890 2024-09-13T15:01:42.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.596+0000 7f918e200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918806bca0 con 0x7f918806e530 2024-09-13T15:01:42.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.596+0000 7f918e200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918806af70 con 0x7f91880c3b30 2024-09-13T15:01:42.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.596+0000 7f9187400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f91880c9890 0x7f9188159110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44196/0 (socket says 172.21.15.7:44196) 2024-09-13T15:01:42.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.596+0000 7f917fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91880c3b30 0x7f918815c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:42.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.596+0000 7f9187400640 1 -- 172.21.15.7:0/3750430708 learned_addr learned my addr 172.21.15.7:0/3750430708 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:01:42.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.596+0000 7f9187e00640 1 --1- 172.21.15.7:0/3750430708 >> v1:172.21.15.77:6789/0 conn(0x7f918806e530 0x7f9188159820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:39702/0 (socket says 172.21.15.7:39702) 2024-09-13T15:01:42.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.596+0000 7f917fe00640 1 -- 172.21.15.7:0/3750430708 >> v1:172.21.15.77:6789/0 conn(0x7f918806e530 legacy=0x7f9188159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.596+0000 7f917fe00640 1 -- 172.21.15.7:0/3750430708 >> v1:172.21.15.7:6789/0 conn(0x7f91880c9890 legacy=0x7f9188159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.596+0000 7f917fe00640 1 -- 172.21.15.7:0/3750430708 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9188069fd0 con 0x7f91880c3b30 2024-09-13T15:01:42.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.600+0000 7f917fe00640 1 --2- 172.21.15.7:0/3750430708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91880c3b30 0x7f918815c680 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f91700097f0 tx=0x7f917001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f85f4bee0f6a8db3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:42.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.600+0000 7f9186a00640 1 -- 172.21.15.7:0/3750430708 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91700ab5f0 con 0x7f91880c3b30 2024-09-13T15:01:42.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.600+0000 7f9186a00640 1 -- 172.21.15.7:0/3750430708 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91700ab750 con 0x7f91880c3b30 2024-09-13T15:01:42.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.600+0000 7f9186a00640 1 -- 172.21.15.7:0/3750430708 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91700abae0 con 0x7f91880c3b30 2024-09-13T15:01:42.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.600+0000 7f918e200640 1 -- 172.21.15.7:0/3750430708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91880c3b30 msgr2=0x7f918815c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.600+0000 7f918e200640 1 --2- 172.21.15.7:0/3750430708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91880c3b30 0x7f918815c680 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f91700097f0 tx=0x7f917001c4e0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.600+0000 7f918e200640 1 -- 172.21.15.7:0/3750430708 shutdown_connections 2024-09-13T15:01:42.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.600+0000 7f918e200640 1 --2- 172.21.15.7:0/3750430708 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91880c3b30 0x7f918815c680 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.600+0000 7f918e200640 1 -- 172.21.15.7:0/3750430708 >> 172.21.15.7:0/3750430708 conn(0x7f9188071730 msgr2=0x7f9188071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:42.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.600+0000 7f918e200640 1 -- 172.21.15.7:0/3750430708 shutdown_connections 2024-09-13T15:01:42.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.600+0000 7f918e200640 1 -- 172.21.15.7:0/3750430708 wait complete. 2024-09-13T15:01:42.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f918e200640 1 Processor -- start 2024-09-13T15:01:42.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f918e200640 1 -- start start 2024-09-13T15:01:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f918e200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f918806e530 0x7f91881473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f918e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91880c3b30 0x7f9188158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f918e200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91880c9890 0x7f91881436a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f918e200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91880ccb90 con 0x7f91880c3b30 2024-09-13T15:01:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f918e200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9188146990 con 0x7f91880c9890 2024-09-13T15:01:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f918e200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9188146f50 con 0x7f918806e530 2024-09-13T15:01:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f9187400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f918806e530 0x7f91881473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f917fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91880c3b30 0x7f9188158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f9187400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f918806e530 0x7f91881473e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:37708/0 (socket says 172.21.15.7:37708) 2024-09-13T15:01:42.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f9187400640 1 -- 172.21.15.7:0/2481953442 learned_addr learned my addr 172.21.15.7:0/2481953442 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:42.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f9187e00640 1 --2- 172.21.15.7:0/2481953442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91880c9890 0x7f91881436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:42.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f9187400640 1 -- 172.21.15.7:0/2481953442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91880c9890 msgr2=0x7f91881436a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f9187400640 1 --2- 172.21.15.7:0/2481953442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91880c9890 0x7f91881436a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f9187400640 1 -- 172.21.15.7:0/2481953442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91880c3b30 msgr2=0x7f9188158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f9187400640 1 --2- 172.21.15.7:0/2481953442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91880c3b30 0x7f9188158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f9187400640 1 -- 172.21.15.7:0/2481953442 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9170009420 con 0x7f918806e530 2024-09-13T15:01:42.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f9187400640 1 --2- 172.21.15.7:0/2481953442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f918806e530 0x7f91881473e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f917800c530 tx=0x7f917800c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:42.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f917f400640 1 -- 172.21.15.7:0/2481953442 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178005cf0 con 0x7f918806e530 2024-09-13T15:01:42.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f917f400640 1 -- 172.21.15.7:0/2481953442 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9178005e50 con 0x7f918806e530 2024-09-13T15:01:42.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f917f400640 1 -- 172.21.15.7:0/2481953442 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9178007270 con 0x7f918806e530 2024-09-13T15:01:42.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f918e200640 1 -- 172.21.15.7:0/2481953442 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91880cdb20 con 0x7f918806e530 2024-09-13T15:01:42.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.604+0000 7f918e200640 1 -- 172.21.15.7:0/2481953442 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91881f3110 con 0x7f918806e530 2024-09-13T15:01:42.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.608+0000 7f918e200640 1 -- 172.21.15.7:0/2481953442 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9188067650 con 0x7f918806e530 2024-09-13T15:01:42.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.608+0000 7f917f400640 1 -- 172.21.15.7:0/2481953442 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7f91780073d0 con 0x7f918806e530 2024-09-13T15:01:42.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.608+0000 7f917f400640 1 --2- 172.21.15.7:0/2481953442 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9164066630 0x7f9164068af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:42.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.608+0000 7f917f400640 1 -- 172.21.15.7:0/2481953442 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9178083280 con 0x7f918806e530 2024-09-13T15:01:42.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.608+0000 7f917fe00640 1 --2- 172.21.15.7:0/2481953442 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9164066630 0x7f9164068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:42.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.608+0000 7f917fe00640 1 --2- 172.21.15.7:0/2481953442 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9164066630 0x7f9164068af0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f91700af000 tx=0x7f91700a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:42.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.612+0000 7f917f400640 1 -- 172.21.15.7:0/2481953442 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9178050a30 con 0x7f918806e530 2024-09-13T15:01:42.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.780+0000 7f918e200640 1 -- 172.21.15.7:0/2481953442 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f918815c680 con 0x7f918806e530 2024-09-13T15:01:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.780+0000 7f917f400640 1 -- 172.21.15.7:0/2481953442 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9178017090 con 0x7f918806e530 2024-09-13T15:01:42.782 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:01:42.782 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-09-13T15:01:42.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-13T15:01:42.782 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-09-13T15:01:42.782 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-09-13T15:01:42.782 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T15:01:42.782 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-09-13T15:01:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.780+0000 7f918e200640 1 -- 172.21.15.7:0/2481953442 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9164066630 msgr2=0x7f9164068af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.780+0000 7f918e200640 1 --2- 172.21.15.7:0/2481953442 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9164066630 0x7f9164068af0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f91700af000 tx=0x7f91700a7000 comp rx=0 tx=0).stop 2024-09-13T15:01:42.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.780+0000 7f918e200640 1 -- 172.21.15.7:0/2481953442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f918806e530 msgr2=0x7f91881473e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.780+0000 7f918e200640 1 --2- 172.21.15.7:0/2481953442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f918806e530 0x7f91881473e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f917800c530 tx=0x7f917800c9f0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.784+0000 7f918e200640 1 -- 172.21.15.7:0/2481953442 shutdown_connections 2024-09-13T15:01:42.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.784+0000 7f918e200640 1 --2- 172.21.15.7:0/2481953442 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9164066630 0x7f9164068af0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.784+0000 7f918e200640 1 --2- 172.21.15.7:0/2481953442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91880c9890 0x7f91881436a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.784+0000 7f918e200640 1 --2- 172.21.15.7:0/2481953442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f91880c3b30 0x7f9188158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.784+0000 7f918e200640 1 --2- 172.21.15.7:0/2481953442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f918806e530 0x7f91881473e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.784+0000 7f918e200640 1 -- 172.21.15.7:0/2481953442 >> 172.21.15.7:0/2481953442 conn(0x7f9188071730 msgr2=0x7f9188071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:42.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.784+0000 7f918e200640 1 -- 172.21.15.7:0/2481953442 shutdown_connections 2024-09-13T15:01:42.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.784+0000 7f918e200640 1 -- 172.21.15.7:0/2481953442 wait complete. 2024-09-13T15:01:42.805 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T15:01:42.805 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T15:01:42.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.948+0000 7fd4cf400640 1 Processor -- start 2024-09-13T15:01:42.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.948+0000 7fd4cf400640 1 -- start start 2024-09-13T15:01:42.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.948+0000 7fd4cf400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd4c814faf0 0x7fd4c806cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:42.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.948+0000 7fd4cf400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd4c8071530 0x7fd4c81555b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:42.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.948+0000 7fd4cf400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c8070440 con 0x7fd4c8155af0 2024-09-13T15:01:42.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.948+0000 7fd4cf400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c8071110 con 0x7fd4c8071530 2024-09-13T15:01:42.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.948+0000 7fd4cf400640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c8070800 con 0x7fd4c814faf0 2024-09-13T15:01:42.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.948+0000 7fd4c7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd4c8071530 0x7fd4c81555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:42.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.948+0000 7fd4cd400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd4c8155af0 0x7fd4c80c5b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44208/0 (socket says 172.21.15.7:44208) 2024-09-13T15:01:42.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.948+0000 7fd4cd400640 1 -- 172.21.15.7:0/4124947288 learned_addr learned my addr 172.21.15.7:0/4124947288 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:01:42.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.948+0000 7fd4cca00640 1 --2- 172.21.15.7:0/4124947288 >> v2:172.21.15.77:3300/0 conn(0x7fd4c814faf0 0x7fd4c806cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:42.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.948+0000 7fd4c7e00640 1 -- 172.21.15.7:0/4124947288 >> v2:172.21.15.77:3300/0 conn(0x7fd4c814faf0 msgr2=0x7fd4c806cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:42.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.948+0000 7fd4c7e00640 1 --2- 172.21.15.7:0/4124947288 >> v2:172.21.15.77:3300/0 conn(0x7fd4c814faf0 0x7fd4c806cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.948+0000 7fd4c7e00640 1 -- 172.21.15.7:0/4124947288 >> v1:172.21.15.7:6789/0 conn(0x7fd4c8155af0 legacy=0x7fd4c80c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.948+0000 7fd4c7e00640 1 -- 172.21.15.7:0/4124947288 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c806d2e0 con 0x7fd4c8071530 2024-09-13T15:01:42.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.948+0000 7fd4c7400640 1 -- 172.21.15.7:0/4124947288 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145865105 0 0) 0x7fd4c00014a0 con 0x7fd4c8155af0 2024-09-13T15:01:42.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.952+0000 7fd4c7e00640 1 --2- 172.21.15.7:0/4124947288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4c8071530 0x7fd4c81555b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8066e20 tx=0x7fd4b401d850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb7b5bd6d1c4c87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:42.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.952+0000 7fd4c7400640 1 -- 172.21.15.7:0/4124947288 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40a67f0 con 0x7fd4c8071530 2024-09-13T15:01:42.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.952+0000 7fd4c7400640 1 -- 172.21.15.7:0/4124947288 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b40a6950 con 0x7fd4c8071530 2024-09-13T15:01:42.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.952+0000 7fd4c7400640 1 -- 172.21.15.7:0/4124947288 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40a6ce0 con 0x7fd4c8071530 2024-09-13T15:01:42.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.952+0000 7fd4cf400640 1 -- 172.21.15.7:0/4124947288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4c8071530 msgr2=0x7fd4c81555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.952+0000 7fd4cf400640 1 --2- 172.21.15.7:0/4124947288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4c8071530 0x7fd4c81555b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd4c8066e20 tx=0x7fd4b401d850 comp rx=0 tx=0).stop 2024-09-13T15:01:42.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.952+0000 7fd4cf400640 1 -- 172.21.15.7:0/4124947288 shutdown_connections 2024-09-13T15:01:42.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.952+0000 7fd4cf400640 1 --2- 172.21.15.7:0/4124947288 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4c8071530 0x7fd4c81555b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.952+0000 7fd4cf400640 1 --2- 172.21.15.7:0/4124947288 >> v2:172.21.15.77:3300/0 conn(0x7fd4c814faf0 0x7fd4c806cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.952+0000 7fd4cf400640 1 -- 172.21.15.7:0/4124947288 >> 172.21.15.7:0/4124947288 conn(0x7fd4c80c7c50 msgr2=0x7fd4c80c8060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:42.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.952+0000 7fd4cf400640 1 -- 172.21.15.7:0/4124947288 shutdown_connections 2024-09-13T15:01:42.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.952+0000 7fd4cf400640 1 -- 172.21.15.7:0/4124947288 wait complete. 2024-09-13T15:01:42.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4cf400640 1 Processor -- start 2024-09-13T15:01:42.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4cf400640 1 -- start start 2024-09-13T15:01:42.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4cf400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4c8071530 0x7fd4c806d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:42.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4cf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4c814faf0 0x7fd4c81515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:42.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4cf400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4c8155af0 0x7fd4c8151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:42.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4cf400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c81429a0 con 0x7fd4c814faf0 2024-09-13T15:01:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4cf400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c8142f20 con 0x7fd4c8155af0 2024-09-13T15:01:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4cf400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c81f5970 con 0x7fd4c8071530 2024-09-13T15:01:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4c7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4c814faf0 0x7fd4c81515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4c7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4c814faf0 0x7fd4c81515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44906/0 (socket says 172.21.15.7:44906) 2024-09-13T15:01:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4c7e00640 1 -- 172.21.15.7:0/1115627754 learned_addr learned my addr 172.21.15.7:0/1115627754 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4cd400640 1 --2- 172.21.15.7:0/1115627754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4c8155af0 0x7fd4c8151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4cca00640 1 --2- 172.21.15.7:0/1115627754 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4c8071530 0x7fd4c806d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4c7e00640 1 -- 172.21.15.7:0/1115627754 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4c8071530 msgr2=0x7fd4c806d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4c7e00640 1 --2- 172.21.15.7:0/1115627754 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4c8071530 0x7fd4c806d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4c7e00640 1 -- 172.21.15.7:0/1115627754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4c8155af0 msgr2=0x7fd4c8151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4c7e00640 1 --2- 172.21.15.7:0/1115627754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4c8155af0 0x7fd4c8151b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:42.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4c7e00640 1 -- 172.21.15.7:0/1115627754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b400a5c0 con 0x7fd4c814faf0 2024-09-13T15:01:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4c7e00640 1 --2- 172.21.15.7:0/1115627754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4c814faf0 0x7fd4c81515c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40b1040 tx=0x7fd4b401a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4c4c00640 1 -- 172.21.15.7:0/1115627754 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40ae850 con 0x7fd4c814faf0 2024-09-13T15:01:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4c4c00640 1 -- 172.21.15.7:0/1115627754 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b40ae9d0 con 0x7fd4c814faf0 2024-09-13T15:01:42.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4c4c00640 1 -- 172.21.15.7:0/1115627754 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40aed80 con 0x7fd4c814faf0 2024-09-13T15:01:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4cf400640 1 -- 172.21.15.7:0/1115627754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c8142c40 con 0x7fd4c814faf0 2024-09-13T15:01:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4cf400640 1 -- 172.21.15.7:0/1115627754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c81f5c50 con 0x7fd4c814faf0 2024-09-13T15:01:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.956+0000 7fd4cf400640 1 -- 172.21.15.7:0/1115627754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c8073850 con 0x7fd4c814faf0 2024-09-13T15:01:42.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.960+0000 7fd4c4c00640 1 -- 172.21.15.7:0/1115627754 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7fd4b40b5040 con 0x7fd4c814faf0 2024-09-13T15:01:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.960+0000 7fd4c4c00640 1 --2- 172.21.15.7:0/1115627754 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd4a8066600 0x7fd4a8068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.960+0000 7fd4c4c00640 1 -- 172.21.15.7:0/1115627754 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd4b411f100 con 0x7fd4c814faf0 2024-09-13T15:01:42.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.960+0000 7fd4cca00640 1 --2- 172.21.15.7:0/1115627754 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd4a8066600 0x7fd4a8068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:42.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.960+0000 7fd4cca00640 1 --2- 172.21.15.7:0/1115627754 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd4a8066600 0x7fd4a8068ac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009a30 tx=0x7fd4bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:42.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:42.964+0000 7fd4c4c00640 1 -- 172.21.15.7:0/1115627754 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd4b40ec9a0 con 0x7fd4c814faf0 2024-09-13T15:01:43.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.132+0000 7fd4cf400640 1 -- 172.21.15.7:0/1115627754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd4c806e560 con 0x7fd4c814faf0 2024-09-13T15:01:43.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.372+0000 7fd4c4c00640 1 -- 172.21.15.7:0/1115627754 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd4b40ecd70 con 0x7fd4c814faf0 2024-09-13T15:01:43.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.372+0000 7fd4c4c00640 1 -- 172.21.15.7:0/1115627754 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd4b40f0430 con 0x7fd4c814faf0 2024-09-13T15:01:43.374 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-09-13T15:01:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.372+0000 7fd4cf400640 1 -- 172.21.15.7:0/1115627754 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd4a8066600 msgr2=0x7fd4a8068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.372+0000 7fd4cf400640 1 --2- 172.21.15.7:0/1115627754 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd4a8066600 0x7fd4a8068ac0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009a30 tx=0x7fd4bc008040 comp rx=0 tx=0).stop 2024-09-13T15:01:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.372+0000 7fd4cf400640 1 -- 172.21.15.7:0/1115627754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4c814faf0 msgr2=0x7fd4c81515c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.372+0000 7fd4cf400640 1 --2- 172.21.15.7:0/1115627754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4c814faf0 0x7fd4c81515c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40b1040 tx=0x7fd4b401a5f0 comp rx=0 tx=0).stop 2024-09-13T15:01:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.372+0000 7fd4cf400640 1 -- 172.21.15.7:0/1115627754 shutdown_connections 2024-09-13T15:01:43.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.372+0000 7fd4cf400640 1 --2- 172.21.15.7:0/1115627754 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd4a8066600 0x7fd4a8068ac0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.372+0000 7fd4cf400640 1 --2- 172.21.15.7:0/1115627754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4c8155af0 0x7fd4c8151b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.372+0000 7fd4cf400640 1 --2- 172.21.15.7:0/1115627754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4c814faf0 0x7fd4c81515c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.372+0000 7fd4cf400640 1 --2- 172.21.15.7:0/1115627754 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd4c8071530 0x7fd4c806d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.372+0000 7fd4cf400640 1 -- 172.21.15.7:0/1115627754 >> 172.21.15.7:0/1115627754 conn(0x7fd4c80c7c50 msgr2=0x7fd4c814d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.372+0000 7fd4cf400640 1 -- 172.21.15.7:0/1115627754 shutdown_connections 2024-09-13T15:01:43.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.372+0000 7fd4cf400640 1 -- 172.21.15.7:0/1115627754 wait complete. 2024-09-13T15:01:43.402 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-13T15:01:43.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.544+0000 7fc11f600640 1 Processor -- start 2024-09-13T15:01:43.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.544+0000 7fc11f600640 1 -- start start 2024-09-13T15:01:43.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.548+0000 7fc11f600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc118153380 0x7fc1180cca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:43.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.548+0000 7fc11f600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1180c7c40 0x7fc1180ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:43.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.548+0000 7fc11f600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11815c760 con 0x7fc11806fe40 2024-09-13T15:01:43.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.548+0000 7fc11f600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11815d3e0 con 0x7fc1180c7c40 2024-09-13T15:01:43.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.548+0000 7fc11f600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11806fa40 con 0x7fc118153380 2024-09-13T15:01:43.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.548+0000 7fc117e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1180c7c40 0x7fc1180ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:43.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.548+0000 7fc11d600640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc11806fe40 0x7fc118159220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44218/0 (socket says 172.21.15.7:44218) 2024-09-13T15:01:43.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.548+0000 7fc11d600640 1 -- 172.21.15.7:0/3901823939 learned_addr learned my addr 172.21.15.7:0/3901823939 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:01:43.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.548+0000 7fc117e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1180c7c40 0x7fc1180ccfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44918/0 (socket says 172.21.15.7:44918) 2024-09-13T15:01:43.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.548+0000 7fc11cc00640 1 --2- 172.21.15.7:0/3901823939 >> v2:172.21.15.77:3300/0 conn(0x7fc118153380 0x7fc1180cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:43.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.548+0000 7fc117e00640 1 -- 172.21.15.7:0/3901823939 >> v2:172.21.15.77:3300/0 conn(0x7fc118153380 msgr2=0x7fc1180cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:43.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.548+0000 7fc117e00640 1 --2- 172.21.15.7:0/3901823939 >> v2:172.21.15.77:3300/0 conn(0x7fc118153380 0x7fc1180cca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:43.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.548+0000 7fc117e00640 1 -- 172.21.15.7:0/3901823939 >> v1:172.21.15.7:6789/0 conn(0x7fc11806fe40 legacy=0x7fc118159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:43.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.548+0000 7fc117e00640 1 -- 172.21.15.7:0/3901823939 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11815ca40 con 0x7fc1180c7c40 2024-09-13T15:01:43.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.548+0000 7fc117400640 1 -- 172.21.15.7:0/3901823939 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195979665 0 0) 0x7fc11815c760 con 0x7fc11806fe40 2024-09-13T15:01:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.552+0000 7fc117e00640 1 --2- 172.21.15.7:0/3901823939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1180c7c40 0x7fc1180ccfa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc1180ca6f0 tx=0x7fc10401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8c5fb8cb8f6a87b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.552+0000 7fc117400640 1 -- 172.21.15.7:0/3901823939 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1040ab650 con 0x7fc1180c7c40 2024-09-13T15:01:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.552+0000 7fc117400640 1 -- 172.21.15.7:0/3901823939 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1040ab7b0 con 0x7fc1180c7c40 2024-09-13T15:01:43.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.552+0000 7fc117400640 1 -- 172.21.15.7:0/3901823939 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1040abb40 con 0x7fc1180c7c40 2024-09-13T15:01:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.552+0000 7fc11f600640 1 -- 172.21.15.7:0/3901823939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1180c7c40 msgr2=0x7fc1180ccfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.552+0000 7fc11f600640 1 --2- 172.21.15.7:0/3901823939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1180c7c40 0x7fc1180ccfa0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc1180ca6f0 tx=0x7fc10401c450 comp rx=0 tx=0).stop 2024-09-13T15:01:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.552+0000 7fc11f600640 1 -- 172.21.15.7:0/3901823939 shutdown_connections 2024-09-13T15:01:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.552+0000 7fc11f600640 1 --2- 172.21.15.7:0/3901823939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1180c7c40 0x7fc1180ccfa0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.552+0000 7fc11f600640 1 --2- 172.21.15.7:0/3901823939 >> v2:172.21.15.77:3300/0 conn(0x7fc118153380 0x7fc1180cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.552+0000 7fc11f600640 1 -- 172.21.15.7:0/3901823939 >> 172.21.15.7:0/3901823939 conn(0x7fc118065d40 msgr2=0x7fc118066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.552+0000 7fc11f600640 1 -- 172.21.15.7:0/3901823939 shutdown_connections 2024-09-13T15:01:43.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.552+0000 7fc11f600640 1 -- 172.21.15.7:0/3901823939 wait complete. 2024-09-13T15:01:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.552+0000 7fc11f600640 1 Processor -- start 2024-09-13T15:01:43.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.552+0000 7fc11f600640 1 -- start start 2024-09-13T15:01:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11f600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc11806fe40 0x7fc11806b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11f600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1180c7c40 0x7fc1181f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11f600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc118153380 0x7fc11814c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:43.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11f600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1180c4fb0 con 0x7fc11806fe40 2024-09-13T15:01:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11f600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1180c5af0 con 0x7fc1180c7c40 2024-09-13T15:01:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11f600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11814f040 con 0x7fc118153380 2024-09-13T15:01:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc11806fe40 0x7fc11806b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc11806fe40 0x7fc11806b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44934/0 (socket says 172.21.15.7:44934) 2024-09-13T15:01:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11cc00640 1 -- 172.21.15.7:0/3240820858 learned_addr learned my addr 172.21.15.7:0/3240820858 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc117e00640 1 --2- 172.21.15.7:0/3240820858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1180c7c40 0x7fc1181f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11d600640 1 --2- 172.21.15.7:0/3240820858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc118153380 0x7fc11814c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11cc00640 1 -- 172.21.15.7:0/3240820858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc118153380 msgr2=0x7fc11814c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11cc00640 1 --2- 172.21.15.7:0/3240820858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc118153380 0x7fc11814c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:43.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11cc00640 1 -- 172.21.15.7:0/3240820858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1180c7c40 msgr2=0x7fc1181f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11cc00640 1 --2- 172.21.15.7:0/3240820858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1180c7c40 0x7fc1181f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11cc00640 1 -- 172.21.15.7:0/3240820858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc104009420 con 0x7fc11806fe40 2024-09-13T15:01:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11cc00640 1 --2- 172.21.15.7:0/3240820858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc11806fe40 0x7fc11806b930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00e990 tx=0x7fc10c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc114c00640 1 -- 172.21.15.7:0/3240820858 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c009690 con 0x7fc11806fe40 2024-09-13T15:01:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc114c00640 1 -- 172.21.15.7:0/3240820858 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c00c9e0 con 0x7fc11806fe40 2024-09-13T15:01:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc114c00640 1 -- 172.21.15.7:0/3240820858 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c00cd50 con 0x7fc11806fe40 2024-09-13T15:01:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11f600640 1 -- 172.21.15.7:0/3240820858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11806f810 con 0x7fc11806fe40 2024-09-13T15:01:43.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11f600640 1 -- 172.21.15.7:0/3240820858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1180c4930 con 0x7fc11806fe40 2024-09-13T15:01:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc11f600640 1 -- 172.21.15.7:0/3240820858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1180c6cf0 con 0x7fc11806fe40 2024-09-13T15:01:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.556+0000 7fc114c00640 1 -- 172.21.15.7:0/3240820858 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc10c013470 con 0x7fc11806fe40 2024-09-13T15:01:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.560+0000 7fc114c00640 1 --2- 172.21.15.7:0/3240820858 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc0f8066690 0x7fc0f8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.560+0000 7fc114c00640 1 -- 172.21.15.7:0/3240820858 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc10c0842e0 con 0x7fc11806fe40 2024-09-13T15:01:43.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.560+0000 7fc117e00640 1 --2- 172.21.15.7:0/3240820858 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc0f8066690 0x7fc0f8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:43.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.560+0000 7fc117e00640 1 --2- 172.21.15.7:0/3240820858 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc0f8066690 0x7fc0f8068b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1040af000 tx=0x7fc1040a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:43.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.564+0000 7fc114c00640 1 -- 172.21.15.7:0/3240820858 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc10c051790 con 0x7fc11806fe40 2024-09-13T15:01:43.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:43.728+0000 7fc11f600640 1 -- 172.21.15.7:0/3240820858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fc118159220 con 0x7fc11806fe40 2024-09-13T15:01:44.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.376+0000 7fc114c00640 1 -- 172.21.15.7:0/3240820858 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7fc10c054db0 con 0x7fc11806fe40 2024-09-13T15:01:44.381 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-09-13T15:01:44.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.384+0000 7fc11f600640 1 -- 172.21.15.7:0/3240820858 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc0f8066690 msgr2=0x7fc0f8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.384+0000 7fc11f600640 1 --2- 172.21.15.7:0/3240820858 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc0f8066690 0x7fc0f8068b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1040af000 tx=0x7fc1040a7000 comp rx=0 tx=0).stop 2024-09-13T15:01:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.384+0000 7fc11f600640 1 -- 172.21.15.7:0/3240820858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc11806fe40 msgr2=0x7fc11806b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.384+0000 7fc11f600640 1 --2- 172.21.15.7:0/3240820858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc11806fe40 0x7fc11806b930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc10c00e990 tx=0x7fc10c00ee50 comp rx=0 tx=0).stop 2024-09-13T15:01:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.388+0000 7fc11f600640 1 -- 172.21.15.7:0/3240820858 shutdown_connections 2024-09-13T15:01:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.388+0000 7fc11f600640 1 --2- 172.21.15.7:0/3240820858 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc0f8066690 0x7fc0f8068b50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.388+0000 7fc11f600640 1 --2- 172.21.15.7:0/3240820858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc118153380 0x7fc11814c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.388+0000 7fc11f600640 1 --2- 172.21.15.7:0/3240820858 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1180c7c40 0x7fc1181f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.388+0000 7fc11f600640 1 --2- 172.21.15.7:0/3240820858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc11806fe40 0x7fc11806b930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.388+0000 7fc11f600640 1 -- 172.21.15.7:0/3240820858 >> 172.21.15.7:0/3240820858 conn(0x7fc118065d40 msgr2=0x7fc118151650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:44.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.388+0000 7fc11f600640 1 -- 172.21.15.7:0/3240820858 shutdown_connections 2024-09-13T15:01:44.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.388+0000 7fc11f600640 1 -- 172.21.15.7:0/3240820858 wait complete. 2024-09-13T15:01:44.423 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T15:01:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.568+0000 7f2187e00640 1 Processor -- start 2024-09-13T15:01:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.568+0000 7f2187e00640 1 -- start start 2024-09-13T15:01:44.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.568+0000 7f2187e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f21800c5ce0 0x7f2180156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.568+0000 7f2187e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21800c6880 con 0x7f218014fdd0 2024-09-13T15:01:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.568+0000 7f2187e00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21800721e0 con 0x7f21801501b0 2024-09-13T15:01:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.568+0000 7f2187e00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f218006f860 con 0x7f21800c5ce0 2024-09-13T15:01:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f2185400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f218014fdd0 0x7f21800c7420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44234/0 (socket says 172.21.15.7:44234) 2024-09-13T15:01:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f2185400640 1 -- 172.21.15.7:0/995381734 learned_addr learned my addr 172.21.15.7:0/995381734 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:01:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f2185e00640 1 --2- 172.21.15.7:0/995381734 >> v2:172.21.15.77:3300/0 conn(0x7f21800c5ce0 0x7f2180156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f217fe00640 1 -- 172.21.15.7:0/995381734 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150867688 0 0) 0x7f21800c6880 con 0x7f218014fdd0 2024-09-13T15:01:44.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f217fe00640 1 -- 172.21.15.7:0/995381734 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2168005740 con 0x7f218014fdd0 2024-09-13T15:01:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f217fe00640 1 -- 172.21.15.7:0/995381734 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 697389268 0 0) 0x7f2168005740 con 0x7f218014fdd0 2024-09-13T15:01:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f217fe00640 1 -- 172.21.15.7:0/995381734 >> v2:172.21.15.77:3300/0 conn(0x7f21800c5ce0 msgr2=0x7f2180156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f217fe00640 1 --2- 172.21.15.7:0/995381734 >> v2:172.21.15.77:3300/0 conn(0x7f21800c5ce0 0x7f2180156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f217fe00640 1 -- 172.21.15.7:0/995381734 >> v1:172.21.15.77:6789/0 conn(0x7f21801501b0 legacy=0x7f21800c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f217fe00640 1 -- 172.21.15.7:0/995381734 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21800c6ad0 con 0x7f218014fdd0 2024-09-13T15:01:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f217fe00640 1 -- 172.21.15.7:0/995381734 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f2174001680 con 0x7f218014fdd0 2024-09-13T15:01:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f217fe00640 1 -- 172.21.15.7:0/995381734 >> v1:172.21.15.7:6789/0 conn(0x7f218014fdd0 legacy=0x7f21800c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f217fe00640 1 --2- 172.21.15.7:0/995381734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2168005b90 0x7f2168005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f217fe00640 1 --2- 172.21.15.7:0/995381734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21680069e0 0x7f2168006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:44.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f217fe00640 1 --2- 172.21.15.7:0/995381734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21680073a0 0x7f216800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f217fe00640 1 -- 172.21.15.7:0/995381734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f218006f860 con 0x7f2168005b90 2024-09-13T15:01:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f217fe00640 1 -- 172.21.15.7:0/995381734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216800e240 con 0x7f21680069e0 2024-09-13T15:01:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f217fe00640 1 -- 172.21.15.7:0/995381734 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216800e400 con 0x7f21680073a0 2024-09-13T15:01:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f2185400640 1 --2- 172.21.15.7:0/995381734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2168005b90 0x7f2168005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f2184a00640 1 --2- 172.21.15.7:0/995381734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21680069e0 0x7f2168006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f2185e00640 1 --2- 172.21.15.7:0/995381734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21680073a0 0x7f216800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f2185400640 1 -- 172.21.15.7:0/995381734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21680073a0 msgr2=0x7f216800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f2185400640 1 --2- 172.21.15.7:0/995381734 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21680073a0 0x7f216800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f2185400640 1 -- 172.21.15.7:0/995381734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21680069e0 msgr2=0x7f2168006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f2185400640 1 --2- 172.21.15.7:0/995381734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21680069e0 0x7f2168006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f2185400640 1 -- 172.21.15.7:0/995381734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2168005740 con 0x7f2168005b90 2024-09-13T15:01:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f2184a00640 1 --2- 172.21.15.7:0/995381734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21680069e0 0x7f2168006e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.572+0000 7f2185e00640 1 -- 172.21.15.7:0/995381734 reap_dead start 2024-09-13T15:01:44.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.576+0000 7f2185400640 1 --2- 172.21.15.7:0/995381734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2168005b90 0x7f2168005fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f217400c1c0 tx=0x7f217401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2226f3c94e02f96e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:44.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.576+0000 7f217fe00640 1 -- 172.21.15.7:0/995381734 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2174005ae0 con 0x7f2168005b90 2024-09-13T15:01:44.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.576+0000 7f217fe00640 1 -- 172.21.15.7:0/995381734 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2174005c40 con 0x7f2168005b90 2024-09-13T15:01:44.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.576+0000 7f217fe00640 1 -- 172.21.15.7:0/995381734 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21740a5ae0 con 0x7f2168005b90 2024-09-13T15:01:44.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.576+0000 7f2187e00640 1 -- 172.21.15.7:0/995381734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2168005b90 msgr2=0x7f2168005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:44.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.576+0000 7f2187e00640 1 --2- 172.21.15.7:0/995381734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2168005b90 0x7f2168005fb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f217400c1c0 tx=0x7f217401cbc0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.576+0000 7f2187e00640 1 -- 172.21.15.7:0/995381734 shutdown_connections 2024-09-13T15:01:44.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.576+0000 7f2187e00640 1 --2- 172.21.15.7:0/995381734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2168005b90 0x7f2168005fb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.576+0000 7f2187e00640 1 -- 172.21.15.7:0/995381734 >> 172.21.15.7:0/995381734 conn(0x7f2180065d40 msgr2=0x7f2180066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:44.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.576+0000 7f2187e00640 1 -- 172.21.15.7:0/995381734 shutdown_connections 2024-09-13T15:01:44.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.576+0000 7f2187e00640 1 -- 172.21.15.7:0/995381734 wait complete. 2024-09-13T15:01:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.576+0000 7f2187e00640 1 Processor -- start 2024-09-13T15:01:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.576+0000 7f2187e00640 1 -- start start 2024-09-13T15:01:44.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.576+0000 7f2187e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2168005b90 0x7f218013f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:44.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2187e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2180143730 0x7f2180147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:44.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2187e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2180144320 0x7f21801e1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:44.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2187e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21801e3a50 con 0x7f2168005b90 2024-09-13T15:01:44.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2187e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2180147ad0 con 0x7f2180143730 2024-09-13T15:01:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2187e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218013fc70 con 0x7f2180144320 2024-09-13T15:01:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2185400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2168005b90 0x7f218013f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2185400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2168005b90 0x7f218013f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44966/0 (socket says 172.21.15.7:44966) 2024-09-13T15:01:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2185400640 1 -- 172.21.15.7:0/103281619 learned_addr learned my addr 172.21.15.7:0/103281619 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2184a00640 1 --2- 172.21.15.7:0/103281619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2180143730 0x7f2180147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2185e00640 1 --2- 172.21.15.7:0/103281619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2180144320 0x7f21801e1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2185400640 1 -- 172.21.15.7:0/103281619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2180144320 msgr2=0x7f21801e1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2185400640 1 --2- 172.21.15.7:0/103281619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2180144320 0x7f21801e1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2185400640 1 -- 172.21.15.7:0/103281619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2180143730 msgr2=0x7f2180147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2185400640 1 --2- 172.21.15.7:0/103281619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2180143730 0x7f2180147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2185400640 1 -- 172.21.15.7:0/103281619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2180144cf0 con 0x7f2168005b90 2024-09-13T15:01:44.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2185400640 1 --2- 172.21.15.7:0/103281619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2168005b90 0x7f218013f730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f217400c1c0 tx=0x7f2168007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:44.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f217d600640 1 -- 172.21.15.7:0/103281619 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21740b4070 con 0x7f2168005b90 2024-09-13T15:01:44.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f217d600640 1 -- 172.21.15.7:0/103281619 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2174005db0 con 0x7f2168005b90 2024-09-13T15:01:44.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f217d600640 1 -- 172.21.15.7:0/103281619 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21740a58a0 con 0x7f2168005b90 2024-09-13T15:01:44.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2187e00640 1 -- 172.21.15.7:0/103281619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21801e33e0 con 0x7f2168005b90 2024-09-13T15:01:44.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2187e00640 1 -- 172.21.15.7:0/103281619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2180147760 con 0x7f2168005b90 2024-09-13T15:01:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f2187e00640 1 -- 172.21.15.7:0/103281619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21801475c0 con 0x7f2168005b90 2024-09-13T15:01:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.580+0000 7f217d600640 1 -- 172.21.15.7:0/103281619 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f21740a5a00 con 0x7f2168005b90 2024-09-13T15:01:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.584+0000 7f217d600640 1 --2- 172.21.15.7:0/103281619 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2160066690 0x7f2160068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.584+0000 7f217d600640 1 -- 172.21.15.7:0/103281619 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f217411db70 con 0x7f2168005b90 2024-09-13T15:01:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.584+0000 7f2184a00640 1 --2- 172.21.15.7:0/103281619 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2160066690 0x7f2160068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:44.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.584+0000 7f2184a00640 1 --2- 172.21.15.7:0/103281619 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2160066690 0x7f2160068b50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f21800cb570 tx=0x7f216c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:44.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.588+0000 7f217d600640 1 -- 172.21.15.7:0/103281619 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f21740eb020 con 0x7f2168005b90 2024-09-13T15:01:44.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.784+0000 7f2187e00640 1 -- 172.21.15.7:0/103281619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f21801475c0 con 0x7f2168005b90 2024-09-13T15:01:44.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.792+0000 7f217d600640 1 -- 172.21.15.7:0/103281619 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f21801475c0 con 0x7f2168005b90 2024-09-13T15:01:44.794 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T15:01:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.796+0000 7f2187e00640 1 -- 172.21.15.7:0/103281619 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2160066690 msgr2=0x7f2160068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.796+0000 7f2187e00640 1 --2- 172.21.15.7:0/103281619 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2160066690 0x7f2160068b50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f21800cb570 tx=0x7f216c009040 comp rx=0 tx=0).stop 2024-09-13T15:01:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.796+0000 7f2187e00640 1 -- 172.21.15.7:0/103281619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2168005b90 msgr2=0x7f218013f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:44.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.796+0000 7f2187e00640 1 --2- 172.21.15.7:0/103281619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2168005b90 0x7f218013f730 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f217400c1c0 tx=0x7f2168007a10 comp rx=0 tx=0).stop 2024-09-13T15:01:44.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.800+0000 7f2187e00640 1 -- 172.21.15.7:0/103281619 shutdown_connections 2024-09-13T15:01:44.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.800+0000 7f2187e00640 1 --2- 172.21.15.7:0/103281619 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2160066690 0x7f2160068b50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.800+0000 7f2187e00640 1 --2- 172.21.15.7:0/103281619 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2180144320 0x7f21801e1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.800+0000 7f2187e00640 1 --2- 172.21.15.7:0/103281619 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2180143730 0x7f2180147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.800+0000 7f2187e00640 1 --2- 172.21.15.7:0/103281619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2168005b90 0x7f218013f730 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.800+0000 7f2187e00640 1 -- 172.21.15.7:0/103281619 >> 172.21.15.7:0/103281619 conn(0x7f2180065d40 msgr2=0x7f21801e3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:44.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.804+0000 7f2187e00640 1 -- 172.21.15.7:0/103281619 shutdown_connections 2024-09-13T15:01:44.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.804+0000 7f2187e00640 1 -- 172.21.15.7:0/103281619 wait complete. 2024-09-13T15:01:44.834 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-13T15:01:44.834 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-13T15:01:44.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9da7600640 1 Processor -- start 2024-09-13T15:01:44.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9da7600640 1 -- start start 2024-09-13T15:01:44.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9da7600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9da015b010 0x7f9da00c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9da7600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da00c6400 con 0x7f9da00b2bf0 2024-09-13T15:01:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9da7600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da00c66a0 con 0x7f9da01510f0 2024-09-13T15:01:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9da7600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00ca040 con 0x7f9da015b010 2024-09-13T15:01:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d97e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9da00b2bf0 0x7f9da015a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44248/0 (socket says 172.21.15.7:44248) 2024-09-13T15:01:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d97e00640 1 -- 172.21.15.7:0/3142722815 learned_addr learned my addr 172.21.15.7:0/3142722815 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:01:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9da5600640 1 --2- 172.21.15.7:0/3142722815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9da015b010 0x7f9da00c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d9fe00640 1 -- 172.21.15.7:0/3142722815 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313330198 0 0) 0x7f9da00c6400 con 0x7f9da00b2bf0 2024-09-13T15:01:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d9fe00640 1 -- 172.21.15.7:0/3142722815 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d84003530 con 0x7f9da00b2bf0 2024-09-13T15:01:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d9fe00640 1 -- 172.21.15.7:0/3142722815 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412949380 0 0) 0x7f9da00c66a0 con 0x7f9da01510f0 2024-09-13T15:01:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d9fe00640 1 -- 172.21.15.7:0/3142722815 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9da00c6400 con 0x7f9da01510f0 2024-09-13T15:01:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d9fe00640 1 -- 172.21.15.7:0/3142722815 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 470598266 0 0) 0x7f9d84003530 con 0x7f9da00b2bf0 2024-09-13T15:01:44.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d9fe00640 1 -- 172.21.15.7:0/3142722815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9da015b010 msgr2=0x7f9da00c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d9fe00640 1 --2- 172.21.15.7:0/3142722815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9da015b010 0x7f9da00c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d9fe00640 1 -- 172.21.15.7:0/3142722815 >> v1:172.21.15.77:6789/0 conn(0x7f9da01510f0 legacy=0x7f9da006f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d9fe00640 1 -- 172.21.15.7:0/3142722815 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da00c6980 con 0x7f9da00b2bf0 2024-09-13T15:01:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d9fe00640 1 -- 172.21.15.7:0/3142722815 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f9d88001680 con 0x7f9da00b2bf0 2024-09-13T15:01:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d9fe00640 1 -- 172.21.15.7:0/3142722815 >> v1:172.21.15.7:6789/0 conn(0x7f9da00b2bf0 legacy=0x7f9da015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d9fe00640 1 --2- 172.21.15.7:0/3142722815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d84003b40 0x7f9d84003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d9fe00640 1 --2- 172.21.15.7:0/3142722815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d840047d0 0x7f9d84004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d9fe00640 1 --2- 172.21.15.7:0/3142722815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9da015b010 0x7f9d84005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d9fe00640 1 -- 172.21.15.7:0/3142722815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00ca040 con 0x7f9d840047d0 2024-09-13T15:01:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d9fe00640 1 -- 172.21.15.7:0/3142722815 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8400bb50 con 0x7f9d84003b40 2024-09-13T15:01:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d9fe00640 1 -- 172.21.15.7:0/3142722815 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8400bd10 con 0x7f9da015b010 2024-09-13T15:01:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9d97e00640 1 --2- 172.21.15.7:0/3142722815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d840047d0 0x7f9d84004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:44.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9da4c00640 1 --2- 172.21.15.7:0/3142722815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d84003b40 0x7f9d84003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.980+0000 7f9da5600640 1 --2- 172.21.15.7:0/3142722815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9da015b010 0x7f9d84005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.984+0000 7f9d97e00640 1 -- 172.21.15.7:0/3142722815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9da015b010 msgr2=0x7f9d84005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.984+0000 7f9d97e00640 1 --2- 172.21.15.7:0/3142722815 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9da015b010 0x7f9d84005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.984+0000 7f9d97e00640 1 -- 172.21.15.7:0/3142722815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d84003b40 msgr2=0x7f9d84003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.984+0000 7f9d97e00640 1 --2- 172.21.15.7:0/3142722815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d84003b40 0x7f9d84003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.984+0000 7f9d97e00640 1 -- 172.21.15.7:0/3142722815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d84003530 con 0x7f9d840047d0 2024-09-13T15:01:44.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.984+0000 7f9da4c00640 1 --2- 172.21.15.7:0/3142722815 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d84003b40 0x7f9d84003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.984+0000 7f9d97e00640 1 --2- 172.21.15.7:0/3142722815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d840047d0 0x7f9d84004c50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800c160 tx=0x7f9d8801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9c71d5877ae1eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.984+0000 7f9d9fe00640 1 -- 172.21.15.7:0/3142722815 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d880058e0 con 0x7f9d840047d0 2024-09-13T15:01:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.984+0000 7f9d9fe00640 1 -- 172.21.15.7:0/3142722815 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d88005a60 con 0x7f9d840047d0 2024-09-13T15:01:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.984+0000 7f9d9fe00640 1 -- 172.21.15.7:0/3142722815 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88005e10 con 0x7f9d840047d0 2024-09-13T15:01:44.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.984+0000 7f9da7600640 1 -- 172.21.15.7:0/3142722815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d840047d0 msgr2=0x7f9d84004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.984+0000 7f9da7600640 1 --2- 172.21.15.7:0/3142722815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d840047d0 0x7f9d84004c50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800c160 tx=0x7f9d8801cbc0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.984+0000 7f9da5600640 1 -- 172.21.15.7:0/3142722815 reap_dead start 2024-09-13T15:01:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.984+0000 7f9da7600640 1 -- 172.21.15.7:0/3142722815 shutdown_connections 2024-09-13T15:01:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.984+0000 7f9da7600640 1 -- 172.21.15.7:0/3142722815 >> 172.21.15.7:0/3142722815 conn(0x7f9da006cf60 msgr2=0x7f9da00717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.984+0000 7f9da7600640 1 -- 172.21.15.7:0/3142722815 shutdown_connections 2024-09-13T15:01:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.984+0000 7f9da7600640 1 -- 172.21.15.7:0/3142722815 wait complete. 2024-09-13T15:01:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da7600640 1 Processor -- start 2024-09-13T15:01:44.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da7600640 1 -- start start 2024-09-13T15:01:44.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da7600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d840047d0 0x7f9da01f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:44.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da7600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da01f3300 0x7f9da006b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:44.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da7600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9da006bd30 0x7f9da014fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:44.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da7600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da01f2e70 con 0x7f9da006bd30 2024-09-13T15:01:44.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da7600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da01f6390 con 0x7f9da01f3300 2024-09-13T15:01:44.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da7600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da01f2910 con 0x7f9d840047d0 2024-09-13T15:01:44.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da5600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9da006bd30 0x7f9da014fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:44.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da5600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9da006bd30 0x7f9da014fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44982/0 (socket says 172.21.15.7:44982) 2024-09-13T15:01:44.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da5600640 1 -- 172.21.15.7:0/4098514521 learned_addr learned my addr 172.21.15.7:0/4098514521 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:44.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9d97e00640 1 --2- 172.21.15.7:0/4098514521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da01f3300 0x7f9da006b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:44.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da4c00640 1 --2- 172.21.15.7:0/4098514521 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d840047d0 0x7f9da01f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:44.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da5600640 1 -- 172.21.15.7:0/4098514521 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d840047d0 msgr2=0x7f9da01f5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:44.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da5600640 1 --2- 172.21.15.7:0/4098514521 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d840047d0 0x7f9da01f5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da5600640 1 -- 172.21.15.7:0/4098514521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da01f3300 msgr2=0x7f9da006b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:44.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da5600640 1 --2- 172.21.15.7:0/4098514521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da01f3300 0x7f9da006b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:44.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da5600640 1 -- 172.21.15.7:0/4098514521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da006b270 con 0x7f9da006bd30 2024-09-13T15:01:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da5600640 1 --2- 172.21.15.7:0/4098514521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9da006bd30 0x7f9da014fcb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9da00c7ec0 tx=0x7f9d980115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9d9d600640 1 -- 172.21.15.7:0/4098514521 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9800e070 con 0x7f9da006bd30 2024-09-13T15:01:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9d9d600640 1 -- 172.21.15.7:0/4098514521 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d98011e70 con 0x7f9da006bd30 2024-09-13T15:01:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da7600640 1 -- 172.21.15.7:0/4098514521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da01f2bb0 con 0x7f9da006bd30 2024-09-13T15:01:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9d9d600640 1 -- 172.21.15.7:0/4098514521 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980039a0 con 0x7f9da006bd30 2024-09-13T15:01:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.988+0000 7f9da7600640 1 -- 172.21.15.7:0/4098514521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da01f5650 con 0x7f9da006bd30 2024-09-13T15:01:44.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.992+0000 7f9da7600640 1 -- 172.21.15.7:0/4098514521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da0067610 con 0x7f9da006bd30 2024-09-13T15:01:44.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.992+0000 7f9d9d600640 1 -- 172.21.15.7:0/4098514521 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9d98003b00 con 0x7f9da006bd30 2024-09-13T15:01:44.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.992+0000 7f9d9d600640 1 --2- 172.21.15.7:0/4098514521 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9d7c0666c0 0x7f9d7c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:44.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.992+0000 7f9d9d600640 1 -- 172.21.15.7:0/4098514521 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d98084980 con 0x7f9da006bd30 2024-09-13T15:01:44.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.992+0000 7f9da4c00640 1 --2- 172.21.15.7:0/4098514521 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9d7c0666c0 0x7f9d7c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:44.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.992+0000 7f9da4c00640 1 --2- 172.21.15.7:0/4098514521 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9d7c0666c0 0x7f9d7c068b80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9d90005350 tx=0x7f9d90009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:44.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:44.996+0000 7f9d9d600640 1 -- 172.21.15.7:0/4098514521 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9d98051bc0 con 0x7f9da006bd30 2024-09-13T15:01:45.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.168+0000 7f9da7600640 1 -- 172.21.15.7:0/4098514521 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f9da015a900 con 0x7f9da006bd30 2024-09-13T15:01:45.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.792+0000 7f9d9d600640 1 -- 172.21.15.7:0/4098514521 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f9d980551e0 con 0x7f9da006bd30 2024-09-13T15:01:45.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.796+0000 7f9da7600640 1 -- 172.21.15.7:0/4098514521 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9d7c0666c0 msgr2=0x7f9d7c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:45.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.796+0000 7f9da7600640 1 --2- 172.21.15.7:0/4098514521 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9d7c0666c0 0x7f9d7c068b80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9d90005350 tx=0x7f9d90009040 comp rx=0 tx=0).stop 2024-09-13T15:01:45.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.796+0000 7f9da7600640 1 -- 172.21.15.7:0/4098514521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9da006bd30 msgr2=0x7f9da014fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:45.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.796+0000 7f9da7600640 1 --2- 172.21.15.7:0/4098514521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9da006bd30 0x7f9da014fcb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9da00c7ec0 tx=0x7f9d980115a0 comp rx=0 tx=0).stop 2024-09-13T15:01:45.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.796+0000 7f9da7600640 1 -- 172.21.15.7:0/4098514521 shutdown_connections 2024-09-13T15:01:45.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.796+0000 7f9da7600640 1 --2- 172.21.15.7:0/4098514521 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9d7c0666c0 0x7f9d7c068b80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:45.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.796+0000 7f9da7600640 1 --2- 172.21.15.7:0/4098514521 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9da006bd30 0x7f9da014fcb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:45.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.796+0000 7f9da7600640 1 --2- 172.21.15.7:0/4098514521 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9da01f3300 0x7f9da006b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:45.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.796+0000 7f9da7600640 1 --2- 172.21.15.7:0/4098514521 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9d840047d0 0x7f9da01f5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:45.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.796+0000 7f9da7600640 1 -- 172.21.15.7:0/4098514521 >> 172.21.15.7:0/4098514521 conn(0x7f9da006cf60 msgr2=0x7f9da00c29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:45.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.796+0000 7f9da7600640 1 -- 172.21.15.7:0/4098514521 shutdown_connections 2024-09-13T15:01:45.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.796+0000 7f9da7600640 1 -- 172.21.15.7:0/4098514521 wait complete. 2024-09-13T15:01:45.819 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T15:01:45.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f435b200640 1 Processor -- start 2024-09-13T15:01:45.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f435b200640 1 -- start start 2024-09-13T15:01:45.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f435b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43541501b0 0x7f4354156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:45.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f435b200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43540c6880 con 0x7f43540c16f0 2024-09-13T15:01:45.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f435b200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43540721e0 con 0x7f435414fdd0 2024-09-13T15:01:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f435b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435406f860 con 0x7f43541501b0 2024-09-13T15:01:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f4359200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f43540c16f0 0x7f43540c55d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44260/0 (socket says 172.21.15.7:44260) 2024-09-13T15:01:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f4359200640 1 -- 172.21.15.7:0/242077196 learned_addr learned my addr 172.21.15.7:0/242077196 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:01:45.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f434b400640 1 --2- 172.21.15.7:0/242077196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43541501b0 0x7f4354156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f4353400640 1 -- 172.21.15.7:0/242077196 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3222498449 0 0) 0x7f43540c6880 con 0x7f43540c16f0 2024-09-13T15:01:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f4353400640 1 -- 172.21.15.7:0/242077196 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4338003530 con 0x7f43540c16f0 2024-09-13T15:01:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f4353400640 1 -- 172.21.15.7:0/242077196 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765852974 0 0) 0x7f43540721e0 con 0x7f435414fdd0 2024-09-13T15:01:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f4353400640 1 -- 172.21.15.7:0/242077196 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43540c6880 con 0x7f435414fdd0 2024-09-13T15:01:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f4353400640 1 -- 172.21.15.7:0/242077196 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 894567342 0 0) 0x7f4338003530 con 0x7f43540c16f0 2024-09-13T15:01:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f4353400640 1 -- 172.21.15.7:0/242077196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43541501b0 msgr2=0x7f4354156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f4353400640 1 --2- 172.21.15.7:0/242077196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43541501b0 0x7f4354156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f4353400640 1 -- 172.21.15.7:0/242077196 >> v1:172.21.15.77:6789/0 conn(0x7f435414fdd0 legacy=0x7f43540c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:45.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f4353400640 1 -- 172.21.15.7:0/242077196 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43540c6ad0 con 0x7f43540c16f0 2024-09-13T15:01:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f4353400640 1 -- 172.21.15.7:0/242077196 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f434c001a00 con 0x7f43540c16f0 2024-09-13T15:01:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.968+0000 7f4353400640 1 -- 172.21.15.7:0/242077196 >> v1:172.21.15.7:6789/0 conn(0x7f43540c16f0 legacy=0x7f43540c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f4353400640 1 --2- 172.21.15.7:0/242077196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4338003b40 0x7f4338003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f4353400640 1 --2- 172.21.15.7:0/242077196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43541501b0 0x7f43380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f4353400640 1 --2- 172.21.15.7:0/242077196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4338004d10 0x7f4338005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f4353400640 1 -- 172.21.15.7:0/242077196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435406f860 con 0x7f4338003b40 2024-09-13T15:01:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f4353400640 1 -- 172.21.15.7:0/242077196 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433800ba40 con 0x7f4338004d10 2024-09-13T15:01:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f4353400640 1 -- 172.21.15.7:0/242077196 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433800bc00 con 0x7f43541501b0 2024-09-13T15:01:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f4353e00640 1 --2- 172.21.15.7:0/242077196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4338003b40 0x7f4338003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f4359200640 1 --2- 172.21.15.7:0/242077196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4338004d10 0x7f4338005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f434b400640 1 --2- 172.21.15.7:0/242077196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43541501b0 0x7f43380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f4353e00640 1 -- 172.21.15.7:0/242077196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43541501b0 msgr2=0x7f43380047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:45.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f4353e00640 1 --2- 172.21.15.7:0/242077196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f43541501b0 0x7f43380047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f4353e00640 1 -- 172.21.15.7:0/242077196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4338004d10 msgr2=0x7f4338005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f4353e00640 1 --2- 172.21.15.7:0/242077196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4338004d10 0x7f4338005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:45.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f4353e00640 1 -- 172.21.15.7:0/242077196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4338003530 con 0x7f4338003b40 2024-09-13T15:01:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f4353e00640 1 --2- 172.21.15.7:0/242077196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4338003b40 0x7f4338003f40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f43440018d0 tx=0x7f434401c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40299dee57d9b935 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f4353400640 1 -- 172.21.15.7:0/242077196 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43440a6040 con 0x7f4338003b40 2024-09-13T15:01:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f4353400640 1 -- 172.21.15.7:0/242077196 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43440052f0 con 0x7f4338003b40 2024-09-13T15:01:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.972+0000 7f4353400640 1 -- 172.21.15.7:0/242077196 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4344003600 con 0x7f4338003b40 2024-09-13T15:01:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f435b200640 1 -- 172.21.15.7:0/242077196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4338003b40 msgr2=0x7f4338003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f435b200640 1 --2- 172.21.15.7:0/242077196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4338003b40 0x7f4338003f40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f43440018d0 tx=0x7f434401c580 comp rx=0 tx=0).stop 2024-09-13T15:01:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f4359200640 1 -- 172.21.15.7:0/242077196 reap_dead start 2024-09-13T15:01:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f435b200640 1 -- 172.21.15.7:0/242077196 shutdown_connections 2024-09-13T15:01:45.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f435b200640 1 -- 172.21.15.7:0/242077196 >> 172.21.15.7:0/242077196 conn(0x7f4354065d40 msgr2=0x7f4354066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:45.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f435b200640 1 -- 172.21.15.7:0/242077196 shutdown_connections 2024-09-13T15:01:45.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f435b200640 1 -- 172.21.15.7:0/242077196 wait complete. 2024-09-13T15:01:45.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f435b200640 1 Processor -- start 2024-09-13T15:01:45.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f435b200640 1 -- start start 2024-09-13T15:01:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f435b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4338003b40 0x7f43540cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f435b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43540cb560 0x7f435414e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f435b200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f435414c7a0 0x7f435414cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f435b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435406dc70 con 0x7f43540cb560 2024-09-13T15:01:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f435b200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435414d160 con 0x7f435414c7a0 2024-09-13T15:01:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f435b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43541f1cd0 con 0x7f4338003b40 2024-09-13T15:01:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f434b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43540cb560 0x7f435414e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f434b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43540cb560 0x7f435414e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45000/0 (socket says 172.21.15.7:45000) 2024-09-13T15:01:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f434b400640 1 -- 172.21.15.7:0/4131854932 learned_addr learned my addr 172.21.15.7:0/4131854932 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f4353e00640 1 --2- 172.21.15.7:0/4131854932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4338003b40 0x7f43540cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:45.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f4359200640 1 --2- 172.21.15.7:0/4131854932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f435414c7a0 0x7f435414cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f434b400640 1 -- 172.21.15.7:0/4131854932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4338003b40 msgr2=0x7f43540cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f434b400640 1 --2- 172.21.15.7:0/4131854932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4338003b40 0x7f43540cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f434b400640 1 -- 172.21.15.7:0/4131854932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f435414c7a0 msgr2=0x7f435414cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f434b400640 1 --2- 172.21.15.7:0/4131854932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f435414c7a0 0x7f435414cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f434b400640 1 -- 172.21.15.7:0/4131854932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43541f1f70 con 0x7f43540cb560 2024-09-13T15:01:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.976+0000 7f4359200640 1 --2- 172.21.15.7:0/4131854932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f435414c7a0 0x7f435414cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.980+0000 7f434b400640 1 --2- 172.21.15.7:0/4131854932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43540cb560 0x7f435414e130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f433c0115d0 tx=0x7f433c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.980+0000 7f4350c00640 1 -- 172.21.15.7:0/4131854932 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c00f8f0 con 0x7f43540cb560 2024-09-13T15:01:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.980+0000 7f4350c00640 1 -- 172.21.15.7:0/4131854932 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433c00fa50 con 0x7f43540cb560 2024-09-13T15:01:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.980+0000 7f4350c00640 1 -- 172.21.15.7:0/4131854932 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433c00fe00 con 0x7f43540cb560 2024-09-13T15:01:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.980+0000 7f435b200640 1 -- 172.21.15.7:0/4131854932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435406d080 con 0x7f43540cb560 2024-09-13T15:01:45.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.980+0000 7f435b200640 1 -- 172.21.15.7:0/4131854932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435406d620 con 0x7f43540cb560 2024-09-13T15:01:45.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.980+0000 7f435b200640 1 -- 172.21.15.7:0/4131854932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4354070820 con 0x7f43540cb560 2024-09-13T15:01:45.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.980+0000 7f4350c00640 1 -- 172.21.15.7:0/4131854932 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f433c015460 con 0x7f43540cb560 2024-09-13T15:01:45.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.980+0000 7f4350c00640 1 --2- 172.21.15.7:0/4131854932 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4330066690 0x7f4330068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:45.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.980+0000 7f4350c00640 1 -- 172.21.15.7:0/4131854932 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f433c084a90 con 0x7f43540cb560 2024-09-13T15:01:45.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.980+0000 7f4353e00640 1 --2- 172.21.15.7:0/4131854932 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4330066690 0x7f4330068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:45.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.984+0000 7f4353e00640 1 --2- 172.21.15.7:0/4131854932 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4330066690 0x7f4330068b50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f43440ac000 tx=0x7f43440a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:45.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:45.984+0000 7f4350c00640 1 -- 172.21.15.7:0/4131854932 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f433c051d10 con 0x7f43540cb560 2024-09-13T15:01:46.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:46.152+0000 7f435b200640 1 -- 172.21.15.7:0/4131854932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f435414f750 con 0x7f43540cb560 2024-09-13T15:01:47.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.804+0000 7f4350c00640 1 -- 172.21.15.7:0/4131854932 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f433c022100 con 0x7f43540cb560 2024-09-13T15:01:47.809 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data_ec' created 2024-09-13T15:01:47.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.808+0000 7f435b200640 1 -- 172.21.15.7:0/4131854932 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4330066690 msgr2=0x7f4330068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:47.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.808+0000 7f435b200640 1 --2- 172.21.15.7:0/4131854932 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4330066690 0x7f4330068b50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f43440ac000 tx=0x7f43440a7000 comp rx=0 tx=0).stop 2024-09-13T15:01:47.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.808+0000 7f435b200640 1 -- 172.21.15.7:0/4131854932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43540cb560 msgr2=0x7f435414e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:47.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.808+0000 7f435b200640 1 --2- 172.21.15.7:0/4131854932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43540cb560 0x7f435414e130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f433c0115d0 tx=0x7f433c011a90 comp rx=0 tx=0).stop 2024-09-13T15:01:47.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.812+0000 7f435b200640 1 -- 172.21.15.7:0/4131854932 shutdown_connections 2024-09-13T15:01:47.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.812+0000 7f435b200640 1 --2- 172.21.15.7:0/4131854932 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4330066690 0x7f4330068b50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:47.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.812+0000 7f435b200640 1 --2- 172.21.15.7:0/4131854932 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f435414c7a0 0x7f435414cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:47.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.812+0000 7f435b200640 1 --2- 172.21.15.7:0/4131854932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43540cb560 0x7f435414e130 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:47.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.812+0000 7f435b200640 1 --2- 172.21.15.7:0/4131854932 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4338003b40 0x7f43540cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:47.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.812+0000 7f435b200640 1 -- 172.21.15.7:0/4131854932 >> 172.21.15.7:0/4131854932 conn(0x7f4354065d40 msgr2=0x7f4354153e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:47.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.812+0000 7f435b200640 1 -- 172.21.15.7:0/4131854932 shutdown_connections 2024-09-13T15:01:47.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.812+0000 7f435b200640 1 -- 172.21.15.7:0/4131854932 wait complete. 2024-09-13T15:01:47.846 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-13T15:01:47.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.992+0000 7fa98a000640 1 Processor -- start 2024-09-13T15:01:47.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.992+0000 7fa98a000640 1 -- start start 2024-09-13T15:01:47.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.992+0000 7fa98a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9840c2110 0x7fa9840c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:47.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.992+0000 7fa98a000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa9840c7800 0x7fa984150e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:47.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.992+0000 7fa98a000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98406e870 con 0x7fa9840c24f0 2024-09-13T15:01:47.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.992+0000 7fa98a000640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa984157fc0 con 0x7fa9840c7800 2024-09-13T15:01:47.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.992+0000 7fa98a000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9840c7d40 con 0x7fa9840c2110 2024-09-13T15:01:47.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.992+0000 7fa97aa00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa9840c24f0 0x7fa9841578b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44272/0 (socket says 172.21.15.7:44272) 2024-09-13T15:01:47.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.992+0000 7fa97aa00640 1 -- 172.21.15.7:0/1629322915 learned_addr learned my addr 172.21.15.7:0/1629322915 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:01:47.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.992+0000 7fa983e00640 1 --2- 172.21.15.7:0/1629322915 >> v2:172.21.15.77:3300/0 conn(0x7fa9840c7800 0x7fa984150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:47.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.992+0000 7fa983400640 1 --2- 172.21.15.7:0/1629322915 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9840c2110 0x7fa9840c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:47.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.992+0000 7fa982a00640 1 -- 172.21.15.7:0/1629322915 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326855400 0 0) 0x7fa98406e870 con 0x7fa9840c24f0 2024-09-13T15:01:47.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.992+0000 7fa982a00640 1 -- 172.21.15.7:0/1629322915 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa968003530 con 0x7fa9840c24f0 2024-09-13T15:01:47.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.992+0000 7fa983e00640 1 -- 172.21.15.7:0/1629322915 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9840c2110 msgr2=0x7fa9840c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:47.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.992+0000 7fa983e00640 1 --2- 172.21.15.7:0/1629322915 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9840c2110 0x7fa9840c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:47.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.992+0000 7fa983e00640 1 -- 172.21.15.7:0/1629322915 >> v1:172.21.15.7:6789/0 conn(0x7fa9840c24f0 legacy=0x7fa9841578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:47.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.992+0000 7fa983e00640 1 -- 172.21.15.7:0/1629322915 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa984157420 con 0x7fa9840c7800 2024-09-13T15:01:47.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.996+0000 7fa983e00640 1 --2- 172.21.15.7:0/1629322915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9840c7800 0x7fa984150e60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009d90 tx=0x7fa97c01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d011db914888527a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:47.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.996+0000 7fa982a00640 1 -- 172.21.15.7:0/1629322915 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0a5a00 con 0x7fa9840c7800 2024-09-13T15:01:48.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.996+0000 7fa982a00640 1 -- 172.21.15.7:0/1629322915 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c0a5b60 con 0x7fa9840c7800 2024-09-13T15:01:48.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.996+0000 7fa982a00640 1 -- 172.21.15.7:0/1629322915 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0ad440 con 0x7fa9840c7800 2024-09-13T15:01:48.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.996+0000 7fa98a000640 1 -- 172.21.15.7:0/1629322915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9840c7800 msgr2=0x7fa984150e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.996+0000 7fa98a000640 1 --2- 172.21.15.7:0/1629322915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9840c7800 0x7fa984150e60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009d90 tx=0x7fa97c01c940 comp rx=0 tx=0).stop 2024-09-13T15:01:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.996+0000 7fa98a000640 1 -- 172.21.15.7:0/1629322915 shutdown_connections 2024-09-13T15:01:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.996+0000 7fa98a000640 1 --2- 172.21.15.7:0/1629322915 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9840c7800 0x7fa984150e60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.996+0000 7fa98a000640 1 --2- 172.21.15.7:0/1629322915 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9840c2110 0x7fa9840c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.996+0000 7fa98a000640 1 -- 172.21.15.7:0/1629322915 >> 172.21.15.7:0/1629322915 conn(0x7fa9840cce00 msgr2=0x7fa9840cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.996+0000 7fa98a000640 1 -- 172.21.15.7:0/1629322915 shutdown_connections 2024-09-13T15:01:48.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:47.996+0000 7fa98a000640 1 -- 172.21.15.7:0/1629322915 wait complete. 2024-09-13T15:01:48.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa98a000640 1 Processor -- start 2024-09-13T15:01:48.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa98a000640 1 -- start start 2024-09-13T15:01:48.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa98a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9840c2110 0x7fa9841f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:48.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa98a000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9840c24f0 0x7fa9841598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:48.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa98a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9840c7800 0x7fa98406d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:48.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa98a000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa984159e30 con 0x7fa9840c2110 2024-09-13T15:01:48.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa98a000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9840cc8f0 con 0x7fa9840c24f0 2024-09-13T15:01:48.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa98a000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9841f2000 con 0x7fa9840c7800 2024-09-13T15:01:48.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa983400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9840c2110 0x7fa9841f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:48.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa983400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9840c2110 0x7fa9841f2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45014/0 (socket says 172.21.15.7:45014) 2024-09-13T15:01:48.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa983400640 1 -- 172.21.15.7:0/3419379201 learned_addr learned my addr 172.21.15.7:0/3419379201 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:48.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa983e00640 1 --2- 172.21.15.7:0/3419379201 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9840c7800 0x7fa98406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:48.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa97aa00640 1 --2- 172.21.15.7:0/3419379201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9840c24f0 0x7fa9841598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:48.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa983400640 1 -- 172.21.15.7:0/3419379201 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9840c7800 msgr2=0x7fa98406d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:48.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa983400640 1 --2- 172.21.15.7:0/3419379201 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9840c7800 0x7fa98406d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:48.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa983400640 1 -- 172.21.15.7:0/3419379201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9840c24f0 msgr2=0x7fa9841598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:48.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa983400640 1 --2- 172.21.15.7:0/3419379201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9840c24f0 0x7fa9841598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:48.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa983400640 1 -- 172.21.15.7:0/3419379201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c009a70 con 0x7fa9840c2110 2024-09-13T15:01:48.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa97aa00640 1 --2- 172.21.15.7:0/3419379201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9840c24f0 0x7fa9841598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:48.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa983400640 1 --2- 172.21.15.7:0/3419379201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9840c2110 0x7fa9841f2490 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa97400e930 tx=0x7fa97400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:48.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa97be00640 1 -- 172.21.15.7:0/3419379201 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974009690 con 0x7fa9840c2110 2024-09-13T15:01:48.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa97be00640 1 -- 172.21.15.7:0/3419379201 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97400ca00 con 0x7fa9840c2110 2024-09-13T15:01:48.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa98a000640 1 -- 172.21.15.7:0/3419379201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9840ccb00 con 0x7fa9840c2110 2024-09-13T15:01:48.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa97be00640 1 -- 172.21.15.7:0/3419379201 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97400cd70 con 0x7fa9840c2110 2024-09-13T15:01:48.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.000+0000 7fa98a000640 1 -- 172.21.15.7:0/3419379201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9841f19b0 con 0x7fa9840c2110 2024-09-13T15:01:48.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.004+0000 7fa98a000640 1 -- 172.21.15.7:0/3419379201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9840c9350 con 0x7fa9840c2110 2024-09-13T15:01:48.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.004+0000 7fa97be00640 1 -- 172.21.15.7:0/3419379201 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa974013470 con 0x7fa9840c2110 2024-09-13T15:01:48.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.004+0000 7fa97be00640 1 --2- 172.21.15.7:0/3419379201 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa960066690 0x7fa960068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:48.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.004+0000 7fa97be00640 1 -- 172.21.15.7:0/3419379201 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fa974084780 con 0x7fa9840c2110 2024-09-13T15:01:48.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.004+0000 7fa97aa00640 1 --2- 172.21.15.7:0/3419379201 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa960066690 0x7fa960068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:48.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.004+0000 7fa97aa00640 1 --2- 172.21.15.7:0/3419379201 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa960066690 0x7fa960068b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa9841ef4d0 tx=0x7fa96c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:48.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.008+0000 7fa97be00640 1 -- 172.21.15.7:0/3419379201 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa974051860 con 0x7fa9840c2110 2024-09-13T15:01:48.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.172+0000 7fa98a000640 1 -- 172.21.15.7:0/3419379201 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fa98414d0a0 con 0x7fa9840c2110 2024-09-13T15:01:48.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.812+0000 7fa97be00640 1 -- 172.21.15.7:0/3419379201 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa974054e80 con 0x7fa9840c2110 2024-09-13T15:01:48.817 INFO:teuthology.orchestra.run.smithi007.stderr:set pool 4 allow_ec_overwrites to true 2024-09-13T15:01:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.820+0000 7fa98a000640 1 -- 172.21.15.7:0/3419379201 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa960066690 msgr2=0x7fa960068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:48.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.820+0000 7fa98a000640 1 --2- 172.21.15.7:0/3419379201 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa960066690 0x7fa960068b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa9841ef4d0 tx=0x7fa96c009040 comp rx=0 tx=0).stop 2024-09-13T15:01:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.820+0000 7fa98a000640 1 -- 172.21.15.7:0/3419379201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9840c2110 msgr2=0x7fa9841f2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:48.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.820+0000 7fa98a000640 1 --2- 172.21.15.7:0/3419379201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9840c2110 0x7fa9841f2490 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa97400e930 tx=0x7fa97400edf0 comp rx=0 tx=0).stop 2024-09-13T15:01:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.824+0000 7fa98a000640 1 -- 172.21.15.7:0/3419379201 shutdown_connections 2024-09-13T15:01:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.824+0000 7fa98a000640 1 --2- 172.21.15.7:0/3419379201 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa960066690 0x7fa960068b50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.824+0000 7fa98a000640 1 --2- 172.21.15.7:0/3419379201 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9840c7800 0x7fa98406d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.824+0000 7fa98a000640 1 --2- 172.21.15.7:0/3419379201 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9840c24f0 0x7fa9841598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.824+0000 7fa98a000640 1 --2- 172.21.15.7:0/3419379201 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9840c2110 0x7fa9841f2490 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:48.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.824+0000 7fa98a000640 1 -- 172.21.15.7:0/3419379201 >> 172.21.15.7:0/3419379201 conn(0x7fa9840cce00 msgr2=0x7fa984155d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:48.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.824+0000 7fa98a000640 1 -- 172.21.15.7:0/3419379201 shutdown_connections 2024-09-13T15:01:48.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:48.824+0000 7fa98a000640 1 -- 172.21.15.7:0/3419379201 wait complete. 2024-09-13T15:01:48.864 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-13T15:01:49.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.012+0000 7f9dd7e00640 1 Processor -- start 2024-09-13T15:01:49.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.012+0000 7f9dd7e00640 1 -- start start 2024-09-13T15:01:49.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.012+0000 7f9dd7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9dd014fdd0 0x7f9dd0156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.012+0000 7f9dd7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dd01501b0 0x7f9dd00c7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.012+0000 7f9dd7e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd00c6880 con 0x7f9dd00c16f0 2024-09-13T15:01:49.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.012+0000 7f9dd7e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd00721e0 con 0x7f9dd014fdd0 2024-09-13T15:01:49.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.012+0000 7f9dd7e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd006f860 con 0x7f9dd01501b0 2024-09-13T15:01:49.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.016+0000 7f9dd5400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9dd014fdd0 0x7f9dd0156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.016+0000 7f9dd5400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9dd014fdd0 0x7f9dd0156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39198/0 (socket says 172.21.15.7:39198) 2024-09-13T15:01:49.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.016+0000 7f9dd5400640 1 -- 172.21.15.7:0/2400408698 learned_addr learned my addr 172.21.15.7:0/2400408698 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:49.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.016+0000 7f9dd4a00640 1 --2- 172.21.15.7:0/2400408698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dd01501b0 0x7f9dd00c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.016+0000 7f9dd5400640 1 -- 172.21.15.7:0/2400408698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dd01501b0 msgr2=0x7f9dd00c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:49.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.016+0000 7f9dd5400640 1 --2- 172.21.15.7:0/2400408698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dd01501b0 0x7f9dd00c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.016+0000 7f9dd5400640 1 -- 172.21.15.7:0/2400408698 >> v1:172.21.15.7:6789/0 conn(0x7f9dd00c16f0 legacy=0x7f9dd00c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:49.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.016+0000 7f9dd5400640 1 -- 172.21.15.7:0/2400408698 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd00c6ad0 con 0x7f9dd014fdd0 2024-09-13T15:01:49.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.016+0000 7f9dcfe00640 1 -- 172.21.15.7:0/2400408698 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814234079 0 0) 0x7f9dd00c6880 con 0x7f9dd00c16f0 2024-09-13T15:01:49.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.016+0000 7f9dd4a00640 1 --2- 172.21.15.7:0/2400408698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dd01501b0 0x7f9dd00c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:49.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.016+0000 7f9dd5400640 1 --2- 172.21.15.7:0/2400408698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9dd014fdd0 0x7f9dd0156780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009870 tx=0x7f9dc401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5b5f3d8a2795e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:49.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.016+0000 7f9dcfe00640 1 -- 172.21.15.7:0/2400408698 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40a9620 con 0x7f9dd014fdd0 2024-09-13T15:01:49.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.016+0000 7f9dcfe00640 1 -- 172.21.15.7:0/2400408698 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc40a9780 con 0x7f9dd014fdd0 2024-09-13T15:01:49.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.016+0000 7f9dcfe00640 1 -- 172.21.15.7:0/2400408698 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40a9b10 con 0x7f9dd014fdd0 2024-09-13T15:01:49.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd7e00640 1 -- 172.21.15.7:0/2400408698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9dd014fdd0 msgr2=0x7f9dd0156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:49.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd7e00640 1 --2- 172.21.15.7:0/2400408698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9dd014fdd0 0x7f9dd0156780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009870 tx=0x7f9dc401c560 comp rx=0 tx=0).stop 2024-09-13T15:01:49.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd7e00640 1 -- 172.21.15.7:0/2400408698 shutdown_connections 2024-09-13T15:01:49.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd7e00640 1 --2- 172.21.15.7:0/2400408698 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dd01501b0 0x7f9dd00c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd7e00640 1 --2- 172.21.15.7:0/2400408698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9dd014fdd0 0x7f9dd0156780 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd7e00640 1 -- 172.21.15.7:0/2400408698 >> 172.21.15.7:0/2400408698 conn(0x7f9dd0065d40 msgr2=0x7f9dd0066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:49.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd7e00640 1 -- 172.21.15.7:0/2400408698 shutdown_connections 2024-09-13T15:01:49.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd7e00640 1 -- 172.21.15.7:0/2400408698 wait complete. 2024-09-13T15:01:49.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd7e00640 1 Processor -- start 2024-09-13T15:01:49.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd7e00640 1 -- start start 2024-09-13T15:01:49.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dd00c16f0 0x7f9dd014f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dd014fdd0 0x7f9dd01f00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9dd01501b0 0x7f9dd0141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd7e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd014e850 con 0x7f9dd01501b0 2024-09-13T15:01:49.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd7e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd01f0620 con 0x7f9dd00c16f0 2024-09-13T15:01:49.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd7e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd014afb0 con 0x7f9dd014fdd0 2024-09-13T15:01:49.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9dd01501b0 0x7f9dd0141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9dd01501b0 0x7f9dd0141e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39204/0 (socket says 172.21.15.7:39204) 2024-09-13T15:01:49.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd5e00640 1 -- 172.21.15.7:0/2353635617 learned_addr learned my addr 172.21.15.7:0/2353635617 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:49.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd5400640 1 --2- 172.21.15.7:0/2353635617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dd00c16f0 0x7f9dd014f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd4a00640 1 --2- 172.21.15.7:0/2353635617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dd014fdd0 0x7f9dd01f00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd5e00640 1 -- 172.21.15.7:0/2353635617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dd014fdd0 msgr2=0x7f9dd01f00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:49.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd5e00640 1 --2- 172.21.15.7:0/2353635617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dd014fdd0 0x7f9dd01f00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd5e00640 1 -- 172.21.15.7:0/2353635617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dd00c16f0 msgr2=0x7f9dd014f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:49.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd5e00640 1 --2- 172.21.15.7:0/2353635617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dd00c16f0 0x7f9dd014f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.020+0000 7f9dd5e00640 1 -- 172.21.15.7:0/2353635617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc40094d0 con 0x7f9dd01501b0 2024-09-13T15:01:49.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.024+0000 7f9dd5e00640 1 --2- 172.21.15.7:0/2353635617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9dd01501b0 0x7f9dd0141e60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800c7c0 tx=0x7f9dc800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:49.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.024+0000 7f9dcd600640 1 -- 172.21.15.7:0/2353635617 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8003db0 con 0x7f9dd01501b0 2024-09-13T15:01:49.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.024+0000 7f9dcd600640 1 -- 172.21.15.7:0/2353635617 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc8005070 con 0x7f9dd01501b0 2024-09-13T15:01:49.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.024+0000 7f9dcd600640 1 -- 172.21.15.7:0/2353635617 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8005420 con 0x7f9dd01501b0 2024-09-13T15:01:49.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.024+0000 7f9dd7e00640 1 -- 172.21.15.7:0/2353635617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd014ea30 con 0x7f9dd01501b0 2024-09-13T15:01:49.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.024+0000 7f9dd7e00640 1 -- 172.21.15.7:0/2353635617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd014a960 con 0x7f9dd01501b0 2024-09-13T15:01:49.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.024+0000 7f9dd7e00640 1 -- 172.21.15.7:0/2353635617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd0156780 con 0x7f9dd01501b0 2024-09-13T15:01:49.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.024+0000 7f9dcd600640 1 -- 172.21.15.7:0/2353635617 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9dc8005580 con 0x7f9dd01501b0 2024-09-13T15:01:49.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.024+0000 7f9dcd600640 1 --2- 172.21.15.7:0/2353635617 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9db0066690 0x7f9db0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.024+0000 7f9dcd600640 1 -- 172.21.15.7:0/2353635617 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f9dc8083d30 con 0x7f9dd01501b0 2024-09-13T15:01:49.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.024+0000 7f9dd5400640 1 --2- 172.21.15.7:0/2353635617 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9db0066690 0x7f9db0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.028+0000 7f9dd5400640 1 --2- 172.21.15.7:0/2353635617 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9db0066690 0x7f9db0068b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40ae000 tx=0x7f9dc40b3040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:49.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.028+0000 7f9dcd600640 1 -- 172.21.15.7:0/2353635617 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9dc8050de0 con 0x7f9dd01501b0 2024-09-13T15:01:49.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.228+0000 7f9dd7e00640 1 -- 172.21.15.7:0/2353635617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f9dd00664a0 con 0x7f9dd01501b0 2024-09-13T15:01:49.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.232+0000 7f9dcd600640 1 -- 172.21.15.7:0/2353635617 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) v1 ==== 137+0+0 (secure 0 0 0) 0x7f9dc8017070 con 0x7f9dd01501b0 2024-09-13T15:01:49.234 INFO:teuthology.orchestra.run.smithi007.stderr:added data pool 4 to fsmap 2024-09-13T15:01:49.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.232+0000 7f9dd7e00640 1 -- 172.21.15.7:0/2353635617 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9db0066690 msgr2=0x7f9db0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:49.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.232+0000 7f9dd7e00640 1 --2- 172.21.15.7:0/2353635617 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9db0066690 0x7f9db0068b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9dc40ae000 tx=0x7f9dc40b3040 comp rx=0 tx=0).stop 2024-09-13T15:01:49.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.232+0000 7f9dd7e00640 1 -- 172.21.15.7:0/2353635617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9dd01501b0 msgr2=0x7f9dd0141e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:49.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.232+0000 7f9dd7e00640 1 --2- 172.21.15.7:0/2353635617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9dd01501b0 0x7f9dd0141e60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800c7c0 tx=0x7f9dc800cc80 comp rx=0 tx=0).stop 2024-09-13T15:01:49.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.232+0000 7f9dd7e00640 1 -- 172.21.15.7:0/2353635617 shutdown_connections 2024-09-13T15:01:49.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.232+0000 7f9dd7e00640 1 --2- 172.21.15.7:0/2353635617 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9db0066690 0x7f9db0068b50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.232+0000 7f9dd7e00640 1 --2- 172.21.15.7:0/2353635617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9dd01501b0 0x7f9dd0141e60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.232+0000 7f9dd7e00640 1 --2- 172.21.15.7:0/2353635617 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9dd014fdd0 0x7f9dd01f00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.232+0000 7f9dd7e00640 1 --2- 172.21.15.7:0/2353635617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9dd00c16f0 0x7f9dd014f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.232+0000 7f9dd7e00640 1 -- 172.21.15.7:0/2353635617 >> 172.21.15.7:0/2353635617 conn(0x7f9dd0065d40 msgr2=0x7f9dd014dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:49.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.232+0000 7f9dd7e00640 1 -- 172.21.15.7:0/2353635617 shutdown_connections 2024-09-13T15:01:49.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.232+0000 7f9dd7e00640 1 -- 172.21.15.7:0/2353635617 wait complete. 2024-09-13T15:01:49.255 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:01:49.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.392+0000 7fd217400640 1 Processor -- start 2024-09-13T15:01:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.392+0000 7fd217400640 1 -- start start 2024-09-13T15:01:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.392+0000 7fd217400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2100c00f0 0x7fd2100c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.392+0000 7fd217400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd2100c04d0 0x7fd21006f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.392+0000 7fd217400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd210155ec0 con 0x7fd2100b0cb0 2024-09-13T15:01:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.392+0000 7fd217400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd210071000 con 0x7fd2100c00f0 2024-09-13T15:01:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.392+0000 7fd217400640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd21006ff60 con 0x7fd2100c04d0 2024-09-13T15:01:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.396+0000 7fd214a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2100c00f0 0x7fd2100c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.396+0000 7fd214a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd2100c00f0 0x7fd2100c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39214/0 (socket says 172.21.15.7:39214) 2024-09-13T15:01:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.396+0000 7fd214a00640 1 -- 172.21.15.7:0/1003902259 learned_addr learned my addr 172.21.15.7:0/1003902259 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:49.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.396+0000 7fd207e00640 1 --2- 172.21.15.7:0/1003902259 >> v2:172.21.15.77:3300/0 conn(0x7fd2100c04d0 0x7fd21006f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.396+0000 7fd214a00640 1 -- 172.21.15.7:0/1003902259 >> v2:172.21.15.77:3300/0 conn(0x7fd2100c04d0 msgr2=0x7fd21006f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:49.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.396+0000 7fd214a00640 1 --2- 172.21.15.7:0/1003902259 >> v2:172.21.15.77:3300/0 conn(0x7fd2100c04d0 0x7fd21006f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.396+0000 7fd214a00640 1 -- 172.21.15.7:0/1003902259 >> v1:172.21.15.77:6789/0 conn(0x7fd2100b0cb0 legacy=0x7fd21014f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:49.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.396+0000 7fd214a00640 1 -- 172.21.15.7:0/1003902259 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd210156160 con 0x7fd2100c00f0 2024-09-13T15:01:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.396+0000 7fd214a00640 1 --2- 172.21.15.7:0/1003902259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2100c00f0 0x7fd2100c5530 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd2100c51f0 tx=0x7fd20001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce92d568da0101 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.396+0000 7fd20fe00640 1 -- 172.21.15.7:0/1003902259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2000a8a10 con 0x7fd2100c00f0 2024-09-13T15:01:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.396+0000 7fd20fe00640 1 -- 172.21.15.7:0/1003902259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2000a8b70 con 0x7fd2100c00f0 2024-09-13T15:01:49.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.396+0000 7fd20fe00640 1 -- 172.21.15.7:0/1003902259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2000b0440 con 0x7fd2100c00f0 2024-09-13T15:01:49.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd217400640 1 -- 172.21.15.7:0/1003902259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2100c00f0 msgr2=0x7fd2100c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:49.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd217400640 1 --2- 172.21.15.7:0/1003902259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2100c00f0 0x7fd2100c5530 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd2100c51f0 tx=0x7fd20001ed10 comp rx=0 tx=0).stop 2024-09-13T15:01:49.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd217400640 1 -- 172.21.15.7:0/1003902259 shutdown_connections 2024-09-13T15:01:49.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd217400640 1 --2- 172.21.15.7:0/1003902259 >> v2:172.21.15.77:3300/0 conn(0x7fd2100c04d0 0x7fd21006f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd217400640 1 --2- 172.21.15.7:0/1003902259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2100c00f0 0x7fd2100c5530 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd217400640 1 -- 172.21.15.7:0/1003902259 >> 172.21.15.7:0/1003902259 conn(0x7fd210065d40 msgr2=0x7fd210066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd217400640 1 -- 172.21.15.7:0/1003902259 shutdown_connections 2024-09-13T15:01:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd217400640 1 -- 172.21.15.7:0/1003902259 wait complete. 2024-09-13T15:01:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd217400640 1 Processor -- start 2024-09-13T15:01:49.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd217400640 1 -- start start 2024-09-13T15:01:49.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd217400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2100b0cb0 0x7fd21014b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd217400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2100c00f0 0x7fd210154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd217400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2100c04d0 0x7fd210147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd217400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd210154730 con 0x7fd2100b0cb0 2024-09-13T15:01:49.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd217400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2100c51d0 con 0x7fd2100c00f0 2024-09-13T15:01:49.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd217400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2101ecfd0 con 0x7fd2100c04d0 2024-09-13T15:01:49.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd214a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2100b0cb0 0x7fd21014b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd214a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2100b0cb0 0x7fd21014b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39230/0 (socket says 172.21.15.7:39230) 2024-09-13T15:01:49.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd214a00640 1 -- 172.21.15.7:0/3429962461 learned_addr learned my addr 172.21.15.7:0/3429962461 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd207e00640 1 --2- 172.21.15.7:0/3429962461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2100c00f0 0x7fd210154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd215400640 1 --2- 172.21.15.7:0/3429962461 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2100c04d0 0x7fd210147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd214a00640 1 -- 172.21.15.7:0/3429962461 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2100c04d0 msgr2=0x7fd210147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd214a00640 1 --2- 172.21.15.7:0/3429962461 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2100c04d0 0x7fd210147110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd214a00640 1 -- 172.21.15.7:0/3429962461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2100c00f0 msgr2=0x7fd210154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd214a00640 1 --2- 172.21.15.7:0/3429962461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2100c00f0 0x7fd210154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd214a00640 1 -- 172.21.15.7:0/3429962461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2000094d0 con 0x7fd2100b0cb0 2024-09-13T15:01:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd215400640 1 --2- 172.21.15.7:0/3429962461 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2100c04d0 0x7fd210147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.400+0000 7fd214a00640 1 --2- 172.21.15.7:0/3429962461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2100b0cb0 0x7fd21014b810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd20001b920 tx=0x7fd20001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.404+0000 7fd20d600640 1 -- 172.21.15.7:0/3429962461 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2000ba600 con 0x7fd2100b0cb0 2024-09-13T15:01:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.404+0000 7fd20d600640 1 -- 172.21.15.7:0/3429962461 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2000ba760 con 0x7fd2100b0cb0 2024-09-13T15:01:49.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.404+0000 7fd20d600640 1 -- 172.21.15.7:0/3429962461 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2000bab10 con 0x7fd2100b0cb0 2024-09-13T15:01:49.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.404+0000 7fd217400640 1 -- 172.21.15.7:0/3429962461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd210153af0 con 0x7fd2100b0cb0 2024-09-13T15:01:49.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.404+0000 7fd217400640 1 -- 172.21.15.7:0/3429962461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd210153d90 con 0x7fd2100b0cb0 2024-09-13T15:01:49.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.404+0000 7fd217400640 1 -- 172.21.15.7:0/3429962461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd210067650 con 0x7fd2100b0cb0 2024-09-13T15:01:49.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.404+0000 7fd20d600640 1 -- 172.21.15.7:0/3429962461 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd2000bac70 con 0x7fd2100b0cb0 2024-09-13T15:01:49.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.404+0000 7fd20d600640 1 --2- 172.21.15.7:0/3429962461 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd1ec0666c0 0x7fd1ec068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.404+0000 7fd20d600640 1 -- 172.21.15.7:0/3429962461 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd2001229e0 con 0x7fd2100b0cb0 2024-09-13T15:01:49.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.404+0000 7fd207e00640 1 --2- 172.21.15.7:0/3429962461 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd1ec0666c0 0x7fd1ec068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.408+0000 7fd207e00640 1 --2- 172.21.15.7:0/3429962461 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd1ec0666c0 0x7fd1ec068b80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd21014a030 tx=0x7fd1f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:49.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.408+0000 7fd20d600640 1 -- 172.21.15.7:0/3429962461 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd2000efa50 con 0x7fd2100b0cb0 2024-09-13T15:01:49.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.604+0000 7fd217400640 1 -- 172.21.15.7:0/3429962461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd210070240 con 0x7fd2100b0cb0 2024-09-13T15:01:49.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.604+0000 7fd20d600640 1 -- 172.21.15.7:0/3429962461 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+6235 (secure 0 0 0) 0x7fd2000f3070 con 0x7fd2100b0cb0 2024-09-13T15:01:49.608 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:01:49.608 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:01:49.230770+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:01:49.608 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 5 2024-09-13T15:01:49.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.608+0000 7fd217400640 1 -- 172.21.15.7:0/3429962461 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd1ec0666c0 msgr2=0x7fd1ec068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:49.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.608+0000 7fd217400640 1 --2- 172.21.15.7:0/3429962461 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd1ec0666c0 0x7fd1ec068b80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd21014a030 tx=0x7fd1f8008040 comp rx=0 tx=0).stop 2024-09-13T15:01:49.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.608+0000 7fd217400640 1 -- 172.21.15.7:0/3429962461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2100b0cb0 msgr2=0x7fd21014b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:49.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.608+0000 7fd217400640 1 --2- 172.21.15.7:0/3429962461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2100b0cb0 0x7fd21014b810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd20001b920 tx=0x7fd20001bab0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.608+0000 7fd217400640 1 -- 172.21.15.7:0/3429962461 shutdown_connections 2024-09-13T15:01:49.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.608+0000 7fd217400640 1 --2- 172.21.15.7:0/3429962461 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd1ec0666c0 0x7fd1ec068b80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.608+0000 7fd217400640 1 --2- 172.21.15.7:0/3429962461 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2100c04d0 0x7fd210147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.608+0000 7fd217400640 1 --2- 172.21.15.7:0/3429962461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2100c00f0 0x7fd210154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.608+0000 7fd217400640 1 --2- 172.21.15.7:0/3429962461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2100b0cb0 0x7fd21014b810 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.608+0000 7fd217400640 1 -- 172.21.15.7:0/3429962461 >> 172.21.15.7:0/3429962461 conn(0x7fd210065d40 msgr2=0x7fd21006d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:49.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.608+0000 7fd217400640 1 -- 172.21.15.7:0/3429962461 shutdown_connections 2024-09-13T15:01:49.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.608+0000 7fd217400640 1 -- 172.21.15.7:0/3429962461 wait complete. 2024-09-13T15:01:49.628 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:01:49.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff2e400640 1 Processor -- start 2024-09-13T15:01:49.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff2e400640 1 -- start start 2024-09-13T15:01:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff2e400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7eff280c5550 0x7eff28157750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff2e400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff280c5930 0x7eff280c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff2e400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7eff280c9370 0x7eff2814d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff2e400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff280c7d90 con 0x7eff280c5550 2024-09-13T15:01:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff2e400640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff280c8070 con 0x7eff280c9370 2024-09-13T15:01:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff2e400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff280c8350 con 0x7eff280c5930 2024-09-13T15:01:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff27400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7eff280c5550 0x7eff28157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff27400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7eff280c5550 0x7eff28157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39246/0 (socket says 172.21.15.7:39246) 2024-09-13T15:01:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff27400640 1 -- 172.21.15.7:0/4266569238 learned_addr learned my addr 172.21.15.7:0/4266569238 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:49.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff27e00640 1 --2- 172.21.15.7:0/4266569238 >> v2:172.21.15.77:3300/0 conn(0x7eff280c9370 0x7eff2814d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff26a00640 1 --2- 172.21.15.7:0/4266569238 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff280c5930 0x7eff280c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff27400640 1 -- 172.21.15.7:0/4266569238 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff280c5930 msgr2=0x7eff280c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:49.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff27400640 1 --2- 172.21.15.7:0/4266569238 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff280c5930 0x7eff280c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff27400640 1 -- 172.21.15.7:0/4266569238 >> v2:172.21.15.77:3300/0 conn(0x7eff280c9370 msgr2=0x7eff2814d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:49.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff27400640 1 --2- 172.21.15.7:0/4266569238 >> v2:172.21.15.77:3300/0 conn(0x7eff280c9370 0x7eff2814d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff27400640 1 -- 172.21.15.7:0/4266569238 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff280c8630 con 0x7eff280c5550 2024-09-13T15:01:49.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.768+0000 7eff27e00640 1 --2- 172.21.15.7:0/4266569238 >> v2:172.21.15.77:3300/0 conn(0x7eff280c9370 0x7eff2814d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:49.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.772+0000 7eff27400640 1 --2- 172.21.15.7:0/4266569238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff280c5550 0x7eff28157750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff28070650 tx=0x7eff1801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6d3f887317fa4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:49.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.772+0000 7eff26000640 1 -- 172.21.15.7:0/4266569238 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180a89d0 con 0x7eff280c5550 2024-09-13T15:01:49.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.772+0000 7eff26000640 1 -- 172.21.15.7:0/4266569238 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff180a8b30 con 0x7eff280c5550 2024-09-13T15:01:49.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.772+0000 7eff26000640 1 -- 172.21.15.7:0/4266569238 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180b0440 con 0x7eff280c5550 2024-09-13T15:01:49.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.772+0000 7eff2e400640 1 -- 172.21.15.7:0/4266569238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff280c5550 msgr2=0x7eff28157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:49.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.772+0000 7eff2e400640 1 --2- 172.21.15.7:0/4266569238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff280c5550 0x7eff28157750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff28070650 tx=0x7eff1801ed10 comp rx=0 tx=0).stop 2024-09-13T15:01:49.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.772+0000 7eff2e400640 1 -- 172.21.15.7:0/4266569238 shutdown_connections 2024-09-13T15:01:49.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.772+0000 7eff2e400640 1 --2- 172.21.15.7:0/4266569238 >> v2:172.21.15.77:3300/0 conn(0x7eff280c9370 0x7eff2814d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.772+0000 7eff2e400640 1 --2- 172.21.15.7:0/4266569238 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff280c5930 0x7eff280c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.772+0000 7eff2e400640 1 --2- 172.21.15.7:0/4266569238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff280c5550 0x7eff28157750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.772+0000 7eff2e400640 1 -- 172.21.15.7:0/4266569238 >> 172.21.15.7:0/4266569238 conn(0x7eff2806e1f0 msgr2=0x7eff2806e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:49.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.772+0000 7eff2e400640 1 -- 172.21.15.7:0/4266569238 shutdown_connections 2024-09-13T15:01:49.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.772+0000 7eff2e400640 1 -- 172.21.15.7:0/4266569238 wait complete. 2024-09-13T15:01:49.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.772+0000 7eff2e400640 1 Processor -- start 2024-09-13T15:01:49.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.772+0000 7eff2e400640 1 -- start start 2024-09-13T15:01:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff2e400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff280c5550 0x7eff281562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff2e400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff280c5930 0x7eff281597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff2e400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff280c9370 0x7eff28159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff2e400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff281f2fe0 con 0x7eff280c5930 2024-09-13T15:01:49.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff2e400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2815a2c0 con 0x7eff280c5550 2024-09-13T15:01:49.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff2e400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff281f2220 con 0x7eff280c9370 2024-09-13T15:01:49.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff26a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff280c5930 0x7eff281597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff26a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff280c5930 0x7eff281597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39252/0 (socket says 172.21.15.7:39252) 2024-09-13T15:01:49.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff26a00640 1 -- 172.21.15.7:0/2201020854 learned_addr learned my addr 172.21.15.7:0/2201020854 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:49.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff27e00640 1 --2- 172.21.15.7:0/2201020854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff280c9370 0x7eff28159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff27400640 1 --2- 172.21.15.7:0/2201020854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff280c5550 0x7eff281562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff26a00640 1 -- 172.21.15.7:0/2201020854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff280c9370 msgr2=0x7eff28159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff26a00640 1 --2- 172.21.15.7:0/2201020854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff280c9370 0x7eff28159ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff26a00640 1 -- 172.21.15.7:0/2201020854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff280c5550 msgr2=0x7eff281562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff26a00640 1 --2- 172.21.15.7:0/2201020854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff280c5550 0x7eff281562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff26a00640 1 -- 172.21.15.7:0/2201020854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff180094d0 con 0x7eff280c5930 2024-09-13T15:01:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff26a00640 1 --2- 172.21.15.7:0/2201020854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff280c5930 0x7eff281597a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7eff1400d7d0 tx=0x7eff1400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff1f400640 1 -- 172.21.15.7:0/2201020854 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14004020 con 0x7eff280c5930 2024-09-13T15:01:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff1f400640 1 -- 172.21.15.7:0/2201020854 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14004180 con 0x7eff280c5930 2024-09-13T15:01:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff2e400640 1 -- 172.21.15.7:0/2201020854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff280668d0 con 0x7eff280c5930 2024-09-13T15:01:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff1f400640 1 -- 172.21.15.7:0/2201020854 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff14004330 con 0x7eff280c5930 2024-09-13T15:01:49.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff2e400640 1 -- 172.21.15.7:0/2201020854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff281f27e0 con 0x7eff280c5930 2024-09-13T15:01:49.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff2e400640 1 -- 172.21.15.7:0/2201020854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff280c79e0 con 0x7eff280c5930 2024-09-13T15:01:49.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.776+0000 7eff1f400640 1 -- 172.21.15.7:0/2201020854 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7eff140096a0 con 0x7eff280c5930 2024-09-13T15:01:49.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.780+0000 7eff1f400640 1 --2- 172.21.15.7:0/2201020854 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7eff080666c0 0x7eff08068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:49.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.780+0000 7eff1f400640 1 -- 172.21.15.7:0/2201020854 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7eff14084800 con 0x7eff280c5930 2024-09-13T15:01:49.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.780+0000 7eff27400640 1 --2- 172.21.15.7:0/2201020854 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7eff080666c0 0x7eff08068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:49.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.780+0000 7eff27400640 1 --2- 172.21.15.7:0/2201020854 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7eff080666c0 0x7eff08068b80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff180b2000 tx=0x7eff18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:49.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.784+0000 7eff1f400640 1 -- 172.21.15.7:0/2201020854 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7eff140517e0 con 0x7eff280c5930 2024-09-13T15:01:49.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.956+0000 7eff2e400640 1 -- 172.21.15.7:0/2201020854 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff280cae00 con 0x7eff280c5930 2024-09-13T15:01:49.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.960+0000 7eff1f400640 1 -- 172.21.15.7:0/2201020854 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18226 (secure 0 0 0) 0x7eff14054e00 con 0x7eff280c5930 2024-09-13T15:01:49.962 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:01:49.962 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:01:49.230530+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:01:49.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.960+0000 7eff2e400640 1 -- 172.21.15.7:0/2201020854 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7eff080666c0 msgr2=0x7eff08068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:49.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.960+0000 7eff2e400640 1 --2- 172.21.15.7:0/2201020854 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7eff080666c0 0x7eff08068b80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7eff180b2000 tx=0x7eff18008040 comp rx=0 tx=0).stop 2024-09-13T15:01:49.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.960+0000 7eff2e400640 1 -- 172.21.15.7:0/2201020854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff280c5930 msgr2=0x7eff281597a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:49.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.960+0000 7eff2e400640 1 --2- 172.21.15.7:0/2201020854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff280c5930 0x7eff281597a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7eff1400d7d0 tx=0x7eff1400dc90 comp rx=0 tx=0).stop 2024-09-13T15:01:49.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.960+0000 7eff2e400640 1 -- 172.21.15.7:0/2201020854 shutdown_connections 2024-09-13T15:01:49.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.960+0000 7eff2e400640 1 --2- 172.21.15.7:0/2201020854 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7eff080666c0 0x7eff08068b80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.960+0000 7eff2e400640 1 --2- 172.21.15.7:0/2201020854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff280c9370 0x7eff28159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.960+0000 7eff2e400640 1 --2- 172.21.15.7:0/2201020854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff280c5930 0x7eff281597a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.960+0000 7eff2e400640 1 --2- 172.21.15.7:0/2201020854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff280c5550 0x7eff281562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:49.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.960+0000 7eff2e400640 1 -- 172.21.15.7:0/2201020854 >> 172.21.15.7:0/2201020854 conn(0x7eff2806e1f0 msgr2=0x7eff280706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:49.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.960+0000 7eff2e400640 1 -- 172.21.15.7:0/2201020854 shutdown_connections 2024-09-13T15:01:49.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:49.960+0000 7eff2e400640 1 -- 172.21.15.7:0/2201020854 wait complete. 2024-09-13T15:01:49.983 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:01:50.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.120+0000 7f90e3600640 1 Processor -- start 2024-09-13T15:01:50.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.120+0000 7f90e3600640 1 -- start start 2024-09-13T15:01:50.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.124+0000 7f90e3600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f90dc153300 0x7f90dc06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.124+0000 7f90e3600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90dc06a0d0 con 0x7f90dc06bbd0 2024-09-13T15:01:50.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.124+0000 7f90e3600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90dc06a370 con 0x7f90dc1536e0 2024-09-13T15:01:50.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.124+0000 7f90e3600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90dc06a650 con 0x7f90dc153300 2024-09-13T15:01:50.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.124+0000 7f90e0c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f90dc153300 0x7f90dc06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.124+0000 7f90e0c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f90dc153300 0x7f90dc06d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39254/0 (socket says 172.21.15.7:39254) 2024-09-13T15:01:50.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.124+0000 7f90e1600640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f90dc06bbd0 0x7f90dc06e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34528/0 (socket says 172.21.15.7:34528) 2024-09-13T15:01:50.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.124+0000 7f90e0c00640 1 -- 172.21.15.7:0/2672429701 learned_addr learned my addr 172.21.15.7:0/2672429701 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:50.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.124+0000 7f90e0c00640 1 -- 172.21.15.7:0/2672429701 >> v1:172.21.15.77:6789/0 conn(0x7f90dc1536e0 legacy=0x7f90dc15d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.124+0000 7f90e0c00640 1 -- 172.21.15.7:0/2672429701 >> v1:172.21.15.7:6789/0 conn(0x7f90dc06bbd0 legacy=0x7f90dc06e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.124+0000 7f90e0c00640 1 -- 172.21.15.7:0/2672429701 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90dc15c8f0 con 0x7f90dc153300 2024-09-13T15:01:50.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.124+0000 7f90db400640 1 -- 172.21.15.7:0/2672429701 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005096612 0 0) 0x7f90dc06a0d0 con 0x7f90dc06bbd0 2024-09-13T15:01:50.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.128+0000 7f90e0c00640 1 --2- 172.21.15.7:0/2672429701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90dc153300 0x7f90dc06d9e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009870 tx=0x7f90d001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c3f7dbda7cee54 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:50.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.128+0000 7f90db400640 1 -- 172.21.15.7:0/2672429701 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d00a8a50 con 0x7f90dc153300 2024-09-13T15:01:50.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.128+0000 7f90db400640 1 -- 172.21.15.7:0/2672429701 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d00a8bb0 con 0x7f90dc153300 2024-09-13T15:01:50.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.128+0000 7f90db400640 1 -- 172.21.15.7:0/2672429701 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d00b0440 con 0x7f90dc153300 2024-09-13T15:01:50.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.128+0000 7f90e3600640 1 -- 172.21.15.7:0/2672429701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90dc153300 msgr2=0x7f90dc06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.128+0000 7f90e3600640 1 --2- 172.21.15.7:0/2672429701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90dc153300 0x7f90dc06d9e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009870 tx=0x7f90d001ed50 comp rx=0 tx=0).stop 2024-09-13T15:01:50.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.128+0000 7f90e3600640 1 -- 172.21.15.7:0/2672429701 shutdown_connections 2024-09-13T15:01:50.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.128+0000 7f90e3600640 1 --2- 172.21.15.7:0/2672429701 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90dc153300 0x7f90dc06d9e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.128+0000 7f90e3600640 1 -- 172.21.15.7:0/2672429701 >> 172.21.15.7:0/2672429701 conn(0x7f90dc071730 msgr2=0x7f90dc071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.128+0000 7f90e3600640 1 -- 172.21.15.7:0/2672429701 shutdown_connections 2024-09-13T15:01:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.128+0000 7f90e3600640 1 -- 172.21.15.7:0/2672429701 wait complete. 2024-09-13T15:01:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.128+0000 7f90e3600640 1 Processor -- start 2024-09-13T15:01:50.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.128+0000 7f90e3600640 1 -- start start 2024-09-13T15:01:50.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e3600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90dc06bbd0 0x7f90dc1ef090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e3600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90dc153300 0x7f90dc0c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e3600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90dc1536e0 0x7f90dc142620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e3600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc154630 con 0x7f90dc06bbd0 2024-09-13T15:01:50.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e3600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc1ef5d0 con 0x7f90dc153300 2024-09-13T15:01:50.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e3600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc1469a0 con 0x7f90dc1536e0 2024-09-13T15:01:50.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90dc06bbd0 0x7f90dc1ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90dc06bbd0 0x7f90dc1ef090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39260/0 (socket says 172.21.15.7:39260) 2024-09-13T15:01:50.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e0c00640 1 -- 172.21.15.7:0/3829813714 learned_addr learned my addr 172.21.15.7:0/3829813714 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:50.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90dbe00640 1 --2- 172.21.15.7:0/3829813714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90dc153300 0x7f90dc0c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e1600640 1 --2- 172.21.15.7:0/3829813714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90dc1536e0 0x7f90dc142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e0c00640 1 -- 172.21.15.7:0/3829813714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90dc1536e0 msgr2=0x7f90dc142620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e0c00640 1 --2- 172.21.15.7:0/3829813714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90dc1536e0 0x7f90dc142620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e0c00640 1 -- 172.21.15.7:0/3829813714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90dc153300 msgr2=0x7f90dc0c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e0c00640 1 --2- 172.21.15.7:0/3829813714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90dc153300 0x7f90dc0c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e0c00640 1 -- 172.21.15.7:0/3829813714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d00094d0 con 0x7f90dc06bbd0 2024-09-13T15:01:50.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90dbe00640 1 --2- 172.21.15.7:0/3829813714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90dc153300 0x7f90dc0c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:50.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e0c00640 1 --2- 172.21.15.7:0/3829813714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90dc06bbd0 0x7f90dc1ef090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90d00b3040 tx=0x7f90d001baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:50.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90d8c00640 1 -- 172.21.15.7:0/3829813714 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d00a8a50 con 0x7f90dc06bbd0 2024-09-13T15:01:50.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90d8c00640 1 -- 172.21.15.7:0/3829813714 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d00bb480 con 0x7f90dc06bbd0 2024-09-13T15:01:50.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90d8c00640 1 -- 172.21.15.7:0/3829813714 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d00bb850 con 0x7f90dc06bbd0 2024-09-13T15:01:50.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e3600640 1 -- 172.21.15.7:0/3829813714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90dc1ee610 con 0x7f90dc06bbd0 2024-09-13T15:01:50.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e3600640 1 -- 172.21.15.7:0/3829813714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90dc153d90 con 0x7f90dc06bbd0 2024-09-13T15:01:50.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90e3600640 1 -- 172.21.15.7:0/3829813714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90dc067650 con 0x7f90dc06bbd0 2024-09-13T15:01:50.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.132+0000 7f90d8c00640 1 -- 172.21.15.7:0/3829813714 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f90d00bb9b0 con 0x7f90dc06bbd0 2024-09-13T15:01:50.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.136+0000 7f90d8c00640 1 --2- 172.21.15.7:0/3829813714 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f90bc0666c0 0x7f90bc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.136+0000 7f90d8c00640 1 -- 172.21.15.7:0/3829813714 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f90d0122bd0 con 0x7f90dc06bbd0 2024-09-13T15:01:50.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.136+0000 7f90dbe00640 1 --2- 172.21.15.7:0/3829813714 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f90bc0666c0 0x7f90bc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.136+0000 7f90dbe00640 1 --2- 172.21.15.7:0/3829813714 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f90bc0666c0 0x7f90bc068b80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f90dc0c32d0 tx=0x7f90c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:50.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.140+0000 7f90d8c00640 1 -- 172.21.15.7:0/3829813714 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f90d00efcd0 con 0x7f90dc06bbd0 2024-09-13T15:01:50.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.300+0000 7f90e3600640 1 -- 172.21.15.7:0/3829813714 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90dc0b28f0 con 0x7f90dc06bbd0 2024-09-13T15:01:50.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.304+0000 7f90d8c00640 1 -- 172.21.15.7:0/3829813714 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18226 (secure 0 0 0) 0x7f90d00b5090 con 0x7f90dc06bbd0 2024-09-13T15:01:50.306 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:01:50.306 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:01:49.230530+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:01:50.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.304+0000 7f90e3600640 1 -- 172.21.15.7:0/3829813714 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f90bc0666c0 msgr2=0x7f90bc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.304+0000 7f90e3600640 1 --2- 172.21.15.7:0/3829813714 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f90bc0666c0 0x7f90bc068b80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f90dc0c32d0 tx=0x7f90c8009040 comp rx=0 tx=0).stop 2024-09-13T15:01:50.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.304+0000 7f90e3600640 1 -- 172.21.15.7:0/3829813714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90dc06bbd0 msgr2=0x7f90dc1ef090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.304+0000 7f90e3600640 1 --2- 172.21.15.7:0/3829813714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90dc06bbd0 0x7f90dc1ef090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f90d00b3040 tx=0x7f90d001baf0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.304+0000 7f90e3600640 1 -- 172.21.15.7:0/3829813714 shutdown_connections 2024-09-13T15:01:50.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.304+0000 7f90e3600640 1 --2- 172.21.15.7:0/3829813714 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f90bc0666c0 0x7f90bc068b80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.304+0000 7f90e3600640 1 --2- 172.21.15.7:0/3829813714 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90dc1536e0 0x7f90dc142620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.304+0000 7f90e3600640 1 --2- 172.21.15.7:0/3829813714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90dc153300 0x7f90dc0c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.304+0000 7f90e3600640 1 --2- 172.21.15.7:0/3829813714 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90dc06bbd0 0x7f90dc1ef090 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.304+0000 7f90e3600640 1 -- 172.21.15.7:0/3829813714 >> 172.21.15.7:0/3829813714 conn(0x7f90dc071730 msgr2=0x7f90dc150320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:50.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.304+0000 7f90e3600640 1 -- 172.21.15.7:0/3829813714 shutdown_connections 2024-09-13T15:01:50.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.304+0000 7f90e3600640 1 -- 172.21.15.7:0/3829813714 wait complete. 2024-09-13T15:01:50.346 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:01:50.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.484+0000 7fb244600640 1 Processor -- start 2024-09-13T15:01:50.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.484+0000 7fb244600640 1 -- start start 2024-09-13T15:01:50.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.484+0000 7fb244600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb23c0c67c0 0x7fb23c0c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.484+0000 7fb244600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb23c0c9ca0 0x7fb23c0ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.484+0000 7fb244600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23c159360 con 0x7fb23c06f390 2024-09-13T15:01:50.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.484+0000 7fb244600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23c159150 con 0x7fb23c0c67c0 2024-09-13T15:01:50.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.484+0000 7fb244600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c159600 con 0x7fb23c0c9ca0 2024-09-13T15:01:50.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.484+0000 7fb241200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb23c0c9ca0 0x7fb23c0ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.484+0000 7fb241c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb23c0c67c0 0x7fb23c0c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.484+0000 7fb242600640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb23c06f390 0x7fb23c0ccdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:39342/0 (socket says 172.21.15.7:39342) 2024-09-13T15:01:50.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.488+0000 7fb242600640 1 -- 172.21.15.7:0/2959877624 learned_addr learned my addr 172.21.15.7:0/2959877624 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:01:50.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.488+0000 7fb241c00640 1 -- 172.21.15.7:0/2959877624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb23c0c9ca0 msgr2=0x7fb23c0ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:50.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.488+0000 7fb241c00640 1 --2- 172.21.15.7:0/2959877624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb23c0c9ca0 0x7fb23c0ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.488+0000 7fb241c00640 1 -- 172.21.15.7:0/2959877624 >> v1:172.21.15.77:6789/0 conn(0x7fb23c06f390 legacy=0x7fb23c0ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.488+0000 7fb241c00640 1 -- 172.21.15.7:0/2959877624 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c1598e0 con 0x7fb23c0c67c0 2024-09-13T15:01:50.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.488+0000 7fb241c00640 1 --2- 172.21.15.7:0/2959877624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb23c0c67c0 0x7fb23c0c8fb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb2300097c0 tx=0x7fb23001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78992dd83ebece08 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:50.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.488+0000 7fb23be00640 1 -- 172.21.15.7:0/2959877624 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300a8990 con 0x7fb23c0c67c0 2024-09-13T15:01:50.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.488+0000 7fb23be00640 1 -- 172.21.15.7:0/2959877624 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2300a8af0 con 0x7fb23c0c67c0 2024-09-13T15:01:50.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.488+0000 7fb23be00640 1 -- 172.21.15.7:0/2959877624 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2300a8e80 con 0x7fb23c0c67c0 2024-09-13T15:01:50.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb244600640 1 -- 172.21.15.7:0/2959877624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb23c0c67c0 msgr2=0x7fb23c0c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb244600640 1 --2- 172.21.15.7:0/2959877624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb23c0c67c0 0x7fb23c0c8fb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb2300097c0 tx=0x7fb23001ec90 comp rx=0 tx=0).stop 2024-09-13T15:01:50.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb244600640 1 -- 172.21.15.7:0/2959877624 shutdown_connections 2024-09-13T15:01:50.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb244600640 1 --2- 172.21.15.7:0/2959877624 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb23c0c9ca0 0x7fb23c0ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb244600640 1 --2- 172.21.15.7:0/2959877624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb23c0c67c0 0x7fb23c0c8fb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb244600640 1 -- 172.21.15.7:0/2959877624 >> 172.21.15.7:0/2959877624 conn(0x7fb23c06cf60 msgr2=0x7fb23c0717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:50.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb244600640 1 -- 172.21.15.7:0/2959877624 shutdown_connections 2024-09-13T15:01:50.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb244600640 1 -- 172.21.15.7:0/2959877624 wait complete. 2024-09-13T15:01:50.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb244600640 1 Processor -- start 2024-09-13T15:01:50.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb244600640 1 -- start start 2024-09-13T15:01:50.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb244600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb23c06f390 0x7fb23c1ee5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb244600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb23c0c67c0 0x7fb23c1f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb244600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb23c0c9ca0 0x7fb23c1562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb244600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c1e4ec0 con 0x7fb23c0c67c0 2024-09-13T15:01:50.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb244600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c1f1b50 con 0x7fb23c0c9ca0 2024-09-13T15:01:50.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb244600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23c1f2110 con 0x7fb23c06f390 2024-09-13T15:01:50.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb241200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb23c0c67c0 0x7fb23c1f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb241200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb23c0c67c0 0x7fb23c1f25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39272/0 (socket says 172.21.15.7:39272) 2024-09-13T15:01:50.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb241200640 1 -- 172.21.15.7:0/2053285847 learned_addr learned my addr 172.21.15.7:0/2053285847 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:50.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb241c00640 1 --2- 172.21.15.7:0/2053285847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb23c06f390 0x7fb23c1ee5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb242600640 1 --2- 172.21.15.7:0/2053285847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb23c0c9ca0 0x7fb23c1562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb241200640 1 -- 172.21.15.7:0/2053285847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb23c06f390 msgr2=0x7fb23c1ee5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb241200640 1 --2- 172.21.15.7:0/2053285847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb23c06f390 0x7fb23c1ee5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb241200640 1 -- 172.21.15.7:0/2053285847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb23c0c9ca0 msgr2=0x7fb23c1562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb241200640 1 --2- 172.21.15.7:0/2053285847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb23c0c9ca0 0x7fb23c1562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.492+0000 7fb241200640 1 -- 172.21.15.7:0/2053285847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb230009420 con 0x7fb23c0c67c0 2024-09-13T15:01:50.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.496+0000 7fb241200640 1 --2- 172.21.15.7:0/2053285847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb23c0c67c0 0x7fb23c1f25a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb22800e8a0 tx=0x7fb22800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:50.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.496+0000 7fb239600640 1 -- 172.21.15.7:0/2053285847 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb228009510 con 0x7fb23c0c67c0 2024-09-13T15:01:50.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.496+0000 7fb239600640 1 -- 172.21.15.7:0/2053285847 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22800c940 con 0x7fb23c0c67c0 2024-09-13T15:01:50.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.496+0000 7fb239600640 1 -- 172.21.15.7:0/2053285847 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22800ccb0 con 0x7fb23c0c67c0 2024-09-13T15:01:50.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.496+0000 7fb244600640 1 -- 172.21.15.7:0/2053285847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb23c154000 con 0x7fb23c0c67c0 2024-09-13T15:01:50.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.496+0000 7fb244600640 1 -- 172.21.15.7:0/2053285847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb23c150830 con 0x7fb23c0c67c0 2024-09-13T15:01:50.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.496+0000 7fb244600640 1 -- 172.21.15.7:0/2053285847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23c0c8fb0 con 0x7fb23c0c67c0 2024-09-13T15:01:50.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.496+0000 7fb239600640 1 -- 172.21.15.7:0/2053285847 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb228013470 con 0x7fb23c0c67c0 2024-09-13T15:01:50.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.496+0000 7fb239600640 1 --2- 172.21.15.7:0/2053285847 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb21c066690 0x7fb21c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.496+0000 7fb239600640 1 -- 172.21.15.7:0/2053285847 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb228084840 con 0x7fb23c0c67c0 2024-09-13T15:01:50.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.496+0000 7fb241c00640 1 --2- 172.21.15.7:0/2053285847 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb21c066690 0x7fb21c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.500+0000 7fb241c00640 1 --2- 172.21.15.7:0/2053285847 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb21c066690 0x7fb21c068b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb2300b2000 tx=0x7fb230008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:50.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.500+0000 7fb239600640 1 -- 172.21.15.7:0/2053285847 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb228051970 con 0x7fb23c0c67c0 2024-09-13T15:01:50.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.696+0000 7fb244600640 1 -- 172.21.15.7:0/2053285847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb23c0c8ae0 con 0x7fb23c0c67c0 2024-09-13T15:01:50.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.696+0000 7fb239600640 1 -- 172.21.15.7:0/2053285847 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+6235 (secure 0 0 0) 0x7fb228054f90 con 0x7fb23c0c67c0 2024-09-13T15:01:50.699 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:01:50.699 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:01:49.230770+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:01:50.699 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 5 2024-09-13T15:01:50.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.696+0000 7fb244600640 1 -- 172.21.15.7:0/2053285847 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb21c066690 msgr2=0x7fb21c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.696+0000 7fb244600640 1 --2- 172.21.15.7:0/2053285847 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb21c066690 0x7fb21c068b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb2300b2000 tx=0x7fb230008040 comp rx=0 tx=0).stop 2024-09-13T15:01:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.696+0000 7fb244600640 1 -- 172.21.15.7:0/2053285847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb23c0c67c0 msgr2=0x7fb23c1f25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.696+0000 7fb244600640 1 --2- 172.21.15.7:0/2053285847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb23c0c67c0 0x7fb23c1f25a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb22800e8a0 tx=0x7fb22800eca0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.696+0000 7fb244600640 1 -- 172.21.15.7:0/2053285847 shutdown_connections 2024-09-13T15:01:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.696+0000 7fb244600640 1 --2- 172.21.15.7:0/2053285847 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb21c066690 0x7fb21c068b50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.696+0000 7fb244600640 1 --2- 172.21.15.7:0/2053285847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb23c0c9ca0 0x7fb23c1562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.696+0000 7fb244600640 1 --2- 172.21.15.7:0/2053285847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb23c0c67c0 0x7fb23c1f25a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.696+0000 7fb244600640 1 --2- 172.21.15.7:0/2053285847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb23c06f390 0x7fb23c1ee5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.696+0000 7fb244600640 1 -- 172.21.15.7:0/2053285847 >> 172.21.15.7:0/2053285847 conn(0x7fb23c06cf60 msgr2=0x7fb23c0cb620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.696+0000 7fb244600640 1 -- 172.21.15.7:0/2053285847 shutdown_connections 2024-09-13T15:01:50.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.696+0000 7fb244600640 1 -- 172.21.15.7:0/2053285847 wait complete. 2024-09-13T15:01:50.720 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:01:50.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9ee6000640 1 Processor -- start 2024-09-13T15:01:50.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9ee6000640 1 -- start start 2024-09-13T15:01:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9ee6000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee00c8fb0 0x7f9ee006f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9ee6000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee0159360 con 0x7f9ee00c67c0 2024-09-13T15:01:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9ee6000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee0159600 con 0x7f9ee006f8d0 2024-09-13T15:01:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9ee6000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee0159150 con 0x7f9ee00c8fb0 2024-09-13T15:01:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9edf400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9ee00c67c0 0x7f9ee00c9ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34542/0 (socket says 172.21.15.7:34542) 2024-09-13T15:01:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9edf400640 1 -- 172.21.15.7:0/2832665488 learned_addr learned my addr 172.21.15.7:0/2832665488 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:01:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9edea00640 1 --2- 172.21.15.7:0/2832665488 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee00c8fb0 0x7f9ee006f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9ede000640 1 -- 172.21.15.7:0/2832665488 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3627634475 0 0) 0x7f9ee0159360 con 0x7f9ee00c67c0 2024-09-13T15:01:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9ede000640 1 -- 172.21.15.7:0/2832665488 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ec4003530 con 0x7f9ee00c67c0 2024-09-13T15:01:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9ede000640 1 -- 172.21.15.7:0/2832665488 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1427940676 0 0) 0x7f9ee0159600 con 0x7f9ee006f8d0 2024-09-13T15:01:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9ede000640 1 -- 172.21.15.7:0/2832665488 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ee0159360 con 0x7f9ee006f8d0 2024-09-13T15:01:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9ede000640 1 -- 172.21.15.7:0/2832665488 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 378158709 0 0) 0x7f9ec4003530 con 0x7f9ee00c67c0 2024-09-13T15:01:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9ede000640 1 -- 172.21.15.7:0/2832665488 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee00c8fb0 msgr2=0x7f9ee006f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9ede000640 1 --2- 172.21.15.7:0/2832665488 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee00c8fb0 0x7f9ee006f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9ede000640 1 -- 172.21.15.7:0/2832665488 >> v1:172.21.15.77:6789/0 conn(0x7f9ee006f8d0 legacy=0x7f9ee00ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9ede000640 1 -- 172.21.15.7:0/2832665488 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee01598e0 con 0x7f9ee00c67c0 2024-09-13T15:01:50.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.860+0000 7f9ede000640 1 -- 172.21.15.7:0/2832665488 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f9ed0001680 con 0x7f9ee00c67c0 2024-09-13T15:01:50.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9ede000640 1 -- 172.21.15.7:0/2832665488 >> v1:172.21.15.7:6789/0 conn(0x7f9ee00c67c0 legacy=0x7f9ee00c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9ede000640 1 --2- 172.21.15.7:0/2832665488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec4003b40 0x7f9ec4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9ede000640 1 --2- 172.21.15.7:0/2832665488 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee00c8fb0 0x7f9ec40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9ede000640 1 --2- 172.21.15.7:0/2832665488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ec4004d10 0x7f9ec4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9ede000640 1 -- 172.21.15.7:0/2832665488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee0159150 con 0x7f9ec4004d10 2024-09-13T15:01:50.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9ede000640 1 -- 172.21.15.7:0/2832665488 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec400ba40 con 0x7f9ec4003b40 2024-09-13T15:01:50.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9ede000640 1 -- 172.21.15.7:0/2832665488 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec400bbb0 con 0x7f9ee00c8fb0 2024-09-13T15:01:50.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9edfe00640 1 --2- 172.21.15.7:0/2832665488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ec4004d10 0x7f9ec4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9edf400640 1 --2- 172.21.15.7:0/2832665488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec4003b40 0x7f9ec4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9edea00640 1 --2- 172.21.15.7:0/2832665488 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee00c8fb0 0x7f9ec40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9edfe00640 1 -- 172.21.15.7:0/2832665488 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee00c8fb0 msgr2=0x7f9ec40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:50.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9edfe00640 1 --2- 172.21.15.7:0/2832665488 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee00c8fb0 0x7f9ec40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9edfe00640 1 -- 172.21.15.7:0/2832665488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec4003b40 msgr2=0x7f9ec4003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:50.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9edfe00640 1 --2- 172.21.15.7:0/2832665488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ec4003b40 0x7f9ec4003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9edfe00640 1 -- 172.21.15.7:0/2832665488 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4003530 con 0x7f9ec4004d10 2024-09-13T15:01:50.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9edfe00640 1 --2- 172.21.15.7:0/2832665488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ec4004d10 0x7f9ec4005190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8001fd0 tx=0x7f9ed801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8670ef20aa5357 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:50.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9ede000640 1 -- 172.21.15.7:0/2832665488 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8003b80 con 0x7f9ec4004d10 2024-09-13T15:01:50.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9ede000640 1 -- 172.21.15.7:0/2832665488 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed8003d00 con 0x7f9ec4004d10 2024-09-13T15:01:50.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.864+0000 7f9ede000640 1 -- 172.21.15.7:0/2832665488 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8005310 con 0x7f9ec4004d10 2024-09-13T15:01:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9ee6000640 1 -- 172.21.15.7:0/2832665488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ec4004d10 msgr2=0x7f9ec4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9ee6000640 1 --2- 172.21.15.7:0/2832665488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ec4004d10 0x7f9ec4005190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8001fd0 tx=0x7f9ed801c900 comp rx=0 tx=0).stop 2024-09-13T15:01:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9edfe00640 1 -- 172.21.15.7:0/2832665488 reap_dead start 2024-09-13T15:01:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9ee6000640 1 -- 172.21.15.7:0/2832665488 shutdown_connections 2024-09-13T15:01:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9ee6000640 1 -- 172.21.15.7:0/2832665488 >> 172.21.15.7:0/2832665488 conn(0x7f9ee006cf60 msgr2=0x7f9ee00717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9ee6000640 1 -- 172.21.15.7:0/2832665488 shutdown_connections 2024-09-13T15:01:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9ee6000640 1 -- 172.21.15.7:0/2832665488 wait complete. 2024-09-13T15:01:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9ee6000640 1 Processor -- start 2024-09-13T15:01:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9ee6000640 1 -- start start 2024-09-13T15:01:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9ee6000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee014fd30 0x7f9ee0154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9ee6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ee0150110 0x7f9ee01546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9ee6000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ee0155860 0x7f9ee014d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9ee6000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00c2760 con 0x7f9ee0150110 2024-09-13T15:01:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9ee6000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee0156940 con 0x7f9ee0155860 2024-09-13T15:01:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9ee6000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee00c3320 con 0x7f9ee014fd30 2024-09-13T15:01:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9edea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ee0150110 0x7f9ee01546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9edea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ee0150110 0x7f9ee01546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39300/0 (socket says 172.21.15.7:39300) 2024-09-13T15:01:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9edea00640 1 -- 172.21.15.7:0/423825438 learned_addr learned my addr 172.21.15.7:0/423825438 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9edf400640 1 --2- 172.21.15.7:0/423825438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee014fd30 0x7f9ee0154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9edfe00640 1 --2- 172.21.15.7:0/423825438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ee0155860 0x7f9ee014d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9edea00640 1 -- 172.21.15.7:0/423825438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee014fd30 msgr2=0x7f9ee0154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9edea00640 1 --2- 172.21.15.7:0/423825438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee014fd30 0x7f9ee0154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9edea00640 1 -- 172.21.15.7:0/423825438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ee0155860 msgr2=0x7f9ee014d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9edea00640 1 --2- 172.21.15.7:0/423825438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ee0155860 0x7f9ee014d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9edea00640 1 -- 172.21.15.7:0/423825438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee0155dc0 con 0x7f9ee0150110 2024-09-13T15:01:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.868+0000 7f9edf400640 1 --2- 172.21.15.7:0/423825438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee014fd30 0x7f9ee0154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.872+0000 7f9edea00640 1 --2- 172.21.15.7:0/423825438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ee0150110 0x7f9ee01546a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0115e0 tx=0x7f9ecc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.872+0000 7f9ed7400640 1 -- 172.21.15.7:0/423825438 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc00f8f0 con 0x7f9ee0150110 2024-09-13T15:01:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.872+0000 7f9ed7400640 1 -- 172.21.15.7:0/423825438 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc00fa50 con 0x7f9ee0150110 2024-09-13T15:01:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.872+0000 7f9ed7400640 1 -- 172.21.15.7:0/423825438 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc00fdc0 con 0x7f9ee0150110 2024-09-13T15:01:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.872+0000 7f9ee6000640 1 -- 172.21.15.7:0/423825438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee01560a0 con 0x7f9ee0150110 2024-09-13T15:01:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.872+0000 7f9ee6000640 1 -- 172.21.15.7:0/423825438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee0156660 con 0x7f9ee0150110 2024-09-13T15:01:50.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.872+0000 7f9ee6000640 1 -- 172.21.15.7:0/423825438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee00caa80 con 0x7f9ee0150110 2024-09-13T15:01:50.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.872+0000 7f9ed7400640 1 -- 172.21.15.7:0/423825438 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ecc015460 con 0x7f9ee0150110 2024-09-13T15:01:50.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.872+0000 7f9ed7400640 1 --2- 172.21.15.7:0/423825438 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9ec00666c0 0x7f9ec0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:50.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.872+0000 7f9ed7400640 1 -- 172.21.15.7:0/423825438 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9ecc084950 con 0x7f9ee0150110 2024-09-13T15:01:50.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.872+0000 7f9edf400640 1 --2- 172.21.15.7:0/423825438 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9ec00666c0 0x7f9ec0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:50.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.876+0000 7f9edf400640 1 --2- 172.21.15.7:0/423825438 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9ec00666c0 0x7f9ec0068b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0001000 tx=0x7f9ed0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:50.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:50.876+0000 7f9ed7400640 1 -- 172.21.15.7:0/423825438 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9ecc051930 con 0x7f9ee0150110 2024-09-13T15:01:51.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:51.040+0000 7f9ee6000640 1 -- 172.21.15.7:0/423825438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ee0156db0 con 0x7f9ee0150110 2024-09-13T15:01:51.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:51.040+0000 7f9ed7400640 1 -- 172.21.15.7:0/423825438 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18226 (secure 0 0 0) 0x7f9ecc054f50 con 0x7f9ee0150110 2024-09-13T15:01:51.043 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:01:51.043 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:01:49.230530+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:01:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:51.040+0000 7f9ee6000640 1 -- 172.21.15.7:0/423825438 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9ec00666c0 msgr2=0x7f9ec0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:51.044+0000 7f9ee6000640 1 --2- 172.21.15.7:0/423825438 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9ec00666c0 0x7f9ec0068b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0001000 tx=0x7f9ed0009040 comp rx=0 tx=0).stop 2024-09-13T15:01:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:51.044+0000 7f9ee6000640 1 -- 172.21.15.7:0/423825438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ee0150110 msgr2=0x7f9ee01546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:51.044+0000 7f9ee6000640 1 --2- 172.21.15.7:0/423825438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ee0150110 0x7f9ee01546a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0115e0 tx=0x7f9ecc011aa0 comp rx=0 tx=0).stop 2024-09-13T15:01:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:51.044+0000 7f9ee6000640 1 -- 172.21.15.7:0/423825438 shutdown_connections 2024-09-13T15:01:51.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:51.044+0000 7f9ee6000640 1 --2- 172.21.15.7:0/423825438 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9ec00666c0 0x7f9ec0068b80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:51.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:51.044+0000 7f9ee6000640 1 --2- 172.21.15.7:0/423825438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ee0155860 0x7f9ee014d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:51.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:51.044+0000 7f9ee6000640 1 --2- 172.21.15.7:0/423825438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ee0150110 0x7f9ee01546a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:51.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:51.044+0000 7f9ee6000640 1 --2- 172.21.15.7:0/423825438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ee014fd30 0x7f9ee0154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:51.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:51.044+0000 7f9ee6000640 1 -- 172.21.15.7:0/423825438 >> 172.21.15.7:0/423825438 conn(0x7f9ee006cf60 msgr2=0x7f9ee00cb930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:51.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:51.044+0000 7f9ee6000640 1 -- 172.21.15.7:0/423825438 shutdown_connections 2024-09-13T15:01:51.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:51.044+0000 7f9ee6000640 1 -- 172.21.15.7:0/423825438 wait complete. 2024-09-13T15:01:51.667 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:01:44.789559+0000', 'modified': '2024-09-13T15:01:49.230770+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.7:6836/2396967179', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 2396967179}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 2396967179}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:01:51.668 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4276:up:creating 2024-09-13T15:01:52.672 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:01:52.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63ce600640 1 Processor -- start 2024-09-13T15:01:52.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63ce600640 1 -- start start 2024-09-13T15:01:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63ce600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f63c80c97d0 0x7f63c806e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63ce600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63c80c9bb0 0x7f63c80cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63ce600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c8159000 con 0x7f63c806dbf0 2024-09-13T15:01:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63ce600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c81592c0 con 0x7f63c80c97d0 2024-09-13T15:01:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63ce600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c81595a0 con 0x7f63c80c9bb0 2024-09-13T15:01:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63cdc00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f63c806dbf0 0x7f63c8152e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:34550/0 (socket says 172.21.15.7:34550) 2024-09-13T15:01:52.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63cdc00640 1 -- 172.21.15.7:0/1254493336 learned_addr learned my addr 172.21.15.7:0/1254493336 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:01:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63cd200640 1 --2- 172.21.15.7:0/1254493336 >> v2:172.21.15.77:3300/0 conn(0x7f63c80c97d0 0x7f63c806e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63c7e00640 1 --2- 172.21.15.7:0/1254493336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63c80c9bb0 0x7f63c80cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63c7400640 1 -- 172.21.15.7:0/1254493336 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973239328 0 0) 0x7f63c8159000 con 0x7f63c806dbf0 2024-09-13T15:01:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63c7400640 1 -- 172.21.15.7:0/1254493336 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63b0003530 con 0x7f63c806dbf0 2024-09-13T15:01:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63cd200640 1 -- 172.21.15.7:0/1254493336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63c80c9bb0 msgr2=0x7f63c80cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63cd200640 1 --2- 172.21.15.7:0/1254493336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63c80c9bb0 0x7f63c80cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63cd200640 1 -- 172.21.15.7:0/1254493336 >> v1:172.21.15.7:6789/0 conn(0x7f63c806dbf0 legacy=0x7f63c8152e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63cd200640 1 -- 172.21.15.7:0/1254493336 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c8159880 con 0x7f63c80c97d0 2024-09-13T15:01:52.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.824+0000 7f63c7e00640 1 --2- 172.21.15.7:0/1254493336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63c80c9bb0 0x7f63c80cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:01:52.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.828+0000 7f63cd200640 1 --2- 172.21.15.7:0/1254493336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c80c97d0 0x7f63c806e1c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0097c0 tx=0x7f63bc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3f397250ac3d1d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.832+0000 7f63c7400640 1 -- 172.21.15.7:0/1254493336 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc0ad640 con 0x7f63c80c97d0 2024-09-13T15:01:52.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.832+0000 7f63c7400640 1 -- 172.21.15.7:0/1254493336 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63bc0ad7a0 con 0x7f63c80c97d0 2024-09-13T15:01:52.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.832+0000 7f63c7400640 1 -- 172.21.15.7:0/1254493336 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc0adb30 con 0x7f63c80c97d0 2024-09-13T15:01:52.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.832+0000 7f63ce600640 1 -- 172.21.15.7:0/1254493336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c80c97d0 msgr2=0x7f63c806e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:52.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.832+0000 7f63ce600640 1 --2- 172.21.15.7:0/1254493336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c80c97d0 0x7f63c806e1c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0097c0 tx=0x7f63bc01c4a0 comp rx=0 tx=0).stop 2024-09-13T15:01:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.832+0000 7f63ce600640 1 -- 172.21.15.7:0/1254493336 shutdown_connections 2024-09-13T15:01:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.832+0000 7f63ce600640 1 --2- 172.21.15.7:0/1254493336 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63c80c9bb0 0x7f63c80cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.832+0000 7f63ce600640 1 --2- 172.21.15.7:0/1254493336 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c80c97d0 0x7f63c806e1c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.832+0000 7f63ce600640 1 -- 172.21.15.7:0/1254493336 >> 172.21.15.7:0/1254493336 conn(0x7f63c8065d40 msgr2=0x7f63c8066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.832+0000 7f63ce600640 1 -- 172.21.15.7:0/1254493336 shutdown_connections 2024-09-13T15:01:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.832+0000 7f63ce600640 1 -- 172.21.15.7:0/1254493336 wait complete. 2024-09-13T15:01:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63ce600640 1 Processor -- start 2024-09-13T15:01:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63ce600640 1 -- start start 2024-09-13T15:01:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63ce600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63c806dbf0 0x7f63c81459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63ce600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63c80c97d0 0x7f63c8144710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63ce600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c80c9bb0 0x7f63c8157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63ce600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c815c430 con 0x7f63c80c97d0 2024-09-13T15:01:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63ce600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c815a510 con 0x7f63c80c9bb0 2024-09-13T15:01:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63ce600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c815be90 con 0x7f63c806dbf0 2024-09-13T15:01:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63c7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63c80c97d0 0x7f63c8144710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63c7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63c80c97d0 0x7f63c8144710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39316/0 (socket says 172.21.15.7:39316) 2024-09-13T15:01:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63c7e00640 1 -- 172.21.15.7:0/12288437 learned_addr learned my addr 172.21.15.7:0/12288437 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63cd200640 1 --2- 172.21.15.7:0/12288437 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63c806dbf0 0x7f63c81459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63cdc00640 1 --2- 172.21.15.7:0/12288437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c80c9bb0 0x7f63c8157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63c7e00640 1 -- 172.21.15.7:0/12288437 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63c806dbf0 msgr2=0x7f63c81459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63c7e00640 1 --2- 172.21.15.7:0/12288437 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63c806dbf0 0x7f63c81459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:52.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63c7e00640 1 -- 172.21.15.7:0/12288437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c80c9bb0 msgr2=0x7f63c8157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:52.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63c7e00640 1 --2- 172.21.15.7:0/12288437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c80c9bb0 0x7f63c8157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:52.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63c7e00640 1 -- 172.21.15.7:0/12288437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b4009420 con 0x7f63c80c97d0 2024-09-13T15:01:52.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63cdc00640 1 --2- 172.21.15.7:0/12288437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c80c9bb0 0x7f63c8157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:52.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63c7e00640 1 --2- 172.21.15.7:0/12288437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63c80c97d0 0x7f63c8144710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f63b400e930 tx=0x7f63b400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:52.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63c4c00640 1 -- 172.21.15.7:0/12288437 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b400ca00 con 0x7f63c80c97d0 2024-09-13T15:01:52.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63c4c00640 1 -- 172.21.15.7:0/12288437 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b400cb60 con 0x7f63c80c97d0 2024-09-13T15:01:52.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63ce600640 1 -- 172.21.15.7:0/12288437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63bc009420 con 0x7f63c80c97d0 2024-09-13T15:01:52.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63c4c00640 1 -- 172.21.15.7:0/12288437 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4013470 con 0x7f63c80c97d0 2024-09-13T15:01:52.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.836+0000 7f63ce600640 1 -- 172.21.15.7:0/12288437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c8157580 con 0x7f63c80c97d0 2024-09-13T15:01:52.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.840+0000 7f63ce600640 1 -- 172.21.15.7:0/12288437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c806e1c0 con 0x7f63c80c97d0 2024-09-13T15:01:52.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.840+0000 7f63c4c00640 1 -- 172.21.15.7:0/12288437 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f63b40135d0 con 0x7f63c80c97d0 2024-09-13T15:01:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.840+0000 7f63c4c00640 1 --2- 172.21.15.7:0/12288437 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f63a8066690 0x7f63a8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.840+0000 7f63c4c00640 1 -- 172.21.15.7:0/12288437 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f63b4084760 con 0x7f63c80c97d0 2024-09-13T15:01:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.840+0000 7f63cd200640 1 --2- 172.21.15.7:0/12288437 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f63a8066690 0x7f63a8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.840+0000 7f63cd200640 1 --2- 172.21.15.7:0/12288437 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f63a8066690 0x7f63a8068b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0af000 tx=0x7f63bc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:52.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:52.844+0000 7f63c4c00640 1 -- 172.21.15.7:0/12288437 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f63b4051740 con 0x7f63c80c97d0 2024-09-13T15:01:53.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.040+0000 7f63ce600640 1 -- 172.21.15.7:0/12288437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63c81636a0 con 0x7f63c80c97d0 2024-09-13T15:01:53.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.040+0000 7f63c4c00640 1 -- 172.21.15.7:0/12288437 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6233 (secure 0 0 0) 0x7f63b4054d60 con 0x7f63c80c97d0 2024-09-13T15:01:53.043 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:01:53.043 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:01:50.818821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T15:01:53.043 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 7 2024-09-13T15:01:53.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.040+0000 7f63ce600640 1 -- 172.21.15.7:0/12288437 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f63a8066690 msgr2=0x7f63a8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:53.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.040+0000 7f63ce600640 1 --2- 172.21.15.7:0/12288437 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f63a8066690 0x7f63a8068b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0af000 tx=0x7f63bc008040 comp rx=0 tx=0).stop 2024-09-13T15:01:53.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.040+0000 7f63ce600640 1 -- 172.21.15.7:0/12288437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63c80c97d0 msgr2=0x7f63c8144710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:53.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.040+0000 7f63ce600640 1 --2- 172.21.15.7:0/12288437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63c80c97d0 0x7f63c8144710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f63b400e930 tx=0x7f63b400edf0 comp rx=0 tx=0).stop 2024-09-13T15:01:53.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.044+0000 7f63ce600640 1 -- 172.21.15.7:0/12288437 shutdown_connections 2024-09-13T15:01:53.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.044+0000 7f63ce600640 1 --2- 172.21.15.7:0/12288437 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f63a8066690 0x7f63a8068b50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.044+0000 7f63ce600640 1 --2- 172.21.15.7:0/12288437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63c80c9bb0 0x7f63c8157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.044+0000 7f63ce600640 1 --2- 172.21.15.7:0/12288437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63c80c97d0 0x7f63c8144710 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.044+0000 7f63ce600640 1 --2- 172.21.15.7:0/12288437 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63c806dbf0 0x7f63c81459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.044+0000 7f63ce600640 1 -- 172.21.15.7:0/12288437 >> 172.21.15.7:0/12288437 conn(0x7f63c8065d40 msgr2=0x7f63c80cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.044+0000 7f63ce600640 1 -- 172.21.15.7:0/12288437 shutdown_connections 2024-09-13T15:01:53.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.044+0000 7f63ce600640 1 -- 172.21.15.7:0/12288437 wait complete. 2024-09-13T15:01:53.668 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:01:44.789559+0000', 'modified': '2024-09-13T15:01:50.818821+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6836/2396967179', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 2396967179}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 2396967179}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-09-13T15:01:53.669 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T15:01:53.669 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T15:01:53.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.812+0000 7f185a000640 1 Processor -- start 2024-09-13T15:01:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.812+0000 7f185a000640 1 -- start start 2024-09-13T15:01:53.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.812+0000 7f185a000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1854151590 0x7f1854157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:53.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.812+0000 7f185a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18540c6130 0x7f18540717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:53.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.812+0000 7f185a000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1854151970 con 0x7f18540c7ea0 2024-09-13T15:01:53.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.812+0000 7f185a000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185415b030 con 0x7f1854151590 2024-09-13T15:01:53.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.812+0000 7f185a000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185415b310 con 0x7f18540c6130 2024-09-13T15:01:53.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.812+0000 7f1853400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1854151590 0x7f1854157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:53.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.812+0000 7f1853400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1854151590 0x7f1854157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39328/0 (socket says 172.21.15.7:39328) 2024-09-13T15:01:53.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.812+0000 7f1853400640 1 -- 172.21.15.7:0/1084474685 learned_addr learned my addr 172.21.15.7:0/1084474685 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:53.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.812+0000 7f1853e00640 1 --2- 172.21.15.7:0/1084474685 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18540c6130 0x7f18540717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:53.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.812+0000 7f1853400640 1 -- 172.21.15.7:0/1084474685 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18540c6130 msgr2=0x7f18540717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:53.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.812+0000 7f1853400640 1 --2- 172.21.15.7:0/1084474685 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18540c6130 0x7f18540717a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:53.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.812+0000 7f1853400640 1 -- 172.21.15.7:0/1084474685 >> v1:172.21.15.77:6789/0 conn(0x7f18540c7ea0 legacy=0x7f185415a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:53.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.812+0000 7f1853400640 1 -- 172.21.15.7:0/1084474685 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1854157340 con 0x7f1854151590 2024-09-13T15:01:53.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.816+0000 7f1853400640 1 --2- 172.21.15.7:0/1084474685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1854151590 0x7f1854157e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1844009e50 tx=0x7f184401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86ca68168a036e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:53.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.816+0000 7f1852a00640 1 -- 172.21.15.7:0/1084474685 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440a57e0 con 0x7f1854151590 2024-09-13T15:01:53.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.816+0000 7f1852a00640 1 -- 172.21.15.7:0/1084474685 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18440a5940 con 0x7f1854151590 2024-09-13T15:01:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.816+0000 7f1852a00640 1 -- 172.21.15.7:0/1084474685 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440a5cd0 con 0x7f1854151590 2024-09-13T15:01:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.816+0000 7f185a000640 1 -- 172.21.15.7:0/1084474685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1854151590 msgr2=0x7f1854157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.816+0000 7f185a000640 1 --2- 172.21.15.7:0/1084474685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1854151590 0x7f1854157e20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1844009e50 tx=0x7f184401ca00 comp rx=0 tx=0).stop 2024-09-13T15:01:53.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.816+0000 7f185a000640 1 -- 172.21.15.7:0/1084474685 shutdown_connections 2024-09-13T15:01:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.816+0000 7f185a000640 1 --2- 172.21.15.7:0/1084474685 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18540c6130 0x7f18540717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.816+0000 7f185a000640 1 --2- 172.21.15.7:0/1084474685 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1854151590 0x7f1854157e20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.816+0000 7f185a000640 1 -- 172.21.15.7:0/1084474685 >> 172.21.15.7:0/1084474685 conn(0x7f18540c7380 msgr2=0x7f18540c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.816+0000 7f185a000640 1 -- 172.21.15.7:0/1084474685 shutdown_connections 2024-09-13T15:01:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.816+0000 7f185a000640 1 -- 172.21.15.7:0/1084474685 wait complete. 2024-09-13T15:01:53.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f185a000640 1 Processor -- start 2024-09-13T15:01:53.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f185a000640 1 -- start start 2024-09-13T15:01:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f185a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18540c6130 0x7f1854149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f185a000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18540c7ea0 0x7f185414a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f185a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1854151590 0x7f185415a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f185a000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1854159ea0 con 0x7f18540c6130 2024-09-13T15:01:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f185a000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185414fbf0 con 0x7f18540c7ea0 2024-09-13T15:01:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f185a000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185414fe00 con 0x7f1854151590 2024-09-13T15:01:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f1853400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18540c6130 0x7f1854149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f1853400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18540c6130 0x7f1854149c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39338/0 (socket says 172.21.15.7:39338) 2024-09-13T15:01:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f1853400640 1 -- 172.21.15.7:0/3183740966 learned_addr learned my addr 172.21.15.7:0/3183740966 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f1853e00640 1 --2- 172.21.15.7:0/3183740966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1854151590 0x7f185415a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f184aa00640 1 --2- 172.21.15.7:0/3183740966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18540c7ea0 0x7f185414a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f1853400640 1 -- 172.21.15.7:0/3183740966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1854151590 msgr2=0x7f185415a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f1853400640 1 --2- 172.21.15.7:0/3183740966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1854151590 0x7f185415a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f1853400640 1 -- 172.21.15.7:0/3183740966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18540c7ea0 msgr2=0x7f185414a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f1853400640 1 --2- 172.21.15.7:0/3183740966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18540c7ea0 0x7f185414a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f1853400640 1 -- 172.21.15.7:0/3183740966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1844009b30 con 0x7f18540c6130 2024-09-13T15:01:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f1853e00640 1 --2- 172.21.15.7:0/3183740966 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1854151590 0x7f185415a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:01:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f1853400640 1 --2- 172.21.15.7:0/3183740966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18540c6130 0x7f1854149c20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f18440af040 tx=0x7f18440197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:53.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f184be00640 1 -- 172.21.15.7:0/3183740966 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440bd070 con 0x7f18540c6130 2024-09-13T15:01:53.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f184be00640 1 -- 172.21.15.7:0/3183740966 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18440b8470 con 0x7f18540c6130 2024-09-13T15:01:53.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f184be00640 1 -- 172.21.15.7:0/3183740966 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18440b8820 con 0x7f18540c6130 2024-09-13T15:01:53.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f185a000640 1 -- 172.21.15.7:0/3183740966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18541500e0 con 0x7f18540c6130 2024-09-13T15:01:53.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.820+0000 7f185a000640 1 -- 172.21.15.7:0/3183740966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1854150960 con 0x7f18540c6130 2024-09-13T15:01:53.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.824+0000 7f184be00640 1 -- 172.21.15.7:0/3183740966 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f18440b8980 con 0x7f18540c6130 2024-09-13T15:01:53.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.824+0000 7f184be00640 1 --2- 172.21.15.7:0/3183740966 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18300666c0 0x7f1830068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:53.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.824+0000 7f184be00640 1 -- 172.21.15.7:0/3183740966 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f184411f250 con 0x7f18540c6130 2024-09-13T15:01:53.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.824+0000 7f184aa00640 1 --2- 172.21.15.7:0/3183740966 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18300666c0 0x7f1830068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:53.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.824+0000 7f185d3aa000 1 Processor -- start 2024-09-13T15:01:53.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.824+0000 7f185d3aa000 1 -- start start 2024-09-13T15:01:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.824+0000 7f184aa00640 1 --2- 172.21.15.7:0/3183740966 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18300666c0 0x7f1830068b80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f18541452d0 tx=0x7f183c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f185d3aa000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c5630 0x563c380c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f185d3aa000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c380c6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f185d3aa000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c6870 0x563c381137e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f185d3aa000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c37f8be80 con 0x563c380c5f50 2024-09-13T15:01:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f185d3aa000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c37f19af0 con 0x563c380c5630 2024-09-13T15:01:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f185d3aa000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c37f170c0 con 0x563c380c6870 2024-09-13T15:01:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f184aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c380c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f184aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c380c6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39352/0 (socket says 172.21.15.7:39352) 2024-09-13T15:01:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f184aa00640 1 -- 172.21.15.7:0/532698303 learned_addr learned my addr 172.21.15.7:0/532698303 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:53.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f1853e00640 1 --2- 172.21.15.7:0/532698303 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c6870 0x563c381137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f1853400640 1 --2- 172.21.15.7:0/532698303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c5630 0x563c380c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f184aa00640 1 -- 172.21.15.7:0/532698303 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c6870 msgr2=0x563c381137e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f184aa00640 1 --2- 172.21.15.7:0/532698303 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c6870 0x563c381137e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f184aa00640 1 -- 172.21.15.7:0/532698303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c5630 msgr2=0x563c380c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f184aa00640 1 --2- 172.21.15.7:0/532698303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c5630 0x563c380c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f184aa00640 1 -- 172.21.15.7:0/532698303 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c37c0e890 con 0x563c380c5f50 2024-09-13T15:01:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f184aa00640 1 --2- 172.21.15.7:0/532698303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c380c6330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f183c001550 tx=0x7f183c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93c4429c24fab47 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f1843e00640 1 -- 172.21.15.7:0/532698303 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c0149d0 con 0x563c380c5f50 2024-09-13T15:01:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f1843e00640 1 -- 172.21.15.7:0/532698303 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c014b30 con 0x563c380c5f50 2024-09-13T15:01:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f1843e00640 1 -- 172.21.15.7:0/532698303 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c014ea0 con 0x563c380c5f50 2024-09-13T15:01:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f185d3aa000 1 -- 172.21.15.7:0/532698303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 msgr2=0x563c380c6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:53.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f185d3aa000 1 --2- 172.21.15.7:0/532698303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c380c6330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f183c001550 tx=0x7f183c012000 comp rx=0 tx=0).stop 2024-09-13T15:01:53.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f185d3aa000 1 -- 172.21.15.7:0/532698303 shutdown_connections 2024-09-13T15:01:53.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f185d3aa000 1 --2- 172.21.15.7:0/532698303 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c6870 0x563c381137e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:53.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f185d3aa000 1 --2- 172.21.15.7:0/532698303 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c380c6330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:53.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f185d3aa000 1 --2- 172.21.15.7:0/532698303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c5630 0x563c380c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:53.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f185d3aa000 1 -- 172.21.15.7:0/532698303 >> 172.21.15.7:0/532698303 conn(0x563c38103500 msgr2=0x563c381058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f185d3aa000 1 -- 172.21.15.7:0/532698303 shutdown_connections 2024-09-13T15:01:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f185d3aa000 1 -- 172.21.15.7:0/532698303 wait complete. 2024-09-13T15:01:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f185d3aa000 1 -- start start 2024-09-13T15:01:53.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.828+0000 7f185d3aa000 1 Processor -- start 2024-09-13T15:01:53.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f185d3aa000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c5630 0x563c381139c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:53.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f185d3aa000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c38113f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f185d3aa000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c6870 0x563c38102320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f185d3aa000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c37f129b0 con 0x563c380c5f50 2024-09-13T15:01:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f185d3aa000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c37eb1c00 con 0x563c380c5630 2024-09-13T15:01:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f185d3aa000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c37ed0070 con 0x563c380c6870 2024-09-13T15:01:53.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f185d3aa000 10 client.0 _ll_register_callbacks cb 0x563c380afae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:01:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f184aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c38113f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f1853400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c5630 0x563c381139c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f184aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c38113f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39368/0 (socket says 172.21.15.7:39368) 2024-09-13T15:01:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f184aa00640 1 -- 172.21.15.7:0/2299127214 learned_addr learned my addr 172.21.15.7:0/2299127214 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:53.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f1853e00640 1 --2- 172.21.15.7:0/2299127214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c6870 0x563c38102320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f184aa00640 1 -- 172.21.15.7:0/2299127214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c6870 msgr2=0x563c38102320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f184aa00640 1 --2- 172.21.15.7:0/2299127214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c6870 0x563c38102320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f184aa00640 1 -- 172.21.15.7:0/2299127214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c5630 msgr2=0x563c381139c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f184aa00640 1 --2- 172.21.15.7:0/2299127214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c5630 0x563c381139c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f184aa00640 1 -- 172.21.15.7:0/2299127214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1854151970 con 0x563c380c5f50 2024-09-13T15:01:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f184aa00640 1 --2- 172.21.15.7:0/2299127214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c38113f00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x563c380b3f90 tx=0x7f183c001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143418c47fbd96a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f1840c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T15:01:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f1840c00640 1 -- 172.21.15.7:0/2299127214 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c020960 con 0x563c380c5f50 2024-09-13T15:01:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f185d3aa000 1 -- 172.21.15.7:0/2299127214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c37ecf5f0 con 0x563c380c5f50 2024-09-13T15:01:53.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f1840c00640 1 -- 172.21.15.7:0/2299127214 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f183c01c040 con 0x563c380c5f50 2024-09-13T15:01:53.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f1840c00640 1 -- 172.21.15.7:0/2299127214 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f183c020ac0 con 0x563c380c5f50 2024-09-13T15:01:53.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f185d3aa000 10 client.4383 fetch_fsmap learned FSMap version 7 2024-09-13T15:01:53.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f185d3aa000 1 -- 172.21.15.7:0/2299127214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x563c37ed7ab0 con 0x563c380c5f50 2024-09-13T15:01:53.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f1840c00640 1 -- 172.21.15.7:0/2299127214 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563c37ecf5f0 con 0x563c380c5f50 2024-09-13T15:01:53.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f1840c00640 1 -- 172.21.15.7:0/2299127214 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 7) v1 ==== 4212+0+0 (secure 0 0 0) 0x7f183c012070 con 0x563c380c5f50 2024-09-13T15:01:53.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f185d3aa000 10 client.4383 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T15:01:53.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f185d3aa000 10 client.4383 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T15:01:53.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f185d3aa000 20 client.4383 populate_metadata read hostname 'smithi007' 2024-09-13T15:01:53.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f185d3aa000 1 --2- 172.21.15.7:0/2299127214 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x563c381118c0 0x563c38111ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:53.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f185d3aa000 4 client.4383 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:01:53.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f185d3aa000 1 -- 172.21.15.7:0/2299127214 --> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c37f0f790 con 0x563c381118c0 2024-09-13T15:01:53.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f1853400640 1 --2- 172.21.15.7:0/2299127214 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x563c381118c0 0x563c38111ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:53.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f1853400640 1 --2- 172.21.15.7:0/2299127214 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x563c381118c0 0x563c38111ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b881309b7140d32 server_cookie=4d5d82e83705e504 in_seq=0 out_seq=0 2024-09-13T15:01:53.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:53.832+0000 7f1840c00640 10 client.4383 ms_handle_connect on v2:172.21.15.7:6834/2396967179 2024-09-13T15:01:55.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.828+0000 7f1840c00640 1 -- 172.21.15.7:0/2299127214 <== mds.0 v2:172.21.15.7:6834/2396967179 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563c37f0f790 con 0x563c381118c0 2024-09-13T15:01:55.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.828+0000 7f1840c00640 10 client.4383 handle_command_reply: tid=0 2024-09-13T15:01:55.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.828+0000 7f185d3aa000 1 client.4383 shutdown 2024-09-13T15:01:55.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.828+0000 7f185d3aa000 1 -- 172.21.15.7:0/2299127214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 msgr2=0x563c38113f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:55.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.828+0000 7f185d3aa000 1 --2- 172.21.15.7:0/2299127214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c38113f00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x563c380b3f90 tx=0x7f183c001090 comp rx=0 tx=0).stop 2024-09-13T15:01:55.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.828+0000 7f185d3aa000 1 -- 172.21.15.7:0/2299127214 shutdown_connections 2024-09-13T15:01:55.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.828+0000 7f185d3aa000 1 --2- 172.21.15.7:0/2299127214 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c6870 0x563c38102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:55.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.828+0000 7f185d3aa000 1 --2- 172.21.15.7:0/2299127214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c38113f00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:55.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.828+0000 7f185d3aa000 1 --2- 172.21.15.7:0/2299127214 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x563c381118c0 0x563c38111ca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:55.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.828+0000 7f185d3aa000 1 --2- 172.21.15.7:0/2299127214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c5630 0x563c381139c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:55.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.828+0000 7f1840c00640 0 client.4383 ms_handle_reset on v2:172.21.15.7:6834/2396967179 2024-09-13T15:01:55.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.828+0000 7f185d3aa000 1 -- 172.21.15.7:0/2299127214 >> 172.21.15.7:0/2299127214 conn(0x563c38103500 msgr2=0x563c381058f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:55.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.828+0000 7f185d3aa000 1 -- 172.21.15.7:0/2299127214 shutdown_connections 2024-09-13T15:01:55.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.828+0000 7f185d3aa000 1 -- 172.21.15.7:0/2299127214 wait complete. 2024-09-13T15:01:55.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.828+0000 7f185d3aa000 20 client.4383 trim_cache size 0 max 16384 2024-09-13T15:01:55.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f185d3aa000 1 Processor -- start 2024-09-13T15:01:55.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f185d3aa000 1 -- start start 2024-09-13T15:01:55.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f185d3aa000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c5630 0x563c38111300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:55.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f185d3aa000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c38101850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:55.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f185d3aa000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c6870 0x563c38101d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:55.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f185d3aa000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c37bcf940 con 0x563c380c5f50 2024-09-13T15:01:55.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f185d3aa000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c37eafc10 con 0x563c380c6870 2024-09-13T15:01:55.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f185d3aa000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c37f074d0 con 0x563c380c5630 2024-09-13T15:01:55.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f184aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c38101850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:55.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f184aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c38101850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39374/0 (socket says 172.21.15.7:39374) 2024-09-13T15:01:55.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f184aa00640 1 -- 172.21.15.7:0/27062279 learned_addr learned my addr 172.21.15.7:0/27062279 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:55.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f1853400640 1 --2- 172.21.15.7:0/27062279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c5630 0x563c38111300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:55.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f1853e00640 1 --2- 172.21.15.7:0/27062279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c6870 0x563c38101d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:55.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f184aa00640 1 -- 172.21.15.7:0/27062279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c5630 msgr2=0x563c38111300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:55.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f184aa00640 1 --2- 172.21.15.7:0/27062279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c5630 0x563c38111300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:55.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f184aa00640 1 -- 172.21.15.7:0/27062279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c6870 msgr2=0x563c38101d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:55.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f184aa00640 1 --2- 172.21.15.7:0/27062279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c6870 0x563c38101d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:55.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f184aa00640 1 -- 172.21.15.7:0/27062279 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c37ebdc00 con 0x563c380c5f50 2024-09-13T15:01:55.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f184aa00640 1 --2- 172.21.15.7:0/27062279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c38101850 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f183c0077f0 tx=0x7f183c029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69eea2673c175bad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:55.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f1848c00640 1 -- 172.21.15.7:0/27062279 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c033a10 con 0x563c380c5f50 2024-09-13T15:01:55.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f1848c00640 1 -- 172.21.15.7:0/27062279 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183c033b70 con 0x563c380c5f50 2024-09-13T15:01:55.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f1848c00640 1 -- 172.21.15.7:0/27062279 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183c033610 con 0x563c380c5f50 2024-09-13T15:01:55.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f185d3aa000 1 -- 172.21.15.7:0/27062279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 msgr2=0x563c38101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:01:55.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f185d3aa000 1 --2- 172.21.15.7:0/27062279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c38101850 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f183c0077f0 tx=0x7f183c029000 comp rx=0 tx=0).stop 2024-09-13T15:01:55.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f185d3aa000 1 -- 172.21.15.7:0/27062279 shutdown_connections 2024-09-13T15:01:55.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f185d3aa000 1 --2- 172.21.15.7:0/27062279 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c6870 0x563c38101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:55.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f185d3aa000 1 --2- 172.21.15.7:0/27062279 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c5f50 0x563c38101850 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:55.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f185d3aa000 1 --2- 172.21.15.7:0/27062279 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c5630 0x563c38111300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:55.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f185d3aa000 1 -- 172.21.15.7:0/27062279 >> 172.21.15.7:0/27062279 conn(0x563c38103500 msgr2=0x563c38101140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:01:55.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f185d3aa000 1 -- 172.21.15.7:0/27062279 shutdown_connections 2024-09-13T15:01:55.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.848+0000 7f185d3aa000 1 -- 172.21.15.7:0/27062279 wait complete. 2024-09-13T15:01:55.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f185d3aa000 1 -- start start 2024-09-13T15:01:55.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f185d3aa000 1 Processor -- start 2024-09-13T15:01:55.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f185d3aa000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c5630 0x563c38119ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:55.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f185d3aa000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c5f50 0x563c3816ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:55.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f185d3aa000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c6870 0x563c3816e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:55.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f185d3aa000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c37f0eeb0 con 0x563c380c6870 2024-09-13T15:01:55.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f185d3aa000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c37ecbf80 con 0x563c380c5f50 2024-09-13T15:01:55.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f185d3aa000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c37f0e1a0 con 0x563c380c5630 2024-09-13T15:01:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f185d3aa000 10 client.0 _ll_register_callbacks cb 0x563c37ecfcb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:01:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f1853e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c6870 0x563c3816e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f1853e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c6870 0x563c3816e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39386/0 (socket says 172.21.15.7:39386) 2024-09-13T15:01:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f1853e00640 1 -- 172.21.15.7:0/1094132075 learned_addr learned my addr 172.21.15.7:0/1094132075 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:01:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f1853400640 1 --2- 172.21.15.7:0/1094132075 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c5630 0x563c38119ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f184aa00640 1 --2- 172.21.15.7:0/1094132075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c5f50 0x563c3816ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f1853e00640 1 -- 172.21.15.7:0/1094132075 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c5630 msgr2=0x563c38119ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f1853e00640 1 --2- 172.21.15.7:0/1094132075 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x563c380c5630 0x563c38119ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f1853e00640 1 -- 172.21.15.7:0/1094132075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c5f50 msgr2=0x563c3816ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:01:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f1853e00640 1 --2- 172.21.15.7:0/1094132075 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c380c5f50 0x563c3816ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:01:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f1853e00640 1 -- 172.21.15.7:0/1094132075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c37ed7ab0 con 0x563c380c6870 2024-09-13T15:01:55.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f1853e00640 1 --2- 172.21.15.7:0/1094132075 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c380c6870 0x563c3816e300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f184c017760 tx=0x7f184c017b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc6224ab4d4b709 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:01:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f1840c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T15:01:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f1840c00640 1 -- 172.21.15.7:0/1094132075 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c01c070 con 0x563c380c6870 2024-09-13T15:01:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f1840c00640 1 -- 172.21.15.7:0/1094132075 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f184c022dc0 con 0x563c380c6870 2024-09-13T15:01:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f185d3aa000 1 -- 172.21.15.7:0/1094132075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c37ee2460 con 0x563c380c6870 2024-09-13T15:01:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f1840c00640 1 -- 172.21.15.7:0/1094132075 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f184c016b20 con 0x563c380c6870 2024-09-13T15:01:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f185d3aa000 10 client.4389 fetch_fsmap learned FSMap version 7 2024-09-13T15:01:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f185d3aa000 1 -- 172.21.15.7:0/1094132075 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x563c37c0ecc0 con 0x563c380c6870 2024-09-13T15:01:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f1840c00640 1 -- 172.21.15.7:0/1094132075 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563c37ee2460 con 0x563c380c6870 2024-09-13T15:01:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f1840c00640 1 -- 172.21.15.7:0/1094132075 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 7) v1 ==== 4212+0+0 (secure 0 0 0) 0x7f184c016c80 con 0x563c380c6870 2024-09-13T15:01:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f185d3aa000 10 client.4389 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T15:01:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f185d3aa000 10 client.4389 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T15:01:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.852+0000 7f185d3aa000 20 client.4389 populate_metadata read hostname 'smithi007' 2024-09-13T15:01:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.856+0000 7f185d3aa000 1 --2- 172.21.15.7:0/1094132075 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x563c3812e570 0x563c3812e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:01:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.856+0000 7f185d3aa000 4 client.4389 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:01:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.856+0000 7f185d3aa000 1 -- 172.21.15.7:0/1094132075 --> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563c37edb9c0 con 0x563c3812e570 2024-09-13T15:01:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.856+0000 7f1853400640 1 --2- 172.21.15.7:0/1094132075 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x563c3812e570 0x563c3812e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.856+0000 7f1840c00640 10 client.4389 ms_handle_connect on v2:172.21.15.7:6834/2396967179 2024-09-13T15:01:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.856+0000 7f1853400640 1 --2- 172.21.15.7:0/1094132075 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x563c3812e570 0x563c3812e950 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7a58a6b0bb2319e server_cookie=b7f456ae34ff23d3 in_seq=0 out_seq=0 2024-09-13T15:01:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.856+0000 7f1853400640 1 -- 172.21.15.7:0/1094132075 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x563c3812e570 msgr2=0x563c3812e950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-09-13T15:01:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.856+0000 7f1853400640 1 -- 172.21.15.7:0/1094132075 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x563c3812e570 msgr2=0x563c3812e950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T15:01:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.856+0000 7f1853400640 1 --2- 172.21.15.7:0/1094132075 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x563c3812e570 0x563c3812e950 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T15:01:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.856+0000 7f1853400640 1 --2- 172.21.15.7:0/1094132075 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x563c3812e570 0x563c3812e950 unknown :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-09-13T15:01:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.856+0000 7f1853400640 1 --2- 172.21.15.7:0/1094132075 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x563c3812e570 0x563c3812e950 unknown :-1 s=BANNER_CONNECTING pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:01:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.856+0000 7f1853400640 1 --2- 172.21.15.7:0/1094132075 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x563c3812e570 0x563c3812e950 crc :-1 s=SESSION_RECONNECTING pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_session_reset received session reset full=1 2024-09-13T15:01:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.856+0000 7f1853400640 1 --2- 172.21.15.7:0/1094132075 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x563c3812e570 0x563c3812e950 crc :-1 s=SESSION_RECONNECTING pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).reset_session 2024-09-13T15:01:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.856+0000 7f1840c00640 0 client.4389 ms_handle_remote_reset on v2:172.21.15.7:6834/2396967179 2024-09-13T15:01:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.856+0000 7f1840c00640 10 client.4389 ms_handle_connect on v2:172.21.15.7:6834/2396967179 2024-09-13T15:01:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:01:55.856+0000 7f1853400640 1 --2- 172.21.15.7:0/1094132075 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x563c3812e570 0x563c3812e950 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d5732a01a1f30d5 server_cookie=cf62411339b6edc in_seq=0 out_seq=0 2024-09-13T15:01:59.728 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-09-13T15:01:59.724+0000 7ff9aa000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:02:12.637 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:02:12.641 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:02:42.710 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:02:42.715 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:03:12.765 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:03:12.769 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:03:42.875 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:03:42.879 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:03:53.701 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-09-13T15:03:54.703 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:03:54.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.849+0000 7fd5f3600640 1 Processor -- start 2024-09-13T15:03:54.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.849+0000 7fd5f3600640 1 -- start start 2024-09-13T15:03:54.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.849+0000 7fd5f3600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd5ec0c04d0 0x7fd5ec06f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:54.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.849+0000 7fd5f3600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ec155ec0 con 0x7fd5ec0b0cb0 2024-09-13T15:03:54.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.849+0000 7fd5f3600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5ec06ff60 con 0x7fd5ec0c00f0 2024-09-13T15:03:54.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.849+0000 7fd5f3600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5ec071000 con 0x7fd5ec0c04d0 2024-09-13T15:03:54.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5f1600640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd5ec0b0cb0 0x7fd5ec14f7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33368/0 (socket says 172.21.15.7:33368) 2024-09-13T15:03:54.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5f1600640 1 -- 172.21.15.7:0/776336249 learned_addr learned my addr 172.21.15.7:0/776336249 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:03:54.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5e3e00640 1 --2- 172.21.15.7:0/776336249 >> v2:172.21.15.77:3300/0 conn(0x7fd5ec0c04d0 0x7fd5ec06f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:54.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5ebe00640 1 -- 172.21.15.7:0/776336249 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086328482 0 0) 0x7fd5ec155ec0 con 0x7fd5ec0b0cb0 2024-09-13T15:03:54.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5ebe00640 1 -- 172.21.15.7:0/776336249 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5d0003530 con 0x7fd5ec0b0cb0 2024-09-13T15:03:54.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5ebe00640 1 -- 172.21.15.7:0/776336249 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 98623599 0 0) 0x7fd5d0003530 con 0x7fd5ec0b0cb0 2024-09-13T15:03:54.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5ebe00640 1 -- 172.21.15.7:0/776336249 >> v2:172.21.15.77:3300/0 conn(0x7fd5ec0c04d0 msgr2=0x7fd5ec06f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:03:54.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5ebe00640 1 --2- 172.21.15.7:0/776336249 >> v2:172.21.15.77:3300/0 conn(0x7fd5ec0c04d0 0x7fd5ec06f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:54.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5ebe00640 1 -- 172.21.15.7:0/776336249 >> v1:172.21.15.77:6789/0 conn(0x7fd5ec0c00f0 legacy=0x7fd5ec0c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:54.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5ebe00640 1 -- 172.21.15.7:0/776336249 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ec156160 con 0x7fd5ec0b0cb0 2024-09-13T15:03:54.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5ebe00640 1 -- 172.21.15.7:0/776336249 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7fd5e4001a00 con 0x7fd5ec0b0cb0 2024-09-13T15:03:54.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5e3e00640 1 --2- 172.21.15.7:0/776336249 >> v2:172.21.15.77:3300/0 conn(0x7fd5ec0c04d0 0x7fd5ec06f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:03:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5ebe00640 1 -- 172.21.15.7:0/776336249 >> v1:172.21.15.7:6789/0 conn(0x7fd5ec0b0cb0 legacy=0x7fd5ec14f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5ebe00640 1 --2- 172.21.15.7:0/776336249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5d0003980 0x7fd5d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5ebe00640 1 --2- 172.21.15.7:0/776336249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5d00047d0 0x7fd5d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5ebe00640 1 --2- 172.21.15.7:0/776336249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5d0005190 0x7fd5d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5ebe00640 1 -- 172.21.15.7:0/776336249 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d000c010 con 0x7fd5d0003980 2024-09-13T15:03:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5ebe00640 1 -- 172.21.15.7:0/776336249 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d000c180 con 0x7fd5d0005190 2024-09-13T15:03:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5ebe00640 1 -- 172.21.15.7:0/776336249 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d000e550 con 0x7fd5d00047d0 2024-09-13T15:03:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5f0c00640 1 --2- 172.21.15.7:0/776336249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5d0003980 0x7fd5d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5f1600640 1 --2- 172.21.15.7:0/776336249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5d0005190 0x7fd5d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5e3e00640 1 --2- 172.21.15.7:0/776336249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5d00047d0 0x7fd5d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5f0c00640 1 -- 172.21.15.7:0/776336249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5d00047d0 msgr2=0x7fd5d0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:03:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5f0c00640 1 --2- 172.21.15.7:0/776336249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5d00047d0 0x7fd5d0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5f0c00640 1 -- 172.21.15.7:0/776336249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5d0005190 msgr2=0x7fd5d000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:03:54.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5f0c00640 1 --2- 172.21.15.7:0/776336249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5d0005190 0x7fd5d000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:54.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5f0c00640 1 -- 172.21.15.7:0/776336249 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d0003530 con 0x7fd5d0003980 2024-09-13T15:03:54.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.853+0000 7fd5f1600640 1 -- 172.21.15.7:0/776336249 reap_dead start 2024-09-13T15:03:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.857+0000 7fd5f0c00640 1 --2- 172.21.15.7:0/776336249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5d0003980 0x7fd5d0003da0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc001780 tx=0x7fd5dc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5704880478eafea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.857+0000 7fd5ebe00640 1 -- 172.21.15.7:0/776336249 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc0052d0 con 0x7fd5d0003980 2024-09-13T15:03:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.857+0000 7fd5ebe00640 1 -- 172.21.15.7:0/776336249 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5dc0a7050 con 0x7fd5d0003980 2024-09-13T15:03:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.857+0000 7fd5ebe00640 1 -- 172.21.15.7:0/776336249 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc003600 con 0x7fd5d0003980 2024-09-13T15:03:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.857+0000 7fd5f3600640 1 -- 172.21.15.7:0/776336249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5d0003980 msgr2=0x7fd5d0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.857+0000 7fd5f3600640 1 --2- 172.21.15.7:0/776336249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5d0003980 0x7fd5d0003da0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc001780 tx=0x7fd5dc01c400 comp rx=0 tx=0).stop 2024-09-13T15:03:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.857+0000 7fd5f3600640 1 -- 172.21.15.7:0/776336249 shutdown_connections 2024-09-13T15:03:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.857+0000 7fd5f3600640 1 --2- 172.21.15.7:0/776336249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5d0003980 0x7fd5d0003da0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.857+0000 7fd5f3600640 1 -- 172.21.15.7:0/776336249 >> 172.21.15.7:0/776336249 conn(0x7fd5ec065d40 msgr2=0x7fd5ec066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:03:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.857+0000 7fd5f3600640 1 -- 172.21.15.7:0/776336249 shutdown_connections 2024-09-13T15:03:54.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.857+0000 7fd5f3600640 1 -- 172.21.15.7:0/776336249 wait complete. 2024-09-13T15:03:54.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.857+0000 7fd5f3600640 1 Processor -- start 2024-09-13T15:03:54.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.857+0000 7fd5f3600640 1 -- start start 2024-09-13T15:03:54.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.857+0000 7fd5f3600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5d0003980 0x7fd5ec14e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:54.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f3600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5ec1ef750 0x7fd5ec14dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:54.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f3600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5ec0c9be0 0x7fd5ec1492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:54.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f3600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec14ebf0 con 0x7fd5d0003980 2024-09-13T15:03:54.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f3600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec14d270 con 0x7fd5ec0c9be0 2024-09-13T15:03:54.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f3600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5ec14ee00 con 0x7fd5ec1ef750 2024-09-13T15:03:54.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5d0003980 0x7fd5ec14e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:54.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5d0003980 0x7fd5ec14e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48014/0 (socket says 172.21.15.7:48014) 2024-09-13T15:03:54.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f0c00640 1 -- 172.21.15.7:0/2628336594 learned_addr learned my addr 172.21.15.7:0/2628336594 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:03:54.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5e3e00640 1 --2- 172.21.15.7:0/2628336594 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5ec1ef750 0x7fd5ec14dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f1600640 1 --2- 172.21.15.7:0/2628336594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5ec0c9be0 0x7fd5ec1492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f0c00640 1 -- 172.21.15.7:0/2628336594 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5ec1ef750 msgr2=0x7fd5ec14dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f0c00640 1 --2- 172.21.15.7:0/2628336594 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5ec1ef750 0x7fd5ec14dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f0c00640 1 -- 172.21.15.7:0/2628336594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5ec0c9be0 msgr2=0x7fd5ec1492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f0c00640 1 --2- 172.21.15.7:0/2628336594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5ec0c9be0 0x7fd5ec1492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f0c00640 1 -- 172.21.15.7:0/2628336594 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ec14f0e0 con 0x7fd5d0003980 2024-09-13T15:03:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5e3e00640 1 --2- 172.21.15.7:0/2628336594 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5ec1ef750 0x7fd5ec14dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:03:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f0c00640 1 --2- 172.21.15.7:0/2628336594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5d0003980 0x7fd5ec14e480 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc01c230 tx=0x7fd5d0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5e9600640 1 -- 172.21.15.7:0/2628336594 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc003e40 con 0x7fd5d0003980 2024-09-13T15:03:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5e9600640 1 -- 172.21.15.7:0/2628336594 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5dc007a40 con 0x7fd5d0003980 2024-09-13T15:03:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5e9600640 1 -- 172.21.15.7:0/2628336594 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc007250 con 0x7fd5d0003980 2024-09-13T15:03:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f3600640 1 -- 172.21.15.7:0/2628336594 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5ec14d480 con 0x7fd5d0003980 2024-09-13T15:03:54.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f3600640 1 -- 172.21.15.7:0/2628336594 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5ec1efbb0 con 0x7fd5d0003980 2024-09-13T15:03:54.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5f3600640 1 -- 172.21.15.7:0/2628336594 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5ec067650 con 0x7fd5d0003980 2024-09-13T15:03:54.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.861+0000 7fd5e9600640 1 -- 172.21.15.7:0/2628336594 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd5dc0073b0 con 0x7fd5d0003980 2024-09-13T15:03:54.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.865+0000 7fd5e9600640 1 --2- 172.21.15.7:0/2628336594 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd5c8066690 0x7fd5c8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:54.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.865+0000 7fd5e9600640 1 -- 172.21.15.7:0/2628336594 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd5dc11eb80 con 0x7fd5d0003980 2024-09-13T15:03:54.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.865+0000 7fd5e3e00640 1 --2- 172.21.15.7:0/2628336594 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd5c8066690 0x7fd5c8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:54.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.865+0000 7fd5e3e00640 1 --2- 172.21.15.7:0/2628336594 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd5c8066690 0x7fd5c8068b50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec14cbb0 tx=0x7fd5d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:54.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:54.869+0000 7fd5e9600640 1 -- 172.21.15.7:0/2628336594 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd5dc0ef490 con 0x7fd5d0003980 2024-09-13T15:03:55.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.061+0000 7fd5f3600640 1 -- 172.21.15.7:0/2628336594 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5ec070240 con 0x7fd5d0003980 2024-09-13T15:03:55.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.061+0000 7fd5e9600640 1 -- 172.21.15.7:0/2628336594 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+6233 (secure 0 0 0) 0x7fd5dc0ef020 con 0x7fd5d0003980 2024-09-13T15:03:55.069 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:03:55.069 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:01:50.818821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-09-13T15:03:55.069 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 7 2024-09-13T15:03:55.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.065+0000 7fd5f3600640 1 -- 172.21.15.7:0/2628336594 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd5c8066690 msgr2=0x7fd5c8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:55.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.065+0000 7fd5f3600640 1 --2- 172.21.15.7:0/2628336594 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd5c8066690 0x7fd5c8068b50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec14cbb0 tx=0x7fd5d4008040 comp rx=0 tx=0).stop 2024-09-13T15:03:55.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.065+0000 7fd5f3600640 1 -- 172.21.15.7:0/2628336594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5d0003980 msgr2=0x7fd5ec14e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:55.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.065+0000 7fd5f3600640 1 --2- 172.21.15.7:0/2628336594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5d0003980 0x7fd5ec14e480 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc01c230 tx=0x7fd5d0005800 comp rx=0 tx=0).stop 2024-09-13T15:03:55.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.065+0000 7fd5f3600640 1 -- 172.21.15.7:0/2628336594 shutdown_connections 2024-09-13T15:03:55.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.065+0000 7fd5f3600640 1 --2- 172.21.15.7:0/2628336594 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd5c8066690 0x7fd5c8068b50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.065+0000 7fd5f3600640 1 --2- 172.21.15.7:0/2628336594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5ec0c9be0 0x7fd5ec1492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.065+0000 7fd5f3600640 1 --2- 172.21.15.7:0/2628336594 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd5ec1ef750 0x7fd5ec14dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.065+0000 7fd5f3600640 1 --2- 172.21.15.7:0/2628336594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd5d0003980 0x7fd5ec14e480 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.065+0000 7fd5f3600640 1 -- 172.21.15.7:0/2628336594 >> 172.21.15.7:0/2628336594 conn(0x7fd5ec065d40 msgr2=0x7fd5ec06d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:03:55.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.065+0000 7fd5f3600640 1 -- 172.21.15.7:0/2628336594 shutdown_connections 2024-09-13T15:03:55.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.065+0000 7fd5f3600640 1 -- 172.21.15.7:0/2628336594 wait complete. 2024-09-13T15:03:55.696 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:01:44.789559+0000', 'modified': '2024-09-13T15:01:50.818821+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6836/2396967179', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 2396967179}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 2396967179}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-09-13T15:03:55.697 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T15:03:55.697 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T15:03:55.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.841+0000 7fa6e1200640 1 Processor -- start 2024-09-13T15:03:55.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.841+0000 7fa6e1200640 1 -- start start 2024-09-13T15:03:55.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.841+0000 7fa6e1200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa6dc0c5550 0x7fa6dc157870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.841+0000 7fa6e1200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa6dc151050 0x7fa6dc0ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.841+0000 7fa6e1200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6dc157db0 con 0x7fa6dc0c5930 2024-09-13T15:03:55.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.841+0000 7fa6e1200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6dc069f30 con 0x7fa6dc151050 2024-09-13T15:03:55.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.841+0000 7fa6e1200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6dc0c9fa0 con 0x7fa6dc0c5550 2024-09-13T15:03:55.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.841+0000 7fa6da800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa6dc151050 0x7fa6dc0ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.841+0000 7fa6da800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa6dc151050 0x7fa6dc0ca6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48020/0 (socket says 172.21.15.7:48020) 2024-09-13T15:03:55.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.841+0000 7fa6da800640 1 -- 172.21.15.7:0/1268155652 learned_addr learned my addr 172.21.15.7:0/1268155652 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:03:55.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.841+0000 7fa6d9e00640 1 --2- 172.21.15.7:0/1268155652 >> v2:172.21.15.77:3300/0 conn(0x7fa6dc0c5550 0x7fa6dc157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.841+0000 7fa6da800640 1 -- 172.21.15.7:0/1268155652 >> v2:172.21.15.77:3300/0 conn(0x7fa6dc0c5550 msgr2=0x7fa6dc157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:03:55.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.841+0000 7fa6da800640 1 --2- 172.21.15.7:0/1268155652 >> v2:172.21.15.77:3300/0 conn(0x7fa6dc0c5550 0x7fa6dc157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.841+0000 7fa6da800640 1 -- 172.21.15.7:0/1268155652 >> v1:172.21.15.77:6789/0 conn(0x7fa6dc0c5930 legacy=0x7fa6dc150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:55.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.841+0000 7fa6da800640 1 -- 172.21.15.7:0/1268155652 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc066c50 con 0x7fa6dc151050 2024-09-13T15:03:55.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.845+0000 7fa6da800640 1 --2- 172.21.15.7:0/1268155652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc151050 0x7fa6dc0ca6d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0c9780 tx=0x7fa6d401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1c296c87593fac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:55.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.845+0000 7fa6d8a00640 1 -- 172.21.15.7:0/1268155652 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40af400 con 0x7fa6dc151050 2024-09-13T15:03:55.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.845+0000 7fa6d8a00640 1 -- 172.21.15.7:0/1268155652 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d40ab050 con 0x7fa6dc151050 2024-09-13T15:03:55.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.845+0000 7fa6d8a00640 1 -- 172.21.15.7:0/1268155652 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40af780 con 0x7fa6dc151050 2024-09-13T15:03:55.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.845+0000 7fa6e1200640 1 -- 172.21.15.7:0/1268155652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc151050 msgr2=0x7fa6dc0ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:55.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.845+0000 7fa6e1200640 1 --2- 172.21.15.7:0/1268155652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc151050 0x7fa6dc0ca6d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0c9780 tx=0x7fa6d401f1e0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.845+0000 7fa6e1200640 1 -- 172.21.15.7:0/1268155652 shutdown_connections 2024-09-13T15:03:55.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.845+0000 7fa6e1200640 1 --2- 172.21.15.7:0/1268155652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc151050 0x7fa6dc0ca6d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.845+0000 7fa6e1200640 1 --2- 172.21.15.7:0/1268155652 >> v2:172.21.15.77:3300/0 conn(0x7fa6dc0c5550 0x7fa6dc157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.845+0000 7fa6e1200640 1 -- 172.21.15.7:0/1268155652 >> 172.21.15.7:0/1268155652 conn(0x7fa6dc06ce10 msgr2=0x7fa6dc06e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:03:55.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.845+0000 7fa6e1200640 1 -- 172.21.15.7:0/1268155652 shutdown_connections 2024-09-13T15:03:55.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.845+0000 7fa6e1200640 1 -- 172.21.15.7:0/1268155652 wait complete. 2024-09-13T15:03:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.845+0000 7fa6e1200640 1 Processor -- start 2024-09-13T15:03:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.845+0000 7fa6e1200640 1 -- start start 2024-09-13T15:03:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6e1200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc0c5550 0x7fa6dc144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6e1200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6dc0c5930 0x7fa6dc1557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6e1200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6dc151050 0x7fa6dc1ef770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6e1200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc14f660 con 0x7fa6dc0c5550 2024-09-13T15:03:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6e1200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc14f0a0 con 0x7fa6dc0c5930 2024-09-13T15:03:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6e1200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc14f380 con 0x7fa6dc151050 2024-09-13T15:03:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6d9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc0c5550 0x7fa6dc144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6d9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc0c5550 0x7fa6dc144050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48026/0 (socket says 172.21.15.7:48026) 2024-09-13T15:03:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6d9e00640 1 -- 172.21.15.7:0/1098871231 learned_addr learned my addr 172.21.15.7:0/1098871231 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:03:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6d9400640 1 --2- 172.21.15.7:0/1098871231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6dc0c5930 0x7fa6dc1557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6da800640 1 --2- 172.21.15.7:0/1098871231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6dc151050 0x7fa6dc1ef770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6d9e00640 1 -- 172.21.15.7:0/1098871231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6dc151050 msgr2=0x7fa6dc1ef770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6d9e00640 1 --2- 172.21.15.7:0/1098871231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6dc151050 0x7fa6dc1ef770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6d9e00640 1 -- 172.21.15.7:0/1098871231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6dc0c5930 msgr2=0x7fa6dc1557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:55.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6d9e00640 1 --2- 172.21.15.7:0/1098871231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6dc0c5930 0x7fa6dc1557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6d9e00640 1 -- 172.21.15.7:0/1098871231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d4009b30 con 0x7fa6dc0c5550 2024-09-13T15:03:55.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6da800640 1 --2- 172.21.15.7:0/1098871231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6dc151050 0x7fa6dc1ef770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:03:55.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6d9e00640 1 --2- 172.21.15.7:0/1098871231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc0c5550 0x7fa6dc144050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc00d800 tx=0x7fa6cc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:55.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6d2000640 1 -- 172.21.15.7:0/1098871231 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc00b6c0 con 0x7fa6dc0c5550 2024-09-13T15:03:55.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6d2000640 1 -- 172.21.15.7:0/1098871231 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6cc00b820 con 0x7fa6dc0c5550 2024-09-13T15:03:55.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6d2000640 1 -- 172.21.15.7:0/1098871231 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc00bb90 con 0x7fa6dc0c5550 2024-09-13T15:03:55.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6e1200640 1 -- 172.21.15.7:0/1098871231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6dc154e00 con 0x7fa6dc0c5550 2024-09-13T15:03:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.849+0000 7fa6e1200640 1 -- 172.21.15.7:0/1098871231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6dc156b90 con 0x7fa6dc0c5550 2024-09-13T15:03:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6d2000640 1 -- 172.21.15.7:0/1098871231 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa6cc00bcf0 con 0x7fa6dc0c5550 2024-09-13T15:03:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6d2000640 1 --2- 172.21.15.7:0/1098871231 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa6bc066690 0x7fa6bc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6d2000640 1 -- 172.21.15.7:0/1098871231 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa6cc084ba0 con 0x7fa6dc0c5550 2024-09-13T15:03:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6e46f1000 1 Processor -- start 2024-09-13T15:03:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6d9400640 1 --2- 172.21.15.7:0/1098871231 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa6bc066690 0x7fa6bc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6e46f1000 1 -- start start 2024-09-13T15:03:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6e46f1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b0600 0x55c4b47b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6e46f1000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0f20 0x55c4b47b1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6e46f1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b1840 0x55c4b47fe7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6e46f1000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4b4676e80 con 0x55c4b47b0f20 2024-09-13T15:03:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6e46f1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4b4604af0 con 0x55c4b47b1840 2024-09-13T15:03:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6e46f1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4b46020c0 con 0x55c4b47b0600 2024-09-13T15:03:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6d9400640 1 --2- 172.21.15.7:0/1098871231 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa6bc066690 0x7fa6bc068b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc14f030 tx=0x7fa6c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6d9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0f20 0x55c4b47b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6d9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0f20 0x55c4b47b1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48040/0 (socket says 172.21.15.7:48040) 2024-09-13T15:03:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6d9400640 1 -- 172.21.15.7:0/2572312759 learned_addr learned my addr 172.21.15.7:0/2572312759 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:03:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6d9e00640 1 --2- 172.21.15.7:0/2572312759 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b0600 0x55c4b47b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6da800640 1 --2- 172.21.15.7:0/2572312759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b1840 0x55c4b47fe7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6d9400640 1 -- 172.21.15.7:0/2572312759 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b0600 msgr2=0x55c4b47b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:03:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6d9400640 1 --2- 172.21.15.7:0/2572312759 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b0600 0x55c4b47b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6d9400640 1 -- 172.21.15.7:0/2572312759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b1840 msgr2=0x55c4b47fe7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:03:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6d9400640 1 --2- 172.21.15.7:0/2572312759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b1840 0x55c4b47fe7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6d9400640 1 -- 172.21.15.7:0/2572312759 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4b42f9890 con 0x55c4b47b0f20 2024-09-13T15:03:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6d9400640 1 --2- 172.21.15.7:0/2572312759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0f20 0x55c4b47b1300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800f870 tx=0x7fa6c8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3561963fde18e88e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6c6a00640 1 -- 172.21.15.7:0/2572312759 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c80149d0 con 0x55c4b47b0f20 2024-09-13T15:03:55.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6c6a00640 1 -- 172.21.15.7:0/2572312759 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c8014b30 con 0x55c4b47b0f20 2024-09-13T15:03:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.853+0000 7fa6c6a00640 1 -- 172.21.15.7:0/2572312759 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8014ea0 con 0x55c4b47b0f20 2024-09-13T15:03:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 -- 172.21.15.7:0/2572312759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0f20 msgr2=0x55c4b47b1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/2572312759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0f20 0x55c4b47b1300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800f870 tx=0x7fa6c8012000 comp rx=0 tx=0).stop 2024-09-13T15:03:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 -- 172.21.15.7:0/2572312759 shutdown_connections 2024-09-13T15:03:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/2572312759 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b1840 0x55c4b47fe7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/2572312759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0f20 0x55c4b47b1300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/2572312759 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b0600 0x55c4b47b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 -- 172.21.15.7:0/2572312759 >> 172.21.15.7:0/2572312759 conn(0x55c4b47ee500 msgr2=0x55c4b47f08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:03:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 -- 172.21.15.7:0/2572312759 shutdown_connections 2024-09-13T15:03:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 -- 172.21.15.7:0/2572312759 wait complete. 2024-09-13T15:03:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 -- start start 2024-09-13T15:03:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 Processor -- start 2024-09-13T15:03:55.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0600 0x55c4b47feb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b0f20 0x55c4b47ff070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b1840 0x55c4b47ed320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4b45fd9b0 con 0x55c4b47b0600 2024-09-13T15:03:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4b459cc00 con 0x55c4b47b0f20 2024-09-13T15:03:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4b45bb070 con 0x55c4b47b1840 2024-09-13T15:03:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 10 client.0 _ll_register_callbacks cb 0x55c4b479aae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:03:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6d9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0600 0x55c4b47feb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6d9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0600 0x55c4b47feb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48050/0 (socket says 172.21.15.7:48050) 2024-09-13T15:03:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6d9e00640 1 -- 172.21.15.7:0/3782475920 learned_addr learned my addr 172.21.15.7:0/3782475920 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:03:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6d9400640 1 --2- 172.21.15.7:0/3782475920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b0f20 0x55c4b47ff070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6da800640 1 --2- 172.21.15.7:0/3782475920 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b1840 0x55c4b47ed320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6d9e00640 1 -- 172.21.15.7:0/3782475920 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b1840 msgr2=0x55c4b47ed320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:03:55.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6d9e00640 1 --2- 172.21.15.7:0/3782475920 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b1840 0x55c4b47ed320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6d9e00640 1 -- 172.21.15.7:0/3782475920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b0f20 msgr2=0x55c4b47ff070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:03:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6d9e00640 1 --2- 172.21.15.7:0/3782475920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b0f20 0x55c4b47ff070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6d9e00640 1 -- 172.21.15.7:0/3782475920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6dc157db0 con 0x55c4b47b0600 2024-09-13T15:03:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6d9400640 1 --2- 172.21.15.7:0/3782475920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b0f20 0x55c4b47ff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:03:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6d9e00640 1 --2- 172.21.15.7:0/3782475920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0600 0x55c4b47feb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc082c70 tx=0x7fa6cc0557a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8da0766e0d2932a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6bb400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T15:03:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6bb400640 1 -- 172.21.15.7:0/3782475920 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc0590b0 con 0x55c4b47b0600 2024-09-13T15:03:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6bb400640 1 -- 172.21.15.7:0/3782475920 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa6cc06d030 con 0x55c4b47b0600 2024-09-13T15:03:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 -- 172.21.15.7:0/3782475920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4b45ba5f0 con 0x55c4b47b0600 2024-09-13T15:03:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6bb400640 1 -- 172.21.15.7:0/3782475920 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6cc059210 con 0x55c4b47b0600 2024-09-13T15:03:55.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 10 client.4407 fetch_fsmap learned FSMap version 7 2024-09-13T15:03:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6e46f1000 1 -- 172.21.15.7:0/3782475920 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c4b45c2ab0 con 0x55c4b47b0600 2024-09-13T15:03:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.857+0000 7fa6bb400640 1 -- 172.21.15.7:0/3782475920 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c4b45ba5f0 con 0x55c4b47b0600 2024-09-13T15:03:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6bb400640 1 -- 172.21.15.7:0/3782475920 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 7) v1 ==== 4212+0+0 (secure 0 0 0) 0x7fa6cc05d6d0 con 0x55c4b47b0600 2024-09-13T15:03:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 10 client.4407 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T15:03:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 10 client.4407 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T15:03:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 20 client.4407 populate_metadata read hostname 'smithi007' 2024-09-13T15:03:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/3782475920 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x55c4b47edbc0 0x55c4b47fba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 4 client.4407 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:03:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 1 -- 172.21.15.7:0/3782475920 --> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c4b45fa790 con 0x55c4b47edbc0 2024-09-13T15:03:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6d9400640 1 --2- 172.21.15.7:0/3782475920 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x55c4b47edbc0 0x55c4b47fba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6bb400640 10 client.4407 ms_handle_connect on v2:172.21.15.7:6834/2396967179 2024-09-13T15:03:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6d9400640 1 --2- 172.21.15.7:0/3782475920 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x55c4b47edbc0 0x55c4b47fba90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4178d36241198a15 server_cookie=c836d3b8ee343c56 in_seq=0 out_seq=0 2024-09-13T15:03:55.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6bb400640 1 -- 172.21.15.7:0/3782475920 <== mds.0 v2:172.21.15.7:6834/2396967179 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c4b45fa790 con 0x55c4b47edbc0 2024-09-13T15:03:55.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6bb400640 10 client.4407 handle_command_reply: tid=0 2024-09-13T15:03:55.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 1 client.4407 shutdown 2024-09-13T15:03:55.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 1 -- 172.21.15.7:0/3782475920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0600 msgr2=0x55c4b47feb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:55.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/3782475920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0600 0x55c4b47feb30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc082c70 tx=0x7fa6cc0557a0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 1 -- 172.21.15.7:0/3782475920 shutdown_connections 2024-09-13T15:03:55.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/3782475920 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b1840 0x55c4b47ed320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/3782475920 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x55c4b47edbc0 0x55c4b47fba90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/3782475920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b0f20 0x55c4b47ff070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/3782475920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0600 0x55c4b47feb30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 1 -- 172.21.15.7:0/3782475920 >> 172.21.15.7:0/3782475920 conn(0x55c4b47ee500 msgr2=0x55c4b47f08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:03:55.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6bb400640 0 client.4407 ms_handle_reset on v2:172.21.15.7:6834/2396967179 2024-09-13T15:03:55.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 1 -- 172.21.15.7:0/3782475920 shutdown_connections 2024-09-13T15:03:55.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 1 -- 172.21.15.7:0/3782475920 wait complete. 2024-09-13T15:03:55.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.861+0000 7fa6e46f1000 20 client.4407 trim_cache size 0 max 16384 2024-09-13T15:03:55.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6e46f1000 1 Processor -- start 2024-09-13T15:03:55.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6e46f1000 1 -- start start 2024-09-13T15:03:55.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6e46f1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b0600 0x55c4b4804970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6e46f1000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0f20 0x55c4b4804eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6e46f1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b1840 0x55c4b480a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6e46f1000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4b42ba940 con 0x55c4b47b0f20 2024-09-13T15:03:55.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6e46f1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4b45fffa0 con 0x55c4b47b1840 2024-09-13T15:03:55.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6e46f1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4b4600510 con 0x55c4b47b0600 2024-09-13T15:03:55.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6d9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0f20 0x55c4b4804eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6d9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0f20 0x55c4b4804eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48066/0 (socket says 172.21.15.7:48066) 2024-09-13T15:03:55.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6d9400640 1 -- 172.21.15.7:0/2489558173 learned_addr learned my addr 172.21.15.7:0/2489558173 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:03:55.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6d9e00640 1 --2- 172.21.15.7:0/2489558173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b0600 0x55c4b4804970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6da800640 1 --2- 172.21.15.7:0/2489558173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b1840 0x55c4b480a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6d9400640 1 -- 172.21.15.7:0/2489558173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b0600 msgr2=0x55c4b4804970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:03:55.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6d9400640 1 --2- 172.21.15.7:0/2489558173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b0600 0x55c4b4804970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6d9400640 1 -- 172.21.15.7:0/2489558173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b1840 msgr2=0x55c4b480a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:03:55.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6d9400640 1 --2- 172.21.15.7:0/2489558173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b1840 0x55c4b480a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6d9400640 1 -- 172.21.15.7:0/2489558173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4b45a8c00 con 0x55c4b47b0f20 2024-09-13T15:03:55.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6d9e00640 1 --2- 172.21.15.7:0/2489558173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b0600 0x55c4b4804970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:03:55.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6da800640 1 --2- 172.21.15.7:0/2489558173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b1840 0x55c4b480a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:03:55.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6d9400640 1 --2- 172.21.15.7:0/2489558173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0f20 0x55c4b4804eb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8023040 tx=0x7fa6c8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d163dee8a1fb466 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:55.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.877+0000 7fa6c7400640 1 -- 172.21.15.7:0/2489558173 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8020610 con 0x55c4b47b0f20 2024-09-13T15:03:55.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6c7400640 1 -- 172.21.15.7:0/2489558173 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6c8020770 con 0x55c4b47b0f20 2024-09-13T15:03:55.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6c7400640 1 -- 172.21.15.7:0/2489558173 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8020b20 con 0x55c4b47b0f20 2024-09-13T15:03:55.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 -- 172.21.15.7:0/2489558173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0f20 msgr2=0x55c4b4804eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:55.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/2489558173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0f20 0x55c4b4804eb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8023040 tx=0x7fa6c8015000 comp rx=0 tx=0).stop 2024-09-13T15:03:55.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 -- 172.21.15.7:0/2489558173 shutdown_connections 2024-09-13T15:03:55.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/2489558173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b1840 0x55c4b480a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/2489558173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b0f20 0x55c4b4804eb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/2489558173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b0600 0x55c4b4804970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 -- 172.21.15.7:0/2489558173 >> 172.21.15.7:0/2489558173 conn(0x55c4b47ee500 msgr2=0x55c4b480e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:03:55.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 -- 172.21.15.7:0/2489558173 shutdown_connections 2024-09-13T15:03:55.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 -- 172.21.15.7:0/2489558173 wait complete. 2024-09-13T15:03:55.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 -- start start 2024-09-13T15:03:55.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 Processor -- start 2024-09-13T15:03:55.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b0600 0x55c4b480db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b0f20 0x55c4b48591b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b1840 0x55c4b48596f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4b45ad1f0 con 0x55c4b47b1840 2024-09-13T15:03:55.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4b45c4c60 con 0x55c4b47b0f20 2024-09-13T15:03:55.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4b46405f0 con 0x55c4b47b0600 2024-09-13T15:03:55.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 10 client.0 _ll_register_callbacks cb 0x55c4b477ae00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:03:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6da800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b1840 0x55c4b48596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6d9e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b0600 0x55c4b480db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6da800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b1840 0x55c4b48596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48072/0 (socket says 172.21.15.7:48072) 2024-09-13T15:03:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6da800640 1 -- 172.21.15.7:0/742294142 learned_addr learned my addr 172.21.15.7:0/742294142 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:03:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6d9400640 1 --2- 172.21.15.7:0/742294142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b0f20 0x55c4b48591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6da800640 1 -- 172.21.15.7:0/742294142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b0600 msgr2=0x55c4b480db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:03:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6da800640 1 --2- 172.21.15.7:0/742294142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b0600 0x55c4b480db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6da800640 1 -- 172.21.15.7:0/742294142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b0f20 msgr2=0x55c4b48591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:03:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6da800640 1 --2- 172.21.15.7:0/742294142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b0f20 0x55c4b48591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6da800640 1 -- 172.21.15.7:0/742294142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4b42f9890 con 0x55c4b47b1840 2024-09-13T15:03:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6d9400640 1 --2- 172.21.15.7:0/742294142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b0f20 0x55c4b48591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:03:55.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6da800640 1 --2- 172.21.15.7:0/742294142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b1840 0x55c4b48596f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4025f30 tx=0x7fa6d401da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee8d40273cbe7c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:55.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6bb400640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T15:03:55.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6bb400640 1 -- 172.21.15.7:0/742294142 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40be070 con 0x55c4b47b1840 2024-09-13T15:03:55.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 -- 172.21.15.7:0/742294142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4b45cd460 con 0x55c4b47b1840 2024-09-13T15:03:55.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6bb400640 1 -- 172.21.15.7:0/742294142 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa6d40091b0 con 0x55c4b47b1840 2024-09-13T15:03:55.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6bb400640 1 -- 172.21.15.7:0/742294142 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6d40b9990 con 0x55c4b47b1840 2024-09-13T15:03:55.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 10 client.4413 fetch_fsmap learned FSMap version 7 2024-09-13T15:03:55.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.881+0000 7fa6e46f1000 1 -- 172.21.15.7:0/742294142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c4b42f9cc0 con 0x55c4b47b1840 2024-09-13T15:03:55.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6bb400640 1 -- 172.21.15.7:0/742294142 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c4b45cd460 con 0x55c4b47b1840 2024-09-13T15:03:55.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6bb400640 1 -- 172.21.15.7:0/742294142 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 7) v1 ==== 4212+0+0 (secure 0 0 0) 0x7fa6d40b9af0 con 0x55c4b47b1840 2024-09-13T15:03:55.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 10 client.4413 fetch_fsmap finished waiting for FSMap version 7 2024-09-13T15:03:55.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 10 client.4413 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T15:03:55.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 20 client.4413 populate_metadata read hostname 'smithi007' 2024-09-13T15:03:55.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/742294142 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x55c4b4859c30 0x55c4b4852a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 4 client.4413 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:03:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 1 -- 172.21.15.7:0/742294142 --> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c4b45c69c0 con 0x55c4b4859c30 2024-09-13T15:03:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6d9e00640 1 --2- 172.21.15.7:0/742294142 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x55c4b4859c30 0x55c4b4852a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6d9e00640 1 --2- 172.21.15.7:0/742294142 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x55c4b4859c30 0x55c4b4852a70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a21a60a45b1bafe server_cookie=80d78f990ccd1cee in_seq=0 out_seq=0 2024-09-13T15:03:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6bb400640 10 client.4413 ms_handle_connect on v2:172.21.15.7:6834/2396967179 2024-09-13T15:03:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6bb400640 1 -- 172.21.15.7:0/742294142 <== mds.0 v2:172.21.15.7:6834/2396967179 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55c4b45c69c0 con 0x55c4b4859c30 2024-09-13T15:03:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6bb400640 10 client.4413 handle_command_reply: tid=0 2024-09-13T15:03:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 1 client.4413 shutdown 2024-09-13T15:03:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 1 -- 172.21.15.7:0/742294142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b1840 msgr2=0x55c4b48596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:55.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/742294142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b1840 0x55c4b48596f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4025f30 tx=0x7fa6d401da20 comp rx=0 tx=0).stop 2024-09-13T15:03:55.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 1 -- 172.21.15.7:0/742294142 shutdown_connections 2024-09-13T15:03:55.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/742294142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c4b47b1840 0x55c4b48596f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/742294142 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x55c4b4859c30 0x55c4b4852a70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/742294142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c4b47b0f20 0x55c4b48591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 1 --2- 172.21.15.7:0/742294142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55c4b47b0600 0x55c4b480db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6bb400640 0 client.4413 ms_handle_reset on v2:172.21.15.7:6834/2396967179 2024-09-13T15:03:55.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 1 -- 172.21.15.7:0/742294142 >> 172.21.15.7:0/742294142 conn(0x55c4b47ee500 msgr2=0x55c4b4805610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:03:55.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 1 -- 172.21.15.7:0/742294142 shutdown_connections 2024-09-13T15:03:55.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 1 -- 172.21.15.7:0/742294142 wait complete. 2024-09-13T15:03:55.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e46f1000 20 client.4413 trim_cache size 0 max 16384 2024-09-13T15:03:55.904 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T15:03:55.904 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "92e6844f-41e8-44ce-a6e6-13b9cf520744", 2024-09-13T15:03:55.905 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-09-13T15:03:55.905 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4276, 2024-09-13T15:03:55.905 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-13T15:03:55.905 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-13T15:03:55.905 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-13T15:03:55.906 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 131.09674953499999, 2024-09-13T15:03:55.906 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 6, 2024-09-13T15:03:55.906 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 27, 2024-09-13T15:03:55.906 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 25, 2024-09-13T15:03:55.906 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 137.15400985100001 2024-09-13T15:03:55.907 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T15:03:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e1200640 1 -- 172.21.15.7:0/1098871231 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa6bc066690 msgr2=0x7fa6bc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e1200640 1 --2- 172.21.15.7:0/1098871231 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa6bc066690 0x7fa6bc068b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc14f030 tx=0x7fa6c8009040 comp rx=0 tx=0).stop 2024-09-13T15:03:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e1200640 1 -- 172.21.15.7:0/1098871231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc0c5550 msgr2=0x7fa6dc144050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e1200640 1 --2- 172.21.15.7:0/1098871231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc0c5550 0x7fa6dc144050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc00d800 tx=0x7fa6cc00dcc0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e1200640 1 -- 172.21.15.7:0/1098871231 shutdown_connections 2024-09-13T15:03:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e1200640 1 --2- 172.21.15.7:0/1098871231 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa6bc066690 0x7fa6bc068b50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e1200640 1 --2- 172.21.15.7:0/1098871231 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa6dc151050 0x7fa6dc1ef770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e1200640 1 --2- 172.21.15.7:0/1098871231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6dc0c5930 0x7fa6dc1557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e1200640 1 --2- 172.21.15.7:0/1098871231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa6dc0c5550 0x7fa6dc144050 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:55.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e1200640 1 -- 172.21.15.7:0/1098871231 >> 172.21.15.7:0/1098871231 conn(0x7fa6dc06ce10 msgr2=0x7fa6dc06e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:03:55.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e1200640 1 -- 172.21.15.7:0/1098871231 shutdown_connections 2024-09-13T15:03:55.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:55.885+0000 7fa6e1200640 1 -- 172.21.15.7:0/1098871231 wait complete. 2024-09-13T15:03:55.911 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T15:03:55.911 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:03:55.912 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:03:56.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.045+0000 7f3328400640 1 Processor -- start 2024-09-13T15:03:56.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.045+0000 7f3328400640 1 -- start start 2024-09-13T15:03:56.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f3328400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f332015ce20 0x7f3320152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:56.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f3328400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3320159d10 con 0x7f332006da80 2024-09-13T15:03:56.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f3328400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33200c6510 con 0x7f332006de60 2024-09-13T15:03:56.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f3328400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3320159120 con 0x7f332015ce20 2024-09-13T15:03:56.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f3325a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f332006da80 0x7f33200c5c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33380/0 (socket says 172.21.15.7:33380) 2024-09-13T15:03:56.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f3325a00640 1 -- 172.21.15.7:0/1418341393 learned_addr learned my addr 172.21.15.7:0/1418341393 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:03:56.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f3326400640 1 --2- 172.21.15.7:0/1418341393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f332015ce20 0x7f3320152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:56.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f331fe00640 1 -- 172.21.15.7:0/1418341393 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083499426 0 0) 0x7f3320159d10 con 0x7f332006da80 2024-09-13T15:03:56.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f331fe00640 1 -- 172.21.15.7:0/1418341393 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3308003530 con 0x7f332006da80 2024-09-13T15:03:56.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f331fe00640 1 -- 172.21.15.7:0/1418341393 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749231565 0 0) 0x7f33200c6510 con 0x7f332006de60 2024-09-13T15:03:56.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f331fe00640 1 -- 172.21.15.7:0/1418341393 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3320159d10 con 0x7f332006de60 2024-09-13T15:03:56.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f331fe00640 1 -- 172.21.15.7:0/1418341393 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2321038047 0 0) 0x7f3308003530 con 0x7f332006da80 2024-09-13T15:03:56.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f331fe00640 1 -- 172.21.15.7:0/1418341393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f332015ce20 msgr2=0x7f3320152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:03:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f331fe00640 1 --2- 172.21.15.7:0/1418341393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f332015ce20 0x7f3320152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f331fe00640 1 -- 172.21.15.7:0/1418341393 >> v1:172.21.15.77:6789/0 conn(0x7f332006de60 legacy=0x7f332015c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f331fe00640 1 -- 172.21.15.7:0/1418341393 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33201593e0 con 0x7f332006da80 2024-09-13T15:03:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f331fe00640 1 -- 172.21.15.7:0/1418341393 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f3314001680 con 0x7f332006da80 2024-09-13T15:03:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f331fe00640 1 -- 172.21.15.7:0/1418341393 >> v1:172.21.15.7:6789/0 conn(0x7f332006da80 legacy=0x7f33200c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f331fe00640 1 --2- 172.21.15.7:0/1418341393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f332015ce20 0x7f3308003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f331fe00640 1 --2- 172.21.15.7:0/1418341393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33080040a0 0x7f33080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f331fe00640 1 --2- 172.21.15.7:0/1418341393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3308004d10 0x7f3308005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f331fe00640 1 -- 172.21.15.7:0/1418341393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3320159120 con 0x7f33080040a0 2024-09-13T15:03:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f331fe00640 1 -- 172.21.15.7:0/1418341393 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330800bb20 con 0x7f3308004d10 2024-09-13T15:03:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f331fe00640 1 -- 172.21.15.7:0/1418341393 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330800bcb0 con 0x7f332015ce20 2024-09-13T15:03:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f3325000640 1 --2- 172.21.15.7:0/1418341393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33080040a0 0x7f33080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:56.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f3325a00640 1 --2- 172.21.15.7:0/1418341393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f332015ce20 0x7f3308003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:56.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f3326400640 1 --2- 172.21.15.7:0/1418341393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3308004d10 0x7f3308005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:56.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f3325000640 1 -- 172.21.15.7:0/1418341393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f332015ce20 msgr2=0x7f3308003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:03:56.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f3325000640 1 --2- 172.21.15.7:0/1418341393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f332015ce20 0x7f3308003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:56.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f3325000640 1 -- 172.21.15.7:0/1418341393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3308004d10 msgr2=0x7f3308005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:03:56.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f3325000640 1 --2- 172.21.15.7:0/1418341393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3308004d10 0x7f3308005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:56.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.049+0000 7f3325000640 1 -- 172.21.15.7:0/1418341393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3308003530 con 0x7f33080040a0 2024-09-13T15:03:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.053+0000 7f3325000640 1 --2- 172.21.15.7:0/1418341393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33080040a0 0x7f33080047d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f330c0018d0 tx=0x7f330c01c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33737076f2131a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.053+0000 7f331fe00640 1 -- 172.21.15.7:0/1418341393 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c0052d0 con 0x7f33080040a0 2024-09-13T15:03:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.053+0000 7f331fe00640 1 -- 172.21.15.7:0/1418341393 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c005450 con 0x7f33080040a0 2024-09-13T15:03:56.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.053+0000 7f331fe00640 1 -- 172.21.15.7:0/1418341393 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c003840 con 0x7f33080040a0 2024-09-13T15:03:56.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.053+0000 7f3328400640 1 -- 172.21.15.7:0/1418341393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33080040a0 msgr2=0x7f33080047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:56.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.053+0000 7f3328400640 1 --2- 172.21.15.7:0/1418341393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33080040a0 0x7f33080047d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f330c0018d0 tx=0x7f330c01c550 comp rx=0 tx=0).stop 2024-09-13T15:03:56.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.053+0000 7f3326400640 1 -- 172.21.15.7:0/1418341393 reap_dead start 2024-09-13T15:03:56.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.053+0000 7f3328400640 1 -- 172.21.15.7:0/1418341393 shutdown_connections 2024-09-13T15:03:56.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.053+0000 7f3328400640 1 -- 172.21.15.7:0/1418341393 >> 172.21.15.7:0/1418341393 conn(0x7f332006c330 msgr2=0x7f33200cb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:03:56.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.053+0000 7f3328400640 1 -- 172.21.15.7:0/1418341393 shutdown_connections 2024-09-13T15:03:56.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.053+0000 7f3328400640 1 -- 172.21.15.7:0/1418341393 wait complete. 2024-09-13T15:03:56.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.053+0000 7f3328400640 1 Processor -- start 2024-09-13T15:03:56.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.053+0000 7f3328400640 1 -- start start 2024-09-13T15:03:56.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3328400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33080040a0 0x7f332014fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:56.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3328400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33201502f0 0x7f3320150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:56.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3328400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3320151000 0x7f33200ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:56.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3328400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33200c4950 con 0x7f33080040a0 2024-09-13T15:03:56.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3328400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33201f5e50 con 0x7f3320151000 2024-09-13T15:03:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3328400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33201f6380 con 0x7f33201502f0 2024-09-13T15:03:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3325a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33080040a0 0x7f332014fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3325a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33080040a0 0x7f332014fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48088/0 (socket says 172.21.15.7:48088) 2024-09-13T15:03:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3325a00640 1 -- 172.21.15.7:0/4238061726 learned_addr learned my addr 172.21.15.7:0/4238061726 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:03:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3325000640 1 --2- 172.21.15.7:0/4238061726 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33201502f0 0x7f3320150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3326400640 1 --2- 172.21.15.7:0/4238061726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3320151000 0x7f33200ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3325a00640 1 -- 172.21.15.7:0/4238061726 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33201502f0 msgr2=0x7f3320150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3325a00640 1 --2- 172.21.15.7:0/4238061726 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33201502f0 0x7f3320150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3325a00640 1 -- 172.21.15.7:0/4238061726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3320151000 msgr2=0x7f33200ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3325a00640 1 --2- 172.21.15.7:0/4238061726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3320151000 0x7f33200ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3325a00640 1 -- 172.21.15.7:0/4238061726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33201f2e30 con 0x7f33080040a0 2024-09-13T15:03:56.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3325a00640 1 --2- 172.21.15.7:0/4238061726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33080040a0 0x7f332014fdb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3314007370 tx=0x7f3314007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:56.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f331d600640 1 -- 172.21.15.7:0/4238061726 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331400f960 con 0x7f33080040a0 2024-09-13T15:03:56.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f331d600640 1 -- 172.21.15.7:0/4238061726 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331400fac0 con 0x7f33080040a0 2024-09-13T15:03:56.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f331d600640 1 -- 172.21.15.7:0/4238061726 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331400fe70 con 0x7f33080040a0 2024-09-13T15:03:56.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3328400640 1 -- 172.21.15.7:0/4238061726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33201f60a0 con 0x7f33080040a0 2024-09-13T15:03:56.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3328400640 1 -- 172.21.15.7:0/4238061726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33201f2350 con 0x7f33080040a0 2024-09-13T15:03:56.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f3328400640 1 -- 172.21.15.7:0/4238061726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f332015c710 con 0x7f33080040a0 2024-09-13T15:03:56.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.057+0000 7f331d600640 1 -- 172.21.15.7:0/4238061726 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f331401d360 con 0x7f33080040a0 2024-09-13T15:03:56.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.061+0000 7f331d600640 1 --2- 172.21.15.7:0/4238061726 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3300066690 0x7f3300068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:56.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.061+0000 7f331d600640 1 -- 172.21.15.7:0/4238061726 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3314083c90 con 0x7f33080040a0 2024-09-13T15:03:56.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.061+0000 7f3325000640 1 --2- 172.21.15.7:0/4238061726 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3300066690 0x7f3300068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:56.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.061+0000 7f3325000640 1 --2- 172.21.15.7:0/4238061726 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3300066690 0x7f3300068b50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f330c0ad000 tx=0x7f330c0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:56.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.065+0000 7f331d600640 1 -- 172.21.15.7:0/4238061726 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3314050ce0 con 0x7f33080040a0 2024-09-13T15:03:56.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.261+0000 7f3328400640 1 -- 172.21.15.7:0/4238061726 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f33200c5170 con 0x7f33080040a0 2024-09-13T15:03:56.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.261+0000 7f331d600640 1 -- 172.21.15.7:0/4238061726 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f331401a020 con 0x7f33080040a0 2024-09-13T15:03:56.267 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T15:03:56.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.261+0000 7f3328400640 1 -- 172.21.15.7:0/4238061726 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3300066690 msgr2=0x7f3300068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:56.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.261+0000 7f3328400640 1 --2- 172.21.15.7:0/4238061726 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3300066690 0x7f3300068b50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f330c0ad000 tx=0x7f330c0a7000 comp rx=0 tx=0).stop 2024-09-13T15:03:56.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.261+0000 7f3328400640 1 -- 172.21.15.7:0/4238061726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33080040a0 msgr2=0x7f332014fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:56.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.261+0000 7f3328400640 1 --2- 172.21.15.7:0/4238061726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33080040a0 0x7f332014fdb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3314007370 tx=0x7f3314007830 comp rx=0 tx=0).stop 2024-09-13T15:03:56.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.261+0000 7f3328400640 1 -- 172.21.15.7:0/4238061726 shutdown_connections 2024-09-13T15:03:56.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.261+0000 7f3328400640 1 --2- 172.21.15.7:0/4238061726 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3300066690 0x7f3300068b50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:56.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.261+0000 7f3328400640 1 --2- 172.21.15.7:0/4238061726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3320151000 0x7f33200ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:56.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.261+0000 7f3328400640 1 --2- 172.21.15.7:0/4238061726 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33201502f0 0x7f3320150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:56.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.261+0000 7f3328400640 1 --2- 172.21.15.7:0/4238061726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33080040a0 0x7f332014fdb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:56.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.261+0000 7f3328400640 1 -- 172.21.15.7:0/4238061726 >> 172.21.15.7:0/4238061726 conn(0x7f332006c330 msgr2=0x7f33200c7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:03:56.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.261+0000 7f3328400640 1 -- 172.21.15.7:0/4238061726 shutdown_connections 2024-09-13T15:03:56.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:56.261+0000 7f3328400640 1 -- 172.21.15.7:0/4238061726 wait complete. 2024-09-13T15:03:56.288 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T15:03:56.288 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:03:56.288 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-09-13T15:03:56.288 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-13T15:03:56.288 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:03:56.288 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T15:03:56.288 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T15:03:56.288 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:03:56.289 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T15:03:56.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:03:56.289 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-09-13T15:03:56.298 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:03:56.298 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:03:56.298 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:03:56.298 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:03:56.298 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-09-13T15:03:56.298 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:03:56.299 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:03:56.299 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-09-13T15:03:56.299 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-09-13T15:03:56.299 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:03:56.299 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-09-13T15:03:56.299 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-09-13T15:03:56.299 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:03:56.299 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-09-13T15:03:56.299 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-09-13T15:03:56.299 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T15:03:56.299 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42330sec preferred_lft 42330sec 2024-09-13T15:03:56.299 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-09-13T15:03:56.300 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:03:56.300 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:03:56.300 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-09-13T15:03:56.300 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-09-13T15:03:56.300 INFO:teuthology.orchestra.run.smithi007.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:03:56.300 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 02:42:5c:b8:91:c4 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:03:56.300 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:03:56.300 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:03:56.302 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T15:03:56.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:03:56.302 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-09-13T15:03:56.302 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-13T15:03:56.302 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add name ceph-brx type bridge 2024-09-13T15:03:56.302 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr flush dev ceph-brx 2024-09-13T15:03:56.302 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set ceph-brx up 2024-09-13T15:03:56.302 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T15:03:56.302 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-13T15:03:56.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:03:56.413 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:03:56.431 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-09-13T15:03:56.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:03:56.433 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-09-13T15:03:56.513 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-09-13T15:03:56.513 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:03:56.513 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T15:03:56.513 INFO:teuthology.orchestra.run.smithi007.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:03:56.513 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T15:03:56.513 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:03:56.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:03:56.514 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-09-13T15:03:56.514 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-13T15:03:56.514 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T15:03:56.514 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T15:03:56.514 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T15:03:56.514 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-13T15:03:56.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:03:56.607 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-13T15:03:56.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:03:56.616 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2024-09-13T15:03:56.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:03:56.665 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-09-13T15:03:56.666 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-13T15:03:56.666 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T15:03:56.666 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-13T15:03:56.666 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-13T15:03:56.750 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-13T15:03:56.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:03:56.750 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-09-13T15:03:56.750 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-13T15:03:56.750 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-13T15:03:56.750 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T15:03:56.750 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-13T15:03:56.751 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-13T15:03:56.751 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-13T15:03:56.751 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-13T15:03:56.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:03:56.914 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-09-13T15:03:56.914 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-13T15:03:56.914 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-09-13T15:03:56.915 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T15:03:56.915 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-13T15:03:56.955 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-13T15:03:56.955 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:03:56.955 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:03:57.016 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-13T15:03:57.016 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:03:57.016 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:03:57.065 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2024-09-13T15:03:57.130 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T15:03:57.131 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T15:03:57.196 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T15:03:57.197 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T15:03:57.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:03:57.198 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2024-09-13T15:03:57.249 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T15:03:57.249 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-13T15:03:57.296 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2024-09-13T15:03:57.317 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T15:03:57.317 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T15:03:57.380 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T15:03:57.382 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T15:03:57.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:03:57.382 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2024-09-13T15:03:57.394 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:2024-09-13T15:03:57.389+0000 7f0cb0d15580 -1 init, newargv = 0x5590739e2990 newargc=15 2024-09-13T15:03:57.394 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:ceph-fuse[33458]: starting ceph client 2024-09-13T15:03:57.404 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:ceph-fuse[33458]: starting fuse 2024-09-13T15:03:58.503 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2024-09-13T15:03:58.527 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T15:03:58.527 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T15:03:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T15:03:58.590 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T15:03:58.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:03:58.591 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2024-09-13T15:03:58.646 INFO:teuthology.orchestra.run.smithi007.stdout:44 2024-09-13T15:03:58.646 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-13T15:03:58.646 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T15:03:58.646 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2024-09-13T15:03:58.646 DEBUG:teuthology.orchestra.run.smithi007:> import re 2024-09-13T15:03:58.647 DEBUG:teuthology.orchestra.run.smithi007:> import os 2024-09-13T15:03:58.647 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2024-09-13T15:03:58.647 DEBUG:teuthology.orchestra.run.smithi007:> 2024-09-13T15:03:58.647 DEBUG:teuthology.orchestra.run.smithi007:> def _find_admin_socket(client_name): 2024-09-13T15:03:58.647 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-13T15:03:58.647 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2024-09-13T15:03:58.647 DEBUG:teuthology.orchestra.run.smithi007:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-13T15:03:58.647 DEBUG:teuthology.orchestra.run.smithi007:> 2024-09-13T15:03:58.647 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2024-09-13T15:03:58.647 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2024-09-13T15:03:58.647 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2024-09-13T15:03:58.647 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2024-09-13T15:03:58.647 DEBUG:teuthology.orchestra.run.smithi007:> 2024-09-13T15:03:58.647 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2024-09-13T15:03:58.647 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T15:03:58.648 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T15:03:58.648 DEBUG:teuthology.orchestra.run.smithi007:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T15:03:58.648 DEBUG:teuthology.orchestra.run.smithi007:> contents = proc_f.read() 2024-09-13T15:03:58.648 DEBUG:teuthology.orchestra.run.smithi007:> if mountpoint in contents: 2024-09-13T15:03:58.648 DEBUG:teuthology.orchestra.run.smithi007:> return f 2024-09-13T15:03:58.648 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T15:03:58.648 DEBUG:teuthology.orchestra.run.smithi007:> 2024-09-13T15:03:58.648 DEBUG:teuthology.orchestra.run.smithi007:> print(_find_admin_socket("client.admin")) 2024-09-13T15:03:58.648 DEBUG:teuthology.orchestra.run.smithi007:> ' 2024-09-13T15:03:58.779 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.admin.33458.asok 2024-09-13T15:03:58.962 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.33458.asok 2024-09-13T15:03:58.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:03:58.962 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.33458.asok status 2024-09-13T15:03:59.148 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T15:03:59.148 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2024-09-13T15:03:59.148 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "50bbe7f395997dcd871813949c49addbbf630361", 2024-09-13T15:03:59.148 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 18.2.4-850-g50bbe7f3 (50bbe7f395997dcd871813949c49addbbf630361) reef (stable)", 2024-09-13T15:03:59.148 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "admin", 2024-09-13T15:03:59.148 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2024-09-13T15:03:59.148 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-13T15:03:59.148 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "33458", 2024-09-13T15:03:59.148 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2024-09-13T15:03:59.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T15:03:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2024-09-13T15:03:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2024-09-13T15:03:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4425, 2024-09-13T15:03:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2024-09-13T15:03:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2024-09-13T15:03:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2024-09-13T15:03:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 4425 2024-09-13T15:03:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T15:03:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2024-09-13T15:03:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2024-09-13T15:03:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2024-09-13T15:03:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1110832260 2024-09-13T15:03:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-13T15:03:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T15:03:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2024-09-13T15:03:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2024-09-13T15:03:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2024-09-13T15:03:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1110832260 2024-09-13T15:03:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-13T15:03:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.4425 192.168.0.1:0/1110832260", 2024-09-13T15:03:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "192.168.0.1:0/1110832260", 2024-09-13T15:03:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2024-09-13T15:03:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 6, 2024-09-13T15:03:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 27, 2024-09-13T15:03:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2024-09-13T15:03:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklisted": false, 2024-09-13T15:03:59.151 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2024-09-13T15:03:59.151 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T15:03:59.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:03:59.163 DEBUG:teuthology.orchestra.run.smithi007:> stat --file-system '--printf=%T 2024-09-13T15:03:59.163 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:03:59.172 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2024-09-13T15:03:59.172 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:03:59.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:03:59.173 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:03:59.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:03:59.238 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-13T15:03:59.325 INFO:teuthology.orchestra.run.smithi007.stdout:# file: . 2024-09-13T15:03:59.325 INFO:teuthology.orchestra.run.smithi007.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-13T15:03:59.325 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:03:59.326 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:03:59.327 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:03:59.378 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:03:59.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfcd800640 1 Processor -- start 2024-09-13T15:03:59.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfcd800640 1 -- start start 2024-09-13T15:03:59.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfcd800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbfc80c04d0 0x7fbfc806f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:59.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfcd800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbfc80b0cb0 0x7fbfc814f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:59.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfcd800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc8155ec0 con 0x7fbfc80c00f0 2024-09-13T15:03:59.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfcd800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc8071000 con 0x7fbfc80c04d0 2024-09-13T15:03:59.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfcd800640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc80c5c40 con 0x7fbfc80b0cb0 2024-09-13T15:03:59.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfbfe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbfc80c04d0 0x7fbfc806f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:59.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfc6a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbfc80c00f0 0x7fbfc80c5530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37782/0 (socket says 172.21.15.7:37782) 2024-09-13T15:03:59.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfc6a00640 1 -- 172.21.15.7:0/3145419630 learned_addr learned my addr 172.21.15.7:0/3145419630 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:03:59.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfc7400640 1 --2- 172.21.15.7:0/3145419630 >> v2:172.21.15.77:3300/0 conn(0x7fbfc80b0cb0 0x7fbfc814f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:59.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfbfe00640 1 -- 172.21.15.7:0/3145419630 >> v2:172.21.15.77:3300/0 conn(0x7fbfc80b0cb0 msgr2=0x7fbfc814f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:03:59.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfbfe00640 1 --2- 172.21.15.7:0/3145419630 >> v2:172.21.15.77:3300/0 conn(0x7fbfc80b0cb0 0x7fbfc814f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:59.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfbfe00640 1 -- 172.21.15.7:0/3145419630 >> v1:172.21.15.7:6789/0 conn(0x7fbfc80c00f0 legacy=0x7fbfc80c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:59.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfbfe00640 1 -- 172.21.15.7:0/3145419630 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc806ff60 con 0x7fbfc80c04d0 2024-09-13T15:03:59.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfc6000640 1 -- 172.21.15.7:0/3145419630 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367135136 0 0) 0x7fbfc8155ec0 con 0x7fbfc80c00f0 2024-09-13T15:03:59.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfc7400640 1 --2- 172.21.15.7:0/3145419630 >> v2:172.21.15.77:3300/0 conn(0x7fbfc80b0cb0 0x7fbfc814f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:03:59.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfbfe00640 1 --2- 172.21.15.7:0/3145419630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfc80c04d0 0x7fbfc806f600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80c68a0 tx=0x7fbfb001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b39cc80925b8e48 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:59.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfc6000640 1 -- 172.21.15.7:0/3145419630 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00a8970 con 0x7fbfc80c04d0 2024-09-13T15:03:59.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfc6000640 1 -- 172.21.15.7:0/3145419630 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb00a8ad0 con 0x7fbfc80c04d0 2024-09-13T15:03:59.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.557+0000 7fbfc6000640 1 -- 172.21.15.7:0/3145419630 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00a8e60 con 0x7fbfc80c04d0 2024-09-13T15:03:59.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfcd800640 1 -- 172.21.15.7:0/3145419630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfc80c04d0 msgr2=0x7fbfc806f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:59.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfcd800640 1 --2- 172.21.15.7:0/3145419630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfc80c04d0 0x7fbfc806f600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80c68a0 tx=0x7fbfb001ec70 comp rx=0 tx=0).stop 2024-09-13T15:03:59.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfcd800640 1 -- 172.21.15.7:0/3145419630 shutdown_connections 2024-09-13T15:03:59.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfcd800640 1 --2- 172.21.15.7:0/3145419630 >> v2:172.21.15.77:3300/0 conn(0x7fbfc80b0cb0 0x7fbfc814f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:59.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfcd800640 1 --2- 172.21.15.7:0/3145419630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfc80c04d0 0x7fbfc806f600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:59.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfcd800640 1 -- 172.21.15.7:0/3145419630 >> 172.21.15.7:0/3145419630 conn(0x7fbfc8065d40 msgr2=0x7fbfc8066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:03:59.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfcd800640 1 -- 172.21.15.7:0/3145419630 shutdown_connections 2024-09-13T15:03:59.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfcd800640 1 -- 172.21.15.7:0/3145419630 wait complete. 2024-09-13T15:03:59.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfcd800640 1 Processor -- start 2024-09-13T15:03:59.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfcd800640 1 -- start start 2024-09-13T15:03:59.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfcd800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc80b0cb0 0x7fbfc81f0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:59.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfcd800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfc80c00f0 0x7fbfc80c0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:59.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfcd800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfc80c04d0 0x7fbfc80ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:59.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfcd800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc80c9b00 con 0x7fbfc80c00f0 2024-09-13T15:03:59.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfcd800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc8146090 con 0x7fbfc80b0cb0 2024-09-13T15:03:59.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfcd800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc8141810 con 0x7fbfc80c04d0 2024-09-13T15:03:59.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfbfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfc80c00f0 0x7fbfc80c0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:59.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfbfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfc80c00f0 0x7fbfc80c0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45368/0 (socket says 172.21.15.7:45368) 2024-09-13T15:03:59.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfbfe00640 1 -- 172.21.15.7:0/1927298583 learned_addr learned my addr 172.21.15.7:0/1927298583 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:03:59.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfc6a00640 1 --2- 172.21.15.7:0/1927298583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc80b0cb0 0x7fbfc81f0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:59.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfc7400640 1 --2- 172.21.15.7:0/1927298583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfc80c04d0 0x7fbfc80ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:59.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfbfe00640 1 -- 172.21.15.7:0/1927298583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfc80c04d0 msgr2=0x7fbfc80ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:59.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfbfe00640 1 --2- 172.21.15.7:0/1927298583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfc80c04d0 0x7fbfc80ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:59.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfbfe00640 1 -- 172.21.15.7:0/1927298583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc80b0cb0 msgr2=0x7fbfc81f0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:59.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfbfe00640 1 --2- 172.21.15.7:0/1927298583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc80b0cb0 0x7fbfc81f0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:59.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.561+0000 7fbfbfe00640 1 -- 172.21.15.7:0/1927298583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb0009420 con 0x7fbfc80c00f0 2024-09-13T15:03:59.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.565+0000 7fbfbfe00640 1 --2- 172.21.15.7:0/1927298583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfc80c00f0 0x7fbfc80c0da0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbfb001b880 tx=0x7fbfb001ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:59.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.565+0000 7fbfbea00640 1 -- 172.21.15.7:0/1927298583 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00bb640 con 0x7fbfc80c00f0 2024-09-13T15:03:59.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.565+0000 7fbfbea00640 1 -- 172.21.15.7:0/1927298583 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb00bb7a0 con 0x7fbfc80c00f0 2024-09-13T15:03:59.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.565+0000 7fbfbea00640 1 -- 172.21.15.7:0/1927298583 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00bbb10 con 0x7fbfc80c00f0 2024-09-13T15:03:59.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.565+0000 7fbfcd800640 1 -- 172.21.15.7:0/1927298583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc81f09d0 con 0x7fbfc80c00f0 2024-09-13T15:03:59.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.565+0000 7fbfcd800640 1 -- 172.21.15.7:0/1927298583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc80c96c0 con 0x7fbfc80c00f0 2024-09-13T15:03:59.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.565+0000 7fbfcd800640 1 -- 172.21.15.7:0/1927298583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc8067650 con 0x7fbfc80c00f0 2024-09-13T15:03:59.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.565+0000 7fbfbea00640 1 -- 172.21.15.7:0/1927298583 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbfb00b7040 con 0x7fbfc80c00f0 2024-09-13T15:03:59.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.565+0000 7fbfbea00640 1 --2- 172.21.15.7:0/1927298583 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbfa4066690 0x7fbfa4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:59.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.565+0000 7fbfbea00640 1 -- 172.21.15.7:0/1927298583 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbfb01229a0 con 0x7fbfc80c00f0 2024-09-13T15:03:59.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.565+0000 7fbfc6a00640 1 --2- 172.21.15.7:0/1927298583 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbfa4066690 0x7fbfa4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:59.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.569+0000 7fbfc6a00640 1 --2- 172.21.15.7:0/1927298583 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbfa4066690 0x7fbfa4068b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8007fd0 tx=0x7fbfb8007d60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:59.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.573+0000 7fbfbea00640 1 -- 172.21.15.7:0/1927298583 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbfb00ef8b0 con 0x7fbfc80c00f0 2024-09-13T15:03:59.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.737+0000 7fbfcd800640 1 -- 172.21.15.7:0/1927298583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfc8156cd0 con 0x7fbfc80c00f0 2024-09-13T15:03:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.737+0000 7fbfbea00640 1 -- 172.21.15.7:0/1927298583 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18616 (secure 0 0 0) 0x7fbfb00f2ed0 con 0x7fbfc80c00f0 2024-09-13T15:03:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:03:59.744 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:02:33.732864+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:03:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.741+0000 7fbfcd800640 1 -- 172.21.15.7:0/1927298583 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbfa4066690 msgr2=0x7fbfa4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.741+0000 7fbfcd800640 1 --2- 172.21.15.7:0/1927298583 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbfa4066690 0x7fbfa4068b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8007fd0 tx=0x7fbfb8007d60 comp rx=0 tx=0).stop 2024-09-13T15:03:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.741+0000 7fbfcd800640 1 -- 172.21.15.7:0/1927298583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfc80c00f0 msgr2=0x7fbfc80c0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.741+0000 7fbfcd800640 1 --2- 172.21.15.7:0/1927298583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfc80c00f0 0x7fbfc80c0da0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbfb001b880 tx=0x7fbfb001ba10 comp rx=0 tx=0).stop 2024-09-13T15:03:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.741+0000 7fbfcd800640 1 -- 172.21.15.7:0/1927298583 shutdown_connections 2024-09-13T15:03:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.741+0000 7fbfcd800640 1 --2- 172.21.15.7:0/1927298583 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbfa4066690 0x7fbfa4068b50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.741+0000 7fbfcd800640 1 --2- 172.21.15.7:0/1927298583 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbfc80c04d0 0x7fbfc80ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.741+0000 7fbfcd800640 1 --2- 172.21.15.7:0/1927298583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbfc80c00f0 0x7fbfc80c0da0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:59.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.741+0000 7fbfcd800640 1 --2- 172.21.15.7:0/1927298583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfc80b0cb0 0x7fbfc81f0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:59.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.741+0000 7fbfcd800640 1 -- 172.21.15.7:0/1927298583 >> 172.21.15.7:0/1927298583 conn(0x7fbfc8065d40 msgr2=0x7fbfc814d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:03:59.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.741+0000 7fbfcd800640 1 -- 172.21.15.7:0/1927298583 shutdown_connections 2024-09-13T15:03:59.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.741+0000 7fbfcd800640 1 -- 172.21.15.7:0/1927298583 wait complete. 2024-09-13T15:03:59.765 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:01:38.710958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:01:43.178724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:01:43.774877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:01:46.843203+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:03:59.766 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:03:59.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.905+0000 7fc36e200640 1 Processor -- start 2024-09-13T15:03:59.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.905+0000 7fc36e200640 1 -- start start 2024-09-13T15:03:59.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc36e200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc36814fdd0 0x7fc368156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:59.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc36e200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3680c6880 con 0x7fc3680c16f0 2024-09-13T15:03:59.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc36e200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3680721e0 con 0x7fc3681501b0 2024-09-13T15:03:59.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc36e200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36806f860 con 0x7fc36814fdd0 2024-09-13T15:03:59.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc367e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc3680c16f0 0x7fc3680c55d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37790/0 (socket says 172.21.15.7:37790) 2024-09-13T15:03:59.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc367e00640 1 -- 172.21.15.7:0/1586722945 learned_addr learned my addr 172.21.15.7:0/1586722945 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:03:59.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc367400640 1 --2- 172.21.15.7:0/1586722945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc36814fdd0 0x7fc368156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:59.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc366a00640 1 -- 172.21.15.7:0/1586722945 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314384121 0 0) 0x7fc3680c6880 con 0x7fc3680c16f0 2024-09-13T15:03:59.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc366a00640 1 -- 172.21.15.7:0/1586722945 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc34c005740 con 0x7fc3680c16f0 2024-09-13T15:03:59.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc367400640 1 -- 172.21.15.7:0/1586722945 >> v1:172.21.15.77:6789/0 conn(0x7fc3681501b0 legacy=0x7fc3680c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:59.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc366a00640 1 -- 172.21.15.7:0/1586722945 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693688798 0 0) 0x7fc3680721e0 con 0x7fc3681501b0 2024-09-13T15:03:59.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc367400640 1 -- 172.21.15.7:0/1586722945 >> v1:172.21.15.7:6789/0 conn(0x7fc3680c16f0 legacy=0x7fc3680c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:59.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc367400640 1 -- 172.21.15.7:0/1586722945 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3680c6ad0 con 0x7fc36814fdd0 2024-09-13T15:03:59.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc367400640 1 --2- 172.21.15.7:0/1586722945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc36814fdd0 0x7fc368156780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc3580097f0 tx=0x7fc35801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25db9cb352ab8edf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:59.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc366a00640 1 -- 172.21.15.7:0/1586722945 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3580ac640 con 0x7fc36814fdd0 2024-09-13T15:03:59.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc366a00640 1 -- 172.21.15.7:0/1586722945 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3580ac7a0 con 0x7fc36814fdd0 2024-09-13T15:03:59.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc366a00640 1 -- 172.21.15.7:0/1586722945 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3580acb10 con 0x7fc36814fdd0 2024-09-13T15:03:59.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc36e200640 1 -- 172.21.15.7:0/1586722945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc36814fdd0 msgr2=0x7fc368156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:59.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc36e200640 1 --2- 172.21.15.7:0/1586722945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc36814fdd0 0x7fc368156780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc3580097f0 tx=0x7fc35801c4e0 comp rx=0 tx=0).stop 2024-09-13T15:03:59.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc36e200640 1 -- 172.21.15.7:0/1586722945 shutdown_connections 2024-09-13T15:03:59.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc36e200640 1 --2- 172.21.15.7:0/1586722945 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc36814fdd0 0x7fc368156780 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:59.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc36e200640 1 -- 172.21.15.7:0/1586722945 >> 172.21.15.7:0/1586722945 conn(0x7fc368065d40 msgr2=0x7fc368066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:03:59.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc36e200640 1 -- 172.21.15.7:0/1586722945 shutdown_connections 2024-09-13T15:03:59.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc36e200640 1 -- 172.21.15.7:0/1586722945 wait complete. 2024-09-13T15:03:59.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc36e200640 1 Processor -- start 2024-09-13T15:03:59.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.909+0000 7fc36e200640 1 -- start start 2024-09-13T15:03:59.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc36e200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3680c16f0 0x7fc36813f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:59.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc36e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc36814fdd0 0x7fc368150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:59.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc36e200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3681501b0 0x7fc368147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:59.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc36e200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc368149bc0 con 0x7fc36814fdd0 2024-09-13T15:03:59.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc36e200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc368151080 con 0x7fc3680c16f0 2024-09-13T15:03:59.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc36e200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc368149e10 con 0x7fc3681501b0 2024-09-13T15:03:59.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc35ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc36814fdd0 0x7fc368150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:59.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc35ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc36814fdd0 0x7fc368150b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45370/0 (socket says 172.21.15.7:45370) 2024-09-13T15:03:59.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc35ea00640 1 -- 172.21.15.7:0/3772907911 learned_addr learned my addr 172.21.15.7:0/3772907911 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:03:59.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc367400640 1 --2- 172.21.15.7:0/3772907911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3680c16f0 0x7fc36813f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:59.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc367e00640 1 --2- 172.21.15.7:0/3772907911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3681501b0 0x7fc368147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:59.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc35ea00640 1 -- 172.21.15.7:0/3772907911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3681501b0 msgr2=0x7fc368147490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:59.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc35ea00640 1 --2- 172.21.15.7:0/3772907911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3681501b0 0x7fc368147490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:59.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc35ea00640 1 -- 172.21.15.7:0/3772907911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3680c16f0 msgr2=0x7fc36813f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:03:59.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc35ea00640 1 --2- 172.21.15.7:0/3772907911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3680c16f0 0x7fc36813f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:03:59.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc35ea00640 1 -- 172.21.15.7:0/3772907911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc358009420 con 0x7fc36814fdd0 2024-09-13T15:03:59.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc35ea00640 1 --2- 172.21.15.7:0/3772907911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc36814fdd0 0x7fc368150b40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc35000c410 tx=0x7fc35000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:59.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc35fe00640 1 -- 172.21.15.7:0/3772907911 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3500054e0 con 0x7fc36814fdd0 2024-09-13T15:03:59.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc35fe00640 1 -- 172.21.15.7:0/3772907911 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc350003600 con 0x7fc36814fdd0 2024-09-13T15:03:59.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc35fe00640 1 -- 172.21.15.7:0/3772907911 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350003990 con 0x7fc36814fdd0 2024-09-13T15:03:59.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc36e200640 1 -- 172.21.15.7:0/3772907911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36814a470 con 0x7fc36814fdd0 2024-09-13T15:03:59.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc36e200640 1 -- 172.21.15.7:0/3772907911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36814a750 con 0x7fc36814fdd0 2024-09-13T15:03:59.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.913+0000 7fc36e200640 1 -- 172.21.15.7:0/3772907911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc368156780 con 0x7fc36814fdd0 2024-09-13T15:03:59.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.917+0000 7fc35fe00640 1 -- 172.21.15.7:0/3772907911 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc350003af0 con 0x7fc36814fdd0 2024-09-13T15:03:59.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.917+0000 7fc35fe00640 1 --2- 172.21.15.7:0/3772907911 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc344066690 0x7fc344068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:03:59.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.917+0000 7fc35fe00640 1 -- 172.21.15.7:0/3772907911 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc3500839b0 con 0x7fc36814fdd0 2024-09-13T15:03:59.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.917+0000 7fc367400640 1 --2- 172.21.15.7:0/3772907911 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc344066690 0x7fc344068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:03:59.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.917+0000 7fc367400640 1 --2- 172.21.15.7:0/3772907911 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc344066690 0x7fc344068b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc3580ae000 tx=0x7fc3580a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:03:59.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:03:59.921+0000 7fc35fe00640 1 -- 172.21.15.7:0/3772907911 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc350050aa0 con 0x7fc36814fdd0 2024-09-13T15:04:00.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.081+0000 7fc36e200640 1 -- 172.21.15.7:0/3772907911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc368161470 con 0x7fc36814fdd0 2024-09-13T15:04:00.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.081+0000 7fc35fe00640 1 -- 172.21.15.7:0/3772907911 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3500170a0 con 0x7fc36814fdd0 2024-09-13T15:04:00.087 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T15:04:00.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.081+0000 7fc36e200640 1 -- 172.21.15.7:0/3772907911 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc344066690 msgr2=0x7fc344068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.081+0000 7fc36e200640 1 --2- 172.21.15.7:0/3772907911 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc344066690 0x7fc344068b50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc3580ae000 tx=0x7fc3580a7000 comp rx=0 tx=0).stop 2024-09-13T15:04:00.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.081+0000 7fc36e200640 1 -- 172.21.15.7:0/3772907911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc36814fdd0 msgr2=0x7fc368150b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.081+0000 7fc36e200640 1 --2- 172.21.15.7:0/3772907911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc36814fdd0 0x7fc368150b40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc35000c410 tx=0x7fc35000c8d0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.081+0000 7fc36e200640 1 -- 172.21.15.7:0/3772907911 shutdown_connections 2024-09-13T15:04:00.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.081+0000 7fc36e200640 1 --2- 172.21.15.7:0/3772907911 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc344066690 0x7fc344068b50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.081+0000 7fc36e200640 1 --2- 172.21.15.7:0/3772907911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3681501b0 0x7fc368147490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.081+0000 7fc36e200640 1 --2- 172.21.15.7:0/3772907911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc36814fdd0 0x7fc368150b40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.081+0000 7fc36e200640 1 --2- 172.21.15.7:0/3772907911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3680c16f0 0x7fc36813f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.081+0000 7fc36e200640 1 -- 172.21.15.7:0/3772907911 >> 172.21.15.7:0/3772907911 conn(0x7fc368065d40 msgr2=0x7fc36814b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:00.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.081+0000 7fc36e200640 1 -- 172.21.15.7:0/3772907911 shutdown_connections 2024-09-13T15:04:00.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.081+0000 7fc36e200640 1 -- 172.21.15.7:0/3772907911 wait complete. 2024-09-13T15:04:00.108 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:04:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.249+0000 7fb746400640 1 Processor -- start 2024-09-13T15:04:00.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.249+0000 7fb746400640 1 -- start start 2024-09-13T15:04:00.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.249+0000 7fb746400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7401501b0 0x7fb740156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:00.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.249+0000 7fb746400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb7400c16f0 0x7fb7400c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.249+0000 7fb746400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7400c6880 con 0x7fb74014fdd0 2024-09-13T15:04:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.249+0000 7fb746400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7400721e0 con 0x7fb7400c16f0 2024-09-13T15:04:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.249+0000 7fb746400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74006f860 con 0x7fb7401501b0 2024-09-13T15:04:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.249+0000 7fb73f400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb74014fdd0 0x7fb7400c7420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37794/0 (socket says 172.21.15.7:37794) 2024-09-13T15:04:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.249+0000 7fb73f400640 1 -- 172.21.15.7:0/2232513010 learned_addr learned my addr 172.21.15.7:0/2232513010 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.249+0000 7fb73fe00640 1 --2- 172.21.15.7:0/2232513010 >> v2:172.21.15.7:3300/0 conn(0x7fb7400c16f0 0x7fb7400c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.249+0000 7fb73ea00640 1 --2- 172.21.15.7:0/2232513010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7401501b0 0x7fb740156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.249+0000 7fb73e000640 1 -- 172.21.15.7:0/2232513010 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658769859 0 0) 0x7fb7400c6880 con 0x7fb74014fdd0 2024-09-13T15:04:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.249+0000 7fb73e000640 1 -- 172.21.15.7:0/2232513010 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb724003530 con 0x7fb74014fdd0 2024-09-13T15:04:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.249+0000 7fb73fe00640 1 -- 172.21.15.7:0/2232513010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7401501b0 msgr2=0x7fb740156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.249+0000 7fb73fe00640 1 --2- 172.21.15.7:0/2232513010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7401501b0 0x7fb740156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.249+0000 7fb73fe00640 1 -- 172.21.15.7:0/2232513010 >> v1:172.21.15.7:6789/0 conn(0x7fb74014fdd0 legacy=0x7fb7400c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.249+0000 7fb73fe00640 1 -- 172.21.15.7:0/2232513010 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7400c6ad0 con 0x7fb7400c16f0 2024-09-13T15:04:00.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb73fe00640 1 --2- 172.21.15.7:0/2232513010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7400c16f0 0x7fb7400c55d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb738009d90 tx=0x7fb73801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b5c1e6dcc6af87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb73e000640 1 -- 172.21.15.7:0/2232513010 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7380a5a30 con 0x7fb7400c16f0 2024-09-13T15:04:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb73e000640 1 -- 172.21.15.7:0/2232513010 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7380a5b90 con 0x7fb7400c16f0 2024-09-13T15:04:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb73e000640 1 -- 172.21.15.7:0/2232513010 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7380ad440 con 0x7fb7400c16f0 2024-09-13T15:04:00.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb746400640 1 -- 172.21.15.7:0/2232513010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7400c16f0 msgr2=0x7fb7400c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb746400640 1 --2- 172.21.15.7:0/2232513010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7400c16f0 0x7fb7400c55d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb738009d90 tx=0x7fb73801c970 comp rx=0 tx=0).stop 2024-09-13T15:04:00.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb746400640 1 -- 172.21.15.7:0/2232513010 shutdown_connections 2024-09-13T15:04:00.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb746400640 1 --2- 172.21.15.7:0/2232513010 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7400c16f0 0x7fb7400c55d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb746400640 1 --2- 172.21.15.7:0/2232513010 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7401501b0 0x7fb740156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb746400640 1 -- 172.21.15.7:0/2232513010 >> 172.21.15.7:0/2232513010 conn(0x7fb740065d40 msgr2=0x7fb740066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:00.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb746400640 1 -- 172.21.15.7:0/2232513010 shutdown_connections 2024-09-13T15:04:00.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb746400640 1 -- 172.21.15.7:0/2232513010 wait complete. 2024-09-13T15:04:00.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb746400640 1 Processor -- start 2024-09-13T15:04:00.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb746400640 1 -- start start 2024-09-13T15:04:00.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb746400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7400c16f0 0x7fb7400cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:00.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb746400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb74014fdd0 0x7fb74014a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:00.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb746400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7401501b0 0x7fb74014c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:00.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb746400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb740147670 con 0x7fb7401501b0 2024-09-13T15:04:00.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb746400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400c7d80 con 0x7fb74014fdd0 2024-09-13T15:04:00.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb746400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7400c8020 con 0x7fb7400c16f0 2024-09-13T15:04:00.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb73fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7401501b0 0x7fb74014c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:00.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb73fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7401501b0 0x7fb74014c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45388/0 (socket says 172.21.15.7:45388) 2024-09-13T15:04:00.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb73f400640 1 --2- 172.21.15.7:0/388288373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7400c16f0 0x7fb7400cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:00.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb73fe00640 1 -- 172.21.15.7:0/388288373 learned_addr learned my addr 172.21.15.7:0/388288373 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:00.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.253+0000 7fb73ea00640 1 --2- 172.21.15.7:0/388288373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb74014fdd0 0x7fb74014a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:00.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.257+0000 7fb73fe00640 1 -- 172.21.15.7:0/388288373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7400c16f0 msgr2=0x7fb7400cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.257+0000 7fb73fe00640 1 --2- 172.21.15.7:0/388288373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7400c16f0 0x7fb7400cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.257+0000 7fb73fe00640 1 -- 172.21.15.7:0/388288373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb74014fdd0 msgr2=0x7fb74014a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.257+0000 7fb73fe00640 1 --2- 172.21.15.7:0/388288373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb74014fdd0 0x7fb74014a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.257+0000 7fb73fe00640 1 -- 172.21.15.7:0/388288373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb738009a70 con 0x7fb7401501b0 2024-09-13T15:04:00.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.257+0000 7fb73ea00640 1 --2- 172.21.15.7:0/388288373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb74014fdd0 0x7fb74014a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:00.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.257+0000 7fb73fe00640 1 --2- 172.21.15.7:0/388288373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7401501b0 0x7fb74014c960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb7380b0040 tx=0x7fb738019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:00.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.257+0000 7fb737400640 1 -- 172.21.15.7:0/388288373 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7380adce0 con 0x7fb7401501b0 2024-09-13T15:04:00.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.257+0000 7fb737400640 1 -- 172.21.15.7:0/388288373 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7380ade40 con 0x7fb7401501b0 2024-09-13T15:04:00.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.257+0000 7fb737400640 1 -- 172.21.15.7:0/388288373 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7380b9690 con 0x7fb7401501b0 2024-09-13T15:04:00.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.257+0000 7fb746400640 1 -- 172.21.15.7:0/388288373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7400ca1e0 con 0x7fb7401501b0 2024-09-13T15:04:00.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.257+0000 7fb746400640 1 -- 172.21.15.7:0/388288373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb740147300 con 0x7fb7401501b0 2024-09-13T15:04:00.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.257+0000 7fb746400640 1 -- 172.21.15.7:0/388288373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7400c55d0 con 0x7fb7401501b0 2024-09-13T15:04:00.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.257+0000 7fb737400640 1 -- 172.21.15.7:0/388288373 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb7380b97f0 con 0x7fb7401501b0 2024-09-13T15:04:00.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.257+0000 7fb737400640 1 --2- 172.21.15.7:0/388288373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb7200666c0 0x7fb720068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:00.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.257+0000 7fb737400640 1 -- 172.21.15.7:0/388288373 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb73811fa50 con 0x7fb7401501b0 2024-09-13T15:04:00.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.261+0000 7fb73f400640 1 --2- 172.21.15.7:0/388288373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb7200666c0 0x7fb720068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:00.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.261+0000 7fb73f400640 1 --2- 172.21.15.7:0/388288373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb7200666c0 0x7fb720068b80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb7300011f0 tx=0x7fb730007d40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:00.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.261+0000 7fb737400640 1 -- 172.21.15.7:0/388288373 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb7380ecaa0 con 0x7fb7401501b0 2024-09-13T15:04:00.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.425+0000 7fb746400640 1 -- 172.21.15.7:0/388288373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb7400c82e0 con 0x7fb7401501b0 2024-09-13T15:04:00.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.425+0000 7fb737400640 1 -- 172.21.15.7:0/388288373 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb738009450 con 0x7fb7401501b0 2024-09-13T15:04:00.432 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T15:04:00.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.429+0000 7fb746400640 1 -- 172.21.15.7:0/388288373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb7200666c0 msgr2=0x7fb720068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.429+0000 7fb746400640 1 --2- 172.21.15.7:0/388288373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb7200666c0 0x7fb720068b80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb7300011f0 tx=0x7fb730007d40 comp rx=0 tx=0).stop 2024-09-13T15:04:00.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.429+0000 7fb746400640 1 -- 172.21.15.7:0/388288373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7401501b0 msgr2=0x7fb74014c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.429+0000 7fb746400640 1 --2- 172.21.15.7:0/388288373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7401501b0 0x7fb74014c960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb7380b0040 tx=0x7fb738019710 comp rx=0 tx=0).stop 2024-09-13T15:04:00.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.429+0000 7fb746400640 1 -- 172.21.15.7:0/388288373 shutdown_connections 2024-09-13T15:04:00.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.429+0000 7fb746400640 1 --2- 172.21.15.7:0/388288373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb7200666c0 0x7fb720068b80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.429+0000 7fb746400640 1 --2- 172.21.15.7:0/388288373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7401501b0 0x7fb74014c960 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.429+0000 7fb746400640 1 --2- 172.21.15.7:0/388288373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb74014fdd0 0x7fb74014a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.429+0000 7fb746400640 1 --2- 172.21.15.7:0/388288373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7400c16f0 0x7fb7400cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.429+0000 7fb746400640 1 -- 172.21.15.7:0/388288373 >> 172.21.15.7:0/388288373 conn(0x7fb740065d40 msgr2=0x7fb7401495e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:00.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.429+0000 7fb746400640 1 -- 172.21.15.7:0/388288373 shutdown_connections 2024-09-13T15:04:00.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.429+0000 7fb746400640 1 -- 172.21.15.7:0/388288373 wait complete. 2024-09-13T15:04:00.453 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:04:00.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f6445000640 1 Processor -- start 2024-09-13T15:04:00.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f6445000640 1 -- start start 2024-09-13T15:04:00.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f6445000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f64400c5430 0x7f644006e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:00.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f6445000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6440159b70 con 0x7f64400733a0 2024-09-13T15:04:00.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f6445000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644015a000 con 0x7f64400c5d60 2024-09-13T15:04:00.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f6445000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64400c67d0 con 0x7f64400c5430 2024-09-13T15:04:00.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f643de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f64400c5430 0x7f644006e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:00.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f643e800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f64400733a0 0x7f64401639b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37808/0 (socket says 172.21.15.7:37808) 2024-09-13T15:04:00.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f643e800640 1 -- 172.21.15.7:0/3495467590 learned_addr learned my addr 172.21.15.7:0/3495467590 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:00.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f643de00640 1 -- 172.21.15.7:0/3495467590 >> v1:172.21.15.77:6789/0 conn(0x7f64400c5d60 legacy=0x7f644015c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f643de00640 1 -- 172.21.15.7:0/3495467590 >> v1:172.21.15.7:6789/0 conn(0x7f64400733a0 legacy=0x7f64401639b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f643de00640 1 -- 172.21.15.7:0/3495467590 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64400c5810 con 0x7f64400c5430 2024-09-13T15:04:00.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f643d400640 1 -- 172.21.15.7:0/3495467590 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456926052 0 0) 0x7f6440159b70 con 0x7f64400733a0 2024-09-13T15:04:00.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f643de00640 1 --2- 172.21.15.7:0/3495467590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64400c5430 0x7f644006e3e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f64300097c0 tx=0x7f643001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e7ab9383c6755e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:00.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f643d400640 1 -- 172.21.15.7:0/3495467590 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64300a8990 con 0x7f64400c5430 2024-09-13T15:04:00.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f643d400640 1 -- 172.21.15.7:0/3495467590 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64300a8af0 con 0x7f64400c5430 2024-09-13T15:04:00.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f643d400640 1 -- 172.21.15.7:0/3495467590 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64300a8e80 con 0x7f64400c5430 2024-09-13T15:04:00.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f6445000640 1 -- 172.21.15.7:0/3495467590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64400c5430 msgr2=0x7f644006e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f6445000640 1 --2- 172.21.15.7:0/3495467590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64400c5430 0x7f644006e3e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f64300097c0 tx=0x7f643001ec90 comp rx=0 tx=0).stop 2024-09-13T15:04:00.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f6445000640 1 -- 172.21.15.7:0/3495467590 shutdown_connections 2024-09-13T15:04:00.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f6445000640 1 --2- 172.21.15.7:0/3495467590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64400c5430 0x7f644006e3e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.593+0000 7f6445000640 1 -- 172.21.15.7:0/3495467590 >> 172.21.15.7:0/3495467590 conn(0x7f64400cb360 msgr2=0x7f64400cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:00.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f6445000640 1 -- 172.21.15.7:0/3495467590 shutdown_connections 2024-09-13T15:04:00.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f6445000640 1 -- 172.21.15.7:0/3495467590 wait complete. 2024-09-13T15:04:00.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f6445000640 1 Processor -- start 2024-09-13T15:04:00.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f6445000640 1 -- start start 2024-09-13T15:04:00.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f6445000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64400733a0 0x7f6440151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:00.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f6445000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64400c5430 0x7f64401e4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:00.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f6445000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64400c5d60 0x7f64401e49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:00.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f6445000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6440150700 con 0x7f64400c5d60 2024-09-13T15:04:00.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f6445000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6440151660 con 0x7f64400c5430 2024-09-13T15:04:00.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f6445000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64401f2780 con 0x7f64400733a0 2024-09-13T15:04:00.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f643e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64400c5d60 0x7f64401e49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:00.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f643e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64400c5d60 0x7f64401e49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45416/0 (socket says 172.21.15.7:45416) 2024-09-13T15:04:00.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f643e800640 1 -- 172.21.15.7:0/3311044012 learned_addr learned my addr 172.21.15.7:0/3311044012 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:00.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f643de00640 1 --2- 172.21.15.7:0/3311044012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64400733a0 0x7f6440151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:00.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f6435400640 1 --2- 172.21.15.7:0/3311044012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64400c5430 0x7f64401e4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:00.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f643e800640 1 -- 172.21.15.7:0/3311044012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64400733a0 msgr2=0x7f6440151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f643e800640 1 --2- 172.21.15.7:0/3311044012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64400733a0 0x7f6440151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f643e800640 1 -- 172.21.15.7:0/3311044012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64400c5430 msgr2=0x7f64401e4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f643e800640 1 --2- 172.21.15.7:0/3311044012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64400c5430 0x7f64401e4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f643e800640 1 -- 172.21.15.7:0/3311044012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6430009420 con 0x7f64400c5d60 2024-09-13T15:04:00.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.597+0000 7f643e800640 1 --2- 172.21.15.7:0/3311044012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64400c5d60 0x7f64401e49d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f643800cc10 tx=0x7f643800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:00.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.601+0000 7f6436a00640 1 -- 172.21.15.7:0/3311044012 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643800ad40 con 0x7f64400c5d60 2024-09-13T15:04:00.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.601+0000 7f6436a00640 1 -- 172.21.15.7:0/3311044012 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6438012400 con 0x7f64400c5d60 2024-09-13T15:04:00.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.601+0000 7f6436a00640 1 -- 172.21.15.7:0/3311044012 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643800aea0 con 0x7f64400c5d60 2024-09-13T15:04:00.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.601+0000 7f6445000640 1 -- 172.21.15.7:0/3311044012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6440150480 con 0x7f64400c5d60 2024-09-13T15:04:00.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.601+0000 7f6445000640 1 -- 172.21.15.7:0/3311044012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64401f29d0 con 0x7f64400c5d60 2024-09-13T15:04:00.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.601+0000 7f6445000640 1 -- 172.21.15.7:0/3311044012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6440151d50 con 0x7f64400c5d60 2024-09-13T15:04:00.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.601+0000 7f6436a00640 1 -- 172.21.15.7:0/3311044012 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6438007070 con 0x7f64400c5d60 2024-09-13T15:04:00.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.601+0000 7f6436a00640 1 --2- 172.21.15.7:0/3311044012 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f641c066690 0x7f641c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:00.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.601+0000 7f6436a00640 1 -- 172.21.15.7:0/3311044012 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6438084500 con 0x7f64400c5d60 2024-09-13T15:04:00.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.601+0000 7f643de00640 1 --2- 172.21.15.7:0/3311044012 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f641c066690 0x7f641c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:00.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.605+0000 7f643de00640 1 --2- 172.21.15.7:0/3311044012 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f641c066690 0x7f641c068b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f64300b2000 tx=0x7f6430008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:00.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.605+0000 7f6436a00640 1 -- 172.21.15.7:0/3311044012 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6440151d50 con 0x7f64400c5d60 2024-09-13T15:04:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.773+0000 7f6445000640 1 -- 172.21.15.7:0/3311044012 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6440151d50 con 0x7f64400c5d60 2024-09-13T15:04:00.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.773+0000 7f6436a00640 1 -- 172.21.15.7:0/3311044012 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6440151d50 con 0x7f64400c5d60 2024-09-13T15:04:00.775 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-13T15:04:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.773+0000 7f6445000640 1 -- 172.21.15.7:0/3311044012 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f641c066690 msgr2=0x7f641c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.773+0000 7f6445000640 1 --2- 172.21.15.7:0/3311044012 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f641c066690 0x7f641c068b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f64300b2000 tx=0x7f6430008040 comp rx=0 tx=0).stop 2024-09-13T15:04:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.773+0000 7f6445000640 1 -- 172.21.15.7:0/3311044012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64400c5d60 msgr2=0x7f64401e49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.773+0000 7f6445000640 1 --2- 172.21.15.7:0/3311044012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64400c5d60 0x7f64401e49d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f643800cc10 tx=0x7f643800a430 comp rx=0 tx=0).stop 2024-09-13T15:04:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.773+0000 7f6445000640 1 -- 172.21.15.7:0/3311044012 shutdown_connections 2024-09-13T15:04:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.773+0000 7f6445000640 1 --2- 172.21.15.7:0/3311044012 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f641c066690 0x7f641c068b50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.773+0000 7f6445000640 1 --2- 172.21.15.7:0/3311044012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64400c5d60 0x7f64401e49d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.773+0000 7f6445000640 1 --2- 172.21.15.7:0/3311044012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64400c5430 0x7f64401e4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.773+0000 7f6445000640 1 --2- 172.21.15.7:0/3311044012 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f64400733a0 0x7f6440151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.773+0000 7f6445000640 1 -- 172.21.15.7:0/3311044012 >> 172.21.15.7:0/3311044012 conn(0x7f64400cb360 msgr2=0x7f64400c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.773+0000 7f6445000640 1 -- 172.21.15.7:0/3311044012 shutdown_connections 2024-09-13T15:04:00.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.773+0000 7f6445000640 1 -- 172.21.15.7:0/3311044012 wait complete. 2024-09-13T15:04:00.796 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:04:00.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.937+0000 7f875dc00640 1 Processor -- start 2024-09-13T15:04:00.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.937+0000 7f875dc00640 1 -- start start 2024-09-13T15:04:00.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.941+0000 7f875dc00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8758150d90 0x7f8758157590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:00.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.941+0000 7f875dc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f87580c1880 0x7f8758071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:00.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.941+0000 7f875dc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8758157100 con 0x7f8758157ad0 2024-09-13T15:04:00.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.941+0000 7f875dc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8758066b00 con 0x7f87580c1880 2024-09-13T15:04:00.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.941+0000 7f875dc00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f875815a3a0 con 0x7f8758150d90 2024-09-13T15:04:00.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.941+0000 7f874e000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8758157ad0 0x7f87580c56f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37822/0 (socket says 172.21.15.7:37822) 2024-09-13T15:04:00.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.941+0000 7f874e000640 1 -- 172.21.15.7:0/2637965982 learned_addr learned my addr 172.21.15.7:0/2637965982 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:00.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.941+0000 7f8757400640 1 --2- 172.21.15.7:0/2637965982 >> v2:172.21.15.7:3300/0 conn(0x7f87580c1880 0x7f8758071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:00.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.941+0000 7f8756a00640 1 --2- 172.21.15.7:0/2637965982 >> v2:172.21.15.77:3300/0 conn(0x7f8758150d90 0x7f8758157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:00.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.941+0000 7f8756000640 1 -- 172.21.15.7:0/2637965982 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904959106 0 0) 0x7f8758157100 con 0x7f8758157ad0 2024-09-13T15:04:00.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.941+0000 7f8756000640 1 -- 172.21.15.7:0/2637965982 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f873c003530 con 0x7f8758157ad0 2024-09-13T15:04:00.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.941+0000 7f8757400640 1 -- 172.21.15.7:0/2637965982 >> v2:172.21.15.77:3300/0 conn(0x7f8758150d90 msgr2=0x7f8758157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:00.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.941+0000 7f8757400640 1 --2- 172.21.15.7:0/2637965982 >> v2:172.21.15.77:3300/0 conn(0x7f8758150d90 0x7f8758157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.941+0000 7f8757400640 1 -- 172.21.15.7:0/2637965982 >> v1:172.21.15.7:6789/0 conn(0x7f8758157ad0 legacy=0x7f87580c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.941+0000 7f8757400640 1 -- 172.21.15.7:0/2637965982 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8758156db0 con 0x7f87580c1880 2024-09-13T15:04:00.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f8757400640 1 --2- 172.21.15.7:0/2637965982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87580c1880 0x7f8758071810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f87580c8530 tx=0x7f875001f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e9e2c352a5a4427 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:00.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f8756000640 1 -- 172.21.15.7:0/2637965982 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87500af600 con 0x7f87580c1880 2024-09-13T15:04:00.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f8756000640 1 -- 172.21.15.7:0/2637965982 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87500ab050 con 0x7f87580c1880 2024-09-13T15:04:00.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f8756000640 1 -- 172.21.15.7:0/2637965982 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87500af980 con 0x7f87580c1880 2024-09-13T15:04:00.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f875dc00640 1 -- 172.21.15.7:0/2637965982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87580c1880 msgr2=0x7f8758071810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f875dc00640 1 --2- 172.21.15.7:0/2637965982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87580c1880 0x7f8758071810 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f87580c8530 tx=0x7f875001f110 comp rx=0 tx=0).stop 2024-09-13T15:04:00.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f875dc00640 1 -- 172.21.15.7:0/2637965982 shutdown_connections 2024-09-13T15:04:00.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f875dc00640 1 --2- 172.21.15.7:0/2637965982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f87580c1880 0x7f8758071810 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f875dc00640 1 --2- 172.21.15.7:0/2637965982 >> v2:172.21.15.77:3300/0 conn(0x7f8758150d90 0x7f8758157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f875dc00640 1 -- 172.21.15.7:0/2637965982 >> 172.21.15.7:0/2637965982 conn(0x7f8758065d40 msgr2=0x7f8758066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:00.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f875dc00640 1 -- 172.21.15.7:0/2637965982 shutdown_connections 2024-09-13T15:04:00.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f875dc00640 1 -- 172.21.15.7:0/2637965982 wait complete. 2024-09-13T15:04:00.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f875dc00640 1 Processor -- start 2024-09-13T15:04:00.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f875dc00640 1 -- start start 2024-09-13T15:04:00.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f875dc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87580c1880 0x7f875814edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:00.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f875dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8758150d90 0x7f875814f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:00.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f875dc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8758157ad0 0x7f8758158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:00.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f875dc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875814a6d0 con 0x7f8758150d90 2024-09-13T15:04:00.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f875dc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875814e5c0 con 0x7f87580c1880 2024-09-13T15:04:00.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f875dc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8758149f40 con 0x7f8758157ad0 2024-09-13T15:04:00.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.945+0000 7f874e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8758150d90 0x7f875814f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:00.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.949+0000 7f874e000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8758150d90 0x7f875814f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45444/0 (socket says 172.21.15.7:45444) 2024-09-13T15:04:00.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.949+0000 7f874e000640 1 -- 172.21.15.7:0/933226373 learned_addr learned my addr 172.21.15.7:0/933226373 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:00.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.949+0000 7f8756a00640 1 --2- 172.21.15.7:0/933226373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87580c1880 0x7f875814edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:00.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.949+0000 7f8757400640 1 --2- 172.21.15.7:0/933226373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8758157ad0 0x7f8758158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:00.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.949+0000 7f874e000640 1 -- 172.21.15.7:0/933226373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8758157ad0 msgr2=0x7f8758158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.949+0000 7f874e000640 1 --2- 172.21.15.7:0/933226373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8758157ad0 0x7f8758158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.949+0000 7f874e000640 1 -- 172.21.15.7:0/933226373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87580c1880 msgr2=0x7f875814edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:00.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.949+0000 7f874e000640 1 --2- 172.21.15.7:0/933226373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87580c1880 0x7f875814edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:00.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.949+0000 7f874e000640 1 -- 172.21.15.7:0/933226373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8750009a70 con 0x7f8758150d90 2024-09-13T15:04:00.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.949+0000 7f874e000640 1 --2- 172.21.15.7:0/933226373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8758150d90 0x7f875814f300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f874000c530 tx=0x7f874000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.949+0000 7f874f400640 1 -- 172.21.15.7:0/933226373 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740005cf0 con 0x7f8758150d90 2024-09-13T15:04:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.949+0000 7f874f400640 1 -- 172.21.15.7:0/933226373 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8740005e50 con 0x7f8758150d90 2024-09-13T15:04:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.949+0000 7f874f400640 1 -- 172.21.15.7:0/933226373 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740007270 con 0x7f8758150d90 2024-09-13T15:04:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.949+0000 7f875dc00640 1 -- 172.21.15.7:0/933226373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87581ed830 con 0x7f8758150d90 2024-09-13T15:04:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.949+0000 7f875dc00640 1 -- 172.21.15.7:0/933226373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f875814a1b0 con 0x7f8758150d90 2024-09-13T15:04:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.949+0000 7f875dc00640 1 -- 172.21.15.7:0/933226373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f875806d4d0 con 0x7f8758150d90 2024-09-13T15:04:00.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.949+0000 7f874f400640 1 -- 172.21.15.7:0/933226373 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f87400073d0 con 0x7f8758150d90 2024-09-13T15:04:00.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.953+0000 7f874f400640 1 --2- 172.21.15.7:0/933226373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f87340666c0 0x7f8734068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:00.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.953+0000 7f874f400640 1 -- 172.21.15.7:0/933226373 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8740083a30 con 0x7f8758150d90 2024-09-13T15:04:00.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.953+0000 7f8756a00640 1 --2- 172.21.15.7:0/933226373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f87340666c0 0x7f8734068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:00.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.953+0000 7f8756a00640 1 --2- 172.21.15.7:0/933226373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f87340666c0 0x7f8734068b80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8748009b60 tx=0x7f8748009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:00.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:00.957+0000 7f874f400640 1 -- 172.21.15.7:0/933226373 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8740050a80 con 0x7f8758150d90 2024-09-13T15:04:01.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.113+0000 7f875dc00640 1 -- 172.21.15.7:0/933226373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f875814a3a0 con 0x7f8758150d90 2024-09-13T15:04:01.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.113+0000 7f874f400640 1 -- 172.21.15.7:0/933226373 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f87400170a0 con 0x7f8758150d90 2024-09-13T15:04:01.117 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T15:04:01.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.117+0000 7f875dc00640 1 -- 172.21.15.7:0/933226373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f87340666c0 msgr2=0x7f8734068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:01.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.117+0000 7f875dc00640 1 --2- 172.21.15.7:0/933226373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f87340666c0 0x7f8734068b80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8748009b60 tx=0x7f8748009190 comp rx=0 tx=0).stop 2024-09-13T15:04:01.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.117+0000 7f875dc00640 1 -- 172.21.15.7:0/933226373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8758150d90 msgr2=0x7f875814f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:01.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.117+0000 7f875dc00640 1 --2- 172.21.15.7:0/933226373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8758150d90 0x7f875814f300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f874000c530 tx=0x7f874000c9f0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.117+0000 7f875dc00640 1 -- 172.21.15.7:0/933226373 shutdown_connections 2024-09-13T15:04:01.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.117+0000 7f875dc00640 1 --2- 172.21.15.7:0/933226373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f87340666c0 0x7f8734068b80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.117+0000 7f875dc00640 1 --2- 172.21.15.7:0/933226373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8758157ad0 0x7f8758158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.117+0000 7f875dc00640 1 --2- 172.21.15.7:0/933226373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8758150d90 0x7f875814f300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.117+0000 7f875dc00640 1 --2- 172.21.15.7:0/933226373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87580c1880 0x7f875814edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.117+0000 7f875dc00640 1 -- 172.21.15.7:0/933226373 >> 172.21.15.7:0/933226373 conn(0x7f8758065d40 msgr2=0x7f8758071810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:01.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.117+0000 7f875dc00640 1 -- 172.21.15.7:0/933226373 shutdown_connections 2024-09-13T15:04:01.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.117+0000 7f875dc00640 1 -- 172.21.15.7:0/933226373 wait complete. 2024-09-13T15:04:01.138 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:04:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.277+0000 7f3238000640 1 Processor -- start 2024-09-13T15:04:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.277+0000 7f3238000640 1 -- start start 2024-09-13T15:04:01.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.277+0000 7f3238000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32301532a0 0x7f3230159230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:01.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.277+0000 7f3238000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f32300c75f0 0x7f32300c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:01.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.277+0000 7f3238000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323006e7e0 con 0x7f323006a450 2024-09-13T15:04:01.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.277+0000 7f3238000640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323006b620 con 0x7f32300c75f0 2024-09-13T15:04:01.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.277+0000 7f3238000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323015c820 con 0x7f32301532a0 2024-09-13T15:04:01.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.277+0000 7f3235600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32301532a0 0x7f3230159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:01.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.277+0000 7f3235600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32301532a0 0x7f3230159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:49056/0 (socket says 172.21.15.7:49056) 2024-09-13T15:04:01.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.277+0000 7f3235600640 1 -- 172.21.15.7:0/2736703290 learned_addr learned my addr 172.21.15.7:0/2736703290 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:01.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.277+0000 7f3236000640 1 --2- 172.21.15.7:0/2736703290 >> v2:172.21.15.77:3300/0 conn(0x7f32300c75f0 0x7f32300c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:01.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.277+0000 7f3235600640 1 -- 172.21.15.7:0/2736703290 >> v2:172.21.15.77:3300/0 conn(0x7f32300c75f0 msgr2=0x7f32300c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:01.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.277+0000 7f3235600640 1 --2- 172.21.15.7:0/2736703290 >> v2:172.21.15.77:3300/0 conn(0x7f32300c75f0 0x7f32300c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.277+0000 7f3235600640 1 -- 172.21.15.7:0/2736703290 >> v1:172.21.15.77:6789/0 conn(0x7f323006a450 legacy=0x7f323006a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:01.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.277+0000 7f3235600640 1 -- 172.21.15.7:0/2736703290 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323015cac0 con 0x7f32301532a0 2024-09-13T15:04:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.281+0000 7f3235600640 1 --2- 172.21.15.7:0/2736703290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32301532a0 0x7f3230159230 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3224009870 tx=0x7f322401ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f54732cc55aba64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:01.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.281+0000 7f322fe00640 1 -- 172.21.15.7:0/2736703290 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32240a8a50 con 0x7f32301532a0 2024-09-13T15:04:01.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.281+0000 7f322fe00640 1 -- 172.21.15.7:0/2736703290 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32240a8bb0 con 0x7f32301532a0 2024-09-13T15:04:01.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.281+0000 7f322fe00640 1 -- 172.21.15.7:0/2736703290 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32240b0440 con 0x7f32301532a0 2024-09-13T15:04:01.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.281+0000 7f3238000640 1 -- 172.21.15.7:0/2736703290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32301532a0 msgr2=0x7f3230159230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:01.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.281+0000 7f3238000640 1 --2- 172.21.15.7:0/2736703290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32301532a0 0x7f3230159230 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3224009870 tx=0x7f322401ed50 comp rx=0 tx=0).stop 2024-09-13T15:04:01.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.281+0000 7f3238000640 1 -- 172.21.15.7:0/2736703290 shutdown_connections 2024-09-13T15:04:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.281+0000 7f3238000640 1 --2- 172.21.15.7:0/2736703290 >> v2:172.21.15.77:3300/0 conn(0x7f32300c75f0 0x7f32300c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.281+0000 7f3238000640 1 --2- 172.21.15.7:0/2736703290 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32301532a0 0x7f3230159230 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3238000640 1 -- 172.21.15.7:0/2736703290 >> 172.21.15.7:0/2736703290 conn(0x7f323006f160 msgr2=0x7f323006f570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3238000640 1 -- 172.21.15.7:0/2736703290 shutdown_connections 2024-09-13T15:04:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3238000640 1 -- 172.21.15.7:0/2736703290 wait complete. 2024-09-13T15:04:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3238000640 1 Processor -- start 2024-09-13T15:04:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3238000640 1 -- start start 2024-09-13T15:04:01.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3238000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f323006a450 0x7f32300c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:01.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3238000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32300c75f0 0x7f32301f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:01.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3238000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32301532a0 0x7f32301f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:01.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3238000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32301f0630 con 0x7f32300c75f0 2024-09-13T15:04:01.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3238000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323014ebd0 con 0x7f323006a450 2024-09-13T15:04:01.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3238000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32301e4ff0 con 0x7f32301532a0 2024-09-13T15:04:01.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3234c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32300c75f0 0x7f32301f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:01.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3235600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f323006a450 0x7f32300c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:01.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3234c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32300c75f0 0x7f32301f22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45458/0 (socket says 172.21.15.7:45458) 2024-09-13T15:04:01.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3234c00640 1 -- 172.21.15.7:0/1988229470 learned_addr learned my addr 172.21.15.7:0/1988229470 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:01.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3236000640 1 --2- 172.21.15.7:0/1988229470 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32301532a0 0x7f32301f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:01.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3234c00640 1 -- 172.21.15.7:0/1988229470 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32301532a0 msgr2=0x7f32301f2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:01.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3234c00640 1 --2- 172.21.15.7:0/1988229470 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32301532a0 0x7f32301f2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3234c00640 1 -- 172.21.15.7:0/1988229470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f323006a450 msgr2=0x7f32300c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:01.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3234c00640 1 --2- 172.21.15.7:0/1988229470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f323006a450 0x7f32300c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3234c00640 1 -- 172.21.15.7:0/1988229470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32240094d0 con 0x7f32300c75f0 2024-09-13T15:04:01.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f3234c00640 1 --2- 172.21.15.7:0/1988229470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32300c75f0 0x7f32301f22f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f321c00c390 tx=0x7f321c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:01.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f322d600640 1 -- 172.21.15.7:0/1988229470 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c0052d0 con 0x7f32300c75f0 2024-09-13T15:04:01.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f322d600640 1 -- 172.21.15.7:0/1988229470 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321c005430 con 0x7f32300c75f0 2024-09-13T15:04:01.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.285+0000 7f322d600640 1 -- 172.21.15.7:0/1988229470 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321c003820 con 0x7f32300c75f0 2024-09-13T15:04:01.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.289+0000 7f3238000640 1 -- 172.21.15.7:0/1988229470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323014ef60 con 0x7f32300c75f0 2024-09-13T15:04:01.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.289+0000 7f3238000640 1 -- 172.21.15.7:0/1988229470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32301f02f0 con 0x7f32300c75f0 2024-09-13T15:04:01.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.289+0000 7f3238000640 1 -- 172.21.15.7:0/1988229470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3230069f30 con 0x7f32300c75f0 2024-09-13T15:04:01.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.289+0000 7f322d600640 1 -- 172.21.15.7:0/1988229470 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f321c003980 con 0x7f32300c75f0 2024-09-13T15:04:01.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.289+0000 7f322d600640 1 --2- 172.21.15.7:0/1988229470 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3210066690 0x7f3210068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:01.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.289+0000 7f322d600640 1 -- 172.21.15.7:0/1988229470 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f321c0836f0 con 0x7f32300c75f0 2024-09-13T15:04:01.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.289+0000 7f3235600640 1 --2- 172.21.15.7:0/1988229470 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3210066690 0x7f3210068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:01.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.289+0000 7f3235600640 1 --2- 172.21.15.7:0/1988229470 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3210066690 0x7f3210068b50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32240b2000 tx=0x7f3224008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:01.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.293+0000 7f322d600640 1 -- 172.21.15.7:0/1988229470 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f321c0506b0 con 0x7f32300c75f0 2024-09-13T15:04:01.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.469+0000 7f3238000640 1 -- 172.21.15.7:0/1988229470 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f323014ef60 con 0x7f32300c75f0 2024-09-13T15:04:01.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.469+0000 7f322d600640 1 -- 172.21.15.7:0/1988229470 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f323014ef60 con 0x7f32300c75f0 2024-09-13T15:04:01.471 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-09-13T15:04:01.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.469+0000 7f3238000640 1 -- 172.21.15.7:0/1988229470 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3210066690 msgr2=0x7f3210068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:01.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.469+0000 7f3238000640 1 --2- 172.21.15.7:0/1988229470 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3210066690 0x7f3210068b50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f32240b2000 tx=0x7f3224008040 comp rx=0 tx=0).stop 2024-09-13T15:04:01.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.469+0000 7f3238000640 1 -- 172.21.15.7:0/1988229470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32300c75f0 msgr2=0x7f32301f22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:01.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.469+0000 7f3238000640 1 --2- 172.21.15.7:0/1988229470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32300c75f0 0x7f32301f22f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f321c00c390 tx=0x7f321c00c850 comp rx=0 tx=0).stop 2024-09-13T15:04:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.469+0000 7f3238000640 1 -- 172.21.15.7:0/1988229470 shutdown_connections 2024-09-13T15:04:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.469+0000 7f3238000640 1 --2- 172.21.15.7:0/1988229470 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3210066690 0x7f3210068b50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.469+0000 7f3238000640 1 --2- 172.21.15.7:0/1988229470 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32301532a0 0x7f32301f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.469+0000 7f3238000640 1 --2- 172.21.15.7:0/1988229470 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32300c75f0 0x7f32301f22f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.469+0000 7f3238000640 1 --2- 172.21.15.7:0/1988229470 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f323006a450 0x7f32300c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.469+0000 7f3238000640 1 -- 172.21.15.7:0/1988229470 >> 172.21.15.7:0/1988229470 conn(0x7f323006f160 msgr2=0x7f32300cd550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.469+0000 7f3238000640 1 -- 172.21.15.7:0/1988229470 shutdown_connections 2024-09-13T15:04:01.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.469+0000 7f3238000640 1 -- 172.21.15.7:0/1988229470 wait complete. 2024-09-13T15:04:01.492 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:04:01.492 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:04:01.501 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:04:01.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.681+0000 7f6392200640 1 Processor -- start 2024-09-13T15:04:01.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.681+0000 7f6392200640 1 -- start start 2024-09-13T15:04:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.681+0000 7f6392200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f638c071a70 0x7f638c1576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.681+0000 7f6392200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f638c0b0bf0 0x7f638c150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:01.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.685+0000 7f6392200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638c0c5530 con 0x7f638c06ddb0 2024-09-13T15:04:01.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.685+0000 7f6392200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c1583b0 con 0x7f638c0b0bf0 2024-09-13T15:04:01.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.685+0000 7f6392200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638c156f40 con 0x7f638c071a70 2024-09-13T15:04:01.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.685+0000 7f638b400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f638c071a70 0x7f638c1576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:01.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.685+0000 7f6382a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f638c0b0bf0 0x7f638c150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:01.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.685+0000 7f638b400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f638c071a70 0x7f638c1576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:49082/0 (socket says 172.21.15.7:49082) 2024-09-13T15:04:01.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.685+0000 7f638b400640 1 -- 172.21.15.7:0/773679144 learned_addr learned my addr 172.21.15.7:0/773679144 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:01.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.685+0000 7f6382a00640 1 -- 172.21.15.7:0/773679144 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f638c071a70 msgr2=0x7f638c1576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:01.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.685+0000 7f6382a00640 1 --2- 172.21.15.7:0/773679144 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f638c071a70 0x7f638c1576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.685+0000 7f6382a00640 1 -- 172.21.15.7:0/773679144 >> v1:172.21.15.77:6789/0 conn(0x7f638c06ddb0 legacy=0x7f638c15a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:01.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.685+0000 7f6382a00640 1 -- 172.21.15.7:0/773679144 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c0b10c0 con 0x7f638c0b0bf0 2024-09-13T15:04:01.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.685+0000 7f6382a00640 1 --2- 172.21.15.7:0/773679144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c0b0bf0 0x7f638c150cd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f63740097c0 tx=0x7f637401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8eb3d4cb4609812 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:01.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f638aa00640 1 -- 172.21.15.7:0/773679144 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63740ab670 con 0x7f638c0b0bf0 2024-09-13T15:04:01.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f638aa00640 1 -- 172.21.15.7:0/773679144 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63740ab7d0 con 0x7f638c0b0bf0 2024-09-13T15:04:01.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f638aa00640 1 -- 172.21.15.7:0/773679144 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63740abb60 con 0x7f638c0b0bf0 2024-09-13T15:04:01.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f6392200640 1 -- 172.21.15.7:0/773679144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c0b0bf0 msgr2=0x7f638c150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:01.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f6392200640 1 --2- 172.21.15.7:0/773679144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c0b0bf0 0x7f638c150cd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f63740097c0 tx=0x7f637401c470 comp rx=0 tx=0).stop 2024-09-13T15:04:01.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f6392200640 1 -- 172.21.15.7:0/773679144 shutdown_connections 2024-09-13T15:04:01.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f6392200640 1 --2- 172.21.15.7:0/773679144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c0b0bf0 0x7f638c150cd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f6392200640 1 --2- 172.21.15.7:0/773679144 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f638c071a70 0x7f638c1576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f6392200640 1 -- 172.21.15.7:0/773679144 >> 172.21.15.7:0/773679144 conn(0x7f638c065d40 msgr2=0x7f638c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:01.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f6392200640 1 -- 172.21.15.7:0/773679144 shutdown_connections 2024-09-13T15:04:01.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f6392200640 1 -- 172.21.15.7:0/773679144 wait complete. 2024-09-13T15:04:01.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f6392200640 1 Processor -- start 2024-09-13T15:04:01.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f6392200640 1 -- start start 2024-09-13T15:04:01.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f6392200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f638c06ddb0 0x7f638c0c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:01.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f6392200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c071a70 0x7f638c0c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:01.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f6392200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f638c0b0bf0 0x7f638c141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:01.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f6392200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c1f6590 con 0x7f638c06ddb0 2024-09-13T15:04:01.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f6392200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c1486b0 con 0x7f638c071a70 2024-09-13T15:04:01.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f6392200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638c0c7380 con 0x7f638c0b0bf0 2024-09-13T15:04:01.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f638b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f638c06ddb0 0x7f638c0c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:01.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f638b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f638c06ddb0 0x7f638c0c67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45462/0 (socket says 172.21.15.7:45462) 2024-09-13T15:04:01.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f638b400640 1 -- 172.21.15.7:0/2790060144 learned_addr learned my addr 172.21.15.7:0/2790060144 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:01.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f6382a00640 1 --2- 172.21.15.7:0/2790060144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c071a70 0x7f638c0c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:01.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.689+0000 7f638be00640 1 --2- 172.21.15.7:0/2790060144 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f638c0b0bf0 0x7f638c141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:01.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.693+0000 7f638b400640 1 -- 172.21.15.7:0/2790060144 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f638c0b0bf0 msgr2=0x7f638c141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:01.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.693+0000 7f638b400640 1 --2- 172.21.15.7:0/2790060144 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f638c0b0bf0 0x7f638c141360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.693+0000 7f638b400640 1 -- 172.21.15.7:0/2790060144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c071a70 msgr2=0x7f638c0c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:01.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.693+0000 7f638b400640 1 --2- 172.21.15.7:0/2790060144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c071a70 0x7f638c0c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.693+0000 7f638b400640 1 -- 172.21.15.7:0/2790060144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6374009420 con 0x7f638c06ddb0 2024-09-13T15:04:01.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.693+0000 7f638b400640 1 --2- 172.21.15.7:0/2790060144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f638c06ddb0 0x7f638c0c67f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f637c00e820 tx=0x7f637c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:01.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.693+0000 7f6383e00640 1 -- 172.21.15.7:0/2790060144 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c009580 con 0x7f638c06ddb0 2024-09-13T15:04:01.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.693+0000 7f6383e00640 1 -- 172.21.15.7:0/2790060144 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c00c940 con 0x7f638c06ddb0 2024-09-13T15:04:01.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.693+0000 7f6383e00640 1 -- 172.21.15.7:0/2790060144 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c00ccf0 con 0x7f638c06ddb0 2024-09-13T15:04:01.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.693+0000 7f6392200640 1 -- 172.21.15.7:0/2790060144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638c1f5fd0 con 0x7f638c06ddb0 2024-09-13T15:04:01.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.693+0000 7f6392200640 1 -- 172.21.15.7:0/2790060144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638c148340 con 0x7f638c06ddb0 2024-09-13T15:04:01.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.693+0000 7f6392200640 1 -- 172.21.15.7:0/2790060144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638c067650 con 0x7f638c06ddb0 2024-09-13T15:04:01.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.693+0000 7f6383e00640 1 -- 172.21.15.7:0/2790060144 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f637c013470 con 0x7f638c06ddb0 2024-09-13T15:04:01.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.693+0000 7f6383e00640 1 --2- 172.21.15.7:0/2790060144 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6368066690 0x7f6368068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:01.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.693+0000 7f6383e00640 1 -- 172.21.15.7:0/2790060144 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f637c084a60 con 0x7f638c06ddb0 2024-09-13T15:04:01.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.697+0000 7f6382a00640 1 --2- 172.21.15.7:0/2790060144 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6368066690 0x7f6368068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:01.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.697+0000 7f6382a00640 1 --2- 172.21.15.7:0/2790060144 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6368066690 0x7f6368068b50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f63740af000 tx=0x7f63740b6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:01.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.697+0000 7f6383e00640 1 -- 172.21.15.7:0/2790060144 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f637c051990 con 0x7f638c06ddb0 2024-09-13T15:04:01.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.861+0000 7f6392200640 1 -- 172.21.15.7:0/2790060144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f638c1481a0 con 0x7f638c06ddb0 2024-09-13T15:04:01.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.865+0000 7f6383e00640 1 -- 172.21.15.7:0/2790060144 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18616 (secure 0 0 0) 0x7f638c1481a0 con 0x7f638c06ddb0 2024-09-13T15:04:01.866 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:01.866 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:02:33.732864+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:04:01.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.865+0000 7f6392200640 1 -- 172.21.15.7:0/2790060144 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6368066690 msgr2=0x7f6368068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:01.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.865+0000 7f6392200640 1 --2- 172.21.15.7:0/2790060144 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6368066690 0x7f6368068b50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f63740af000 tx=0x7f63740b6040 comp rx=0 tx=0).stop 2024-09-13T15:04:01.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.865+0000 7f6392200640 1 -- 172.21.15.7:0/2790060144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f638c06ddb0 msgr2=0x7f638c0c67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:01.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.865+0000 7f6392200640 1 --2- 172.21.15.7:0/2790060144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f638c06ddb0 0x7f638c0c67f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f637c00e820 tx=0x7f637c00ece0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.865+0000 7f6392200640 1 -- 172.21.15.7:0/2790060144 shutdown_connections 2024-09-13T15:04:01.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.865+0000 7f6392200640 1 --2- 172.21.15.7:0/2790060144 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6368066690 0x7f6368068b50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.865+0000 7f6392200640 1 --2- 172.21.15.7:0/2790060144 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f638c0b0bf0 0x7f638c141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.865+0000 7f6392200640 1 --2- 172.21.15.7:0/2790060144 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c071a70 0x7f638c0c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.865+0000 7f6392200640 1 --2- 172.21.15.7:0/2790060144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f638c06ddb0 0x7f638c0c67f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:01.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.865+0000 7f6392200640 1 -- 172.21.15.7:0/2790060144 >> 172.21.15.7:0/2790060144 conn(0x7f638c065d40 msgr2=0x7f638c158fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:01.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.865+0000 7f6392200640 1 -- 172.21.15.7:0/2790060144 shutdown_connections 2024-09-13T15:04:01.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:01.865+0000 7f6392200640 1 -- 172.21.15.7:0/2790060144 wait complete. 2024-09-13T15:04:01.888 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:01:38.710958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:01:43.178724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:01:43.774877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:01:46.843203+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:04:01.888 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:04:02.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.029+0000 7fbdd2400640 1 Processor -- start 2024-09-13T15:04:02.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.029+0000 7fbdd2400640 1 -- start start 2024-09-13T15:04:02.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.033+0000 7fbdd2400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbdcc1503e0 0x7fbdcc0c5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.033+0000 7fbdd2400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdcc06fde0 con 0x7fbdcc0c7960 2024-09-13T15:04:02.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.033+0000 7fbdd2400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdcc0c6780 con 0x7fbdcc0c7580 2024-09-13T15:04:02.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.033+0000 7fbdd2400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdcc0c6a40 con 0x7fbdcc1503e0 2024-09-13T15:04:02.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.033+0000 7fbdd1a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbdcc1503e0 0x7fbdcc0c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.033+0000 7fbdc3e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbdcc0c7960 0x7fbdcc14fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37834/0 (socket says 172.21.15.7:37834) 2024-09-13T15:04:02.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.033+0000 7fbdc3e00640 1 -- 172.21.15.7:0/2186954315 learned_addr learned my addr 172.21.15.7:0/2186954315 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:02.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.033+0000 7fbdd1a00640 1 -- 172.21.15.7:0/2186954315 >> v1:172.21.15.77:6789/0 conn(0x7fbdcc0c7580 legacy=0x7fbdcc06f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.033+0000 7fbdd1a00640 1 -- 172.21.15.7:0/2186954315 >> v1:172.21.15.7:6789/0 conn(0x7fbdcc0c7960 legacy=0x7fbdcc14fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.033+0000 7fbdd1a00640 1 -- 172.21.15.7:0/2186954315 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc0c6d20 con 0x7fbdcc1503e0 2024-09-13T15:04:02.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.033+0000 7fbdd1a00640 1 --2- 172.21.15.7:0/2186954315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc1503e0 0x7fbdcc0c5290 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009d90 tx=0x7fbdc401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205c638fa1a7da79 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:02.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdcbe00640 1 -- 172.21.15.7:0/2186954315 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40af600 con 0x7fbdcc1503e0 2024-09-13T15:04:02.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdcbe00640 1 -- 172.21.15.7:0/2186954315 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc40ab050 con 0x7fbdcc1503e0 2024-09-13T15:04:02.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdcbe00640 1 -- 172.21.15.7:0/2186954315 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40af980 con 0x7fbdcc1503e0 2024-09-13T15:04:02.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdd2400640 1 -- 172.21.15.7:0/2186954315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc1503e0 msgr2=0x7fbdcc0c5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdd2400640 1 --2- 172.21.15.7:0/2186954315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc1503e0 0x7fbdcc0c5290 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009d90 tx=0x7fbdc401f150 comp rx=0 tx=0).stop 2024-09-13T15:04:02.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdd2400640 1 -- 172.21.15.7:0/2186954315 shutdown_connections 2024-09-13T15:04:02.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdd2400640 1 --2- 172.21.15.7:0/2186954315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc1503e0 0x7fbdcc0c5290 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdd2400640 1 -- 172.21.15.7:0/2186954315 >> 172.21.15.7:0/2186954315 conn(0x7fbdcc065d40 msgr2=0x7fbdcc066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:02.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdd2400640 1 -- 172.21.15.7:0/2186954315 shutdown_connections 2024-09-13T15:04:02.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdd2400640 1 -- 172.21.15.7:0/2186954315 wait complete. 2024-09-13T15:04:02.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdd2400640 1 Processor -- start 2024-09-13T15:04:02.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdd2400640 1 -- start start 2024-09-13T15:04:02.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdd2400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbdcc0c7580 0x7fbdcc1e0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdd2400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc0c7960 0x7fbdcc1f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdd2400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdcc1503e0 0x7fbdcc1e1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdd2400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc149140 con 0x7fbdcc0c7960 2024-09-13T15:04:02.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdd2400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc155710 con 0x7fbdcc1503e0 2024-09-13T15:04:02.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdd2400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc0ca3e0 con 0x7fbdcc0c7580 2024-09-13T15:04:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdc3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc0c7960 0x7fbdcc1f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdc3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc0c7960 0x7fbdcc1f1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45478/0 (socket says 172.21.15.7:45478) 2024-09-13T15:04:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdc3e00640 1 -- 172.21.15.7:0/596487762 learned_addr learned my addr 172.21.15.7:0/596487762 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdd1a00640 1 --2- 172.21.15.7:0/596487762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdcc1503e0 0x7fbdcc1e1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.037+0000 7fbdd1000640 1 --2- 172.21.15.7:0/596487762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbdcc0c7580 0x7fbdcc1e0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.041+0000 7fbdc3e00640 1 -- 172.21.15.7:0/596487762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbdcc0c7580 msgr2=0x7fbdcc1e0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.041+0000 7fbdc3e00640 1 --2- 172.21.15.7:0/596487762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbdcc0c7580 0x7fbdcc1e0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.041+0000 7fbdc3e00640 1 -- 172.21.15.7:0/596487762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdcc1503e0 msgr2=0x7fbdcc1e1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.041+0000 7fbdc3e00640 1 --2- 172.21.15.7:0/596487762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdcc1503e0 0x7fbdcc1e1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.041+0000 7fbdc3e00640 1 -- 172.21.15.7:0/596487762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc4009a70 con 0x7fbdcc0c7960 2024-09-13T15:04:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.041+0000 7fbdc3e00640 1 --2- 172.21.15.7:0/596487762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc0c7960 0x7fbdcc1f1d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400c4d0 tx=0x7fbdb400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.041+0000 7fbdc9600640 1 -- 172.21.15.7:0/596487762 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4005cf0 con 0x7fbdcc0c7960 2024-09-13T15:04:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.041+0000 7fbdc9600640 1 -- 172.21.15.7:0/596487762 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb4005e50 con 0x7fbdcc0c7960 2024-09-13T15:04:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.041+0000 7fbdd2400640 1 -- 172.21.15.7:0/596487762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdcc155920 con 0x7fbdcc0c7960 2024-09-13T15:04:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.041+0000 7fbdc9600640 1 -- 172.21.15.7:0/596487762 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4007270 con 0x7fbdcc0c7960 2024-09-13T15:04:02.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.041+0000 7fbdd2400640 1 -- 172.21.15.7:0/596487762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdcc0ca070 con 0x7fbdcc0c7960 2024-09-13T15:04:02.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.041+0000 7fbdd2400640 1 -- 172.21.15.7:0/596487762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdcc0ca570 con 0x7fbdcc0c7960 2024-09-13T15:04:02.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.041+0000 7fbdc9600640 1 -- 172.21.15.7:0/596487762 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbdb40073d0 con 0x7fbdcc0c7960 2024-09-13T15:04:02.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.041+0000 7fbdc9600640 1 --2- 172.21.15.7:0/596487762 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbda80666c0 0x7fbda8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.041+0000 7fbdc9600640 1 -- 172.21.15.7:0/596487762 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbdb40839f0 con 0x7fbdcc0c7960 2024-09-13T15:04:02.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.045+0000 7fbdd1000640 1 --2- 172.21.15.7:0/596487762 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbda80666c0 0x7fbda8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.045+0000 7fbdd1000640 1 --2- 172.21.15.7:0/596487762 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbda80666c0 0x7fbda8068b80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc000f70 tx=0x7fbdbc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:02.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.045+0000 7fbdc9600640 1 -- 172.21.15.7:0/596487762 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbdb40509b0 con 0x7fbdcc0c7960 2024-09-13T15:04:02.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.209+0000 7fbdd2400640 1 -- 172.21.15.7:0/596487762 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbdcc0c1880 con 0x7fbdcc0c7960 2024-09-13T15:04:02.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.209+0000 7fbdc9600640 1 -- 172.21.15.7:0/596487762 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbdb40170a0 con 0x7fbdcc0c7960 2024-09-13T15:04:02.212 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T15:04:02.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.209+0000 7fbdd2400640 1 -- 172.21.15.7:0/596487762 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbda80666c0 msgr2=0x7fbda8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.209+0000 7fbdd2400640 1 --2- 172.21.15.7:0/596487762 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbda80666c0 0x7fbda8068b80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc000f70 tx=0x7fbdbc009040 comp rx=0 tx=0).stop 2024-09-13T15:04:02.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.209+0000 7fbdd2400640 1 -- 172.21.15.7:0/596487762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc0c7960 msgr2=0x7fbdcc1f1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.209+0000 7fbdd2400640 1 --2- 172.21.15.7:0/596487762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc0c7960 0x7fbdcc1f1d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400c4d0 tx=0x7fbdb400c990 comp rx=0 tx=0).stop 2024-09-13T15:04:02.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.213+0000 7fbdd2400640 1 -- 172.21.15.7:0/596487762 shutdown_connections 2024-09-13T15:04:02.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.213+0000 7fbdd2400640 1 --2- 172.21.15.7:0/596487762 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbda80666c0 0x7fbda8068b80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.213+0000 7fbdd2400640 1 --2- 172.21.15.7:0/596487762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbdcc1503e0 0x7fbdcc1e1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.213+0000 7fbdd2400640 1 --2- 172.21.15.7:0/596487762 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbdcc0c7960 0x7fbdcc1f1d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.213+0000 7fbdd2400640 1 --2- 172.21.15.7:0/596487762 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbdcc0c7580 0x7fbdcc1e0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.213+0000 7fbdd2400640 1 -- 172.21.15.7:0/596487762 >> 172.21.15.7:0/596487762 conn(0x7fbdcc065d40 msgr2=0x7fbdcc071230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:02.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.213+0000 7fbdd2400640 1 -- 172.21.15.7:0/596487762 shutdown_connections 2024-09-13T15:04:02.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.213+0000 7fbdd2400640 1 -- 172.21.15.7:0/596487762 wait complete. 2024-09-13T15:04:02.233 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:04:02.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.373+0000 7f34f7200640 1 Processor -- start 2024-09-13T15:04:02.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.373+0000 7f34f7200640 1 -- start start 2024-09-13T15:04:02.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.373+0000 7f34f7200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34f8152d20 0x7f34f806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.373+0000 7f34f7200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f34f806df00 0x7f34f8071500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.373+0000 7f34f7200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f34f8153100 0x7f34f8071a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.373+0000 7f34f7200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f8159e40 con 0x7f34f8153100 2024-09-13T15:04:02.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.373+0000 7f34f7200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f806e530 con 0x7f34f806df00 2024-09-13T15:04:02.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.373+0000 7f34f7200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f8158fe0 con 0x7f34f8152d20 2024-09-13T15:04:02.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.373+0000 7f34f6800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f34f8153100 0x7f34f8071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.377+0000 7f34f6800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f34f8153100 0x7f34f8071a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45480/0 (socket says 172.21.15.7:45480) 2024-09-13T15:04:02.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.377+0000 7f34f6800640 1 -- 172.21.15.7:0/978224226 learned_addr learned my addr 172.21.15.7:0/978224226 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:02.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.377+0000 7f34efe00640 1 --2- 172.21.15.7:0/978224226 >> v2:172.21.15.77:3300/0 conn(0x7f34f806df00 0x7f34f8071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.377+0000 7f34f5e00640 1 --2- 172.21.15.7:0/978224226 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34f8152d20 0x7f34f806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.377+0000 7f34f6800640 1 -- 172.21.15.7:0/978224226 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34f8152d20 msgr2=0x7f34f806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:02.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.377+0000 7f34f6800640 1 --2- 172.21.15.7:0/978224226 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34f8152d20 0x7f34f806d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.377+0000 7f34f6800640 1 -- 172.21.15.7:0/978224226 >> v2:172.21.15.77:3300/0 conn(0x7f34f806df00 msgr2=0x7f34f8071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:02.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.377+0000 7f34f6800640 1 --2- 172.21.15.7:0/978224226 >> v2:172.21.15.77:3300/0 conn(0x7f34f806df00 0x7f34f8071500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.377+0000 7f34f6800640 1 -- 172.21.15.7:0/978224226 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f81592c0 con 0x7f34f8153100 2024-09-13T15:04:02.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.377+0000 7f34f6800640 1 --2- 172.21.15.7:0/978224226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34f8153100 0x7f34f8071a40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f34f80700b0 tx=0x7f34f001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d7b66e80b9109f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.377+0000 7f34f5400640 1 -- 172.21.15.7:0/978224226 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00a5760 con 0x7f34f8153100 2024-09-13T15:04:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.377+0000 7f34f5400640 1 -- 172.21.15.7:0/978224226 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f00a58c0 con 0x7f34f8153100 2024-09-13T15:04:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.377+0000 7f34f5400640 1 -- 172.21.15.7:0/978224226 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00a5c50 con 0x7f34f8153100 2024-09-13T15:04:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f7200640 1 -- 172.21.15.7:0/978224226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34f8153100 msgr2=0x7f34f8071a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f7200640 1 --2- 172.21.15.7:0/978224226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34f8153100 0x7f34f8071a40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f34f80700b0 tx=0x7f34f001c9f0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f7200640 1 -- 172.21.15.7:0/978224226 shutdown_connections 2024-09-13T15:04:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f7200640 1 --2- 172.21.15.7:0/978224226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34f8153100 0x7f34f8071a40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f7200640 1 --2- 172.21.15.7:0/978224226 >> v2:172.21.15.77:3300/0 conn(0x7f34f806df00 0x7f34f8071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f7200640 1 --2- 172.21.15.7:0/978224226 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34f8152d20 0x7f34f806d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f7200640 1 -- 172.21.15.7:0/978224226 >> 172.21.15.7:0/978224226 conn(0x7f34f80cc9b0 msgr2=0x7f34f80ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f7200640 1 -- 172.21.15.7:0/978224226 shutdown_connections 2024-09-13T15:04:02.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f7200640 1 -- 172.21.15.7:0/978224226 wait complete. 2024-09-13T15:04:02.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f7200640 1 Processor -- start 2024-09-13T15:04:02.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f7200640 1 -- start start 2024-09-13T15:04:02.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f7200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34f8152d20 0x7f34f80cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f7200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34f8153100 0x7f34f80cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f7200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34f81494d0 0x7f34f81f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f7200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f8148710 con 0x7f34f8153100 2024-09-13T15:04:02.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f7200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f8156030 con 0x7f34f8152d20 2024-09-13T15:04:02.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f7200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f81562f0 con 0x7f34f81494d0 2024-09-13T15:04:02.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34efe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34f8153100 0x7f34f80cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34efe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34f8153100 0x7f34f80cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45482/0 (socket says 172.21.15.7:45482) 2024-09-13T15:04:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34efe00640 1 -- 172.21.15.7:0/2574620369 learned_addr learned my addr 172.21.15.7:0/2574620369 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f5e00640 1 --2- 172.21.15.7:0/2574620369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34f8152d20 0x7f34f80cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f6800640 1 --2- 172.21.15.7:0/2574620369 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34f81494d0 0x7f34f81f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34efe00640 1 -- 172.21.15.7:0/2574620369 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34f81494d0 msgr2=0x7f34f81f54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34efe00640 1 --2- 172.21.15.7:0/2574620369 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34f81494d0 0x7f34f81f54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34efe00640 1 -- 172.21.15.7:0/2574620369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34f8152d20 msgr2=0x7f34f80cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34efe00640 1 --2- 172.21.15.7:0/2574620369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34f8152d20 0x7f34f80cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34efe00640 1 -- 172.21.15.7:0/2574620369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f0009b30 con 0x7f34f8153100 2024-09-13T15:04:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34f5e00640 1 --2- 172.21.15.7:0/2574620369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34f8152d20 0x7f34f80cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:02.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34efe00640 1 --2- 172.21.15.7:0/2574620369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34f8153100 0x7f34f80cbe70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f34e000e820 tx=0x7f34e000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.381+0000 7f34ee000640 1 -- 172.21.15.7:0/2574620369 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e00095b0 con 0x7f34f8153100 2024-09-13T15:04:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.385+0000 7f34ee000640 1 -- 172.21.15.7:0/2574620369 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e000c940 con 0x7f34f8153100 2024-09-13T15:04:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.385+0000 7f34ee000640 1 -- 172.21.15.7:0/2574620369 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e000ccd0 con 0x7f34f8153100 2024-09-13T15:04:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.385+0000 7f34f7200640 1 -- 172.21.15.7:0/2574620369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f8147d70 con 0x7f34f8153100 2024-09-13T15:04:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.385+0000 7f34f7200640 1 -- 172.21.15.7:0/2574620369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f8148330 con 0x7f34f8153100 2024-09-13T15:04:02.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.385+0000 7f34f7200640 1 -- 172.21.15.7:0/2574620369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f8067650 con 0x7f34f8153100 2024-09-13T15:04:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.385+0000 7f34ee000640 1 -- 172.21.15.7:0/2574620369 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f34e0013470 con 0x7f34f8153100 2024-09-13T15:04:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.385+0000 7f34ee000640 1 --2- 172.21.15.7:0/2574620369 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f34d4066690 0x7f34d4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.385+0000 7f34ee000640 1 -- 172.21.15.7:0/2574620369 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f34e0084750 con 0x7f34f8153100 2024-09-13T15:04:02.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.385+0000 7f34f5e00640 1 --2- 172.21.15.7:0/2574620369 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f34d4066690 0x7f34d4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.389+0000 7f34f5e00640 1 --2- 172.21.15.7:0/2574620369 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f34d4066690 0x7f34d4068b50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009bb0 tx=0x7f34e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:02.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.389+0000 7f34ee000640 1 -- 172.21.15.7:0/2574620369 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f34e0051660 con 0x7f34f8153100 2024-09-13T15:04:02.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.549+0000 7f34f7200640 1 -- 172.21.15.7:0/2574620369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f34f80c92b0 con 0x7f34f8153100 2024-09-13T15:04:02.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.549+0000 7f34ee000640 1 -- 172.21.15.7:0/2574620369 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f34e0054c80 con 0x7f34f8153100 2024-09-13T15:04:02.553 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T15:04:02.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.553+0000 7f34f7200640 1 -- 172.21.15.7:0/2574620369 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f34d4066690 msgr2=0x7f34d4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.553+0000 7f34f7200640 1 --2- 172.21.15.7:0/2574620369 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f34d4066690 0x7f34d4068b50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009bb0 tx=0x7f34e8008040 comp rx=0 tx=0).stop 2024-09-13T15:04:02.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.553+0000 7f34f7200640 1 -- 172.21.15.7:0/2574620369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34f8153100 msgr2=0x7f34f80cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.553+0000 7f34f7200640 1 --2- 172.21.15.7:0/2574620369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34f8153100 0x7f34f80cbe70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f34e000e820 tx=0x7f34e000ece0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.553+0000 7f34f7200640 1 -- 172.21.15.7:0/2574620369 shutdown_connections 2024-09-13T15:04:02.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.553+0000 7f34f7200640 1 --2- 172.21.15.7:0/2574620369 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f34d4066690 0x7f34d4068b50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.553+0000 7f34f7200640 1 --2- 172.21.15.7:0/2574620369 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34f81494d0 0x7f34f81f54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.553+0000 7f34f7200640 1 --2- 172.21.15.7:0/2574620369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34f8153100 0x7f34f80cbe70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.553+0000 7f34f7200640 1 --2- 172.21.15.7:0/2574620369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34f8152d20 0x7f34f80cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.553+0000 7f34f7200640 1 -- 172.21.15.7:0/2574620369 >> 172.21.15.7:0/2574620369 conn(0x7f34f80cc9b0 msgr2=0x7f34f8151370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:02.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.553+0000 7f34f7200640 1 -- 172.21.15.7:0/2574620369 shutdown_connections 2024-09-13T15:04:02.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.553+0000 7f34f7200640 1 -- 172.21.15.7:0/2574620369 wait complete. 2024-09-13T15:04:02.574 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:04:02.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.713+0000 7f94e7c00640 1 Processor -- start 2024-09-13T15:04:02.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.717+0000 7f94e7c00640 1 -- start start 2024-09-13T15:04:02.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.717+0000 7f94e7c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f94e006f610 0x7f94e0151000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.717+0000 7f94e7c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94e00c6d70 0x7f94e0151540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.717+0000 7f94e7c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e00c4cc0 con 0x7f94e00c90f0 2024-09-13T15:04:02.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.717+0000 7f94e7c00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e00c8100 con 0x7f94e006f610 2024-09-13T15:04:02.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.717+0000 7f94e7c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00c61b0 con 0x7f94e00c6d70 2024-09-13T15:04:02.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.717+0000 7f94dfe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f94e00c90f0 0x7f94e00c6660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37846/0 (socket says 172.21.15.7:37846) 2024-09-13T15:04:02.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.717+0000 7f94dfe00640 1 -- 172.21.15.7:0/1021956014 learned_addr learned my addr 172.21.15.7:0/1021956014 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:02.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.717+0000 7f94e5200640 1 --2- 172.21.15.7:0/1021956014 >> v2:172.21.15.77:3300/0 conn(0x7f94e006f610 0x7f94e0151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.717+0000 7f94e5c00640 1 --2- 172.21.15.7:0/1021956014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94e00c6d70 0x7f94e0151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.717+0000 7f94df400640 1 -- 172.21.15.7:0/1021956014 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281522381 0 0) 0x7f94e00c4cc0 con 0x7f94e00c90f0 2024-09-13T15:04:02.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.717+0000 7f94df400640 1 -- 172.21.15.7:0/1021956014 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c8003530 con 0x7f94e00c90f0 2024-09-13T15:04:02.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.717+0000 7f94e5200640 1 -- 172.21.15.7:0/1021956014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94e00c6d70 msgr2=0x7f94e0151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:02.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.717+0000 7f94e5200640 1 --2- 172.21.15.7:0/1021956014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94e00c6d70 0x7f94e0151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.717+0000 7f94e5200640 1 -- 172.21.15.7:0/1021956014 >> v1:172.21.15.7:6789/0 conn(0x7f94e00c90f0 legacy=0x7f94e00c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.717+0000 7f94e5200640 1 -- 172.21.15.7:0/1021956014 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e00c8350 con 0x7f94e006f610 2024-09-13T15:04:02.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.721+0000 7f94e5200640 1 --2- 172.21.15.7:0/1021956014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94e006f610 0x7f94e0151000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f94d40097c0 tx=0x7f94d401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c26eac655638dc1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:02.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.721+0000 7f94df400640 1 -- 172.21.15.7:0/1021956014 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d40a8990 con 0x7f94e006f610 2024-09-13T15:04:02.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.721+0000 7f94df400640 1 -- 172.21.15.7:0/1021956014 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d40a8af0 con 0x7f94e006f610 2024-09-13T15:04:02.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.721+0000 7f94df400640 1 -- 172.21.15.7:0/1021956014 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d40a8e80 con 0x7f94e006f610 2024-09-13T15:04:02.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.721+0000 7f94e7c00640 1 -- 172.21.15.7:0/1021956014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94e006f610 msgr2=0x7f94e0151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.721+0000 7f94e7c00640 1 --2- 172.21.15.7:0/1021956014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94e006f610 0x7f94e0151000 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f94d40097c0 tx=0x7f94d401ec90 comp rx=0 tx=0).stop 2024-09-13T15:04:02.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.721+0000 7f94e7c00640 1 -- 172.21.15.7:0/1021956014 shutdown_connections 2024-09-13T15:04:02.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.721+0000 7f94e7c00640 1 --2- 172.21.15.7:0/1021956014 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94e00c6d70 0x7f94e0151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.721+0000 7f94e7c00640 1 --2- 172.21.15.7:0/1021956014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94e006f610 0x7f94e0151000 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.721+0000 7f94e7c00640 1 -- 172.21.15.7:0/1021956014 >> 172.21.15.7:0/1021956014 conn(0x7f94e00717c0 msgr2=0x7f94e0071bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:02.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.721+0000 7f94e7c00640 1 -- 172.21.15.7:0/1021956014 shutdown_connections 2024-09-13T15:04:02.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.721+0000 7f94e7c00640 1 -- 172.21.15.7:0/1021956014 wait complete. 2024-09-13T15:04:02.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e7c00640 1 Processor -- start 2024-09-13T15:04:02.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e7c00640 1 -- start start 2024-09-13T15:04:02.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e7c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94e006f610 0x7f94e00ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e7c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94e00c6d70 0x7f94e00bfb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e7c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94e00c90f0 0x7f94e00c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e7c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0151f70 con 0x7f94e006f610 2024-09-13T15:04:02.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e7c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e01f1ed0 con 0x7f94e00c6d70 2024-09-13T15:04:02.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e7c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0152b20 con 0x7f94e00c90f0 2024-09-13T15:04:02.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94e006f610 0x7f94e00ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94e006f610 0x7f94e00ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45484/0 (socket says 172.21.15.7:45484) 2024-09-13T15:04:02.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e5200640 1 -- 172.21.15.7:0/4066350604 learned_addr learned my addr 172.21.15.7:0/4066350604 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:02.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e5c00640 1 --2- 172.21.15.7:0/4066350604 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94e00c90f0 0x7f94e00c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94dfe00640 1 --2- 172.21.15.7:0/4066350604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94e00c6d70 0x7f94e00bfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e5200640 1 -- 172.21.15.7:0/4066350604 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94e00c90f0 msgr2=0x7f94e00c0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e5200640 1 --2- 172.21.15.7:0/4066350604 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94e00c90f0 0x7f94e00c0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e5200640 1 -- 172.21.15.7:0/4066350604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94e00c6d70 msgr2=0x7f94e00bfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e5200640 1 --2- 172.21.15.7:0/4066350604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94e00c6d70 0x7f94e00bfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e5200640 1 -- 172.21.15.7:0/4066350604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d4009420 con 0x7f94e006f610 2024-09-13T15:04:02.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e5c00640 1 --2- 172.21.15.7:0/4066350604 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94e00c90f0 0x7f94e00c0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:02.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e5200640 1 --2- 172.21.15.7:0/4066350604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94e006f610 0x7f94e00ccd10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f94d40b3040 tx=0x7f94d401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:02.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94dcc00640 1 -- 172.21.15.7:0/4066350604 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d40b0d60 con 0x7f94e006f610 2024-09-13T15:04:02.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94dcc00640 1 -- 172.21.15.7:0/4066350604 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d40b9430 con 0x7f94e006f610 2024-09-13T15:04:02.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94dcc00640 1 -- 172.21.15.7:0/4066350604 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d40b97e0 con 0x7f94e006f610 2024-09-13T15:04:02.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e7c00640 1 -- 172.21.15.7:0/4066350604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e01f2d10 con 0x7f94e006f610 2024-09-13T15:04:02.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e7c00640 1 -- 172.21.15.7:0/4066350604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e01f23e0 con 0x7f94e006f610 2024-09-13T15:04:02.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.725+0000 7f94e7c00640 1 -- 172.21.15.7:0/4066350604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e00c6660 con 0x7f94e006f610 2024-09-13T15:04:02.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.729+0000 7f94dcc00640 1 -- 172.21.15.7:0/4066350604 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f94d40b7040 con 0x7f94e006f610 2024-09-13T15:04:02.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.729+0000 7f94dcc00640 1 --2- 172.21.15.7:0/4066350604 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f94c0066690 0x7f94c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:02.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.729+0000 7f94dcc00640 1 -- 172.21.15.7:0/4066350604 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f94d4122040 con 0x7f94e006f610 2024-09-13T15:04:02.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.729+0000 7f94dfe00640 1 --2- 172.21.15.7:0/4066350604 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f94c0066690 0x7f94c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:02.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.729+0000 7f94dfe00640 1 --2- 172.21.15.7:0/4066350604 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f94c0066690 0x7f94c0068b50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f94e014d840 tx=0x7f94cc007d40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:02.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.733+0000 7f94dcc00640 1 -- 172.21.15.7:0/4066350604 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f94d40eef50 con 0x7f94e006f610 2024-09-13T15:04:02.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.897+0000 7f94e7c00640 1 -- 172.21.15.7:0/4066350604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94e014b540 con 0x7f94e006f610 2024-09-13T15:04:02.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.897+0000 7f94dcc00640 1 -- 172.21.15.7:0/4066350604 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f94d40b5020 con 0x7f94e006f610 2024-09-13T15:04:02.899 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-13T15:04:02.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.897+0000 7f94e7c00640 1 -- 172.21.15.7:0/4066350604 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f94c0066690 msgr2=0x7f94c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.897+0000 7f94e7c00640 1 --2- 172.21.15.7:0/4066350604 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f94c0066690 0x7f94c0068b50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f94e014d840 tx=0x7f94cc007d40 comp rx=0 tx=0).stop 2024-09-13T15:04:02.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.897+0000 7f94e7c00640 1 -- 172.21.15.7:0/4066350604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94e006f610 msgr2=0x7f94e00ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:02.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.897+0000 7f94e7c00640 1 --2- 172.21.15.7:0/4066350604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94e006f610 0x7f94e00ccd10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f94d40b3040 tx=0x7f94d401ba30 comp rx=0 tx=0).stop 2024-09-13T15:04:02.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.897+0000 7f94e7c00640 1 -- 172.21.15.7:0/4066350604 shutdown_connections 2024-09-13T15:04:02.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.897+0000 7f94e7c00640 1 --2- 172.21.15.7:0/4066350604 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f94c0066690 0x7f94c0068b50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.897+0000 7f94e7c00640 1 --2- 172.21.15.7:0/4066350604 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f94e00c90f0 0x7f94e00c0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.897+0000 7f94e7c00640 1 --2- 172.21.15.7:0/4066350604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f94e00c6d70 0x7f94e00bfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.897+0000 7f94e7c00640 1 --2- 172.21.15.7:0/4066350604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f94e006f610 0x7f94e00ccd10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:02.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.897+0000 7f94e7c00640 1 -- 172.21.15.7:0/4066350604 >> 172.21.15.7:0/4066350604 conn(0x7f94e00717c0 msgr2=0x7f94e014b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:02.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.897+0000 7f94e7c00640 1 -- 172.21.15.7:0/4066350604 shutdown_connections 2024-09-13T15:04:02.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:02.897+0000 7f94e7c00640 1 -- 172.21.15.7:0/4066350604 wait complete. 2024-09-13T15:04:02.921 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:04:03.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.061+0000 7ff989800640 1 Processor -- start 2024-09-13T15:04:03.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.061+0000 7ff989800640 1 -- start start 2024-09-13T15:04:03.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.061+0000 7ff989800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff984150d90 0x7ff984157590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:03.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.061+0000 7ff989800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff984157ad0 0x7ff9840c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:03.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.061+0000 7ff989800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff984157100 con 0x7ff9840c5c30 2024-09-13T15:04:03.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.061+0000 7ff989800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff984066b00 con 0x7ff984150d90 2024-09-13T15:04:03.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.061+0000 7ff989800640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98415a3a0 con 0x7ff984157ad0 2024-09-13T15:04:03.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.061+0000 7ff983400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff9840c5c30 0x7ff984071810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37852/0 (socket says 172.21.15.7:37852) 2024-09-13T15:04:03.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.061+0000 7ff983400640 1 -- 172.21.15.7:0/1345527840 learned_addr learned my addr 172.21.15.7:0/1345527840 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:03.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.061+0000 7ff982a00640 1 --2- 172.21.15.7:0/1345527840 >> v2:172.21.15.7:3300/0 conn(0x7ff984150d90 0x7ff984157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:03.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.061+0000 7ff97a000640 1 --2- 172.21.15.7:0/1345527840 >> v2:172.21.15.77:3300/0 conn(0x7ff984157ad0 0x7ff9840c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:03.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.065+0000 7ff982a00640 1 -- 172.21.15.7:0/1345527840 >> v2:172.21.15.77:3300/0 conn(0x7ff984157ad0 msgr2=0x7ff9840c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:03.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.065+0000 7ff982a00640 1 --2- 172.21.15.7:0/1345527840 >> v2:172.21.15.77:3300/0 conn(0x7ff984157ad0 0x7ff9840c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.065+0000 7ff982a00640 1 -- 172.21.15.7:0/1345527840 >> v1:172.21.15.7:6789/0 conn(0x7ff9840c5c30 legacy=0x7ff984071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:03.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.065+0000 7ff982000640 1 -- 172.21.15.7:0/1345527840 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949085177 0 0) 0x7ff984157100 con 0x7ff9840c5c30 2024-09-13T15:04:03.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.065+0000 7ff982a00640 1 -- 172.21.15.7:0/1345527840 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff984156db0 con 0x7ff984150d90 2024-09-13T15:04:03.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.065+0000 7ff982a00640 1 --2- 172.21.15.7:0/1345527840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff984150d90 0x7ff984157590 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff98406d210 tx=0x7ff97401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c57247588d96ba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:03.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.065+0000 7ff982000640 1 -- 172.21.15.7:0/1345527840 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9740a8970 con 0x7ff984150d90 2024-09-13T15:04:03.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.065+0000 7ff982000640 1 -- 172.21.15.7:0/1345527840 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9740a8ad0 con 0x7ff984150d90 2024-09-13T15:04:03.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.065+0000 7ff982000640 1 -- 172.21.15.7:0/1345527840 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9740a8e60 con 0x7ff984150d90 2024-09-13T15:04:03.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.065+0000 7ff989800640 1 -- 172.21.15.7:0/1345527840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff984150d90 msgr2=0x7ff984157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:03.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.065+0000 7ff989800640 1 --2- 172.21.15.7:0/1345527840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff984150d90 0x7ff984157590 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff98406d210 tx=0x7ff97401ec70 comp rx=0 tx=0).stop 2024-09-13T15:04:03.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.065+0000 7ff989800640 1 -- 172.21.15.7:0/1345527840 shutdown_connections 2024-09-13T15:04:03.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.065+0000 7ff989800640 1 --2- 172.21.15.7:0/1345527840 >> v2:172.21.15.77:3300/0 conn(0x7ff984157ad0 0x7ff9840c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.065+0000 7ff989800640 1 --2- 172.21.15.7:0/1345527840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff984150d90 0x7ff984157590 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.065+0000 7ff989800640 1 -- 172.21.15.7:0/1345527840 >> 172.21.15.7:0/1345527840 conn(0x7ff984065d40 msgr2=0x7ff984066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:03.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.065+0000 7ff989800640 1 -- 172.21.15.7:0/1345527840 shutdown_connections 2024-09-13T15:04:03.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff989800640 1 -- 172.21.15.7:0/1345527840 wait complete. 2024-09-13T15:04:03.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff989800640 1 Processor -- start 2024-09-13T15:04:03.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff989800640 1 -- start start 2024-09-13T15:04:03.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff989800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9840c5c30 0x7ff984143650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:03.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff989800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff984150d90 0x7ff984147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:03.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff989800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff984157ad0 0x7ff984147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:03.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff989800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98414a430 con 0x7ff984157ad0 2024-09-13T15:04:03.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff989800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff984143b90 con 0x7ff984150d90 2024-09-13T15:04:03.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff989800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9840c57d0 con 0x7ff9840c5c30 2024-09-13T15:04:03.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff983400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff984157ad0 0x7ff984147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:03.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff983400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff984157ad0 0x7ff984147c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45498/0 (socket says 172.21.15.7:45498) 2024-09-13T15:04:03.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff983400640 1 -- 172.21.15.7:0/3814682294 learned_addr learned my addr 172.21.15.7:0/3814682294 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:03.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff97a000640 1 --2- 172.21.15.7:0/3814682294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff984150d90 0x7ff984147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:03.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff982a00640 1 --2- 172.21.15.7:0/3814682294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9840c5c30 0x7ff984143650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:03.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff983400640 1 -- 172.21.15.7:0/3814682294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9840c5c30 msgr2=0x7ff984143650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:03.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff983400640 1 --2- 172.21.15.7:0/3814682294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9840c5c30 0x7ff984143650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff983400640 1 -- 172.21.15.7:0/3814682294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff984150d90 msgr2=0x7ff984147750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:03.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff983400640 1 --2- 172.21.15.7:0/3814682294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff984150d90 0x7ff984147750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff983400640 1 -- 172.21.15.7:0/3814682294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff974009420 con 0x7ff984157ad0 2024-09-13T15:04:03.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff983400640 1 --2- 172.21.15.7:0/3814682294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff984157ad0 0x7ff984147c90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff97c001570 tx=0x7ff97c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:03.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff97b400640 1 -- 172.21.15.7:0/3814682294 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c00a640 con 0x7ff984157ad0 2024-09-13T15:04:03.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff97b400640 1 -- 172.21.15.7:0/3814682294 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff97c00a7c0 con 0x7ff984157ad0 2024-09-13T15:04:03.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff97b400640 1 -- 172.21.15.7:0/3814682294 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c00ab70 con 0x7ff984157ad0 2024-09-13T15:04:03.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.069+0000 7ff989800640 1 -- 172.21.15.7:0/3814682294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98406f600 con 0x7ff984157ad0 2024-09-13T15:04:03.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.073+0000 7ff989800640 1 -- 172.21.15.7:0/3814682294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98406fba0 con 0x7ff984157ad0 2024-09-13T15:04:03.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.073+0000 7ff989800640 1 -- 172.21.15.7:0/3814682294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff984151170 con 0x7ff984157ad0 2024-09-13T15:04:03.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.073+0000 7ff97b400640 1 -- 172.21.15.7:0/3814682294 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff97c00acd0 con 0x7ff984157ad0 2024-09-13T15:04:03.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.073+0000 7ff97b400640 1 --2- 172.21.15.7:0/3814682294 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff960066690 0x7ff960068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:03.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.073+0000 7ff97b400640 1 -- 172.21.15.7:0/3814682294 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff97c083b10 con 0x7ff984157ad0 2024-09-13T15:04:03.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.073+0000 7ff982a00640 1 --2- 172.21.15.7:0/3814682294 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff960066690 0x7ff960068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:03.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.077+0000 7ff982a00640 1 --2- 172.21.15.7:0/3814682294 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff960066690 0x7ff960068b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff9740b2000 tx=0x7ff974008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:03.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.077+0000 7ff97b400640 1 -- 172.21.15.7:0/3814682294 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff97c050ad0 con 0x7ff984157ad0 2024-09-13T15:04:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.237+0000 7ff989800640 1 -- 172.21.15.7:0/3814682294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff9840c54d0 con 0x7ff984157ad0 2024-09-13T15:04:03.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.237+0000 7ff97b400640 1 -- 172.21.15.7:0/3814682294 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff97c018020 con 0x7ff984157ad0 2024-09-13T15:04:03.240 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T15:04:03.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.241+0000 7ff989800640 1 -- 172.21.15.7:0/3814682294 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff960066690 msgr2=0x7ff960068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.241+0000 7ff989800640 1 --2- 172.21.15.7:0/3814682294 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff960066690 0x7ff960068b50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff9740b2000 tx=0x7ff974008040 comp rx=0 tx=0).stop 2024-09-13T15:04:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.241+0000 7ff989800640 1 -- 172.21.15.7:0/3814682294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff984157ad0 msgr2=0x7ff984147c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.241+0000 7ff989800640 1 --2- 172.21.15.7:0/3814682294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff984157ad0 0x7ff984147c90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff97c001570 tx=0x7ff97c00cca0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.241+0000 7ff989800640 1 -- 172.21.15.7:0/3814682294 shutdown_connections 2024-09-13T15:04:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.241+0000 7ff989800640 1 --2- 172.21.15.7:0/3814682294 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff960066690 0x7ff960068b50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.241+0000 7ff989800640 1 --2- 172.21.15.7:0/3814682294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff984157ad0 0x7ff984147c90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.241+0000 7ff989800640 1 --2- 172.21.15.7:0/3814682294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff984150d90 0x7ff984147750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.241+0000 7ff989800640 1 --2- 172.21.15.7:0/3814682294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff9840c5c30 0x7ff984143650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.241+0000 7ff989800640 1 -- 172.21.15.7:0/3814682294 >> 172.21.15.7:0/3814682294 conn(0x7ff984065d40 msgr2=0x7ff984155e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.241+0000 7ff989800640 1 -- 172.21.15.7:0/3814682294 shutdown_connections 2024-09-13T15:04:03.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.241+0000 7ff989800640 1 -- 172.21.15.7:0/3814682294 wait complete. 2024-09-13T15:04:03.262 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:04:03.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.401+0000 7f0e41600640 1 Processor -- start 2024-09-13T15:04:03.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.401+0000 7f0e41600640 1 -- start start 2024-09-13T15:04:03.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.401+0000 7f0e41600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0e3c0c4060 0x7f0e3c06f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:03.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.401+0000 7f0e41600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e3c0c4440 0x7f0e3c1506f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:03.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.401+0000 7f0e41600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c0c4a50 con 0x7f0e3c0c3710 2024-09-13T15:04:03.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.401+0000 7f0e41600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c0c6050 con 0x7f0e3c0c4060 2024-09-13T15:04:03.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.401+0000 7f0e41600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0c62f0 con 0x7f0e3c0c4440 2024-09-13T15:04:03.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.401+0000 7f0e3be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0e3c0c4060 0x7f0e3c06f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:03.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.401+0000 7f0e3be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0e3c0c4060 0x7f0e3c06f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45514/0 (socket says 172.21.15.7:45514) 2024-09-13T15:04:03.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.401+0000 7f0e3be00640 1 -- 172.21.15.7:0/4094345855 learned_addr learned my addr 172.21.15.7:0/4094345855 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:03.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.401+0000 7f0e33400640 1 --2- 172.21.15.7:0/4094345855 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e3c0c4440 0x7f0e3c1506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:03.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.401+0000 7f0e3be00640 1 -- 172.21.15.7:0/4094345855 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e3c0c4440 msgr2=0x7f0e3c1506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:03.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.401+0000 7f0e3be00640 1 --2- 172.21.15.7:0/4094345855 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e3c0c4440 0x7f0e3c1506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.401+0000 7f0e3be00640 1 -- 172.21.15.7:0/4094345855 >> v1:172.21.15.77:6789/0 conn(0x7f0e3c0c3710 legacy=0x7f0e3c156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:03.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.401+0000 7f0e3be00640 1 -- 172.21.15.7:0/4094345855 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c0c65d0 con 0x7f0e3c0c4060 2024-09-13T15:04:03.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.405+0000 7f0e3be00640 1 --2- 172.21.15.7:0/4094345855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e3c0c4060 0x7f0e3c06f3e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c009870 tx=0x7f0e2c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa9e042b4de9581 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:03.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.405+0000 7f0e3b400640 1 -- 172.21.15.7:0/4094345855 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c0a8a50 con 0x7f0e3c0c4060 2024-09-13T15:04:03.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.405+0000 7f0e3b400640 1 -- 172.21.15.7:0/4094345855 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2c0a8bb0 con 0x7f0e3c0c4060 2024-09-13T15:04:03.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.405+0000 7f0e3b400640 1 -- 172.21.15.7:0/4094345855 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c0b0440 con 0x7f0e3c0c4060 2024-09-13T15:04:03.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.405+0000 7f0e41600640 1 -- 172.21.15.7:0/4094345855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e3c0c4060 msgr2=0x7f0e3c06f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:03.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.405+0000 7f0e41600640 1 --2- 172.21.15.7:0/4094345855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e3c0c4060 0x7f0e3c06f3e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c009870 tx=0x7f0e2c01ed50 comp rx=0 tx=0).stop 2024-09-13T15:04:03.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.405+0000 7f0e41600640 1 -- 172.21.15.7:0/4094345855 shutdown_connections 2024-09-13T15:04:03.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.405+0000 7f0e41600640 1 --2- 172.21.15.7:0/4094345855 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e3c0c4440 0x7f0e3c1506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.405+0000 7f0e41600640 1 --2- 172.21.15.7:0/4094345855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e3c0c4060 0x7f0e3c06f3e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.405+0000 7f0e41600640 1 -- 172.21.15.7:0/4094345855 >> 172.21.15.7:0/4094345855 conn(0x7f0e3c065d40 msgr2=0x7f0e3c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:03.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.405+0000 7f0e41600640 1 -- 172.21.15.7:0/4094345855 shutdown_connections 2024-09-13T15:04:03.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.405+0000 7f0e41600640 1 -- 172.21.15.7:0/4094345855 wait complete. 2024-09-13T15:04:03.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e41600640 1 Processor -- start 2024-09-13T15:04:03.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e41600640 1 -- start start 2024-09-13T15:04:03.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e41600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e3c0c3710 0x7f0e3c14d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:03.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e41600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e3c0c4060 0x7f0e3c1e3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e41600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e3c147100 0x7f0e3c1f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e41600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c145a80 con 0x7f0e3c0c4060 2024-09-13T15:04:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e41600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c1454c0 con 0x7f0e3c147100 2024-09-13T15:04:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e41600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c1457a0 con 0x7f0e3c0c3710 2024-09-13T15:04:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e33400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e3c0c4060 0x7f0e3c1e3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e33400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e3c0c4060 0x7f0e3c1e3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45520/0 (socket says 172.21.15.7:45520) 2024-09-13T15:04:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e33400640 1 -- 172.21.15.7:0/3556096647 learned_addr learned my addr 172.21.15.7:0/3556096647 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e3be00640 1 --2- 172.21.15.7:0/3556096647 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e3c0c3710 0x7f0e3c14d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e40c00640 1 --2- 172.21.15.7:0/3556096647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e3c147100 0x7f0e3c1f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e33400640 1 -- 172.21.15.7:0/3556096647 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e3c0c3710 msgr2=0x7f0e3c14d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e33400640 1 --2- 172.21.15.7:0/3556096647 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e3c0c3710 0x7f0e3c14d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e33400640 1 -- 172.21.15.7:0/3556096647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e3c147100 msgr2=0x7f0e3c1f1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:03.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e33400640 1 --2- 172.21.15.7:0/3556096647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e3c147100 0x7f0e3c1f1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e33400640 1 -- 172.21.15.7:0/3556096647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c0094d0 con 0x7f0e3c0c4060 2024-09-13T15:04:03.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e40c00640 1 --2- 172.21.15.7:0/3556096647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e3c147100 0x7f0e3c1f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:03.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e33400640 1 --2- 172.21.15.7:0/3556096647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e3c0c4060 0x7f0e3c1e3900 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0e2400e870 tx=0x7f0e2400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:03.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e38c00640 1 -- 172.21.15.7:0/3556096647 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e24009510 con 0x7f0e3c0c4060 2024-09-13T15:04:03.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e38c00640 1 -- 172.21.15.7:0/3556096647 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2400eec0 con 0x7f0e3c0c4060 2024-09-13T15:04:03.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e38c00640 1 -- 172.21.15.7:0/3556096647 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2400cb40 con 0x7f0e3c0c4060 2024-09-13T15:04:03.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e41600640 1 -- 172.21.15.7:0/3556096647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c1f16b0 con 0x7f0e3c0c4060 2024-09-13T15:04:03.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e41600640 1 -- 172.21.15.7:0/3556096647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c14dc90 con 0x7f0e3c0c4060 2024-09-13T15:04:03.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.409+0000 7f0e41600640 1 -- 172.21.15.7:0/3556096647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c06f3e0 con 0x7f0e3c0c4060 2024-09-13T15:04:03.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.413+0000 7f0e38c00640 1 -- 172.21.15.7:0/3556096647 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0e2400cca0 con 0x7f0e3c0c4060 2024-09-13T15:04:03.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.413+0000 7f0e38c00640 1 --2- 172.21.15.7:0/3556096647 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e18066690 0x7f0e18068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:03.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.413+0000 7f0e38c00640 1 -- 172.21.15.7:0/3556096647 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e24084740 con 0x7f0e3c0c4060 2024-09-13T15:04:03.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.413+0000 7f0e3be00640 1 --2- 172.21.15.7:0/3556096647 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e18066690 0x7f0e18068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:03.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.413+0000 7f0e3be00640 1 --2- 172.21.15.7:0/3556096647 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e18066690 0x7f0e18068b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0b2000 tx=0x7f0e2c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:03.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.417+0000 7f0e38c00640 1 -- 172.21.15.7:0/3556096647 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0e24051670 con 0x7f0e3c0c4060 2024-09-13T15:04:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.589+0000 7f0e41600640 1 -- 172.21.15.7:0/3556096647 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0e3c0661c0 con 0x7f0e3c0c4060 2024-09-13T15:04:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.589+0000 7f0e38c00640 1 -- 172.21.15.7:0/3556096647 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0e24054c90 con 0x7f0e3c0c4060 2024-09-13T15:04:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2024-09-13T15:04:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.589+0000 7f0e41600640 1 -- 172.21.15.7:0/3556096647 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e18066690 msgr2=0x7f0e18068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.589+0000 7f0e41600640 1 --2- 172.21.15.7:0/3556096647 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e18066690 0x7f0e18068b50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0b2000 tx=0x7f0e2c009040 comp rx=0 tx=0).stop 2024-09-13T15:04:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.589+0000 7f0e41600640 1 -- 172.21.15.7:0/3556096647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e3c0c4060 msgr2=0x7f0e3c1e3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.589+0000 7f0e41600640 1 --2- 172.21.15.7:0/3556096647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e3c0c4060 0x7f0e3c1e3900 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0e2400e870 tx=0x7f0e2400ec70 comp rx=0 tx=0).stop 2024-09-13T15:04:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.589+0000 7f0e41600640 1 -- 172.21.15.7:0/3556096647 shutdown_connections 2024-09-13T15:04:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.589+0000 7f0e41600640 1 --2- 172.21.15.7:0/3556096647 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e18066690 0x7f0e18068b50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.589+0000 7f0e41600640 1 --2- 172.21.15.7:0/3556096647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e3c147100 0x7f0e3c1f1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.589+0000 7f0e41600640 1 --2- 172.21.15.7:0/3556096647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e3c0c4060 0x7f0e3c1e3900 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.589+0000 7f0e41600640 1 --2- 172.21.15.7:0/3556096647 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e3c0c3710 0x7f0e3c14d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.589+0000 7f0e41600640 1 -- 172.21.15.7:0/3556096647 >> 172.21.15.7:0/3556096647 conn(0x7f0e3c065d40 msgr2=0x7f0e3c071410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.589+0000 7f0e41600640 1 -- 172.21.15.7:0/3556096647 shutdown_connections 2024-09-13T15:04:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:03.589+0000 7f0e41600640 1 -- 172.21.15.7:0/3556096647 wait complete. 2024-09-13T15:04:03.613 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2024-09-13T15:04:03.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:03.614 DEBUG:teuthology.orchestra.run.smithi007:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-13T15:04:03.644 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi007.stderr:ceph-fuse[33458]: fuse finished with error 0 and tester_r 0 2024-09-13T15:04:03.647 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:04:09.749 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T15:04:09.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:09.750 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-13T15:04:09.767 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:04:09.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.957+0000 7feb4fe00640 1 Processor -- start 2024-09-13T15:04:09.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.957+0000 7feb4fe00640 1 -- start start 2024-09-13T15:04:09.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.961+0000 7feb4fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb50071790 0x7feb500c6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:09.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.961+0000 7feb4fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7feb50151120 0x7feb500c73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:09.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.961+0000 7feb4fe00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb500c4c80 con 0x7feb50071b70 2024-09-13T15:04:09.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.961+0000 7feb4fe00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb500c3eb0 con 0x7feb50151120 2024-09-13T15:04:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.961+0000 7feb4fe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb500c6470 con 0x7feb50071790 2024-09-13T15:04:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.961+0000 7feb4f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7feb50151120 0x7feb500c73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.961+0000 7feb4f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7feb50151120 0x7feb500c73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33654/0 (socket says 172.21.15.7:33654) 2024-09-13T15:04:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.961+0000 7feb4f400640 1 -- 172.21.15.7:0/453495588 learned_addr learned my addr 172.21.15.7:0/453495588 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.961+0000 7feb4ea00640 1 --2- 172.21.15.7:0/453495588 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb50071790 0x7feb500c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:09.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.961+0000 7feb4f400640 1 -- 172.21.15.7:0/453495588 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb50071790 msgr2=0x7feb500c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:09.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.961+0000 7feb4f400640 1 --2- 172.21.15.7:0/453495588 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb50071790 0x7feb500c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:09.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.961+0000 7feb4f400640 1 -- 172.21.15.7:0/453495588 >> v1:172.21.15.77:6789/0 conn(0x7feb50071b70 legacy=0x7feb50150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:09.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.961+0000 7feb4f400640 1 -- 172.21.15.7:0/453495588 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb500c6170 con 0x7feb50151120 2024-09-13T15:04:09.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.961+0000 7feb4ea00640 1 --2- 172.21.15.7:0/453495588 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb50071790 0x7feb500c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:09.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.965+0000 7feb4f400640 1 --2- 172.21.15.7:0/453495588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb50151120 0x7feb500c73b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feb480098a0 tx=0x7feb4801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3045db74337e8058 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:09.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.965+0000 7feb4e000640 1 -- 172.21.15.7:0/453495588 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb480a7070 con 0x7feb50151120 2024-09-13T15:04:09.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.965+0000 7feb4e000640 1 -- 172.21.15.7:0/453495588 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb480ab430 con 0x7feb50151120 2024-09-13T15:04:09.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.965+0000 7feb4e000640 1 -- 172.21.15.7:0/453495588 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb480ab7c0 con 0x7feb50151120 2024-09-13T15:04:09.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.965+0000 7feb4fe00640 1 -- 172.21.15.7:0/453495588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb50151120 msgr2=0x7feb500c73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:09.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.965+0000 7feb4fe00640 1 --2- 172.21.15.7:0/453495588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb50151120 0x7feb500c73b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7feb480098a0 tx=0x7feb4801c540 comp rx=0 tx=0).stop 2024-09-13T15:04:09.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.965+0000 7feb4fe00640 1 -- 172.21.15.7:0/453495588 shutdown_connections 2024-09-13T15:04:09.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.965+0000 7feb4fe00640 1 --2- 172.21.15.7:0/453495588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb50151120 0x7feb500c73b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:09.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.965+0000 7feb4fe00640 1 --2- 172.21.15.7:0/453495588 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb50071790 0x7feb500c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:09.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.965+0000 7feb4fe00640 1 -- 172.21.15.7:0/453495588 >> 172.21.15.7:0/453495588 conn(0x7feb500cc9b0 msgr2=0x7feb500ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:09.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.965+0000 7feb4fe00640 1 -- 172.21.15.7:0/453495588 shutdown_connections 2024-09-13T15:04:09.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.965+0000 7feb4fe00640 1 -- 172.21.15.7:0/453495588 wait complete. 2024-09-13T15:04:09.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.965+0000 7feb4fe00640 1 Processor -- start 2024-09-13T15:04:09.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.965+0000 7feb4fe00640 1 -- start start 2024-09-13T15:04:09.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.965+0000 7feb4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb50071790 0x7feb50139640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:09.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb50071b70 0x7feb5013eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb50151120 0x7feb501f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb501f30b0 con 0x7feb50071790 2024-09-13T15:04:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4fe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb50148a90 con 0x7feb50151120 2024-09-13T15:04:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4fe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5014d330 con 0x7feb50071b70 2024-09-13T15:04:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb50071790 0x7feb50139640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb50071790 0x7feb50139640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33670/0 (socket says 172.21.15.7:33670) 2024-09-13T15:04:09.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4ea00640 1 -- 172.21.15.7:0/2853389060 learned_addr learned my addr 172.21.15.7:0/2853389060 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4f400640 1 --2- 172.21.15.7:0/2853389060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb50151120 0x7feb501f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb46000640 1 --2- 172.21.15.7:0/2853389060 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb50071b70 0x7feb5013eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4ea00640 1 -- 172.21.15.7:0/2853389060 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb50071b70 msgr2=0x7feb5013eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4ea00640 1 --2- 172.21.15.7:0/2853389060 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb50071b70 0x7feb5013eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4ea00640 1 -- 172.21.15.7:0/2853389060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb50151120 msgr2=0x7feb501f3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4ea00640 1 --2- 172.21.15.7:0/2853389060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb50151120 0x7feb501f3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:09.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4ea00640 1 -- 172.21.15.7:0/2853389060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb480094d0 con 0x7feb50071790 2024-09-13T15:04:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4ea00640 1 --2- 172.21.15.7:0/2853389060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb50071790 0x7feb50139640 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feb40009fc0 tx=0x7feb4000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb47400640 1 -- 172.21.15.7:0/2853389060 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40003ba0 con 0x7feb50071790 2024-09-13T15:04:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb47400640 1 -- 172.21.15.7:0/2853389060 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4000f040 con 0x7feb50071790 2024-09-13T15:04:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb47400640 1 -- 172.21.15.7:0/2853389060 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40004030 con 0x7feb50071790 2024-09-13T15:04:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4fe00640 1 -- 172.21.15.7:0/2853389060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb501f3300 con 0x7feb50071790 2024-09-13T15:04:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4fe00640 1 -- 172.21.15.7:0/2853389060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5013f410 con 0x7feb50071790 2024-09-13T15:04:09.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb4fe00640 1 -- 172.21.15.7:0/2853389060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb50067650 con 0x7feb50071790 2024-09-13T15:04:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.969+0000 7feb47400640 1 -- 172.21.15.7:0/2853389060 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feb40004190 con 0x7feb50071790 2024-09-13T15:04:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.973+0000 7feb47400640 1 --2- 172.21.15.7:0/2853389060 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7feb2c066690 0x7feb2c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.973+0000 7feb47400640 1 -- 172.21.15.7:0/2853389060 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feb40084870 con 0x7feb50071790 2024-09-13T15:04:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.973+0000 7feb46000640 1 --2- 172.21.15.7:0/2853389060 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7feb2c066690 0x7feb2c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:09.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.973+0000 7feb46000640 1 --2- 172.21.15.7:0/2853389060 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7feb2c066690 0x7feb2c068b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feb5014b490 tx=0x7feb38009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:09.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:09.977+0000 7feb47400640 1 -- 172.21.15.7:0/2853389060 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feb400518c0 con 0x7feb50071790 2024-09-13T15:04:10.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.141+0000 7feb4fe00640 1 -- 172.21.15.7:0/2853389060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb500c6900 con 0x7feb50071790 2024-09-13T15:04:10.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.141+0000 7feb47400640 1 -- 172.21.15.7:0/2853389060 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18616 (secure 0 0 0) 0x7feb40054ee0 con 0x7feb50071790 2024-09-13T15:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:10.144 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:02:33.732864+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:04:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.145+0000 7feb4fe00640 1 -- 172.21.15.7:0/2853389060 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7feb2c066690 msgr2=0x7feb2c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.145+0000 7feb4fe00640 1 --2- 172.21.15.7:0/2853389060 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7feb2c066690 0x7feb2c068b50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feb5014b490 tx=0x7feb38009040 comp rx=0 tx=0).stop 2024-09-13T15:04:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.145+0000 7feb4fe00640 1 -- 172.21.15.7:0/2853389060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb50071790 msgr2=0x7feb50139640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.145+0000 7feb4fe00640 1 --2- 172.21.15.7:0/2853389060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb50071790 0x7feb50139640 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feb40009fc0 tx=0x7feb4000d560 comp rx=0 tx=0).stop 2024-09-13T15:04:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.145+0000 7feb4fe00640 1 -- 172.21.15.7:0/2853389060 shutdown_connections 2024-09-13T15:04:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.145+0000 7feb4fe00640 1 --2- 172.21.15.7:0/2853389060 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7feb2c066690 0x7feb2c068b50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.145+0000 7feb4fe00640 1 --2- 172.21.15.7:0/2853389060 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb50151120 0x7feb501f3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.145+0000 7feb4fe00640 1 --2- 172.21.15.7:0/2853389060 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7feb50071b70 0x7feb5013eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.145+0000 7feb4fe00640 1 --2- 172.21.15.7:0/2853389060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb50071790 0x7feb50139640 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.145+0000 7feb4fe00640 1 -- 172.21.15.7:0/2853389060 >> 172.21.15.7:0/2853389060 conn(0x7feb500cc9b0 msgr2=0x7feb500ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:10.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.145+0000 7feb4fe00640 1 -- 172.21.15.7:0/2853389060 shutdown_connections 2024-09-13T15:04:10.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.145+0000 7feb4fe00640 1 -- 172.21.15.7:0/2853389060 wait complete. 2024-09-13T15:04:10.166 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:04:10.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa1a5c00640 1 Processor -- start 2024-09-13T15:04:10.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa1a5c00640 1 -- start start 2024-09-13T15:04:10.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa1a5c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa1a0153170 0x7fa1a006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:10.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa1a5c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1a00c9f30 0x7fa1a00c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:10.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa1a5c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1a00c7a20 0x7fa1a0159590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:10.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa1a5c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a0159170 con 0x7fa1a0153170 2024-09-13T15:04:10.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa1a5c00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a015c7f0 con 0x7fa1a00c9f30 2024-09-13T15:04:10.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa1a5c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a015cad0 con 0x7fa1a00c7a20 2024-09-13T15:04:10.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa197e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1a00c9f30 0x7fa1a00c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:10.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa1a5200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1a00c7a20 0x7fa1a0159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:10.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa19fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa1a0153170 0x7fa1a006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:10.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa197e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa1a00c9f30 0x7fa1a00c74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56214/0 (socket says 172.21.15.7:56214) 2024-09-13T15:04:10.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa197e00640 1 -- 172.21.15.7:0/3026746396 learned_addr learned my addr 172.21.15.7:0/3026746396 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:10.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa197e00640 1 -- 172.21.15.7:0/3026746396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1a00c7a20 msgr2=0x7fa1a0159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:10.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa197e00640 1 --2- 172.21.15.7:0/3026746396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1a00c7a20 0x7fa1a0159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa197e00640 1 -- 172.21.15.7:0/3026746396 >> v2:172.21.15.7:3300/0 conn(0x7fa1a0153170 msgr2=0x7fa1a006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:10.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa197e00640 1 --2- 172.21.15.7:0/3026746396 >> v2:172.21.15.7:3300/0 conn(0x7fa1a0153170 0x7fa1a006db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa197e00640 1 -- 172.21.15.7:0/3026746396 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a015cdb0 con 0x7fa1a00c9f30 2024-09-13T15:04:10.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.305+0000 7fa19fe00640 1 --2- 172.21.15.7:0/3026746396 >> v2:172.21.15.7:3300/0 conn(0x7fa1a0153170 0x7fa1a006db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:10.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.309+0000 7fa197e00640 1 --2- 172.21.15.7:0/3026746396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a00c9f30 0x7fa1a00c74e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1a006d370 tx=0x7fa18801ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4974203fa84ddc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:10.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.309+0000 7fa19f400640 1 -- 172.21.15.7:0/3026746396 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1880a89d0 con 0x7fa1a00c9f30 2024-09-13T15:04:10.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.309+0000 7fa19f400640 1 -- 172.21.15.7:0/3026746396 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1880a8b30 con 0x7fa1a00c9f30 2024-09-13T15:04:10.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.309+0000 7fa19f400640 1 -- 172.21.15.7:0/3026746396 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1880b0440 con 0x7fa1a00c9f30 2024-09-13T15:04:10.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.309+0000 7fa1a5c00640 1 -- 172.21.15.7:0/3026746396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a00c9f30 msgr2=0x7fa1a00c74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:10.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.309+0000 7fa1a5c00640 1 --2- 172.21.15.7:0/3026746396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a00c9f30 0x7fa1a00c74e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa1a006d370 tx=0x7fa18801ed10 comp rx=0 tx=0).stop 2024-09-13T15:04:10.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.309+0000 7fa1a5c00640 1 -- 172.21.15.7:0/3026746396 shutdown_connections 2024-09-13T15:04:10.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.309+0000 7fa1a5c00640 1 --2- 172.21.15.7:0/3026746396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1a00c7a20 0x7fa1a0159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.309+0000 7fa1a5c00640 1 --2- 172.21.15.7:0/3026746396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a00c9f30 0x7fa1a00c74e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.309+0000 7fa1a5c00640 1 --2- 172.21.15.7:0/3026746396 >> v2:172.21.15.7:3300/0 conn(0x7fa1a0153170 0x7fa1a006db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.309+0000 7fa1a5c00640 1 -- 172.21.15.7:0/3026746396 >> 172.21.15.7:0/3026746396 conn(0x7fa1a0065d40 msgr2=0x7fa1a0066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:10.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.309+0000 7fa1a5c00640 1 -- 172.21.15.7:0/3026746396 shutdown_connections 2024-09-13T15:04:10.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.309+0000 7fa1a5c00640 1 -- 172.21.15.7:0/3026746396 wait complete. 2024-09-13T15:04:10.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5c00640 1 Processor -- start 2024-09-13T15:04:10.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5c00640 1 -- start start 2024-09-13T15:04:10.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a00c7a20 0x7fa1a0155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:10.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1a00c9f30 0x7fa1a014fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:10.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1a0153170 0x7fa1a0150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:10.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a01567b0 con 0x7fa1a0153170 2024-09-13T15:04:10.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a01543f0 con 0x7fa1a00c7a20 2024-09-13T15:04:10.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a01546d0 con 0x7fa1a00c9f30 2024-09-13T15:04:10.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1a0153170 0x7fa1a0150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:10.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1a0153170 0x7fa1a0150060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33682/0 (socket says 172.21.15.7:33682) 2024-09-13T15:04:10.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5200640 1 -- 172.21.15.7:0/3141765092 learned_addr learned my addr 172.21.15.7:0/3141765092 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:10.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa19fe00640 1 --2- 172.21.15.7:0/3141765092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a00c7a20 0x7fa1a0155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:10.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa197e00640 1 --2- 172.21.15.7:0/3141765092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1a00c9f30 0x7fa1a014fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:10.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5200640 1 -- 172.21.15.7:0/3141765092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1a00c9f30 msgr2=0x7fa1a014fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:10.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5200640 1 --2- 172.21.15.7:0/3141765092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1a00c9f30 0x7fa1a014fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5200640 1 -- 172.21.15.7:0/3141765092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a00c7a20 msgr2=0x7fa1a0155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5200640 1 --2- 172.21.15.7:0/3141765092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a00c7a20 0x7fa1a0155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5200640 1 -- 172.21.15.7:0/3141765092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa190009420 con 0x7fa1a0153170 2024-09-13T15:04:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa19fe00640 1 --2- 172.21.15.7:0/3141765092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a00c7a20 0x7fa1a0155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa197e00640 1 --2- 172.21.15.7:0/3141765092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1a00c9f30 0x7fa1a014fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5200640 1 --2- 172.21.15.7:0/3141765092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1a0153170 0x7fa1a0150060 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa19800eed0 tx=0x7fa19800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa19cc00640 1 -- 172.21.15.7:0/3141765092 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa198010040 con 0x7fa1a0153170 2024-09-13T15:04:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa19cc00640 1 -- 172.21.15.7:0/3141765092 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa198014400 con 0x7fa1a0153170 2024-09-13T15:04:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa19cc00640 1 -- 172.21.15.7:0/3141765092 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa198009ea0 con 0x7fa1a0153170 2024-09-13T15:04:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5c00640 1 -- 172.21.15.7:0/3141765092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1880094d0 con 0x7fa1a0153170 2024-09-13T15:04:10.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.313+0000 7fa1a5c00640 1 -- 172.21.15.7:0/3141765092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a0154c90 con 0x7fa1a0153170 2024-09-13T15:04:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.317+0000 7fa1a5c00640 1 -- 172.21.15.7:0/3141765092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a0153550 con 0x7fa1a0153170 2024-09-13T15:04:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.317+0000 7fa19cc00640 1 -- 172.21.15.7:0/3141765092 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa1980147b0 con 0x7fa1a0153170 2024-09-13T15:04:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.317+0000 7fa19cc00640 1 --2- 172.21.15.7:0/3141765092 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa17c0666c0 0x7fa17c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:10.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.317+0000 7fa19cc00640 1 -- 172.21.15.7:0/3141765092 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa198084d00 con 0x7fa1a0153170 2024-09-13T15:04:10.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.317+0000 7fa19fe00640 1 --2- 172.21.15.7:0/3141765092 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa17c0666c0 0x7fa17c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:10.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.317+0000 7fa19fe00640 1 --2- 172.21.15.7:0/3141765092 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa17c0666c0 0x7fa17c068b80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa190009ca0 tx=0x7fa190008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:10.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.321+0000 7fa19cc00640 1 -- 172.21.15.7:0/3141765092 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa198051ca0 con 0x7fa1a0153170 2024-09-13T15:04:10.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.485+0000 7fa1a5c00640 1 -- 172.21.15.7:0/3141765092 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1a0150e20 con 0x7fa1a0153170 2024-09-13T15:04:10.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.485+0000 7fa19cc00640 1 -- 172.21.15.7:0/3141765092 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18616 (secure 0 0 0) 0x7fa198018090 con 0x7fa1a0153170 2024-09-13T15:04:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:10.489 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:02:33.732864+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:04:10.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.489+0000 7fa1a5c00640 1 -- 172.21.15.7:0/3141765092 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa17c0666c0 msgr2=0x7fa17c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:10.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.489+0000 7fa1a5c00640 1 --2- 172.21.15.7:0/3141765092 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa17c0666c0 0x7fa17c068b80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa190009ca0 tx=0x7fa190008040 comp rx=0 tx=0).stop 2024-09-13T15:04:10.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.489+0000 7fa1a5c00640 1 -- 172.21.15.7:0/3141765092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1a0153170 msgr2=0x7fa1a0150060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:10.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.489+0000 7fa1a5c00640 1 --2- 172.21.15.7:0/3141765092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1a0153170 0x7fa1a0150060 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa19800eed0 tx=0x7fa19800b480 comp rx=0 tx=0).stop 2024-09-13T15:04:10.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.489+0000 7fa1a5c00640 1 -- 172.21.15.7:0/3141765092 shutdown_connections 2024-09-13T15:04:10.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.489+0000 7fa1a5c00640 1 --2- 172.21.15.7:0/3141765092 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa17c0666c0 0x7fa17c068b80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.489+0000 7fa1a5c00640 1 --2- 172.21.15.7:0/3141765092 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1a0153170 0x7fa1a0150060 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.489+0000 7fa1a5c00640 1 --2- 172.21.15.7:0/3141765092 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa1a00c9f30 0x7fa1a014fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.489+0000 7fa1a5c00640 1 --2- 172.21.15.7:0/3141765092 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a00c7a20 0x7fa1a0155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.489+0000 7fa1a5c00640 1 -- 172.21.15.7:0/3141765092 >> 172.21.15.7:0/3141765092 conn(0x7fa1a0065d40 msgr2=0x7fa1a00c71d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:10.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.489+0000 7fa1a5c00640 1 -- 172.21.15.7:0/3141765092 shutdown_connections 2024-09-13T15:04:10.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.489+0000 7fa1a5c00640 1 -- 172.21.15.7:0/3141765092 wait complete. 2024-09-13T15:04:10.511 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T15:04:10.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.649+0000 7fc078200640 1 Processor -- start 2024-09-13T15:04:10.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.649+0000 7fc078200640 1 -- start start 2024-09-13T15:04:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.653+0000 7fc078200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc070150250 0x7fc0700b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.653+0000 7fc078200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc0701568e0 0x7fc0700cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.653+0000 7fc078200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc0700cc090 0x7fc0701595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.653+0000 7fc078200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0700b1e80 con 0x7fc0700cc090 2024-09-13T15:04:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.653+0000 7fc078200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc070150630 con 0x7fc0701568e0 2024-09-13T15:04:10.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.653+0000 7fc078200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0700c7210 con 0x7fc070150250 2024-09-13T15:04:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.653+0000 7fc076200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc0700cc090 0x7fc0701595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.653+0000 7fc076200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc0700cc090 0x7fc0701595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33694/0 (socket says 172.21.15.7:33694) 2024-09-13T15:04:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.653+0000 7fc076200640 1 -- 172.21.15.7:0/2637398434 learned_addr learned my addr 172.21.15.7:0/2637398434 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.653+0000 7fc075800640 1 --2- 172.21.15.7:0/2637398434 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc070150250 0x7fc0700b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.653+0000 7fc074e00640 1 --2- 172.21.15.7:0/2637398434 >> v2:172.21.15.77:3300/0 conn(0x7fc0701568e0 0x7fc0700cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.653+0000 7fc076200640 1 -- 172.21.15.7:0/2637398434 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc070150250 msgr2=0x7fc0700b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.653+0000 7fc076200640 1 --2- 172.21.15.7:0/2637398434 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc070150250 0x7fc0700b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.653+0000 7fc076200640 1 -- 172.21.15.7:0/2637398434 >> v2:172.21.15.77:3300/0 conn(0x7fc0701568e0 msgr2=0x7fc0700cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.653+0000 7fc076200640 1 --2- 172.21.15.7:0/2637398434 >> v2:172.21.15.77:3300/0 conn(0x7fc0701568e0 0x7fc0700cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.653+0000 7fc076200640 1 -- 172.21.15.7:0/2637398434 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0700c6c50 con 0x7fc0700cc090 2024-09-13T15:04:10.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.657+0000 7fc076200640 1 --2- 172.21.15.7:0/2637398434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0700cc090 0x7fc0701595d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc07006af80 tx=0x7fc06801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a382aee8a34a3d9e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.657+0000 7fc06fe00640 1 -- 172.21.15.7:0/2637398434 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0680af400 con 0x7fc0700cc090 2024-09-13T15:04:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.657+0000 7fc06fe00640 1 -- 172.21.15.7:0/2637398434 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0680ab050 con 0x7fc0700cc090 2024-09-13T15:04:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.657+0000 7fc06fe00640 1 -- 172.21.15.7:0/2637398434 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0680af780 con 0x7fc0700cc090 2024-09-13T15:04:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.657+0000 7fc078200640 1 -- 172.21.15.7:0/2637398434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0700cc090 msgr2=0x7fc0701595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.657+0000 7fc078200640 1 --2- 172.21.15.7:0/2637398434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0700cc090 0x7fc0701595d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc07006af80 tx=0x7fc06801f1e0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.657+0000 7fc078200640 1 -- 172.21.15.7:0/2637398434 shutdown_connections 2024-09-13T15:04:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.657+0000 7fc078200640 1 --2- 172.21.15.7:0/2637398434 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0700cc090 0x7fc0701595d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.657+0000 7fc078200640 1 --2- 172.21.15.7:0/2637398434 >> v2:172.21.15.77:3300/0 conn(0x7fc0701568e0 0x7fc0700cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.657+0000 7fc078200640 1 --2- 172.21.15.7:0/2637398434 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc070150250 0x7fc0700b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.657+0000 7fc078200640 1 -- 172.21.15.7:0/2637398434 >> 172.21.15.7:0/2637398434 conn(0x7fc070069f30 msgr2=0x7fc07006a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:10.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.657+0000 7fc078200640 1 -- 172.21.15.7:0/2637398434 shutdown_connections 2024-09-13T15:04:10.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.657+0000 7fc078200640 1 -- 172.21.15.7:0/2637398434 wait complete. 2024-09-13T15:04:10.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.657+0000 7fc078200640 1 Processor -- start 2024-09-13T15:04:10.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.657+0000 7fc078200640 1 -- start start 2024-09-13T15:04:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc078200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0700cc090 0x7fc0701e3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc078200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc070150250 0x7fc070149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc078200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0701568e0 0x7fc070149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc078200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0701e2be0 con 0x7fc0700cc090 2024-09-13T15:04:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc078200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0701e3c80 con 0x7fc0701568e0 2024-09-13T15:04:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc078200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0701ef490 con 0x7fc070150250 2024-09-13T15:04:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc075800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0700cc090 0x7fc0701e3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc075800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0700cc090 0x7fc0701e3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33700/0 (socket says 172.21.15.7:33700) 2024-09-13T15:04:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc075800640 1 -- 172.21.15.7:0/3815910304 learned_addr learned my addr 172.21.15.7:0/3815910304 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:10.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc074e00640 1 --2- 172.21.15.7:0/3815910304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc070150250 0x7fc070149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:10.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc076200640 1 --2- 172.21.15.7:0/3815910304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0701568e0 0x7fc070149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:10.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc075800640 1 -- 172.21.15.7:0/3815910304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc070150250 msgr2=0x7fc070149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:10.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc075800640 1 --2- 172.21.15.7:0/3815910304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc070150250 0x7fc070149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc075800640 1 -- 172.21.15.7:0/3815910304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0701568e0 msgr2=0x7fc070149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:10.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc075800640 1 --2- 172.21.15.7:0/3815910304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0701568e0 0x7fc070149bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:10.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc075800640 1 -- 172.21.15.7:0/3815910304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc068009b30 con 0x7fc0700cc090 2024-09-13T15:04:10.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc076200640 1 --2- 172.21.15.7:0/3815910304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0701568e0 0x7fc070149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:10.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc075800640 1 --2- 172.21.15.7:0/3815910304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0700cc090 0x7fc0701e3740 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc06400d800 tx=0x7fc06400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:10.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc06d600640 1 -- 172.21.15.7:0/3815910304 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640096a0 con 0x7fc0700cc090 2024-09-13T15:04:10.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc06d600640 1 -- 172.21.15.7:0/3815910304 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc064009800 con 0x7fc0700cc090 2024-09-13T15:04:10.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc06d600640 1 -- 172.21.15.7:0/3815910304 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc064009b70 con 0x7fc0700cc090 2024-09-13T15:04:10.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc078200640 1 -- 172.21.15.7:0/3815910304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0701ef750 con 0x7fc0700cc090 2024-09-13T15:04:10.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc078200640 1 -- 172.21.15.7:0/3815910304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0701e08d0 con 0x7fc0700cc090 2024-09-13T15:04:10.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc078200640 1 -- 172.21.15.7:0/3815910304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc070067650 con 0x7fc0700cc090 2024-09-13T15:04:10.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.661+0000 7fc06d600640 1 -- 172.21.15.7:0/3815910304 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc064009cd0 con 0x7fc0700cc090 2024-09-13T15:04:10.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.665+0000 7fc06d600640 1 --2- 172.21.15.7:0/3815910304 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc0500666c0 0x7fc050068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:10.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.665+0000 7fc06d600640 1 -- 172.21.15.7:0/3815910304 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc064084bb0 con 0x7fc0700cc090 2024-09-13T15:04:10.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.665+0000 7fc074e00640 1 --2- 172.21.15.7:0/3815910304 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc0500666c0 0x7fc050068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:10.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.665+0000 7fc074e00640 1 --2- 172.21.15.7:0/3815910304 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc0500666c0 0x7fc050068b80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc070158fb0 tx=0x7fc05c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:10.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.669+0000 7fc06d600640 1 -- 172.21.15.7:0/3815910304 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc064051b60 con 0x7fc0700cc090 2024-09-13T15:04:10.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:10.865+0000 7fc078200640 1 -- 172.21.15.7:0/3815910304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc070156d20 con 0x7fc0700cc090 2024-09-13T15:04:11.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.809+0000 7fc06d600640 1 -- 172.21.15.7:0/3815910304 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc064055180 con 0x7fc0700cc090 2024-09-13T15:04:11.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.809+0000 7fc078200640 1 -- 172.21.15.7:0/3815910304 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc0500666c0 msgr2=0x7fc050068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:11.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.809+0000 7fc078200640 1 --2- 172.21.15.7:0/3815910304 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc0500666c0 0x7fc050068b80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc070158fb0 tx=0x7fc05c009190 comp rx=0 tx=0).stop 2024-09-13T15:04:11.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.809+0000 7fc078200640 1 -- 172.21.15.7:0/3815910304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0700cc090 msgr2=0x7fc0701e3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:11.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.809+0000 7fc078200640 1 --2- 172.21.15.7:0/3815910304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0700cc090 0x7fc0701e3740 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc06400d800 tx=0x7fc06400dcc0 comp rx=0 tx=0).stop 2024-09-13T15:04:11.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.809+0000 7fc078200640 1 -- 172.21.15.7:0/3815910304 shutdown_connections 2024-09-13T15:04:11.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.809+0000 7fc078200640 1 --2- 172.21.15.7:0/3815910304 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc0500666c0 0x7fc050068b80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:11.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.809+0000 7fc078200640 1 --2- 172.21.15.7:0/3815910304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0701568e0 0x7fc070149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:11.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.809+0000 7fc078200640 1 --2- 172.21.15.7:0/3815910304 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc070150250 0x7fc070149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:11.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.809+0000 7fc078200640 1 --2- 172.21.15.7:0/3815910304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0700cc090 0x7fc0701e3740 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:11.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.809+0000 7fc078200640 1 -- 172.21.15.7:0/3815910304 >> 172.21.15.7:0/3815910304 conn(0x7fc070069f30 msgr2=0x7fc0700c88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:11.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.809+0000 7fc078200640 1 -- 172.21.15.7:0/3815910304 shutdown_connections 2024-09-13T15:04:11.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.809+0000 7fc078200640 1 -- 172.21.15.7:0/3815910304 wait complete. 2024-09-13T15:04:11.837 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-09-13T15:04:11.838 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-09-13T15:04:11.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.985+0000 7f23b5e00640 1 Processor -- start 2024-09-13T15:04:11.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.985+0000 7f23b5e00640 1 -- start start 2024-09-13T15:04:11.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.985+0000 7f23b5e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f23b01501b0 0x7f23b0156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:11.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.985+0000 7f23b5e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23b00c16f0 0x7f23b00c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:11.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.985+0000 7f23b5e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b00c6880 con 0x7f23b014fdd0 2024-09-13T15:04:11.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.985+0000 7f23b5e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b00721e0 con 0x7f23b01501b0 2024-09-13T15:04:11.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.985+0000 7f23b5e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b006f860 con 0x7f23b00c16f0 2024-09-13T15:04:11.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.985+0000 7f23a6000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f23b01501b0 0x7f23b0156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:11.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.985+0000 7f23a6000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f23b01501b0 0x7f23b0156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33702/0 (socket says 172.21.15.7:33702) 2024-09-13T15:04:11.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.985+0000 7f23aea00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f23b014fdd0 0x7f23b00c7420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50762/0 (socket says 172.21.15.7:50762) 2024-09-13T15:04:11.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.985+0000 7f23a6000640 1 -- 172.21.15.7:0/3469753364 learned_addr learned my addr 172.21.15.7:0/3469753364 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:11.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.985+0000 7f23af400640 1 --2- 172.21.15.7:0/3469753364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23b00c16f0 0x7f23b00c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:11.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.985+0000 7f23a6000640 1 -- 172.21.15.7:0/3469753364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23b00c16f0 msgr2=0x7f23b00c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:11.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.985+0000 7f23a6000640 1 --2- 172.21.15.7:0/3469753364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23b00c16f0 0x7f23b00c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:11.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.985+0000 7f23a6000640 1 -- 172.21.15.7:0/3469753364 >> v1:172.21.15.7:6789/0 conn(0x7f23b014fdd0 legacy=0x7f23b00c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:11.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.985+0000 7f23a6000640 1 -- 172.21.15.7:0/3469753364 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b00c6ad0 con 0x7f23b01501b0 2024-09-13T15:04:11.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.985+0000 7f23ae000640 1 -- 172.21.15.7:0/3469753364 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765081264 0 0) 0x7f23b00c6880 con 0x7f23b014fdd0 2024-09-13T15:04:11.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.989+0000 7f23a6000640 1 --2- 172.21.15.7:0/3469753364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b01501b0 0x7f23b0156780 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2398009870 tx=0x7f239801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2b4c3ca08a10e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:11.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.989+0000 7f23ae000640 1 -- 172.21.15.7:0/3469753364 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23980a9620 con 0x7f23b01501b0 2024-09-13T15:04:11.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.989+0000 7f23ae000640 1 -- 172.21.15.7:0/3469753364 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23980a9780 con 0x7f23b01501b0 2024-09-13T15:04:11.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.989+0000 7f23ae000640 1 -- 172.21.15.7:0/3469753364 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23980a9b10 con 0x7f23b01501b0 2024-09-13T15:04:11.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.989+0000 7f23b5e00640 1 -- 172.21.15.7:0/3469753364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b01501b0 msgr2=0x7f23b0156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:11.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.989+0000 7f23b5e00640 1 --2- 172.21.15.7:0/3469753364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b01501b0 0x7f23b0156780 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2398009870 tx=0x7f239801c560 comp rx=0 tx=0).stop 2024-09-13T15:04:11.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.989+0000 7f23b5e00640 1 -- 172.21.15.7:0/3469753364 shutdown_connections 2024-09-13T15:04:11.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.989+0000 7f23b5e00640 1 --2- 172.21.15.7:0/3469753364 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23b00c16f0 0x7f23b00c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:11.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.989+0000 7f23b5e00640 1 --2- 172.21.15.7:0/3469753364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b01501b0 0x7f23b0156780 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:11.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.989+0000 7f23b5e00640 1 -- 172.21.15.7:0/3469753364 >> 172.21.15.7:0/3469753364 conn(0x7f23b0065d40 msgr2=0x7f23b0066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:11.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.989+0000 7f23b5e00640 1 -- 172.21.15.7:0/3469753364 shutdown_connections 2024-09-13T15:04:11.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.989+0000 7f23b5e00640 1 -- 172.21.15.7:0/3469753364 wait complete. 2024-09-13T15:04:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.989+0000 7f23b5e00640 1 Processor -- start 2024-09-13T15:04:11.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.989+0000 7f23b5e00640 1 -- start start 2024-09-13T15:04:11.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23b5e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23b00c16f0 0x7f23b0138fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:11.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23b5e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23b014fdd0 0x7f23b01394f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:11.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23b5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b01501b0 0x7f23b01622b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:11.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23b5e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b0138b90 con 0x7f23b01501b0 2024-09-13T15:04:11.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23b5e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b014a2a0 con 0x7f23b014fdd0 2024-09-13T15:04:11.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23b5e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b0162fd0 con 0x7f23b00c16f0 2024-09-13T15:04:11.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23af400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b01501b0 0x7f23b01622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:11.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23af400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b01501b0 0x7f23b01622b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33710/0 (socket says 172.21.15.7:33710) 2024-09-13T15:04:11.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23af400640 1 -- 172.21.15.7:0/3119939953 learned_addr learned my addr 172.21.15.7:0/3119939953 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:11.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23aea00640 1 --2- 172.21.15.7:0/3119939953 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23b00c16f0 0x7f23b0138fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:11.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23a6000640 1 --2- 172.21.15.7:0/3119939953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23b014fdd0 0x7f23b01394f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:11.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23af400640 1 -- 172.21.15.7:0/3119939953 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23b00c16f0 msgr2=0x7f23b0138fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:11.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23af400640 1 --2- 172.21.15.7:0/3119939953 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23b00c16f0 0x7f23b0138fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:11.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23af400640 1 -- 172.21.15.7:0/3119939953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23b014fdd0 msgr2=0x7f23b01394f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:11.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23af400640 1 --2- 172.21.15.7:0/3119939953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23b014fdd0 0x7f23b01394f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:11.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23af400640 1 -- 172.21.15.7:0/3119939953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23980094d0 con 0x7f23b01501b0 2024-09-13T15:04:11.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23aea00640 1 --2- 172.21.15.7:0/3119939953 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23b00c16f0 0x7f23b0138fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:11.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23af400640 1 --2- 172.21.15.7:0/3119939953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b01501b0 0x7f23b01622b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f23a800d800 tx=0x7f23a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:11.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23a7e00640 1 -- 172.21.15.7:0/3119939953 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a800b6c0 con 0x7f23b01501b0 2024-09-13T15:04:11.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23a7e00640 1 -- 172.21.15.7:0/3119939953 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a800b820 con 0x7f23b01501b0 2024-09-13T15:04:11.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23a7e00640 1 -- 172.21.15.7:0/3119939953 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a800bbd0 con 0x7f23b01501b0 2024-09-13T15:04:11.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23b5e00640 1 -- 172.21.15.7:0/3119939953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b0137f10 con 0x7f23b01501b0 2024-09-13T15:04:11.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23b5e00640 1 -- 172.21.15.7:0/3119939953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b01384d0 con 0x7f23b01501b0 2024-09-13T15:04:11.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.993+0000 7f23b5e00640 1 -- 172.21.15.7:0/3119939953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b0138cd0 con 0x7f23b01501b0 2024-09-13T15:04:11.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.997+0000 7f23a7e00640 1 -- 172.21.15.7:0/3119939953 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f23a800bd30 con 0x7f23b01501b0 2024-09-13T15:04:11.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.997+0000 7f23a7e00640 1 --2- 172.21.15.7:0/3119939953 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f238c066690 0x7f238c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:11.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.997+0000 7f23a7e00640 1 -- 172.21.15.7:0/3119939953 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f23a8084a30 con 0x7f23b01501b0 2024-09-13T15:04:11.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.997+0000 7f23aea00640 1 --2- 172.21.15.7:0/3119939953 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f238c066690 0x7f238c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:11.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:11.997+0000 7f23aea00640 1 --2- 172.21.15.7:0/3119939953 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f238c066690 0x7f238c068b50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f23a0005fd0 tx=0x7f23a0005b80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:12.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.001+0000 7f23a7e00640 1 -- 172.21.15.7:0/3119939953 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f23b0138cd0 con 0x7f23b01501b0 2024-09-13T15:04:12.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.197+0000 7f23b5e00640 1 -- 172.21.15.7:0/3119939953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f23b0138cd0 con 0x7f23b01501b0 2024-09-13T15:04:12.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.581+0000 7f23a7e00640 1 -- 172.21.15.7:0/3119939953 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v9) v1 ==== 105+0+0 (secure 0 0 0) 0x7f23b0138cd0 con 0x7f23b01501b0 2024-09-13T15:04:12.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.581+0000 7f23b5e00640 1 -- 172.21.15.7:0/3119939953 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f238c066690 msgr2=0x7f238c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:12.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.581+0000 7f23b5e00640 1 --2- 172.21.15.7:0/3119939953 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f238c066690 0x7f238c068b50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f23a0005fd0 tx=0x7f23a0005b80 comp rx=0 tx=0).stop 2024-09-13T15:04:12.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.581+0000 7f23b5e00640 1 -- 172.21.15.7:0/3119939953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b01501b0 msgr2=0x7f23b01622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:12.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.581+0000 7f23b5e00640 1 --2- 172.21.15.7:0/3119939953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b01501b0 0x7f23b01622b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f23a800d800 tx=0x7f23a800dcc0 comp rx=0 tx=0).stop 2024-09-13T15:04:12.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.581+0000 7f23b5e00640 1 -- 172.21.15.7:0/3119939953 shutdown_connections 2024-09-13T15:04:12.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.581+0000 7f23b5e00640 1 --2- 172.21.15.7:0/3119939953 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f238c066690 0x7f238c068b50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:12.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.581+0000 7f23b5e00640 1 --2- 172.21.15.7:0/3119939953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23b01501b0 0x7f23b01622b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:12.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.581+0000 7f23b5e00640 1 --2- 172.21.15.7:0/3119939953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f23b014fdd0 0x7f23b01394f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:12.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.581+0000 7f23b5e00640 1 --2- 172.21.15.7:0/3119939953 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f23b00c16f0 0x7f23b0138fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:12.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.581+0000 7f23b5e00640 1 -- 172.21.15.7:0/3119939953 >> 172.21.15.7:0/3119939953 conn(0x7f23b0065d40 msgr2=0x7f23b0147850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:12.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.581+0000 7f23b5e00640 1 -- 172.21.15.7:0/3119939953 shutdown_connections 2024-09-13T15:04:12.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.581+0000 7f23b5e00640 1 -- 172.21.15.7:0/3119939953 wait complete. 2024-09-13T15:04:12.606 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T15:04:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.749+0000 7fae8da00640 1 Processor -- start 2024-09-13T15:04:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.749+0000 7fae8da00640 1 -- start start 2024-09-13T15:04:12.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.749+0000 7fae8da00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fae88071810 0x7fae88071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:12.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.749+0000 7fae8da00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae88157100 con 0x7fae88150d90 2024-09-13T15:04:12.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.749+0000 7fae8da00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae8815a3a0 con 0x7fae880c1880 2024-09-13T15:04:12.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.749+0000 7fae8da00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae88066b00 con 0x7fae88071810 2024-09-13T15:04:12.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.749+0000 7fae86a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fae88150d90 0x7fae88157590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50772/0 (socket says 172.21.15.7:50772) 2024-09-13T15:04:12.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.749+0000 7fae86a00640 1 -- 172.21.15.7:0/3426792685 learned_addr learned my addr 172.21.15.7:0/3426792685 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:12.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.749+0000 7fae87400640 1 --2- 172.21.15.7:0/3426792685 >> v2:172.21.15.77:3300/0 conn(0x7fae88071810 0x7fae88071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:12.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.749+0000 7fae86000640 1 -- 172.21.15.7:0/3426792685 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125626190 0 0) 0x7fae88157100 con 0x7fae88150d90 2024-09-13T15:04:12.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.749+0000 7fae86000640 1 -- 172.21.15.7:0/3426792685 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae6c003530 con 0x7fae88150d90 2024-09-13T15:04:12.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.749+0000 7fae87400640 1 -- 172.21.15.7:0/3426792685 >> v1:172.21.15.77:6789/0 conn(0x7fae880c1880 legacy=0x7fae880c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:12.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.749+0000 7fae87400640 1 -- 172.21.15.7:0/3426792685 >> v1:172.21.15.7:6789/0 conn(0x7fae88150d90 legacy=0x7fae88157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:12.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.749+0000 7fae87400640 1 -- 172.21.15.7:0/3426792685 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae88156db0 con 0x7fae88071810 2024-09-13T15:04:12.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.753+0000 7fae87400640 1 --2- 172.21.15.7:0/3426792685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae88071810 0x7fae88071c60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fae80009d90 tx=0x7fae8001f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adc3255616868c49 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:12.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.753+0000 7fae86000640 1 -- 172.21.15.7:0/3426792685 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae800af600 con 0x7fae88071810 2024-09-13T15:04:12.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.753+0000 7fae86000640 1 -- 172.21.15.7:0/3426792685 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae800ab050 con 0x7fae88071810 2024-09-13T15:04:12.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.753+0000 7fae86000640 1 -- 172.21.15.7:0/3426792685 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae800af980 con 0x7fae88071810 2024-09-13T15:04:12.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.753+0000 7fae8da00640 1 -- 172.21.15.7:0/3426792685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae88071810 msgr2=0x7fae88071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.753+0000 7fae8da00640 1 --2- 172.21.15.7:0/3426792685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae88071810 0x7fae88071c60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fae80009d90 tx=0x7fae8001f150 comp rx=0 tx=0).stop 2024-09-13T15:04:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.753+0000 7fae8da00640 1 -- 172.21.15.7:0/3426792685 shutdown_connections 2024-09-13T15:04:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.753+0000 7fae8da00640 1 --2- 172.21.15.7:0/3426792685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae88071810 0x7fae88071c60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.753+0000 7fae8da00640 1 -- 172.21.15.7:0/3426792685 >> 172.21.15.7:0/3426792685 conn(0x7fae88065d40 msgr2=0x7fae88066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.753+0000 7fae8da00640 1 -- 172.21.15.7:0/3426792685 shutdown_connections 2024-09-13T15:04:12.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.753+0000 7fae8da00640 1 -- 172.21.15.7:0/3426792685 wait complete. 2024-09-13T15:04:12.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae8da00640 1 Processor -- start 2024-09-13T15:04:12.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae8da00640 1 -- start start 2024-09-13T15:04:12.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae8da00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae88071810 0x7fae88146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:12.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae8da00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae880c1880 0x7fae88158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:12.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae8da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae88150d90 0x7fae881594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:12.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae8da00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae88147190 con 0x7fae88150d90 2024-09-13T15:04:12.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae8da00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae880ca210 con 0x7fae880c1880 2024-09-13T15:04:12.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae8da00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae88070650 con 0x7fae88071810 2024-09-13T15:04:12.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae87400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae88150d90 0x7fae881594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:12.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae87400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae88150d90 0x7fae881594b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33722/0 (socket says 172.21.15.7:33722) 2024-09-13T15:04:12.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae87400640 1 -- 172.21.15.7:0/1670192828 learned_addr learned my addr 172.21.15.7:0/1670192828 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:12.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae7e000640 1 --2- 172.21.15.7:0/1670192828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae880c1880 0x7fae88158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:12.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae86a00640 1 --2- 172.21.15.7:0/1670192828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae88071810 0x7fae88146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:12.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae87400640 1 -- 172.21.15.7:0/1670192828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae88071810 msgr2=0x7fae88146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:12.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae87400640 1 --2- 172.21.15.7:0/1670192828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae88071810 0x7fae88146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:12.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae87400640 1 -- 172.21.15.7:0/1670192828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae880c1880 msgr2=0x7fae88158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:12.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae87400640 1 --2- 172.21.15.7:0/1670192828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae880c1880 0x7fae88158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:12.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae87400640 1 -- 172.21.15.7:0/1670192828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae80009a70 con 0x7fae88150d90 2024-09-13T15:04:12.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae87400640 1 --2- 172.21.15.7:0/1670192828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae88150d90 0x7fae881594b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fae800b2040 tx=0x7fae8001bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:12.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae7f400640 1 -- 172.21.15.7:0/1670192828 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80009450 con 0x7fae88150d90 2024-09-13T15:04:12.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae7f400640 1 -- 172.21.15.7:0/1670192828 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae800b9410 con 0x7fae88150d90 2024-09-13T15:04:12.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae7f400640 1 -- 172.21.15.7:0/1670192828 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae800b97c0 con 0x7fae88150d90 2024-09-13T15:04:12.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.757+0000 7fae8da00640 1 -- 172.21.15.7:0/1670192828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae88157f80 con 0x7fae88150d90 2024-09-13T15:04:12.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.761+0000 7fae8da00640 1 -- 172.21.15.7:0/1670192828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8806f600 con 0x7fae88150d90 2024-09-13T15:04:12.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.761+0000 7fae8da00640 1 -- 172.21.15.7:0/1670192828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae881584a0 con 0x7fae88150d90 2024-09-13T15:04:12.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.761+0000 7fae7f400640 1 -- 172.21.15.7:0/1670192828 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fae800b6050 con 0x7fae88150d90 2024-09-13T15:04:12.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.761+0000 7fae7f400640 1 --2- 172.21.15.7:0/1670192828 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fae640666c0 0x7fae64068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:12.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.761+0000 7fae7f400640 1 -- 172.21.15.7:0/1670192828 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fae80122a00 con 0x7fae88150d90 2024-09-13T15:04:12.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.761+0000 7fae86a00640 1 --2- 172.21.15.7:0/1670192828 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fae640666c0 0x7fae64068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:12.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.761+0000 7fae86a00640 1 --2- 172.21.15.7:0/1670192828 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fae640666c0 0x7fae64068b80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fae780011f0 tx=0x7fae78009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:12.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.765+0000 7fae7f400640 1 -- 172.21.15.7:0/1670192828 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fae881584a0 con 0x7fae88150d90 2024-09-13T15:04:12.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:12.969+0000 7fae8da00640 1 -- 172.21.15.7:0/1670192828 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fae881584a0 con 0x7fae88150d90 2024-09-13T15:04:13.173 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:04:13.176 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:04:13.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.813+0000 7fae7f400640 1 -- 172.21.15.7:0/1670192828 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fae881584a0 con 0x7fae88150d90 2024-09-13T15:04:13.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.813+0000 7fae8da00640 1 -- 172.21.15.7:0/1670192828 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fae640666c0 msgr2=0x7fae64068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:13.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.813+0000 7fae8da00640 1 --2- 172.21.15.7:0/1670192828 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fae640666c0 0x7fae64068b80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fae780011f0 tx=0x7fae78009040 comp rx=0 tx=0).stop 2024-09-13T15:04:13.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.813+0000 7fae8da00640 1 -- 172.21.15.7:0/1670192828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae88150d90 msgr2=0x7fae881594b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:13.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.813+0000 7fae8da00640 1 --2- 172.21.15.7:0/1670192828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae88150d90 0x7fae881594b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fae800b2040 tx=0x7fae8001bef0 comp rx=0 tx=0).stop 2024-09-13T15:04:13.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.813+0000 7fae8da00640 1 -- 172.21.15.7:0/1670192828 shutdown_connections 2024-09-13T15:04:13.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.813+0000 7fae8da00640 1 --2- 172.21.15.7:0/1670192828 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fae640666c0 0x7fae64068b80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:13.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.813+0000 7fae8da00640 1 --2- 172.21.15.7:0/1670192828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae88150d90 0x7fae881594b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:13.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.813+0000 7fae8da00640 1 --2- 172.21.15.7:0/1670192828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae880c1880 0x7fae88158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:13.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.813+0000 7fae8da00640 1 --2- 172.21.15.7:0/1670192828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae88071810 0x7fae88146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:13.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.813+0000 7fae8da00640 1 -- 172.21.15.7:0/1670192828 >> 172.21.15.7:0/1670192828 conn(0x7fae88065d40 msgr2=0x7fae880c1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:13.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.813+0000 7fae8da00640 1 -- 172.21.15.7:0/1670192828 shutdown_connections 2024-09-13T15:04:13.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.813+0000 7fae8da00640 1 -- 172.21.15.7:0/1670192828 wait complete. 2024-09-13T15:04:13.842 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-13T15:04:13.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.989+0000 7f06cdc00640 1 Processor -- start 2024-09-13T15:04:13.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.989+0000 7f06cdc00640 1 -- start start 2024-09-13T15:04:13.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.989+0000 7f06cdc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06c80c00f0 0x7f06c80c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:13.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.989+0000 7f06cdc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f06c80b0cb0 0x7f06c814f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:13.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.989+0000 7f06cdc00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c806fd10 con 0x7f06c80c04d0 2024-09-13T15:04:13.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.989+0000 7f06cdc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c8071000 con 0x7f06c80b0cb0 2024-09-13T15:04:13.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.989+0000 7f06cdc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c8155ec0 con 0x7f06c80c00f0 2024-09-13T15:04:13.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.989+0000 7f06c7400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f06c80b0cb0 0x7f06c814f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:13.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.989+0000 7f06c7400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f06c80b0cb0 0x7f06c814f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33736/0 (socket says 172.21.15.7:33736) 2024-09-13T15:04:13.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.989+0000 7f06c7400640 1 -- 172.21.15.7:0/1903242989 learned_addr learned my addr 172.21.15.7:0/1903242989 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:13.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.989+0000 7f06c6a00640 1 --2- 172.21.15.7:0/1903242989 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06c80c00f0 0x7f06c80c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:13.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.989+0000 7f06c7400640 1 -- 172.21.15.7:0/1903242989 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06c80c00f0 msgr2=0x7f06c80c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:13.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.989+0000 7f06c7400640 1 --2- 172.21.15.7:0/1903242989 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06c80c00f0 0x7f06c80c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:13.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.989+0000 7f06c7400640 1 -- 172.21.15.7:0/1903242989 >> v1:172.21.15.77:6789/0 conn(0x7f06c80c04d0 legacy=0x7f06c806f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:13.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.989+0000 7f06c7400640 1 -- 172.21.15.7:0/1903242989 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c806ff60 con 0x7f06c80b0cb0 2024-09-13T15:04:13.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.993+0000 7f06c7400640 1 --2- 172.21.15.7:0/1903242989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c80b0cb0 0x7f06c814f7e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f06c000d150 tx=0x7f06c0021420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450ad67d80e58632 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.993+0000 7f06c6000640 1 -- 172.21.15.7:0/1903242989 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c000b2d0 con 0x7f06c80b0cb0 2024-09-13T15:04:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.993+0000 7f06c6000640 1 -- 172.21.15.7:0/1903242989 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c00ad050 con 0x7f06c80b0cb0 2024-09-13T15:04:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.993+0000 7f06c6000640 1 -- 172.21.15.7:0/1903242989 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c0009820 con 0x7f06c80b0cb0 2024-09-13T15:04:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.993+0000 7f06cdc00640 1 -- 172.21.15.7:0/1903242989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c80b0cb0 msgr2=0x7f06c814f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.993+0000 7f06cdc00640 1 --2- 172.21.15.7:0/1903242989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c80b0cb0 0x7f06c814f7e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f06c000d150 tx=0x7f06c0021420 comp rx=0 tx=0).stop 2024-09-13T15:04:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.993+0000 7f06cdc00640 1 -- 172.21.15.7:0/1903242989 shutdown_connections 2024-09-13T15:04:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.993+0000 7f06cdc00640 1 --2- 172.21.15.7:0/1903242989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c80b0cb0 0x7f06c814f7e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.993+0000 7f06cdc00640 1 --2- 172.21.15.7:0/1903242989 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06c80c00f0 0x7f06c80c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.993+0000 7f06cdc00640 1 -- 172.21.15.7:0/1903242989 >> 172.21.15.7:0/1903242989 conn(0x7f06c8065d40 msgr2=0x7f06c8066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.993+0000 7f06cdc00640 1 -- 172.21.15.7:0/1903242989 shutdown_connections 2024-09-13T15:04:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.993+0000 7f06cdc00640 1 -- 172.21.15.7:0/1903242989 wait complete. 2024-09-13T15:04:13.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.993+0000 7f06cdc00640 1 Processor -- start 2024-09-13T15:04:13.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.993+0000 7f06cdc00640 1 -- start start 2024-09-13T15:04:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06cdc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06c80b0cb0 0x7f06c81ef830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06cdc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c80c00f0 0x7f06c806ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06cdc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c80c04d0 0x7f06c8146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06cdc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c81eee20 con 0x7f06c80c00f0 2024-09-13T15:04:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06cdc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80b0620 con 0x7f06c80c04d0 2024-09-13T15:04:14.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06cdc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80cb9d0 con 0x7f06c80b0cb0 2024-09-13T15:04:14.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c80c00f0 0x7f06c806ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:14.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06bfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c80c00f0 0x7f06c806ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33748/0 (socket says 172.21.15.7:33748) 2024-09-13T15:04:14.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06bfe00640 1 -- 172.21.15.7:0/2926440090 learned_addr learned my addr 172.21.15.7:0/2926440090 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:14.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06c7400640 1 --2- 172.21.15.7:0/2926440090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c80c04d0 0x7f06c8146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:14.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06c6a00640 1 --2- 172.21.15.7:0/2926440090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06c80b0cb0 0x7f06c81ef830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:14.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06bfe00640 1 -- 172.21.15.7:0/2926440090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06c80b0cb0 msgr2=0x7f06c81ef830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:14.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06bfe00640 1 --2- 172.21.15.7:0/2926440090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06c80b0cb0 0x7f06c81ef830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:14.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06bfe00640 1 -- 172.21.15.7:0/2926440090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c80c04d0 msgr2=0x7f06c8146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:14.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06bfe00640 1 --2- 172.21.15.7:0/2926440090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c80c04d0 0x7f06c8146b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:14.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06bfe00640 1 -- 172.21.15.7:0/2926440090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c000bd40 con 0x7f06c80c00f0 2024-09-13T15:04:14.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06c7400640 1 --2- 172.21.15.7:0/2926440090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c80c04d0 0x7f06c8146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:14.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06bfe00640 1 --2- 172.21.15.7:0/2926440090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c80c00f0 0x7f06c806ccf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f06b000c500 tx=0x7f06b000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:14.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06bea00640 1 -- 172.21.15.7:0/2926440090 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b00052d0 con 0x7f06c80c00f0 2024-09-13T15:04:14.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06bea00640 1 -- 172.21.15.7:0/2926440090 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b0005430 con 0x7f06c80c00f0 2024-09-13T15:04:14.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06bea00640 1 -- 172.21.15.7:0/2926440090 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06b0003800 con 0x7f06c80c00f0 2024-09-13T15:04:14.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06cdc00640 1 -- 172.21.15.7:0/2926440090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c81ef3a0 con 0x7f06c80c00f0 2024-09-13T15:04:14.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06cdc00640 1 -- 172.21.15.7:0/2926440090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c80cb410 con 0x7f06c80c00f0 2024-09-13T15:04:14.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:13.997+0000 7f06cdc00640 1 -- 172.21.15.7:0/2926440090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c8067650 con 0x7f06c80c00f0 2024-09-13T15:04:14.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.001+0000 7f06bea00640 1 -- 172.21.15.7:0/2926440090 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f06b0003960 con 0x7f06c80c00f0 2024-09-13T15:04:14.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.001+0000 7f06bea00640 1 --2- 172.21.15.7:0/2926440090 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f06a40666c0 0x7f06a4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:14.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.001+0000 7f06bea00640 1 -- 172.21.15.7:0/2926440090 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f06b0083b00 con 0x7f06c80c00f0 2024-09-13T15:04:14.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.001+0000 7f06c6a00640 1 --2- 172.21.15.7:0/2926440090 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f06a40666c0 0x7f06a4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:14.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.001+0000 7f06c6a00640 1 --2- 172.21.15.7:0/2926440090 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f06a40666c0 0x7f06a4068b80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009a50 tx=0x7f06b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:14.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.005+0000 7f06bea00640 1 -- 172.21.15.7:0/2926440090 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06b0085e60 con 0x7f06c80c00f0 2024-09-13T15:04:14.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.201+0000 7f06cdc00640 1 -- 172.21.15.7:0/2926440090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f06c81ef530 con 0x7f06c80c00f0 2024-09-13T15:04:14.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.829+0000 7f06bea00640 1 -- 172.21.15.7:0/2926440090 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) v1 ==== 115+0+0 (secure 0 0 0) 0x7f06b0050a40 con 0x7f06c80c00f0 2024-09-13T15:04:14.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.829+0000 7f06cdc00640 1 -- 172.21.15.7:0/2926440090 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f06a40666c0 msgr2=0x7f06a4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:14.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.829+0000 7f06cdc00640 1 --2- 172.21.15.7:0/2926440090 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f06a40666c0 0x7f06a4068b80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f06b8009a50 tx=0x7f06b8008040 comp rx=0 tx=0).stop 2024-09-13T15:04:14.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.829+0000 7f06cdc00640 1 -- 172.21.15.7:0/2926440090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c80c00f0 msgr2=0x7f06c806ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:14.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.829+0000 7f06cdc00640 1 --2- 172.21.15.7:0/2926440090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c80c00f0 0x7f06c806ccf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f06b000c500 tx=0x7f06b000c9c0 comp rx=0 tx=0).stop 2024-09-13T15:04:14.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.829+0000 7f06cdc00640 1 -- 172.21.15.7:0/2926440090 shutdown_connections 2024-09-13T15:04:14.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.829+0000 7f06cdc00640 1 --2- 172.21.15.7:0/2926440090 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f06a40666c0 0x7f06a4068b80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:14.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.829+0000 7f06cdc00640 1 --2- 172.21.15.7:0/2926440090 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06c80c04d0 0x7f06c8146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:14.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.829+0000 7f06cdc00640 1 --2- 172.21.15.7:0/2926440090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f06c80c00f0 0x7f06c806ccf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:14.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.829+0000 7f06cdc00640 1 --2- 172.21.15.7:0/2926440090 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f06c80b0cb0 0x7f06c81ef830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:14.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.829+0000 7f06cdc00640 1 -- 172.21.15.7:0/2926440090 >> 172.21.15.7:0/2926440090 conn(0x7f06c8065d40 msgr2=0x7f06c806d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:14.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.829+0000 7f06cdc00640 1 -- 172.21.15.7:0/2926440090 shutdown_connections 2024-09-13T15:04:14.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:14.829+0000 7f06cdc00640 1 -- 172.21.15.7:0/2926440090 wait complete. 2024-09-13T15:04:14.856 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T15:04:14.856 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:04:15.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f341f000640 1 Processor -- start 2024-09-13T15:04:15.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f341f000640 1 -- start start 2024-09-13T15:04:15.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f341f000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f34180c9c40 0x7f34180662d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f341f000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34180ca020 0x7f34180c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f341f000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f34180c6ff0 0x7f34180c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f341f000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3418159400 con 0x7f34180c9c40 2024-09-13T15:04:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f341f000640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34181596e0 con 0x7f34180c6ff0 2024-09-13T15:04:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f341f000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34181599c0 con 0x7f34180ca020 2024-09-13T15:04:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f3417e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f34180c9c40 0x7f34180662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f3417e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f34180c9c40 0x7f34180662d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33764/0 (socket says 172.21.15.7:33764) 2024-09-13T15:04:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f3417e00640 1 -- 172.21.15.7:0/3432979132 learned_addr learned my addr 172.21.15.7:0/3432979132 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f340fe00640 1 --2- 172.21.15.7:0/3432979132 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34180ca020 0x7f34180c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f341d000640 1 --2- 172.21.15.7:0/3432979132 >> v2:172.21.15.77:3300/0 conn(0x7f34180c6ff0 0x7f34180c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f3417e00640 1 -- 172.21.15.7:0/3432979132 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34180ca020 msgr2=0x7f34180c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f3417e00640 1 --2- 172.21.15.7:0/3432979132 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34180ca020 0x7f34180c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f3417e00640 1 -- 172.21.15.7:0/3432979132 >> v2:172.21.15.77:3300/0 conn(0x7f34180c6ff0 msgr2=0x7f34180c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f3417e00640 1 --2- 172.21.15.7:0/3432979132 >> v2:172.21.15.77:3300/0 conn(0x7f34180c6ff0 0x7f34180c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.001+0000 7f3417e00640 1 -- 172.21.15.7:0/3432979132 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3418159ca0 con 0x7f34180c9c40 2024-09-13T15:04:15.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.005+0000 7f3417e00640 1 --2- 172.21.15.7:0/3432979132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34180c9c40 0x7f34180662d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f34180c2500 tx=0x7f340801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd919e10f004f57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:15.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.005+0000 7f3417400640 1 -- 172.21.15.7:0/3432979132 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34080a89d0 con 0x7f34180c9c40 2024-09-13T15:04:15.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.005+0000 7f3417400640 1 -- 172.21.15.7:0/3432979132 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34080a8b30 con 0x7f34180c9c40 2024-09-13T15:04:15.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.005+0000 7f3417400640 1 -- 172.21.15.7:0/3432979132 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34080b0440 con 0x7f34180c9c40 2024-09-13T15:04:15.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.005+0000 7f341f000640 1 -- 172.21.15.7:0/3432979132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34180c9c40 msgr2=0x7f34180662d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.005+0000 7f341f000640 1 --2- 172.21.15.7:0/3432979132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34180c9c40 0x7f34180662d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f34180c2500 tx=0x7f340801ed10 comp rx=0 tx=0).stop 2024-09-13T15:04:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.005+0000 7f341f000640 1 -- 172.21.15.7:0/3432979132 shutdown_connections 2024-09-13T15:04:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.005+0000 7f341f000640 1 --2- 172.21.15.7:0/3432979132 >> v2:172.21.15.77:3300/0 conn(0x7f34180c6ff0 0x7f34180c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.005+0000 7f341f000640 1 --2- 172.21.15.7:0/3432979132 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34180ca020 0x7f34180c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.005+0000 7f341f000640 1 --2- 172.21.15.7:0/3432979132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34180c9c40 0x7f34180662d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.005+0000 7f341f000640 1 -- 172.21.15.7:0/3432979132 >> 172.21.15.7:0/3432979132 conn(0x7f341806e1f0 msgr2=0x7f341806e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.005+0000 7f341f000640 1 -- 172.21.15.7:0/3432979132 shutdown_connections 2024-09-13T15:04:15.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.005+0000 7f341f000640 1 -- 172.21.15.7:0/3432979132 wait complete. 2024-09-13T15:04:15.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.005+0000 7f341f000640 1 Processor -- start 2024-09-13T15:04:15.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.005+0000 7f341f000640 1 -- start start 2024-09-13T15:04:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341f000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34180c6ff0 0x7f34181541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341f000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34180c9c40 0x7f341815a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341f000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34180ca020 0x7f3418071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341f000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3418151e10 con 0x7f34180ca020 2024-09-13T15:04:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341f000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341815a7b0 con 0x7f34180c9c40 2024-09-13T15:04:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341f000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3418152080 con 0x7f34180c6ff0 2024-09-13T15:04:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34180ca020 0x7f3418071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341d000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34180ca020 0x7f3418071000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33768/0 (socket says 172.21.15.7:33768) 2024-09-13T15:04:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341d000640 1 -- 172.21.15.7:0/1556905929 learned_addr learned my addr 172.21.15.7:0/1556905929 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f3417e00640 1 --2- 172.21.15.7:0/1556905929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34180c6ff0 0x7f34181541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f340fe00640 1 --2- 172.21.15.7:0/1556905929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34180c9c40 0x7f341815a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341d000640 1 -- 172.21.15.7:0/1556905929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34180c6ff0 msgr2=0x7f34181541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:15.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341d000640 1 --2- 172.21.15.7:0/1556905929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34180c6ff0 0x7f34181541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341d000640 1 -- 172.21.15.7:0/1556905929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34180c9c40 msgr2=0x7f341815a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:15.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341d000640 1 --2- 172.21.15.7:0/1556905929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34180c9c40 0x7f341815a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341d000640 1 -- 172.21.15.7:0/1556905929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34080094d0 con 0x7f34180ca020 2024-09-13T15:04:15.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341d000640 1 --2- 172.21.15.7:0/1556905929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34180ca020 0x7f3418071000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3410007e60 tx=0x7f341000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:15.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f3414c00640 1 -- 172.21.15.7:0/1556905929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3410014620 con 0x7f34180ca020 2024-09-13T15:04:15.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f3414c00640 1 -- 172.21.15.7:0/1556905929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341000ee90 con 0x7f34180ca020 2024-09-13T15:04:15.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f3414c00640 1 -- 172.21.15.7:0/1556905929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34100149e0 con 0x7f34180ca020 2024-09-13T15:04:15.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341f000640 1 -- 172.21.15.7:0/1556905929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34181f1a80 con 0x7f34180ca020 2024-09-13T15:04:15.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341f000640 1 -- 172.21.15.7:0/1556905929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34181f2040 con 0x7f34180ca020 2024-09-13T15:04:15.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.009+0000 7f341f000640 1 -- 172.21.15.7:0/1556905929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34181f2200 con 0x7f34180ca020 2024-09-13T15:04:15.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.013+0000 7f3414c00640 1 -- 172.21.15.7:0/1556905929 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3410014b40 con 0x7f34180ca020 2024-09-13T15:04:15.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.013+0000 7f3414c00640 1 --2- 172.21.15.7:0/1556905929 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f33f4066690 0x7f33f4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.013+0000 7f3414c00640 1 -- 172.21.15.7:0/1556905929 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3410084ed0 con 0x7f34180ca020 2024-09-13T15:04:15.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.013+0000 7f3417e00640 1 --2- 172.21.15.7:0/1556905929 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f33f4066690 0x7f33f4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.013+0000 7f3417e00640 1 --2- 172.21.15.7:0/1556905929 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f33f4066690 0x7f33f4068b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f34080b2000 tx=0x7f3408009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:15.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.017+0000 7f3414c00640 1 -- 172.21.15.7:0/1556905929 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3410051d50 con 0x7f34180ca020 2024-09-13T15:04:15.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.213+0000 7f341f000640 1 -- 172.21.15.7:0/1556905929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3418067650 con 0x7f34180ca020 2024-09-13T15:04:15.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.213+0000 7f3414c00640 1 -- 172.21.15.7:0/1556905929 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+6252 (secure 0 0 0) 0x7f3410055370 con 0x7f34180ca020 2024-09-13T15:04:15.216 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:15.217 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4232,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4238,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:04:14.819441+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4276,"mds_1":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:04:15.217 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 11 2024-09-13T15:04:15.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.217+0000 7f341f000640 1 -- 172.21.15.7:0/1556905929 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f33f4066690 msgr2=0x7f33f4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:15.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.217+0000 7f341f000640 1 --2- 172.21.15.7:0/1556905929 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f33f4066690 0x7f33f4068b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f34080b2000 tx=0x7f3408009040 comp rx=0 tx=0).stop 2024-09-13T15:04:15.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.217+0000 7f341f000640 1 -- 172.21.15.7:0/1556905929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34180ca020 msgr2=0x7f3418071000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:15.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.217+0000 7f341f000640 1 --2- 172.21.15.7:0/1556905929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34180ca020 0x7f3418071000 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3410007e60 tx=0x7f341000e4b0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.217+0000 7f341f000640 1 -- 172.21.15.7:0/1556905929 shutdown_connections 2024-09-13T15:04:15.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.217+0000 7f341f000640 1 --2- 172.21.15.7:0/1556905929 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f33f4066690 0x7f33f4068b50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.217+0000 7f341f000640 1 --2- 172.21.15.7:0/1556905929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34180ca020 0x7f3418071000 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.217+0000 7f341f000640 1 --2- 172.21.15.7:0/1556905929 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34180c9c40 0x7f341815a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.217+0000 7f341f000640 1 --2- 172.21.15.7:0/1556905929 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f34180c6ff0 0x7f34181541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.217+0000 7f341f000640 1 -- 172.21.15.7:0/1556905929 >> 172.21.15.7:0/1556905929 conn(0x7f341806e1f0 msgr2=0x7f341814f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:15.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.217+0000 7f341f000640 1 -- 172.21.15.7:0/1556905929 shutdown_connections 2024-09-13T15:04:15.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.217+0000 7f341f000640 1 -- 172.21.15.7:0/1556905929 wait complete. 2024-09-13T15:04:15.238 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:04:15.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.377+0000 7f565e600640 1 Processor -- start 2024-09-13T15:04:15.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.377+0000 7f565e600640 1 -- start start 2024-09-13T15:04:15.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.377+0000 7f565e600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f56580c8fb0 0x7f565806f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.377+0000 7f565e600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f565806f8d0 0x7f56580ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.377+0000 7f565e600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5658159360 con 0x7f56580c67c0 2024-09-13T15:04:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.377+0000 7f565e600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5658159150 con 0x7f565806f8d0 2024-09-13T15:04:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.377+0000 7f565e600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5658159600 con 0x7f56580c8fb0 2024-09-13T15:04:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.377+0000 7f5657e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f565806f8d0 0x7f56580ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.377+0000 7f5657e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f565806f8d0 0x7f56580ccdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33770/0 (socket says 172.21.15.7:33770) 2024-09-13T15:04:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.377+0000 7f5657e00640 1 -- 172.21.15.7:0/2000734222 learned_addr learned my addr 172.21.15.7:0/2000734222 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.377+0000 7f564ea00640 1 --2- 172.21.15.7:0/2000734222 >> v2:172.21.15.77:3300/0 conn(0x7f56580c8fb0 0x7f565806f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.377+0000 7f5657e00640 1 -- 172.21.15.7:0/2000734222 >> v2:172.21.15.77:3300/0 conn(0x7f56580c8fb0 msgr2=0x7f565806f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.377+0000 7f5657e00640 1 --2- 172.21.15.7:0/2000734222 >> v2:172.21.15.77:3300/0 conn(0x7f56580c8fb0 0x7f565806f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.377+0000 7f5657e00640 1 -- 172.21.15.7:0/2000734222 >> v1:172.21.15.77:6789/0 conn(0x7f56580c67c0 legacy=0x7f56580c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:15.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.377+0000 7f5657e00640 1 -- 172.21.15.7:0/2000734222 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56581598e0 con 0x7f565806f8d0 2024-09-13T15:04:15.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.377+0000 7f564ea00640 1 --2- 172.21.15.7:0/2000734222 >> v2:172.21.15.77:3300/0 conn(0x7f56580c8fb0 0x7f565806f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:15.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.381+0000 7f5657e00640 1 --2- 172.21.15.7:0/2000734222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f565806f8d0 0x7f56580ccdd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f565806bd70 tx=0x7f565001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe680ba0483d5d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:15.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.381+0000 7f5656a00640 1 -- 172.21.15.7:0/2000734222 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56500af400 con 0x7f565806f8d0 2024-09-13T15:04:15.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.381+0000 7f5656a00640 1 -- 172.21.15.7:0/2000734222 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56500ab050 con 0x7f565806f8d0 2024-09-13T15:04:15.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.381+0000 7f5656a00640 1 -- 172.21.15.7:0/2000734222 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56500af780 con 0x7f565806f8d0 2024-09-13T15:04:15.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.381+0000 7f565e600640 1 -- 172.21.15.7:0/2000734222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f565806f8d0 msgr2=0x7f56580ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:15.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.381+0000 7f565e600640 1 --2- 172.21.15.7:0/2000734222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f565806f8d0 0x7f56580ccdd0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f565806bd70 tx=0x7f565001f1e0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.381+0000 7f565e600640 1 -- 172.21.15.7:0/2000734222 shutdown_connections 2024-09-13T15:04:15.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.381+0000 7f565e600640 1 --2- 172.21.15.7:0/2000734222 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f565806f8d0 0x7f56580ccdd0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.381+0000 7f565e600640 1 --2- 172.21.15.7:0/2000734222 >> v2:172.21.15.77:3300/0 conn(0x7f56580c8fb0 0x7f565806f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.381+0000 7f565e600640 1 -- 172.21.15.7:0/2000734222 >> 172.21.15.7:0/2000734222 conn(0x7f565806cf60 msgr2=0x7f56580717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:15.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.381+0000 7f565e600640 1 -- 172.21.15.7:0/2000734222 shutdown_connections 2024-09-13T15:04:15.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.381+0000 7f565e600640 1 -- 172.21.15.7:0/2000734222 wait complete. 2024-09-13T15:04:15.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f565e600640 1 Processor -- start 2024-09-13T15:04:15.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f565e600640 1 -- start start 2024-09-13T15:04:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f565e600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f565806f8d0 0x7f5658154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f565e600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56580c67c0 0x7f56581f21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f565e600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56580c8fb0 0x7f56581f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f565e600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56581f2db0 con 0x7f565806f8d0 2024-09-13T15:04:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f565e600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5658154ae0 con 0x7f56580c8fb0 2024-09-13T15:04:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f565e600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56581544d0 con 0x7f56580c67c0 2024-09-13T15:04:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f5657400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f565806f8d0 0x7f5658154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f5657400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f565806f8d0 0x7f5658154f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33786/0 (socket says 172.21.15.7:33786) 2024-09-13T15:04:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f5657400640 1 -- 172.21.15.7:0/727805375 learned_addr learned my addr 172.21.15.7:0/727805375 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f564ea00640 1 --2- 172.21.15.7:0/727805375 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56580c67c0 0x7f56581f21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f5657e00640 1 --2- 172.21.15.7:0/727805375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56580c8fb0 0x7f56581f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f5657400640 1 -- 172.21.15.7:0/727805375 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56580c67c0 msgr2=0x7f56581f21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f5657400640 1 --2- 172.21.15.7:0/727805375 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56580c67c0 0x7f56581f21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f5657400640 1 -- 172.21.15.7:0/727805375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56580c8fb0 msgr2=0x7f56581f26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f5657400640 1 --2- 172.21.15.7:0/727805375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56580c8fb0 0x7f56581f26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f5657400640 1 -- 172.21.15.7:0/727805375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5650009b30 con 0x7f565806f8d0 2024-09-13T15:04:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f5657400640 1 --2- 172.21.15.7:0/727805375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f565806f8d0 0x7f5658154f70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f564800c530 tx=0x7f564800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f564fe00640 1 -- 172.21.15.7:0/727805375 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648005220 con 0x7f565806f8d0 2024-09-13T15:04:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f564fe00640 1 -- 172.21.15.7:0/727805375 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5648005380 con 0x7f565806f8d0 2024-09-13T15:04:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f564fe00640 1 -- 172.21.15.7:0/727805375 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648007270 con 0x7f565806f8d0 2024-09-13T15:04:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f565e600640 1 -- 172.21.15.7:0/727805375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56581554b0 con 0x7f565806f8d0 2024-09-13T15:04:15.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.385+0000 7f565e600640 1 -- 172.21.15.7:0/727805375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56581565a0 con 0x7f565806f8d0 2024-09-13T15:04:15.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.389+0000 7f565e600640 1 -- 172.21.15.7:0/727805375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56580cad30 con 0x7f565806f8d0 2024-09-13T15:04:15.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.389+0000 7f564fe00640 1 -- 172.21.15.7:0/727805375 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f56480073d0 con 0x7f565806f8d0 2024-09-13T15:04:15.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.389+0000 7f564fe00640 1 --2- 172.21.15.7:0/727805375 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5634066690 0x7f5634068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.389+0000 7f564fe00640 1 -- 172.21.15.7:0/727805375 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5648083f10 con 0x7f565806f8d0 2024-09-13T15:04:15.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.389+0000 7f564ea00640 1 --2- 172.21.15.7:0/727805375 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5634066690 0x7f5634068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.389+0000 7f564ea00640 1 --2- 172.21.15.7:0/727805375 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5634066690 0x7f5634068b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f56581f3010 tx=0x7f5640008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:15.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.393+0000 7f564fe00640 1 -- 172.21.15.7:0/727805375 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5648050e20 con 0x7f565806f8d0 2024-09-13T15:04:15.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.557+0000 7f565e600640 1 -- 172.21.15.7:0/727805375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56580caa50 con 0x7f565806f8d0 2024-09-13T15:04:15.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.557+0000 7f564fe00640 1 -- 172.21.15.7:0/727805375 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18616 (secure 0 0 0) 0x7f5648054440 con 0x7f565806f8d0 2024-09-13T15:04:15.560 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:15.560 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:02:33.732864+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:04:15.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.561+0000 7f565e600640 1 -- 172.21.15.7:0/727805375 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5634066690 msgr2=0x7f5634068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:15.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.561+0000 7f565e600640 1 --2- 172.21.15.7:0/727805375 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5634066690 0x7f5634068b50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f56581f3010 tx=0x7f5640008040 comp rx=0 tx=0).stop 2024-09-13T15:04:15.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.561+0000 7f565e600640 1 -- 172.21.15.7:0/727805375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f565806f8d0 msgr2=0x7f5658154f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:15.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.561+0000 7f565e600640 1 --2- 172.21.15.7:0/727805375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f565806f8d0 0x7f5658154f70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f564800c530 tx=0x7f564800c9f0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.561+0000 7f565e600640 1 -- 172.21.15.7:0/727805375 shutdown_connections 2024-09-13T15:04:15.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.561+0000 7f565e600640 1 --2- 172.21.15.7:0/727805375 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5634066690 0x7f5634068b50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.561+0000 7f565e600640 1 --2- 172.21.15.7:0/727805375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56580c8fb0 0x7f56581f26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.561+0000 7f565e600640 1 --2- 172.21.15.7:0/727805375 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56580c67c0 0x7f56581f21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.561+0000 7f565e600640 1 --2- 172.21.15.7:0/727805375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f565806f8d0 0x7f5658154f70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.561+0000 7f565e600640 1 -- 172.21.15.7:0/727805375 >> 172.21.15.7:0/727805375 conn(0x7f565806cf60 msgr2=0x7f56580cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:15.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.561+0000 7f565e600640 1 -- 172.21.15.7:0/727805375 shutdown_connections 2024-09-13T15:04:15.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.561+0000 7f565e600640 1 -- 172.21.15.7:0/727805375 wait complete. 2024-09-13T15:04:15.582 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T15:04:15.582 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:04:15.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.717+0000 7f5f7c000640 1 Processor -- start 2024-09-13T15:04:15.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.717+0000 7f5f7c000640 1 -- start start 2024-09-13T15:04:15.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.721+0000 7f5f7c000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5f740b0bf0 0x7f5f74150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.721+0000 7f5f7c000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5f7406ddb0 0x7f5f74151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.721+0000 7f5f7c000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f740c5530 con 0x7f5f74071a70 2024-09-13T15:04:15.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.721+0000 7f5f7c000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f74151750 con 0x7f5f7406ddb0 2024-09-13T15:04:15.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.721+0000 7f5f7c000640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f741583b0 con 0x7f5f740b0bf0 2024-09-13T15:04:15.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.721+0000 7f5f7a000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5f7406ddb0 0x7f5f74151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.721+0000 7f5f79600640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5f74071a70 0x7f5f741576e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:45646/0 (socket says 172.21.15.7:45646) 2024-09-13T15:04:15.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.721+0000 7f5f79600640 1 -- 172.21.15.7:0/1526136579 learned_addr learned my addr 172.21.15.7:0/1526136579 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:15.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.721+0000 7f5f78c00640 1 --2- 172.21.15.7:0/1526136579 >> v2:172.21.15.77:3300/0 conn(0x7f5f740b0bf0 0x7f5f74150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.721+0000 7f5f7a000640 1 -- 172.21.15.7:0/1526136579 >> v2:172.21.15.77:3300/0 conn(0x7f5f740b0bf0 msgr2=0x7f5f74150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:15.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.721+0000 7f5f7a000640 1 --2- 172.21.15.7:0/1526136579 >> v2:172.21.15.77:3300/0 conn(0x7f5f740b0bf0 0x7f5f74150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.721+0000 7f5f7a000640 1 -- 172.21.15.7:0/1526136579 >> v1:172.21.15.77:6789/0 conn(0x7f5f74071a70 legacy=0x7f5f741576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:15.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.721+0000 7f5f7a000640 1 -- 172.21.15.7:0/1526136579 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f74156f40 con 0x7f5f7406ddb0 2024-09-13T15:04:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f7a000640 1 --2- 172.21.15.7:0/1526136579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7406ddb0 0x7f5f74151210 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5f74072760 tx=0x7f5f6c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f960aac18d56325e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f73e00640 1 -- 172.21.15.7:0/1526136579 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c0a59c0 con 0x7f5f7406ddb0 2024-09-13T15:04:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f73e00640 1 -- 172.21.15.7:0/1526136579 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c0a5b20 con 0x7f5f7406ddb0 2024-09-13T15:04:15.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f73e00640 1 -- 172.21.15.7:0/1526136579 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c0ad440 con 0x7f5f7406ddb0 2024-09-13T15:04:15.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f7c000640 1 -- 172.21.15.7:0/1526136579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7406ddb0 msgr2=0x7f5f74151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:15.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f7c000640 1 --2- 172.21.15.7:0/1526136579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7406ddb0 0x7f5f74151210 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5f74072760 tx=0x7f5f6c01c900 comp rx=0 tx=0).stop 2024-09-13T15:04:15.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f7c000640 1 -- 172.21.15.7:0/1526136579 shutdown_connections 2024-09-13T15:04:15.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f7c000640 1 --2- 172.21.15.7:0/1526136579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7406ddb0 0x7f5f74151210 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f7c000640 1 --2- 172.21.15.7:0/1526136579 >> v2:172.21.15.77:3300/0 conn(0x7f5f740b0bf0 0x7f5f74150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f7c000640 1 -- 172.21.15.7:0/1526136579 >> 172.21.15.7:0/1526136579 conn(0x7f5f74065d40 msgr2=0x7f5f74066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:15.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f7c000640 1 -- 172.21.15.7:0/1526136579 shutdown_connections 2024-09-13T15:04:15.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f7c000640 1 -- 172.21.15.7:0/1526136579 wait complete. 2024-09-13T15:04:15.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f7c000640 1 Processor -- start 2024-09-13T15:04:15.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f7c000640 1 -- start start 2024-09-13T15:04:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f7c000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f7406ddb0 0x7f5f74142150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f7c000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f74071a70 0x7f5f74143c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f7c000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f740b0bf0 0x7f5f74155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f7c000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f74150640 con 0x7f5f74071a70 2024-09-13T15:04:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f7c000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f741441c0 con 0x7f5f740b0bf0 2024-09-13T15:04:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.725+0000 7f5f7c000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7413da10 con 0x7f5f7406ddb0 2024-09-13T15:04:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f78c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f74071a70 0x7f5f74143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f78c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f74071a70 0x7f5f74143c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33798/0 (socket says 172.21.15.7:33798) 2024-09-13T15:04:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f78c00640 1 -- 172.21.15.7:0/1478484266 learned_addr learned my addr 172.21.15.7:0/1478484266 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f79600640 1 --2- 172.21.15.7:0/1478484266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f7406ddb0 0x7f5f74142150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f7a000640 1 --2- 172.21.15.7:0/1478484266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f740b0bf0 0x7f5f74155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f78c00640 1 -- 172.21.15.7:0/1478484266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f7406ddb0 msgr2=0x7f5f74142150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f78c00640 1 --2- 172.21.15.7:0/1478484266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f7406ddb0 0x7f5f74142150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f78c00640 1 -- 172.21.15.7:0/1478484266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f740b0bf0 msgr2=0x7f5f74155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f78c00640 1 --2- 172.21.15.7:0/1478484266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f740b0bf0 0x7f5f74155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f78c00640 1 -- 172.21.15.7:0/1478484266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c009a70 con 0x7f5f74071a70 2024-09-13T15:04:15.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f78c00640 1 --2- 172.21.15.7:0/1478484266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f74071a70 0x7f5f74143c80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000d800 tx=0x7f5f6000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:15.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f71600640 1 -- 172.21.15.7:0/1478484266 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6000b6c0 con 0x7f5f74071a70 2024-09-13T15:04:15.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f71600640 1 -- 172.21.15.7:0/1478484266 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6000b820 con 0x7f5f74071a70 2024-09-13T15:04:15.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f71600640 1 -- 172.21.15.7:0/1478484266 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6000bb90 con 0x7f5f74071a70 2024-09-13T15:04:15.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f7c000640 1 -- 172.21.15.7:0/1478484266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7413d730 con 0x7f5f74071a70 2024-09-13T15:04:15.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f7c000640 1 -- 172.21.15.7:0/1478484266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f74150260 con 0x7f5f74071a70 2024-09-13T15:04:15.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f7c000640 1 -- 172.21.15.7:0/1478484266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f74150420 con 0x7f5f74071a70 2024-09-13T15:04:15.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.729+0000 7f5f71600640 1 -- 172.21.15.7:0/1478484266 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5f6000bcf0 con 0x7f5f74071a70 2024-09-13T15:04:15.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.733+0000 7f5f71600640 1 --2- 172.21.15.7:0/1478484266 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5f54066690 0x7f5f54068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:15.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.733+0000 7f5f71600640 1 -- 172.21.15.7:0/1478484266 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5f60084ab0 con 0x7f5f74071a70 2024-09-13T15:04:15.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.733+0000 7f5f79600640 1 --2- 172.21.15.7:0/1478484266 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5f54066690 0x7f5f54068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:15.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.733+0000 7f5f79600640 1 --2- 172.21.15.7:0/1478484266 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5f54066690 0x7f5f54068b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5f68005890 tx=0x7f5f68009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:15.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.737+0000 7f5f71600640 1 -- 172.21.15.7:0/1478484266 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5f60051a50 con 0x7f5f74071a70 2024-09-13T15:04:15.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.897+0000 7f5f7c000640 1 -- 172.21.15.7:0/1478484266 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5f74157df0 con 0x7f5f54066690 2024-09-13T15:04:15.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.925+0000 7f5f71600640 1 -- 172.21.15.7:0/1478484266 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368694 (secure 0 0 0) 0x7f5f68001c80 con 0x7f5f54066690 2024-09-13T15:04:15.931 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:15.936 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T15:04:15.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.933+0000 7f5f7c000640 1 -- 172.21.15.7:0/1478484266 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5f54066690 msgr2=0x7f5f54068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:15.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.933+0000 7f5f7c000640 1 --2- 172.21.15.7:0/1478484266 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5f54066690 0x7f5f54068b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5f68005890 tx=0x7f5f68009040 comp rx=0 tx=0).stop 2024-09-13T15:04:15.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.933+0000 7f5f7c000640 1 -- 172.21.15.7:0/1478484266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f74071a70 msgr2=0x7f5f74143c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:15.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.933+0000 7f5f7c000640 1 --2- 172.21.15.7:0/1478484266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f74071a70 0x7f5f74143c80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000d800 tx=0x7f5f6000dcc0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.933+0000 7f5f7c000640 1 -- 172.21.15.7:0/1478484266 shutdown_connections 2024-09-13T15:04:15.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.933+0000 7f5f7c000640 1 --2- 172.21.15.7:0/1478484266 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5f54066690 0x7f5f54068b50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.933+0000 7f5f7c000640 1 --2- 172.21.15.7:0/1478484266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f740b0bf0 0x7f5f74155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.933+0000 7f5f7c000640 1 --2- 172.21.15.7:0/1478484266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f74071a70 0x7f5f74143c80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.933+0000 7f5f7c000640 1 --2- 172.21.15.7:0/1478484266 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f7406ddb0 0x7f5f74142150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:15.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.933+0000 7f5f7c000640 1 -- 172.21.15.7:0/1478484266 >> 172.21.15.7:0/1478484266 conn(0x7f5f74065d40 msgr2=0x7f5f74150aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:15.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.933+0000 7f5f7c000640 1 -- 172.21.15.7:0/1478484266 shutdown_connections 2024-09-13T15:04:15.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:15.933+0000 7f5f7c000640 1 -- 172.21.15.7:0/1478484266 wait complete. 2024-09-13T15:04:15.954 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-09-13T15:04:14.683754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231900,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":754742820,"statfs":{"total":773094113280,"available":772856647680,"internally_reserved":0,"allocated":3547136,"data_stored":2126210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":233819704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004625"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742671+0000","last_change":"2024-09-13T15:01:44.418856+0000","last_active":"2024-09-13T15:02:33.742671+0000","last_peered":"2024-09-13T15:02:33.742671+0000","last_clean":"2024-09-13T15:02:33.742671+0000","last_became_active":"2024-09-13T15:01:44.418641+0000","last_became_peered":"2024-09-13T15:01:44.418641+0000","last_unstale":"2024-09-13T15:02:33.742671+0000","last_undegraded":"2024-09-13T15:02:33.742671+0000","last_fullsized":"2024-09-13T15:02:33.742671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:40.178824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738513+0000","last_change":"2024-09-13T15:01:44.809371+0000","last_active":"2024-09-13T15:02:33.738513+0000","last_peered":"2024-09-13T15:02:33.738513+0000","last_clean":"2024-09-13T15:02:33.738513+0000","last_became_active":"2024-09-13T15:01:44.809091+0000","last_became_peered":"2024-09-13T15:01:44.809091+0000","last_unstale":"2024-09-13T15:02:33.738513+0000","last_undegraded":"2024-09-13T15:02:33.738513+0000","last_fullsized":"2024-09-13T15:02:33.738513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:22.412025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737520+0000","last_change":"2024-09-13T15:01:48.910757+0000","last_active":"2024-09-13T15:02:33.737520+0000","last_peered":"2024-09-13T15:02:33.737520+0000","last_clean":"2024-09-13T15:02:33.737520+0000","last_became_active":"2024-09-13T15:01:48.910262+0000","last_became_peered":"2024-09-13T15:01:48.910262+0000","last_unstale":"2024-09-13T15:02:33.737520+0000","last_undegraded":"2024-09-13T15:02:33.737520+0000","last_fullsized":"2024-09-13T15:02:33.737520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:39.290557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738791+0000","last_change":"2024-09-13T15:01:44.404818+0000","last_active":"2024-09-13T15:02:33.738791+0000","last_peered":"2024-09-13T15:02:33.738791+0000","last_clean":"2024-09-13T15:02:33.738791+0000","last_became_active":"2024-09-13T15:01:44.401666+0000","last_became_peered":"2024-09-13T15:01:44.401666+0000","last_unstale":"2024-09-13T15:02:33.738791+0000","last_undegraded":"2024-09-13T15:02:33.738791+0000","last_fullsized":"2024-09-13T15:02:33.738791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:31.818163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742417+0000","last_change":"2024-09-13T15:01:44.850292+0000","last_active":"2024-09-13T15:02:33.742417+0000","last_peered":"2024-09-13T15:02:33.742417+0000","last_clean":"2024-09-13T15:02:33.742417+0000","last_became_active":"2024-09-13T15:01:44.849825+0000","last_became_peered":"2024-09-13T15:01:44.849825+0000","last_unstale":"2024-09-13T15:02:33.742417+0000","last_undegraded":"2024-09-13T15:02:33.742417+0000","last_fullsized":"2024-09-13T15:02:33.742417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:22.582742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.746607+0000","last_change":"2024-09-13T15:01:48.850426+0000","last_active":"2024-09-13T15:02:33.746607+0000","last_peered":"2024-09-13T15:02:33.746607+0000","last_clean":"2024-09-13T15:02:33.746607+0000","last_became_active":"2024-09-13T15:01:48.848750+0000","last_became_peered":"2024-09-13T15:01:48.848750+0000","last_unstale":"2024-09-13T15:02:33.746607+0000","last_undegraded":"2024-09-13T15:02:33.746607+0000","last_fullsized":"2024-09-13T15:02:33.746607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:55.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117554+0000","last_change":"2024-09-13T15:01:44.437850+0000","last_active":"2024-09-13T15:02:34.117554+0000","last_peered":"2024-09-13T15:02:34.117554+0000","last_clean":"2024-09-13T15:02:34.117554+0000","last_became_active":"2024-09-13T15:01:44.437168+0000","last_became_peered":"2024-09-13T15:01:44.437168+0000","last_unstale":"2024-09-13T15:02:34.117554+0000","last_undegraded":"2024-09-13T15:02:34.117554+0000","last_fullsized":"2024-09-13T15:02:34.117554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:23.540408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.754363+0000","last_change":"2024-09-13T15:01:44.845989+0000","last_active":"2024-09-13T15:02:32.754363+0000","last_peered":"2024-09-13T15:02:32.754363+0000","last_clean":"2024-09-13T15:02:32.754363+0000","last_became_active":"2024-09-13T15:01:44.845395+0000","last_became_peered":"2024-09-13T15:01:44.845395+0000","last_unstale":"2024-09-13T15:02:32.754363+0000","last_undegraded":"2024-09-13T15:02:32.754363+0000","last_fullsized":"2024-09-13T15:02:32.754363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:52.267507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.739791+0000","last_change":"2024-09-13T15:01:48.865388+0000","last_active":"2024-09-13T15:02:32.739791+0000","last_peered":"2024-09-13T15:02:32.739791+0000","last_clean":"2024-09-13T15:02:32.739791+0000","last_became_active":"2024-09-13T15:01:48.864314+0000","last_became_peered":"2024-09-13T15:01:48.864314+0000","last_unstale":"2024-09-13T15:02:32.739791+0000","last_undegraded":"2024-09-13T15:02:32.739791+0000","last_fullsized":"2024-09-13T15:02:32.739791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:18.637430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116848+0000","last_change":"2024-09-13T15:01:44.424080+0000","last_active":"2024-09-13T15:02:34.116848+0000","last_peered":"2024-09-13T15:02:34.116848+0000","last_clean":"2024-09-13T15:02:34.116848+0000","last_became_active":"2024-09-13T15:01:44.423381+0000","last_became_peered":"2024-09-13T15:01:44.423381+0000","last_unstale":"2024-09-13T15:02:34.116848+0000","last_undegraded":"2024-09-13T15:02:34.116848+0000","last_fullsized":"2024-09-13T15:02:34.116848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:38:20.455380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.754463+0000","last_change":"2024-09-13T15:01:44.849670+0000","last_active":"2024-09-13T15:02:32.754463+0000","last_peered":"2024-09-13T15:02:32.754463+0000","last_clean":"2024-09-13T15:02:32.754463+0000","last_became_active":"2024-09-13T15:01:44.849038+0000","last_became_peered":"2024-09-13T15:01:44.849038+0000","last_unstale":"2024-09-13T15:02:32.754463+0000","last_undegraded":"2024-09-13T15:02:32.754463+0000","last_fullsized":"2024-09-13T15:02:32.754463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:45.570774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.742068+0000","last_change":"2024-09-13T15:01:48.854953+0000","last_active":"2024-09-13T15:02:32.742068+0000","last_peered":"2024-09-13T15:02:32.742068+0000","last_clean":"2024-09-13T15:02:32.742068+0000","last_became_active":"2024-09-13T15:01:48.853858+0000","last_became_peered":"2024-09-13T15:01:48.853858+0000","last_unstale":"2024-09-13T15:02:32.742068+0000","last_undegraded":"2024-09-13T15:02:32.742068+0000","last_fullsized":"2024-09-13T15:02:32.742068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:07.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742073+0000","last_change":"2024-09-13T15:01:44.824391+0000","last_active":"2024-09-13T15:02:33.742073+0000","last_peered":"2024-09-13T15:02:33.742073+0000","last_clean":"2024-09-13T15:02:33.742073+0000","last_became_active":"2024-09-13T15:01:44.823690+0000","last_became_peered":"2024-09-13T15:01:44.823690+0000","last_unstale":"2024-09-13T15:02:33.742073+0000","last_undegraded":"2024-09-13T15:02:33.742073+0000","last_fullsized":"2024-09-13T15:02:33.742073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116708+0000","last_change":"2024-09-13T15:01:44.421523+0000","last_active":"2024-09-13T15:02:34.116708+0000","last_peered":"2024-09-13T15:02:34.116708+0000","last_clean":"2024-09-13T15:02:34.116708+0000","last_became_active":"2024-09-13T15:01:44.419965+0000","last_became_peered":"2024-09-13T15:01:44.419965+0000","last_unstale":"2024-09-13T15:02:34.116708+0000","last_undegraded":"2024-09-13T15:02:34.116708+0000","last_fullsized":"2024-09-13T15:02:34.116708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:34.918774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749714+0000","last_change":"2024-09-13T15:01:48.850895+0000","last_active":"2024-09-13T15:02:33.749714+0000","last_peered":"2024-09-13T15:02:33.749714+0000","last_clean":"2024-09-13T15:02:33.749714+0000","last_became_active":"2024-09-13T15:01:48.849856+0000","last_became_peered":"2024-09-13T15:01:48.849856+0000","last_unstale":"2024-09-13T15:02:33.749714+0000","last_undegraded":"2024-09-13T15:02:33.749714+0000","last_fullsized":"2024-09-13T15:02:33.749714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:59.616442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738227+0000","last_change":"2024-09-13T15:01:44.806026+0000","last_active":"2024-09-13T15:02:33.738227+0000","last_peered":"2024-09-13T15:02:33.738227+0000","last_clean":"2024-09-13T15:02:33.738227+0000","last_became_active":"2024-09-13T15:01:44.805767+0000","last_became_peered":"2024-09-13T15:01:44.805767+0000","last_unstale":"2024-09-13T15:02:33.738227+0000","last_undegraded":"2024-09-13T15:02:33.738227+0000","last_fullsized":"2024-09-13T15:02:33.738227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:50.696113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743085+0000","last_change":"2024-09-13T15:01:44.401897+0000","last_active":"2024-09-13T15:02:33.743085+0000","last_peered":"2024-09-13T15:02:33.743085+0000","last_clean":"2024-09-13T15:02:33.743085+0000","last_became_active":"2024-09-13T15:01:44.401559+0000","last_became_peered":"2024-09-13T15:01:44.401559+0000","last_unstale":"2024-09-13T15:02:33.743085+0000","last_undegraded":"2024-09-13T15:02:33.743085+0000","last_fullsized":"2024-09-13T15:02:33.743085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:58.535567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749109+0000","last_change":"2024-09-13T15:01:48.858808+0000","last_active":"2024-09-13T15:02:33.749109+0000","last_peered":"2024-09-13T15:02:33.749109+0000","last_clean":"2024-09-13T15:02:33.749109+0000","last_became_active":"2024-09-13T15:01:48.857802+0000","last_became_peered":"2024-09-13T15:01:48.857802+0000","last_unstale":"2024-09-13T15:02:33.749109+0000","last_undegraded":"2024-09-13T15:02:33.749109+0000","last_fullsized":"2024-09-13T15:02:33.749109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:41.628058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737738+0000","last_change":"2024-09-13T15:01:44.808674+0000","last_active":"2024-09-13T15:02:33.737738+0000","last_peered":"2024-09-13T15:02:33.737738+0000","last_clean":"2024-09-13T15:02:33.737738+0000","last_became_active":"2024-09-13T15:01:44.808420+0000","last_became_peered":"2024-09-13T15:01:44.808420+0000","last_unstale":"2024-09-13T15:02:33.737738+0000","last_undegraded":"2024-09-13T15:02:33.737738+0000","last_fullsized":"2024-09-13T15:02:33.737738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:33.447973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741996+0000","last_change":"2024-09-13T15:01:44.406717+0000","last_active":"2024-09-13T15:02:33.741996+0000","last_peered":"2024-09-13T15:02:33.741996+0000","last_clean":"2024-09-13T15:02:33.741996+0000","last_became_active":"2024-09-13T15:01:44.406354+0000","last_became_peered":"2024-09-13T15:01:44.406354+0000","last_unstale":"2024-09-13T15:02:33.741996+0000","last_undegraded":"2024-09-13T15:02:33.741996+0000","last_fullsized":"2024-09-13T15:02:33.741996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:49.413632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741522+0000","last_change":"2024-09-13T15:01:48.909879+0000","last_active":"2024-09-13T15:02:33.741522+0000","last_peered":"2024-09-13T15:02:33.741522+0000","last_clean":"2024-09-13T15:02:33.741522+0000","last_became_active":"2024-09-13T15:01:48.909494+0000","last_became_peered":"2024-09-13T15:01:48.909494+0000","last_unstale":"2024-09-13T15:02:33.741522+0000","last_undegraded":"2024-09-13T15:02:33.741522+0000","last_fullsized":"2024-09-13T15:02:33.741522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:54.415920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748317+0000","last_change":"2024-09-13T15:01:44.825065+0000","last_active":"2024-09-13T15:02:33.748317+0000","last_peered":"2024-09-13T15:02:33.748317+0000","last_clean":"2024-09-13T15:02:33.748317+0000","last_became_active":"2024-09-13T15:01:44.824392+0000","last_became_peered":"2024-09-13T15:01:44.824392+0000","last_unstale":"2024-09-13T15:02:33.748317+0000","last_undegraded":"2024-09-13T15:02:33.748317+0000","last_fullsized":"2024-09-13T15:02:33.748317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:49.717211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116092+0000","last_change":"2024-09-13T15:01:44.421119+0000","last_active":"2024-09-13T15:02:34.116092+0000","last_peered":"2024-09-13T15:02:34.116092+0000","last_clean":"2024-09-13T15:02:34.116092+0000","last_became_active":"2024-09-13T15:01:44.419082+0000","last_became_peered":"2024-09-13T15:01:44.419082+0000","last_unstale":"2024-09-13T15:02:34.116092+0000","last_undegraded":"2024-09-13T15:02:34.116092+0000","last_fullsized":"2024-09-13T15:02:34.116092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.011350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749456+0000","last_change":"2024-09-13T15:01:48.856387+0000","last_active":"2024-09-13T15:02:33.749456+0000","last_peered":"2024-09-13T15:02:33.749456+0000","last_clean":"2024-09-13T15:02:33.749456+0000","last_became_active":"2024-09-13T15:01:48.855433+0000","last_became_peered":"2024-09-13T15:01:48.855433+0000","last_unstale":"2024-09-13T15:02:33.749456+0000","last_undegraded":"2024-09-13T15:02:33.749456+0000","last_fullsized":"2024-09-13T15:02:33.749456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:58.309929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744608+0000","last_change":"2024-09-13T15:01:44.807909+0000","last_active":"2024-09-13T15:02:33.744608+0000","last_peered":"2024-09-13T15:02:33.744608+0000","last_clean":"2024-09-13T15:02:33.744608+0000","last_became_active":"2024-09-13T15:01:44.807643+0000","last_became_peered":"2024-09-13T15:01:44.807643+0000","last_unstale":"2024-09-13T15:02:33.744608+0000","last_undegraded":"2024-09-13T15:02:33.744608+0000","last_fullsized":"2024-09-13T15:02:33.744608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:30.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744683+0000","last_change":"2024-09-13T15:01:44.430200+0000","last_active":"2024-09-13T15:02:33.744683+0000","last_peered":"2024-09-13T15:02:33.744683+0000","last_clean":"2024-09-13T15:02:33.744683+0000","last_became_active":"2024-09-13T15:01:44.429510+0000","last_became_peered":"2024-09-13T15:01:44.429510+0000","last_unstale":"2024-09-13T15:02:33.744683+0000","last_undegraded":"2024-09-13T15:02:33.744683+0000","last_fullsized":"2024-09-13T15:02:33.744683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:52.921485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748075+0000","last_change":"2024-09-13T15:01:48.912116+0000","last_active":"2024-09-13T15:02:33.748075+0000","last_peered":"2024-09-13T15:02:33.748075+0000","last_clean":"2024-09-13T15:02:33.748075+0000","last_became_active":"2024-09-13T15:01:48.911578+0000","last_became_peered":"2024-09-13T15:01:48.911578+0000","last_unstale":"2024-09-13T15:02:33.748075+0000","last_undegraded":"2024-09-13T15:02:33.748075+0000","last_fullsized":"2024-09-13T15:02:33.748075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:50.826715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738926+0000","last_change":"2024-09-13T15:01:44.838344+0000","last_active":"2024-09-13T15:02:33.738926+0000","last_peered":"2024-09-13T15:02:33.738926+0000","last_clean":"2024-09-13T15:02:33.738926+0000","last_became_active":"2024-09-13T15:01:44.838128+0000","last_became_peered":"2024-09-13T15:01:44.838128+0000","last_unstale":"2024-09-13T15:02:33.738926+0000","last_undegraded":"2024-09-13T15:02:33.738926+0000","last_fullsized":"2024-09-13T15:02:33.738926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:09:50.373976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742357+0000","last_change":"2024-09-13T15:01:44.430749+0000","last_active":"2024-09-13T15:02:33.742357+0000","last_peered":"2024-09-13T15:02:33.742357+0000","last_clean":"2024-09-13T15:02:33.742357+0000","last_became_active":"2024-09-13T15:01:44.430548+0000","last_became_peered":"2024-09-13T15:01:44.430548+0000","last_unstale":"2024-09-13T15:02:33.742357+0000","last_undegraded":"2024-09-13T15:02:33.742357+0000","last_fullsized":"2024-09-13T15:02:33.742357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:30.312447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737398+0000","last_change":"2024-09-13T15:01:48.911224+0000","last_active":"2024-09-13T15:02:33.737398+0000","last_peered":"2024-09-13T15:02:33.737398+0000","last_clean":"2024-09-13T15:02:33.737398+0000","last_became_active":"2024-09-13T15:01:48.910150+0000","last_became_peered":"2024-09-13T15:01:48.910150+0000","last_unstale":"2024-09-13T15:02:33.737398+0000","last_undegraded":"2024-09-13T15:02:33.737398+0000","last_fullsized":"2024-09-13T15:02:33.737398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:41.244267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743138+0000","last_change":"2024-09-13T15:01:44.812200+0000","last_active":"2024-09-13T15:02:33.743138+0000","last_peered":"2024-09-13T15:02:33.743138+0000","last_clean":"2024-09-13T15:02:33.743138+0000","last_became_active":"2024-09-13T15:01:44.811915+0000","last_became_peered":"2024-09-13T15:01:44.811915+0000","last_unstale":"2024-09-13T15:02:33.743138+0000","last_undegraded":"2024-09-13T15:02:33.743138+0000","last_fullsized":"2024-09-13T15:02:33.743138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:07.944520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117799+0000","last_change":"2024-09-13T15:01:44.423119+0000","last_active":"2024-09-13T15:02:34.117799+0000","last_peered":"2024-09-13T15:02:34.117799+0000","last_clean":"2024-09-13T15:02:34.117799+0000","last_became_active":"2024-09-13T15:01:44.422297+0000","last_became_peered":"2024-09-13T15:01:44.422297+0000","last_unstale":"2024-09-13T15:02:34.117799+0000","last_undegraded":"2024-09-13T15:02:34.117799+0000","last_fullsized":"2024-09-13T15:02:34.117799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:09.798196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743841+0000","last_change":"2024-09-13T15:01:48.908569+0000","last_active":"2024-09-13T15:02:33.743841+0000","last_peered":"2024-09-13T15:02:33.743841+0000","last_clean":"2024-09-13T15:02:33.743841+0000","last_became_active":"2024-09-13T15:01:48.908118+0000","last_became_peered":"2024-09-13T15:01:48.908118+0000","last_unstale":"2024-09-13T15:02:33.743841+0000","last_undegraded":"2024-09-13T15:02:33.743841+0000","last_fullsized":"2024-09-13T15:02:33.743841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:06.459855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743852+0000","last_change":"2024-09-13T15:01:44.850837+0000","last_active":"2024-09-13T15:02:33.743852+0000","last_peered":"2024-09-13T15:02:33.743852+0000","last_clean":"2024-09-13T15:02:33.743852+0000","last_became_active":"2024-09-13T15:01:44.850263+0000","last_became_peered":"2024-09-13T15:01:44.850263+0000","last_unstale":"2024-09-13T15:02:33.743852+0000","last_undegraded":"2024-09-13T15:02:33.743852+0000","last_fullsized":"2024-09-13T15:02:33.743852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:16.956369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743192+0000","last_change":"2024-09-13T15:01:44.399163+0000","last_active":"2024-09-13T15:02:33.743192+0000","last_peered":"2024-09-13T15:02:33.743192+0000","last_clean":"2024-09-13T15:02:33.743192+0000","last_became_active":"2024-09-13T15:01:44.398881+0000","last_became_peered":"2024-09-13T15:01:44.398881+0000","last_unstale":"2024-09-13T15:02:33.743192+0000","last_undegraded":"2024-09-13T15:02:33.743192+0000","last_fullsized":"2024-09-13T15:02:33.743192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:49.622676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743584+0000","last_change":"2024-09-13T15:01:48.852798+0000","last_active":"2024-09-13T15:02:33.743584+0000","last_peered":"2024-09-13T15:02:33.743584+0000","last_clean":"2024-09-13T15:02:33.743584+0000","last_became_active":"2024-09-13T15:01:48.851948+0000","last_became_peered":"2024-09-13T15:01:48.851948+0000","last_unstale":"2024-09-13T15:02:33.743584+0000","last_undegraded":"2024-09-13T15:02:33.743584+0000","last_fullsized":"2024-09-13T15:02:33.743584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:20.061043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749414+0000","last_change":"2024-09-13T15:01:44.824074+0000","last_active":"2024-09-13T15:02:33.749414+0000","last_peered":"2024-09-13T15:02:33.749414+0000","last_clean":"2024-09-13T15:02:33.749414+0000","last_became_active":"2024-09-13T15:01:44.821475+0000","last_became_peered":"2024-09-13T15:01:44.821475+0000","last_unstale":"2024-09-13T15:02:33.749414+0000","last_undegraded":"2024-09-13T15:02:33.749414+0000","last_fullsized":"2024-09-13T15:02:33.749414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:21.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742662+0000","last_change":"2024-09-13T15:01:44.433502+0000","last_active":"2024-09-13T15:02:33.742662+0000","last_peered":"2024-09-13T15:02:33.742662+0000","last_clean":"2024-09-13T15:02:33.742662+0000","last_became_active":"2024-09-13T15:01:44.432902+0000","last_became_peered":"2024-09-13T15:01:44.432902+0000","last_unstale":"2024-09-13T15:02:33.742662+0000","last_undegraded":"2024-09-13T15:02:33.742662+0000","last_fullsized":"2024-09-13T15:02:33.742662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:59.189559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743046+0000","last_change":"2024-09-13T15:01:48.846695+0000","last_active":"2024-09-13T15:02:33.743046+0000","last_peered":"2024-09-13T15:02:33.743046+0000","last_clean":"2024-09-13T15:02:33.743046+0000","last_became_active":"2024-09-13T15:01:48.846301+0000","last_became_peered":"2024-09-13T15:01:48.846301+0000","last_unstale":"2024-09-13T15:02:33.743046+0000","last_undegraded":"2024-09-13T15:02:33.743046+0000","last_fullsized":"2024-09-13T15:02:33.743046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:17.532499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741535+0000","last_change":"2024-09-13T15:01:44.814483+0000","last_active":"2024-09-13T15:02:33.741535+0000","last_peered":"2024-09-13T15:02:33.741535+0000","last_clean":"2024-09-13T15:02:33.741535+0000","last_became_active":"2024-09-13T15:01:44.814192+0000","last_became_peered":"2024-09-13T15:01:44.814192+0000","last_unstale":"2024-09-13T15:02:33.741535+0000","last_undegraded":"2024-09-13T15:02:33.741535+0000","last_fullsized":"2024-09-13T15:02:33.741535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:32:30.303635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741224+0000","last_change":"2024-09-13T15:01:44.399314+0000","last_active":"2024-09-13T15:02:33.741224+0000","last_peered":"2024-09-13T15:02:33.741224+0000","last_clean":"2024-09-13T15:02:33.741224+0000","last_became_active":"2024-09-13T15:01:44.398904+0000","last_became_peered":"2024-09-13T15:01:44.398904+0000","last_unstale":"2024-09-13T15:02:33.741224+0000","last_undegraded":"2024-09-13T15:02:33.741224+0000","last_fullsized":"2024-09-13T15:02:33.741224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.645179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741624+0000","last_change":"2024-09-13T15:01:48.859142+0000","last_active":"2024-09-13T15:02:33.741624+0000","last_peered":"2024-09-13T15:02:33.741624+0000","last_clean":"2024-09-13T15:02:33.741624+0000","last_became_active":"2024-09-13T15:01:48.858649+0000","last_became_peered":"2024-09-13T15:01:48.858649+0000","last_unstale":"2024-09-13T15:02:33.741624+0000","last_undegraded":"2024-09-13T15:02:33.741624+0000","last_fullsized":"2024-09-13T15:02:33.741624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:27.314012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743419+0000","last_change":"2024-09-13T15:01:44.826501+0000","last_active":"2024-09-13T15:02:33.743419+0000","last_peered":"2024-09-13T15:02:33.743419+0000","last_clean":"2024-09-13T15:02:33.743419+0000","last_became_active":"2024-09-13T15:01:44.826222+0000","last_became_peered":"2024-09-13T15:01:44.826222+0000","last_unstale":"2024-09-13T15:02:33.743419+0000","last_undegraded":"2024-09-13T15:02:33.743419+0000","last_fullsized":"2024-09-13T15:02:33.743419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:00.543916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116096+0000","last_change":"2024-09-13T15:01:44.421891+0000","last_active":"2024-09-13T15:02:34.116096+0000","last_peered":"2024-09-13T15:02:34.116096+0000","last_clean":"2024-09-13T15:02:34.116096+0000","last_became_active":"2024-09-13T15:01:44.419660+0000","last_became_peered":"2024-09-13T15:01:44.419660+0000","last_unstale":"2024-09-13T15:02:34.116096+0000","last_undegraded":"2024-09-13T15:02:34.116096+0000","last_fullsized":"2024-09-13T15:02:34.116096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:27.554128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.120816+0000","last_change":"2024-09-13T15:02:34.119111+0000","last_active":"2024-09-13T15:02:34.120816+0000","last_peered":"2024-09-13T15:02:34.120816+0000","last_clean":"2024-09-13T15:02:34.120816+0000","last_became_active":"2024-09-13T15:02:34.118461+0000","last_became_peered":"2024-09-13T15:02:34.118461+0000","last_unstale":"2024-09-13T15:02:34.120816+0000","last_undegraded":"2024-09-13T15:02:34.120816+0000","last_fullsized":"2024-09-13T15:02:34.120816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:35.096846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738701+0000","last_change":"2024-09-13T15:01:44.850498+0000","last_active":"2024-09-13T15:02:33.738701+0000","last_peered":"2024-09-13T15:02:33.738701+0000","last_clean":"2024-09-13T15:02:33.738701+0000","last_became_active":"2024-09-13T15:01:44.850234+0000","last_became_peered":"2024-09-13T15:01:44.850234+0000","last_unstale":"2024-09-13T15:02:33.738701+0000","last_undegraded":"2024-09-13T15:02:33.738701+0000","last_fullsized":"2024-09-13T15:02:33.738701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:37.202494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743323+0000","last_change":"2024-09-13T15:01:44.411997+0000","last_active":"2024-09-13T15:02:33.743323+0000","last_peered":"2024-09-13T15:02:33.743323+0000","last_clean":"2024-09-13T15:02:33.743323+0000","last_became_active":"2024-09-13T15:01:44.410675+0000","last_became_peered":"2024-09-13T15:01:44.410675+0000","last_unstale":"2024-09-13T15:02:33.743323+0000","last_undegraded":"2024-09-13T15:02:33.743323+0000","last_fullsized":"2024-09-13T15:02:33.743323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:50:55.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116345+0000","last_change":"2024-09-13T15:01:40.834440+0000","last_active":"2024-09-13T15:02:34.116345+0000","last_peered":"2024-09-13T15:02:34.116345+0000","last_clean":"2024-09-13T15:02:34.116345+0000","last_became_active":"2024-09-13T15:01:40.832279+0000","last_became_peered":"2024-09-13T15:01:40.832279+0000","last_unstale":"2024-09-13T15:02:34.116345+0000","last_undegraded":"2024-09-13T15:02:34.116345+0000","last_fullsized":"2024-09-13T15:02:34.116345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_clean_scrub_stamp":"2024-09-13T15:01:39.264455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:11.875506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743545+0000","last_change":"2024-09-13T15:01:48.919580+0000","last_active":"2024-09-13T15:02:33.743545+0000","last_peered":"2024-09-13T15:02:33.743545+0000","last_clean":"2024-09-13T15:02:33.743545+0000","last_became_active":"2024-09-13T15:01:48.918678+0000","last_became_peered":"2024-09-13T15:01:48.918678+0000","last_unstale":"2024-09-13T15:02:33.743545+0000","last_undegraded":"2024-09-13T15:02:33.743545+0000","last_fullsized":"2024-09-13T15:02:33.743545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:02.840528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116879+0000","last_change":"2024-09-13T15:01:44.849975+0000","last_active":"2024-09-13T15:02:34.116879+0000","last_peered":"2024-09-13T15:02:34.116879+0000","last_clean":"2024-09-13T15:02:34.116879+0000","last_became_active":"2024-09-13T15:01:44.849457+0000","last_became_peered":"2024-09-13T15:01:44.849457+0000","last_unstale":"2024-09-13T15:02:34.116879+0000","last_undegraded":"2024-09-13T15:02:34.116879+0000","last_fullsized":"2024-09-13T15:02:34.116879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:51.139153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742016+0000","last_change":"2024-09-13T15:01:44.420906+0000","last_active":"2024-09-13T15:02:33.742016+0000","last_peered":"2024-09-13T15:02:33.742016+0000","last_clean":"2024-09-13T15:02:33.742016+0000","last_became_active":"2024-09-13T15:01:44.420601+0000","last_became_peered":"2024-09-13T15:01:44.420601+0000","last_unstale":"2024-09-13T15:02:33.742016+0000","last_undegraded":"2024-09-13T15:02:33.742016+0000","last_fullsized":"2024-09-13T15:02:33.742016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:33.245745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741847+0000","last_change":"2024-09-13T15:01:48.911047+0000","last_active":"2024-09-13T15:02:33.741847+0000","last_peered":"2024-09-13T15:02:33.741847+0000","last_clean":"2024-09-13T15:02:33.741847+0000","last_became_active":"2024-09-13T15:01:48.910479+0000","last_became_peered":"2024-09-13T15:01:48.910479+0000","last_unstale":"2024-09-13T15:02:33.741847+0000","last_undegraded":"2024-09-13T15:02:33.741847+0000","last_fullsized":"2024-09-13T15:02:33.741847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:06.558889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745346+0000","last_change":"2024-09-13T15:01:44.838098+0000","last_active":"2024-09-13T15:02:33.745346+0000","last_peered":"2024-09-13T15:02:33.745346+0000","last_clean":"2024-09-13T15:02:33.745346+0000","last_became_active":"2024-09-13T15:01:44.837429+0000","last_became_peered":"2024-09-13T15:01:44.837429+0000","last_unstale":"2024-09-13T15:02:33.745346+0000","last_undegraded":"2024-09-13T15:02:33.745346+0000","last_fullsized":"2024-09-13T15:02:33.745346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:37.795841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742419+0000","last_change":"2024-09-13T15:01:44.406999+0000","last_active":"2024-09-13T15:02:33.742419+0000","last_peered":"2024-09-13T15:02:33.742419+0000","last_clean":"2024-09-13T15:02:33.742419+0000","last_became_active":"2024-09-13T15:01:44.406719+0000","last_became_peered":"2024-09-13T15:01:44.406719+0000","last_unstale":"2024-09-13T15:02:33.742419+0000","last_undegraded":"2024-09-13T15:02:33.742419+0000","last_fullsized":"2024-09-13T15:02:33.742419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:33.397091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743939+0000","last_change":"2024-09-13T15:01:48.857931+0000","last_active":"2024-09-13T15:02:33.743939+0000","last_peered":"2024-09-13T15:02:33.743939+0000","last_clean":"2024-09-13T15:02:33.743939+0000","last_became_active":"2024-09-13T15:01:48.857542+0000","last_became_peered":"2024-09-13T15:01:48.857542+0000","last_unstale":"2024-09-13T15:02:33.743939+0000","last_undegraded":"2024-09-13T15:02:33.743939+0000","last_fullsized":"2024-09-13T15:02:33.743939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:32.805405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118403+0000","last_change":"2024-09-13T15:01:44.835470+0000","last_active":"2024-09-13T15:02:34.118403+0000","last_peered":"2024-09-13T15:02:34.118403+0000","last_clean":"2024-09-13T15:02:34.118403+0000","last_became_active":"2024-09-13T15:01:44.831166+0000","last_became_peered":"2024-09-13T15:01:44.831166+0000","last_unstale":"2024-09-13T15:02:34.118403+0000","last_undegraded":"2024-09-13T15:02:34.118403+0000","last_fullsized":"2024-09-13T15:02:34.118403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:05.887592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742413+0000","last_change":"2024-09-13T15:01:44.403111+0000","last_active":"2024-09-13T15:02:33.742413+0000","last_peered":"2024-09-13T15:02:33.742413+0000","last_clean":"2024-09-13T15:02:33.742413+0000","last_became_active":"2024-09-13T15:01:44.401799+0000","last_became_peered":"2024-09-13T15:01:44.401799+0000","last_unstale":"2024-09-13T15:02:33.742413+0000","last_undegraded":"2024-09-13T15:02:33.742413+0000","last_fullsized":"2024-09-13T15:02:33.742413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:54.589470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740292+0000","last_change":"2024-09-13T15:01:48.912490+0000","last_active":"2024-09-13T15:02:33.740292+0000","last_peered":"2024-09-13T15:02:33.740292+0000","last_clean":"2024-09-13T15:02:33.740292+0000","last_became_active":"2024-09-13T15:01:48.911474+0000","last_became_peered":"2024-09-13T15:01:48.911474+0000","last_unstale":"2024-09-13T15:02:33.740292+0000","last_undegraded":"2024-09-13T15:02:33.740292+0000","last_fullsized":"2024-09-13T15:02:33.740292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:54.295921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117960+0000","last_change":"2024-09-13T15:01:44.818472+0000","last_active":"2024-09-13T15:02:34.117960+0000","last_peered":"2024-09-13T15:02:34.117960+0000","last_clean":"2024-09-13T15:02:34.117960+0000","last_became_active":"2024-09-13T15:01:44.817718+0000","last_became_peered":"2024-09-13T15:01:44.817718+0000","last_unstale":"2024-09-13T15:02:34.117960+0000","last_undegraded":"2024-09-13T15:02:34.117960+0000","last_fullsized":"2024-09-13T15:02:34.117960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:21.310696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.750292+0000","last_change":"2024-09-13T15:01:44.410376+0000","last_active":"2024-09-13T15:02:33.750292+0000","last_peered":"2024-09-13T15:02:33.750292+0000","last_clean":"2024-09-13T15:02:33.750292+0000","last_became_active":"2024-09-13T15:01:44.409585+0000","last_became_peered":"2024-09-13T15:01:44.409585+0000","last_unstale":"2024-09-13T15:02:33.750292+0000","last_undegraded":"2024-09-13T15:02:33.750292+0000","last_fullsized":"2024-09-13T15:02:33.750292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:45.845804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.747358+0000","last_change":"2024-09-13T15:01:48.861130+0000","last_active":"2024-09-13T15:02:33.747358+0000","last_peered":"2024-09-13T15:02:33.747358+0000","last_clean":"2024-09-13T15:02:33.747358+0000","last_became_active":"2024-09-13T15:01:48.860317+0000","last_became_peered":"2024-09-13T15:01:48.860317+0000","last_unstale":"2024-09-13T15:02:33.747358+0000","last_undegraded":"2024-09-13T15:02:33.747358+0000","last_fullsized":"2024-09-13T15:02:33.747358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:45.317747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116786+0000","last_change":"2024-09-13T15:01:44.835494+0000","last_active":"2024-09-13T15:02:34.116786+0000","last_peered":"2024-09-13T15:02:34.116786+0000","last_clean":"2024-09-13T15:02:34.116786+0000","last_became_active":"2024-09-13T15:01:44.831150+0000","last_became_peered":"2024-09-13T15:01:44.831150+0000","last_unstale":"2024-09-13T15:02:34.116786+0000","last_undegraded":"2024-09-13T15:02:34.116786+0000","last_fullsized":"2024-09-13T15:02:34.116786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:29.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740939+0000","last_change":"2024-09-13T15:01:44.390278+0000","last_active":"2024-09-13T15:02:33.740939+0000","last_peered":"2024-09-13T15:02:33.740939+0000","last_clean":"2024-09-13T15:02:33.740939+0000","last_became_active":"2024-09-13T15:01:44.389946+0000","last_became_peered":"2024-09-13T15:01:44.389946+0000","last_unstale":"2024-09-13T15:02:33.740939+0000","last_undegraded":"2024-09-13T15:02:33.740939+0000","last_fullsized":"2024-09-13T15:02:33.740939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:53.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744367+0000","last_change":"2024-09-13T15:01:48.848009+0000","last_active":"2024-09-13T15:02:33.744367+0000","last_peered":"2024-09-13T15:02:33.744367+0000","last_clean":"2024-09-13T15:02:33.744367+0000","last_became_active":"2024-09-13T15:01:48.847605+0000","last_became_peered":"2024-09-13T15:01:48.847605+0000","last_unstale":"2024-09-13T15:02:33.744367+0000","last_undegraded":"2024-09-13T15:02:33.744367+0000","last_fullsized":"2024-09-13T15:02:33.744367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:32.053010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741353+0000","last_change":"2024-09-13T15:01:44.808572+0000","last_active":"2024-09-13T15:02:33.741353+0000","last_peered":"2024-09-13T15:02:33.741353+0000","last_clean":"2024-09-13T15:02:33.741353+0000","last_became_active":"2024-09-13T15:01:44.808140+0000","last_became_peered":"2024-09-13T15:01:44.808140+0000","last_unstale":"2024-09-13T15:02:33.741353+0000","last_undegraded":"2024-09-13T15:02:33.741353+0000","last_fullsized":"2024-09-13T15:02:33.741353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:15.497720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742109+0000","last_change":"2024-09-13T15:01:44.428794+0000","last_active":"2024-09-13T15:02:33.742109+0000","last_peered":"2024-09-13T15:02:33.742109+0000","last_clean":"2024-09-13T15:02:33.742109+0000","last_became_active":"2024-09-13T15:01:44.428271+0000","last_became_peered":"2024-09-13T15:01:44.428271+0000","last_unstale":"2024-09-13T15:02:33.742109+0000","last_undegraded":"2024-09-13T15:02:33.742109+0000","last_fullsized":"2024-09-13T15:02:33.742109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:53.225826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738469+0000","last_change":"2024-09-13T15:01:48.916354+0000","last_active":"2024-09-13T15:02:33.738469+0000","last_peered":"2024-09-13T15:02:33.738469+0000","last_clean":"2024-09-13T15:02:33.738469+0000","last_became_active":"2024-09-13T15:01:48.916008+0000","last_became_peered":"2024-09-13T15:01:48.916008+0000","last_unstale":"2024-09-13T15:02:33.738469+0000","last_undegraded":"2024-09-13T15:02:33.738469+0000","last_fullsized":"2024-09-13T15:02:33.738469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:58.115410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116589+0000","last_change":"2024-09-13T15:01:44.826700+0000","last_active":"2024-09-13T15:02:34.116589+0000","last_peered":"2024-09-13T15:02:34.116589+0000","last_clean":"2024-09-13T15:02:34.116589+0000","last_became_active":"2024-09-13T15:01:44.825996+0000","last_became_peered":"2024-09-13T15:01:44.825996+0000","last_unstale":"2024-09-13T15:02:34.116589+0000","last_undegraded":"2024-09-13T15:02:34.116589+0000","last_fullsized":"2024-09-13T15:02:34.116589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:11.963837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742455+0000","last_change":"2024-09-13T15:01:44.409339+0000","last_active":"2024-09-13T15:02:33.742455+0000","last_peered":"2024-09-13T15:02:33.742455+0000","last_clean":"2024-09-13T15:02:33.742455+0000","last_became_active":"2024-09-13T15:01:44.408644+0000","last_became_peered":"2024-09-13T15:01:44.408644+0000","last_unstale":"2024-09-13T15:02:33.742455+0000","last_undegraded":"2024-09-13T15:02:33.742455+0000","last_fullsized":"2024-09-13T15:02:33.742455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:29.297950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737959+0000","last_change":"2024-09-13T15:01:48.916478+0000","last_active":"2024-09-13T15:02:33.737959+0000","last_peered":"2024-09-13T15:02:33.737959+0000","last_clean":"2024-09-13T15:02:33.737959+0000","last_became_active":"2024-09-13T15:01:48.916198+0000","last_became_peered":"2024-09-13T15:01:48.916198+0000","last_unstale":"2024-09-13T15:02:33.737959+0000","last_undegraded":"2024-09-13T15:02:33.737959+0000","last_fullsized":"2024-09-13T15:02:33.737959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:26.311460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743617+0000","last_change":"2024-09-13T15:01:44.831833+0000","last_active":"2024-09-13T15:02:33.743617+0000","last_peered":"2024-09-13T15:02:33.743617+0000","last_clean":"2024-09-13T15:02:33.743617+0000","last_became_active":"2024-09-13T15:01:44.831583+0000","last_became_peered":"2024-09-13T15:01:44.831583+0000","last_unstale":"2024-09-13T15:02:33.743617+0000","last_undegraded":"2024-09-13T15:02:33.743617+0000","last_fullsized":"2024-09-13T15:02:33.743617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.715951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744192+0000","last_change":"2024-09-13T15:01:44.408752+0000","last_active":"2024-09-13T15:02:33.744192+0000","last_peered":"2024-09-13T15:02:33.744192+0000","last_clean":"2024-09-13T15:02:33.744192+0000","last_became_active":"2024-09-13T15:01:44.408453+0000","last_became_peered":"2024-09-13T15:01:44.408453+0000","last_unstale":"2024-09-13T15:02:33.744192+0000","last_undegraded":"2024-09-13T15:02:33.744192+0000","last_fullsized":"2024-09-13T15:02:33.744192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:31.587404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743419+0000","last_change":"2024-09-13T15:01:48.916681+0000","last_active":"2024-09-13T15:02:33.743419+0000","last_peered":"2024-09-13T15:02:33.743419+0000","last_clean":"2024-09-13T15:02:33.743419+0000","last_became_active":"2024-09-13T15:01:48.916185+0000","last_became_peered":"2024-09-13T15:01:48.916185+0000","last_unstale":"2024-09-13T15:02:33.743419+0000","last_undegraded":"2024-09-13T15:02:33.743419+0000","last_fullsized":"2024-09-13T15:02:33.743419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:33.862835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116757+0000","last_change":"2024-09-13T15:01:44.817007+0000","last_active":"2024-09-13T15:02:34.116757+0000","last_peered":"2024-09-13T15:02:34.116757+0000","last_clean":"2024-09-13T15:02:34.116757+0000","last_became_active":"2024-09-13T15:01:44.815435+0000","last_became_peered":"2024-09-13T15:01:44.815435+0000","last_unstale":"2024-09-13T15:02:34.116757+0000","last_undegraded":"2024-09-13T15:02:34.116757+0000","last_fullsized":"2024-09-13T15:02:34.116757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:25.887993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:03.647333+0000","last_change":"2024-09-13T15:01:44.435688+0000","last_active":"2024-09-13T15:04:03.647333+0000","last_peered":"2024-09-13T15:04:03.647333+0000","last_clean":"2024-09-13T15:04:03.647333+0000","last_became_active":"2024-09-13T15:01:44.435222+0000","last_became_peered":"2024-09-13T15:01:44.435222+0000","last_unstale":"2024-09-13T15:04:03.647333+0000","last_undegraded":"2024-09-13T15:04:03.647333+0000","last_fullsized":"2024-09-13T15:04:03.647333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:24.705633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742810+0000","last_change":"2024-09-13T15:01:48.847694+0000","last_active":"2024-09-13T15:02:33.742810+0000","last_peered":"2024-09-13T15:02:33.742810+0000","last_clean":"2024-09-13T15:02:33.742810+0000","last_became_active":"2024-09-13T15:01:48.846835+0000","last_became_peered":"2024-09-13T15:01:48.846835+0000","last_unstale":"2024-09-13T15:02:33.742810+0000","last_undegraded":"2024-09-13T15:02:33.742810+0000","last_fullsized":"2024-09-13T15:02:33.742810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:49.763472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749658+0000","last_change":"2024-09-13T15:01:44.835315+0000","last_active":"2024-09-13T15:02:33.749658+0000","last_peered":"2024-09-13T15:02:33.749658+0000","last_clean":"2024-09-13T15:02:33.749658+0000","last_became_active":"2024-09-13T15:01:44.834643+0000","last_became_peered":"2024-09-13T15:01:44.834643+0000","last_unstale":"2024-09-13T15:02:33.749658+0000","last_undegraded":"2024-09-13T15:02:33.749658+0000","last_fullsized":"2024-09-13T15:02:33.749658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:15.535195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742300+0000","last_change":"2024-09-13T15:01:44.424966+0000","last_active":"2024-09-13T15:02:33.742300+0000","last_peered":"2024-09-13T15:02:33.742300+0000","last_clean":"2024-09-13T15:02:33.742300+0000","last_became_active":"2024-09-13T15:01:44.424714+0000","last_became_peered":"2024-09-13T15:01:44.424714+0000","last_unstale":"2024-09-13T15:02:33.742300+0000","last_undegraded":"2024-09-13T15:02:33.742300+0000","last_fullsized":"2024-09-13T15:02:33.742300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:46.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.756425+0000","last_change":"2024-09-13T15:02:33.753482+0000","last_active":"2024-09-13T15:02:33.756425+0000","last_peered":"2024-09-13T15:02:33.756425+0000","last_clean":"2024-09-13T15:02:33.756425+0000","last_became_active":"2024-09-13T15:02:33.752505+0000","last_became_peered":"2024-09-13T15:02:33.752505+0000","last_unstale":"2024-09-13T15:02:33.756425+0000","last_undegraded":"2024-09-13T15:02:33.756425+0000","last_fullsized":"2024-09-13T15:02:33.756425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:59.041586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742572+0000","last_change":"2024-09-13T15:01:44.837032+0000","last_active":"2024-09-13T15:02:33.742572+0000","last_peered":"2024-09-13T15:02:33.742572+0000","last_clean":"2024-09-13T15:02:33.742572+0000","last_became_active":"2024-09-13T15:01:44.836750+0000","last_became_peered":"2024-09-13T15:01:44.836750+0000","last_unstale":"2024-09-13T15:02:33.742572+0000","last_undegraded":"2024-09-13T15:02:33.742572+0000","last_fullsized":"2024-09-13T15:02:33.742572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:04.491426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.747046+0000","last_change":"2024-09-13T15:01:44.437854+0000","last_active":"2024-09-13T15:02:33.747046+0000","last_peered":"2024-09-13T15:02:33.747046+0000","last_clean":"2024-09-13T15:02:33.747046+0000","last_became_active":"2024-09-13T15:01:44.437433+0000","last_became_peered":"2024-09-13T15:01:44.437433+0000","last_unstale":"2024-09-13T15:02:33.747046+0000","last_undegraded":"2024-09-13T15:02:33.747046+0000","last_fullsized":"2024-09-13T15:02:33.747046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:47.302388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737553+0000","last_change":"2024-09-13T15:01:48.841829+0000","last_active":"2024-09-13T15:02:33.737553+0000","last_peered":"2024-09-13T15:02:33.737553+0000","last_clean":"2024-09-13T15:02:33.737553+0000","last_became_active":"2024-09-13T15:01:48.841267+0000","last_became_peered":"2024-09-13T15:01:48.841267+0000","last_unstale":"2024-09-13T15:02:33.737553+0000","last_undegraded":"2024-09-13T15:02:33.737553+0000","last_fullsized":"2024-09-13T15:02:33.737553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:25.029615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.746815+0000","last_change":"2024-09-13T15:01:44.844701+0000","last_active":"2024-09-13T15:02:33.746815+0000","last_peered":"2024-09-13T15:02:33.746815+0000","last_clean":"2024-09-13T15:02:33.746815+0000","last_became_active":"2024-09-13T15:01:44.843982+0000","last_became_peered":"2024-09-13T15:01:44.843982+0000","last_unstale":"2024-09-13T15:02:33.746815+0000","last_undegraded":"2024-09-13T15:02:33.746815+0000","last_fullsized":"2024-09-13T15:02:33.746815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744456+0000","last_change":"2024-09-13T15:01:44.436081+0000","last_active":"2024-09-13T15:02:33.744456+0000","last_peered":"2024-09-13T15:02:33.744456+0000","last_clean":"2024-09-13T15:02:33.744456+0000","last_became_active":"2024-09-13T15:01:44.435367+0000","last_became_peered":"2024-09-13T15:01:44.435367+0000","last_unstale":"2024-09-13T15:02:33.744456+0000","last_undegraded":"2024-09-13T15:02:33.744456+0000","last_fullsized":"2024-09-13T15:02:33.744456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:57:57.065719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737590+0000","last_change":"2024-09-13T15:01:48.910562+0000","last_active":"2024-09-13T15:02:33.737590+0000","last_peered":"2024-09-13T15:02:33.737590+0000","last_clean":"2024-09-13T15:02:33.737590+0000","last_became_active":"2024-09-13T15:01:48.909681+0000","last_became_peered":"2024-09-13T15:01:48.909681+0000","last_unstale":"2024-09-13T15:02:33.737590+0000","last_undegraded":"2024-09-13T15:02:33.737590+0000","last_fullsized":"2024-09-13T15:02:33.737590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:35.989769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.120759+0000","last_change":"2024-09-13T15:02:34.118951+0000","last_active":"2024-09-13T15:02:34.120759+0000","last_peered":"2024-09-13T15:02:34.120759+0000","last_clean":"2024-09-13T15:02:34.120759+0000","last_became_active":"2024-09-13T15:02:34.118477+0000","last_became_peered":"2024-09-13T15:02:34.118477+0000","last_unstale":"2024-09-13T15:02:34.120759+0000","last_undegraded":"2024-09-13T15:02:34.120759+0000","last_fullsized":"2024-09-13T15:02:34.120759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:13.697114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741807+0000","last_change":"2024-09-13T15:01:44.808417+0000","last_active":"2024-09-13T15:02:33.741807+0000","last_peered":"2024-09-13T15:02:33.741807+0000","last_clean":"2024-09-13T15:02:33.741807+0000","last_became_active":"2024-09-13T15:01:44.807641+0000","last_became_peered":"2024-09-13T15:01:44.807641+0000","last_unstale":"2024-09-13T15:02:33.741807+0000","last_undegraded":"2024-09-13T15:02:33.741807+0000","last_fullsized":"2024-09-13T15:02:33.741807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:58.296966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740623+0000","last_change":"2024-09-13T15:01:44.433582+0000","last_active":"2024-09-13T15:02:33.740623+0000","last_peered":"2024-09-13T15:02:33.740623+0000","last_clean":"2024-09-13T15:02:33.740623+0000","last_became_active":"2024-09-13T15:01:44.433124+0000","last_became_peered":"2024-09-13T15:01:44.433124+0000","last_unstale":"2024-09-13T15:02:33.740623+0000","last_undegraded":"2024-09-13T15:02:33.740623+0000","last_fullsized":"2024-09-13T15:02:33.740623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:04.476996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744178+0000","last_change":"2024-09-13T15:01:48.855090+0000","last_active":"2024-09-13T15:02:33.744178+0000","last_peered":"2024-09-13T15:02:33.744178+0000","last_clean":"2024-09-13T15:02:33.744178+0000","last_became_active":"2024-09-13T15:01:48.852925+0000","last_became_peered":"2024-09-13T15:01:48.852925+0000","last_unstale":"2024-09-13T15:02:33.744178+0000","last_undegraded":"2024-09-13T15:02:33.744178+0000","last_fullsized":"2024-09-13T15:02:33.744178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.176480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748607+0000","last_change":"2024-09-13T15:02:33.746356+0000","last_active":"2024-09-13T15:02:33.748607+0000","last_peered":"2024-09-13T15:02:33.748607+0000","last_clean":"2024-09-13T15:02:33.748607+0000","last_became_active":"2024-09-13T15:02:33.746005+0000","last_became_peered":"2024-09-13T15:02:33.746005+0000","last_unstale":"2024-09-13T15:02:33.748607+0000","last_undegraded":"2024-09-13T15:02:33.748607+0000","last_fullsized":"2024-09-13T15:02:33.748607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:41.159781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737817+0000","last_change":"2024-09-13T15:01:44.436900+0000","last_active":"2024-09-13T15:02:33.737817+0000","last_peered":"2024-09-13T15:02:33.737817+0000","last_clean":"2024-09-13T15:02:33.737817+0000","last_became_active":"2024-09-13T15:01:44.436646+0000","last_became_peered":"2024-09-13T15:01:44.436646+0000","last_unstale":"2024-09-13T15:02:33.737817+0000","last_undegraded":"2024-09-13T15:02:33.737817+0000","last_fullsized":"2024-09-13T15:02:33.737817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:52.505856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742710+0000","last_change":"2024-09-13T15:01:44.430115+0000","last_active":"2024-09-13T15:02:33.742710+0000","last_peered":"2024-09-13T15:02:33.742710+0000","last_clean":"2024-09-13T15:02:33.742710+0000","last_became_active":"2024-09-13T15:01:44.429339+0000","last_became_peered":"2024-09-13T15:01:44.429339+0000","last_unstale":"2024-09-13T15:02:33.742710+0000","last_undegraded":"2024-09-13T15:02:33.742710+0000","last_fullsized":"2024-09-13T15:02:33.742710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:47.224125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.742489+0000","last_change":"2024-09-13T15:01:44.822034+0000","last_active":"2024-09-13T15:02:32.742489+0000","last_peered":"2024-09-13T15:02:32.742489+0000","last_clean":"2024-09-13T15:02:32.742489+0000","last_became_active":"2024-09-13T15:01:44.821734+0000","last_became_peered":"2024-09-13T15:01:44.821734+0000","last_unstale":"2024-09-13T15:02:32.742489+0000","last_undegraded":"2024-09-13T15:02:32.742489+0000","last_fullsized":"2024-09-13T15:02:32.742489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:57:44.629046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.743796+0000","last_change":"2024-09-13T15:01:48.858033+0000","last_active":"2024-09-13T15:02:32.743796+0000","last_peered":"2024-09-13T15:02:32.743796+0000","last_clean":"2024-09-13T15:02:32.743796+0000","last_became_active":"2024-09-13T15:01:48.857584+0000","last_became_peered":"2024-09-13T15:01:48.857584+0000","last_unstale":"2024-09-13T15:02:32.743796+0000","last_undegraded":"2024-09-13T15:02:32.743796+0000","last_fullsized":"2024-09-13T15:02:32.743796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:04.797167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738348+0000","last_change":"2024-09-13T15:01:44.422582+0000","last_active":"2024-09-13T15:02:33.738348+0000","last_peered":"2024-09-13T15:02:33.738348+0000","last_clean":"2024-09-13T15:02:33.738348+0000","last_became_active":"2024-09-13T15:01:44.422367+0000","last_became_peered":"2024-09-13T15:01:44.422367+0000","last_unstale":"2024-09-13T15:02:33.738348+0000","last_undegraded":"2024-09-13T15:02:33.738348+0000","last_fullsized":"2024-09-13T15:02:33.738348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.902724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.742628+0000","last_change":"2024-09-13T15:01:44.820841+0000","last_active":"2024-09-13T15:02:32.742628+0000","last_peered":"2024-09-13T15:02:32.742628+0000","last_clean":"2024-09-13T15:02:32.742628+0000","last_became_active":"2024-09-13T15:01:44.816584+0000","last_became_peered":"2024-09-13T15:01:44.816584+0000","last_unstale":"2024-09-13T15:02:32.742628+0000","last_undegraded":"2024-09-13T15:02:32.742628+0000","last_fullsized":"2024-09-13T15:02:32.742628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:26.763818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.737009+0000","last_change":"2024-09-13T15:01:48.840771+0000","last_active":"2024-09-13T15:02:32.737009+0000","last_peered":"2024-09-13T15:02:32.737009+0000","last_clean":"2024-09-13T15:02:32.737009+0000","last_became_active":"2024-09-13T15:01:48.840397+0000","last_became_peered":"2024-09-13T15:01:48.840397+0000","last_unstale":"2024-09-13T15:02:32.737009+0000","last_undegraded":"2024-09-13T15:02:32.737009+0000","last_fullsized":"2024-09-13T15:02:32.737009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:59.700088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741113+0000","last_change":"2024-09-13T15:01:44.809497+0000","last_active":"2024-09-13T15:02:33.741113+0000","last_peered":"2024-09-13T15:02:33.741113+0000","last_clean":"2024-09-13T15:02:33.741113+0000","last_became_active":"2024-09-13T15:01:44.808669+0000","last_became_peered":"2024-09-13T15:01:44.808669+0000","last_unstale":"2024-09-13T15:02:33.741113+0000","last_undegraded":"2024-09-13T15:02:33.741113+0000","last_fullsized":"2024-09-13T15:02:33.741113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:45.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744117+0000","last_change":"2024-09-13T15:01:44.836353+0000","last_active":"2024-09-13T15:02:33.744117+0000","last_peered":"2024-09-13T15:02:33.744117+0000","last_clean":"2024-09-13T15:02:33.744117+0000","last_became_active":"2024-09-13T15:01:44.836102+0000","last_became_peered":"2024-09-13T15:01:44.836102+0000","last_unstale":"2024-09-13T15:02:33.744117+0000","last_undegraded":"2024-09-13T15:02:33.744117+0000","last_fullsized":"2024-09-13T15:02:33.744117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:14.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741973+0000","last_change":"2024-09-13T15:01:44.849091+0000","last_active":"2024-09-13T15:02:33.741973+0000","last_peered":"2024-09-13T15:02:33.741973+0000","last_clean":"2024-09-13T15:02:33.741973+0000","last_became_active":"2024-09-13T15:01:44.846506+0000","last_became_peered":"2024-09-13T15:01:44.846506+0000","last_unstale":"2024-09-13T15:02:33.741973+0000","last_undegraded":"2024-09-13T15:02:33.741973+0000","last_fullsized":"2024-09-13T15:02:33.741973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:38.026998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743939+0000","last_change":"2024-09-13T15:01:44.809873+0000","last_active":"2024-09-13T15:02:33.743939+0000","last_peered":"2024-09-13T15:02:33.743939+0000","last_clean":"2024-09-13T15:02:33.743939+0000","last_became_active":"2024-09-13T15:01:44.809585+0000","last_became_peered":"2024-09-13T15:01:44.809585+0000","last_unstale":"2024-09-13T15:02:33.743939+0000","last_undegraded":"2024-09-13T15:02:33.743939+0000","last_fullsized":"2024-09-13T15:02:33.743939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:20.272320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738378+0000","last_change":"2024-09-13T15:01:44.816761+0000","last_active":"2024-09-13T15:02:33.738378+0000","last_peered":"2024-09-13T15:02:33.738378+0000","last_clean":"2024-09-13T15:02:33.738378+0000","last_became_active":"2024-09-13T15:01:44.816480+0000","last_became_peered":"2024-09-13T15:01:44.816480+0000","last_unstale":"2024-09-13T15:02:33.738378+0000","last_undegraded":"2024-09-13T15:02:33.738378+0000","last_fullsized":"2024-09-13T15:02:33.738378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:46.000440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742115+0000","last_change":"2024-09-13T15:01:44.808373+0000","last_active":"2024-09-13T15:02:33.742115+0000","last_peered":"2024-09-13T15:02:33.742115+0000","last_clean":"2024-09-13T15:02:33.742115+0000","last_became_active":"2024-09-13T15:01:44.807622+0000","last_became_peered":"2024-09-13T15:01:44.807622+0000","last_unstale":"2024-09-13T15:02:33.742115+0000","last_undegraded":"2024-09-13T15:02:33.742115+0000","last_fullsized":"2024-09-13T15:02:33.742115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:38.584426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745064+0000","last_change":"2024-09-13T15:01:44.832521+0000","last_active":"2024-09-13T15:02:33.745064+0000","last_peered":"2024-09-13T15:02:33.745064+0000","last_clean":"2024-09-13T15:02:33.745064+0000","last_became_active":"2024-09-13T15:01:44.831889+0000","last_became_peered":"2024-09-13T15:01:44.831889+0000","last_unstale":"2024-09-13T15:02:33.745064+0000","last_undegraded":"2024-09-13T15:02:33.745064+0000","last_fullsized":"2024-09-13T15:02:33.745064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:07.563684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738576+0000","last_change":"2024-09-13T15:01:44.817583+0000","last_active":"2024-09-13T15:02:33.738576+0000","last_peered":"2024-09-13T15:02:33.738576+0000","last_clean":"2024-09-13T15:02:33.738576+0000","last_became_active":"2024-09-13T15:01:44.817350+0000","last_became_peered":"2024-09-13T15:01:44.817350+0000","last_unstale":"2024-09-13T15:02:33.738576+0000","last_undegraded":"2024-09-13T15:02:33.738576+0000","last_fullsized":"2024-09-13T15:02:33.738576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:10.913776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740529+0000","last_change":"2024-09-13T15:01:44.838372+0000","last_active":"2024-09-13T15:02:33.740529+0000","last_peered":"2024-09-13T15:02:33.740529+0000","last_clean":"2024-09-13T15:02:33.740529+0000","last_became_active":"2024-09-13T15:01:44.837588+0000","last_became_peered":"2024-09-13T15:01:44.837588+0000","last_unstale":"2024-09-13T15:02:33.740529+0000","last_undegraded":"2024-09-13T15:02:33.740529+0000","last_fullsized":"2024-09-13T15:02:33.740529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:05:12.877936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737718+0000","last_change":"2024-09-13T15:01:44.828159+0000","last_active":"2024-09-13T15:02:33.737718+0000","last_peered":"2024-09-13T15:02:33.737718+0000","last_clean":"2024-09-13T15:02:33.737718+0000","last_became_active":"2024-09-13T15:01:44.827910+0000","last_became_peered":"2024-09-13T15:01:44.827910+0000","last_unstale":"2024-09-13T15:02:33.737718+0000","last_undegraded":"2024-09-13T15:02:33.737718+0000","last_fullsized":"2024-09-13T15:02:33.737718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:07:32.776119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.119204+0000","last_change":"2024-09-13T15:02:34.119204+0000","last_active":"2024-09-13T15:02:34.119204+0000","last_peered":"2024-09-13T15:02:34.119204+0000","last_clean":"2024-09-13T15:02:34.119204+0000","last_became_active":"2024-09-13T15:02:34.118621+0000","last_became_peered":"2024-09-13T15:02:34.118621+0000","last_unstale":"2024-09-13T15:02:34.119204+0000","last_undegraded":"2024-09-13T15:02:34.119204+0000","last_fullsized":"2024-09-13T15:02:34.119204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:33.356064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743857+0000","last_change":"2024-09-13T15:01:44.831717+0000","last_active":"2024-09-13T15:02:33.743857+0000","last_peered":"2024-09-13T15:02:33.743857+0000","last_clean":"2024-09-13T15:02:33.743857+0000","last_became_active":"2024-09-13T15:01:44.831495+0000","last_became_peered":"2024-09-13T15:01:44.831495+0000","last_unstale":"2024-09-13T15:02:33.743857+0000","last_undegraded":"2024-09-13T15:02:33.743857+0000","last_fullsized":"2024-09-13T15:02:33.743857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:48.753543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743869+0000","last_change":"2024-09-13T15:01:44.829698+0000","last_active":"2024-09-13T15:02:33.743869+0000","last_peered":"2024-09-13T15:02:33.743869+0000","last_clean":"2024-09-13T15:02:33.743869+0000","last_became_active":"2024-09-13T15:01:44.828999+0000","last_became_peered":"2024-09-13T15:01:44.828999+0000","last_unstale":"2024-09-13T15:02:33.743869+0000","last_undegraded":"2024-09-13T15:02:33.743869+0000","last_fullsized":"2024-09-13T15:02:33.743869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:30.591718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117647+0000","last_change":"2024-09-13T15:01:44.817554+0000","last_active":"2024-09-13T15:02:34.117647+0000","last_peered":"2024-09-13T15:02:34.117647+0000","last_clean":"2024-09-13T15:02:34.117647+0000","last_became_active":"2024-09-13T15:01:44.816258+0000","last_became_peered":"2024-09-13T15:01:44.816258+0000","last_unstale":"2024-09-13T15:02:34.117647+0000","last_undegraded":"2024-09-13T15:02:34.117647+0000","last_fullsized":"2024-09-13T15:02:34.117647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:07.927802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742322+0000","last_change":"2024-09-13T15:01:44.809979+0000","last_active":"2024-09-13T15:02:33.742322+0000","last_peered":"2024-09-13T15:02:33.742322+0000","last_clean":"2024-09-13T15:02:33.742322+0000","last_became_active":"2024-09-13T15:01:44.809687+0000","last_became_peered":"2024-09-13T15:01:44.809687+0000","last_unstale":"2024-09-13T15:02:33.742322+0000","last_undegraded":"2024-09-13T15:02:33.742322+0000","last_fullsized":"2024-09-13T15:02:33.742322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:45.583840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.119233+0000","last_change":"2024-09-13T15:02:34.119233+0000","last_active":"2024-09-13T15:02:34.119233+0000","last_peered":"2024-09-13T15:02:34.119233+0000","last_clean":"2024-09-13T15:02:34.119233+0000","last_became_active":"2024-09-13T15:02:34.118798+0000","last_became_peered":"2024-09-13T15:02:34.118798+0000","last_unstale":"2024-09-13T15:02:34.119233+0000","last_undegraded":"2024-09-13T15:02:34.119233+0000","last_fullsized":"2024-09-13T15:02:34.119233+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:12.367569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740392+0000","last_change":"2024-09-13T15:01:44.848904+0000","last_active":"2024-09-13T15:02:33.740392+0000","last_peered":"2024-09-13T15:02:33.740392+0000","last_clean":"2024-09-13T15:02:33.740392+0000","last_became_active":"2024-09-13T15:01:44.846074+0000","last_became_peered":"2024-09-13T15:01:44.846074+0000","last_unstale":"2024-09-13T15:02:33.740392+0000","last_undegraded":"2024-09-13T15:02:33.740392+0000","last_fullsized":"2024-09-13T15:02:33.740392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:37.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741904+0000","last_change":"2024-09-13T15:01:44.828243+0000","last_active":"2024-09-13T15:02:33.741904+0000","last_peered":"2024-09-13T15:02:33.741904+0000","last_clean":"2024-09-13T15:02:33.741904+0000","last_became_active":"2024-09-13T15:01:44.828024+0000","last_became_peered":"2024-09-13T15:01:44.828024+0000","last_unstale":"2024-09-13T15:02:33.741904+0000","last_undegraded":"2024-09-13T15:02:33.741904+0000","last_fullsized":"2024-09-13T15:02:33.741904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:28:47.388087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743573+0000","last_change":"2024-09-13T15:01:44.808879+0000","last_active":"2024-09-13T15:02:33.743573+0000","last_peered":"2024-09-13T15:02:33.743573+0000","last_clean":"2024-09-13T15:02:33.743573+0000","last_became_active":"2024-09-13T15:01:44.808609+0000","last_became_peered":"2024-09-13T15:01:44.808609+0000","last_unstale":"2024-09-13T15:02:33.743573+0000","last_undegraded":"2024-09-13T15:02:33.743573+0000","last_fullsized":"2024-09-13T15:02:33.743573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:59.817452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738213+0000","last_change":"2024-09-13T15:01:44.811171+0000","last_active":"2024-09-13T15:02:33.738213+0000","last_peered":"2024-09-13T15:02:33.738213+0000","last_clean":"2024-09-13T15:02:33.738213+0000","last_became_active":"2024-09-13T15:01:44.809918+0000","last_became_peered":"2024-09-13T15:01:44.809918+0000","last_unstale":"2024-09-13T15:02:33.738213+0000","last_undegraded":"2024-09-13T15:02:33.738213+0000","last_fullsized":"2024-09-13T15:02:33.738213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:48.359429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749385+0000","last_change":"2024-09-13T15:01:44.833663+0000","last_active":"2024-09-13T15:02:33.749385+0000","last_peered":"2024-09-13T15:02:33.749385+0000","last_clean":"2024-09-13T15:02:33.749385+0000","last_became_active":"2024-09-13T15:01:44.828737+0000","last_became_peered":"2024-09-13T15:01:44.828737+0000","last_unstale":"2024-09-13T15:02:33.749385+0000","last_undegraded":"2024-09-13T15:02:33.749385+0000","last_fullsized":"2024-09-13T15:02:33.749385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:08.579890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744005+0000","last_change":"2024-09-13T15:01:44.851143+0000","last_active":"2024-09-13T15:02:33.744005+0000","last_peered":"2024-09-13T15:02:33.744005+0000","last_clean":"2024-09-13T15:02:33.744005+0000","last_became_active":"2024-09-13T15:01:44.850410+0000","last_became_peered":"2024-09-13T15:01:44.850410+0000","last_unstale":"2024-09-13T15:02:33.744005+0000","last_undegraded":"2024-09-13T15:02:33.744005+0000","last_fullsized":"2024-09-13T15:02:33.744005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:11.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744851+0000","last_change":"2024-09-13T15:01:44.840082+0000","last_active":"2024-09-13T15:02:33.744851+0000","last_peered":"2024-09-13T15:02:33.744851+0000","last_clean":"2024-09-13T15:02:33.744851+0000","last_became_active":"2024-09-13T15:01:44.839371+0000","last_became_peered":"2024-09-13T15:01:44.839371+0000","last_unstale":"2024-09-13T15:02:33.744851+0000","last_undegraded":"2024-09-13T15:02:33.744851+0000","last_fullsized":"2024-09-13T15:02:33.744851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:13.433036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118361+0000","last_change":"2024-09-13T15:01:44.850416+0000","last_active":"2024-09-13T15:02:34.118361+0000","last_peered":"2024-09-13T15:02:34.118361+0000","last_clean":"2024-09-13T15:02:34.118361+0000","last_became_active":"2024-09-13T15:01:44.849766+0000","last_became_peered":"2024-09-13T15:01:44.849766+0000","last_unstale":"2024-09-13T15:02:34.118361+0000","last_undegraded":"2024-09-13T15:02:34.118361+0000","last_fullsized":"2024-09-13T15:02:34.118361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:11.985610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.736396+0000","last_change":"2024-09-13T15:01:44.837060+0000","last_active":"2024-09-13T15:02:32.736396+0000","last_peered":"2024-09-13T15:02:32.736396+0000","last_clean":"2024-09-13T15:02:32.736396+0000","last_became_active":"2024-09-13T15:01:44.836770+0000","last_became_peered":"2024-09-13T15:01:44.836770+0000","last_unstale":"2024-09-13T15:02:32.736396+0000","last_undegraded":"2024-09-13T15:02:32.736396+0000","last_fullsized":"2024-09-13T15:02:32.736396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:45.915852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.748907+0000","last_change":"2024-09-13T15:01:44.815867+0000","last_active":"2024-09-13T15:02:32.748907+0000","last_peered":"2024-09-13T15:02:32.748907+0000","last_clean":"2024-09-13T15:02:32.748907+0000","last_became_active":"2024-09-13T15:01:44.815116+0000","last_became_peered":"2024-09-13T15:01:44.815116+0000","last_unstale":"2024-09-13T15:02:32.748907+0000","last_undegraded":"2024-09-13T15:02:32.748907+0000","last_fullsized":"2024-09-13T15:02:32.748907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:02.814724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.753660+0000","last_change":"2024-09-13T15:01:44.850022+0000","last_active":"2024-09-13T15:02:32.753660+0000","last_peered":"2024-09-13T15:02:32.753660+0000","last_clean":"2024-09-13T15:02:32.753660+0000","last_became_active":"2024-09-13T15:01:44.849533+0000","last_became_peered":"2024-09-13T15:01:44.849533+0000","last_unstale":"2024-09-13T15:02:32.753660+0000","last_undegraded":"2024-09-13T15:02:32.753660+0000","last_fullsized":"2024-09-13T15:02:32.753660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:09.837692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.751363+0000","last_change":"2024-09-13T15:01:44.817139+0000","last_active":"2024-09-13T15:02:32.751363+0000","last_peered":"2024-09-13T15:02:32.751363+0000","last_clean":"2024-09-13T15:02:32.751363+0000","last_became_active":"2024-09-13T15:01:44.816416+0000","last_became_peered":"2024-09-13T15:01:44.816416+0000","last_unstale":"2024-09-13T15:02:32.751363+0000","last_undegraded":"2024-09-13T15:02:32.751363+0000","last_fullsized":"2024-09-13T15:02:32.751363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:38.382210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749061+0000","last_change":"2024-09-13T15:02:33.747735+0000","last_active":"2024-09-13T15:02:33.749061+0000","last_peered":"2024-09-13T15:02:33.749061+0000","last_clean":"2024-09-13T15:02:33.749061+0000","last_became_active":"2024-09-13T15:02:33.747405+0000","last_became_peered":"2024-09-13T15:02:33.747405+0000","last_unstale":"2024-09-13T15:02:33.749061+0000","last_undegraded":"2024-09-13T15:02:33.749061+0000","last_fullsized":"2024-09-13T15:02:33.749061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:20.616184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742170+0000","last_change":"2024-09-13T15:01:44.808264+0000","last_active":"2024-09-13T15:02:33.742170+0000","last_peered":"2024-09-13T15:02:33.742170+0000","last_clean":"2024-09-13T15:02:33.742170+0000","last_became_active":"2024-09-13T15:01:44.807776+0000","last_became_peered":"2024-09-13T15:01:44.807776+0000","last_unstale":"2024-09-13T15:02:33.742170+0000","last_undegraded":"2024-09-13T15:02:33.742170+0000","last_fullsized":"2024-09-13T15:02:33.742170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:17.637800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742252+0000","last_change":"2024-09-13T15:01:44.804985+0000","last_active":"2024-09-13T15:02:33.742252+0000","last_peered":"2024-09-13T15:02:33.742252+0000","last_clean":"2024-09-13T15:02:33.742252+0000","last_became_active":"2024-09-13T15:01:44.803977+0000","last_became_peered":"2024-09-13T15:01:44.803977+0000","last_unstale":"2024-09-13T15:02:33.742252+0000","last_undegraded":"2024-09-13T15:02:33.742252+0000","last_fullsized":"2024-09-13T15:02:33.742252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:12.999738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118211+0000","last_change":"2024-09-13T15:01:44.824666+0000","last_active":"2024-09-13T15:02:34.118211+0000","last_peered":"2024-09-13T15:02:34.118211+0000","last_clean":"2024-09-13T15:02:34.118211+0000","last_became_active":"2024-09-13T15:01:44.815381+0000","last_became_peered":"2024-09-13T15:01:44.815381+0000","last_unstale":"2024-09-13T15:02:34.118211+0000","last_undegraded":"2024-09-13T15:02:34.118211+0000","last_fullsized":"2024-09-13T15:02:34.118211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:12:17.680247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542177,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":707986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.94599999999999995,"15min":0.94099999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4079999999999999,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.755},{"interface":"front","average":{"1min":0.878,"5min":0.877,"15min":0.877},"min":{"1min":0.57999999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.78900000000000003}]},{"osd":1,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.873,"15min":0.877},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.147,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.028,"15min":1.036},"min":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0009999999999999,"15min":1.0089999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.4570000000000001,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.98699999999999999,"15min":0.995},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.321,"5min":1.452,"15min":1.452},"last":0.90500000000000003}]},{"osd":3,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.92200000000000004,"15min":0.93000000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.1220000000000001,"5min":1.232,"15min":1.232},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.1020000000000001,"15min":1.1140000000000001},"min":{"1min":0.79000000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.496,"5min":1.7,"15min":1.7},"last":0.875}]},{"osd":4,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3700000000000001,"5min":1.643,"15min":1.643},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.03,"15min":1.046},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.137,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.94499999999999995}]},{"osd":5,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.153,"15min":1.165},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.579,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.1040000000000001,"15min":1.1060000000000001},"min":{"1min":0.86799999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.4359999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.0509999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.179,"15min":1.1890000000000001},"min":{"1min":0.81299999999999994,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4970000000000001,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.1399999999999999,"15min":1.157},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.266,"5min":1.641,"15min":1.641},"last":1.0309999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542178,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":120831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.84399999999999997,"15min":0.83799999999999997},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1200000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.89200000000000002,"15min":0.90600000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.099,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.80700000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.85599999999999998,"15min":0.85399999999999998},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90400000000000003,"15min":0.90300000000000002},"min":{"1min":0.63200000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1499999999999999,"5min":1.167,"15min":1.167},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.85699999999999998,"15min":0.86299999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.097,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89300000000000002,"15min":0.88600000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91500000000000004,"15min":0.91600000000000004},"min":{"1min":0.74399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1339999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.749},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95299999999999996,"15min":0.95499999999999996},"min":{"1min":0.77600000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.175,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.90700000000000003}]},{"osd":4,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.93600000000000005,"15min":0.94099999999999995},"min":{"1min":0.68700000000000006,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1220000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.997,"15min":1.0069999999999999},"min":{"1min":0.70299999999999996,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.093}]},{"osd":5,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.95799999999999996,"15min":0.96299999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.014},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.038,"15min":1.048},"min":{"1min":0.67100000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.123}]},{"osd":7,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.024,"15min":1.032},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.167,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.1000000000000001,"15min":1.111},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.2949999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.94399999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542177,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":117126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.86899999999999999,"15min":0.872},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.86899999999999999,"15min":0.86299999999999999},"min":{"1min":0.71599999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.282,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.93700000000000006,"15min":0.94499999999999995},"min":{"1min":0.63700000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3839999999999999,"5min":1.401,"15min":1.401},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.89200000000000002,"15min":0.89600000000000002},"min":{"1min":0.65700000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93500000000000005,"15min":0.94499999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95099999999999996,"15min":0.94899999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.81000000000000005}]},{"osd":3,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.94499999999999995,"15min":0.94799999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.2849999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97199999999999998,"15min":0.97099999999999997},"min":{"1min":0.72699999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.97699999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.85299999999999998,"15min":0.85599999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2330000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.0600000000000001,"15min":1.079},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.2669999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.78300000000000003}]},{"osd":6,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.028,"15min":1.044},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.202,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.004,"5min":1.083,"15min":1.0960000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.496,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.0489999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.085,"15min":1.087},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.145,"15min":1.153},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.5609999999999999,"5min":1.988,"15min":1.988},"last":1.1200000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542177,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":117162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.90000000000000002,"15min":0.90600000000000003},"min":{"1min":0.60399999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.071,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.83099999999999996,"15min":0.82699999999999996},"min":{"1min":0.63200000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.139,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.752}]},{"osd":1,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.92200000000000004,"15min":0.92600000000000005},"min":{"1min":0.68200000000000005,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.131,"5min":1.224,"15min":1.224},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.871,"15min":0.87},"min":{"1min":0.623,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.157,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.93700000000000006,"15min":0.94299999999999995},"min":{"1min":0.70299999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.0780000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.95799999999999996,"15min":0.96199999999999997},"min":{"1min":0.67500000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1240000000000001,"5min":1.669,"15min":1.669},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90200000000000002,"15min":0.90600000000000003},"min":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.099,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.0069999999999999,"15min":1.0189999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.2230000000000001,"5min":1.881,"15min":1.881},"last":0.85999999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":1.0169999999999999,"15min":1.05},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.028,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.96999999999999997,"15min":0.98499999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.1819999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.82799999999999996}]},{"osd":6,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.0109999999999999,"15min":1.0269999999999999},"min":{"1min":0.64000000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.107,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.083,"15min":1.0960000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.367,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.155}]},{"osd":7,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.046,"15min":1.054},"min":{"1min":0.751,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.2569999999999999,"5min":1.623,"15min":1.623},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.2090000000000001,"15min":1.2210000000000001},"min":{"1min":0.96099999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3180000000000001,"5min":1.996,"15min":1.996},"last":1.234}]}]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":299008,"data_stored":120831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.501,"15min":0.501},"min":{"1min":0.371,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64900000000000002,"5min":0.747,"15min":0.747},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.66300000000000003,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.374,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.71499999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.76600000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.443},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81200000000000006,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.61399999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97599999999999998,"5min":1.179,"15min":1.179},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85999999999999999,"15min":0.86399999999999999},"min":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.034,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.83199999999999996}]},{"osd":5,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.873,"15min":0.876},"min":{"1min":0.68500000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0740000000000001,"5min":1.284,"15min":1.284},"last":0.75},{"interface":"front","average":{"1min":0.87,"5min":0.93300000000000005,"15min":0.94299999999999995},"min":{"1min":0.70599999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.212,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.88600000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.89400000000000002,"15min":0.90700000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0269999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.94099999999999995,"15min":0.95099999999999996},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.1539999999999999,"5min":1.21,"15min":1.21},"last":0.86799999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.95299999999999996,"15min":0.96899999999999997},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.1499999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.96399999999999997,"15min":0.98799999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0640000000000001,"5min":1.228,"15min":1.228},"last":0.77900000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":117036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48599999999999999,"15min":0.48799999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.33700000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76600000000000001,"5min":1.157,"15min":1.157},"last":0.45900000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.41599999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.71199999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59199999999999997}]},{"osd":3,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.44700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73899999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.48599999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.499}]},{"osd":4,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.96699999999999997,"15min":0.98099999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.1899999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.94799999999999995,"15min":0.96299999999999997},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.123,"5min":1.675,"15min":1.675},"last":0.752}]},{"osd":5,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.92300000000000004,"15min":0.93000000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.0920000000000001,"5min":1.296,"15min":1.296},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.877,"15min":0.88700000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.77600000000000002}]},{"osd":6,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.88,"15min":0.88400000000000001},"min":{"1min":0.69599999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.93500000000000005,"15min":0.94199999999999995},"min":{"1min":0.748,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.1859999999999999,"5min":1.373,"15min":1.373},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.82099999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.98699999999999999,"15min":0.995},"min":{"1min":0.78800000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2010000000000001,"5min":1.353,"15min":1.353},"last":0.54400000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":117196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.32500000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.57699999999999996,"5min":0.871,"15min":0.871},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69799999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.62}]},{"osd":2,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.37,"15min":0.37},"max":{"1min":0.64600000000000002,"5min":1.071,"15min":1.071},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68700000000000006,"5min":1.107,"15min":1.107},"last":0.436}]},{"osd":3,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.84799999999999998,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.61599999999999999,"15min":0.63},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68899999999999995,"5min":1.323,"15min":1.323},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.90600000000000003,"15min":0.91800000000000004},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.0169999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.88400000000000001,"15min":0.89300000000000002},"min":{"1min":0.68799999999999994,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1830000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.879,"15min":0.89000000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0289999999999999,"5min":1.228,"15min":1.228},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.91300000000000003,"15min":0.93100000000000005},"min":{"1min":0.70699999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.96899999999999997,"5min":1.365,"15min":1.365},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.90400000000000003,"15min":0.91400000000000003},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":0.999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.751},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.94499999999999995,"15min":0.96499999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":0.98199999999999998,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.70299999999999996}]},{"osd":7,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.94799999999999995,"15min":0.96699999999999997},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":0.95499999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.93500000000000005,"15min":0.94899999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2170000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.88900000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542177,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":892928,"data_stored":708042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.66800000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.58699999999999997,"15min":0.60199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68899999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.46200000000000002}]},{"osd":2,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.623,"15min":0.64100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.64400000000000002,"5min":1.669,"15min":1.669},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.498}]},{"osd":3,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56299999999999994,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69399999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.72499999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88900000000000001},"min":{"1min":0.67100000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.0980000000000001,"5min":1.274,"15min":1.274},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.90400000000000003,"15min":0.91200000000000003},"min":{"1min":0.67500000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0580000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.71899999999999997}]},{"osd":5,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.88300000000000001,"15min":0.88900000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.026,"5min":1.165,"15min":1.165},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.95199999999999996,"15min":0.96699999999999997},"min":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.0940000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.91200000000000003,"15min":0.92500000000000004},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":0.93899999999999995},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.745},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.93200000000000005,"15min":0.94599999999999995},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.038,"5min":1.141,"15min":1.141},"last":0.85699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:04:15.962 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:04:16.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.137+0000 7f8fab200640 1 Processor -- start 2024-09-13T15:04:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.137+0000 7f8fab200640 1 -- start start 2024-09-13T15:04:16.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.141+0000 7f8fab200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fa40c9c40 0x7f8fa40662d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:16.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.141+0000 7f8fab200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8fa40ca020 0x7f8fa40c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:16.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.141+0000 7f8fab200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa4159400 con 0x7f8fa40c6ff0 2024-09-13T15:04:16.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.141+0000 7f8fab200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa41596e0 con 0x7f8fa40ca020 2024-09-13T15:04:16.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.141+0000 7f8fab200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa41599c0 con 0x7f8fa40c9c40 2024-09-13T15:04:16.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.141+0000 7f8fa9200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8fa40c6ff0 0x7f8fa4152b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50778/0 (socket says 172.21.15.7:50778) 2024-09-13T15:04:16.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.141+0000 7f8fa9200640 1 -- 172.21.15.7:0/1702549790 learned_addr learned my addr 172.21.15.7:0/1702549790 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:16.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.141+0000 7f8fa3e00640 1 --2- 172.21.15.7:0/1702549790 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fa40c9c40 0x7f8fa40662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:16.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.141+0000 7f8f9b400640 1 --2- 172.21.15.7:0/1702549790 >> v2:172.21.15.77:3300/0 conn(0x7f8fa40ca020 0x7f8fa40c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:16.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.141+0000 7f8fa3400640 1 -- 172.21.15.7:0/1702549790 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386838608 0 0) 0x7f8fa4159400 con 0x7f8fa40c6ff0 2024-09-13T15:04:16.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.141+0000 7f8fa3400640 1 -- 172.21.15.7:0/1702549790 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f88003530 con 0x7f8fa40c6ff0 2024-09-13T15:04:16.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.141+0000 7f8fa3e00640 1 -- 172.21.15.7:0/1702549790 >> v2:172.21.15.77:3300/0 conn(0x7f8fa40ca020 msgr2=0x7f8fa40c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:16.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.141+0000 7f8fa3e00640 1 --2- 172.21.15.7:0/1702549790 >> v2:172.21.15.77:3300/0 conn(0x7f8fa40ca020 0x7f8fa40c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.141+0000 7f8fa3e00640 1 -- 172.21.15.7:0/1702549790 >> v1:172.21.15.7:6789/0 conn(0x7f8fa40c6ff0 legacy=0x7f8fa4152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:16.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.141+0000 7f8fa3e00640 1 -- 172.21.15.7:0/1702549790 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa4159ca0 con 0x7f8fa40c9c40 2024-09-13T15:04:16.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.141+0000 7f8f9b400640 1 --2- 172.21.15.7:0/1702549790 >> v2:172.21.15.77:3300/0 conn(0x7f8fa40ca020 0x7f8fa40c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:16.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fa3e00640 1 --2- 172.21.15.7:0/1702549790 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fa40c9c40 0x7f8fa40662d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8f940097c0 tx=0x7f8f9401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca2a265981d2423b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fa3400640 1 -- 172.21.15.7:0/1702549790 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f940a8990 con 0x7f8fa40c9c40 2024-09-13T15:04:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fa3400640 1 -- 172.21.15.7:0/1702549790 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f940a8af0 con 0x7f8fa40c9c40 2024-09-13T15:04:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fa3400640 1 -- 172.21.15.7:0/1702549790 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f940a8e80 con 0x7f8fa40c9c40 2024-09-13T15:04:16.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fab200640 1 -- 172.21.15.7:0/1702549790 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fa40c9c40 msgr2=0x7f8fa40662d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:16.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fab200640 1 --2- 172.21.15.7:0/1702549790 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fa40c9c40 0x7f8fa40662d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8f940097c0 tx=0x7f8f9401ec90 comp rx=0 tx=0).stop 2024-09-13T15:04:16.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fab200640 1 -- 172.21.15.7:0/1702549790 shutdown_connections 2024-09-13T15:04:16.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fab200640 1 --2- 172.21.15.7:0/1702549790 >> v2:172.21.15.77:3300/0 conn(0x7f8fa40ca020 0x7f8fa40c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fab200640 1 --2- 172.21.15.7:0/1702549790 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fa40c9c40 0x7f8fa40662d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fab200640 1 -- 172.21.15.7:0/1702549790 >> 172.21.15.7:0/1702549790 conn(0x7f8fa406e1f0 msgr2=0x7f8fa406e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:16.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fab200640 1 -- 172.21.15.7:0/1702549790 shutdown_connections 2024-09-13T15:04:16.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fab200640 1 -- 172.21.15.7:0/1702549790 wait complete. 2024-09-13T15:04:16.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fab200640 1 Processor -- start 2024-09-13T15:04:16.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fab200640 1 -- start start 2024-09-13T15:04:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fab200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa40c6ff0 0x7f8fa40ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fab200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fa40c9c40 0x7f8fa40c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fab200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fa40ca020 0x7f8fa4147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fab200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa414c420 con 0x7f8fa40c9c40 2024-09-13T15:04:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fab200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa41f20b0 con 0x7f8fa40c6ff0 2024-09-13T15:04:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.145+0000 7f8fab200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa414c140 con 0x7f8fa40ca020 2024-09-13T15:04:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8f9b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fa40c9c40 0x7f8fa40c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8f9b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fa40c9c40 0x7f8fa40c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33808/0 (socket says 172.21.15.7:33808) 2024-09-13T15:04:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8f9b400640 1 -- 172.21.15.7:0/626971439 learned_addr learned my addr 172.21.15.7:0/626971439 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8fa3e00640 1 --2- 172.21.15.7:0/626971439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa40c6ff0 0x7f8fa40ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8fa9200640 1 --2- 172.21.15.7:0/626971439 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fa40ca020 0x7f8fa4147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8f9b400640 1 -- 172.21.15.7:0/626971439 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fa40ca020 msgr2=0x7f8fa4147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8f9b400640 1 --2- 172.21.15.7:0/626971439 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fa40ca020 0x7f8fa4147920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8f9b400640 1 -- 172.21.15.7:0/626971439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa40c6ff0 msgr2=0x7f8fa40ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8f9b400640 1 --2- 172.21.15.7:0/626971439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa40c6ff0 0x7f8fa40ca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8f9b400640 1 -- 172.21.15.7:0/626971439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8c009a70 con 0x7f8fa40c9c40 2024-09-13T15:04:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8f9b400640 1 --2- 172.21.15.7:0/626971439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fa40c9c40 0x7f8fa40c6530 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00efc0 tx=0x7f8f8c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8fa0c00640 1 -- 172.21.15.7:0/626971439 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c014680 con 0x7f8fa40c9c40 2024-09-13T15:04:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8fa0c00640 1 -- 172.21.15.7:0/626971439 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c00f040 con 0x7f8fa40c9c40 2024-09-13T15:04:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8fab200640 1 -- 172.21.15.7:0/626971439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f94009420 con 0x7f8fa40c9c40 2024-09-13T15:04:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8fa0c00640 1 -- 172.21.15.7:0/626971439 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c014a00 con 0x7f8fa40c9c40 2024-09-13T15:04:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8fab200640 1 -- 172.21.15.7:0/626971439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa41f1d40 con 0x7f8fa40c9c40 2024-09-13T15:04:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8fab200640 1 -- 172.21.15.7:0/626971439 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa4067650 con 0x7f8fa40c9c40 2024-09-13T15:04:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8fa0c00640 1 -- 172.21.15.7:0/626971439 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8f8c014b60 con 0x7f8fa40c9c40 2024-09-13T15:04:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8fa0c00640 1 --2- 172.21.15.7:0/626971439 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8f80066690 0x7f8f80068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.149+0000 7f8fa0c00640 1 -- 172.21.15.7:0/626971439 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8f8c0853e0 con 0x7f8fa40c9c40 2024-09-13T15:04:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.153+0000 7f8fa3e00640 1 --2- 172.21.15.7:0/626971439 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8f80066690 0x7f8f80068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.153+0000 7f8fa3e00640 1 --2- 172.21.15.7:0/626971439 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8f80066690 0x7f8f80068b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8f940b2000 tx=0x7f8f94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:16.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.157+0000 7f8fa0c00640 1 -- 172.21.15.7:0/626971439 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8f8c052430 con 0x7f8fa40c9c40 2024-09-13T15:04:16.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.313+0000 7f8fab200640 1 -- 172.21.15.7:0/626971439 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8fa4066810 con 0x7f8f80066690 2024-09-13T15:04:16.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.341+0000 7f8fa0c00640 1 -- 172.21.15.7:0/626971439 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368694 (secure 0 0 0) 0x7f8f940b0440 con 0x7f8f80066690 2024-09-13T15:04:16.350 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T15:04:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.345+0000 7f8fab200640 1 -- 172.21.15.7:0/626971439 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8f80066690 msgr2=0x7f8f80068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.345+0000 7f8fab200640 1 --2- 172.21.15.7:0/626971439 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8f80066690 0x7f8f80068b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8f940b2000 tx=0x7f8f94008040 comp rx=0 tx=0).stop 2024-09-13T15:04:16.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.345+0000 7f8fab200640 1 -- 172.21.15.7:0/626971439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fa40c9c40 msgr2=0x7f8fa40c6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.345+0000 7f8fab200640 1 --2- 172.21.15.7:0/626971439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fa40c9c40 0x7f8fa40c6530 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00efc0 tx=0x7f8f8c009f90 comp rx=0 tx=0).stop 2024-09-13T15:04:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.345+0000 7f8fab200640 1 -- 172.21.15.7:0/626971439 shutdown_connections 2024-09-13T15:04:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.345+0000 7f8fab200640 1 --2- 172.21.15.7:0/626971439 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8f80066690 0x7f8f80068b50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.345+0000 7f8fab200640 1 --2- 172.21.15.7:0/626971439 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fa40ca020 0x7f8fa4147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.345+0000 7f8fab200640 1 --2- 172.21.15.7:0/626971439 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fa40c9c40 0x7f8fa40c6530 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.345+0000 7f8fab200640 1 --2- 172.21.15.7:0/626971439 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fa40c6ff0 0x7f8fa40ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.345+0000 7f8fab200640 1 -- 172.21.15.7:0/626971439 >> 172.21.15.7:0/626971439 conn(0x7f8fa406e1f0 msgr2=0x7f8fa4158880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.345+0000 7f8fab200640 1 -- 172.21.15.7:0/626971439 shutdown_connections 2024-09-13T15:04:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.345+0000 7f8fab200640 1 -- 172.21.15.7:0/626971439 wait complete. 2024-09-13T15:04:16.368 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-09-13T15:04:14.683754+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231900,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":754742820,"statfs":{"total":773094113280,"available":772856647680,"internally_reserved":0,"allocated":3547136,"data_stored":2126210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":233819704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004625"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742671+0000","last_change":"2024-09-13T15:01:44.418856+0000","last_active":"2024-09-13T15:02:33.742671+0000","last_peered":"2024-09-13T15:02:33.742671+0000","last_clean":"2024-09-13T15:02:33.742671+0000","last_became_active":"2024-09-13T15:01:44.418641+0000","last_became_peered":"2024-09-13T15:01:44.418641+0000","last_unstale":"2024-09-13T15:02:33.742671+0000","last_undegraded":"2024-09-13T15:02:33.742671+0000","last_fullsized":"2024-09-13T15:02:33.742671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:40.178824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738513+0000","last_change":"2024-09-13T15:01:44.809371+0000","last_active":"2024-09-13T15:02:33.738513+0000","last_peered":"2024-09-13T15:02:33.738513+0000","last_clean":"2024-09-13T15:02:33.738513+0000","last_became_active":"2024-09-13T15:01:44.809091+0000","last_became_peered":"2024-09-13T15:01:44.809091+0000","last_unstale":"2024-09-13T15:02:33.738513+0000","last_undegraded":"2024-09-13T15:02:33.738513+0000","last_fullsized":"2024-09-13T15:02:33.738513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:22.412025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737520+0000","last_change":"2024-09-13T15:01:48.910757+0000","last_active":"2024-09-13T15:02:33.737520+0000","last_peered":"2024-09-13T15:02:33.737520+0000","last_clean":"2024-09-13T15:02:33.737520+0000","last_became_active":"2024-09-13T15:01:48.910262+0000","last_became_peered":"2024-09-13T15:01:48.910262+0000","last_unstale":"2024-09-13T15:02:33.737520+0000","last_undegraded":"2024-09-13T15:02:33.737520+0000","last_fullsized":"2024-09-13T15:02:33.737520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:39.290557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738791+0000","last_change":"2024-09-13T15:01:44.404818+0000","last_active":"2024-09-13T15:02:33.738791+0000","last_peered":"2024-09-13T15:02:33.738791+0000","last_clean":"2024-09-13T15:02:33.738791+0000","last_became_active":"2024-09-13T15:01:44.401666+0000","last_became_peered":"2024-09-13T15:01:44.401666+0000","last_unstale":"2024-09-13T15:02:33.738791+0000","last_undegraded":"2024-09-13T15:02:33.738791+0000","last_fullsized":"2024-09-13T15:02:33.738791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:31.818163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742417+0000","last_change":"2024-09-13T15:01:44.850292+0000","last_active":"2024-09-13T15:02:33.742417+0000","last_peered":"2024-09-13T15:02:33.742417+0000","last_clean":"2024-09-13T15:02:33.742417+0000","last_became_active":"2024-09-13T15:01:44.849825+0000","last_became_peered":"2024-09-13T15:01:44.849825+0000","last_unstale":"2024-09-13T15:02:33.742417+0000","last_undegraded":"2024-09-13T15:02:33.742417+0000","last_fullsized":"2024-09-13T15:02:33.742417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:22.582742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.746607+0000","last_change":"2024-09-13T15:01:48.850426+0000","last_active":"2024-09-13T15:02:33.746607+0000","last_peered":"2024-09-13T15:02:33.746607+0000","last_clean":"2024-09-13T15:02:33.746607+0000","last_became_active":"2024-09-13T15:01:48.848750+0000","last_became_peered":"2024-09-13T15:01:48.848750+0000","last_unstale":"2024-09-13T15:02:33.746607+0000","last_undegraded":"2024-09-13T15:02:33.746607+0000","last_fullsized":"2024-09-13T15:02:33.746607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:55.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117554+0000","last_change":"2024-09-13T15:01:44.437850+0000","last_active":"2024-09-13T15:02:34.117554+0000","last_peered":"2024-09-13T15:02:34.117554+0000","last_clean":"2024-09-13T15:02:34.117554+0000","last_became_active":"2024-09-13T15:01:44.437168+0000","last_became_peered":"2024-09-13T15:01:44.437168+0000","last_unstale":"2024-09-13T15:02:34.117554+0000","last_undegraded":"2024-09-13T15:02:34.117554+0000","last_fullsized":"2024-09-13T15:02:34.117554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:23.540408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.754363+0000","last_change":"2024-09-13T15:01:44.845989+0000","last_active":"2024-09-13T15:02:32.754363+0000","last_peered":"2024-09-13T15:02:32.754363+0000","last_clean":"2024-09-13T15:02:32.754363+0000","last_became_active":"2024-09-13T15:01:44.845395+0000","last_became_peered":"2024-09-13T15:01:44.845395+0000","last_unstale":"2024-09-13T15:02:32.754363+0000","last_undegraded":"2024-09-13T15:02:32.754363+0000","last_fullsized":"2024-09-13T15:02:32.754363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:52.267507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.739791+0000","last_change":"2024-09-13T15:01:48.865388+0000","last_active":"2024-09-13T15:02:32.739791+0000","last_peered":"2024-09-13T15:02:32.739791+0000","last_clean":"2024-09-13T15:02:32.739791+0000","last_became_active":"2024-09-13T15:01:48.864314+0000","last_became_peered":"2024-09-13T15:01:48.864314+0000","last_unstale":"2024-09-13T15:02:32.739791+0000","last_undegraded":"2024-09-13T15:02:32.739791+0000","last_fullsized":"2024-09-13T15:02:32.739791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:18.637430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116848+0000","last_change":"2024-09-13T15:01:44.424080+0000","last_active":"2024-09-13T15:02:34.116848+0000","last_peered":"2024-09-13T15:02:34.116848+0000","last_clean":"2024-09-13T15:02:34.116848+0000","last_became_active":"2024-09-13T15:01:44.423381+0000","last_became_peered":"2024-09-13T15:01:44.423381+0000","last_unstale":"2024-09-13T15:02:34.116848+0000","last_undegraded":"2024-09-13T15:02:34.116848+0000","last_fullsized":"2024-09-13T15:02:34.116848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:38:20.455380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.754463+0000","last_change":"2024-09-13T15:01:44.849670+0000","last_active":"2024-09-13T15:02:32.754463+0000","last_peered":"2024-09-13T15:02:32.754463+0000","last_clean":"2024-09-13T15:02:32.754463+0000","last_became_active":"2024-09-13T15:01:44.849038+0000","last_became_peered":"2024-09-13T15:01:44.849038+0000","last_unstale":"2024-09-13T15:02:32.754463+0000","last_undegraded":"2024-09-13T15:02:32.754463+0000","last_fullsized":"2024-09-13T15:02:32.754463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:45.570774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.742068+0000","last_change":"2024-09-13T15:01:48.854953+0000","last_active":"2024-09-13T15:02:32.742068+0000","last_peered":"2024-09-13T15:02:32.742068+0000","last_clean":"2024-09-13T15:02:32.742068+0000","last_became_active":"2024-09-13T15:01:48.853858+0000","last_became_peered":"2024-09-13T15:01:48.853858+0000","last_unstale":"2024-09-13T15:02:32.742068+0000","last_undegraded":"2024-09-13T15:02:32.742068+0000","last_fullsized":"2024-09-13T15:02:32.742068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:07.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742073+0000","last_change":"2024-09-13T15:01:44.824391+0000","last_active":"2024-09-13T15:02:33.742073+0000","last_peered":"2024-09-13T15:02:33.742073+0000","last_clean":"2024-09-13T15:02:33.742073+0000","last_became_active":"2024-09-13T15:01:44.823690+0000","last_became_peered":"2024-09-13T15:01:44.823690+0000","last_unstale":"2024-09-13T15:02:33.742073+0000","last_undegraded":"2024-09-13T15:02:33.742073+0000","last_fullsized":"2024-09-13T15:02:33.742073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116708+0000","last_change":"2024-09-13T15:01:44.421523+0000","last_active":"2024-09-13T15:02:34.116708+0000","last_peered":"2024-09-13T15:02:34.116708+0000","last_clean":"2024-09-13T15:02:34.116708+0000","last_became_active":"2024-09-13T15:01:44.419965+0000","last_became_peered":"2024-09-13T15:01:44.419965+0000","last_unstale":"2024-09-13T15:02:34.116708+0000","last_undegraded":"2024-09-13T15:02:34.116708+0000","last_fullsized":"2024-09-13T15:02:34.116708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:34.918774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749714+0000","last_change":"2024-09-13T15:01:48.850895+0000","last_active":"2024-09-13T15:02:33.749714+0000","last_peered":"2024-09-13T15:02:33.749714+0000","last_clean":"2024-09-13T15:02:33.749714+0000","last_became_active":"2024-09-13T15:01:48.849856+0000","last_became_peered":"2024-09-13T15:01:48.849856+0000","last_unstale":"2024-09-13T15:02:33.749714+0000","last_undegraded":"2024-09-13T15:02:33.749714+0000","last_fullsized":"2024-09-13T15:02:33.749714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:59.616442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738227+0000","last_change":"2024-09-13T15:01:44.806026+0000","last_active":"2024-09-13T15:02:33.738227+0000","last_peered":"2024-09-13T15:02:33.738227+0000","last_clean":"2024-09-13T15:02:33.738227+0000","last_became_active":"2024-09-13T15:01:44.805767+0000","last_became_peered":"2024-09-13T15:01:44.805767+0000","last_unstale":"2024-09-13T15:02:33.738227+0000","last_undegraded":"2024-09-13T15:02:33.738227+0000","last_fullsized":"2024-09-13T15:02:33.738227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:50.696113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743085+0000","last_change":"2024-09-13T15:01:44.401897+0000","last_active":"2024-09-13T15:02:33.743085+0000","last_peered":"2024-09-13T15:02:33.743085+0000","last_clean":"2024-09-13T15:02:33.743085+0000","last_became_active":"2024-09-13T15:01:44.401559+0000","last_became_peered":"2024-09-13T15:01:44.401559+0000","last_unstale":"2024-09-13T15:02:33.743085+0000","last_undegraded":"2024-09-13T15:02:33.743085+0000","last_fullsized":"2024-09-13T15:02:33.743085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:58.535567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749109+0000","last_change":"2024-09-13T15:01:48.858808+0000","last_active":"2024-09-13T15:02:33.749109+0000","last_peered":"2024-09-13T15:02:33.749109+0000","last_clean":"2024-09-13T15:02:33.749109+0000","last_became_active":"2024-09-13T15:01:48.857802+0000","last_became_peered":"2024-09-13T15:01:48.857802+0000","last_unstale":"2024-09-13T15:02:33.749109+0000","last_undegraded":"2024-09-13T15:02:33.749109+0000","last_fullsized":"2024-09-13T15:02:33.749109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:41.628058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737738+0000","last_change":"2024-09-13T15:01:44.808674+0000","last_active":"2024-09-13T15:02:33.737738+0000","last_peered":"2024-09-13T15:02:33.737738+0000","last_clean":"2024-09-13T15:02:33.737738+0000","last_became_active":"2024-09-13T15:01:44.808420+0000","last_became_peered":"2024-09-13T15:01:44.808420+0000","last_unstale":"2024-09-13T15:02:33.737738+0000","last_undegraded":"2024-09-13T15:02:33.737738+0000","last_fullsized":"2024-09-13T15:02:33.737738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:33.447973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741996+0000","last_change":"2024-09-13T15:01:44.406717+0000","last_active":"2024-09-13T15:02:33.741996+0000","last_peered":"2024-09-13T15:02:33.741996+0000","last_clean":"2024-09-13T15:02:33.741996+0000","last_became_active":"2024-09-13T15:01:44.406354+0000","last_became_peered":"2024-09-13T15:01:44.406354+0000","last_unstale":"2024-09-13T15:02:33.741996+0000","last_undegraded":"2024-09-13T15:02:33.741996+0000","last_fullsized":"2024-09-13T15:02:33.741996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:49.413632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741522+0000","last_change":"2024-09-13T15:01:48.909879+0000","last_active":"2024-09-13T15:02:33.741522+0000","last_peered":"2024-09-13T15:02:33.741522+0000","last_clean":"2024-09-13T15:02:33.741522+0000","last_became_active":"2024-09-13T15:01:48.909494+0000","last_became_peered":"2024-09-13T15:01:48.909494+0000","last_unstale":"2024-09-13T15:02:33.741522+0000","last_undegraded":"2024-09-13T15:02:33.741522+0000","last_fullsized":"2024-09-13T15:02:33.741522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:54.415920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748317+0000","last_change":"2024-09-13T15:01:44.825065+0000","last_active":"2024-09-13T15:02:33.748317+0000","last_peered":"2024-09-13T15:02:33.748317+0000","last_clean":"2024-09-13T15:02:33.748317+0000","last_became_active":"2024-09-13T15:01:44.824392+0000","last_became_peered":"2024-09-13T15:01:44.824392+0000","last_unstale":"2024-09-13T15:02:33.748317+0000","last_undegraded":"2024-09-13T15:02:33.748317+0000","last_fullsized":"2024-09-13T15:02:33.748317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:49.717211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116092+0000","last_change":"2024-09-13T15:01:44.421119+0000","last_active":"2024-09-13T15:02:34.116092+0000","last_peered":"2024-09-13T15:02:34.116092+0000","last_clean":"2024-09-13T15:02:34.116092+0000","last_became_active":"2024-09-13T15:01:44.419082+0000","last_became_peered":"2024-09-13T15:01:44.419082+0000","last_unstale":"2024-09-13T15:02:34.116092+0000","last_undegraded":"2024-09-13T15:02:34.116092+0000","last_fullsized":"2024-09-13T15:02:34.116092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.011350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749456+0000","last_change":"2024-09-13T15:01:48.856387+0000","last_active":"2024-09-13T15:02:33.749456+0000","last_peered":"2024-09-13T15:02:33.749456+0000","last_clean":"2024-09-13T15:02:33.749456+0000","last_became_active":"2024-09-13T15:01:48.855433+0000","last_became_peered":"2024-09-13T15:01:48.855433+0000","last_unstale":"2024-09-13T15:02:33.749456+0000","last_undegraded":"2024-09-13T15:02:33.749456+0000","last_fullsized":"2024-09-13T15:02:33.749456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:58.309929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744608+0000","last_change":"2024-09-13T15:01:44.807909+0000","last_active":"2024-09-13T15:02:33.744608+0000","last_peered":"2024-09-13T15:02:33.744608+0000","last_clean":"2024-09-13T15:02:33.744608+0000","last_became_active":"2024-09-13T15:01:44.807643+0000","last_became_peered":"2024-09-13T15:01:44.807643+0000","last_unstale":"2024-09-13T15:02:33.744608+0000","last_undegraded":"2024-09-13T15:02:33.744608+0000","last_fullsized":"2024-09-13T15:02:33.744608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:30.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"25'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744683+0000","last_change":"2024-09-13T15:01:44.430200+0000","last_active":"2024-09-13T15:02:33.744683+0000","last_peered":"2024-09-13T15:02:33.744683+0000","last_clean":"2024-09-13T15:02:33.744683+0000","last_became_active":"2024-09-13T15:01:44.429510+0000","last_became_peered":"2024-09-13T15:01:44.429510+0000","last_unstale":"2024-09-13T15:02:33.744683+0000","last_undegraded":"2024-09-13T15:02:33.744683+0000","last_fullsized":"2024-09-13T15:02:33.744683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:52.921485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748075+0000","last_change":"2024-09-13T15:01:48.912116+0000","last_active":"2024-09-13T15:02:33.748075+0000","last_peered":"2024-09-13T15:02:33.748075+0000","last_clean":"2024-09-13T15:02:33.748075+0000","last_became_active":"2024-09-13T15:01:48.911578+0000","last_became_peered":"2024-09-13T15:01:48.911578+0000","last_unstale":"2024-09-13T15:02:33.748075+0000","last_undegraded":"2024-09-13T15:02:33.748075+0000","last_fullsized":"2024-09-13T15:02:33.748075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:50.826715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738926+0000","last_change":"2024-09-13T15:01:44.838344+0000","last_active":"2024-09-13T15:02:33.738926+0000","last_peered":"2024-09-13T15:02:33.738926+0000","last_clean":"2024-09-13T15:02:33.738926+0000","last_became_active":"2024-09-13T15:01:44.838128+0000","last_became_peered":"2024-09-13T15:01:44.838128+0000","last_unstale":"2024-09-13T15:02:33.738926+0000","last_undegraded":"2024-09-13T15:02:33.738926+0000","last_fullsized":"2024-09-13T15:02:33.738926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:09:50.373976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742357+0000","last_change":"2024-09-13T15:01:44.430749+0000","last_active":"2024-09-13T15:02:33.742357+0000","last_peered":"2024-09-13T15:02:33.742357+0000","last_clean":"2024-09-13T15:02:33.742357+0000","last_became_active":"2024-09-13T15:01:44.430548+0000","last_became_peered":"2024-09-13T15:01:44.430548+0000","last_unstale":"2024-09-13T15:02:33.742357+0000","last_undegraded":"2024-09-13T15:02:33.742357+0000","last_fullsized":"2024-09-13T15:02:33.742357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:30.312447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737398+0000","last_change":"2024-09-13T15:01:48.911224+0000","last_active":"2024-09-13T15:02:33.737398+0000","last_peered":"2024-09-13T15:02:33.737398+0000","last_clean":"2024-09-13T15:02:33.737398+0000","last_became_active":"2024-09-13T15:01:48.910150+0000","last_became_peered":"2024-09-13T15:01:48.910150+0000","last_unstale":"2024-09-13T15:02:33.737398+0000","last_undegraded":"2024-09-13T15:02:33.737398+0000","last_fullsized":"2024-09-13T15:02:33.737398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:41.244267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743138+0000","last_change":"2024-09-13T15:01:44.812200+0000","last_active":"2024-09-13T15:02:33.743138+0000","last_peered":"2024-09-13T15:02:33.743138+0000","last_clean":"2024-09-13T15:02:33.743138+0000","last_became_active":"2024-09-13T15:01:44.811915+0000","last_became_peered":"2024-09-13T15:01:44.811915+0000","last_unstale":"2024-09-13T15:02:33.743138+0000","last_undegraded":"2024-09-13T15:02:33.743138+0000","last_fullsized":"2024-09-13T15:02:33.743138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:07.944520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117799+0000","last_change":"2024-09-13T15:01:44.423119+0000","last_active":"2024-09-13T15:02:34.117799+0000","last_peered":"2024-09-13T15:02:34.117799+0000","last_clean":"2024-09-13T15:02:34.117799+0000","last_became_active":"2024-09-13T15:01:44.422297+0000","last_became_peered":"2024-09-13T15:01:44.422297+0000","last_unstale":"2024-09-13T15:02:34.117799+0000","last_undegraded":"2024-09-13T15:02:34.117799+0000","last_fullsized":"2024-09-13T15:02:34.117799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:09.798196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743841+0000","last_change":"2024-09-13T15:01:48.908569+0000","last_active":"2024-09-13T15:02:33.743841+0000","last_peered":"2024-09-13T15:02:33.743841+0000","last_clean":"2024-09-13T15:02:33.743841+0000","last_became_active":"2024-09-13T15:01:48.908118+0000","last_became_peered":"2024-09-13T15:01:48.908118+0000","last_unstale":"2024-09-13T15:02:33.743841+0000","last_undegraded":"2024-09-13T15:02:33.743841+0000","last_fullsized":"2024-09-13T15:02:33.743841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:06.459855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743852+0000","last_change":"2024-09-13T15:01:44.850837+0000","last_active":"2024-09-13T15:02:33.743852+0000","last_peered":"2024-09-13T15:02:33.743852+0000","last_clean":"2024-09-13T15:02:33.743852+0000","last_became_active":"2024-09-13T15:01:44.850263+0000","last_became_peered":"2024-09-13T15:01:44.850263+0000","last_unstale":"2024-09-13T15:02:33.743852+0000","last_undegraded":"2024-09-13T15:02:33.743852+0000","last_fullsized":"2024-09-13T15:02:33.743852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:16.956369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743192+0000","last_change":"2024-09-13T15:01:44.399163+0000","last_active":"2024-09-13T15:02:33.743192+0000","last_peered":"2024-09-13T15:02:33.743192+0000","last_clean":"2024-09-13T15:02:33.743192+0000","last_became_active":"2024-09-13T15:01:44.398881+0000","last_became_peered":"2024-09-13T15:01:44.398881+0000","last_unstale":"2024-09-13T15:02:33.743192+0000","last_undegraded":"2024-09-13T15:02:33.743192+0000","last_fullsized":"2024-09-13T15:02:33.743192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:49.622676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743584+0000","last_change":"2024-09-13T15:01:48.852798+0000","last_active":"2024-09-13T15:02:33.743584+0000","last_peered":"2024-09-13T15:02:33.743584+0000","last_clean":"2024-09-13T15:02:33.743584+0000","last_became_active":"2024-09-13T15:01:48.851948+0000","last_became_peered":"2024-09-13T15:01:48.851948+0000","last_unstale":"2024-09-13T15:02:33.743584+0000","last_undegraded":"2024-09-13T15:02:33.743584+0000","last_fullsized":"2024-09-13T15:02:33.743584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:20.061043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749414+0000","last_change":"2024-09-13T15:01:44.824074+0000","last_active":"2024-09-13T15:02:33.749414+0000","last_peered":"2024-09-13T15:02:33.749414+0000","last_clean":"2024-09-13T15:02:33.749414+0000","last_became_active":"2024-09-13T15:01:44.821475+0000","last_became_peered":"2024-09-13T15:01:44.821475+0000","last_unstale":"2024-09-13T15:02:33.749414+0000","last_undegraded":"2024-09-13T15:02:33.749414+0000","last_fullsized":"2024-09-13T15:02:33.749414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:21.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742662+0000","last_change":"2024-09-13T15:01:44.433502+0000","last_active":"2024-09-13T15:02:33.742662+0000","last_peered":"2024-09-13T15:02:33.742662+0000","last_clean":"2024-09-13T15:02:33.742662+0000","last_became_active":"2024-09-13T15:01:44.432902+0000","last_became_peered":"2024-09-13T15:01:44.432902+0000","last_unstale":"2024-09-13T15:02:33.742662+0000","last_undegraded":"2024-09-13T15:02:33.742662+0000","last_fullsized":"2024-09-13T15:02:33.742662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:59.189559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743046+0000","last_change":"2024-09-13T15:01:48.846695+0000","last_active":"2024-09-13T15:02:33.743046+0000","last_peered":"2024-09-13T15:02:33.743046+0000","last_clean":"2024-09-13T15:02:33.743046+0000","last_became_active":"2024-09-13T15:01:48.846301+0000","last_became_peered":"2024-09-13T15:01:48.846301+0000","last_unstale":"2024-09-13T15:02:33.743046+0000","last_undegraded":"2024-09-13T15:02:33.743046+0000","last_fullsized":"2024-09-13T15:02:33.743046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:17.532499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741535+0000","last_change":"2024-09-13T15:01:44.814483+0000","last_active":"2024-09-13T15:02:33.741535+0000","last_peered":"2024-09-13T15:02:33.741535+0000","last_clean":"2024-09-13T15:02:33.741535+0000","last_became_active":"2024-09-13T15:01:44.814192+0000","last_became_peered":"2024-09-13T15:01:44.814192+0000","last_unstale":"2024-09-13T15:02:33.741535+0000","last_undegraded":"2024-09-13T15:02:33.741535+0000","last_fullsized":"2024-09-13T15:02:33.741535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:32:30.303635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741224+0000","last_change":"2024-09-13T15:01:44.399314+0000","last_active":"2024-09-13T15:02:33.741224+0000","last_peered":"2024-09-13T15:02:33.741224+0000","last_clean":"2024-09-13T15:02:33.741224+0000","last_became_active":"2024-09-13T15:01:44.398904+0000","last_became_peered":"2024-09-13T15:01:44.398904+0000","last_unstale":"2024-09-13T15:02:33.741224+0000","last_undegraded":"2024-09-13T15:02:33.741224+0000","last_fullsized":"2024-09-13T15:02:33.741224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.645179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741624+0000","last_change":"2024-09-13T15:01:48.859142+0000","last_active":"2024-09-13T15:02:33.741624+0000","last_peered":"2024-09-13T15:02:33.741624+0000","last_clean":"2024-09-13T15:02:33.741624+0000","last_became_active":"2024-09-13T15:01:48.858649+0000","last_became_peered":"2024-09-13T15:01:48.858649+0000","last_unstale":"2024-09-13T15:02:33.741624+0000","last_undegraded":"2024-09-13T15:02:33.741624+0000","last_fullsized":"2024-09-13T15:02:33.741624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:27.314012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743419+0000","last_change":"2024-09-13T15:01:44.826501+0000","last_active":"2024-09-13T15:02:33.743419+0000","last_peered":"2024-09-13T15:02:33.743419+0000","last_clean":"2024-09-13T15:02:33.743419+0000","last_became_active":"2024-09-13T15:01:44.826222+0000","last_became_peered":"2024-09-13T15:01:44.826222+0000","last_unstale":"2024-09-13T15:02:33.743419+0000","last_undegraded":"2024-09-13T15:02:33.743419+0000","last_fullsized":"2024-09-13T15:02:33.743419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:00.543916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116096+0000","last_change":"2024-09-13T15:01:44.421891+0000","last_active":"2024-09-13T15:02:34.116096+0000","last_peered":"2024-09-13T15:02:34.116096+0000","last_clean":"2024-09-13T15:02:34.116096+0000","last_became_active":"2024-09-13T15:01:44.419660+0000","last_became_peered":"2024-09-13T15:01:44.419660+0000","last_unstale":"2024-09-13T15:02:34.116096+0000","last_undegraded":"2024-09-13T15:02:34.116096+0000","last_fullsized":"2024-09-13T15:02:34.116096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:27.554128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.120816+0000","last_change":"2024-09-13T15:02:34.119111+0000","last_active":"2024-09-13T15:02:34.120816+0000","last_peered":"2024-09-13T15:02:34.120816+0000","last_clean":"2024-09-13T15:02:34.120816+0000","last_became_active":"2024-09-13T15:02:34.118461+0000","last_became_peered":"2024-09-13T15:02:34.118461+0000","last_unstale":"2024-09-13T15:02:34.120816+0000","last_undegraded":"2024-09-13T15:02:34.120816+0000","last_fullsized":"2024-09-13T15:02:34.120816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:35.096846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738701+0000","last_change":"2024-09-13T15:01:44.850498+0000","last_active":"2024-09-13T15:02:33.738701+0000","last_peered":"2024-09-13T15:02:33.738701+0000","last_clean":"2024-09-13T15:02:33.738701+0000","last_became_active":"2024-09-13T15:01:44.850234+0000","last_became_peered":"2024-09-13T15:01:44.850234+0000","last_unstale":"2024-09-13T15:02:33.738701+0000","last_undegraded":"2024-09-13T15:02:33.738701+0000","last_fullsized":"2024-09-13T15:02:33.738701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:37.202494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743323+0000","last_change":"2024-09-13T15:01:44.411997+0000","last_active":"2024-09-13T15:02:33.743323+0000","last_peered":"2024-09-13T15:02:33.743323+0000","last_clean":"2024-09-13T15:02:33.743323+0000","last_became_active":"2024-09-13T15:01:44.410675+0000","last_became_peered":"2024-09-13T15:01:44.410675+0000","last_unstale":"2024-09-13T15:02:33.743323+0000","last_undegraded":"2024-09-13T15:02:33.743323+0000","last_fullsized":"2024-09-13T15:02:33.743323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:50:55.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116345+0000","last_change":"2024-09-13T15:01:40.834440+0000","last_active":"2024-09-13T15:02:34.116345+0000","last_peered":"2024-09-13T15:02:34.116345+0000","last_clean":"2024-09-13T15:02:34.116345+0000","last_became_active":"2024-09-13T15:01:40.832279+0000","last_became_peered":"2024-09-13T15:01:40.832279+0000","last_unstale":"2024-09-13T15:02:34.116345+0000","last_undegraded":"2024-09-13T15:02:34.116345+0000","last_fullsized":"2024-09-13T15:02:34.116345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_clean_scrub_stamp":"2024-09-13T15:01:39.264455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:11.875506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743545+0000","last_change":"2024-09-13T15:01:48.919580+0000","last_active":"2024-09-13T15:02:33.743545+0000","last_peered":"2024-09-13T15:02:33.743545+0000","last_clean":"2024-09-13T15:02:33.743545+0000","last_became_active":"2024-09-13T15:01:48.918678+0000","last_became_peered":"2024-09-13T15:01:48.918678+0000","last_unstale":"2024-09-13T15:02:33.743545+0000","last_undegraded":"2024-09-13T15:02:33.743545+0000","last_fullsized":"2024-09-13T15:02:33.743545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:02.840528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116879+0000","last_change":"2024-09-13T15:01:44.849975+0000","last_active":"2024-09-13T15:02:34.116879+0000","last_peered":"2024-09-13T15:02:34.116879+0000","last_clean":"2024-09-13T15:02:34.116879+0000","last_became_active":"2024-09-13T15:01:44.849457+0000","last_became_peered":"2024-09-13T15:01:44.849457+0000","last_unstale":"2024-09-13T15:02:34.116879+0000","last_undegraded":"2024-09-13T15:02:34.116879+0000","last_fullsized":"2024-09-13T15:02:34.116879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:51.139153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742016+0000","last_change":"2024-09-13T15:01:44.420906+0000","last_active":"2024-09-13T15:02:33.742016+0000","last_peered":"2024-09-13T15:02:33.742016+0000","last_clean":"2024-09-13T15:02:33.742016+0000","last_became_active":"2024-09-13T15:01:44.420601+0000","last_became_peered":"2024-09-13T15:01:44.420601+0000","last_unstale":"2024-09-13T15:02:33.742016+0000","last_undegraded":"2024-09-13T15:02:33.742016+0000","last_fullsized":"2024-09-13T15:02:33.742016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:33.245745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741847+0000","last_change":"2024-09-13T15:01:48.911047+0000","last_active":"2024-09-13T15:02:33.741847+0000","last_peered":"2024-09-13T15:02:33.741847+0000","last_clean":"2024-09-13T15:02:33.741847+0000","last_became_active":"2024-09-13T15:01:48.910479+0000","last_became_peered":"2024-09-13T15:01:48.910479+0000","last_unstale":"2024-09-13T15:02:33.741847+0000","last_undegraded":"2024-09-13T15:02:33.741847+0000","last_fullsized":"2024-09-13T15:02:33.741847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:06.558889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745346+0000","last_change":"2024-09-13T15:01:44.838098+0000","last_active":"2024-09-13T15:02:33.745346+0000","last_peered":"2024-09-13T15:02:33.745346+0000","last_clean":"2024-09-13T15:02:33.745346+0000","last_became_active":"2024-09-13T15:01:44.837429+0000","last_became_peered":"2024-09-13T15:01:44.837429+0000","last_unstale":"2024-09-13T15:02:33.745346+0000","last_undegraded":"2024-09-13T15:02:33.745346+0000","last_fullsized":"2024-09-13T15:02:33.745346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:37.795841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742419+0000","last_change":"2024-09-13T15:01:44.406999+0000","last_active":"2024-09-13T15:02:33.742419+0000","last_peered":"2024-09-13T15:02:33.742419+0000","last_clean":"2024-09-13T15:02:33.742419+0000","last_became_active":"2024-09-13T15:01:44.406719+0000","last_became_peered":"2024-09-13T15:01:44.406719+0000","last_unstale":"2024-09-13T15:02:33.742419+0000","last_undegraded":"2024-09-13T15:02:33.742419+0000","last_fullsized":"2024-09-13T15:02:33.742419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:33.397091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743939+0000","last_change":"2024-09-13T15:01:48.857931+0000","last_active":"2024-09-13T15:02:33.743939+0000","last_peered":"2024-09-13T15:02:33.743939+0000","last_clean":"2024-09-13T15:02:33.743939+0000","last_became_active":"2024-09-13T15:01:48.857542+0000","last_became_peered":"2024-09-13T15:01:48.857542+0000","last_unstale":"2024-09-13T15:02:33.743939+0000","last_undegraded":"2024-09-13T15:02:33.743939+0000","last_fullsized":"2024-09-13T15:02:33.743939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:32.805405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118403+0000","last_change":"2024-09-13T15:01:44.835470+0000","last_active":"2024-09-13T15:02:34.118403+0000","last_peered":"2024-09-13T15:02:34.118403+0000","last_clean":"2024-09-13T15:02:34.118403+0000","last_became_active":"2024-09-13T15:01:44.831166+0000","last_became_peered":"2024-09-13T15:01:44.831166+0000","last_unstale":"2024-09-13T15:02:34.118403+0000","last_undegraded":"2024-09-13T15:02:34.118403+0000","last_fullsized":"2024-09-13T15:02:34.118403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:05.887592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742413+0000","last_change":"2024-09-13T15:01:44.403111+0000","last_active":"2024-09-13T15:02:33.742413+0000","last_peered":"2024-09-13T15:02:33.742413+0000","last_clean":"2024-09-13T15:02:33.742413+0000","last_became_active":"2024-09-13T15:01:44.401799+0000","last_became_peered":"2024-09-13T15:01:44.401799+0000","last_unstale":"2024-09-13T15:02:33.742413+0000","last_undegraded":"2024-09-13T15:02:33.742413+0000","last_fullsized":"2024-09-13T15:02:33.742413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:54.589470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740292+0000","last_change":"2024-09-13T15:01:48.912490+0000","last_active":"2024-09-13T15:02:33.740292+0000","last_peered":"2024-09-13T15:02:33.740292+0000","last_clean":"2024-09-13T15:02:33.740292+0000","last_became_active":"2024-09-13T15:01:48.911474+0000","last_became_peered":"2024-09-13T15:01:48.911474+0000","last_unstale":"2024-09-13T15:02:33.740292+0000","last_undegraded":"2024-09-13T15:02:33.740292+0000","last_fullsized":"2024-09-13T15:02:33.740292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:54.295921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117960+0000","last_change":"2024-09-13T15:01:44.818472+0000","last_active":"2024-09-13T15:02:34.117960+0000","last_peered":"2024-09-13T15:02:34.117960+0000","last_clean":"2024-09-13T15:02:34.117960+0000","last_became_active":"2024-09-13T15:01:44.817718+0000","last_became_peered":"2024-09-13T15:01:44.817718+0000","last_unstale":"2024-09-13T15:02:34.117960+0000","last_undegraded":"2024-09-13T15:02:34.117960+0000","last_fullsized":"2024-09-13T15:02:34.117960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:21.310696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.750292+0000","last_change":"2024-09-13T15:01:44.410376+0000","last_active":"2024-09-13T15:02:33.750292+0000","last_peered":"2024-09-13T15:02:33.750292+0000","last_clean":"2024-09-13T15:02:33.750292+0000","last_became_active":"2024-09-13T15:01:44.409585+0000","last_became_peered":"2024-09-13T15:01:44.409585+0000","last_unstale":"2024-09-13T15:02:33.750292+0000","last_undegraded":"2024-09-13T15:02:33.750292+0000","last_fullsized":"2024-09-13T15:02:33.750292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:45.845804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.747358+0000","last_change":"2024-09-13T15:01:48.861130+0000","last_active":"2024-09-13T15:02:33.747358+0000","last_peered":"2024-09-13T15:02:33.747358+0000","last_clean":"2024-09-13T15:02:33.747358+0000","last_became_active":"2024-09-13T15:01:48.860317+0000","last_became_peered":"2024-09-13T15:01:48.860317+0000","last_unstale":"2024-09-13T15:02:33.747358+0000","last_undegraded":"2024-09-13T15:02:33.747358+0000","last_fullsized":"2024-09-13T15:02:33.747358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:45.317747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116786+0000","last_change":"2024-09-13T15:01:44.835494+0000","last_active":"2024-09-13T15:02:34.116786+0000","last_peered":"2024-09-13T15:02:34.116786+0000","last_clean":"2024-09-13T15:02:34.116786+0000","last_became_active":"2024-09-13T15:01:44.831150+0000","last_became_peered":"2024-09-13T15:01:44.831150+0000","last_unstale":"2024-09-13T15:02:34.116786+0000","last_undegraded":"2024-09-13T15:02:34.116786+0000","last_fullsized":"2024-09-13T15:02:34.116786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:29.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"25'8","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740939+0000","last_change":"2024-09-13T15:01:44.390278+0000","last_active":"2024-09-13T15:02:33.740939+0000","last_peered":"2024-09-13T15:02:33.740939+0000","last_clean":"2024-09-13T15:02:33.740939+0000","last_became_active":"2024-09-13T15:01:44.389946+0000","last_became_peered":"2024-09-13T15:01:44.389946+0000","last_unstale":"2024-09-13T15:02:33.740939+0000","last_undegraded":"2024-09-13T15:02:33.740939+0000","last_fullsized":"2024-09-13T15:02:33.740939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:53.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744367+0000","last_change":"2024-09-13T15:01:48.848009+0000","last_active":"2024-09-13T15:02:33.744367+0000","last_peered":"2024-09-13T15:02:33.744367+0000","last_clean":"2024-09-13T15:02:33.744367+0000","last_became_active":"2024-09-13T15:01:48.847605+0000","last_became_peered":"2024-09-13T15:01:48.847605+0000","last_unstale":"2024-09-13T15:02:33.744367+0000","last_undegraded":"2024-09-13T15:02:33.744367+0000","last_fullsized":"2024-09-13T15:02:33.744367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:32.053010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741353+0000","last_change":"2024-09-13T15:01:44.808572+0000","last_active":"2024-09-13T15:02:33.741353+0000","last_peered":"2024-09-13T15:02:33.741353+0000","last_clean":"2024-09-13T15:02:33.741353+0000","last_became_active":"2024-09-13T15:01:44.808140+0000","last_became_peered":"2024-09-13T15:01:44.808140+0000","last_unstale":"2024-09-13T15:02:33.741353+0000","last_undegraded":"2024-09-13T15:02:33.741353+0000","last_fullsized":"2024-09-13T15:02:33.741353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:15.497720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742109+0000","last_change":"2024-09-13T15:01:44.428794+0000","last_active":"2024-09-13T15:02:33.742109+0000","last_peered":"2024-09-13T15:02:33.742109+0000","last_clean":"2024-09-13T15:02:33.742109+0000","last_became_active":"2024-09-13T15:01:44.428271+0000","last_became_peered":"2024-09-13T15:01:44.428271+0000","last_unstale":"2024-09-13T15:02:33.742109+0000","last_undegraded":"2024-09-13T15:02:33.742109+0000","last_fullsized":"2024-09-13T15:02:33.742109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:53.225826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738469+0000","last_change":"2024-09-13T15:01:48.916354+0000","last_active":"2024-09-13T15:02:33.738469+0000","last_peered":"2024-09-13T15:02:33.738469+0000","last_clean":"2024-09-13T15:02:33.738469+0000","last_became_active":"2024-09-13T15:01:48.916008+0000","last_became_peered":"2024-09-13T15:01:48.916008+0000","last_unstale":"2024-09-13T15:02:33.738469+0000","last_undegraded":"2024-09-13T15:02:33.738469+0000","last_fullsized":"2024-09-13T15:02:33.738469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:58.115410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116589+0000","last_change":"2024-09-13T15:01:44.826700+0000","last_active":"2024-09-13T15:02:34.116589+0000","last_peered":"2024-09-13T15:02:34.116589+0000","last_clean":"2024-09-13T15:02:34.116589+0000","last_became_active":"2024-09-13T15:01:44.825996+0000","last_became_peered":"2024-09-13T15:01:44.825996+0000","last_unstale":"2024-09-13T15:02:34.116589+0000","last_undegraded":"2024-09-13T15:02:34.116589+0000","last_fullsized":"2024-09-13T15:02:34.116589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:11.963837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742455+0000","last_change":"2024-09-13T15:01:44.409339+0000","last_active":"2024-09-13T15:02:33.742455+0000","last_peered":"2024-09-13T15:02:33.742455+0000","last_clean":"2024-09-13T15:02:33.742455+0000","last_became_active":"2024-09-13T15:01:44.408644+0000","last_became_peered":"2024-09-13T15:01:44.408644+0000","last_unstale":"2024-09-13T15:02:33.742455+0000","last_undegraded":"2024-09-13T15:02:33.742455+0000","last_fullsized":"2024-09-13T15:02:33.742455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:29.297950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737959+0000","last_change":"2024-09-13T15:01:48.916478+0000","last_active":"2024-09-13T15:02:33.737959+0000","last_peered":"2024-09-13T15:02:33.737959+0000","last_clean":"2024-09-13T15:02:33.737959+0000","last_became_active":"2024-09-13T15:01:48.916198+0000","last_became_peered":"2024-09-13T15:01:48.916198+0000","last_unstale":"2024-09-13T15:02:33.737959+0000","last_undegraded":"2024-09-13T15:02:33.737959+0000","last_fullsized":"2024-09-13T15:02:33.737959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:26.311460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743617+0000","last_change":"2024-09-13T15:01:44.831833+0000","last_active":"2024-09-13T15:02:33.743617+0000","last_peered":"2024-09-13T15:02:33.743617+0000","last_clean":"2024-09-13T15:02:33.743617+0000","last_became_active":"2024-09-13T15:01:44.831583+0000","last_became_peered":"2024-09-13T15:01:44.831583+0000","last_unstale":"2024-09-13T15:02:33.743617+0000","last_undegraded":"2024-09-13T15:02:33.743617+0000","last_fullsized":"2024-09-13T15:02:33.743617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.715951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744192+0000","last_change":"2024-09-13T15:01:44.408752+0000","last_active":"2024-09-13T15:02:33.744192+0000","last_peered":"2024-09-13T15:02:33.744192+0000","last_clean":"2024-09-13T15:02:33.744192+0000","last_became_active":"2024-09-13T15:01:44.408453+0000","last_became_peered":"2024-09-13T15:01:44.408453+0000","last_unstale":"2024-09-13T15:02:33.744192+0000","last_undegraded":"2024-09-13T15:02:33.744192+0000","last_fullsized":"2024-09-13T15:02:33.744192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:31.587404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743419+0000","last_change":"2024-09-13T15:01:48.916681+0000","last_active":"2024-09-13T15:02:33.743419+0000","last_peered":"2024-09-13T15:02:33.743419+0000","last_clean":"2024-09-13T15:02:33.743419+0000","last_became_active":"2024-09-13T15:01:48.916185+0000","last_became_peered":"2024-09-13T15:01:48.916185+0000","last_unstale":"2024-09-13T15:02:33.743419+0000","last_undegraded":"2024-09-13T15:02:33.743419+0000","last_fullsized":"2024-09-13T15:02:33.743419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:33.862835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116757+0000","last_change":"2024-09-13T15:01:44.817007+0000","last_active":"2024-09-13T15:02:34.116757+0000","last_peered":"2024-09-13T15:02:34.116757+0000","last_clean":"2024-09-13T15:02:34.116757+0000","last_became_active":"2024-09-13T15:01:44.815435+0000","last_became_peered":"2024-09-13T15:01:44.815435+0000","last_unstale":"2024-09-13T15:02:34.116757+0000","last_undegraded":"2024-09-13T15:02:34.116757+0000","last_fullsized":"2024-09-13T15:02:34.116757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:25.887993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:03.647333+0000","last_change":"2024-09-13T15:01:44.435688+0000","last_active":"2024-09-13T15:04:03.647333+0000","last_peered":"2024-09-13T15:04:03.647333+0000","last_clean":"2024-09-13T15:04:03.647333+0000","last_became_active":"2024-09-13T15:01:44.435222+0000","last_became_peered":"2024-09-13T15:01:44.435222+0000","last_unstale":"2024-09-13T15:04:03.647333+0000","last_undegraded":"2024-09-13T15:04:03.647333+0000","last_fullsized":"2024-09-13T15:04:03.647333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:24.705633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742810+0000","last_change":"2024-09-13T15:01:48.847694+0000","last_active":"2024-09-13T15:02:33.742810+0000","last_peered":"2024-09-13T15:02:33.742810+0000","last_clean":"2024-09-13T15:02:33.742810+0000","last_became_active":"2024-09-13T15:01:48.846835+0000","last_became_peered":"2024-09-13T15:01:48.846835+0000","last_unstale":"2024-09-13T15:02:33.742810+0000","last_undegraded":"2024-09-13T15:02:33.742810+0000","last_fullsized":"2024-09-13T15:02:33.742810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:49.763472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749658+0000","last_change":"2024-09-13T15:01:44.835315+0000","last_active":"2024-09-13T15:02:33.749658+0000","last_peered":"2024-09-13T15:02:33.749658+0000","last_clean":"2024-09-13T15:02:33.749658+0000","last_became_active":"2024-09-13T15:01:44.834643+0000","last_became_peered":"2024-09-13T15:01:44.834643+0000","last_unstale":"2024-09-13T15:02:33.749658+0000","last_undegraded":"2024-09-13T15:02:33.749658+0000","last_fullsized":"2024-09-13T15:02:33.749658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:15.535195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742300+0000","last_change":"2024-09-13T15:01:44.424966+0000","last_active":"2024-09-13T15:02:33.742300+0000","last_peered":"2024-09-13T15:02:33.742300+0000","last_clean":"2024-09-13T15:02:33.742300+0000","last_became_active":"2024-09-13T15:01:44.424714+0000","last_became_peered":"2024-09-13T15:01:44.424714+0000","last_unstale":"2024-09-13T15:02:33.742300+0000","last_undegraded":"2024-09-13T15:02:33.742300+0000","last_fullsized":"2024-09-13T15:02:33.742300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:46.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.756425+0000","last_change":"2024-09-13T15:02:33.753482+0000","last_active":"2024-09-13T15:02:33.756425+0000","last_peered":"2024-09-13T15:02:33.756425+0000","last_clean":"2024-09-13T15:02:33.756425+0000","last_became_active":"2024-09-13T15:02:33.752505+0000","last_became_peered":"2024-09-13T15:02:33.752505+0000","last_unstale":"2024-09-13T15:02:33.756425+0000","last_undegraded":"2024-09-13T15:02:33.756425+0000","last_fullsized":"2024-09-13T15:02:33.756425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:59.041586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742572+0000","last_change":"2024-09-13T15:01:44.837032+0000","last_active":"2024-09-13T15:02:33.742572+0000","last_peered":"2024-09-13T15:02:33.742572+0000","last_clean":"2024-09-13T15:02:33.742572+0000","last_became_active":"2024-09-13T15:01:44.836750+0000","last_became_peered":"2024-09-13T15:01:44.836750+0000","last_unstale":"2024-09-13T15:02:33.742572+0000","last_undegraded":"2024-09-13T15:02:33.742572+0000","last_fullsized":"2024-09-13T15:02:33.742572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:04.491426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.747046+0000","last_change":"2024-09-13T15:01:44.437854+0000","last_active":"2024-09-13T15:02:33.747046+0000","last_peered":"2024-09-13T15:02:33.747046+0000","last_clean":"2024-09-13T15:02:33.747046+0000","last_became_active":"2024-09-13T15:01:44.437433+0000","last_became_peered":"2024-09-13T15:01:44.437433+0000","last_unstale":"2024-09-13T15:02:33.747046+0000","last_undegraded":"2024-09-13T15:02:33.747046+0000","last_fullsized":"2024-09-13T15:02:33.747046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:47.302388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737553+0000","last_change":"2024-09-13T15:01:48.841829+0000","last_active":"2024-09-13T15:02:33.737553+0000","last_peered":"2024-09-13T15:02:33.737553+0000","last_clean":"2024-09-13T15:02:33.737553+0000","last_became_active":"2024-09-13T15:01:48.841267+0000","last_became_peered":"2024-09-13T15:01:48.841267+0000","last_unstale":"2024-09-13T15:02:33.737553+0000","last_undegraded":"2024-09-13T15:02:33.737553+0000","last_fullsized":"2024-09-13T15:02:33.737553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:25.029615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.746815+0000","last_change":"2024-09-13T15:01:44.844701+0000","last_active":"2024-09-13T15:02:33.746815+0000","last_peered":"2024-09-13T15:02:33.746815+0000","last_clean":"2024-09-13T15:02:33.746815+0000","last_became_active":"2024-09-13T15:01:44.843982+0000","last_became_peered":"2024-09-13T15:01:44.843982+0000","last_unstale":"2024-09-13T15:02:33.746815+0000","last_undegraded":"2024-09-13T15:02:33.746815+0000","last_fullsized":"2024-09-13T15:02:33.746815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744456+0000","last_change":"2024-09-13T15:01:44.436081+0000","last_active":"2024-09-13T15:02:33.744456+0000","last_peered":"2024-09-13T15:02:33.744456+0000","last_clean":"2024-09-13T15:02:33.744456+0000","last_became_active":"2024-09-13T15:01:44.435367+0000","last_became_peered":"2024-09-13T15:01:44.435367+0000","last_unstale":"2024-09-13T15:02:33.744456+0000","last_undegraded":"2024-09-13T15:02:33.744456+0000","last_fullsized":"2024-09-13T15:02:33.744456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:57:57.065719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737590+0000","last_change":"2024-09-13T15:01:48.910562+0000","last_active":"2024-09-13T15:02:33.737590+0000","last_peered":"2024-09-13T15:02:33.737590+0000","last_clean":"2024-09-13T15:02:33.737590+0000","last_became_active":"2024-09-13T15:01:48.909681+0000","last_became_peered":"2024-09-13T15:01:48.909681+0000","last_unstale":"2024-09-13T15:02:33.737590+0000","last_undegraded":"2024-09-13T15:02:33.737590+0000","last_fullsized":"2024-09-13T15:02:33.737590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:35.989769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.120759+0000","last_change":"2024-09-13T15:02:34.118951+0000","last_active":"2024-09-13T15:02:34.120759+0000","last_peered":"2024-09-13T15:02:34.120759+0000","last_clean":"2024-09-13T15:02:34.120759+0000","last_became_active":"2024-09-13T15:02:34.118477+0000","last_became_peered":"2024-09-13T15:02:34.118477+0000","last_unstale":"2024-09-13T15:02:34.120759+0000","last_undegraded":"2024-09-13T15:02:34.120759+0000","last_fullsized":"2024-09-13T15:02:34.120759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:13.697114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741807+0000","last_change":"2024-09-13T15:01:44.808417+0000","last_active":"2024-09-13T15:02:33.741807+0000","last_peered":"2024-09-13T15:02:33.741807+0000","last_clean":"2024-09-13T15:02:33.741807+0000","last_became_active":"2024-09-13T15:01:44.807641+0000","last_became_peered":"2024-09-13T15:01:44.807641+0000","last_unstale":"2024-09-13T15:02:33.741807+0000","last_undegraded":"2024-09-13T15:02:33.741807+0000","last_fullsized":"2024-09-13T15:02:33.741807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:58.296966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740623+0000","last_change":"2024-09-13T15:01:44.433582+0000","last_active":"2024-09-13T15:02:33.740623+0000","last_peered":"2024-09-13T15:02:33.740623+0000","last_clean":"2024-09-13T15:02:33.740623+0000","last_became_active":"2024-09-13T15:01:44.433124+0000","last_became_peered":"2024-09-13T15:01:44.433124+0000","last_unstale":"2024-09-13T15:02:33.740623+0000","last_undegraded":"2024-09-13T15:02:33.740623+0000","last_fullsized":"2024-09-13T15:02:33.740623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:04.476996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744178+0000","last_change":"2024-09-13T15:01:48.855090+0000","last_active":"2024-09-13T15:02:33.744178+0000","last_peered":"2024-09-13T15:02:33.744178+0000","last_clean":"2024-09-13T15:02:33.744178+0000","last_became_active":"2024-09-13T15:01:48.852925+0000","last_became_peered":"2024-09-13T15:01:48.852925+0000","last_unstale":"2024-09-13T15:02:33.744178+0000","last_undegraded":"2024-09-13T15:02:33.744178+0000","last_fullsized":"2024-09-13T15:02:33.744178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.176480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748607+0000","last_change":"2024-09-13T15:02:33.746356+0000","last_active":"2024-09-13T15:02:33.748607+0000","last_peered":"2024-09-13T15:02:33.748607+0000","last_clean":"2024-09-13T15:02:33.748607+0000","last_became_active":"2024-09-13T15:02:33.746005+0000","last_became_peered":"2024-09-13T15:02:33.746005+0000","last_unstale":"2024-09-13T15:02:33.748607+0000","last_undegraded":"2024-09-13T15:02:33.748607+0000","last_fullsized":"2024-09-13T15:02:33.748607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:41.159781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737817+0000","last_change":"2024-09-13T15:01:44.436900+0000","last_active":"2024-09-13T15:02:33.737817+0000","last_peered":"2024-09-13T15:02:33.737817+0000","last_clean":"2024-09-13T15:02:33.737817+0000","last_became_active":"2024-09-13T15:01:44.436646+0000","last_became_peered":"2024-09-13T15:01:44.436646+0000","last_unstale":"2024-09-13T15:02:33.737817+0000","last_undegraded":"2024-09-13T15:02:33.737817+0000","last_fullsized":"2024-09-13T15:02:33.737817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:52.505856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742710+0000","last_change":"2024-09-13T15:01:44.430115+0000","last_active":"2024-09-13T15:02:33.742710+0000","last_peered":"2024-09-13T15:02:33.742710+0000","last_clean":"2024-09-13T15:02:33.742710+0000","last_became_active":"2024-09-13T15:01:44.429339+0000","last_became_peered":"2024-09-13T15:01:44.429339+0000","last_unstale":"2024-09-13T15:02:33.742710+0000","last_undegraded":"2024-09-13T15:02:33.742710+0000","last_fullsized":"2024-09-13T15:02:33.742710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:47.224125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.742489+0000","last_change":"2024-09-13T15:01:44.822034+0000","last_active":"2024-09-13T15:02:32.742489+0000","last_peered":"2024-09-13T15:02:32.742489+0000","last_clean":"2024-09-13T15:02:32.742489+0000","last_became_active":"2024-09-13T15:01:44.821734+0000","last_became_peered":"2024-09-13T15:01:44.821734+0000","last_unstale":"2024-09-13T15:02:32.742489+0000","last_undegraded":"2024-09-13T15:02:32.742489+0000","last_fullsized":"2024-09-13T15:02:32.742489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:57:44.629046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.743796+0000","last_change":"2024-09-13T15:01:48.858033+0000","last_active":"2024-09-13T15:02:32.743796+0000","last_peered":"2024-09-13T15:02:32.743796+0000","last_clean":"2024-09-13T15:02:32.743796+0000","last_became_active":"2024-09-13T15:01:48.857584+0000","last_became_peered":"2024-09-13T15:01:48.857584+0000","last_unstale":"2024-09-13T15:02:32.743796+0000","last_undegraded":"2024-09-13T15:02:32.743796+0000","last_fullsized":"2024-09-13T15:02:32.743796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:04.797167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738348+0000","last_change":"2024-09-13T15:01:44.422582+0000","last_active":"2024-09-13T15:02:33.738348+0000","last_peered":"2024-09-13T15:02:33.738348+0000","last_clean":"2024-09-13T15:02:33.738348+0000","last_became_active":"2024-09-13T15:01:44.422367+0000","last_became_peered":"2024-09-13T15:01:44.422367+0000","last_unstale":"2024-09-13T15:02:33.738348+0000","last_undegraded":"2024-09-13T15:02:33.738348+0000","last_fullsized":"2024-09-13T15:02:33.738348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.902724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.742628+0000","last_change":"2024-09-13T15:01:44.820841+0000","last_active":"2024-09-13T15:02:32.742628+0000","last_peered":"2024-09-13T15:02:32.742628+0000","last_clean":"2024-09-13T15:02:32.742628+0000","last_became_active":"2024-09-13T15:01:44.816584+0000","last_became_peered":"2024-09-13T15:01:44.816584+0000","last_unstale":"2024-09-13T15:02:32.742628+0000","last_undegraded":"2024-09-13T15:02:32.742628+0000","last_fullsized":"2024-09-13T15:02:32.742628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:26.763818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.737009+0000","last_change":"2024-09-13T15:01:48.840771+0000","last_active":"2024-09-13T15:02:32.737009+0000","last_peered":"2024-09-13T15:02:32.737009+0000","last_clean":"2024-09-13T15:02:32.737009+0000","last_became_active":"2024-09-13T15:01:48.840397+0000","last_became_peered":"2024-09-13T15:01:48.840397+0000","last_unstale":"2024-09-13T15:02:32.737009+0000","last_undegraded":"2024-09-13T15:02:32.737009+0000","last_fullsized":"2024-09-13T15:02:32.737009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:59.700088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741113+0000","last_change":"2024-09-13T15:01:44.809497+0000","last_active":"2024-09-13T15:02:33.741113+0000","last_peered":"2024-09-13T15:02:33.741113+0000","last_clean":"2024-09-13T15:02:33.741113+0000","last_became_active":"2024-09-13T15:01:44.808669+0000","last_became_peered":"2024-09-13T15:01:44.808669+0000","last_unstale":"2024-09-13T15:02:33.741113+0000","last_undegraded":"2024-09-13T15:02:33.741113+0000","last_fullsized":"2024-09-13T15:02:33.741113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:45.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744117+0000","last_change":"2024-09-13T15:01:44.836353+0000","last_active":"2024-09-13T15:02:33.744117+0000","last_peered":"2024-09-13T15:02:33.744117+0000","last_clean":"2024-09-13T15:02:33.744117+0000","last_became_active":"2024-09-13T15:01:44.836102+0000","last_became_peered":"2024-09-13T15:01:44.836102+0000","last_unstale":"2024-09-13T15:02:33.744117+0000","last_undegraded":"2024-09-13T15:02:33.744117+0000","last_fullsized":"2024-09-13T15:02:33.744117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:14.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741973+0000","last_change":"2024-09-13T15:01:44.849091+0000","last_active":"2024-09-13T15:02:33.741973+0000","last_peered":"2024-09-13T15:02:33.741973+0000","last_clean":"2024-09-13T15:02:33.741973+0000","last_became_active":"2024-09-13T15:01:44.846506+0000","last_became_peered":"2024-09-13T15:01:44.846506+0000","last_unstale":"2024-09-13T15:02:33.741973+0000","last_undegraded":"2024-09-13T15:02:33.741973+0000","last_fullsized":"2024-09-13T15:02:33.741973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:38.026998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743939+0000","last_change":"2024-09-13T15:01:44.809873+0000","last_active":"2024-09-13T15:02:33.743939+0000","last_peered":"2024-09-13T15:02:33.743939+0000","last_clean":"2024-09-13T15:02:33.743939+0000","last_became_active":"2024-09-13T15:01:44.809585+0000","last_became_peered":"2024-09-13T15:01:44.809585+0000","last_unstale":"2024-09-13T15:02:33.743939+0000","last_undegraded":"2024-09-13T15:02:33.743939+0000","last_fullsized":"2024-09-13T15:02:33.743939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:20.272320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738378+0000","last_change":"2024-09-13T15:01:44.816761+0000","last_active":"2024-09-13T15:02:33.738378+0000","last_peered":"2024-09-13T15:02:33.738378+0000","last_clean":"2024-09-13T15:02:33.738378+0000","last_became_active":"2024-09-13T15:01:44.816480+0000","last_became_peered":"2024-09-13T15:01:44.816480+0000","last_unstale":"2024-09-13T15:02:33.738378+0000","last_undegraded":"2024-09-13T15:02:33.738378+0000","last_fullsized":"2024-09-13T15:02:33.738378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:46.000440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742115+0000","last_change":"2024-09-13T15:01:44.808373+0000","last_active":"2024-09-13T15:02:33.742115+0000","last_peered":"2024-09-13T15:02:33.742115+0000","last_clean":"2024-09-13T15:02:33.742115+0000","last_became_active":"2024-09-13T15:01:44.807622+0000","last_became_peered":"2024-09-13T15:01:44.807622+0000","last_unstale":"2024-09-13T15:02:33.742115+0000","last_undegraded":"2024-09-13T15:02:33.742115+0000","last_fullsized":"2024-09-13T15:02:33.742115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:38.584426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745064+0000","last_change":"2024-09-13T15:01:44.832521+0000","last_active":"2024-09-13T15:02:33.745064+0000","last_peered":"2024-09-13T15:02:33.745064+0000","last_clean":"2024-09-13T15:02:33.745064+0000","last_became_active":"2024-09-13T15:01:44.831889+0000","last_became_peered":"2024-09-13T15:01:44.831889+0000","last_unstale":"2024-09-13T15:02:33.745064+0000","last_undegraded":"2024-09-13T15:02:33.745064+0000","last_fullsized":"2024-09-13T15:02:33.745064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:07.563684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738576+0000","last_change":"2024-09-13T15:01:44.817583+0000","last_active":"2024-09-13T15:02:33.738576+0000","last_peered":"2024-09-13T15:02:33.738576+0000","last_clean":"2024-09-13T15:02:33.738576+0000","last_became_active":"2024-09-13T15:01:44.817350+0000","last_became_peered":"2024-09-13T15:01:44.817350+0000","last_unstale":"2024-09-13T15:02:33.738576+0000","last_undegraded":"2024-09-13T15:02:33.738576+0000","last_fullsized":"2024-09-13T15:02:33.738576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:10.913776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740529+0000","last_change":"2024-09-13T15:01:44.838372+0000","last_active":"2024-09-13T15:02:33.740529+0000","last_peered":"2024-09-13T15:02:33.740529+0000","last_clean":"2024-09-13T15:02:33.740529+0000","last_became_active":"2024-09-13T15:01:44.837588+0000","last_became_peered":"2024-09-13T15:01:44.837588+0000","last_unstale":"2024-09-13T15:02:33.740529+0000","last_undegraded":"2024-09-13T15:02:33.740529+0000","last_fullsized":"2024-09-13T15:02:33.740529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:05:12.877936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737718+0000","last_change":"2024-09-13T15:01:44.828159+0000","last_active":"2024-09-13T15:02:33.737718+0000","last_peered":"2024-09-13T15:02:33.737718+0000","last_clean":"2024-09-13T15:02:33.737718+0000","last_became_active":"2024-09-13T15:01:44.827910+0000","last_became_peered":"2024-09-13T15:01:44.827910+0000","last_unstale":"2024-09-13T15:02:33.737718+0000","last_undegraded":"2024-09-13T15:02:33.737718+0000","last_fullsized":"2024-09-13T15:02:33.737718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:07:32.776119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.119204+0000","last_change":"2024-09-13T15:02:34.119204+0000","last_active":"2024-09-13T15:02:34.119204+0000","last_peered":"2024-09-13T15:02:34.119204+0000","last_clean":"2024-09-13T15:02:34.119204+0000","last_became_active":"2024-09-13T15:02:34.118621+0000","last_became_peered":"2024-09-13T15:02:34.118621+0000","last_unstale":"2024-09-13T15:02:34.119204+0000","last_undegraded":"2024-09-13T15:02:34.119204+0000","last_fullsized":"2024-09-13T15:02:34.119204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:33.356064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743857+0000","last_change":"2024-09-13T15:01:44.831717+0000","last_active":"2024-09-13T15:02:33.743857+0000","last_peered":"2024-09-13T15:02:33.743857+0000","last_clean":"2024-09-13T15:02:33.743857+0000","last_became_active":"2024-09-13T15:01:44.831495+0000","last_became_peered":"2024-09-13T15:01:44.831495+0000","last_unstale":"2024-09-13T15:02:33.743857+0000","last_undegraded":"2024-09-13T15:02:33.743857+0000","last_fullsized":"2024-09-13T15:02:33.743857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:48.753543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743869+0000","last_change":"2024-09-13T15:01:44.829698+0000","last_active":"2024-09-13T15:02:33.743869+0000","last_peered":"2024-09-13T15:02:33.743869+0000","last_clean":"2024-09-13T15:02:33.743869+0000","last_became_active":"2024-09-13T15:01:44.828999+0000","last_became_peered":"2024-09-13T15:01:44.828999+0000","last_unstale":"2024-09-13T15:02:33.743869+0000","last_undegraded":"2024-09-13T15:02:33.743869+0000","last_fullsized":"2024-09-13T15:02:33.743869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:30.591718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117647+0000","last_change":"2024-09-13T15:01:44.817554+0000","last_active":"2024-09-13T15:02:34.117647+0000","last_peered":"2024-09-13T15:02:34.117647+0000","last_clean":"2024-09-13T15:02:34.117647+0000","last_became_active":"2024-09-13T15:01:44.816258+0000","last_became_peered":"2024-09-13T15:01:44.816258+0000","last_unstale":"2024-09-13T15:02:34.117647+0000","last_undegraded":"2024-09-13T15:02:34.117647+0000","last_fullsized":"2024-09-13T15:02:34.117647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:07.927802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742322+0000","last_change":"2024-09-13T15:01:44.809979+0000","last_active":"2024-09-13T15:02:33.742322+0000","last_peered":"2024-09-13T15:02:33.742322+0000","last_clean":"2024-09-13T15:02:33.742322+0000","last_became_active":"2024-09-13T15:01:44.809687+0000","last_became_peered":"2024-09-13T15:01:44.809687+0000","last_unstale":"2024-09-13T15:02:33.742322+0000","last_undegraded":"2024-09-13T15:02:33.742322+0000","last_fullsized":"2024-09-13T15:02:33.742322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:45.583840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.119233+0000","last_change":"2024-09-13T15:02:34.119233+0000","last_active":"2024-09-13T15:02:34.119233+0000","last_peered":"2024-09-13T15:02:34.119233+0000","last_clean":"2024-09-13T15:02:34.119233+0000","last_became_active":"2024-09-13T15:02:34.118798+0000","last_became_peered":"2024-09-13T15:02:34.118798+0000","last_unstale":"2024-09-13T15:02:34.119233+0000","last_undegraded":"2024-09-13T15:02:34.119233+0000","last_fullsized":"2024-09-13T15:02:34.119233+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:12.367569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740392+0000","last_change":"2024-09-13T15:01:44.848904+0000","last_active":"2024-09-13T15:02:33.740392+0000","last_peered":"2024-09-13T15:02:33.740392+0000","last_clean":"2024-09-13T15:02:33.740392+0000","last_became_active":"2024-09-13T15:01:44.846074+0000","last_became_peered":"2024-09-13T15:01:44.846074+0000","last_unstale":"2024-09-13T15:02:33.740392+0000","last_undegraded":"2024-09-13T15:02:33.740392+0000","last_fullsized":"2024-09-13T15:02:33.740392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:37.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741904+0000","last_change":"2024-09-13T15:01:44.828243+0000","last_active":"2024-09-13T15:02:33.741904+0000","last_peered":"2024-09-13T15:02:33.741904+0000","last_clean":"2024-09-13T15:02:33.741904+0000","last_became_active":"2024-09-13T15:01:44.828024+0000","last_became_peered":"2024-09-13T15:01:44.828024+0000","last_unstale":"2024-09-13T15:02:33.741904+0000","last_undegraded":"2024-09-13T15:02:33.741904+0000","last_fullsized":"2024-09-13T15:02:33.741904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:28:47.388087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743573+0000","last_change":"2024-09-13T15:01:44.808879+0000","last_active":"2024-09-13T15:02:33.743573+0000","last_peered":"2024-09-13T15:02:33.743573+0000","last_clean":"2024-09-13T15:02:33.743573+0000","last_became_active":"2024-09-13T15:01:44.808609+0000","last_became_peered":"2024-09-13T15:01:44.808609+0000","last_unstale":"2024-09-13T15:02:33.743573+0000","last_undegraded":"2024-09-13T15:02:33.743573+0000","last_fullsized":"2024-09-13T15:02:33.743573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:59.817452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738213+0000","last_change":"2024-09-13T15:01:44.811171+0000","last_active":"2024-09-13T15:02:33.738213+0000","last_peered":"2024-09-13T15:02:33.738213+0000","last_clean":"2024-09-13T15:02:33.738213+0000","last_became_active":"2024-09-13T15:01:44.809918+0000","last_became_peered":"2024-09-13T15:01:44.809918+0000","last_unstale":"2024-09-13T15:02:33.738213+0000","last_undegraded":"2024-09-13T15:02:33.738213+0000","last_fullsized":"2024-09-13T15:02:33.738213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:48.359429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749385+0000","last_change":"2024-09-13T15:01:44.833663+0000","last_active":"2024-09-13T15:02:33.749385+0000","last_peered":"2024-09-13T15:02:33.749385+0000","last_clean":"2024-09-13T15:02:33.749385+0000","last_became_active":"2024-09-13T15:01:44.828737+0000","last_became_peered":"2024-09-13T15:01:44.828737+0000","last_unstale":"2024-09-13T15:02:33.749385+0000","last_undegraded":"2024-09-13T15:02:33.749385+0000","last_fullsized":"2024-09-13T15:02:33.749385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:08.579890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744005+0000","last_change":"2024-09-13T15:01:44.851143+0000","last_active":"2024-09-13T15:02:33.744005+0000","last_peered":"2024-09-13T15:02:33.744005+0000","last_clean":"2024-09-13T15:02:33.744005+0000","last_became_active":"2024-09-13T15:01:44.850410+0000","last_became_peered":"2024-09-13T15:01:44.850410+0000","last_unstale":"2024-09-13T15:02:33.744005+0000","last_undegraded":"2024-09-13T15:02:33.744005+0000","last_fullsized":"2024-09-13T15:02:33.744005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:11.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744851+0000","last_change":"2024-09-13T15:01:44.840082+0000","last_active":"2024-09-13T15:02:33.744851+0000","last_peered":"2024-09-13T15:02:33.744851+0000","last_clean":"2024-09-13T15:02:33.744851+0000","last_became_active":"2024-09-13T15:01:44.839371+0000","last_became_peered":"2024-09-13T15:01:44.839371+0000","last_unstale":"2024-09-13T15:02:33.744851+0000","last_undegraded":"2024-09-13T15:02:33.744851+0000","last_fullsized":"2024-09-13T15:02:33.744851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:13.433036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118361+0000","last_change":"2024-09-13T15:01:44.850416+0000","last_active":"2024-09-13T15:02:34.118361+0000","last_peered":"2024-09-13T15:02:34.118361+0000","last_clean":"2024-09-13T15:02:34.118361+0000","last_became_active":"2024-09-13T15:01:44.849766+0000","last_became_peered":"2024-09-13T15:01:44.849766+0000","last_unstale":"2024-09-13T15:02:34.118361+0000","last_undegraded":"2024-09-13T15:02:34.118361+0000","last_fullsized":"2024-09-13T15:02:34.118361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:11.985610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.736396+0000","last_change":"2024-09-13T15:01:44.837060+0000","last_active":"2024-09-13T15:02:32.736396+0000","last_peered":"2024-09-13T15:02:32.736396+0000","last_clean":"2024-09-13T15:02:32.736396+0000","last_became_active":"2024-09-13T15:01:44.836770+0000","last_became_peered":"2024-09-13T15:01:44.836770+0000","last_unstale":"2024-09-13T15:02:32.736396+0000","last_undegraded":"2024-09-13T15:02:32.736396+0000","last_fullsized":"2024-09-13T15:02:32.736396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:45.915852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.748907+0000","last_change":"2024-09-13T15:01:44.815867+0000","last_active":"2024-09-13T15:02:32.748907+0000","last_peered":"2024-09-13T15:02:32.748907+0000","last_clean":"2024-09-13T15:02:32.748907+0000","last_became_active":"2024-09-13T15:01:44.815116+0000","last_became_peered":"2024-09-13T15:01:44.815116+0000","last_unstale":"2024-09-13T15:02:32.748907+0000","last_undegraded":"2024-09-13T15:02:32.748907+0000","last_fullsized":"2024-09-13T15:02:32.748907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:02.814724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.753660+0000","last_change":"2024-09-13T15:01:44.850022+0000","last_active":"2024-09-13T15:02:32.753660+0000","last_peered":"2024-09-13T15:02:32.753660+0000","last_clean":"2024-09-13T15:02:32.753660+0000","last_became_active":"2024-09-13T15:01:44.849533+0000","last_became_peered":"2024-09-13T15:01:44.849533+0000","last_unstale":"2024-09-13T15:02:32.753660+0000","last_undegraded":"2024-09-13T15:02:32.753660+0000","last_fullsized":"2024-09-13T15:02:32.753660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:09.837692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.751363+0000","last_change":"2024-09-13T15:01:44.817139+0000","last_active":"2024-09-13T15:02:32.751363+0000","last_peered":"2024-09-13T15:02:32.751363+0000","last_clean":"2024-09-13T15:02:32.751363+0000","last_became_active":"2024-09-13T15:01:44.816416+0000","last_became_peered":"2024-09-13T15:01:44.816416+0000","last_unstale":"2024-09-13T15:02:32.751363+0000","last_undegraded":"2024-09-13T15:02:32.751363+0000","last_fullsized":"2024-09-13T15:02:32.751363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:38.382210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749061+0000","last_change":"2024-09-13T15:02:33.747735+0000","last_active":"2024-09-13T15:02:33.749061+0000","last_peered":"2024-09-13T15:02:33.749061+0000","last_clean":"2024-09-13T15:02:33.749061+0000","last_became_active":"2024-09-13T15:02:33.747405+0000","last_became_peered":"2024-09-13T15:02:33.747405+0000","last_unstale":"2024-09-13T15:02:33.749061+0000","last_undegraded":"2024-09-13T15:02:33.749061+0000","last_fullsized":"2024-09-13T15:02:33.749061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:20.616184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742170+0000","last_change":"2024-09-13T15:01:44.808264+0000","last_active":"2024-09-13T15:02:33.742170+0000","last_peered":"2024-09-13T15:02:33.742170+0000","last_clean":"2024-09-13T15:02:33.742170+0000","last_became_active":"2024-09-13T15:01:44.807776+0000","last_became_peered":"2024-09-13T15:01:44.807776+0000","last_unstale":"2024-09-13T15:02:33.742170+0000","last_undegraded":"2024-09-13T15:02:33.742170+0000","last_fullsized":"2024-09-13T15:02:33.742170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:17.637800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742252+0000","last_change":"2024-09-13T15:01:44.804985+0000","last_active":"2024-09-13T15:02:33.742252+0000","last_peered":"2024-09-13T15:02:33.742252+0000","last_clean":"2024-09-13T15:02:33.742252+0000","last_became_active":"2024-09-13T15:01:44.803977+0000","last_became_peered":"2024-09-13T15:01:44.803977+0000","last_unstale":"2024-09-13T15:02:33.742252+0000","last_undegraded":"2024-09-13T15:02:33.742252+0000","last_fullsized":"2024-09-13T15:02:33.742252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:12.999738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118211+0000","last_change":"2024-09-13T15:01:44.824666+0000","last_active":"2024-09-13T15:02:34.118211+0000","last_peered":"2024-09-13T15:02:34.118211+0000","last_clean":"2024-09-13T15:02:34.118211+0000","last_became_active":"2024-09-13T15:01:44.815381+0000","last_became_peered":"2024-09-13T15:01:44.815381+0000","last_unstale":"2024-09-13T15:02:34.118211+0000","last_undegraded":"2024-09-13T15:02:34.118211+0000","last_fullsized":"2024-09-13T15:02:34.118211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:12:17.680247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542177,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":707986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.94599999999999995,"15min":0.94099999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4079999999999999,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.755},{"interface":"front","average":{"1min":0.878,"5min":0.877,"15min":0.877},"min":{"1min":0.57999999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.78900000000000003}]},{"osd":1,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.873,"15min":0.877},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.147,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.028,"15min":1.036},"min":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0009999999999999,"15min":1.0089999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.4570000000000001,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.98699999999999999,"15min":0.995},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.321,"5min":1.452,"15min":1.452},"last":0.90500000000000003}]},{"osd":3,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.92200000000000004,"15min":0.93000000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.1220000000000001,"5min":1.232,"15min":1.232},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.1020000000000001,"15min":1.1140000000000001},"min":{"1min":0.79000000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.496,"5min":1.7,"15min":1.7},"last":0.875}]},{"osd":4,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3700000000000001,"5min":1.643,"15min":1.643},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.03,"15min":1.046},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.137,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.94499999999999995}]},{"osd":5,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.153,"15min":1.165},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.579,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.095,"5min":1.1040000000000001,"15min":1.1060000000000001},"min":{"1min":0.86799999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.4359999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.0509999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.179,"15min":1.1890000000000001},"min":{"1min":0.81299999999999994,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4970000000000001,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.1399999999999999,"15min":1.157},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.266,"5min":1.641,"15min":1.641},"last":1.0309999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542178,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":120831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.84399999999999997,"15min":0.83799999999999997},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1200000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.89200000000000002,"15min":0.90600000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.099,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.80700000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.85599999999999998,"15min":0.85399999999999998},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90400000000000003,"15min":0.90300000000000002},"min":{"1min":0.63200000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1499999999999999,"5min":1.167,"15min":1.167},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.85699999999999998,"15min":0.86299999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.097,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89300000000000002,"15min":0.88600000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91500000000000004,"15min":0.91600000000000004},"min":{"1min":0.74399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1339999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.749},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95299999999999996,"15min":0.95499999999999996},"min":{"1min":0.77600000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.175,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.90700000000000003}]},{"osd":4,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.93600000000000005,"15min":0.94099999999999995},"min":{"1min":0.68700000000000006,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1220000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.997,"15min":1.0069999999999999},"min":{"1min":0.70299999999999996,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.093}]},{"osd":5,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.95799999999999996,"15min":0.96299999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.014},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.038,"15min":1.048},"min":{"1min":0.67100000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.123}]},{"osd":7,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.024,"15min":1.032},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.167,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.1000000000000001,"15min":1.111},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.2949999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.94399999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542177,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":117126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.86899999999999999,"15min":0.872},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.86899999999999999,"15min":0.86299999999999999},"min":{"1min":0.71599999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.282,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.93700000000000006,"15min":0.94499999999999995},"min":{"1min":0.63700000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3839999999999999,"5min":1.401,"15min":1.401},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.89200000000000002,"15min":0.89600000000000002},"min":{"1min":0.65700000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93500000000000005,"15min":0.94499999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95099999999999996,"15min":0.94899999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.81000000000000005}]},{"osd":3,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.94499999999999995,"15min":0.94799999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.2849999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97199999999999998,"15min":0.97099999999999997},"min":{"1min":0.72699999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.97699999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.85299999999999998,"15min":0.85599999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2330000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.0600000000000001,"15min":1.079},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.2669999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.78300000000000003}]},{"osd":6,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.028,"15min":1.044},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.202,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.004,"5min":1.083,"15min":1.0960000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.496,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.0489999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.085,"15min":1.087},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.145,"15min":1.153},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.5609999999999999,"5min":1.988,"15min":1.988},"last":1.1200000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542177,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":117162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.90000000000000002,"15min":0.90600000000000003},"min":{"1min":0.60399999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.071,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.83099999999999996,"15min":0.82699999999999996},"min":{"1min":0.63200000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.139,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.752}]},{"osd":1,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.92200000000000004,"15min":0.92600000000000005},"min":{"1min":0.68200000000000005,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.131,"5min":1.224,"15min":1.224},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.871,"15min":0.87},"min":{"1min":0.623,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.157,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.93700000000000006,"15min":0.94299999999999995},"min":{"1min":0.70299999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.0780000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.95799999999999996,"15min":0.96199999999999997},"min":{"1min":0.67500000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1240000000000001,"5min":1.669,"15min":1.669},"last":0.60799999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90200000000000002,"15min":0.90600000000000003},"min":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.099,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.0069999999999999,"15min":1.0189999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.2230000000000001,"5min":1.881,"15min":1.881},"last":0.85999999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":1.0169999999999999,"15min":1.05},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.028,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.96999999999999997,"15min":0.98499999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.1819999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.82799999999999996}]},{"osd":6,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.0109999999999999,"15min":1.0269999999999999},"min":{"1min":0.64000000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.107,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.083,"15min":1.0960000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.367,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.155}]},{"osd":7,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.046,"15min":1.054},"min":{"1min":0.751,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.2569999999999999,"5min":1.623,"15min":1.623},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.2090000000000001,"15min":1.2210000000000001},"min":{"1min":0.96099999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3180000000000001,"5min":1.996,"15min":1.996},"last":1.234}]}]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":299008,"data_stored":120831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.501,"15min":0.501},"min":{"1min":0.371,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64900000000000002,"5min":0.747,"15min":0.747},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.66300000000000003,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.374,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.71499999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.56499999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.76600000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.443},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81200000000000006,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.47899999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.61399999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97599999999999998,"5min":1.179,"15min":1.179},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85999999999999999,"15min":0.86399999999999999},"min":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.034,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.83199999999999996}]},{"osd":5,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.873,"15min":0.876},"min":{"1min":0.68500000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0740000000000001,"5min":1.284,"15min":1.284},"last":0.75},{"interface":"front","average":{"1min":0.87,"5min":0.93300000000000005,"15min":0.94299999999999995},"min":{"1min":0.70599999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.212,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.88600000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.89400000000000002,"15min":0.90700000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0269999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.94099999999999995,"15min":0.95099999999999996},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.1539999999999999,"5min":1.21,"15min":1.21},"last":0.86799999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.95299999999999996,"15min":0.96899999999999997},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.1499999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.96399999999999997,"15min":0.98799999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0640000000000001,"5min":1.228,"15min":1.228},"last":0.77900000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":117036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48599999999999999,"15min":0.48799999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.33700000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76600000000000001,"5min":1.157,"15min":1.157},"last":0.45900000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.41599999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.71199999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.59199999999999997}]},{"osd":3,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.44700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73899999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.48599999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.499}]},{"osd":4,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.96699999999999997,"15min":0.98099999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.1899999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.94799999999999995,"15min":0.96299999999999997},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.123,"5min":1.675,"15min":1.675},"last":0.752}]},{"osd":5,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.92300000000000004,"15min":0.93000000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.0920000000000001,"5min":1.296,"15min":1.296},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.877,"15min":0.88700000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.77600000000000002}]},{"osd":6,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.88,"15min":0.88400000000000001},"min":{"1min":0.69599999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.93500000000000005,"15min":0.94199999999999995},"min":{"1min":0.748,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.1859999999999999,"5min":1.373,"15min":1.373},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.82099999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.98699999999999999,"15min":0.995},"min":{"1min":0.78800000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2010000000000001,"5min":1.353,"15min":1.353},"last":0.54400000000000004}]}]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":117196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.32500000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.57699999999999996,"5min":0.871,"15min":0.871},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69799999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.62}]},{"osd":2,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.37,"15min":0.37},"max":{"1min":0.64600000000000002,"5min":1.071,"15min":1.071},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68700000000000006,"5min":1.107,"15min":1.107},"last":0.436}]},{"osd":3,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.84799999999999998,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.61599999999999999,"15min":0.63},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68899999999999995,"5min":1.323,"15min":1.323},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.90600000000000003,"15min":0.91800000000000004},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.0169999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.88400000000000001,"15min":0.89300000000000002},"min":{"1min":0.68799999999999994,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1830000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.879,"15min":0.89000000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0289999999999999,"5min":1.228,"15min":1.228},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.91300000000000003,"15min":0.93100000000000005},"min":{"1min":0.70699999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.96899999999999997,"5min":1.365,"15min":1.365},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.90400000000000003,"15min":0.91400000000000003},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":0.999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.751},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.94499999999999995,"15min":0.96499999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":0.98199999999999998,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.70299999999999996}]},{"osd":7,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.94799999999999995,"15min":0.96699999999999997},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":0.95499999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.93500000000000005,"15min":0.94899999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2170000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.88900000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542177,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":892928,"data_stored":708042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.66800000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.58699999999999997,"15min":0.60199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68899999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.46200000000000002}]},{"osd":2,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.623,"15min":0.64100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.64400000000000002,"5min":1.669,"15min":1.669},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.498}]},{"osd":3,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56299999999999994,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69399999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.72499999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88900000000000001},"min":{"1min":0.67100000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.0980000000000001,"5min":1.274,"15min":1.274},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.90400000000000003,"15min":0.91200000000000003},"min":{"1min":0.67500000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0580000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.71899999999999997}]},{"osd":5,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.88300000000000001,"15min":0.88900000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.026,"5min":1.165,"15min":1.165},"last":0.77200000000000002}]},{"osd":6,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.95199999999999996,"15min":0.96699999999999997},"min":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.0940000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.91200000000000003,"15min":0.92500000000000004},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":0.93899999999999995},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.745},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.93200000000000005,"15min":0.94599999999999995},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.038,"5min":1.141,"15min":1.141},"last":0.85699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:04:16.377 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T15:04:16.377 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T15:04:16.377 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T15:04:16.378 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T15:04:16.378 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T15:04:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.545+0000 7f1d6f400640 1 Processor -- start 2024-09-13T15:04:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.545+0000 7f1d6f400640 1 -- start start 2024-09-13T15:04:16.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.549+0000 7f1d6f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1d6806da80 0x7f1d680c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:16.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.549+0000 7f1d6f400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1d680c7900 0x7f1d68152e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:16.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.549+0000 7f1d6f400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d680c6770 con 0x7f1d6806de60 2024-09-13T15:04:16.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.549+0000 7f1d6f400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6815a060 con 0x7f1d6806da80 2024-09-13T15:04:16.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.549+0000 7f1d6f400640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d68159240 con 0x7f1d680c7900 2024-09-13T15:04:16.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.549+0000 7f1d6ca00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1d6806da80 0x7f1d680c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:16.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.549+0000 7f1d6ca00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1d6806da80 0x7f1d680c73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33824/0 (socket says 172.21.15.7:33824) 2024-09-13T15:04:16.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.549+0000 7f1d6ca00640 1 -- 172.21.15.7:0/4263194844 learned_addr learned my addr 172.21.15.7:0/4263194844 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:16.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.549+0000 7f1d6d400640 1 --2- 172.21.15.7:0/4263194844 >> v2:172.21.15.77:3300/0 conn(0x7f1d680c7900 0x7f1d68152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:16.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.549+0000 7f1d6ca00640 1 -- 172.21.15.7:0/4263194844 >> v2:172.21.15.77:3300/0 conn(0x7f1d680c7900 msgr2=0x7f1d68152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:16.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.549+0000 7f1d6ca00640 1 --2- 172.21.15.7:0/4263194844 >> v2:172.21.15.77:3300/0 conn(0x7f1d680c7900 0x7f1d68152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.549+0000 7f1d6ca00640 1 -- 172.21.15.7:0/4263194844 >> v1:172.21.15.77:6789/0 conn(0x7f1d6806de60 legacy=0x7f1d6815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:16.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.549+0000 7f1d6ca00640 1 -- 172.21.15.7:0/4263194844 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d681594e0 con 0x7f1d6806da80 2024-09-13T15:04:16.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d6ca00640 1 --2- 172.21.15.7:0/4263194844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d6806da80 0x7f1d680c73c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1d680c6b50 tx=0x7f1d5801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5243ce49fa2ada5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:16.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d67e00640 1 -- 172.21.15.7:0/4263194844 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d580aa610 con 0x7f1d6806da80 2024-09-13T15:04:16.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d67e00640 1 -- 172.21.15.7:0/4263194844 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d580a6040 con 0x7f1d6806da80 2024-09-13T15:04:16.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d67e00640 1 -- 172.21.15.7:0/4263194844 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d580aa990 con 0x7f1d6806da80 2024-09-13T15:04:16.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d6f400640 1 -- 172.21.15.7:0/4263194844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d6806da80 msgr2=0x7f1d680c73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:16.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d6f400640 1 --2- 172.21.15.7:0/4263194844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d6806da80 0x7f1d680c73c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1d680c6b50 tx=0x7f1d5801c4b0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d6f400640 1 -- 172.21.15.7:0/4263194844 shutdown_connections 2024-09-13T15:04:16.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d6f400640 1 --2- 172.21.15.7:0/4263194844 >> v2:172.21.15.77:3300/0 conn(0x7f1d680c7900 0x7f1d68152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d6f400640 1 --2- 172.21.15.7:0/4263194844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d6806da80 0x7f1d680c73c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d6f400640 1 -- 172.21.15.7:0/4263194844 >> 172.21.15.7:0/4263194844 conn(0x7f1d6806c330 msgr2=0x7f1d680cb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:16.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d6f400640 1 -- 172.21.15.7:0/4263194844 shutdown_connections 2024-09-13T15:04:16.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d6f400640 1 -- 172.21.15.7:0/4263194844 wait complete. 2024-09-13T15:04:16.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d6f400640 1 Processor -- start 2024-09-13T15:04:16.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d6f400640 1 -- start start 2024-09-13T15:04:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d6f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d6806da80 0x7f1d68151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d6f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d6806de60 0x7f1d680c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d6f400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d680c7900 0x7f1d680c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.553+0000 7f1d6f400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d681589e0 con 0x7f1d6806da80 2024-09-13T15:04:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d6f400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6814f8e0 con 0x7f1d6806de60 2024-09-13T15:04:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d6f400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d68158c10 con 0x7f1d680c7900 2024-09-13T15:04:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d6ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d6806da80 0x7f1d68151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d6ca00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d6806da80 0x7f1d68151cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33830/0 (socket says 172.21.15.7:33830) 2024-09-13T15:04:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d6ca00640 1 -- 172.21.15.7:0/2940261327 learned_addr learned my addr 172.21.15.7:0/2940261327 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d5fe00640 1 --2- 172.21.15.7:0/2940261327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d6806de60 0x7f1d680c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:16.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d6d400640 1 --2- 172.21.15.7:0/2940261327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d680c7900 0x7f1d680c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:16.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d6ca00640 1 -- 172.21.15.7:0/2940261327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d680c7900 msgr2=0x7f1d680c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:16.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d6ca00640 1 --2- 172.21.15.7:0/2940261327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d680c7900 0x7f1d680c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d6ca00640 1 -- 172.21.15.7:0/2940261327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d6806de60 msgr2=0x7f1d680c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:16.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d6ca00640 1 --2- 172.21.15.7:0/2940261327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d6806de60 0x7f1d680c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d6ca00640 1 -- 172.21.15.7:0/2940261327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d580094d0 con 0x7f1d6806da80 2024-09-13T15:04:16.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d6ca00640 1 --2- 172.21.15.7:0/2940261327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d6806da80 0x7f1d68151cd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1d5801a0e0 tx=0x7f1d5801acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:16.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d65600640 1 -- 172.21.15.7:0/2940261327 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d580bd5f0 con 0x7f1d6806da80 2024-09-13T15:04:16.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d65600640 1 -- 172.21.15.7:0/2940261327 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d580bd750 con 0x7f1d6806da80 2024-09-13T15:04:16.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d6f400640 1 -- 172.21.15.7:0/2940261327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d6814e0a0 con 0x7f1d6806da80 2024-09-13T15:04:16.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d65600640 1 -- 172.21.15.7:0/2940261327 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d580bdb00 con 0x7f1d6806da80 2024-09-13T15:04:16.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d6f400640 1 -- 172.21.15.7:0/2940261327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d680c3c10 con 0x7f1d6806da80 2024-09-13T15:04:16.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d6f400640 1 -- 172.21.15.7:0/2940261327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d680c88b0 con 0x7f1d6806da80 2024-09-13T15:04:16.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d65600640 1 -- 172.21.15.7:0/2940261327 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1d580b33f0 con 0x7f1d6806da80 2024-09-13T15:04:16.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.557+0000 7f1d65600640 1 --2- 172.21.15.7:0/2940261327 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1d440666c0 0x7f1d44068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:16.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.561+0000 7f1d65600640 1 -- 172.21.15.7:0/2940261327 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1d5811f5a0 con 0x7f1d6806da80 2024-09-13T15:04:16.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.561+0000 7f1d5fe00640 1 --2- 172.21.15.7:0/2940261327 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1d440666c0 0x7f1d44068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:16.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.561+0000 7f1d5fe00640 1 --2- 172.21.15.7:0/2940261327 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1d440666c0 0x7f1d44068b80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1d6814a9e0 tx=0x7f1d50009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:16.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.561+0000 7f1d65600640 1 -- 172.21.15.7:0/2940261327 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1d580ec540 con 0x7f1d6806da80 2024-09-13T15:04:16.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.761+0000 7f1d6f400640 1 -- 172.21.15.7:0/2940261327 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1d680c3e00 con 0x7f1d6806da80 2024-09-13T15:04:16.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.765+0000 7f1d65600640 1 -- 172.21.15.7:0/2940261327 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164899 (secure 0 0 0) 0x7f1d580efb60 con 0x7f1d6806da80 2024-09-13T15:04:16.770 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:16.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.769+0000 7f1d6f400640 1 -- 172.21.15.7:0/2940261327 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1d440666c0 msgr2=0x7f1d44068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:16.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.769+0000 7f1d6f400640 1 --2- 172.21.15.7:0/2940261327 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1d440666c0 0x7f1d44068b80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1d6814a9e0 tx=0x7f1d50009040 comp rx=0 tx=0).stop 2024-09-13T15:04:16.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.769+0000 7f1d6f400640 1 -- 172.21.15.7:0/2940261327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d6806da80 msgr2=0x7f1d68151cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:16.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.769+0000 7f1d6f400640 1 --2- 172.21.15.7:0/2940261327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d6806da80 0x7f1d68151cd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1d5801a0e0 tx=0x7f1d5801acf0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.769+0000 7f1d6f400640 1 -- 172.21.15.7:0/2940261327 shutdown_connections 2024-09-13T15:04:16.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.769+0000 7f1d6f400640 1 --2- 172.21.15.7:0/2940261327 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1d440666c0 0x7f1d44068b80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.769+0000 7f1d6f400640 1 --2- 172.21.15.7:0/2940261327 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1d680c7900 0x7f1d680c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.769+0000 7f1d6f400640 1 --2- 172.21.15.7:0/2940261327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d6806de60 0x7f1d680c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.769+0000 7f1d6f400640 1 --2- 172.21.15.7:0/2940261327 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1d6806da80 0x7f1d68151cd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.769+0000 7f1d6f400640 1 -- 172.21.15.7:0/2940261327 >> 172.21.15.7:0/2940261327 conn(0x7f1d6806c330 msgr2=0x7f1d680ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:16.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.769+0000 7f1d6f400640 1 -- 172.21.15.7:0/2940261327 shutdown_connections 2024-09-13T15:04:16.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.769+0000 7f1d6f400640 1 -- 172.21.15.7:0/2940261327 wait complete. 2024-09-13T15:04:16.790 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1464925128},{"type":"v1","addr":"172.21.15.77:6833","nonce":1464925128}]},"active_addr":"172.21.15.77:6833/1464925128","active_change":"2024-09-13T15:01:32.613573+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":2742271627}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":2915041109}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":995868446}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":1929397937}]}]} 2024-09-13T15:04:16.793 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T15:04:16.793 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T15:04:16.793 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:04:16.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.933+0000 7ff705800640 1 Processor -- start 2024-09-13T15:04:16.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.933+0000 7ff705800640 1 -- start start 2024-09-13T15:04:16.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.933+0000 7ff705800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff7000c04d0 0x7ff70006f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:16.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.933+0000 7ff705800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff700155ec0 con 0x7ff7000c00f0 2024-09-13T15:04:16.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.933+0000 7ff705800640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff70006ff60 con 0x7ff7000b0cb0 2024-09-13T15:04:16.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.933+0000 7ff705800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff700071000 con 0x7ff7000c04d0 2024-09-13T15:04:16.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.933+0000 7ff6fea00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff7000c00f0 0x7ff7000c5530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50786/0 (socket says 172.21.15.7:50786) 2024-09-13T15:04:16.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.933+0000 7ff6fea00640 1 -- 172.21.15.7:0/2142274896 learned_addr learned my addr 172.21.15.7:0/2142274896 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:16.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.933+0000 7ff6f6000640 1 --2- 172.21.15.7:0/2142274896 >> v2:172.21.15.7:3300/0 conn(0x7ff7000c04d0 0x7ff70006f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:16.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.933+0000 7ff6fe000640 1 -- 172.21.15.7:0/2142274896 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549276734 0 0) 0x7ff700155ec0 con 0x7ff7000c00f0 2024-09-13T15:04:16.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.937+0000 7ff6fe000640 1 -- 172.21.15.7:0/2142274896 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6e4005740 con 0x7ff7000c00f0 2024-09-13T15:04:16.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.937+0000 7ff6f6000640 1 -- 172.21.15.7:0/2142274896 >> v1:172.21.15.77:6789/0 conn(0x7ff7000b0cb0 legacy=0x7ff70014f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:16.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.937+0000 7ff6f6000640 1 -- 172.21.15.7:0/2142274896 >> v1:172.21.15.7:6789/0 conn(0x7ff7000c00f0 legacy=0x7ff7000c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:16.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.937+0000 7ff6f6000640 1 -- 172.21.15.7:0/2142274896 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff700156160 con 0x7ff7000c04d0 2024-09-13T15:04:16.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.937+0000 7ff6f6000640 1 --2- 172.21.15.7:0/2142274896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7000c04d0 0x7ff70006f600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80097c0 tx=0x7ff6e801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1ded09bcf4ba76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.937+0000 7ff6fe000640 1 -- 172.21.15.7:0/2142274896 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e80a8990 con 0x7ff7000c04d0 2024-09-13T15:04:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.937+0000 7ff6fe000640 1 -- 172.21.15.7:0/2142274896 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e80a8af0 con 0x7ff7000c04d0 2024-09-13T15:04:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.937+0000 7ff6fe000640 1 -- 172.21.15.7:0/2142274896 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e80a8e80 con 0x7ff7000c04d0 2024-09-13T15:04:16.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.937+0000 7ff705800640 1 -- 172.21.15.7:0/2142274896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7000c04d0 msgr2=0x7ff70006f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:16.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.937+0000 7ff705800640 1 --2- 172.21.15.7:0/2142274896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7000c04d0 0x7ff70006f600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80097c0 tx=0x7ff6e801ec90 comp rx=0 tx=0).stop 2024-09-13T15:04:16.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.937+0000 7ff705800640 1 -- 172.21.15.7:0/2142274896 shutdown_connections 2024-09-13T15:04:16.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.937+0000 7ff705800640 1 --2- 172.21.15.7:0/2142274896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7000c04d0 0x7ff70006f600 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.937+0000 7ff705800640 1 -- 172.21.15.7:0/2142274896 >> 172.21.15.7:0/2142274896 conn(0x7ff700065d40 msgr2=0x7ff700066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:16.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff705800640 1 -- 172.21.15.7:0/2142274896 shutdown_connections 2024-09-13T15:04:16.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff705800640 1 -- 172.21.15.7:0/2142274896 wait complete. 2024-09-13T15:04:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff705800640 1 Processor -- start 2024-09-13T15:04:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff705800640 1 -- start start 2024-09-13T15:04:16.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff705800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7000b0cb0 0x7ff7000adb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:16.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff705800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7000c00f0 0x7ff7001ef570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:16.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff705800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7000c04d0 0x7ff7000af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:16.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff705800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7001ef150 con 0x7ff7000c00f0 2024-09-13T15:04:16.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff705800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000afc10 con 0x7ff7000b0cb0 2024-09-13T15:04:16.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff705800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000b02a0 con 0x7ff7000c04d0 2024-09-13T15:04:16.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff6f6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7000c00f0 0x7ff7001ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:16.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff6f6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7000c00f0 0x7ff7001ef570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33854/0 (socket says 172.21.15.7:33854) 2024-09-13T15:04:16.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff6f6000640 1 -- 172.21.15.7:0/3100830655 learned_addr learned my addr 172.21.15.7:0/3100830655 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:16.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff6fea00640 1 --2- 172.21.15.7:0/3100830655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7000b0cb0 0x7ff7000adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:16.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff6ff400640 1 --2- 172.21.15.7:0/3100830655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7000c04d0 0x7ff7000af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff6f6000640 1 -- 172.21.15.7:0/3100830655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7000c04d0 msgr2=0x7ff7000af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff6f6000640 1 --2- 172.21.15.7:0/3100830655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7000c04d0 0x7ff7000af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff6f6000640 1 -- 172.21.15.7:0/3100830655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7000b0cb0 msgr2=0x7ff7000adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff6f6000640 1 --2- 172.21.15.7:0/3100830655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7000b0cb0 0x7ff7000adb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff6f6000640 1 -- 172.21.15.7:0/3100830655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e8009420 con 0x7ff7000c00f0 2024-09-13T15:04:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff6ff400640 1 --2- 172.21.15.7:0/3100830655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7000c04d0 0x7ff7000af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff6fea00640 1 --2- 172.21.15.7:0/3100830655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7000b0cb0 0x7ff7000adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.941+0000 7ff6f6000640 1 --2- 172.21.15.7:0/3100830655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7000c00f0 0x7ff7001ef570 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff6e801c8c0 tx=0x7ff6e801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.945+0000 7ff6f7400640 1 -- 172.21.15.7:0/3100830655 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e80bb640 con 0x7ff7000c00f0 2024-09-13T15:04:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.945+0000 7ff6f7400640 1 -- 172.21.15.7:0/3100830655 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e80bb7c0 con 0x7ff7000c00f0 2024-09-13T15:04:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.945+0000 7ff705800640 1 -- 172.21.15.7:0/3100830655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7001eeab0 con 0x7ff7000c00f0 2024-09-13T15:04:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.945+0000 7ff6f7400640 1 -- 172.21.15.7:0/3100830655 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e80bbb70 con 0x7ff7000c00f0 2024-09-13T15:04:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.945+0000 7ff705800640 1 -- 172.21.15.7:0/3100830655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7000b0510 con 0x7ff7000c00f0 2024-09-13T15:04:16.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.945+0000 7ff705800640 1 -- 172.21.15.7:0/3100830655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff700067650 con 0x7ff7000c00f0 2024-09-13T15:04:16.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.945+0000 7ff6f7400640 1 -- 172.21.15.7:0/3100830655 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff6e80b7040 con 0x7ff7000c00f0 2024-09-13T15:04:16.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.945+0000 7ff6f7400640 1 --2- 172.21.15.7:0/3100830655 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff6dc0666c0 0x7ff6dc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:16.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.945+0000 7ff6f7400640 1 -- 172.21.15.7:0/3100830655 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff6e8122900 con 0x7ff7000c00f0 2024-09-13T15:04:16.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.945+0000 7ff6fea00640 1 --2- 172.21.15.7:0/3100830655 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff6dc0666c0 0x7ff6dc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:16.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.949+0000 7ff6fea00640 1 --2- 172.21.15.7:0/3100830655 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff6dc0666c0 0x7ff6dc068b80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00011f0 tx=0x7ff6f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:16.949+0000 7ff6f7400640 1 -- 172.21.15.7:0/3100830655 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff6e80ef810 con 0x7ff7000c00f0 2024-09-13T15:04:17.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.113+0000 7ff705800640 1 -- 172.21.15.7:0/3100830655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7001ef290 con 0x7ff7000c00f0 2024-09-13T15:04:17.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.113+0000 7ff6f7400640 1 -- 172.21.15.7:0/3100830655 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18616 (secure 0 0 0) 0x7ff7001ef290 con 0x7ff7000c00f0 2024-09-13T15:04:17.117 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:17.117 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:02:33.732864+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:04:17.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.117+0000 7ff705800640 1 -- 172.21.15.7:0/3100830655 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff6dc0666c0 msgr2=0x7ff6dc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.117+0000 7ff705800640 1 --2- 172.21.15.7:0/3100830655 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff6dc0666c0 0x7ff6dc068b80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff6f00011f0 tx=0x7ff6f0009040 comp rx=0 tx=0).stop 2024-09-13T15:04:17.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.117+0000 7ff705800640 1 -- 172.21.15.7:0/3100830655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7000c00f0 msgr2=0x7ff7001ef570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.117+0000 7ff705800640 1 --2- 172.21.15.7:0/3100830655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7000c00f0 0x7ff7001ef570 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff6e801c8c0 tx=0x7ff6e801ba30 comp rx=0 tx=0).stop 2024-09-13T15:04:17.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.117+0000 7ff705800640 1 -- 172.21.15.7:0/3100830655 shutdown_connections 2024-09-13T15:04:17.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.117+0000 7ff705800640 1 --2- 172.21.15.7:0/3100830655 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff6dc0666c0 0x7ff6dc068b80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.117+0000 7ff705800640 1 --2- 172.21.15.7:0/3100830655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff7000c04d0 0x7ff7000af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.117+0000 7ff705800640 1 --2- 172.21.15.7:0/3100830655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7000c00f0 0x7ff7001ef570 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.117+0000 7ff705800640 1 --2- 172.21.15.7:0/3100830655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff7000b0cb0 0x7ff7000adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.117+0000 7ff705800640 1 -- 172.21.15.7:0/3100830655 >> 172.21.15.7:0/3100830655 conn(0x7ff700065d40 msgr2=0x7ff70006f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.117+0000 7ff705800640 1 -- 172.21.15.7:0/3100830655 shutdown_connections 2024-09-13T15:04:17.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.117+0000 7ff705800640 1 -- 172.21.15.7:0/3100830655 wait complete. 2024-09-13T15:04:17.137 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T15:04:17.138 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:04:17.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.277+0000 7f8bf7800640 1 Processor -- start 2024-09-13T15:04:17.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.277+0000 7f8bf7800640 1 -- start start 2024-09-13T15:04:17.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.277+0000 7f8bf7800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bf00cbfa0 0x7f8bf00c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.277+0000 7f8bf7800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8bf00cb300 0x7f8bf00c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.277+0000 7f8bf7800640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf0156d80 con 0x7f8bf00cbbc0 2024-09-13T15:04:17.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.277+0000 7f8bf7800640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf0155f20 con 0x7f8bf00cb300 2024-09-13T15:04:17.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.277+0000 7f8bf7800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf0156200 con 0x7f8bf00cbfa0 2024-09-13T15:04:17.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.277+0000 7f8be7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bf00cbfa0 0x7f8bf00c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.277+0000 7f8bf5800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8bf00cb300 0x7f8bf00c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.277+0000 7f8bf5800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8bf00cb300 0x7f8bf00c4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56414/0 (socket says 172.21.15.7:56414) 2024-09-13T15:04:17.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.277+0000 7f8be7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bf00cbfa0 0x7f8bf00c47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:41592/0 (socket says 172.21.15.7:41592) 2024-09-13T15:04:17.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.277+0000 7f8bf5800640 1 -- 172.21.15.7:0/3630794550 learned_addr learned my addr 172.21.15.7:0/3630794550 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:17.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.277+0000 7f8bf4e00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8bf00cbbc0 0x7f8bf00ca0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:45676/0 (socket says 172.21.15.7:45676) 2024-09-13T15:04:17.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.277+0000 7f8bf5800640 1 -- 172.21.15.7:0/3630794550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bf00cbfa0 msgr2=0x7f8bf00c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:17.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.277+0000 7f8bf5800640 1 --2- 172.21.15.7:0/3630794550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bf00cbfa0 0x7f8bf00c47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.277+0000 7f8bf5800640 1 -- 172.21.15.7:0/3630794550 >> v1:172.21.15.77:6789/0 conn(0x7f8bf00cbbc0 legacy=0x7f8bf00ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.277+0000 7f8bf5800640 1 -- 172.21.15.7:0/3630794550 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf01564e0 con 0x7f8bf00cb300 2024-09-13T15:04:17.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.281+0000 7f8bf5800640 1 --2- 172.21.15.7:0/3630794550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00cb300 0x7f8bf00c4d00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8be8009e50 tx=0x7f8be801f210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f257d15a7d879e61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.281+0000 7f8befe00640 1 -- 172.21.15.7:0/3630794550 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be80af400 con 0x7f8bf00cb300 2024-09-13T15:04:17.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.281+0000 7f8befe00640 1 -- 172.21.15.7:0/3630794550 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be80ab050 con 0x7f8bf00cb300 2024-09-13T15:04:17.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.281+0000 7f8befe00640 1 -- 172.21.15.7:0/3630794550 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be80af780 con 0x7f8bf00cb300 2024-09-13T15:04:17.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.281+0000 7f8bf7800640 1 -- 172.21.15.7:0/3630794550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00cb300 msgr2=0x7f8bf00c4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.281+0000 7f8bf7800640 1 --2- 172.21.15.7:0/3630794550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00cb300 0x7f8bf00c4d00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8be8009e50 tx=0x7f8be801f210 comp rx=0 tx=0).stop 2024-09-13T15:04:17.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.281+0000 7f8bf7800640 1 -- 172.21.15.7:0/3630794550 shutdown_connections 2024-09-13T15:04:17.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.281+0000 7f8bf7800640 1 --2- 172.21.15.7:0/3630794550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00cb300 0x7f8bf00c4d00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.281+0000 7f8bf7800640 1 --2- 172.21.15.7:0/3630794550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bf00cbfa0 0x7f8bf00c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.281+0000 7f8bf7800640 1 -- 172.21.15.7:0/3630794550 >> 172.21.15.7:0/3630794550 conn(0x7f8bf006e1f0 msgr2=0x7f8bf006e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.281+0000 7f8bf7800640 1 -- 172.21.15.7:0/3630794550 shutdown_connections 2024-09-13T15:04:17.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.281+0000 7f8bf7800640 1 -- 172.21.15.7:0/3630794550 wait complete. 2024-09-13T15:04:17.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8bf7800640 1 Processor -- start 2024-09-13T15:04:17.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8bf7800640 1 -- start start 2024-09-13T15:04:17.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8bf7800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00cb300 0x7f8bf0144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8bf7800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bf00cbbc0 0x7f8bf0162580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8bf7800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bf00cbfa0 0x7f8bf014b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8bf7800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf0163300 con 0x7f8bf00cbbc0 2024-09-13T15:04:17.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8bf7800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf014d5f0 con 0x7f8bf00cb300 2024-09-13T15:04:17.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8bf7800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf0155ae0 con 0x7f8bf00cbfa0 2024-09-13T15:04:17.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8be7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bf00cbbc0 0x7f8bf0162580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8be7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bf00cbbc0 0x7f8bf0162580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33868/0 (socket says 172.21.15.7:33868) 2024-09-13T15:04:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8be7e00640 1 -- 172.21.15.7:0/3146196977 learned_addr learned my addr 172.21.15.7:0/3146196977 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8bf4e00640 1 --2- 172.21.15.7:0/3146196977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00cb300 0x7f8bf0144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8bf5800640 1 --2- 172.21.15.7:0/3146196977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bf00cbfa0 0x7f8bf014b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8be7e00640 1 -- 172.21.15.7:0/3146196977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bf00cbfa0 msgr2=0x7f8bf014b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8be7e00640 1 --2- 172.21.15.7:0/3146196977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bf00cbfa0 0x7f8bf014b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8be7e00640 1 -- 172.21.15.7:0/3146196977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00cb300 msgr2=0x7f8bf0144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8be7e00640 1 --2- 172.21.15.7:0/3146196977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00cb300 0x7f8bf0144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8be7e00640 1 -- 172.21.15.7:0/3146196977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be8009b30 con 0x7f8bf00cbbc0 2024-09-13T15:04:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8bf5800640 1 --2- 172.21.15.7:0/3146196977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bf00cbfa0 0x7f8bf014b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8be7e00640 1 --2- 172.21.15.7:0/3146196977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bf00cbbc0 0x7f8bf0162580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800e840 tx=0x7f8bd800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8bed600640 1 -- 172.21.15.7:0/3146196977 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd8009510 con 0x7f8bf00cbbc0 2024-09-13T15:04:17.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8bed600640 1 -- 172.21.15.7:0/3146196977 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd800ee90 con 0x7f8bf00cbbc0 2024-09-13T15:04:17.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8bed600640 1 -- 172.21.15.7:0/3146196977 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd800cb60 con 0x7f8bf00cbbc0 2024-09-13T15:04:17.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8bf7800640 1 -- 172.21.15.7:0/3146196977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf01617e0 con 0x7f8bf00cbbc0 2024-09-13T15:04:17.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.285+0000 7f8bf7800640 1 -- 172.21.15.7:0/3146196977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf0163510 con 0x7f8bf00cbbc0 2024-09-13T15:04:17.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.289+0000 7f8bf7800640 1 -- 172.21.15.7:0/3146196977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf00ca0e0 con 0x7f8bf00cbbc0 2024-09-13T15:04:17.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.289+0000 7f8bed600640 1 -- 172.21.15.7:0/3146196977 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8bd800ccc0 con 0x7f8bf00cbbc0 2024-09-13T15:04:17.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.289+0000 7f8bed600640 1 --2- 172.21.15.7:0/3146196977 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8bcc0666c0 0x7f8bcc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.289+0000 7f8bed600640 1 -- 172.21.15.7:0/3146196977 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8bd8084690 con 0x7f8bf00cbbc0 2024-09-13T15:04:17.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.289+0000 7f8bf4e00640 1 --2- 172.21.15.7:0/3146196977 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8bcc0666c0 0x7f8bcc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.289+0000 7f8bf4e00640 1 --2- 172.21.15.7:0/3146196977 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8bcc0666c0 0x7f8bcc068b80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8be0000f70 tx=0x7f8be0007e90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.293+0000 7f8bed600640 1 -- 172.21.15.7:0/3146196977 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8bd80515c0 con 0x7f8bf00cbbc0 2024-09-13T15:04:17.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.453+0000 7f8bf7800640 1 -- 172.21.15.7:0/3146196977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bf0070a00 con 0x7f8bf00cbbc0 2024-09-13T15:04:17.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.457+0000 7f8bed600640 1 -- 172.21.15.7:0/3146196977 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18616 (secure 0 0 0) 0x7f8bd8054be0 con 0x7f8bf00cbbc0 2024-09-13T15:04:17.458 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:17.459 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:02:33.732864+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:04:17.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.457+0000 7f8bf7800640 1 -- 172.21.15.7:0/3146196977 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8bcc0666c0 msgr2=0x7f8bcc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.457+0000 7f8bf7800640 1 --2- 172.21.15.7:0/3146196977 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8bcc0666c0 0x7f8bcc068b80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8be0000f70 tx=0x7f8be0007e90 comp rx=0 tx=0).stop 2024-09-13T15:04:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.457+0000 7f8bf7800640 1 -- 172.21.15.7:0/3146196977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bf00cbbc0 msgr2=0x7f8bf0162580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.457+0000 7f8bf7800640 1 --2- 172.21.15.7:0/3146196977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bf00cbbc0 0x7f8bf0162580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8bd800e840 tx=0x7f8bd800ec40 comp rx=0 tx=0).stop 2024-09-13T15:04:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.457+0000 7f8bf7800640 1 -- 172.21.15.7:0/3146196977 shutdown_connections 2024-09-13T15:04:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.457+0000 7f8bf7800640 1 --2- 172.21.15.7:0/3146196977 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8bcc0666c0 0x7f8bcc068b80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.457+0000 7f8bf7800640 1 --2- 172.21.15.7:0/3146196977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8bf00cbfa0 0x7f8bf014b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.457+0000 7f8bf7800640 1 --2- 172.21.15.7:0/3146196977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8bf00cbbc0 0x7f8bf0162580 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.457+0000 7f8bf7800640 1 --2- 172.21.15.7:0/3146196977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf00cb300 0x7f8bf0144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.457+0000 7f8bf7800640 1 -- 172.21.15.7:0/3146196977 >> 172.21.15.7:0/3146196977 conn(0x7f8bf006e1f0 msgr2=0x7f8bf014f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.457+0000 7f8bf7800640 1 -- 172.21.15.7:0/3146196977 shutdown_connections 2024-09-13T15:04:17.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.457+0000 7f8bf7800640 1 -- 172.21.15.7:0/3146196977 wait complete. 2024-09-13T15:04:17.480 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T15:04:17.480 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T15:04:17.480 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T15:04:17.481 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T15:04:17.481 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T15:04:17.482 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T15:04:17.482 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T15:04:17.482 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T15:04:17.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.733+0000 7efd23e00640 1 Processor -- start 2024-09-13T15:04:17.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.733+0000 7efd23e00640 1 -- start start 2024-09-13T15:04:17.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.733+0000 7efd23e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efd1c06cf70 0x7efd1c155e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.733+0000 7efd23e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efd1c06da60 0x7efd1c152460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.733+0000 7efd23e00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1c1563b0 con 0x7efd1c06d350 2024-09-13T15:04:17.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.733+0000 7efd23e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd1c0c6640 con 0x7efd1c06da60 2024-09-13T15:04:17.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.733+0000 7efd23e00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd1c0c56e0 con 0x7efd1c06cf70 2024-09-13T15:04:17.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.733+0000 7fa31fa00640 1 Processor -- start 2024-09-13T15:04:17.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.733+0000 7efd21400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efd1c06cf70 0x7efd1c155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.733+0000 7efd21400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efd1c06cf70 0x7efd1c155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56428/0 (socket says 172.21.15.7:56428) 2024-09-13T15:04:17.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.733+0000 7efd21400640 1 -- 172.21.15.7:0/3988441315 learned_addr learned my addr 172.21.15.7:0/3988441315 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:17.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.733+0000 7efd21e00640 1 --2- 172.21.15.7:0/3988441315 >> v2:172.21.15.7:3300/0 conn(0x7efd1c06da60 0x7efd1c152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.737+0000 7efd21400640 1 -- 172.21.15.7:0/3988441315 >> v2:172.21.15.7:3300/0 conn(0x7efd1c06da60 msgr2=0x7efd1c152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:17.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.737+0000 7efd21400640 1 --2- 172.21.15.7:0/3988441315 >> v2:172.21.15.7:3300/0 conn(0x7efd1c06da60 0x7efd1c152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.737+0000 7efd21400640 1 -- 172.21.15.7:0/3988441315 >> v1:172.21.15.77:6789/0 conn(0x7efd1c06d350 legacy=0x7efd1c156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.737+0000 7efd21400640 1 -- 172.21.15.7:0/3988441315 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c0c59c0 con 0x7efd1c06cf70 2024-09-13T15:04:17.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.737+0000 7fa31fa00640 1 -- start start 2024-09-13T15:04:17.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.737+0000 7f57a9e00640 1 Processor -- start 2024-09-13T15:04:17.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7f57a9e00640 1 -- start start 2024-09-13T15:04:17.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7fa31fa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa318153350 0x7fa3180c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7fa31fa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa31815c900 0x7fa31815cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7fa31fa00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa31806c210 con 0x7fa31806bad0 2024-09-13T15:04:17.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7fa31fa00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3180c1b30 con 0x7fa318153350 2024-09-13T15:04:17.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7fa31fa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31815d2b0 con 0x7fa31815c900 2024-09-13T15:04:17.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7efd21400640 1 --2- 172.21.15.7:0/3988441315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd1c06cf70 0x7efd1c155e70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efd1c06c150 tx=0x7efd0801e970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e7cf2bb40547da0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7fdca7e00640 1 Processor -- start 2024-09-13T15:04:17.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7fa31da00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa31815c900 0x7fa31815cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7fa31da00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa31815c900 0x7fa31815cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:41610/0 (socket says 172.21.15.7:41610) 2024-09-13T15:04:17.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7fa31da00640 1 -- 172.21.15.7:0/4136176326 learned_addr learned my addr 172.21.15.7:0/4136176326 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:17.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7fa31d000640 1 --2- 172.21.15.7:0/4136176326 >> v2:172.21.15.7:3300/0 conn(0x7fa318153350 0x7fa3180c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7fa317e00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa31806bad0 0x7fa3180bffe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:45698/0 (socket says 172.21.15.7:45698) 2024-09-13T15:04:17.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7fa31da00640 1 -- 172.21.15.7:0/4136176326 >> v2:172.21.15.7:3300/0 conn(0x7fa318153350 msgr2=0x7fa3180c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:17.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7fa31da00640 1 --2- 172.21.15.7:0/4136176326 >> v2:172.21.15.7:3300/0 conn(0x7fa318153350 0x7fa3180c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7fa31da00640 1 -- 172.21.15.7:0/4136176326 >> v1:172.21.15.77:6789/0 conn(0x7fa31806bad0 legacy=0x7fa3180bffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7fa31da00640 1 -- 172.21.15.7:0/4136176326 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3180afe90 con 0x7fa31815c900 2024-09-13T15:04:17.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7fdca7e00640 1 -- start start 2024-09-13T15:04:17.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7f57a9e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f579c0dcbe0 0x7f579c0e35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7f57a9e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f579c0dcfc0 0x7f579c04e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7f57a9e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f579c008820 0x7f579c046e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7f57a9e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c04dfb0 con 0x7f579c008820 2024-09-13T15:04:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7f57a9e00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c008c90 con 0x7f579c0dcfc0 2024-09-13T15:04:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7f57a9e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c008ef0 con 0x7f579c0dcbe0 2024-09-13T15:04:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7f57a8a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f579c0dcbe0 0x7f579c0e35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7efd1be00640 1 -- 172.21.15.7:0/3988441315 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd080a7a40 con 0x7efd1c06cf70 2024-09-13T15:04:17.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7efd1be00640 1 -- 172.21.15.7:0/3988441315 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd080ab070 con 0x7efd1c06cf70 2024-09-13T15:04:17.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7efd1be00640 1 -- 172.21.15.7:0/3988441315 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd080a7dc0 con 0x7efd1c06cf70 2024-09-13T15:04:17.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7f57a8a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f579c0dcbe0 0x7f579c0e35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:41618/0 (socket says 172.21.15.7:41618) 2024-09-13T15:04:17.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7f57a8a00640 1 -- 172.21.15.7:0/4169409899 learned_addr learned my addr 172.21.15.7:0/4169409899 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:17.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7f57a3e00640 1 --2- 172.21.15.7:0/4169409899 >> v2:172.21.15.77:3300/0 conn(0x7f579c0dcfc0 0x7f579c04e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f57a8a00640 1 -- 172.21.15.7:0/4169409899 >> v2:172.21.15.77:3300/0 conn(0x7f579c0dcfc0 msgr2=0x7f579c04e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:17.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f57a8a00640 1 --2- 172.21.15.7:0/4169409899 >> v2:172.21.15.77:3300/0 conn(0x7f579c0dcfc0 0x7f579c04e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f57a8a00640 1 -- 172.21.15.7:0/4169409899 >> v2:172.21.15.7:3300/0 conn(0x7f579c008820 msgr2=0x7f579c046e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:17.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f57a8a00640 1 --2- 172.21.15.7:0/4169409899 >> v2:172.21.15.7:3300/0 conn(0x7f579c008820 0x7f579c046e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f57a8a00640 1 -- 172.21.15.7:0/4169409899 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c0091d0 con 0x7f579c0dcbe0 2024-09-13T15:04:17.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f176f800640 1 Processor -- start 2024-09-13T15:04:17.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7efd23e00640 1 -- 172.21.15.7:0/3988441315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd1c06cf70 msgr2=0x7efd1c155e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7efd23e00640 1 --2- 172.21.15.7:0/3988441315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd1c06cf70 0x7efd1c155e70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efd1c06c150 tx=0x7efd0801e970 comp rx=0 tx=0).stop 2024-09-13T15:04:17.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7efd23e00640 1 -- 172.21.15.7:0/3988441315 shutdown_connections 2024-09-13T15:04:17.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7efd23e00640 1 --2- 172.21.15.7:0/3988441315 >> v2:172.21.15.7:3300/0 conn(0x7efd1c06da60 0x7efd1c152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7efd23e00640 1 --2- 172.21.15.7:0/3988441315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd1c06cf70 0x7efd1c155e70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7efd23e00640 1 -- 172.21.15.7:0/3988441315 >> 172.21.15.7:0/3988441315 conn(0x7efd1c0c7380 msgr2=0x7efd1c0c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7fdca7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdca814fcd0 0x7fdca81500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7fdca7e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdca8159bd0 0x7fdca80c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7fdca7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdca80c6ff0 0x7fdca80c7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7fdca7e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca8070ca0 con 0x7fdca814fcd0 2024-09-13T15:04:17.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7fdca7e00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca80c8100 con 0x7fdca8159bd0 2024-09-13T15:04:17.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7fdca7e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca80c83e0 con 0x7fdca80c6ff0 2024-09-13T15:04:17.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7f036be00640 1 Processor -- start 2024-09-13T15:04:17.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.741+0000 7f036be00640 1 -- start start 2024-09-13T15:04:17.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f036be00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f036c0b35b0 0x7f036c0c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f176f800640 1 -- start start 2024-09-13T15:04:17.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f036be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f036c0b3990 0x7f036c0c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f036aa00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f036c0b35b0 0x7f036c0c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f036be00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f036c0cec70 0x7f036c0cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f036aa00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f036c0b35b0 0x7f036c0c92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56440/0 (socket says 172.21.15.7:56440) 2024-09-13T15:04:17.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7efd23e00640 1 -- 172.21.15.7:0/3988441315 shutdown_connections 2024-09-13T15:04:17.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f036be00640 1 -- 172.21.15.7:0/2833427306 --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036c0c5740 con 0x7f036c0b3990 2024-09-13T15:04:17.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f036be00640 1 -- 172.21.15.7:0/2833427306 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f036c0ca1d0 con 0x7f036c0b35b0 2024-09-13T15:04:17.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f036be00640 1 -- 172.21.15.7:0/2833427306 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036c15e200 con 0x7f036c0cec70 2024-09-13T15:04:17.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f036a000640 1 --2- 172.21.15.7:0/2833427306 >> v2:172.21.15.7:3300/0 conn(0x7f036c0b3990 0x7f036c0c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f036aa00640 1 -- 172.21.15.7:0/2833427306 learned_addr learned my addr 172.21.15.7:0/2833427306 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:17.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f036b400640 1 --2- 172.21.15.7:0/2833427306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f036c0cec70 0x7f036c0cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7fdca7400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdca80c6ff0 0x7fdca80c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7fdca6000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdca8159bd0 0x7fdca80c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7fdca7400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdca80c6ff0 0x7fdca80c7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:41630/0 (socket says 172.21.15.7:41630) 2024-09-13T15:04:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7fdca7400640 1 -- 172.21.15.7:0/1212589328 learned_addr learned my addr 172.21.15.7:0/1212589328 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7fdca6a00640 1 --2- 172.21.15.7:0/1212589328 >> v2:172.21.15.7:3300/0 conn(0x7fdca814fcd0 0x7fdca81500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7f57a8a00640 1 --2- 172.21.15.7:0/4169409899 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f579c0dcbe0 0x7f579c0e35d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f579c00e910 tx=0x7f579801ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e36a718334e373a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7f57a3400640 1 -- 172.21.15.7:0/4169409899 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980a89f0 con 0x7f579c0dcbe0 2024-09-13T15:04:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7f57a3400640 1 -- 172.21.15.7:0/4169409899 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57980a8b50 con 0x7f579c0dcbe0 2024-09-13T15:04:17.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7f57a3400640 1 -- 172.21.15.7:0/4169409899 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980b0440 con 0x7f579c0dcbe0 2024-09-13T15:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7f176f800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f176815cea0 0x7f17680bc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7f176f800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17680c6140 con 0x7f176815cac0 2024-09-13T15:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7f176f800640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176806ce90 con 0x7f1768153730 2024-09-13T15:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7f176f800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176806d170 con 0x7f176815cea0 2024-09-13T15:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7f176ce00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f176815cac0 0x7f1768153020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50796/0 (socket says 172.21.15.7:50796) 2024-09-13T15:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7f176ce00640 1 -- 172.21.15.7:0/1499220684 learned_addr learned my addr 172.21.15.7:0/1499220684 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:17.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7fa31da00640 1 --2- 172.21.15.7:0/4136176326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa31815c900 0x7fa31815cd70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa310009e50 tx=0x7fa31001c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51d1fc229ab9e3ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7efd23e00640 1 -- 172.21.15.7:0/3988441315 wait complete. 2024-09-13T15:04:17.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7efd23e00640 1 Processor -- start 2024-09-13T15:04:17.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7efd23e00640 1 -- start start 2024-09-13T15:04:17.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7efd23e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd1c06cf70 0x7efd1c1f27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7efd23e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd1c06d350 0x7efd1c1f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7efd23e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd1c06da60 0x7efd1c1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7efd23e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c0bd490 con 0x7efd1c06da60 2024-09-13T15:04:17.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7efd23e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c154920 con 0x7efd1c06d350 2024-09-13T15:04:17.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7efd23e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1c0bdca0 con 0x7efd1c06cf70 2024-09-13T15:04:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7efd20a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd1c06d350 0x7efd1c1f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7efd21e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd1c06da60 0x7efd1c1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7efd20a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd1c06d350 0x7efd1c1f3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56462/0 (socket says 172.21.15.7:56462) 2024-09-13T15:04:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f036aa00640 1 -- 172.21.15.7:0/2833427306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f036c0cec70 msgr2=0x7f036c0cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f036aa00640 1 --2- 172.21.15.7:0/2833427306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f036c0cec70 0x7f036c0cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f036aa00640 1 -- 172.21.15.7:0/2833427306 >> v2:172.21.15.7:3300/0 conn(0x7f036c0b3990 msgr2=0x7f036c0c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f036aa00640 1 --2- 172.21.15.7:0/2833427306 >> v2:172.21.15.7:3300/0 conn(0x7f036c0b3990 0x7f036c0c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f036b400640 1 --2- 172.21.15.7:0/2833427306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f036c0cec70 0x7f036c0cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7f036aa00640 1 -- 172.21.15.7:0/2833427306 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c15d3a0 con 0x7f036c0b35b0 2024-09-13T15:04:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7fdca6000640 1 -- 172.21.15.7:0/1212589328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdca80c6ff0 msgr2=0x7fdca80c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7fdca6000640 1 --2- 172.21.15.7:0/1212589328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdca80c6ff0 0x7fdca80c7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7fdca6000640 1 -- 172.21.15.7:0/1212589328 >> v2:172.21.15.7:3300/0 conn(0x7fdca814fcd0 msgr2=0x7fdca81500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7fdca6000640 1 --2- 172.21.15.7:0/1212589328 >> v2:172.21.15.7:3300/0 conn(0x7fdca814fcd0 0x7fdca81500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7fdca6000640 1 -- 172.21.15.7:0/1212589328 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca80c86c0 con 0x7fdca8159bd0 2024-09-13T15:04:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.745+0000 7fdca7400640 1 --2- 172.21.15.7:0/1212589328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdca80c6ff0 0x7fdca80c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7fe46d200640 1 Processor -- start 2024-09-13T15:04:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7fe46d200640 1 -- start start 2024-09-13T15:04:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7fe46d200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe468151590 0x7fe468157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7f2f34200640 1 Processor -- start 2024-09-13T15:04:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7f2f34200640 1 -- start start 2024-09-13T15:04:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7f2f34200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2f2c1576f0 0x7f2f2c0c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7f176d800640 1 --2- 172.21.15.7:0/1499220684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f176815cea0 0x7f17680bc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7efd20a00640 1 -- 172.21.15.7:0/3456892577 learned_addr learned my addr 172.21.15.7:0/3456892577 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:17.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7f2f34200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2c06d080 con 0x7f2f2c06dc20 2024-09-13T15:04:17.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7fe46d200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4680c7ea0 0x7fe4680c6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7fe46d200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe46815a7a0 0x7fe4680717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7fe46d200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe468151970 con 0x7fe46815a7a0 2024-09-13T15:04:17.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7fe46d200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe46815b030 con 0x7fe468151590 2024-09-13T15:04:17.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7fe46d200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46815b310 con 0x7fe4680c7ea0 2024-09-13T15:04:17.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7fe465e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe468151590 0x7fe468157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7fe465400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4680c7ea0 0x7fe4680c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7fe465e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe468151590 0x7fe468157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56466/0 (socket says 172.21.15.7:56466) 2024-09-13T15:04:17.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7fe465e00640 1 -- 172.21.15.7:0/1788120867 learned_addr learned my addr 172.21.15.7:0/1788120867 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:17.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7f2f34200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2c0c5b90 con 0x7f2f2c06f6b0 2024-09-13T15:04:17.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7f2f34200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c15e560 con 0x7f2f2c1576f0 2024-09-13T15:04:17.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.749+0000 7efd21400640 1 --2- 172.21.15.7:0/3456892577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd1c06cf70 0x7efd1c1f27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f2f30e00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2f2c06f6b0 0x7f2f2c06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:45706/0 (socket says 172.21.15.7:45706) 2024-09-13T15:04:17.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f2f30e00640 1 -- 172.21.15.7:0/1082662943 learned_addr learned my addr 172.21.15.7:0/1082662943 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:17.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f176d800640 1 -- 172.21.15.7:0/1499220684 >> v1:172.21.15.77:6789/0 conn(0x7f1768153730 legacy=0x7f1768161be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f176d800640 1 -- 172.21.15.7:0/1499220684 >> v1:172.21.15.7:6789/0 conn(0x7f176815cac0 legacy=0x7f1768153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f176d800640 1 -- 172.21.15.7:0/1499220684 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176806d450 con 0x7f176815cea0 2024-09-13T15:04:17.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fa317400640 1 -- 172.21.15.7:0/4136176326 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3100a5830 con 0x7fa31815c900 2024-09-13T15:04:17.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fe465e00640 1 -- 172.21.15.7:0/1788120867 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4680c7ea0 msgr2=0x7fe4680c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:17.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fe465e00640 1 --2- 172.21.15.7:0/1788120867 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4680c7ea0 0x7fe4680c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fe465e00640 1 -- 172.21.15.7:0/1788120867 >> v2:172.21.15.7:3300/0 conn(0x7fe46815a7a0 msgr2=0x7fe4680717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:17.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fe465e00640 1 --2- 172.21.15.7:0/1788120867 >> v2:172.21.15.7:3300/0 conn(0x7fe46815a7a0 0x7fe4680717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fe465e00640 1 -- 172.21.15.7:0/1788120867 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe468157340 con 0x7fe468151590 2024-09-13T15:04:17.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fdca6000640 1 --2- 172.21.15.7:0/1212589328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdca8159bd0 0x7fdca80c67c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdca806d960 tx=0x7fdc9801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afd34c1ff30b22cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fa317400640 1 -- 172.21.15.7:0/4136176326 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3100a5990 con 0x7fa31815c900 2024-09-13T15:04:17.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f2f31800640 1 --2- 172.21.15.7:0/1082662943 >> v2:172.21.15.7:3300/0 conn(0x7f2f2c1576f0 0x7f2f2c0c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7efd21400640 1 -- 172.21.15.7:0/3456892577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd1c06d350 msgr2=0x7efd1c1f3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7efd21400640 1 --2- 172.21.15.7:0/3456892577 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd1c06d350 0x7efd1c1f3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7efd21400640 1 -- 172.21.15.7:0/3456892577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd1c06da60 msgr2=0x7efd1c1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7efd21400640 1 --2- 172.21.15.7:0/3456892577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd1c06da60 0x7efd1c1543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f2f2be00640 1 -- 172.21.15.7:0/1082662943 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785011373 0 0) 0x7f2f2c0c5b90 con 0x7f2f2c06f6b0 2024-09-13T15:04:17.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fa317400640 1 -- 172.21.15.7:0/4136176326 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3100a5d20 con 0x7fa31815c900 2024-09-13T15:04:17.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7efd21400640 1 -- 172.21.15.7:0/3456892577 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd08008550 con 0x7efd1c06cf70 2024-09-13T15:04:17.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7efd21e00640 1 --2- 172.21.15.7:0/3456892577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd1c06da60 0x7efd1c1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f2f2be00640 1 -- 172.21.15.7:0/1082662943 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f10003530 con 0x7f2f2c06f6b0 2024-09-13T15:04:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fdca5600640 1 -- 172.21.15.7:0/1212589328 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980a8950 con 0x7fdca8159bd0 2024-09-13T15:04:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f57a9e00640 1 -- 172.21.15.7:0/4169409899 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f579c0dcbe0 msgr2=0x7f579c0e35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f57a9e00640 1 --2- 172.21.15.7:0/4169409899 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f579c0dcbe0 0x7f579c0e35d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f579c00e910 tx=0x7f579801ed30 comp rx=0 tx=0).stop 2024-09-13T15:04:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fdca5600640 1 -- 172.21.15.7:0/1212589328 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc980a8ab0 con 0x7fdca8159bd0 2024-09-13T15:04:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f57a9e00640 1 -- 172.21.15.7:0/4169409899 shutdown_connections 2024-09-13T15:04:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f57a9e00640 1 --2- 172.21.15.7:0/4169409899 >> v2:172.21.15.7:3300/0 conn(0x7f579c008820 0x7f579c046e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f57a9e00640 1 --2- 172.21.15.7:0/4169409899 >> v2:172.21.15.77:3300/0 conn(0x7f579c0dcfc0 0x7f579c04e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f57a9e00640 1 --2- 172.21.15.7:0/4169409899 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f579c0dcbe0 0x7f579c0e35d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f57a9e00640 1 -- 172.21.15.7:0/4169409899 >> 172.21.15.7:0/4169409899 conn(0x7f579c00db70 msgr2=0x7f579c00df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f57a9e00640 1 -- 172.21.15.7:0/4169409899 shutdown_connections 2024-09-13T15:04:17.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f2f31800640 1 -- 172.21.15.7:0/1082662943 >> v1:172.21.15.77:6789/0 conn(0x7f2f2c06f6b0 legacy=0x7f2f2c06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f2f31800640 1 -- 172.21.15.7:0/1082662943 >> v1:172.21.15.7:6789/0 conn(0x7f2f2c06dc20 legacy=0x7f2f2c15d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f036aa00640 1 --2- 172.21.15.7:0/2833427306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f036c0b35b0 0x7f036c0c92e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f036c0cf7c0 tx=0x7f035c01ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be50b23e4e8c51f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fa31fa00640 1 -- 172.21.15.7:0/4136176326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa31815c900 msgr2=0x7fa31815cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fa31fa00640 1 --2- 172.21.15.7:0/4136176326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa31815c900 0x7fa31815cd70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa310009e50 tx=0x7fa31001c990 comp rx=0 tx=0).stop 2024-09-13T15:04:17.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7efd21400640 1 --2- 172.21.15.7:0/3456892577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd1c06cf70 0x7efd1c1f27f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efd080af000 tx=0x7efd0801d1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f0369600640 1 -- 172.21.15.7:0/2833427306 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c0a89d0 con 0x7f036c0b35b0 2024-09-13T15:04:17.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f0369600640 1 -- 172.21.15.7:0/2833427306 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035c0a8b30 con 0x7f036c0b35b0 2024-09-13T15:04:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fdca5600640 1 -- 172.21.15.7:0/1212589328 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980a8950 con 0x7fdca8159bd0 2024-09-13T15:04:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fdca7e00640 1 -- 172.21.15.7:0/1212589328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdca8159bd0 msgr2=0x7fdca80c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fdca7e00640 1 --2- 172.21.15.7:0/1212589328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdca8159bd0 0x7fdca80c67c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdca806d960 tx=0x7fdc9801ec90 comp rx=0 tx=0).stop 2024-09-13T15:04:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f2f31800640 1 -- 172.21.15.7:0/1082662943 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c0c5e50 con 0x7f2f2c1576f0 2024-09-13T15:04:17.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fdca7e00640 1 -- 172.21.15.7:0/1212589328 shutdown_connections 2024-09-13T15:04:17.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fdca7e00640 1 --2- 172.21.15.7:0/1212589328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdca80c6ff0 0x7fdca80c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fdca7e00640 1 --2- 172.21.15.7:0/1212589328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdca8159bd0 0x7fdca80c67c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fdca7e00640 1 --2- 172.21.15.7:0/1212589328 >> v2:172.21.15.7:3300/0 conn(0x7fdca814fcd0 0x7fdca81500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fdca7e00640 1 -- 172.21.15.7:0/1212589328 >> 172.21.15.7:0/1212589328 conn(0x7fdca806cc20 msgr2=0x7fdca80cb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7efd19600640 1 -- 172.21.15.7:0/3456892577 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd080a8df0 con 0x7efd1c06cf70 2024-09-13T15:04:17.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7efd19600640 1 -- 172.21.15.7:0/3456892577 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0800b150 con 0x7efd1c06cf70 2024-09-13T15:04:17.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7efd19600640 1 -- 172.21.15.7:0/3456892577 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0800b500 con 0x7efd1c06cf70 2024-09-13T15:04:17.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fa31fa00640 1 -- 172.21.15.7:0/4136176326 shutdown_connections 2024-09-13T15:04:17.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fa31fa00640 1 --2- 172.21.15.7:0/4136176326 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa31815c900 0x7fa31815cd70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fa31fa00640 1 --2- 172.21.15.7:0/4136176326 >> v2:172.21.15.7:3300/0 conn(0x7fa318153350 0x7fa3180c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fa31fa00640 1 -- 172.21.15.7:0/4136176326 >> 172.21.15.7:0/4136176326 conn(0x7fa31806d560 msgr2=0x7fa31806d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fa31fa00640 1 -- 172.21.15.7:0/4136176326 shutdown_connections 2024-09-13T15:04:17.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fdca7e00640 1 -- 172.21.15.7:0/1212589328 shutdown_connections 2024-09-13T15:04:17.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fa31fa00640 1 -- 172.21.15.7:0/4136176326 wait complete. 2024-09-13T15:04:17.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7efd23e00640 1 -- 172.21.15.7:0/3456892577 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd1c0bd6e0 con 0x7efd1c06cf70 2024-09-13T15:04:17.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7fdca7e00640 1 -- 172.21.15.7:0/1212589328 wait complete. 2024-09-13T15:04:17.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f57a9e00640 1 -- 172.21.15.7:0/4169409899 wait complete. 2024-09-13T15:04:17.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7efd23e00640 1 -- 172.21.15.7:0/3456892577 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1c1f1d10 con 0x7efd1c06cf70 2024-09-13T15:04:17.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.753+0000 7f0369600640 1 -- 172.21.15.7:0/2833427306 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035c0b0440 con 0x7f036c0b35b0 2024-09-13T15:04:17.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f036be00640 1 -- 172.21.15.7:0/2833427306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f036c0b35b0 msgr2=0x7f036c0c92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f036be00640 1 --2- 172.21.15.7:0/2833427306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f036c0b35b0 0x7f036c0c92e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f036c0cf7c0 tx=0x7f035c01ed30 comp rx=0 tx=0).stop 2024-09-13T15:04:17.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f036be00640 1 -- 172.21.15.7:0/2833427306 shutdown_connections 2024-09-13T15:04:17.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f036be00640 1 --2- 172.21.15.7:0/2833427306 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f036c0cec70 0x7f036c0cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f036be00640 1 --2- 172.21.15.7:0/2833427306 >> v2:172.21.15.7:3300/0 conn(0x7f036c0b3990 0x7f036c0c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f036be00640 1 --2- 172.21.15.7:0/2833427306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f036c0b35b0 0x7f036c0c92e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7efd23e00640 1 -- 172.21.15.7:0/3456892577 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd1c071cf0 con 0x7efd1c06cf70 2024-09-13T15:04:17.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f036be00640 1 -- 172.21.15.7:0/2833427306 >> 172.21.15.7:0/2833427306 conn(0x7f036c065f10 msgr2=0x7f036c066320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f036be00640 1 -- 172.21.15.7:0/2833427306 shutdown_connections 2024-09-13T15:04:17.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f176d800640 1 --2- 172.21.15.7:0/1499220684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f176815cea0 0x7f17680bc310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1760009dc0 tx=0x7f176001f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fb9c18bf9be61ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f036be00640 1 -- 172.21.15.7:0/2833427306 wait complete. 2024-09-13T15:04:17.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f1767400640 1 -- 172.21.15.7:0/1499220684 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17600af600 con 0x7f176815cea0 2024-09-13T15:04:17.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f1767400640 1 -- 172.21.15.7:0/1499220684 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17600ab050 con 0x7f176815cea0 2024-09-13T15:04:17.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f1767400640 1 -- 172.21.15.7:0/1499220684 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17600af980 con 0x7f176815cea0 2024-09-13T15:04:17.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f57a9e00640 1 Processor -- start 2024-09-13T15:04:17.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7fdca7e00640 1 Processor -- start 2024-09-13T15:04:17.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7fa31fa00640 1 Processor -- start 2024-09-13T15:04:17.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7fa31fa00640 1 -- start start 2024-09-13T15:04:17.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f176f800640 1 -- 172.21.15.7:0/1499220684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f176815cea0 msgr2=0x7f17680bc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f176f800640 1 --2- 172.21.15.7:0/1499220684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f176815cea0 0x7f17680bc310 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1760009dc0 tx=0x7f176001f170 comp rx=0 tx=0).stop 2024-09-13T15:04:17.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f2f31800640 1 --2- 172.21.15.7:0/1082662943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f2c1576f0 0x7f2f2c0c6e30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f24009d90 tx=0x7f2f2401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596b8b1761449d9d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7fdca7e00640 1 -- start start 2024-09-13T15:04:17.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f57a9e00640 1 -- start start 2024-09-13T15:04:17.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7fe465e00640 1 --2- 172.21.15.7:0/1788120867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe468151590 0x7fe468157e20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe46806c150 tx=0x7fe45801c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80ef6f1ccb140389 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f176f800640 1 -- 172.21.15.7:0/1499220684 shutdown_connections 2024-09-13T15:04:17.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f176f800640 1 --2- 172.21.15.7:0/1499220684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f176815cea0 0x7f17680bc310 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f176f800640 1 -- 172.21.15.7:0/1499220684 >> 172.21.15.7:0/1499220684 conn(0x7f17680c7380 msgr2=0x7f17680c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7fe464a00640 1 -- 172.21.15.7:0/1788120867 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4580ab5f0 con 0x7fe468151590 2024-09-13T15:04:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7fe464a00640 1 -- 172.21.15.7:0/1788120867 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4580ab750 con 0x7fe468151590 2024-09-13T15:04:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7fe464a00640 1 -- 172.21.15.7:0/1788120867 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4580abae0 con 0x7fe468151590 2024-09-13T15:04:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f2f2be00640 1 -- 172.21.15.7:0/1082662943 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f240af600 con 0x7f2f2c1576f0 2024-09-13T15:04:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7f2f2be00640 1 -- 172.21.15.7:0/1082662943 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f240ab050 con 0x7f2f2c1576f0 2024-09-13T15:04:17.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.757+0000 7efd19600640 1 -- 172.21.15.7:0/3456892577 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efd0800b660 con 0x7efd1c06cf70 2024-09-13T15:04:17.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a9e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f579c008820 0x7f579c0d7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fdca7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdca80c6ff0 0x7fdca81580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f2f2be00640 1 -- 172.21.15.7:0/1082662943 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f240af960 con 0x7f2f2c1576f0 2024-09-13T15:04:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fe46d200640 1 -- 172.21.15.7:0/1788120867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe468151590 msgr2=0x7fe468157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fe46d200640 1 --2- 172.21.15.7:0/1788120867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe468151590 0x7fe468157e20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe46806c150 tx=0x7fe45801c520 comp rx=0 tx=0).stop 2024-09-13T15:04:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a9e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f579c0dcbe0 0x7f579c169b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f579c008820 0x7f579c0d7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f579c008820 0x7f579c0d7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33924/0 (socket says 172.21.15.7:33924) 2024-09-13T15:04:17.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fdca7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdca814fcd0 0x7fdca81534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f2f34200640 1 -- 172.21.15.7:0/1082662943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f2c1576f0 msgr2=0x7f2f2c0c6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f2f34200640 1 --2- 172.21.15.7:0/1082662943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f2c1576f0 0x7f2f2c0c6e30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f24009d90 tx=0x7f2f2401f150 comp rx=0 tx=0).stop 2024-09-13T15:04:17.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fdca6a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdca80c6ff0 0x7fdca81580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fdca6a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdca80c6ff0 0x7fdca81580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56482/0 (socket says 172.21.15.7:56482) 2024-09-13T15:04:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fdca6a00640 1 -- 172.21.15.7:0/109155825 learned_addr learned my addr 172.21.15.7:0/109155825 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f2f34200640 1 -- 172.21.15.7:0/1082662943 shutdown_connections 2024-09-13T15:04:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f2f34200640 1 --2- 172.21.15.7:0/1082662943 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f2c1576f0 0x7f2f2c0c6e30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f2f34200640 1 -- 172.21.15.7:0/1082662943 >> 172.21.15.7:0/1082662943 conn(0x7f2f2c0c7380 msgr2=0x7f2f2c0c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fe46d200640 1 -- 172.21.15.7:0/1788120867 shutdown_connections 2024-09-13T15:04:17.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fe46d200640 1 --2- 172.21.15.7:0/1788120867 >> v2:172.21.15.7:3300/0 conn(0x7fe46815a7a0 0x7fe4680717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fe46d200640 1 --2- 172.21.15.7:0/1788120867 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4680c7ea0 0x7fe4680c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f036be00640 1 Processor -- start 2024-09-13T15:04:17.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fe46d200640 1 --2- 172.21.15.7:0/1788120867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe468151590 0x7fe468157e20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fe46d200640 1 -- 172.21.15.7:0/1788120867 >> 172.21.15.7:0/1788120867 conn(0x7fe4680c7380 msgr2=0x7fe4680c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7efd19600640 1 --2- 172.21.15.7:0/3456892577 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efcfc066790 0x7efcfc068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7efd19600640 1 -- 172.21.15.7:0/3456892577 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efd0811ebb0 con 0x7efd1c06cf70 2024-09-13T15:04:17.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7efd19600640 1 --2- 172.21.15.7:0/3456892577 >> [v2:172.21.15.7:6824/3381512335,v1:172.21.15.7:6825/3381512335] conn(0x7efcfc0700f0 0x7efcfc072590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f176f800640 1 -- 172.21.15.7:0/1499220684 shutdown_connections 2024-09-13T15:04:17.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f176f800640 1 -- 172.21.15.7:0/1499220684 wait complete. 2024-09-13T15:04:17.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7efd19600640 1 -- 172.21.15.7:0/3456892577 --> [v2:172.21.15.7:6824/3381512335,v1:172.21.15.7:6825/3381512335] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efcfc072c60 con 0x7efcfc0700f0 2024-09-13T15:04:17.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7efd19600640 1 -- 172.21.15.7:0/3456892577 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd0811ef60 con 0x7efd1c06cf70 2024-09-13T15:04:17.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a9e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f579c0dcfc0 0x7f579c17bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a9e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c1787d0 con 0x7f579c008820 2024-09-13T15:04:17.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a9e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c1797a0 con 0x7f579c0dcbe0 2024-09-13T15:04:17.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a9e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c0e01e0 con 0x7f579c0dcfc0 2024-09-13T15:04:17.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a8a00640 1 -- 172.21.15.7:0/3785962375 learned_addr learned my addr 172.21.15.7:0/3785962375 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:17.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fa31fa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31806bad0 0x7fa3181559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fa31fa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa318153350 0x7fa318155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7efd20a00640 1 --2- 172.21.15.7:0/3456892577 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efcfc066790 0x7efcfc068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fdca7e00640 1 --2- 172.21.15.7:0/109155825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdca8159bd0 0x7fdca8153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fdca7e00640 1 -- 172.21.15.7:0/109155825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca81549a0 con 0x7fdca814fcd0 2024-09-13T15:04:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fdca7e00640 1 -- 172.21.15.7:0/109155825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca81521c0 con 0x7fdca80c6ff0 2024-09-13T15:04:17.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fdca7e00640 1 -- 172.21.15.7:0/109155825 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca8152460 con 0x7fdca8159bd0 2024-09-13T15:04:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f2f34200640 1 -- 172.21.15.7:0/1082662943 shutdown_connections 2024-09-13T15:04:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f2f34200640 1 -- 172.21.15.7:0/1082662943 wait complete. 2024-09-13T15:04:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a3e00640 1 --2- 172.21.15.7:0/3785962375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f579c0dcbe0 0x7f579c169b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fa31d000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31806bad0 0x7fa3181559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fa31d000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31806bad0 0x7fa3181559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56500/0 (socket says 172.21.15.7:56500) 2024-09-13T15:04:17.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f036be00640 1 -- start start 2024-09-13T15:04:17.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a9400640 1 --2- 172.21.15.7:0/3785962375 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f579c0dcfc0 0x7f579c17bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a8a00640 1 -- 172.21.15.7:0/3785962375 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f579c0dcfc0 msgr2=0x7f579c17bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fa31d000640 1 -- 172.21.15.7:0/801040693 learned_addr learned my addr 172.21.15.7:0/801040693 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:17.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7efd21e00640 1 --2- 172.21.15.7:0/3456892577 >> [v2:172.21.15.7:6824/3381512335,v1:172.21.15.7:6825/3381512335] conn(0x7efcfc0700f0 0x7efcfc072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fdca7400640 1 --2- 172.21.15.7:0/109155825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdca8159bd0 0x7fdca8153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a8a00640 1 --2- 172.21.15.7:0/3785962375 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f579c0dcfc0 0x7f579c17bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a8a00640 1 -- 172.21.15.7:0/3785962375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f579c0dcbe0 msgr2=0x7f579c169b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fa31fa00640 1 --2- 172.21.15.7:0/801040693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa31815c900 0x7fa3180c2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fe46d200640 1 -- 172.21.15.7:0/1788120867 shutdown_connections 2024-09-13T15:04:17.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a8a00640 1 --2- 172.21.15.7:0/3785962375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f579c0dcbe0 0x7f579c169b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a8a00640 1 -- 172.21.15.7:0/3785962375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57980094d0 con 0x7f579c008820 2024-09-13T15:04:17.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fa317e00640 1 --2- 172.21.15.7:0/801040693 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa318153350 0x7fa318155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fdca6a00640 1 -- 172.21.15.7:0/109155825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdca8159bd0 msgr2=0x7fdca8153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fdca6a00640 1 --2- 172.21.15.7:0/109155825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdca8159bd0 0x7fdca8153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fdca6a00640 1 -- 172.21.15.7:0/109155825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdca814fcd0 msgr2=0x7fdca81534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fdca6a00640 1 --2- 172.21.15.7:0/109155825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdca814fcd0 0x7fdca81534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fdca6a00640 1 -- 172.21.15.7:0/109155825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc98009420 con 0x7fdca80c6ff0 2024-09-13T15:04:17.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fa31da00640 1 --2- 172.21.15.7:0/801040693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa31815c900 0x7fa3180c2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a3e00640 1 --2- 172.21.15.7:0/3785962375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f579c0dcbe0 0x7f579c169b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:17.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a9400640 1 --2- 172.21.15.7:0/3785962375 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f579c0dcfc0 0x7f579c17bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:04:17.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fe46d200640 1 -- 172.21.15.7:0/1788120867 wait complete. 2024-09-13T15:04:17.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fa31fa00640 1 -- 172.21.15.7:0/801040693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa318154ca0 con 0x7fa31815c900 2024-09-13T15:04:17.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7efd20a00640 1 --2- 172.21.15.7:0/3456892577 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efcfc066790 0x7efcfc068c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efd1c1f50d0 tx=0x7efd10009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fa31fa00640 1 -- 172.21.15.7:0/801040693 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180c4da0 con 0x7fa31806bad0 2024-09-13T15:04:17.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fa31fa00640 1 -- 172.21.15.7:0/801040693 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3180c3620 con 0x7fa318153350 2024-09-13T15:04:17.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fdca6a00640 1 --2- 172.21.15.7:0/109155825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdca80c6ff0 0x7fdca81580a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400d800 tx=0x7fdc9400dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7f57a8a00640 1 --2- 172.21.15.7:0/3785962375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f579c008820 0x7f579c0d7060 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f57980b3040 tx=0x7f579801bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fa31da00640 1 -- 172.21.15.7:0/801040693 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa318153350 msgr2=0x7fa318155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fa31da00640 1 --2- 172.21.15.7:0/801040693 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa318153350 0x7fa318155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fa31da00640 1 -- 172.21.15.7:0/801040693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31806bad0 msgr2=0x7fa3181559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fa31da00640 1 --2- 172.21.15.7:0/801040693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31806bad0 0x7fa3181559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.761+0000 7fa31da00640 1 -- 172.21.15.7:0/801040693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa310009b30 con 0x7fa31815c900 2024-09-13T15:04:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fa31d000640 1 --2- 172.21.15.7:0/801040693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa31806bad0 0x7fa3181559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f2f34200640 1 Processor -- start 2024-09-13T15:04:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f57a0c00640 1 -- 172.21.15.7:0/3785962375 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980b0d80 con 0x7f579c008820 2024-09-13T15:04:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f57a0c00640 1 -- 172.21.15.7:0/3785962375 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57980bb470 con 0x7f579c008820 2024-09-13T15:04:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f57a0c00640 1 -- 172.21.15.7:0/3785962375 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57980bb820 con 0x7f579c008820 2024-09-13T15:04:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f036be00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f036c0b35b0 0x7f036c154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f036be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f036c0b3990 0x7f036c0c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f036be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f036c0cec70 0x7f036c1f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fdc9ea00640 1 -- 172.21.15.7:0/109155825 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9400b6c0 con 0x7fdca80c6ff0 2024-09-13T15:04:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fdc9ea00640 1 -- 172.21.15.7:0/109155825 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9400b820 con 0x7fdca80c6ff0 2024-09-13T15:04:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f57a9e00640 1 -- 172.21.15.7:0/3785962375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579c1789e0 con 0x7f579c008820 2024-09-13T15:04:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fa31da00640 1 --2- 172.21.15.7:0/801040693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa31815c900 0x7fa3180c2840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa3100ab000 tx=0x7fa310019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fdc9ea00640 1 -- 172.21.15.7:0/109155825 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9400bb90 con 0x7fdca80c6ff0 2024-09-13T15:04:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fdca7e00640 1 -- 172.21.15.7:0/109155825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca8152720 con 0x7fdca80c6ff0 2024-09-13T15:04:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f57a9e00640 1 -- 172.21.15.7:0/3785962375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579c178fa0 con 0x7f579c008820 2024-09-13T15:04:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f036aa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f036c0b35b0 0x7f036c154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f036aa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f036c0b35b0 0x7f036c154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:41692/0 (socket says 172.21.15.7:41692) 2024-09-13T15:04:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fdca7e00640 1 -- 172.21.15.7:0/109155825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca8152ce0 con 0x7fdca80c6ff0 2024-09-13T15:04:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f036aa00640 1 -- 172.21.15.7:0/2479648816 learned_addr learned my addr 172.21.15.7:0/2479648816 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f036a000640 1 --2- 172.21.15.7:0/2479648816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f036c0b3990 0x7f036c0c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f036b400640 1 --2- 172.21.15.7:0/2479648816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f036c0cec70 0x7f036c1f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f036be00640 1 -- 172.21.15.7:0/2479648816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c156fc0 con 0x7f036c0b3990 2024-09-13T15:04:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fe46d200640 1 Processor -- start 2024-09-13T15:04:17.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f2f34200640 1 -- start start 2024-09-13T15:04:17.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f036be00640 1 -- 172.21.15.7:0/2479648816 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c1f2a00 con 0x7f036c0cec70 2024-09-13T15:04:17.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f036be00640 1 -- 172.21.15.7:0/2479648816 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036c158050 con 0x7f036c0b35b0 2024-09-13T15:04:17.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f2f34200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f2c06dc20 0x7f2f2c1e6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f2f34200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f2c06f6b0 0x7f2f2c1e8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f2f34200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f2c1576f0 0x7f2f2c070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f2f34200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1e81d0 con 0x7f2f2c1576f0 2024-09-13T15:04:17.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f2f34200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1e5780 con 0x7f2f2c06dc20 2024-09-13T15:04:17.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f2f34200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1e93c0 con 0x7f2f2c06f6b0 2024-09-13T15:04:17.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f57a9e00640 1 -- 172.21.15.7:0/3785962375 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f579c04f2a0 con 0x7f579c008820 2024-09-13T15:04:17.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f176f800640 1 Processor -- start 2024-09-13T15:04:17.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f176f800640 1 -- start start 2024-09-13T15:04:17.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7efd21e00640 1 --2- 172.21.15.7:0/3456892577 >> [v2:172.21.15.7:6824/3381512335,v1:172.21.15.7:6825/3381512335] conn(0x7efcfc0700f0 0x7efcfc072590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f036a000640 1 -- 172.21.15.7:0/2479648816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f036c0b35b0 msgr2=0x7f036c154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f036a000640 1 --2- 172.21.15.7:0/2479648816 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f036c0b35b0 0x7f036c154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f036a000640 1 -- 172.21.15.7:0/2479648816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f036c0cec70 msgr2=0x7f036c1f2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f036a000640 1 --2- 172.21.15.7:0/2479648816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f036c0cec70 0x7f036c1f2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f036a000640 1 -- 172.21.15.7:0/2479648816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c0094d0 con 0x7f036c0b3990 2024-09-13T15:04:17.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fdca7e00640 1 -- 172.21.15.7:0/109155825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdca80c2f00 con 0x7fdca80c6ff0 2024-09-13T15:04:17.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fe46d200640 1 -- start start 2024-09-13T15:04:17.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fe46d200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4680c7ea0 0x7fe4681fa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fe46d200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe468151590 0x7fe4681f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f2f30e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f2c06f6b0 0x7f2f2c1e8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f2f30e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f2c06f6b0 0x7f2f2c1e8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:41708/0 (socket says 172.21.15.7:41708) 2024-09-13T15:04:17.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f2f30e00640 1 -- 172.21.15.7:0/683081636 learned_addr learned my addr 172.21.15.7:0/683081636 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:17.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f2f32200640 1 --2- 172.21.15.7:0/683081636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f2c1576f0 0x7f2f2c070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fe46d200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe46815a7a0 0x7fe4681ed550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fe46d200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4681f6a20 con 0x7fe468151590 2024-09-13T15:04:17.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fe46d200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680c8970 con 0x7fe46815a7a0 2024-09-13T15:04:17.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fe46d200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4681fa140 con 0x7fe4680c7ea0 2024-09-13T15:04:17.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f2f31800640 1 --2- 172.21.15.7:0/683081636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f2c06dc20 0x7f2f2c1e6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7f036a000640 1 --2- 172.21.15.7:0/2479648816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f036c0b3990 0x7f036c0c62d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f035800e820 tx=0x7f035800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f2f30e00640 1 -- 172.21.15.7:0/683081636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f2c06dc20 msgr2=0x7f2f2c1e6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f2f30e00640 1 --2- 172.21.15.7:0/683081636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f2c06dc20 0x7f2f2c1e6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f2f30e00640 1 -- 172.21.15.7:0/683081636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f2c1576f0 msgr2=0x7f2f2c070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f2f30e00640 1 --2- 172.21.15.7:0/683081636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f2c1576f0 0x7f2f2c070720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f2f30e00640 1 -- 172.21.15.7:0/683081636 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f24009a70 con 0x7f2f2c06f6b0 2024-09-13T15:04:17.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f2f32200640 1 --2- 172.21.15.7:0/683081636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f2c1576f0 0x7f2f2c070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:17.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fe466800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe46815a7a0 0x7fe4681ed550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fe465e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4680c7ea0 0x7fe4681fa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fe465400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe468151590 0x7fe4681f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f176f800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1768153730 0x7f1768154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f176f800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f176815cac0 0x7f17680bd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f176f800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f176815cea0 0x7f1768155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f176f800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17680c9690 con 0x7f176815cac0 2024-09-13T15:04:17.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f176f800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1768155490 con 0x7f176815cea0 2024-09-13T15:04:17.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f176f800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1768154d80 con 0x7f1768153730 2024-09-13T15:04:17.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fa314c00640 1 -- 172.21.15.7:0/801040693 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3100b8470 con 0x7fa31815c900 2024-09-13T15:04:17.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fa314c00640 1 -- 172.21.15.7:0/801040693 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3100b85d0 con 0x7fa31815c900 2024-09-13T15:04:17.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.765+0000 7fa314c00640 1 -- 172.21.15.7:0/801040693 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3100b8980 con 0x7fa31815c900 2024-09-13T15:04:17.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fe465400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe468151590 0x7fe4681f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33968/0 (socket says 172.21.15.7:33968) 2024-09-13T15:04:17.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fe465400640 1 -- 172.21.15.7:0/643311426 learned_addr learned my addr 172.21.15.7:0/643311426 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:17.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f0362a00640 1 -- 172.21.15.7:0/2479648816 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035800c940 con 0x7f036c0b3990 2024-09-13T15:04:17.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f0362a00640 1 -- 172.21.15.7:0/2479648816 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035800caa0 con 0x7f036c0b3990 2024-09-13T15:04:17.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f0362a00640 1 -- 172.21.15.7:0/2479648816 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035800ce10 con 0x7f036c0b3990 2024-09-13T15:04:17.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f036be00640 1 -- 172.21.15.7:0/2479648816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f036c157db0 con 0x7f036c0b3990 2024-09-13T15:04:17.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f036be00640 1 -- 172.21.15.7:0/2479648816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036c1f6c70 con 0x7f036c0b3990 2024-09-13T15:04:17.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f176ce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1768153730 0x7f1768154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f176ce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1768153730 0x7f1768154350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:41718/0 (socket says 172.21.15.7:41718) 2024-09-13T15:04:17.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f176ce00640 1 -- 172.21.15.7:0/1425112138 learned_addr learned my addr 172.21.15.7:0/1425112138 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:17.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f176d800640 1 --2- 172.21.15.7:0/1425112138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f176815cea0 0x7f1768155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fdc9ea00640 1 -- 172.21.15.7:0/109155825 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdc9400bcf0 con 0x7fdca80c6ff0 2024-09-13T15:04:17.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f2f30e00640 1 --2- 172.21.15.7:0/683081636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f2c06f6b0 0x7f2f2c1e8e80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800c500 tx=0x7f2f1800c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7efd19600640 1 -- 172.21.15.7:0/3456892577 <== osd.3 v2:172.21.15.7:6824/3381512335 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7efcfc072c60 con 0x7efcfc0700f0 2024-09-13T15:04:17.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fa31fa00640 1 -- 172.21.15.7:0/801040693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3180c38e0 con 0x7fa31815c900 2024-09-13T15:04:17.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f2f29600640 1 -- 172.21.15.7:0/683081636 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18005cf0 con 0x7f2f2c06f6b0 2024-09-13T15:04:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f2f29600640 1 -- 172.21.15.7:0/683081636 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f18005e50 con 0x7f2f2c06f6b0 2024-09-13T15:04:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f2f29600640 1 -- 172.21.15.7:0/683081636 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f180072f0 con 0x7f2f2c06f6b0 2024-09-13T15:04:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fa31fa00640 1 -- 172.21.15.7:0/801040693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3181551d0 con 0x7fa31815c900 2024-09-13T15:04:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fa31fa00640 1 -- 172.21.15.7:0/801040693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa2f4000fd0 con 0x7fa31815c900 2024-09-13T15:04:17.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f036be00640 1 -- 172.21.15.7:0/2479648816 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0344000fd0 con 0x7f036c0b3990 2024-09-13T15:04:17.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f1767e00640 1 --2- 172.21.15.7:0/1425112138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f176815cac0 0x7f17680bd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f176ce00640 1 -- 172.21.15.7:0/1425112138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f176815cea0 msgr2=0x7f1768155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f176ce00640 1 --2- 172.21.15.7:0/1425112138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f176815cea0 0x7f1768155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f176ce00640 1 -- 172.21.15.7:0/1425112138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f176815cac0 msgr2=0x7f17680bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fe465400640 1 -- 172.21.15.7:0/643311426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4680c7ea0 msgr2=0x7fe4681fa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fe465400640 1 --2- 172.21.15.7:0/643311426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4680c7ea0 0x7fe4681fa5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fe465400640 1 -- 172.21.15.7:0/643311426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe46815a7a0 msgr2=0x7fe4681ed550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fe465400640 1 --2- 172.21.15.7:0/643311426 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe46815a7a0 0x7fe4681ed550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fe465400640 1 -- 172.21.15.7:0/643311426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4580094d0 con 0x7fe468151590 2024-09-13T15:04:17.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fe465e00640 1 --2- 172.21.15.7:0/643311426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe4680c7ea0 0x7fe4681fa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:04:17.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f2f34200640 1 -- 172.21.15.7:0/683081636 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2c1e83e0 con 0x7f2f2c06f6b0 2024-09-13T15:04:17.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f2f34200640 1 -- 172.21.15.7:0/683081636 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2c1e54a0 con 0x7f2f2c06f6b0 2024-09-13T15:04:17.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f176ce00640 1 --2- 172.21.15.7:0/1425112138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f176815cac0 0x7f17680bd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f176ce00640 1 -- 172.21.15.7:0/1425112138 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1760009a70 con 0x7f1768153730 2024-09-13T15:04:17.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fdc9ea00640 1 --2- 172.21.15.7:0/109155825 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdc88066790 0x7fdc88068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f57a0c00640 1 -- 172.21.15.7:0/3785962375 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f57980b7070 con 0x7f579c008820 2024-09-13T15:04:17.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fdc9ea00640 1 -- 172.21.15.7:0/109155825 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdc94085560 con 0x7fdca80c6ff0 2024-09-13T15:04:17.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f1767e00640 1 --2- 172.21.15.7:0/1425112138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f176815cac0 0x7f17680bd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:17.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f176ce00640 1 --2- 172.21.15.7:0/1425112138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1768153730 0x7f1768154350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f175800c530 tx=0x7f175800c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7f2f34200640 1 -- 172.21.15.7:0/683081636 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2f2c06cd10 con 0x7f2f2c06f6b0 2024-09-13T15:04:17.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fdc9ea00640 1 --2- 172.21.15.7:0/109155825 >> [v2:172.21.15.77:6816/2210594384,v1:172.21.15.77:6817/2210594384] conn(0x7fdc880700f0 0x7fdc88072590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fdc9ea00640 1 -- 172.21.15.7:0/109155825 --> [v2:172.21.15.77:6816/2210594384,v1:172.21.15.77:6817/2210594384] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc88072c60 con 0x7fdc880700f0 2024-09-13T15:04:17.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fdc9ea00640 1 -- 172.21.15.7:0/109155825 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc94085910 con 0x7fdca80c6ff0 2024-09-13T15:04:17.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7fdca6000640 1 --2- 172.21.15.7:0/109155825 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdc88066790 0x7fdc88068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.769+0000 7fe465400640 1 --2- 172.21.15.7:0/643311426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe468151590 0x7fe4681f64e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe45000e960 tx=0x7fe45000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7f1764c00640 1 -- 172.21.15.7:0/1425112138 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758005cf0 con 0x7f1768153730 2024-09-13T15:04:17.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7f1764c00640 1 -- 172.21.15.7:0/1425112138 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1758005e50 con 0x7f1768153730 2024-09-13T15:04:17.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7f1764c00640 1 -- 172.21.15.7:0/1425112138 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758007270 con 0x7f1768153730 2024-09-13T15:04:17.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7f176f800640 1 -- 172.21.15.7:0/1425112138 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1768151c50 con 0x7f1768153730 2024-09-13T15:04:17.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7fdca7400640 1 --2- 172.21.15.7:0/109155825 >> [v2:172.21.15.77:6816/2210594384,v1:172.21.15.77:6817/2210594384] conn(0x7fdc880700f0 0x7fdc88072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7f57a0c00640 1 --2- 172.21.15.7:0/3785962375 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5784066790 0x7f5784068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7f57a0c00640 1 -- 172.21.15.7:0/3785962375 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f57981226f0 con 0x7f579c008820 2024-09-13T15:04:17.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7f57a0c00640 1 --2- 172.21.15.7:0/3785962375 >> [v2:172.21.15.7:6800/834888081,v1:172.21.15.7:6801/834888081] conn(0x7f57840700f0 0x7f5784072590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7f57a0c00640 1 -- 172.21.15.7:0/3785962375 --> [v2:172.21.15.7:6800/834888081,v1:172.21.15.7:6801/834888081] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5784072c60 con 0x7f57840700f0 2024-09-13T15:04:17.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7f57a0c00640 1 -- 172.21.15.7:0/3785962375 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5798124d10 con 0x7f579c008820 2024-09-13T15:04:17.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7fdca7400640 1 --2- 172.21.15.7:0/109155825 >> [v2:172.21.15.77:6816/2210594384,v1:172.21.15.77:6817/2210594384] conn(0x7fdc880700f0 0x7fdc88072590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7f176f800640 1 -- 172.21.15.7:0/1425112138 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17680c93d0 con 0x7f1768153730 2024-09-13T15:04:17.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7fe45e000640 1 -- 172.21.15.7:0/643311426 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe450009690 con 0x7fe468151590 2024-09-13T15:04:17.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7f57a3e00640 1 --2- 172.21.15.7:0/3785962375 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5784066790 0x7f5784068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7f176f800640 1 -- 172.21.15.7:0/1425112138 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1740000fd0 con 0x7f1768153730 2024-09-13T15:04:17.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7fdca6000640 1 --2- 172.21.15.7:0/109155825 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdc88066790 0x7fdc88068c50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdc980b2000 tx=0x7fdc98004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7f2f29600640 1 -- 172.21.15.7:0/683081636 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2f18007450 con 0x7f2f2c06f6b0 2024-09-13T15:04:17.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7f57a9400640 1 --2- 172.21.15.7:0/3785962375 >> [v2:172.21.15.7:6800/834888081,v1:172.21.15.7:6801/834888081] conn(0x7f57840700f0 0x7f5784072590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7f0362a00640 1 -- 172.21.15.7:0/2479648816 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0358013470 con 0x7f036c0b3990 2024-09-13T15:04:17.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7fa314c00640 1 -- 172.21.15.7:0/801040693 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa3100b8ae0 con 0x7fa31815c900 2024-09-13T15:04:17.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7fe45e000640 1 -- 172.21.15.7:0/643311426 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45000c9a0 con 0x7fe468151590 2024-09-13T15:04:17.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7fe45e000640 1 -- 172.21.15.7:0/643311426 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45000cd10 con 0x7fe468151590 2024-09-13T15:04:17.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7fe46d200640 1 -- 172.21.15.7:0/643311426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4680c8bc0 con 0x7fe468151590 2024-09-13T15:04:17.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7f57a9400640 1 --2- 172.21.15.7:0/3785962375 >> [v2:172.21.15.7:6800/834888081,v1:172.21.15.7:6801/834888081] conn(0x7f57840700f0 0x7f5784072590 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7fa314c00640 1 --2- 172.21.15.7:0/801040693 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa2f8066710 0x7fa2f8068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7f2f29600640 1 --2- 172.21.15.7:0/683081636 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2f0c066710 0x7f2f0c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.773+0000 7fe46d200640 1 -- 172.21.15.7:0/643311426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4681f9af0 con 0x7fe468151590 2024-09-13T15:04:17.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f57a0c00640 1 -- 172.21.15.7:0/3785962375 <== osd.0 v2:172.21.15.7:6800/834888081 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f5784072c60 con 0x7f57840700f0 2024-09-13T15:04:17.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7fa314c00640 1 -- 172.21.15.7:0/801040693 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa3100f08a0 con 0x7fa31815c900 2024-09-13T15:04:17.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7fa314c00640 1 --2- 172.21.15.7:0/801040693 >> [v2:172.21.15.7:6816/1539771714,v1:172.21.15.7:6817/1539771714] conn(0x7fa2f8070df0 0x7fa2f8073290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7fa314c00640 1 -- 172.21.15.7:0/801040693 --> [v2:172.21.15.7:6816/1539771714,v1:172.21.15.7:6817/1539771714] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa2f8073960 con 0x7fa2f8070df0 2024-09-13T15:04:17.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7fa314c00640 1 -- 172.21.15.7:0/801040693 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3100f0670 con 0x7fa31815c900 2024-09-13T15:04:17.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7fa31d000640 1 --2- 172.21.15.7:0/801040693 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa2f8066710 0x7fa2f8068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f0362a00640 1 --2- 172.21.15.7:0/2479648816 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f034c0666e0 0x7f034c068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f0362a00640 1 -- 172.21.15.7:0/2479648816 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f03580848f0 con 0x7f036c0b3990 2024-09-13T15:04:17.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f0362a00640 1 --2- 172.21.15.7:0/2479648816 >> [v2:172.21.15.77:6800/2910694434,v1:172.21.15.77:6801/2910694434] conn(0x7f034c070040 0x7f034c0724e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f0362a00640 1 -- 172.21.15.7:0/2479648816 --> [v2:172.21.15.77:6800/2910694434,v1:172.21.15.77:6801/2910694434] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f034c072bb0 con 0x7f034c070040 2024-09-13T15:04:17.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f0362a00640 1 -- 172.21.15.7:0/2479648816 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0358084c60 con 0x7f036c0b3990 2024-09-13T15:04:17.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7fdc9ea00640 1 -- 172.21.15.7:0/109155825 <== osd.5 v2:172.21.15.77:6816/2210594384 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fdc88072c60 con 0x7fdc880700f0 2024-09-13T15:04:17.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7fe457400640 1 -- 172.21.15.7:0/643311426 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe438000fd0 con 0x7fe468151590 2024-09-13T15:04:17.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f2f29600640 1 -- 172.21.15.7:0/683081636 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2f18084270 con 0x7f2f2c06f6b0 2024-09-13T15:04:17.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f2f29600640 1 --2- 172.21.15.7:0/683081636 >> [v2:172.21.15.77:6824/328054321,v1:172.21.15.77:6825/328054321] conn(0x7f2f0c070070 0x7f2f0c072510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f2f29600640 1 -- 172.21.15.7:0/683081636 --> [v2:172.21.15.77:6824/328054321,v1:172.21.15.77:6825/328054321] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f0c072be0 con 0x7f2f0c070070 2024-09-13T15:04:17.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f2f29600640 1 -- 172.21.15.7:0/683081636 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f180845e0 con 0x7f2f2c06f6b0 2024-09-13T15:04:17.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f2f32200640 1 --2- 172.21.15.7:0/683081636 >> [v2:172.21.15.77:6824/328054321,v1:172.21.15.77:6825/328054321] conn(0x7f2f0c070070 0x7f2f0c072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7fa317e00640 1 --2- 172.21.15.7:0/801040693 >> [v2:172.21.15.7:6816/1539771714,v1:172.21.15.7:6817/1539771714] conn(0x7fa2f8070df0 0x7fa2f8073290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f2f31800640 1 --2- 172.21.15.7:0/683081636 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2f0c066710 0x7f2f0c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f036b400640 1 --2- 172.21.15.7:0/2479648816 >> [v2:172.21.15.77:6800/2910694434,v1:172.21.15.77:6801/2910694434] conn(0x7f034c070040 0x7f034c0724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f036aa00640 1 --2- 172.21.15.7:0/2479648816 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f034c0666e0 0x7f034c068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f57a3e00640 1 --2- 172.21.15.7:0/3785962375 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5784066790 0x7f5784068c50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f579c0d9900 tx=0x7f5790008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f1764c00640 1 -- 172.21.15.7:0/1425112138 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f17580073d0 con 0x7f1768153730 2024-09-13T15:04:17.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7fa317e00640 1 --2- 172.21.15.7:0/801040693 >> [v2:172.21.15.7:6816/1539771714,v1:172.21.15.7:6817/1539771714] conn(0x7fa2f8070df0 0x7fa2f8073290 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f036b400640 1 --2- 172.21.15.7:0/2479648816 >> [v2:172.21.15.77:6800/2910694434,v1:172.21.15.77:6801/2910694434] conn(0x7f034c070040 0x7f034c0724e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f2f32200640 1 --2- 172.21.15.7:0/683081636 >> [v2:172.21.15.77:6824/328054321,v1:172.21.15.77:6825/328054321] conn(0x7f2f0c070070 0x7f2f0c072510 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f2f31800640 1 --2- 172.21.15.7:0/683081636 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2f0c066710 0x7f2f0c068bd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2f240b1000 tx=0x7f2f240aa000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f036aa00640 1 --2- 172.21.15.7:0/2479648816 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f034c0666e0 0x7f034c068ba0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f035c01ed70 tx=0x7f035c0aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7fa31d000640 1 --2- 172.21.15.7:0/801040693 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa2f8066710 0x7fa2f8068bd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009d20 tx=0x7fa30c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f1764c00640 1 --2- 172.21.15.7:0/1425112138 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f17480666e0 0x7f1748068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.777+0000 7f1764c00640 1 -- 172.21.15.7:0/1425112138 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f17580842b0 con 0x7f1768153730 2024-09-13T15:04:17.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7fa314c00640 1 -- 172.21.15.7:0/801040693 <== osd.2 v2:172.21.15.7:6816/1539771714 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa2f8073960 con 0x7fa2f8070df0 2024-09-13T15:04:17.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7f1767e00640 1 --2- 172.21.15.7:0/1425112138 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f17480666e0 0x7f1748068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7f1764c00640 1 --2- 172.21.15.7:0/1425112138 >> [v2:172.21.15.7:6808/436262321,v1:172.21.15.7:6809/436262321] conn(0x7f1748070040 0x7f17480724e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7f1764c00640 1 -- 172.21.15.7:0/1425112138 --> [v2:172.21.15.7:6808/436262321,v1:172.21.15.7:6809/436262321] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1748072bb0 con 0x7f1748070040 2024-09-13T15:04:17.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7f1764c00640 1 -- 172.21.15.7:0/1425112138 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1758084620 con 0x7f1768153730 2024-09-13T15:04:17.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7fe45e000640 1 -- 172.21.15.7:0/643311426 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe450013470 con 0x7fe468151590 2024-09-13T15:04:17.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7f176d800640 1 --2- 172.21.15.7:0/1425112138 >> [v2:172.21.15.7:6808/436262321,v1:172.21.15.7:6809/436262321] conn(0x7f1748070040 0x7f17480724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7f0362a00640 1 -- 172.21.15.7:0/2479648816 <== osd.4 v2:172.21.15.77:6800/2910694434 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f034c072bb0 con 0x7f034c070040 2024-09-13T15:04:17.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7f1767e00640 1 --2- 172.21.15.7:0/1425112138 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f17480666e0 0x7f1748068ba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f176814d2b0 tx=0x7f1754009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7f2f29600640 1 -- 172.21.15.7:0/683081636 <== osd.7 v2:172.21.15.77:6824/328054321 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2f0c072be0 con 0x7f2f0c070070 2024-09-13T15:04:17.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7f176d800640 1 --2- 172.21.15.7:0/1425112138 >> [v2:172.21.15.7:6808/436262321,v1:172.21.15.7:6809/436262321] conn(0x7f1748070040 0x7f17480724e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7fe45e000640 1 --2- 172.21.15.7:0/643311426 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe444066760 0x7fe444068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7fe45e000640 1 -- 172.21.15.7:0/643311426 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe450084b30 con 0x7fe468151590 2024-09-13T15:04:17.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7fe45e000640 1 --2- 172.21.15.7:0/643311426 >> [v2:172.21.15.77:6807/1578568057,v1:172.21.15.77:6809/1578568057] conn(0x7fe4440700c0 0x7fe444072560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:17.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7fe45e000640 1 -- 172.21.15.7:0/643311426 --> [v2:172.21.15.77:6807/1578568057,v1:172.21.15.77:6809/1578568057] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe444072c30 con 0x7fe4440700c0 2024-09-13T15:04:17.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7fe45e000640 1 -- 172.21.15.7:0/643311426 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe450084ee0 con 0x7fe468151590 2024-09-13T15:04:17.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7fe466800640 1 --2- 172.21.15.7:0/643311426 >> [v2:172.21.15.77:6807/1578568057,v1:172.21.15.77:6809/1578568057] conn(0x7fe4440700c0 0x7fe444072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7fe465e00640 1 --2- 172.21.15.7:0/643311426 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe444066760 0x7fe444068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:17.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.781+0000 7f1764c00640 1 -- 172.21.15.7:0/1425112138 <== osd.1 v2:172.21.15.7:6808/436262321 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1748072bb0 con 0x7f1748070040 2024-09-13T15:04:17.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.785+0000 7fe466800640 1 --2- 172.21.15.7:0/643311426 >> [v2:172.21.15.77:6807/1578568057,v1:172.21.15.77:6809/1578568057] conn(0x7fe4440700c0 0x7fe444072560 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.785+0000 7fe465e00640 1 --2- 172.21.15.7:0/643311426 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe444066760 0x7fe444068c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe4580af000 tx=0x7fe458008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:17.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.785+0000 7fe45e000640 1 -- 172.21.15.7:0/643311426 <== osd.6 v2:172.21.15.77:6807/1578568057 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe444072c30 con 0x7fe4440700c0 2024-09-13T15:04:17.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.797+0000 7efd23e00640 1 -- 172.21.15.7:0/3456892577 --> [v2:172.21.15.7:6824/3381512335,v1:172.21.15.7:6825/3381512335] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efd1c071cf0 con 0x7efcfc0700f0 2024-09-13T15:04:17.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.805+0000 7fdca7e00640 1 -- 172.21.15.7:0/109155825 --> [v2:172.21.15.77:6816/2210594384,v1:172.21.15.77:6817/2210594384] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdca80c8f60 con 0x7fdc880700f0 2024-09-13T15:04:17.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.805+0000 7efd19600640 1 -- 172.21.15.7:0/3456892577 <== osd.3 v2:172.21.15.7:6824/3381512335 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efd1c071cf0 con 0x7efcfc0700f0 2024-09-13T15:04:17.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.805+0000 7efd23e00640 1 -- 172.21.15.7:0/3456892577 >> [v2:172.21.15.7:6824/3381512335,v1:172.21.15.7:6825/3381512335] conn(0x7efcfc0700f0 msgr2=0x7efcfc072590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.805+0000 7efd23e00640 1 --2- 172.21.15.7:0/3456892577 >> [v2:172.21.15.7:6824/3381512335,v1:172.21.15.7:6825/3381512335] conn(0x7efcfc0700f0 0x7efcfc072590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.805+0000 7efd23e00640 1 -- 172.21.15.7:0/3456892577 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efcfc066790 msgr2=0x7efcfc068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.805+0000 7efd23e00640 1 --2- 172.21.15.7:0/3456892577 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efcfc066790 0x7efcfc068c50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efd1c1f50d0 tx=0x7efd10009040 comp rx=0 tx=0).stop 2024-09-13T15:04:17.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.805+0000 7efd23e00640 1 -- 172.21.15.7:0/3456892577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd1c06cf70 msgr2=0x7efd1c1f27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.805+0000 7efd23e00640 1 --2- 172.21.15.7:0/3456892577 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efd1c06cf70 0x7efd1c1f27f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efd080af000 tx=0x7efd0801d1b0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.805+0000 7efd21e00640 1 -- 172.21.15.7:0/3456892577 reap_dead start 2024-09-13T15:04:17.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.805+0000 7efd23e00640 1 -- 172.21.15.7:0/3456892577 shutdown_connections 2024-09-13T15:04:17.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.805+0000 7efd23e00640 1 -- 172.21.15.7:0/3456892577 >> 172.21.15.7:0/3456892577 conn(0x7efd1c0c7380 msgr2=0x7efd1c0c90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.805+0000 7efd23e00640 1 -- 172.21.15.7:0/3456892577 shutdown_connections 2024-09-13T15:04:17.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.805+0000 7efd23e00640 1 -- 172.21.15.7:0/3456892577 wait complete. 2024-09-13T15:04:17.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.805+0000 7fdc9ea00640 1 -- 172.21.15.7:0/109155825 <== osd.5 v2:172.21.15.77:6816/2210594384 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdca0009750 con 0x7fdc880700f0 2024-09-13T15:04:17.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fdca7e00640 1 -- 172.21.15.7:0/109155825 >> [v2:172.21.15.77:6816/2210594384,v1:172.21.15.77:6817/2210594384] conn(0x7fdc880700f0 msgr2=0x7fdc88072590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fdca7e00640 1 --2- 172.21.15.7:0/109155825 >> [v2:172.21.15.77:6816/2210594384,v1:172.21.15.77:6817/2210594384] conn(0x7fdc880700f0 0x7fdc88072590 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fdca7e00640 1 -- 172.21.15.7:0/109155825 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdc88066790 msgr2=0x7fdc88068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fdca7e00640 1 --2- 172.21.15.7:0/109155825 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdc88066790 0x7fdc88068c50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdc980b2000 tx=0x7fdc98004740 comp rx=0 tx=0).stop 2024-09-13T15:04:17.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fdca7e00640 1 -- 172.21.15.7:0/109155825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdca80c6ff0 msgr2=0x7fdca81580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fdca7e00640 1 --2- 172.21.15.7:0/109155825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdca80c6ff0 0x7fdca81580a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400d800 tx=0x7fdc9400dcc0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fdca7400640 1 -- 172.21.15.7:0/109155825 reap_dead start 2024-09-13T15:04:17.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fdca7e00640 1 -- 172.21.15.7:0/109155825 shutdown_connections 2024-09-13T15:04:17.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fdca7e00640 1 -- 172.21.15.7:0/109155825 >> 172.21.15.7:0/109155825 conn(0x7fdca806cc20 msgr2=0x7fdca8071670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fdca7e00640 1 -- 172.21.15.7:0/109155825 shutdown_connections 2024-09-13T15:04:17.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fdca7e00640 1 -- 172.21.15.7:0/109155825 wait complete. 2024-09-13T15:04:17.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fe457400640 1 -- 172.21.15.7:0/643311426 --> [v2:172.21.15.77:6807/1578568057,v1:172.21.15.77:6809/1578568057] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe438002cc0 con 0x7fe4440700c0 2024-09-13T15:04:17.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fa31fa00640 1 -- 172.21.15.7:0/801040693 --> [v2:172.21.15.7:6816/1539771714,v1:172.21.15.7:6817/1539771714] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa2f4002cc0 con 0x7fa2f8070df0 2024-09-13T15:04:17.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7f2f34200640 1 -- 172.21.15.7:0/683081636 --> [v2:172.21.15.77:6824/328054321,v1:172.21.15.77:6825/328054321] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2f2c067610 con 0x7f2f0c070070 2024-09-13T15:04:17.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7f57a9e00640 1 -- 172.21.15.7:0/3785962375 --> [v2:172.21.15.7:6800/834888081,v1:172.21.15.7:6801/834888081] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f579c0e30b0 con 0x7f57840700f0 2024-09-13T15:04:17.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fa314c00640 1 -- 172.21.15.7:0/801040693 <== osd.2 v2:172.21.15.7:6816/1539771714 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa2f4002cc0 con 0x7fa2f8070df0 2024-09-13T15:04:17.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fe45e000640 1 -- 172.21.15.7:0/643311426 <== osd.6 v2:172.21.15.77:6807/1578568057 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe438002cc0 con 0x7fe4440700c0 2024-09-13T15:04:17.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fa31fa00640 1 -- 172.21.15.7:0/801040693 >> [v2:172.21.15.7:6816/1539771714,v1:172.21.15.7:6817/1539771714] conn(0x7fa2f8070df0 msgr2=0x7fa2f8073290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fa31fa00640 1 --2- 172.21.15.7:0/801040693 >> [v2:172.21.15.7:6816/1539771714,v1:172.21.15.7:6817/1539771714] conn(0x7fa2f8070df0 0x7fa2f8073290 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7f2f29600640 1 -- 172.21.15.7:0/683081636 <== osd.7 v2:172.21.15.77:6824/328054321 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2f2c067610 con 0x7f2f0c070070 2024-09-13T15:04:17.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7f57a0c00640 1 -- 172.21.15.7:0/3785962375 <== osd.0 v2:172.21.15.7:6800/834888081 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f57a404e740 con 0x7f57840700f0 2024-09-13T15:04:17.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fa31fa00640 1 -- 172.21.15.7:0/801040693 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa2f8066710 msgr2=0x7fa2f8068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fa31fa00640 1 --2- 172.21.15.7:0/801040693 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa2f8066710 0x7fa2f8068bd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009d20 tx=0x7fa30c008040 comp rx=0 tx=0).stop 2024-09-13T15:04:17.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fa31fa00640 1 -- 172.21.15.7:0/801040693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa31815c900 msgr2=0x7fa3180c2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fa31fa00640 1 --2- 172.21.15.7:0/801040693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa31815c900 0x7fa3180c2840 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa3100ab000 tx=0x7fa310019730 comp rx=0 tx=0).stop 2024-09-13T15:04:17.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fa31da00640 1 -- 172.21.15.7:0/801040693 reap_dead start 2024-09-13T15:04:17.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fe457400640 1 -- 172.21.15.7:0/643311426 >> [v2:172.21.15.77:6807/1578568057,v1:172.21.15.77:6809/1578568057] conn(0x7fe4440700c0 msgr2=0x7fe444072560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fe457400640 1 --2- 172.21.15.7:0/643311426 >> [v2:172.21.15.77:6807/1578568057,v1:172.21.15.77:6809/1578568057] conn(0x7fe4440700c0 0x7fe444072560 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fa31fa00640 1 -- 172.21.15.7:0/801040693 shutdown_connections 2024-09-13T15:04:17.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fa31fa00640 1 -- 172.21.15.7:0/801040693 >> 172.21.15.7:0/801040693 conn(0x7fa31806d560 msgr2=0x7fa31806d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fe457400640 1 -- 172.21.15.7:0/643311426 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe444066760 msgr2=0x7fe444068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fa31fa00640 1 -- 172.21.15.7:0/801040693 shutdown_connections 2024-09-13T15:04:17.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fe457400640 1 --2- 172.21.15.7:0/643311426 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe444066760 0x7fe444068c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe4580af000 tx=0x7fe458008040 comp rx=0 tx=0).stop 2024-09-13T15:04:17.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fe457400640 1 -- 172.21.15.7:0/643311426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe468151590 msgr2=0x7fe4681f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fe457400640 1 --2- 172.21.15.7:0/643311426 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe468151590 0x7fe4681f64e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe45000e960 tx=0x7fe45000ee20 comp rx=0 tx=0).stop 2024-09-13T15:04:17.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fa31fa00640 1 -- 172.21.15.7:0/801040693 wait complete. 2024-09-13T15:04:17.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7f036be00640 1 -- 172.21.15.7:0/2479648816 --> [v2:172.21.15.77:6800/2910694434,v1:172.21.15.77:6801/2910694434] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0344002cc0 con 0x7f034c070040 2024-09-13T15:04:17.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fe466800640 1 -- 172.21.15.7:0/643311426 reap_dead start 2024-09-13T15:04:17.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fe457400640 1 -- 172.21.15.7:0/643311426 shutdown_connections 2024-09-13T15:04:17.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fe457400640 1 -- 172.21.15.7:0/643311426 >> 172.21.15.7:0/643311426 conn(0x7fe4680c7380 msgr2=0x7fe4680c0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7fe457400640 1 -- 172.21.15.7:0/643311426 shutdown_connections 2024-09-13T15:04:17.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7fe457400640 1 -- 172.21.15.7:0/643311426 wait complete. 2024-09-13T15:04:17.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f2f34200640 1 -- 172.21.15.7:0/683081636 >> [v2:172.21.15.77:6824/328054321,v1:172.21.15.77:6825/328054321] conn(0x7f2f0c070070 msgr2=0x7f2f0c072510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f2f34200640 1 --2- 172.21.15.7:0/683081636 >> [v2:172.21.15.77:6824/328054321,v1:172.21.15.77:6825/328054321] conn(0x7f2f0c070070 0x7f2f0c072510 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7f57a9e00640 1 -- 172.21.15.7:0/3785962375 >> [v2:172.21.15.7:6800/834888081,v1:172.21.15.7:6801/834888081] conn(0x7f57840700f0 msgr2=0x7f5784072590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.809+0000 7f57a9e00640 1 --2- 172.21.15.7:0/3785962375 >> [v2:172.21.15.7:6800/834888081,v1:172.21.15.7:6801/834888081] conn(0x7f57840700f0 0x7f5784072590 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f57a9e00640 1 -- 172.21.15.7:0/3785962375 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5784066790 msgr2=0x7f5784068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f57a9e00640 1 --2- 172.21.15.7:0/3785962375 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5784066790 0x7f5784068c50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f579c0d9900 tx=0x7f5790008040 comp rx=0 tx=0).stop 2024-09-13T15:04:17.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f57a9e00640 1 -- 172.21.15.7:0/3785962375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f579c008820 msgr2=0x7f579c0d7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f57a9e00640 1 --2- 172.21.15.7:0/3785962375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f579c008820 0x7f579c0d7060 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f57980b3040 tx=0x7f579801bad0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f176f800640 1 -- 172.21.15.7:0/1425112138 --> [v2:172.21.15.7:6808/436262321,v1:172.21.15.7:6809/436262321] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1740002cc0 con 0x7f1748070040 2024-09-13T15:04:17.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f2f34200640 1 -- 172.21.15.7:0/683081636 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2f0c066710 msgr2=0x7f2f0c068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f2f34200640 1 --2- 172.21.15.7:0/683081636 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2f0c066710 0x7f2f0c068bd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2f240b1000 tx=0x7f2f240aa000 comp rx=0 tx=0).stop 2024-09-13T15:04:17.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f2f34200640 1 -- 172.21.15.7:0/683081636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f2c06f6b0 msgr2=0x7f2f2c1e8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f2f34200640 1 --2- 172.21.15.7:0/683081636 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f2c06f6b0 0x7f2f2c1e8e80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800c500 tx=0x7f2f1800c9c0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f57a9400640 1 -- 172.21.15.7:0/3785962375 reap_dead start 2024-09-13T15:04:17.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f57a9e00640 1 -- 172.21.15.7:0/3785962375 shutdown_connections 2024-09-13T15:04:17.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f57a9e00640 1 -- 172.21.15.7:0/3785962375 >> 172.21.15.7:0/3785962375 conn(0x7f579c00db70 msgr2=0x7f579c0e16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f2f32200640 1 -- 172.21.15.7:0/683081636 reap_dead start 2024-09-13T15:04:17.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f0362a00640 1 -- 172.21.15.7:0/2479648816 <== osd.4 v2:172.21.15.77:6800/2910694434 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0344002cc0 con 0x7f034c070040 2024-09-13T15:04:17.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f2f34200640 1 -- 172.21.15.7:0/683081636 shutdown_connections 2024-09-13T15:04:17.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f2f34200640 1 -- 172.21.15.7:0/683081636 >> 172.21.15.7:0/683081636 conn(0x7f2f2c0c7380 msgr2=0x7f2f2c0c9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f57a9e00640 1 -- 172.21.15.7:0/3785962375 shutdown_connections 2024-09-13T15:04:17.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f57a9e00640 1 -- 172.21.15.7:0/3785962375 wait complete. 2024-09-13T15:04:17.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f036be00640 1 -- 172.21.15.7:0/2479648816 >> [v2:172.21.15.77:6800/2910694434,v1:172.21.15.77:6801/2910694434] conn(0x7f034c070040 msgr2=0x7f034c0724e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f036be00640 1 --2- 172.21.15.7:0/2479648816 >> [v2:172.21.15.77:6800/2910694434,v1:172.21.15.77:6801/2910694434] conn(0x7f034c070040 0x7f034c0724e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f2f34200640 1 -- 172.21.15.7:0/683081636 shutdown_connections 2024-09-13T15:04:17.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f1764c00640 1 -- 172.21.15.7:0/1425112138 <== osd.1 v2:172.21.15.7:6808/436262321 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1740002cc0 con 0x7f1748070040 2024-09-13T15:04:17.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f036be00640 1 -- 172.21.15.7:0/2479648816 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f034c0666e0 msgr2=0x7f034c068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f036be00640 1 --2- 172.21.15.7:0/2479648816 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f034c0666e0 0x7f034c068ba0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f035c01ed70 tx=0x7f035c0aa070 comp rx=0 tx=0).stop 2024-09-13T15:04:17.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f036be00640 1 -- 172.21.15.7:0/2479648816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f036c0b3990 msgr2=0x7f036c0c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f036be00640 1 --2- 172.21.15.7:0/2479648816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f036c0b3990 0x7f036c0c62d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f035800e820 tx=0x7f035800ece0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f036b400640 1 -- 172.21.15.7:0/2479648816 reap_dead start 2024-09-13T15:04:17.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f2f34200640 1 -- 172.21.15.7:0/683081636 wait complete. 2024-09-13T15:04:17.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f036be00640 1 -- 172.21.15.7:0/2479648816 shutdown_connections 2024-09-13T15:04:17.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f036be00640 1 -- 172.21.15.7:0/2479648816 >> 172.21.15.7:0/2479648816 conn(0x7f036c065f10 msgr2=0x7f036c15cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f176f800640 1 -- 172.21.15.7:0/1425112138 >> [v2:172.21.15.7:6808/436262321,v1:172.21.15.7:6809/436262321] conn(0x7f1748070040 msgr2=0x7f17480724e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f176f800640 1 --2- 172.21.15.7:0/1425112138 >> [v2:172.21.15.7:6808/436262321,v1:172.21.15.7:6809/436262321] conn(0x7f1748070040 0x7f17480724e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f036be00640 1 -- 172.21.15.7:0/2479648816 shutdown_connections 2024-09-13T15:04:17.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f176f800640 1 -- 172.21.15.7:0/1425112138 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f17480666e0 msgr2=0x7f1748068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f176f800640 1 --2- 172.21.15.7:0/1425112138 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f17480666e0 0x7f1748068ba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f176814d2b0 tx=0x7f1754009040 comp rx=0 tx=0).stop 2024-09-13T15:04:17.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f176f800640 1 -- 172.21.15.7:0/1425112138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1768153730 msgr2=0x7f1768154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:17.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f176f800640 1 --2- 172.21.15.7:0/1425112138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1768153730 0x7f1768154350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f175800c530 tx=0x7f175800c9f0 comp rx=0 tx=0).stop 2024-09-13T15:04:17.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f176d800640 1 -- 172.21.15.7:0/1425112138 reap_dead start 2024-09-13T15:04:17.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f176f800640 1 -- 172.21.15.7:0/1425112138 shutdown_connections 2024-09-13T15:04:17.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f176f800640 1 -- 172.21.15.7:0/1425112138 >> 172.21.15.7:0/1425112138 conn(0x7f17680c7380 msgr2=0x7f17680c4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:17.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f036be00640 1 -- 172.21.15.7:0/2479648816 wait complete. 2024-09-13T15:04:17.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f176f800640 1 -- 172.21.15.7:0/1425112138 shutdown_connections 2024-09-13T15:04:17.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:17.813+0000 7f176f800640 1 -- 172.21.15.7:0/1425112138 wait complete. 2024-09-13T15:04:17.858 INFO:teuthology.orchestra.run.smithi007.stdout:60129542177 2024-09-13T15:04:17.858 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T15:04:17.859 INFO:teuthology.orchestra.run.smithi007.stdout:60129542178 2024-09-13T15:04:17.860 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T15:04:17.860 INFO:teuthology.orchestra.run.smithi007.stdout:60129542179 2024-09-13T15:04:17.861 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T15:04:17.863 INFO:teuthology.orchestra.run.smithi007.stdout:60129542177 2024-09-13T15:04:17.863 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T15:04:17.867 INFO:teuthology.orchestra.run.smithi007.stdout:60129542178 2024-09-13T15:04:17.867 INFO:teuthology.orchestra.run.smithi007.stdout:60129542178 2024-09-13T15:04:17.868 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T15:04:17.868 INFO:teuthology.orchestra.run.smithi007.stdout:60129542178 2024-09-13T15:04:17.869 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T15:04:17.869 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T15:04:17.870 INFO:teuthology.orchestra.run.smithi007.stdout:60129542178 2024-09-13T15:04:17.871 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T15:04:18.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.065+0000 7f192a000640 1 Processor -- start 2024-09-13T15:04:18.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.065+0000 7f192a000640 1 -- start start 2024-09-13T15:04:18.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.069+0000 7f192a000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f192406cd50 0x7f19240c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.069+0000 7f192a000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f19240c1880 0x7f19240c7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.069+0000 7f192a000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192414f630 con 0x7f192414f250 2024-09-13T15:04:18.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.069+0000 7f192a000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19240c70c0 con 0x7f19240c1880 2024-09-13T15:04:18.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.069+0000 7f192a000640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19240c5fb0 con 0x7f192406cd50 2024-09-13T15:04:18.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.073+0000 7f1922a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f192406cd50 0x7f19240c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.073+0000 7f1923400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f192414f250 0x7f19241558a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50812/0 (socket says 172.21.15.7:50812) 2024-09-13T15:04:18.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.073+0000 7f1923400640 1 -- 172.21.15.7:0/619202606 learned_addr learned my addr 172.21.15.7:0/619202606 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:18.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.073+0000 7f1923e00640 1 --2- 172.21.15.7:0/619202606 >> v2:172.21.15.7:3300/0 conn(0x7f19240c1880 0x7f19240c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.073+0000 7f1922a00640 1 -- 172.21.15.7:0/619202606 >> v2:172.21.15.7:3300/0 conn(0x7f19240c1880 msgr2=0x7f19240c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:18.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.073+0000 7f1922a00640 1 --2- 172.21.15.7:0/619202606 >> v2:172.21.15.7:3300/0 conn(0x7f19240c1880 0x7f19240c7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.073+0000 7f1922a00640 1 -- 172.21.15.7:0/619202606 >> v1:172.21.15.7:6789/0 conn(0x7f192414f250 legacy=0x7f19241558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:18.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.073+0000 7f311fc00640 1 Processor -- start 2024-09-13T15:04:18.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.073+0000 7f311fc00640 1 -- start start 2024-09-13T15:04:18.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.077+0000 7f311fc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3110006440 0x7f3110006820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.077+0000 7f311fc00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f31100d8e80 0x7f31100d92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.077+0000 7f311fc00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31100e6c20 con 0x7f31100e6130 2024-09-13T15:04:18.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.077+0000 7f311fc00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3110006d60 con 0x7f31100d8e80 2024-09-13T15:04:18.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.077+0000 7f5963000640 1 Processor -- start 2024-09-13T15:04:18.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.077+0000 7f311fc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3110032d80 con 0x7f3110006440 2024-09-13T15:04:18.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.077+0000 7f5963000640 1 -- start start 2024-09-13T15:04:18.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.077+0000 7f311dc00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f31100d8e80 0x7f31100d92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.077+0000 7f311dc00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f31100d8e80 0x7f31100d92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56554/0 (socket says 172.21.15.7:56554) 2024-09-13T15:04:18.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.077+0000 7f311dc00640 1 -- 172.21.15.7:0/2729420022 learned_addr learned my addr 172.21.15.7:0/2729420022 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:18.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.077+0000 7f3117e00640 1 --2- 172.21.15.7:0/2729420022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3110006440 0x7f3110006820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.077+0000 7f311dc00640 1 -- 172.21.15.7:0/2729420022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3110006440 msgr2=0x7f3110006820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:18.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.073+0000 7f1922a00640 1 -- 172.21.15.7:0/619202606 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19240c6820 con 0x7f192406cd50 2024-09-13T15:04:18.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.073+0000 7f1923e00640 1 --2- 172.21.15.7:0/619202606 >> v2:172.21.15.7:3300/0 conn(0x7f19240c1880 0x7f19240c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:18.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.081+0000 7f5963000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f595c14f4c0 0x7f595c0c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.081+0000 7f5963000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c0c2790 con 0x7f595c155a30 2024-09-13T15:04:18.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.081+0000 7f5963000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c0c6890 con 0x7f595c0c5410 2024-09-13T15:04:18.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.081+0000 7f5963000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595c071cc0 con 0x7f595c14f4c0 2024-09-13T15:04:18.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.081+0000 7f5962600640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f595c0c5410 0x7f595c06c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:45736/0 (socket says 172.21.15.7:45736) 2024-09-13T15:04:18.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.081+0000 7f5961c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f595c14f4c0 0x7f595c0c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.081+0000 7f5961c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f595c14f4c0 0x7f595c0c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33994/0 (socket says 172.21.15.7:33994) 2024-09-13T15:04:18.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.081+0000 7f5961c00640 1 -- 172.21.15.7:0/3507782028 learned_addr learned my addr 172.21.15.7:0/3507782028 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:18.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.077+0000 7f311dc00640 1 --2- 172.21.15.7:0/2729420022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3110006440 0x7f3110006820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.077+0000 7f311dc00640 1 -- 172.21.15.7:0/2729420022 >> v1:172.21.15.77:6789/0 conn(0x7f31100e6130 legacy=0x7f31100e6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.081+0000 7f5961c00640 1 -- 172.21.15.7:0/3507782028 >> v1:172.21.15.77:6789/0 conn(0x7f595c0c5410 legacy=0x7f595c06c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.081+0000 7f5961c00640 1 -- 172.21.15.7:0/3507782028 >> v1:172.21.15.7:6789/0 conn(0x7f595c155a30 legacy=0x7f595c0c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:18.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.077+0000 7f311dc00640 1 -- 172.21.15.7:0/2729420022 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3110006f40 con 0x7f31100d8e80 2024-09-13T15:04:18.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.081+0000 7f3117e00640 1 --2- 172.21.15.7:0/2729420022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3110006440 0x7f3110006820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:18.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.081+0000 7f5961c00640 1 -- 172.21.15.7:0/3507782028 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c0c70c0 con 0x7f595c14f4c0 2024-09-13T15:04:18.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.081+0000 7f1922a00640 1 --2- 172.21.15.7:0/619202606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f192406cd50 0x7f19240c5a70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1924152aa0 tx=0x7f191c01f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37e5d24cc30cede5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.081+0000 7f1922000640 1 -- 172.21.15.7:0/619202606 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c0af600 con 0x7f192406cd50 2024-09-13T15:04:18.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.081+0000 7f1922000640 1 -- 172.21.15.7:0/619202606 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f191c0ab050 con 0x7f192406cd50 2024-09-13T15:04:18.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.081+0000 7f1922000640 1 -- 172.21.15.7:0/619202606 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f191c0af980 con 0x7f192406cd50 2024-09-13T15:04:18.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f311dc00640 1 --2- 172.21.15.7:0/2729420022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31100d8e80 0x7f31100d92d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f310c009870 tx=0x7f310c01ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df86192abba7bd33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f192a000640 1 -- 172.21.15.7:0/619202606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f192406cd50 msgr2=0x7f19240c5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f192a000640 1 --2- 172.21.15.7:0/619202606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f192406cd50 0x7f19240c5a70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1924152aa0 tx=0x7f191c01f130 comp rx=0 tx=0).stop 2024-09-13T15:04:18.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f192a000640 1 -- 172.21.15.7:0/619202606 shutdown_connections 2024-09-13T15:04:18.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f192a000640 1 --2- 172.21.15.7:0/619202606 >> v2:172.21.15.7:3300/0 conn(0x7f19240c1880 0x7f19240c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f192a000640 1 --2- 172.21.15.7:0/619202606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f192406cd50 0x7f19240c5a70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f192a000640 1 -- 172.21.15.7:0/619202606 >> 172.21.15.7:0/619202606 conn(0x7f1924065d40 msgr2=0x7f1924066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:18.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f3117400640 1 -- 172.21.15.7:0/2729420022 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c0a8950 con 0x7f31100d8e80 2024-09-13T15:04:18.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f3117400640 1 -- 172.21.15.7:0/2729420022 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c0a8ab0 con 0x7f31100d8e80 2024-09-13T15:04:18.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f3117400640 1 -- 172.21.15.7:0/2729420022 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c0a8e40 con 0x7f31100d8e80 2024-09-13T15:04:18.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f311fc00640 1 -- 172.21.15.7:0/2729420022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31100d8e80 msgr2=0x7f31100d92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f311fc00640 1 --2- 172.21.15.7:0/2729420022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31100d8e80 0x7f31100d92d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f310c009870 tx=0x7f310c01ed90 comp rx=0 tx=0).stop 2024-09-13T15:04:18.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f192a000640 1 -- 172.21.15.7:0/619202606 shutdown_connections 2024-09-13T15:04:18.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f311fc00640 1 -- 172.21.15.7:0/2729420022 shutdown_connections 2024-09-13T15:04:18.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f311fc00640 1 --2- 172.21.15.7:0/2729420022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31100d8e80 0x7f31100d92d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f311fc00640 1 --2- 172.21.15.7:0/2729420022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3110006440 0x7f3110006820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f311fc00640 1 -- 172.21.15.7:0/2729420022 >> 172.21.15.7:0/2729420022 conn(0x7f311004fc30 msgr2=0x7f3110050010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:18.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f192a000640 1 -- 172.21.15.7:0/619202606 wait complete. 2024-09-13T15:04:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f311fc00640 1 -- 172.21.15.7:0/2729420022 shutdown_connections 2024-09-13T15:04:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.085+0000 7f311fc00640 1 -- 172.21.15.7:0/2729420022 wait complete. 2024-09-13T15:04:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.089+0000 7f5961c00640 1 --2- 172.21.15.7:0/3507782028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f595c14f4c0 0x7f595c0c6170 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5950009870 tx=0x7f595001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dda555abacb521d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.089+0000 7f192a000640 1 Processor -- start 2024-09-13T15:04:18.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.089+0000 7f192a000640 1 -- start start 2024-09-13T15:04:18.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.089+0000 7f311fc00640 1 Processor -- start 2024-09-13T15:04:18.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.089+0000 7f311fc00640 1 -- start start 2024-09-13T15:04:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.089+0000 7f595be00640 1 -- 172.21.15.7:0/3507782028 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59500a8a10 con 0x7f595c14f4c0 2024-09-13T15:04:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.089+0000 7f595be00640 1 -- 172.21.15.7:0/3507782028 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59500a8b70 con 0x7f595c14f4c0 2024-09-13T15:04:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.089+0000 7f595be00640 1 -- 172.21.15.7:0/3507782028 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59500b0440 con 0x7f595c14f4c0 2024-09-13T15:04:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.089+0000 7f5963000640 1 -- 172.21.15.7:0/3507782028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f595c14f4c0 msgr2=0x7f595c0c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.089+0000 7f5963000640 1 --2- 172.21.15.7:0/3507782028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f595c14f4c0 0x7f595c0c6170 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5950009870 tx=0x7f595001ed10 comp rx=0 tx=0).stop 2024-09-13T15:04:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.089+0000 7f5963000640 1 -- 172.21.15.7:0/3507782028 shutdown_connections 2024-09-13T15:04:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.089+0000 7f5963000640 1 --2- 172.21.15.7:0/3507782028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f595c14f4c0 0x7f595c0c6170 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f5963000640 1 -- 172.21.15.7:0/3507782028 >> 172.21.15.7:0/3507782028 conn(0x7f595c06b7d0 msgr2=0x7f595c065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f311fc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3110006440 0x7f31101710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f192a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f192406cd50 0x7f19241f6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f311fc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31100d8e80 0x7f3110049050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f311fc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31100e6130 0x7f311004dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f192a000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19240c1880 0x7f19241f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f3117e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31100d8e80 0x7f3110049050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f311fc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31100d31b0 con 0x7f31100e6130 2024-09-13T15:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f311fc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31100d3a50 con 0x7f31100d8e80 2024-09-13T15:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f311fc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3110171610 con 0x7f3110006440 2024-09-13T15:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f3117e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31100d8e80 0x7f3110049050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56568/0 (socket says 172.21.15.7:56568) 2024-09-13T15:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f3117e00640 1 -- 172.21.15.7:0/3329480494 learned_addr learned my addr 172.21.15.7:0/3329480494 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f192a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f192414f250 0x7f19241f5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f192a000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1924156af0 con 0x7f192406cd50 2024-09-13T15:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f192a000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19241f3e30 con 0x7f19240c1880 2024-09-13T15:04:18.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f192a000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19241f6a60 con 0x7f192414f250 2024-09-13T15:04:18.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f5963000640 1 -- 172.21.15.7:0/3507782028 shutdown_connections 2024-09-13T15:04:18.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f311d200640 1 --2- 172.21.15.7:0/3329480494 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3110006440 0x7f31101710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f1923400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f192406cd50 0x7f19241f6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f1923400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f192406cd50 0x7f19241f6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33998/0 (socket says 172.21.15.7:33998) 2024-09-13T15:04:18.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f1923400640 1 -- 172.21.15.7:0/3718370962 learned_addr learned my addr 172.21.15.7:0/3718370962 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:18.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f1923e00640 1 --2- 172.21.15.7:0/3718370962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f192414f250 0x7f19241f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f3117e00640 1 -- 172.21.15.7:0/3329480494 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3110006440 msgr2=0x7f31101710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f3117e00640 1 --2- 172.21.15.7:0/3329480494 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3110006440 0x7f31101710d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f3117e00640 1 -- 172.21.15.7:0/3329480494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31100e6130 msgr2=0x7f311004dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f311dc00640 1 --2- 172.21.15.7:0/3329480494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31100e6130 0x7f311004dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f5963000640 1 -- 172.21.15.7:0/3507782028 wait complete. 2024-09-13T15:04:18.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f1922a00640 1 --2- 172.21.15.7:0/3718370962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19240c1880 0x7f19241f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f3117e00640 1 --2- 172.21.15.7:0/3329480494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31100e6130 0x7f311004dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f3117e00640 1 -- 172.21.15.7:0/3329480494 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3118074490 con 0x7f31100d8e80 2024-09-13T15:04:18.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f311dc00640 1 --2- 172.21.15.7:0/3329480494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31100e6130 0x7f311004dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:04:18.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f3117e00640 1 --2- 172.21.15.7:0/3329480494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31100d8e80 0x7f3110049050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3118073160 tx=0x7f3118067500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f1923400640 1 -- 172.21.15.7:0/3718370962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f192414f250 msgr2=0x7f19241f5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f1923400640 1 --2- 172.21.15.7:0/3718370962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f192414f250 0x7f19241f5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f1923400640 1 -- 172.21.15.7:0/3718370962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19240c1880 msgr2=0x7f19241f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f1923400640 1 --2- 172.21.15.7:0/3718370962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19240c1880 0x7f19241f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f1923400640 1 -- 172.21.15.7:0/3718370962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1910009420 con 0x7f192406cd50 2024-09-13T15:04:18.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f3114c00640 1 -- 172.21.15.7:0/3329480494 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311806e070 con 0x7f31100d8e80 2024-09-13T15:04:18.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f3114c00640 1 -- 172.21.15.7:0/3329480494 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3118068310 con 0x7f31100d8e80 2024-09-13T15:04:18.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f3114c00640 1 -- 172.21.15.7:0/3329480494 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3118090070 con 0x7f31100d8e80 2024-09-13T15:04:18.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f311fc00640 1 -- 172.21.15.7:0/3329480494 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310c0094d0 con 0x7f31100d8e80 2024-09-13T15:04:18.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.093+0000 7f311fc00640 1 -- 172.21.15.7:0/3329480494 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3110049b40 con 0x7f31100d8e80 2024-09-13T15:04:18.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.097+0000 7f1923400640 1 --2- 172.21.15.7:0/3718370962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f192406cd50 0x7f19241f6190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f191400c500 tx=0x7f191400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.097+0000 7f191b400640 1 -- 172.21.15.7:0/3718370962 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1914005cf0 con 0x7f192406cd50 2024-09-13T15:04:18.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.097+0000 7f191b400640 1 -- 172.21.15.7:0/3718370962 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1914005e50 con 0x7f192406cd50 2024-09-13T15:04:18.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.097+0000 7f191b400640 1 -- 172.21.15.7:0/3718370962 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19140072f0 con 0x7f192406cd50 2024-09-13T15:04:18.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.097+0000 7f192a000640 1 -- 172.21.15.7:0/3718370962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191c009a70 con 0x7f192406cd50 2024-09-13T15:04:18.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.097+0000 7f192a000640 1 -- 172.21.15.7:0/3718370962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19241f40f0 con 0x7f192406cd50 2024-09-13T15:04:18.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.097+0000 7f5963000640 1 Processor -- start 2024-09-13T15:04:18.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.097+0000 7f5963000640 1 -- start start 2024-09-13T15:04:18.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.097+0000 7f310a000640 1 -- 172.21.15.7:0/3329480494 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31100d3c00 con 0x7f31100d8e80 2024-09-13T15:04:18.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.097+0000 7f3114c00640 1 -- 172.21.15.7:0/3329480494 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3118068480 con 0x7f31100d8e80 2024-09-13T15:04:18.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5963000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f595c0c5410 0x7f595c1f2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5963000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f595c14f4c0 0x7f595c153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5963000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f595c155a30 0x7f595c0b7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f192a000640 1 -- 172.21.15.7:0/3718370962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18fc005260 con 0x7f192406cd50 2024-09-13T15:04:18.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f3114c00640 1 --2- 172.21.15.7:0/3329480494 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f30f80666c0 0x7f30f8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5961c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f595c0c5410 0x7f595c1f2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5963000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c0c66b0 con 0x7f595c14f4c0 2024-09-13T15:04:18.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5961c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f595c0c5410 0x7f595c1f2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56584/0 (socket says 172.21.15.7:56584) 2024-09-13T15:04:18.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5961c00640 1 -- 172.21.15.7:0/311875879 learned_addr learned my addr 172.21.15.7:0/311875879 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:18.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5963000640 1 -- 172.21.15.7:0/311875879 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c06d290 con 0x7f595c0c5410 2024-09-13T15:04:18.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5963000640 1 -- 172.21.15.7:0/311875879 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595c150970 con 0x7f595c155a30 2024-09-13T15:04:18.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5962600640 1 --2- 172.21.15.7:0/311875879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f595c155a30 0x7f595c0b7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f3114c00640 1 -- 172.21.15.7:0/3329480494 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f31180fea50 con 0x7f31100d8e80 2024-09-13T15:04:18.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f311d200640 1 --2- 172.21.15.7:0/3329480494 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f30f80666c0 0x7f30f8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5961200640 1 --2- 172.21.15.7:0/311875879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f595c14f4c0 0x7f595c153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5962600640 1 -- 172.21.15.7:0/311875879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f595c0c5410 msgr2=0x7f595c1f2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5962600640 1 --2- 172.21.15.7:0/311875879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f595c0c5410 0x7f595c1f2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5962600640 1 -- 172.21.15.7:0/311875879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f595c14f4c0 msgr2=0x7f595c153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f191b400640 1 -- 172.21.15.7:0/3718370962 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1914007450 con 0x7f192406cd50 2024-09-13T15:04:18.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5962600640 1 --2- 172.21.15.7:0/311875879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f595c14f4c0 0x7f595c153430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5962600640 1 -- 172.21.15.7:0/311875879 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59500094d0 con 0x7f595c155a30 2024-09-13T15:04:18.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5962600640 1 --2- 172.21.15.7:0/311875879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f595c155a30 0x7f595c0b7f90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f595400c760 tx=0x7f595400cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5959600640 1 -- 172.21.15.7:0/311875879 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595400ce70 con 0x7f595c155a30 2024-09-13T15:04:18.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5963000640 1 -- 172.21.15.7:0/311875879 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595c1555d0 con 0x7f595c155a30 2024-09-13T15:04:18.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5959600640 1 -- 172.21.15.7:0/311875879 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595400a640 con 0x7f595c155a30 2024-09-13T15:04:18.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5959600640 1 -- 172.21.15.7:0/311875879 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595400a9b0 con 0x7f595c155a30 2024-09-13T15:04:18.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f5963000640 1 -- 172.21.15.7:0/311875879 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595c1f2c40 con 0x7f595c155a30 2024-09-13T15:04:18.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.105+0000 7f191b400640 1 --2- 172.21.15.7:0/3718370962 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1904066760 0x7f1904068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.105+0000 7f191b400640 1 -- 172.21.15.7:0/3718370962 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1914083b00 con 0x7f192406cd50 2024-09-13T15:04:18.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.105+0000 7f1922a00640 1 --2- 172.21.15.7:0/3718370962 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1904066760 0x7f1904068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.101+0000 7f311d200640 1 --2- 172.21.15.7:0/3329480494 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f30f80666c0 0x7f30f8068b80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3104007fd0 tx=0x7f3104009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.105+0000 7f1922a00640 1 --2- 172.21.15.7:0/3718370962 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1904066760 0x7f1904068c20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1924152aa0 tx=0x7f191c0aa000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.105+0000 7f5963000640 1 -- 172.21.15.7:0/311875879 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595c06d720 con 0x7f595c155a30 2024-09-13T15:04:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.105+0000 7f5959600640 1 -- 172.21.15.7:0/311875879 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f595400ab10 con 0x7f595c155a30 2024-09-13T15:04:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.105+0000 7f5959600640 1 --2- 172.21.15.7:0/311875879 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f593c066690 0x7f593c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.105+0000 7f5959600640 1 -- 172.21.15.7:0/311875879 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5954084440 con 0x7f595c155a30 2024-09-13T15:04:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.109+0000 7f5961c00640 1 --2- 172.21.15.7:0/311875879 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f593c066690 0x7f593c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.109+0000 7f5961c00640 1 --2- 172.21.15.7:0/311875879 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f593c066690 0x7f593c068b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5950009870 tx=0x7f59500aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.113+0000 7f191b400640 1 -- 172.21.15.7:0/3718370962 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1914050b40 con 0x7f192406cd50 2024-09-13T15:04:18.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.125+0000 7f3114c00640 1 -- 172.21.15.7:0/3329480494 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f31180cba90 con 0x7f31100d8e80 2024-09-13T15:04:18.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.133+0000 7f5959600640 1 -- 172.21.15.7:0/311875879 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5954051510 con 0x7f595c155a30 2024-09-13T15:04:18.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.165+0000 7f9c30000640 1 Processor -- start 2024-09-13T15:04:18.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.165+0000 7f9c30000640 1 -- start start 2024-09-13T15:04:18.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.165+0000 7eff18a00640 1 Processor -- start 2024-09-13T15:04:18.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.165+0000 7eff18a00640 1 -- start start 2024-09-13T15:04:18.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.165+0000 7eff18a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff140b15c0 0x7eff14169e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.165+0000 7eff18a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff141699e0 con 0x7eff14165e20 2024-09-13T15:04:18.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.165+0000 7eff18a00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff141662d0 con 0x7eff14160140 2024-09-13T15:04:18.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.165+0000 7eff18a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff140ceb60 con 0x7eff140b15c0 2024-09-13T15:04:18.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.165+0000 7f9c30000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c280c7ea0 0x7f9c28155e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.165+0000 7f9c30000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9c2806da60 0x7f9c2806cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.165+0000 7f9c30000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c281563b0 con 0x7f9c280c5180 2024-09-13T15:04:18.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c30000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c280c6640 con 0x7f9c2806da60 2024-09-13T15:04:18.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c30000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c280c59c0 con 0x7f9c280c7ea0 2024-09-13T15:04:18.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.165+0000 7f7d48e00640 1 Processor -- start 2024-09-13T15:04:18.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.165+0000 7f7d48e00640 1 -- start start 2024-09-13T15:04:18.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c2e000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9c280c5180 0x7f9c28156a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50832/0 (socket says 172.21.15.7:50832) 2024-09-13T15:04:18.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c2e000640 1 -- 172.21.15.7:0/968558498 learned_addr learned my addr 172.21.15.7:0/968558498 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:18.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c2cc00640 1 --2- 172.21.15.7:0/968558498 >> v2:172.21.15.7:3300/0 conn(0x7f9c2806da60 0x7f9c2806cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7eff0be00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff140b15c0 0x7eff14169e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7eff12800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7eff14165e20 0x7eff140ca9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:50826/0 (socket says 172.21.15.7:50826) 2024-09-13T15:04:18.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7eff12800640 1 -- 172.21.15.7:0/1825174211 learned_addr learned my addr 172.21.15.7:0/1825174211 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:18.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7eff11e00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7eff14160140 0x7eff140c9e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:45744/0 (socket says 172.21.15.7:45744) 2024-09-13T15:04:18.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f7d48e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7d3c006470 0x7f7d3c006850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f7d48e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3c0e6c50 con 0x7f7d3c0e6160 2024-09-13T15:04:18.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f7d48e00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3c006f70 con 0x7f7d3c0d8eb0 2024-09-13T15:04:18.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f7d48e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3c006d90 con 0x7f7d3c006470 2024-09-13T15:04:18.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c27e00640 1 -- 172.21.15.7:0/968558498 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128741581 0 0) 0x7f9c200014a0 con 0x7f9c280c5180 2024-09-13T15:04:18.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c27e00640 1 -- 172.21.15.7:0/968558498 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c10003530 con 0x7f9c280c5180 2024-09-13T15:04:18.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c2d600640 1 --2- 172.21.15.7:0/968558498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c280c7ea0 0x7f9c28155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f7d41400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7d3c006470 0x7f7d3c006850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f7d41400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7d3c006470 0x7f7d3c006850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34038/0 (socket says 172.21.15.7:34038) 2024-09-13T15:04:18.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f7d41400640 1 -- 172.21.15.7:0/567619374 learned_addr learned my addr 172.21.15.7:0/567619374 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:18.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c27e00640 1 -- 172.21.15.7:0/968558498 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 500173297 0 0) 0x7f9c10003530 con 0x7f9c280c5180 2024-09-13T15:04:18.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c27e00640 1 -- 172.21.15.7:0/968558498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c280c7ea0 msgr2=0x7f9c28155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:18.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c27e00640 1 --2- 172.21.15.7:0/968558498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c280c7ea0 0x7f9c28155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c27e00640 1 -- 172.21.15.7:0/968558498 >> v2:172.21.15.7:3300/0 conn(0x7f9c2806da60 msgr2=0x7f9c2806cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:18.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c27e00640 1 --2- 172.21.15.7:0/968558498 >> v2:172.21.15.7:3300/0 conn(0x7f9c2806da60 0x7f9c2806cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c27e00640 1 -- 172.21.15.7:0/968558498 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c280c5ca0 con 0x7f9c280c5180 2024-09-13T15:04:18.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c27e00640 1 -- 172.21.15.7:0/968558498 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f9c20001b90 con 0x7f9c280c5180 2024-09-13T15:04:18.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c27e00640 1 -- 172.21.15.7:0/968558498 >> v1:172.21.15.7:6789/0 conn(0x7f9c280c5180 legacy=0x7f9c28156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c27e00640 1 --2- 172.21.15.7:0/968558498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c10003980 0x7f9c10003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c27e00640 1 --2- 172.21.15.7:0/968558498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c10004370 0x7f9c10004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c27e00640 1 --2- 172.21.15.7:0/968558498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c10004f70 0x7f9c1000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c27e00640 1 -- 172.21.15.7:0/968558498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c280c6640 con 0x7f9c10004f70 2024-09-13T15:04:18.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c27e00640 1 -- 172.21.15.7:0/968558498 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c280c59c0 con 0x7f9c10004370 2024-09-13T15:04:18.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c27e00640 1 -- 172.21.15.7:0/968558498 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1000bf00 con 0x7f9c10003980 2024-09-13T15:04:18.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c2d600640 1 --2- 172.21.15.7:0/968558498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c280c7ea0 0x7f9c28155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:18.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f9c2d600640 1 --2- 172.21.15.7:0/968558498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c10003980 0x7f9c10003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.173+0000 7f9c2cc00640 1 --2- 172.21.15.7:0/968558498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c10004370 0x7f9c10004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.173+0000 7f9c2e000640 1 --2- 172.21.15.7:0/968558498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c10004f70 0x7f9c1000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.173+0000 7f9c2d600640 1 -- 172.21.15.7:0/968558498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c10004370 msgr2=0x7f9c10004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:18.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.173+0000 7f9c2d600640 1 --2- 172.21.15.7:0/968558498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c10004370 0x7f9c10004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.173+0000 7f9c2d600640 1 -- 172.21.15.7:0/968558498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c10004f70 msgr2=0x7f9c1000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:18.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.173+0000 7f9c2d600640 1 --2- 172.21.15.7:0/968558498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c10004f70 0x7f9c1000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.173+0000 7eff0be00640 1 -- 172.21.15.7:0/1825174211 >> v1:172.21.15.77:6789/0 conn(0x7eff14160140 legacy=0x7eff140c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.173+0000 7eff0be00640 1 -- 172.21.15.7:0/1825174211 >> v1:172.21.15.7:6789/0 conn(0x7eff14165e20 legacy=0x7eff140ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.173+0000 7eff11400640 1 -- 172.21.15.7:0/1825174211 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387775127 0 0) 0x7eff141699e0 con 0x7eff14165e20 2024-09-13T15:04:18.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.173+0000 7eff0be00640 1 -- 172.21.15.7:0/1825174211 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff140cee00 con 0x7eff140b15c0 2024-09-13T15:04:18.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f7d41400640 1 -- 172.21.15.7:0/567619374 >> v1:172.21.15.77:6789/0 conn(0x7f7d3c0d8eb0 legacy=0x7f7d3c04b710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:04:18.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f7d41400640 1 -- 172.21.15.7:0/567619374 >> v1:172.21.15.7:6789/0 conn(0x7f7d3c0e6160 legacy=0x7f7d3c0e6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.169+0000 7f7d41400640 1 -- 172.21.15.7:0/567619374 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3c007210 con 0x7f7d3c006470 2024-09-13T15:04:18.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.173+0000 7f9c2d600640 1 -- 172.21.15.7:0/968558498 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c280c5ca0 con 0x7f9c10003980 2024-09-13T15:04:18.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.173+0000 7f9c2cc00640 1 --2- 172.21.15.7:0/968558498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c10004370 0x7f9c10004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:18.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.173+0000 7f7d41400640 1 --2- 172.21.15.7:0/567619374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d3c006470 0x7f7d3c006850 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009870 tx=0x7f7d3001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9465cf6e7e95e534 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.173+0000 7f7d40a00640 1 -- 172.21.15.7:0/567619374 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300a8a10 con 0x7f7d3c006470 2024-09-13T15:04:18.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7f7d40a00640 1 -- 172.21.15.7:0/567619374 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d300a8b70 con 0x7f7d3c006470 2024-09-13T15:04:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7f7d40a00640 1 -- 172.21.15.7:0/567619374 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300b0440 con 0x7f7d3c006470 2024-09-13T15:04:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7f7d48e00640 1 -- 172.21.15.7:0/567619374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d3c006470 msgr2=0x7f7d3c006850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7f7d48e00640 1 --2- 172.21.15.7:0/567619374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d3c006470 0x7f7d3c006850 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009870 tx=0x7f7d3001ed30 comp rx=0 tx=0).stop 2024-09-13T15:04:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7f7d48e00640 1 -- 172.21.15.7:0/567619374 shutdown_connections 2024-09-13T15:04:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7f7d48e00640 1 --2- 172.21.15.7:0/567619374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d3c006470 0x7f7d3c006850 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7f7d48e00640 1 -- 172.21.15.7:0/567619374 >> 172.21.15.7:0/567619374 conn(0x7f7d3c04fc60 msgr2=0x7f7d3c050040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7f9c2e000640 1 --2- 172.21.15.7:0/968558498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c10004f70 0x7f9c1000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7f7d48e00640 1 -- 172.21.15.7:0/567619374 shutdown_connections 2024-09-13T15:04:18.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7f7d48e00640 1 -- 172.21.15.7:0/567619374 wait complete. 2024-09-13T15:04:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7eff0be00640 1 --2- 172.21.15.7:0/1825174211 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff140b15c0 0x7eff14169e70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efefc009770 tx=0x7efefc01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5027186b2cffef3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7eff11400640 1 -- 172.21.15.7:0/1825174211 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc0ac620 con 0x7eff140b15c0 2024-09-13T15:04:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7eff11400640 1 -- 172.21.15.7:0/1825174211 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc0ac780 con 0x7eff140b15c0 2024-09-13T15:04:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7eff11400640 1 -- 172.21.15.7:0/1825174211 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc0acb10 con 0x7eff140b15c0 2024-09-13T15:04:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7eff18a00640 1 -- 172.21.15.7:0/1825174211 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff140b15c0 msgr2=0x7eff14169e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7eff18a00640 1 --2- 172.21.15.7:0/1825174211 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff140b15c0 0x7eff14169e70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efefc009770 tx=0x7efefc01c3a0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7eff18a00640 1 -- 172.21.15.7:0/1825174211 shutdown_connections 2024-09-13T15:04:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7eff18a00640 1 --2- 172.21.15.7:0/1825174211 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff140b15c0 0x7eff14169e70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7eff18a00640 1 -- 172.21.15.7:0/1825174211 >> 172.21.15.7:0/1825174211 conn(0x7eff1406b940 msgr2=0x7eff14065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.177+0000 7f9c2d600640 1 --2- 172.21.15.7:0/968558498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c10003980 0x7f9c10003da0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9c2806e140 tx=0x7f9c1c01cb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=467c3408ee88f480 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7eff18a00640 1 -- 172.21.15.7:0/1825174211 shutdown_connections 2024-09-13T15:04:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f63a7e00640 1 Processor -- start 2024-09-13T15:04:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7eff18a00640 1 -- 172.21.15.7:0/1825174211 wait complete. 2024-09-13T15:04:18.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f9c27e00640 1 -- 172.21.15.7:0/968558498 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c004030 con 0x7f9c10003980 2024-09-13T15:04:18.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f9c27e00640 1 -- 172.21.15.7:0/968558498 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c004190 con 0x7f9c10003980 2024-09-13T15:04:18.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f9c27e00640 1 -- 172.21.15.7:0/968558498 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c004500 con 0x7f9c10003980 2024-09-13T15:04:18.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f7d48e00640 1 Processor -- start 2024-09-13T15:04:18.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f9c30000640 1 -- 172.21.15.7:0/968558498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c10003980 msgr2=0x7f9c10003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f9c30000640 1 --2- 172.21.15.7:0/968558498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c10003980 0x7f9c10003da0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9c2806e140 tx=0x7f9c1c01cb10 comp rx=0 tx=0).stop 2024-09-13T15:04:18.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f9c2e000640 1 -- 172.21.15.7:0/968558498 reap_dead start 2024-09-13T15:04:18.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f7d48e00640 1 -- start start 2024-09-13T15:04:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f9c30000640 1 -- 172.21.15.7:0/968558498 shutdown_connections 2024-09-13T15:04:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f9c30000640 1 -- 172.21.15.7:0/968558498 >> 172.21.15.7:0/968558498 conn(0x7f9c280c7380 msgr2=0x7f9c280c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f9c30000640 1 -- 172.21.15.7:0/968558498 shutdown_connections 2024-09-13T15:04:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f9c30000640 1 -- 172.21.15.7:0/968558498 wait complete. 2024-09-13T15:04:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f63a7e00640 1 -- start start 2024-09-13T15:04:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f63a7e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f63a814f240 0x7f63a806ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f63a7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f63a806f5c0 0x7f63a80c5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7eff18a00640 1 Processor -- start 2024-09-13T15:04:18.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f63a6a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f63a814f240 0x7f63a806ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f63a6a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f63a814f240 0x7f63a806ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56602/0 (socket says 172.21.15.7:56602) 2024-09-13T15:04:18.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f63a6000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f63a806f5c0 0x7f63a80c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7eff18a00640 1 -- start start 2024-09-13T15:04:18.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f7d48e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d3c0d8eb0 0x7f7d3c04e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f63a6000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f63a806f5c0 0x7f63a80c5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34064/0 (socket says 172.21.15.7:34064) 2024-09-13T15:04:18.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f63a7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a80c7e70 0x7f63a806af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f63a6000640 1 -- 172.21.15.7:0/4223169854 learned_addr learned my addr 172.21.15.7:0/4223169854 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:18.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f63a7e00640 1 -- 172.21.15.7:0/4223169854 --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a80717e0 con 0x7f63a806f5c0 2024-09-13T15:04:18.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f63a7e00640 1 -- 172.21.15.7:0/4223169854 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a8158e60 con 0x7f63a814f240 2024-09-13T15:04:18.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f63a7e00640 1 -- 172.21.15.7:0/4223169854 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a8158570 con 0x7f63a80c7e70 2024-09-13T15:04:18.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.181+0000 7f7d48e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d3c0e6160 0x7f7d3c04c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c30000640 1 Processor -- start 2024-09-13T15:04:18.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f7d48e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d3c0e4480 0x7f7d3c0cf380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c30000640 1 -- start start 2024-09-13T15:04:18.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f63a6000640 1 -- 172.21.15.7:0/4223169854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a80c7e70 msgr2=0x7f63a806af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:18.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f63a6000640 1 --2- 172.21.15.7:0/4223169854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a80c7e70 0x7f63a806af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f63a6000640 1 -- 172.21.15.7:0/4223169854 >> v2:172.21.15.77:3300/0 conn(0x7f63a814f240 msgr2=0x7f63a806ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:18.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f63a6000640 1 --2- 172.21.15.7:0/4223169854 >> v2:172.21.15.77:3300/0 conn(0x7f63a814f240 0x7f63a806ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f63a6000640 1 -- 172.21.15.7:0/4223169854 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a806c030 con 0x7f63a806f5c0 2024-09-13T15:04:18.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7eff18a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff140b15c0 0x7eff14168230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f7d48e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c0e5930 con 0x7f7d3c0d8eb0 2024-09-13T15:04:18.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f7d48e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c0d2eb0 con 0x7f7d3c0e4480 2024-09-13T15:04:18.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f7d48e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c0d28f0 con 0x7f7d3c0e6160 2024-09-13T15:04:18.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f7d41400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d3c0e6160 0x7f7d3c04c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f7d41400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d3c0e6160 0x7f7d3c04c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:41790/0 (socket says 172.21.15.7:41790) 2024-09-13T15:04:18.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f7d41400640 1 -- 172.21.15.7:0/1473551343 learned_addr learned my addr 172.21.15.7:0/1473551343 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:18.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f7d42800640 1 --2- 172.21.15.7:0/1473551343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d3c0e4480 0x7f7d3c0cf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7eff11e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff140b15c0 0x7eff14168230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7eff11e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff140b15c0 0x7eff14168230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:41796/0 (socket says 172.21.15.7:41796) 2024-09-13T15:04:18.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7eff11e00640 1 -- 172.21.15.7:0/3120426921 learned_addr learned my addr 172.21.15.7:0/3120426921 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:18.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7eff18a00640 1 --2- 172.21.15.7:0/3120426921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff14160140 0x7eff141ef700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c30000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c10003980 0x7f9c281513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c30000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c28153b10 0x7f9c28157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c30000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c28154850 0x7f9c2813df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7eff18a00640 1 --2- 172.21.15.7:0/3120426921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff14165e20 0x7eff1415cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7eff18a00640 1 -- 172.21.15.7:0/3120426921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff140c81d0 con 0x7eff14160140 2024-09-13T15:04:18.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7eff18a00640 1 -- 172.21.15.7:0/3120426921 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff140c8d80 con 0x7eff14165e20 2024-09-13T15:04:18.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7eff18a00640 1 -- 172.21.15.7:0/3120426921 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff140c7440 con 0x7eff140b15c0 2024-09-13T15:04:18.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f7d41e00640 1 --2- 172.21.15.7:0/1473551343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d3c0d8eb0 0x7f7d3c04e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c2cc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c28153b10 0x7f9c28157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c2cc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c28153b10 0x7f9c28157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56622/0 (socket says 172.21.15.7:56622) 2024-09-13T15:04:18.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c2e000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c28154850 0x7f9c2813df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7eff12800640 1 --2- 172.21.15.7:0/3120426921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff14165e20 0x7eff1415cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f7d41400640 1 -- 172.21.15.7:0/1473551343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d3c0e4480 msgr2=0x7f7d3c0cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f7d41400640 1 --2- 172.21.15.7:0/1473551343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d3c0e4480 0x7f7d3c0cf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f7d41400640 1 -- 172.21.15.7:0/1473551343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d3c0d8eb0 msgr2=0x7f7d3c04e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f7d41400640 1 --2- 172.21.15.7:0/1473551343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d3c0d8eb0 0x7f7d3c04e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f7d41400640 1 -- 172.21.15.7:0/1473551343 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d300094d0 con 0x7f7d3c0e6160 2024-09-13T15:04:18.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c2e000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c28154850 0x7f9c2813df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:41798/0 (socket says 172.21.15.7:41798) 2024-09-13T15:04:18.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c2cc00640 1 -- 172.21.15.7:0/312629703 learned_addr learned my addr 172.21.15.7:0/312629703 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:18.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c30000640 1 -- 172.21.15.7:0/312629703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c281424f0 con 0x7f9c10003980 2024-09-13T15:04:18.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c30000640 1 -- 172.21.15.7:0/312629703 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c28153680 con 0x7f9c28153b10 2024-09-13T15:04:18.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c30000640 1 -- 172.21.15.7:0/312629703 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c280c1770 con 0x7f9c28154850 2024-09-13T15:04:18.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f7d42800640 1 --2- 172.21.15.7:0/1473551343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d3c0e4480 0x7f7d3c0cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:18.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7eff11e00640 1 -- 172.21.15.7:0/3120426921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff14165e20 msgr2=0x7eff1415cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7eff11e00640 1 --2- 172.21.15.7:0/3120426921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff14165e20 0x7eff1415cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7eff11e00640 1 -- 172.21.15.7:0/3120426921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff14160140 msgr2=0x7eff141ef700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7eff11e00640 1 --2- 172.21.15.7:0/3120426921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff14160140 0x7eff141ef700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7eff11e00640 1 -- 172.21.15.7:0/3120426921 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc009420 con 0x7eff140b15c0 2024-09-13T15:04:18.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c2d600640 1 --2- 172.21.15.7:0/312629703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c10003980 0x7f9c281513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c2e000640 1 -- 172.21.15.7:0/312629703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c28153b10 msgr2=0x7f9c28157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c2e000640 1 --2- 172.21.15.7:0/312629703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c28153b10 0x7f9c28157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c2e000640 1 -- 172.21.15.7:0/312629703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c10003980 msgr2=0x7f9c281513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c2e000640 1 --2- 172.21.15.7:0/312629703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c10003980 0x7f9c281513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f9c2e000640 1 -- 172.21.15.7:0/312629703 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c28155280 con 0x7f9c28154850 2024-09-13T15:04:18.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7fb1fc600640 1 Processor -- start 2024-09-13T15:04:18.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7fb1fc600640 1 -- start start 2024-09-13T15:04:18.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.185+0000 7f7d41400640 1 --2- 172.21.15.7:0/1473551343 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d3c0e6160 0x7f7d3c04c9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d300b3040 tx=0x7f7d3001bad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7eff11e00640 1 --2- 172.21.15.7:0/3120426921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff140b15c0 0x7eff14168230 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff04009ec0 tx=0x7eff0400c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7f9c2e000640 1 --2- 172.21.15.7:0/312629703 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c28154850 0x7f9c2813df60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9c280c4da0 tx=0x7f9c2000e530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7f7d3a000640 1 -- 172.21.15.7:0/1473551343 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300b0de0 con 0x7f7d3c0e6160 2024-09-13T15:04:18.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7f7d48e00640 1 -- 172.21.15.7:0/1473551343 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3c0d2bd0 con 0x7f7d3c0e6160 2024-09-13T15:04:18.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7f7d48e00640 1 -- 172.21.15.7:0/1473551343 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3c0d1360 con 0x7f7d3c0e6160 2024-09-13T15:04:18.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7f7d3a000640 1 -- 172.21.15.7:0/1473551343 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d30004020 con 0x7f7d3c0e6160 2024-09-13T15:04:18.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7f7d3a000640 1 -- 172.21.15.7:0/1473551343 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30004390 con 0x7f7d3c0e6160 2024-09-13T15:04:18.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7eff0a000640 1 -- 172.21.15.7:0/3120426921 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04007a30 con 0x7eff140b15c0 2024-09-13T15:04:18.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7eff0a000640 1 -- 172.21.15.7:0/3120426921 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff04007b90 con 0x7eff140b15c0 2024-09-13T15:04:18.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7eff0a000640 1 -- 172.21.15.7:0/3120426921 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0400ce10 con 0x7eff140b15c0 2024-09-13T15:04:18.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7fb1fc600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1f41576f0 0x7fb1f40c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7fb1fc600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb1f406f6b0 0x7fb1f4157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7eff18a00640 1 -- 172.21.15.7:0/3120426921 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff140c7780 con 0x7eff140b15c0 2024-09-13T15:04:18.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7f7d48e00640 1 -- 172.21.15.7:0/1473551343 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d1c005260 con 0x7f7d3c0e6160 2024-09-13T15:04:18.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7f9c25600640 1 -- 172.21.15.7:0/312629703 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2000eb30 con 0x7f9c28154850 2024-09-13T15:04:18.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7f9c25600640 1 -- 172.21.15.7:0/312629703 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2000ec90 con 0x7f9c28154850 2024-09-13T15:04:18.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7f9c25600640 1 -- 172.21.15.7:0/312629703 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c20014480 con 0x7f9c28154850 2024-09-13T15:04:18.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7f9c30000640 1 -- 172.21.15.7:0/312629703 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c28142740 con 0x7f9c28154850 2024-09-13T15:04:18.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7fb1f9c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1f41576f0 0x7fb1f40c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7fb1f9c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1f41576f0 0x7fb1f40c6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56642/0 (socket says 172.21.15.7:56642) 2024-09-13T15:04:18.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7fb1f9c00640 1 -- 172.21.15.7:0/3132839729 learned_addr learned my addr 172.21.15.7:0/3132839729 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:18.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7fb1fc600640 1 -- 172.21.15.7:0/3132839729 --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1f406d080 con 0x7fb1f406d510 2024-09-13T15:04:18.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7fb1fc600640 1 -- 172.21.15.7:0/3132839729 --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f40c5b90 con 0x7fb1f406f6b0 2024-09-13T15:04:18.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7fb1fc600640 1 -- 172.21.15.7:0/3132839729 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1f415e560 con 0x7fb1f41576f0 2024-09-13T15:04:18.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7f9c30000640 1 -- 172.21.15.7:0/312629703 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c28153030 con 0x7f9c28154850 2024-09-13T15:04:18.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7eff18a00640 1 -- 172.21.15.7:0/3120426921 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff141ef1e0 con 0x7eff140b15c0 2024-09-13T15:04:18.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7f9c30000640 1 -- 172.21.15.7:0/312629703 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c28067610 con 0x7f9c28154850 2024-09-13T15:04:18.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.189+0000 7fb1f9200640 1 --2- 172.21.15.7:0/3132839729 >> v2:172.21.15.7:3300/0 conn(0x7fb1f406f6b0 0x7fb1f4157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f3e00640 1 -- 172.21.15.7:0/3132839729 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496852134 0 0) 0x7fb1f406d080 con 0x7fb1f406d510 2024-09-13T15:04:18.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f3e00640 1 -- 172.21.15.7:0/3132839729 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1dc003530 con 0x7fb1f406d510 2024-09-13T15:04:18.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7eff18a00640 1 -- 172.21.15.7:0/3120426921 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff141ef3d0 con 0x7eff140b15c0 2024-09-13T15:04:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f3e00640 1 -- 172.21.15.7:0/3132839729 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 757231728 0 0) 0x7fb1dc003530 con 0x7fb1f406d510 2024-09-13T15:04:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f3e00640 1 -- 172.21.15.7:0/3132839729 >> v2:172.21.15.77:3300/0 conn(0x7fb1f41576f0 msgr2=0x7fb1f40c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f3e00640 1 --2- 172.21.15.7:0/3132839729 >> v2:172.21.15.77:3300/0 conn(0x7fb1f41576f0 0x7fb1f40c6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f3e00640 1 -- 172.21.15.7:0/3132839729 >> v2:172.21.15.7:3300/0 conn(0x7fb1f406f6b0 msgr2=0x7fb1f4157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f3e00640 1 --2- 172.21.15.7:0/3132839729 >> v2:172.21.15.7:3300/0 conn(0x7fb1f406f6b0 0x7fb1f4157ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f3e00640 1 -- 172.21.15.7:0/3132839729 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f40c5e50 con 0x7fb1f406d510 2024-09-13T15:04:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f3e00640 1 -- 172.21.15.7:0/3132839729 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7fb1ec001a00 con 0x7fb1f406d510 2024-09-13T15:04:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f3e00640 1 -- 172.21.15.7:0/3132839729 >> v1:172.21.15.7:6789/0 conn(0x7fb1f406d510 legacy=0x7fb1f406d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f9c00640 1 --2- 172.21.15.7:0/3132839729 >> v2:172.21.15.77:3300/0 conn(0x7fb1f41576f0 0x7fb1f40c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-13T15:04:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7f63a6000640 1 --2- 172.21.15.7:0/4223169854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63a806f5c0 0x7f63a80c5280 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f63a804e8f0 tx=0x7f6394027430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145c46df1af0efff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f3e00640 1 --2- 172.21.15.7:0/3132839729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1dc003980 0x7fb1dc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f3e00640 1 --2- 172.21.15.7:0/3132839729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1dc0047d0 0x7fb1dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f3e00640 1 --2- 172.21.15.7:0/3132839729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1dc005190 0x7fb1dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f3e00640 1 -- 172.21.15.7:0/3132839729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f40c5b90 con 0x7fb1dc0047d0 2024-09-13T15:04:18.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f3e00640 1 -- 172.21.15.7:0/3132839729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f415e560 con 0x7fb1dc003980 2024-09-13T15:04:18.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f3e00640 1 -- 172.21.15.7:0/3132839729 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc00c0c0 con 0x7fb1dc005190 2024-09-13T15:04:18.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7f9c25600640 1 -- 172.21.15.7:0/312629703 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9c200145e0 con 0x7f9c28154850 2024-09-13T15:04:18.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f9c00640 1 --2- 172.21.15.7:0/3132839729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1dc003980 0x7fb1dc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1fa600640 1 --2- 172.21.15.7:0/3132839729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1dc005190 0x7fb1dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f9c00640 1 -- 172.21.15.7:0/3132839729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1dc005190 msgr2=0x7fb1dc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:18.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f9c00640 1 --2- 172.21.15.7:0/3132839729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1dc005190 0x7fb1dc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f9c00640 1 -- 172.21.15.7:0/3132839729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1dc0047d0 msgr2=0x7fb1dc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:18.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f9c00640 1 --2- 172.21.15.7:0/3132839729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1dc0047d0 0x7fb1dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1f9c00640 1 -- 172.21.15.7:0/3132839729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f40c5e50 con 0x7fb1dc003980 2024-09-13T15:04:18.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1fa600640 1 --2- 172.21.15.7:0/3132839729 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1dc005190 0x7fb1dc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:18.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7fb1fa600640 1 -- 172.21.15.7:0/3132839729 reap_dead start 2024-09-13T15:04:18.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7f7d3a000640 1 -- 172.21.15.7:0/1473551343 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7d300b7070 con 0x7f7d3c0e6160 2024-09-13T15:04:18.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.193+0000 7eff0a000640 1 -- 172.21.15.7:0/3120426921 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7eff04009070 con 0x7eff140b15c0 2024-09-13T15:04:18.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7eff0a000640 1 --2- 172.21.15.7:0/3120426921 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efef0066760 0x7efef0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f9c25600640 1 --2- 172.21.15.7:0/312629703 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9c08066790 0x7f9c08068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f9c25600640 1 -- 172.21.15.7:0/312629703 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9c20084240 con 0x7f9c28154850 2024-09-13T15:04:18.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f9c2d600640 1 --2- 172.21.15.7:0/312629703 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9c08066790 0x7f9c08068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7eff0a000640 1 -- 172.21.15.7:0/3120426921 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7eff040863c0 con 0x7eff140b15c0 2024-09-13T15:04:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f63a5600640 1 -- 172.21.15.7:0/4223169854 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63940112d0 con 0x7f63a806f5c0 2024-09-13T15:04:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f63a5600640 1 -- 172.21.15.7:0/4223169854 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63940b3050 con 0x7f63a806f5c0 2024-09-13T15:04:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f63a5600640 1 -- 172.21.15.7:0/4223169854 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6394011650 con 0x7f63a806f5c0 2024-09-13T15:04:18.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7eff0be00640 1 --2- 172.21.15.7:0/3120426921 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efef0066760 0x7efef0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f7d3a000640 1 --2- 172.21.15.7:0/1473551343 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d24066690 0x7f7d24068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f9c2d600640 1 --2- 172.21.15.7:0/312629703 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9c08066790 0x7f9c08068c50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0ae000 tx=0x7f9c1c0046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f63a7e00640 1 -- 172.21.15.7:0/4223169854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63a806f5c0 msgr2=0x7f63a80c5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f63a7e00640 1 --2- 172.21.15.7:0/4223169854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63a806f5c0 0x7f63a80c5280 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f63a804e8f0 tx=0x7f6394027430 comp rx=0 tx=0).stop 2024-09-13T15:04:18.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f7d3a000640 1 -- 172.21.15.7:0/1473551343 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7d30121e80 con 0x7f7d3c0e6160 2024-09-13T15:04:18.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f7d41e00640 1 --2- 172.21.15.7:0/1473551343 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d24066690 0x7f7d24068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f63a7e00640 1 -- 172.21.15.7:0/4223169854 shutdown_connections 2024-09-13T15:04:18.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f63a7e00640 1 --2- 172.21.15.7:0/4223169854 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a80c7e70 0x7f63a806af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f63a7e00640 1 --2- 172.21.15.7:0/4223169854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63a806f5c0 0x7f63a80c5280 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f63a7e00640 1 --2- 172.21.15.7:0/4223169854 >> v2:172.21.15.77:3300/0 conn(0x7f63a814f240 0x7f63a806ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f63a7e00640 1 -- 172.21.15.7:0/4223169854 >> 172.21.15.7:0/4223169854 conn(0x7f63a80c7380 msgr2=0x7f63a80c7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:18.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f63a7e00640 1 -- 172.21.15.7:0/4223169854 shutdown_connections 2024-09-13T15:04:18.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f63a7e00640 1 -- 172.21.15.7:0/4223169854 wait complete. 2024-09-13T15:04:18.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7eff0be00640 1 --2- 172.21.15.7:0/3120426921 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efef0066760 0x7efef0068c20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efefc0ae000 tx=0x7efefc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.197+0000 7f7d41e00640 1 --2- 172.21.15.7:0/1473551343 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d24066690 0x7f7d24068b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7d34007fd0 tx=0x7f7d34009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7fb1f9c00640 1 --2- 172.21.15.7:0/3132839729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1dc003980 0x7fb1dc003da0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800ab60 tx=0x7fb1e801c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8828d1013ec2447f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a7e00640 1 Processor -- start 2024-09-13T15:04:18.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7fb1f3e00640 1 -- 172.21.15.7:0/3132839729 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e80a8660 con 0x7fb1dc003980 2024-09-13T15:04:18.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7fb1f3e00640 1 -- 172.21.15.7:0/3132839729 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e80a87c0 con 0x7fb1dc003980 2024-09-13T15:04:18.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7fb1f3e00640 1 -- 172.21.15.7:0/3132839729 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e80a8b70 con 0x7fb1dc003980 2024-09-13T15:04:18.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a7e00640 1 -- start start 2024-09-13T15:04:18.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7fb1fc600640 1 -- 172.21.15.7:0/3132839729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1dc003980 msgr2=0x7fb1dc003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7fb1fc600640 1 --2- 172.21.15.7:0/3132839729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1dc003980 0x7fb1dc003da0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800ab60 tx=0x7fb1e801c6f0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7fb1fc600640 1 -- 172.21.15.7:0/3132839729 shutdown_connections 2024-09-13T15:04:18.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7fb1fc600640 1 --2- 172.21.15.7:0/3132839729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1dc003980 0x7fb1dc003da0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7fb1fc600640 1 -- 172.21.15.7:0/3132839729 >> 172.21.15.7:0/3132839729 conn(0x7fb1f40c7380 msgr2=0x7fb1f40c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:18.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7fb1fc600640 1 -- 172.21.15.7:0/3132839729 shutdown_connections 2024-09-13T15:04:18.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a806f5c0 0x7f63a80ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63a80c7e70 0x7f63a8146b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7fb1fc600640 1 -- 172.21.15.7:0/3132839729 wait complete. 2024-09-13T15:04:18.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a814f240 0x7f63a81470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a7e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a81442f0 con 0x7f63a80c7e70 2024-09-13T15:04:18.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a7e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a81477f0 con 0x7f63a806f5c0 2024-09-13T15:04:18.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a7e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a8143d50 con 0x7f63a814f240 2024-09-13T15:04:18.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a6a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a806f5c0 0x7f63a80ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63a80c7e70 0x7f63a8146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a6a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a806f5c0 0x7f63a80ca080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56662/0 (socket says 172.21.15.7:56662) 2024-09-13T15:04:18.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63a80c7e70 0x7f63a8146b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:34128/0 (socket says 172.21.15.7:34128) 2024-09-13T15:04:18.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a6a00640 1 -- 172.21.15.7:0/1990253870 learned_addr learned my addr 172.21.15.7:0/1990253870 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:18.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a7400640 1 --2- 172.21.15.7:0/1990253870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a814f240 0x7f63a81470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a7400640 1 -- 172.21.15.7:0/1990253870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a806f5c0 msgr2=0x7f63a80ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a7400640 1 --2- 172.21.15.7:0/1990253870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a806f5c0 0x7f63a80ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a7400640 1 -- 172.21.15.7:0/1990253870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63a80c7e70 msgr2=0x7f63a8146b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a7400640 1 --2- 172.21.15.7:0/1990253870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63a80c7e70 0x7f63a8146b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.201+0000 7f63a7400640 1 -- 172.21.15.7:0/1990253870 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6394011d70 con 0x7f63a814f240 2024-09-13T15:04:18.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7f63a7400640 1 --2- 172.21.15.7:0/1990253870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a814f240 0x7f63a81470d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f63a000be50 tx=0x7f63a000bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1fc600640 1 Processor -- start 2024-09-13T15:04:18.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1fc600640 1 -- start start 2024-09-13T15:04:18.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1fc600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1dc003980 0x7fb1f4159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1fc600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f40c2910 0x7fb1f415a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1fc600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1f4158800 0x7fb1f4158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1fc600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f40c1120 con 0x7fb1f4158800 2024-09-13T15:04:18.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1fc600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f41591c0 con 0x7fb1f40c2910 2024-09-13T15:04:18.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1fc600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1f40c0af0 con 0x7fb1dc003980 2024-09-13T15:04:18.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1f9200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f40c2910 0x7fb1f415a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1f9c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1dc003980 0x7fb1f4159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1fa600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1f4158800 0x7fb1f4158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1f9c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1dc003980 0x7fb1f4159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:41826/0 (socket says 172.21.15.7:41826) 2024-09-13T15:04:18.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1f9c00640 1 -- 172.21.15.7:0/2658522634 learned_addr learned my addr 172.21.15.7:0/2658522634 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:18.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7f9c25600640 1 -- 172.21.15.7:0/312629703 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9c20051310 con 0x7f9c28154850 2024-09-13T15:04:18.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1f9c00640 1 -- 172.21.15.7:0/2658522634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f40c2910 msgr2=0x7fb1f415a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1f9c00640 1 --2- 172.21.15.7:0/2658522634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f40c2910 0x7fb1f415a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1f9c00640 1 -- 172.21.15.7:0/2658522634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1f4158800 msgr2=0x7fb1f4158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1f9c00640 1 --2- 172.21.15.7:0/2658522634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1f4158800 0x7fb1f4158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.205+0000 7fb1f9c00640 1 -- 172.21.15.7:0/2658522634 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f41f39d0 con 0x7fb1dc003980 2024-09-13T15:04:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.209+0000 7fb1fa600640 1 --2- 172.21.15.7:0/2658522634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1f4158800 0x7fb1f4158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.209+0000 7fb1f9c00640 1 --2- 172.21.15.7:0/2658522634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1dc003980 0x7fb1f4159db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800ab60 tx=0x7fb1dc005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.217+0000 7f7d3a000640 1 -- 172.21.15.7:0/1473551343 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7d300eeec0 con 0x7f7d3c0e6160 2024-09-13T15:04:18.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.229+0000 7fb1f1600640 1 -- 172.21.15.7:0/2658522634 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e80b5070 con 0x7fb1dc003980 2024-09-13T15:04:18.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.229+0000 7fb1f1600640 1 -- 172.21.15.7:0/2658522634 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e80b0400 con 0x7fb1dc003980 2024-09-13T15:04:18.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.229+0000 7fb1f1600640 1 -- 172.21.15.7:0/2658522634 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e80b0790 con 0x7fb1dc003980 2024-09-13T15:04:18.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.233+0000 7eff0a000640 1 -- 172.21.15.7:0/3120426921 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7eff04053400 con 0x7eff140b15c0 2024-09-13T15:04:18.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.229+0000 7f639ea00640 1 -- 172.21.15.7:0/1990253870 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a000ce90 con 0x7f63a814f240 2024-09-13T15:04:18.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.229+0000 7f639ea00640 1 -- 172.21.15.7:0/1990253870 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a0014440 con 0x7f63a814f240 2024-09-13T15:04:18.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.229+0000 7f639ea00640 1 -- 172.21.15.7:0/1990253870 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00147d0 con 0x7f63a814f240 2024-09-13T15:04:18.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.233+0000 7f63a7e00640 1 -- 172.21.15.7:0/1990253870 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a8144010 con 0x7f63a814f240 2024-09-13T15:04:18.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.233+0000 7f63a7e00640 1 -- 172.21.15.7:0/1990253870 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a80c9260 con 0x7f63a814f240 2024-09-13T15:04:18.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.233+0000 7fb1fc600640 1 -- 172.21.15.7:0/2658522634 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1f40c0af0 con 0x7fb1dc003980 2024-09-13T15:04:18.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.233+0000 7fb1fc600640 1 -- 172.21.15.7:0/2658522634 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1f40c0d40 con 0x7fb1dc003980 2024-09-13T15:04:18.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.233+0000 7f63a7e00640 1 -- 172.21.15.7:0/1990253870 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6380005260 con 0x7f63a814f240 2024-09-13T15:04:18.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.233+0000 7fb1fc600640 1 -- 172.21.15.7:0/2658522634 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1f41f3e80 con 0x7fb1dc003980 2024-09-13T15:04:18.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.237+0000 7f639ea00640 1 -- 172.21.15.7:0/1990253870 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f63a001d3b0 con 0x7f63a814f240 2024-09-13T15:04:18.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.237+0000 7f639ea00640 1 --2- 172.21.15.7:0/1990253870 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6388066760 0x7f6388068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.237+0000 7f639ea00640 1 -- 172.21.15.7:0/1990253870 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f63a0084ac0 con 0x7f63a814f240 2024-09-13T15:04:18.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.237+0000 7fb1f1600640 1 -- 172.21.15.7:0/2658522634 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb1e80b08f0 con 0x7fb1dc003980 2024-09-13T15:04:18.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.237+0000 7fb1f1600640 1 --2- 172.21.15.7:0/2658522634 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb1d4066690 0x7fb1d4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:18.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.237+0000 7fb1f1600640 1 -- 172.21.15.7:0/2658522634 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb1e811e9d0 con 0x7fb1dc003980 2024-09-13T15:04:18.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.237+0000 7f63a6a00640 1 --2- 172.21.15.7:0/1990253870 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6388066760 0x7f6388068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.237+0000 7fb1f9200640 1 --2- 172.21.15.7:0/2658522634 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb1d4066690 0x7fb1d4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:18.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.241+0000 7fb1f9200640 1 --2- 172.21.15.7:0/2658522634 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb1d4066690 0x7fb1d4068b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb1f406fbb0 tx=0x7fb1e0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.241+0000 7f63a6a00640 1 --2- 172.21.15.7:0/1990253870 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6388066760 0x7f6388068c20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6398009b80 tx=0x7f6398009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:18.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.245+0000 7f639ea00640 1 -- 172.21.15.7:0/1990253870 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f63a0051b90 con 0x7f63a814f240 2024-09-13T15:04:18.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.261+0000 7fb1f1600640 1 -- 172.21.15.7:0/2658522634 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb1e80eba20 con 0x7fb1dc003980 2024-09-13T15:04:18.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.413+0000 7f192a000640 1 -- 172.21.15.7:0/3718370962 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f18fc005510 con 0x7f192406cd50 2024-09-13T15:04:18.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.413+0000 7f191b400640 1 -- 172.21.15.7:0/3718370962 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1914054160 con 0x7f192406cd50 2024-09-13T15:04:18.418 INFO:teuthology.orchestra.run.smithi007.stdout:60129542176 2024-09-13T15:04:18.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.417+0000 7f192a000640 1 -- 172.21.15.7:0/3718370962 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1904066760 msgr2=0x7f1904068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.417+0000 7f192a000640 1 --2- 172.21.15.7:0/3718370962 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1904066760 0x7f1904068c20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1924152aa0 tx=0x7f191c0aa000 comp rx=0 tx=0).stop 2024-09-13T15:04:18.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.417+0000 7f192a000640 1 -- 172.21.15.7:0/3718370962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f192406cd50 msgr2=0x7f19241f6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.417+0000 7f192a000640 1 --2- 172.21.15.7:0/3718370962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f192406cd50 0x7f19241f6190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f191400c500 tx=0x7f191400c9c0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.417+0000 7f192a000640 1 -- 172.21.15.7:0/3718370962 shutdown_connections 2024-09-13T15:04:18.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.417+0000 7f192a000640 1 --2- 172.21.15.7:0/3718370962 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1904066760 0x7f1904068c20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.417+0000 7f192a000640 1 --2- 172.21.15.7:0/3718370962 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f192414f250 0x7f19241f5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.417+0000 7f192a000640 1 --2- 172.21.15.7:0/3718370962 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19240c1880 0x7f19241f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.417+0000 7f192a000640 1 --2- 172.21.15.7:0/3718370962 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f192406cd50 0x7f19241f6190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.417+0000 7f192a000640 1 -- 172.21.15.7:0/3718370962 >> 172.21.15.7:0/3718370962 conn(0x7f1924065d40 msgr2=0x7f19240c0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:18.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.417+0000 7f192a000640 1 -- 172.21.15.7:0/3718370962 shutdown_connections 2024-09-13T15:04:18.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.417+0000 7f192a000640 1 -- 172.21.15.7:0/3718370962 wait complete. 2024-09-13T15:04:18.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.441+0000 7f310a000640 1 -- 172.21.15.7:0/3329480494 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3110006820 con 0x7f31100d8e80 2024-09-13T15:04:18.447 INFO:teuthology.orchestra.run.smithi007.stdout:60129542177 2024-09-13T15:04:18.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.445+0000 7f3114c00640 1 -- 172.21.15.7:0/3329480494 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f31180cba90 con 0x7f31100d8e80 2024-09-13T15:04:18.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542176 for osd.3 2024-09-13T15:04:18.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.449+0000 7f310a000640 1 -- 172.21.15.7:0/3329480494 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f30f80666c0 msgr2=0x7f30f8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.449+0000 7f310a000640 1 --2- 172.21.15.7:0/3329480494 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f30f80666c0 0x7f30f8068b80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3104007fd0 tx=0x7f3104009040 comp rx=0 tx=0).stop 2024-09-13T15:04:18.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.449+0000 7f310a000640 1 -- 172.21.15.7:0/3329480494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31100d8e80 msgr2=0x7f3110049050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.449+0000 7f310a000640 1 --2- 172.21.15.7:0/3329480494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31100d8e80 0x7f3110049050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3118073160 tx=0x7f3118067500 comp rx=0 tx=0).stop 2024-09-13T15:04:18.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.449+0000 7f310a000640 1 -- 172.21.15.7:0/3329480494 shutdown_connections 2024-09-13T15:04:18.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.449+0000 7f310a000640 1 --2- 172.21.15.7:0/3329480494 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f30f80666c0 0x7f30f8068b80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.449+0000 7f310a000640 1 --2- 172.21.15.7:0/3329480494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31100e6130 0x7f311004dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.449+0000 7f310a000640 1 --2- 172.21.15.7:0/3329480494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31100d8e80 0x7f3110049050 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.449+0000 7f310a000640 1 --2- 172.21.15.7:0/3329480494 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3110006440 0x7f31101710d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.449+0000 7f310a000640 1 -- 172.21.15.7:0/3329480494 >> 172.21.15.7:0/3329480494 conn(0x7f311004fc30 msgr2=0x7f311004cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:18.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.449+0000 7f310a000640 1 -- 172.21.15.7:0/3329480494 shutdown_connections 2024-09-13T15:04:18.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.449+0000 7f310a000640 1 -- 172.21.15.7:0/3329480494 wait complete. 2024-09-13T15:04:18.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.473+0000 7f5963000640 1 -- 172.21.15.7:0/311875879 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f595c153150 con 0x7f595c155a30 2024-09-13T15:04:18.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.477+0000 7f5959600640 1 -- 172.21.15.7:0/311875879 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f595c153150 con 0x7f595c155a30 2024-09-13T15:04:18.479 INFO:teuthology.orchestra.run.smithi007.stdout:60129542178 2024-09-13T15:04:18.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.477+0000 7f5963000640 1 -- 172.21.15.7:0/311875879 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f593c066690 msgr2=0x7f593c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.477+0000 7f5963000640 1 --2- 172.21.15.7:0/311875879 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f593c066690 0x7f593c068b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5950009870 tx=0x7f59500aa070 comp rx=0 tx=0).stop 2024-09-13T15:04:18.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.477+0000 7f5963000640 1 -- 172.21.15.7:0/311875879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f595c155a30 msgr2=0x7f595c0b7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.477+0000 7f5963000640 1 --2- 172.21.15.7:0/311875879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f595c155a30 0x7f595c0b7f90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f595400c760 tx=0x7f595400cc20 comp rx=0 tx=0).stop 2024-09-13T15:04:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.481+0000 7f5963000640 1 -- 172.21.15.7:0/311875879 shutdown_connections 2024-09-13T15:04:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.481+0000 7f5963000640 1 --2- 172.21.15.7:0/311875879 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f593c066690 0x7f593c068b50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.481+0000 7f5963000640 1 --2- 172.21.15.7:0/311875879 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f595c155a30 0x7f595c0b7f90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.481+0000 7f5963000640 1 --2- 172.21.15.7:0/311875879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f595c14f4c0 0x7f595c153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.481+0000 7f5963000640 1 --2- 172.21.15.7:0/311875879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f595c0c5410 0x7f595c1f2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.481+0000 7f5963000640 1 -- 172.21.15.7:0/311875879 >> 172.21.15.7:0/311875879 conn(0x7f595c06b7d0 msgr2=0x7f595c070890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:18.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.481+0000 7f5963000640 1 -- 172.21.15.7:0/311875879 shutdown_connections 2024-09-13T15:04:18.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.481+0000 7f5963000640 1 -- 172.21.15.7:0/311875879 wait complete. 2024-09-13T15:04:18.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542177 for osd.5 2024-09-13T15:04:18.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.6 2024-09-13T15:04:18.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.513+0000 7f9c30000640 1 -- 172.21.15.7:0/312629703 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9c28155e70 con 0x7f9c28154850 2024-09-13T15:04:18.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.517+0000 7f9c25600640 1 -- 172.21.15.7:0/312629703 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c20019020 con 0x7f9c28154850 2024-09-13T15:04:18.518 INFO:teuthology.orchestra.run.smithi007.stdout:60129542177 2024-09-13T15:04:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.517+0000 7f9c30000640 1 -- 172.21.15.7:0/312629703 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9c08066790 msgr2=0x7f9c08068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.517+0000 7f9c30000640 1 --2- 172.21.15.7:0/312629703 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9c08066790 0x7f9c08068c50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0ae000 tx=0x7f9c1c0046d0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.517+0000 7f9c30000640 1 -- 172.21.15.7:0/312629703 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c28154850 msgr2=0x7f9c2813df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.517+0000 7f9c30000640 1 --2- 172.21.15.7:0/312629703 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c28154850 0x7f9c2813df60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9c280c4da0 tx=0x7f9c2000e530 comp rx=0 tx=0).stop 2024-09-13T15:04:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.517+0000 7f9c30000640 1 -- 172.21.15.7:0/312629703 shutdown_connections 2024-09-13T15:04:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.517+0000 7f9c30000640 1 --2- 172.21.15.7:0/312629703 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9c08066790 0x7f9c08068c50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.517+0000 7f9c30000640 1 --2- 172.21.15.7:0/312629703 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c28154850 0x7f9c2813df60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.517+0000 7f9c30000640 1 --2- 172.21.15.7:0/312629703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c28153b10 0x7f9c28157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.517+0000 7f9c30000640 1 --2- 172.21.15.7:0/312629703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c10003980 0x7f9c281513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.517+0000 7f9c30000640 1 -- 172.21.15.7:0/312629703 >> 172.21.15.7:0/312629703 conn(0x7f9c280c7380 msgr2=0x7f9c281440b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.517+0000 7f9c30000640 1 -- 172.21.15.7:0/312629703 shutdown_connections 2024-09-13T15:04:18.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.517+0000 7f9c30000640 1 -- 172.21.15.7:0/312629703 wait complete. 2024-09-13T15:04:18.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.529+0000 7eff18a00640 1 -- 172.21.15.7:0/3120426921 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7eff14160520 con 0x7eff140b15c0 2024-09-13T15:04:18.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.529+0000 7eff0a000640 1 -- 172.21.15.7:0/3120426921 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff04019020 con 0x7eff140b15c0 2024-09-13T15:04:18.531 INFO:teuthology.orchestra.run.smithi007.stdout:60129542177 2024-09-13T15:04:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.533+0000 7eff18a00640 1 -- 172.21.15.7:0/3120426921 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efef0066760 msgr2=0x7efef0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.533+0000 7eff18a00640 1 --2- 172.21.15.7:0/3120426921 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efef0066760 0x7efef0068c20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7efefc0ae000 tx=0x7efefc008040 comp rx=0 tx=0).stop 2024-09-13T15:04:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.533+0000 7eff18a00640 1 -- 172.21.15.7:0/3120426921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff140b15c0 msgr2=0x7eff14168230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.533+0000 7eff18a00640 1 --2- 172.21.15.7:0/3120426921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff140b15c0 0x7eff14168230 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7eff04009ec0 tx=0x7eff0400c430 comp rx=0 tx=0).stop 2024-09-13T15:04:18.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.537+0000 7eff18a00640 1 -- 172.21.15.7:0/3120426921 shutdown_connections 2024-09-13T15:04:18.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.537+0000 7eff18a00640 1 --2- 172.21.15.7:0/3120426921 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efef0066760 0x7efef0068c20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.537+0000 7eff18a00640 1 --2- 172.21.15.7:0/3120426921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff14165e20 0x7eff1415cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.537+0000 7eff18a00640 1 --2- 172.21.15.7:0/3120426921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7eff14160140 0x7eff141ef700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.537+0000 7eff18a00640 1 --2- 172.21.15.7:0/3120426921 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7eff140b15c0 0x7eff14168230 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.537+0000 7eff18a00640 1 -- 172.21.15.7:0/3120426921 >> 172.21.15.7:0/3120426921 conn(0x7eff1406b940 msgr2=0x7eff140c99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:18.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.537+0000 7eff18a00640 1 -- 172.21.15.7:0/3120426921 shutdown_connections 2024-09-13T15:04:18.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.537+0000 7eff18a00640 1 -- 172.21.15.7:0/3120426921 wait complete. 2024-09-13T15:04:18.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542177 for osd.2 2024-09-13T15:04:18.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.541+0000 7fb1fc600640 1 -- 172.21.15.7:0/2658522634 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb1f4067610 con 0x7fb1dc003980 2024-09-13T15:04:18.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.541+0000 7fb1f1600640 1 -- 172.21.15.7:0/2658522634 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb1e80bf020 con 0x7fb1dc003980 2024-09-13T15:04:18.545 INFO:teuthology.orchestra.run.smithi007.stdout:60129542177 2024-09-13T15:04:18.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.545+0000 7fb1fc600640 1 -- 172.21.15.7:0/2658522634 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb1d4066690 msgr2=0x7fb1d4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.545+0000 7fb1fc600640 1 --2- 172.21.15.7:0/2658522634 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb1d4066690 0x7fb1d4068b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb1f406fbb0 tx=0x7fb1e0009190 comp rx=0 tx=0).stop 2024-09-13T15:04:18.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.545+0000 7fb1fc600640 1 -- 172.21.15.7:0/2658522634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1dc003980 msgr2=0x7fb1f4159db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.545+0000 7fb1fc600640 1 --2- 172.21.15.7:0/2658522634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1dc003980 0x7fb1f4159db0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800ab60 tx=0x7fb1dc005800 comp rx=0 tx=0).stop 2024-09-13T15:04:18.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.545+0000 7fb1fc600640 1 -- 172.21.15.7:0/2658522634 shutdown_connections 2024-09-13T15:04:18.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.545+0000 7fb1fc600640 1 --2- 172.21.15.7:0/2658522634 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb1d4066690 0x7fb1d4068b50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.545+0000 7fb1fc600640 1 --2- 172.21.15.7:0/2658522634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1f4158800 0x7fb1f4158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.545+0000 7fb1fc600640 1 --2- 172.21.15.7:0/2658522634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1f40c2910 0x7fb1f415a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.545+0000 7fb1fc600640 1 --2- 172.21.15.7:0/2658522634 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb1dc003980 0x7fb1f4159db0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.545+0000 7fb1fc600640 1 -- 172.21.15.7:0/2658522634 >> 172.21.15.7:0/2658522634 conn(0x7fb1f40c7380 msgr2=0x7fb1f40c90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:18.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.545+0000 7fb1fc600640 1 -- 172.21.15.7:0/2658522634 shutdown_connections 2024-09-13T15:04:18.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.545+0000 7fb1fc600640 1 -- 172.21.15.7:0/2658522634 wait complete. 2024-09-13T15:04:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.553+0000 7f7d48e00640 1 -- 172.21.15.7:0/1473551343 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7d1c0057e0 con 0x7f7d3c0e6160 2024-09-13T15:04:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.557+0000 7f7d3a000640 1 -- 172.21.15.7:0/1473551343 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d300b5020 con 0x7f7d3c0e6160 2024-09-13T15:04:18.558 INFO:teuthology.orchestra.run.smithi007.stdout:60129542176 2024-09-13T15:04:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.557+0000 7f7d48e00640 1 -- 172.21.15.7:0/1473551343 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d24066690 msgr2=0x7f7d24068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.557+0000 7f7d48e00640 1 --2- 172.21.15.7:0/1473551343 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d24066690 0x7f7d24068b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7d34007fd0 tx=0x7f7d34009040 comp rx=0 tx=0).stop 2024-09-13T15:04:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.557+0000 7f7d48e00640 1 -- 172.21.15.7:0/1473551343 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d3c0e6160 msgr2=0x7f7d3c04c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.557+0000 7f7d48e00640 1 --2- 172.21.15.7:0/1473551343 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d3c0e6160 0x7f7d3c04c9c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7d300b3040 tx=0x7f7d3001bad0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.557+0000 7f7d48e00640 1 -- 172.21.15.7:0/1473551343 shutdown_connections 2024-09-13T15:04:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.557+0000 7f7d48e00640 1 --2- 172.21.15.7:0/1473551343 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d24066690 0x7f7d24068b50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.557+0000 7f7d48e00640 1 --2- 172.21.15.7:0/1473551343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d3c0e4480 0x7f7d3c0cf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.557+0000 7f7d48e00640 1 --2- 172.21.15.7:0/1473551343 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d3c0e6160 0x7f7d3c04c9c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.557+0000 7f7d48e00640 1 --2- 172.21.15.7:0/1473551343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d3c0d8eb0 0x7f7d3c04e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.557+0000 7f7d48e00640 1 -- 172.21.15.7:0/1473551343 >> 172.21.15.7:0/1473551343 conn(0x7f7d3c04fc60 msgr2=0x7f7d3c0348d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.557+0000 7f7d48e00640 1 -- 172.21.15.7:0/1473551343 shutdown_connections 2024-09-13T15:04:18.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.557+0000 7f7d48e00640 1 -- 172.21.15.7:0/1473551343 wait complete. 2024-09-13T15:04:18.562 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542177 for osd.7 2024-09-13T15:04:18.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542177 for osd.0 2024-09-13T15:04:18.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.581+0000 7f63a7e00640 1 -- 172.21.15.7:0/1990253870 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f63800050d0 con 0x7f63a814f240 2024-09-13T15:04:18.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.585+0000 7f639ea00640 1 -- 172.21.15.7:0/1990253870 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f63a0019020 con 0x7f63a814f240 2024-09-13T15:04:18.586 INFO:teuthology.orchestra.run.smithi007.stdout:60129542177 2024-09-13T15:04:18.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542176 for osd.1 2024-09-13T15:04:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.585+0000 7f63a7e00640 1 -- 172.21.15.7:0/1990253870 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6388066760 msgr2=0x7f6388068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.585+0000 7f63a7e00640 1 --2- 172.21.15.7:0/1990253870 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6388066760 0x7f6388068c20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6398009b80 tx=0x7f6398009190 comp rx=0 tx=0).stop 2024-09-13T15:04:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.585+0000 7f63a7e00640 1 -- 172.21.15.7:0/1990253870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a814f240 msgr2=0x7f63a81470d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.585+0000 7f63a7e00640 1 --2- 172.21.15.7:0/1990253870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a814f240 0x7f63a81470d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f63a000be50 tx=0x7f63a000bf40 comp rx=0 tx=0).stop 2024-09-13T15:04:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.585+0000 7f63a7e00640 1 -- 172.21.15.7:0/1990253870 shutdown_connections 2024-09-13T15:04:18.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.585+0000 7f63a7e00640 1 --2- 172.21.15.7:0/1990253870 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6388066760 0x7f6388068c20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.585+0000 7f63a7e00640 1 --2- 172.21.15.7:0/1990253870 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63a814f240 0x7f63a81470d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.585+0000 7f63a7e00640 1 --2- 172.21.15.7:0/1990253870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63a80c7e70 0x7f63a8146b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.585+0000 7f63a7e00640 1 --2- 172.21.15.7:0/1990253870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f63a806f5c0 0x7f63a80ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.585+0000 7f63a7e00640 1 -- 172.21.15.7:0/1990253870 >> 172.21.15.7:0/1990253870 conn(0x7f63a80c7380 msgr2=0x7f63a80c5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:18.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.585+0000 7f63a7e00640 1 -- 172.21.15.7:0/1990253870 shutdown_connections 2024-09-13T15:04:18.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:18.585+0000 7f63a7e00640 1 -- 172.21.15.7:0/1990253870 wait complete. 2024-09-13T15:04:18.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542177 for osd.4 2024-09-13T15:04:19.453 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T15:04:19.484 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T15:04:19.515 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T15:04:19.542 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T15:04:19.563 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T15:04:19.569 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T15:04:19.589 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T15:04:19.608 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T15:04:19.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.617+0000 7f65bb200640 1 Processor -- start 2024-09-13T15:04:19.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.617+0000 7f65bb200640 1 -- start start 2024-09-13T15:04:19.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.617+0000 7f65bb200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f65bc13c8b0 0x7f65bc0c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.617+0000 7f65bb200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65bc0c6840 0x7f65bc156c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.617+0000 7f65bb200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65bc0ca3e0 con 0x7f65bc0c63f0 2024-09-13T15:04:19.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.617+0000 7f65bb200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc0c4f50 con 0x7f65bc13c8b0 2024-09-13T15:04:19.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.617+0000 7f65bb200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc0c70c0 con 0x7f65bc0c6840 2024-09-13T15:04:19.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.621+0000 7f65b9e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f65bc13c8b0 0x7f65bc0c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.621+0000 7f65ba800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65bc0c6840 0x7f65bc156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.621+0000 7f65b9e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f65bc13c8b0 0x7f65bc0c9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:46538/0 (socket says 172.21.15.7:46538) 2024-09-13T15:04:19.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.621+0000 7f65b9e00640 1 -- 172.21.15.7:0/474280747 learned_addr learned my addr 172.21.15.7:0/474280747 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:19.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.621+0000 7f65ba800640 1 -- 172.21.15.7:0/474280747 >> v2:172.21.15.77:3300/0 conn(0x7f65bc13c8b0 msgr2=0x7f65bc0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:19.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.621+0000 7f65ba800640 1 --2- 172.21.15.7:0/474280747 >> v2:172.21.15.77:3300/0 conn(0x7f65bc13c8b0 0x7f65bc0c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.621+0000 7f65ba800640 1 -- 172.21.15.7:0/474280747 >> v1:172.21.15.7:6789/0 conn(0x7f65bc0c63f0 legacy=0x7f65bc06ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.621+0000 7f65ba800640 1 -- 172.21.15.7:0/474280747 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc0c6de0 con 0x7f65bc0c6840 2024-09-13T15:04:19.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.621+0000 7f65b9e00640 1 --2- 172.21.15.7:0/474280747 >> v2:172.21.15.77:3300/0 conn(0x7f65bc13c8b0 0x7f65bc0c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:19.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.629+0000 7f65ba800640 1 --2- 172.21.15.7:0/474280747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65bc0c6840 0x7f65bc156c50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f65b4009dc0 tx=0x7f65b401c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e4a7df63fffa89b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.629+0000 7f65b8a00640 1 -- 172.21.15.7:0/474280747 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b40a58d0 con 0x7f65bc0c6840 2024-09-13T15:04:19.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.629+0000 7f65b8a00640 1 -- 172.21.15.7:0/474280747 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b40a5a30 con 0x7f65bc0c6840 2024-09-13T15:04:19.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.629+0000 7f65b8a00640 1 -- 172.21.15.7:0/474280747 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b40a5dc0 con 0x7f65bc0c6840 2024-09-13T15:04:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.629+0000 7f65bb200640 1 -- 172.21.15.7:0/474280747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65bc0c6840 msgr2=0x7f65bc156c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.629+0000 7f65bb200640 1 --2- 172.21.15.7:0/474280747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65bc0c6840 0x7f65bc156c50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f65b4009dc0 tx=0x7f65b401c870 comp rx=0 tx=0).stop 2024-09-13T15:04:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.629+0000 7f65bb200640 1 -- 172.21.15.7:0/474280747 shutdown_connections 2024-09-13T15:04:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.629+0000 7f65bb200640 1 --2- 172.21.15.7:0/474280747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65bc0c6840 0x7f65bc156c50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.629+0000 7f65bb200640 1 --2- 172.21.15.7:0/474280747 >> v2:172.21.15.77:3300/0 conn(0x7f65bc13c8b0 0x7f65bc0c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.629+0000 7f65bb200640 1 -- 172.21.15.7:0/474280747 >> 172.21.15.7:0/474280747 conn(0x7f65bc0733a0 msgr2=0x7f65bc0737b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:19.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.629+0000 7f65bb200640 1 -- 172.21.15.7:0/474280747 shutdown_connections 2024-09-13T15:04:19.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.633+0000 7f65bb200640 1 -- 172.21.15.7:0/474280747 wait complete. 2024-09-13T15:04:19.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.633+0000 7f65bb200640 1 Processor -- start 2024-09-13T15:04:19.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.633+0000 7f65bb200640 1 -- start start 2024-09-13T15:04:19.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.637+0000 7f65bb200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65bc0c63f0 0x7f65bc139ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.637+0000 7f65bb200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65bc0c6840 0x7f65bc13fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.637+0000 7f65bb200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65bc13c8b0 0x7f65bc13e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.637+0000 7f65bb200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc1263b0 con 0x7f65bc0c63f0 2024-09-13T15:04:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.637+0000 7f65bb200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc1275b0 con 0x7f65bc13c8b0 2024-09-13T15:04:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.637+0000 7f65bb200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc13d2d0 con 0x7f65bc0c6840 2024-09-13T15:04:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.637+0000 7f65b9400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65bc0c6840 0x7f65bc13fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.637+0000 7f65b9400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65bc0c6840 0x7f65bc13fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:53524/0 (socket says 172.21.15.7:53524) 2024-09-13T15:04:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.637+0000 7f65b9400640 1 -- 172.21.15.7:0/197102107 learned_addr learned my addr 172.21.15.7:0/197102107 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.637+0000 7f65ba800640 1 --2- 172.21.15.7:0/197102107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65bc13c8b0 0x7f65bc13e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.637+0000 7f65b9e00640 1 --2- 172.21.15.7:0/197102107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65bc0c63f0 0x7f65bc139ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.637+0000 7f65b9400640 1 -- 172.21.15.7:0/197102107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65bc13c8b0 msgr2=0x7f65bc13e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.637+0000 7f65b9400640 1 --2- 172.21.15.7:0/197102107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65bc13c8b0 0x7f65bc13e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.637+0000 7f65b9400640 1 -- 172.21.15.7:0/197102107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65bc0c63f0 msgr2=0x7f65bc139ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.637+0000 7f65b9400640 1 --2- 172.21.15.7:0/197102107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65bc0c63f0 0x7f65bc139ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.637+0000 7f65b9400640 1 -- 172.21.15.7:0/197102107 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a40094d0 con 0x7f65bc0c6840 2024-09-13T15:04:19.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.641+0000 7f65b9400640 1 --2- 172.21.15.7:0/197102107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65bc0c6840 0x7f65bc13fb90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009e90 tx=0x7f65ac00c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.641+0000 7f65b2000640 1 -- 172.21.15.7:0/197102107 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00cdf0 con 0x7f65bc0c6840 2024-09-13T15:04:19.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.641+0000 7f65b2000640 1 -- 172.21.15.7:0/197102107 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac004020 con 0x7f65bc0c6840 2024-09-13T15:04:19.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.641+0000 7f65b2000640 1 -- 172.21.15.7:0/197102107 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0043d0 con 0x7f65bc0c6840 2024-09-13T15:04:19.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.641+0000 7f65bb200640 1 -- 172.21.15.7:0/197102107 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b4009a70 con 0x7f65bc0c6840 2024-09-13T15:04:19.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.641+0000 7f65bb200640 1 -- 172.21.15.7:0/197102107 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc13d590 con 0x7f65bc0c6840 2024-09-13T15:04:19.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.641+0000 7f65bb200640 1 -- 172.21.15.7:0/197102107 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65bc13cc90 con 0x7f65bc0c6840 2024-09-13T15:04:19.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.645+0000 7f65b2000640 1 -- 172.21.15.7:0/197102107 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f65ac003600 con 0x7f65bc0c6840 2024-09-13T15:04:19.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.645+0000 7f65b2000640 1 --2- 172.21.15.7:0/197102107 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6598066690 0x7f6598068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.645+0000 7f65b2000640 1 -- 172.21.15.7:0/197102107 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f65ac086da0 con 0x7f65bc0c6840 2024-09-13T15:04:19.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.649+0000 7f65b9e00640 1 --2- 172.21.15.7:0/197102107 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6598066690 0x7f6598068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.649+0000 7f65b9e00640 1 --2- 172.21.15.7:0/197102107 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6598066690 0x7f6598068b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f65a4009bd0 tx=0x7f65a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.661+0000 7f65b2000640 1 -- 172.21.15.7:0/197102107 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f65ac053c20 con 0x7f65bc0c6840 2024-09-13T15:04:19.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.685+0000 7fcad0c00640 1 Processor -- start 2024-09-13T15:04:19.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.685+0000 7fcad0c00640 1 -- start start 2024-09-13T15:04:19.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.689+0000 7fcad0c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcacc14f250 0x7fcacc0c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.689+0000 7fcad0c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcacc0c1880 0x7fcacc0c7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.689+0000 7fcad0c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcacc14f630 con 0x7fcacc06cd50 2024-09-13T15:04:19.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.689+0000 7fcaca800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcacc0c1880 0x7fcacc0c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.689+0000 7fcaca800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcacc0c1880 0x7fcacc0c7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:53532/0 (socket says 172.21.15.7:53532) 2024-09-13T15:04:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.689+0000 7fcaca800640 1 -- 172.21.15.7:0/2946206825 learned_addr learned my addr 172.21.15.7:0/2946206825 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.689+0000 7fcad0c00640 1 -- 172.21.15.7:0/2946206825 --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcacc0c70c0 con 0x7fcacc14f250 2024-09-13T15:04:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.689+0000 7fcad0c00640 1 -- 172.21.15.7:0/2946206825 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc0c5fb0 con 0x7fcacc0c1880 2024-09-13T15:04:19.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.689+0000 7fcaca800640 1 -- 172.21.15.7:0/2946206825 >> v2:172.21.15.7:3300/0 conn(0x7fcacc14f250 msgr2=0x7fcacc0c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:19.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.689+0000 7fcaca800640 1 --2- 172.21.15.7:0/2946206825 >> v2:172.21.15.7:3300/0 conn(0x7fcacc14f250 0x7fcacc0c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.689+0000 7fcaca800640 1 -- 172.21.15.7:0/2946206825 >> v1:172.21.15.77:6789/0 conn(0x7fcacc06cd50 legacy=0x7fcacc1558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:19.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.689+0000 7fcaca800640 1 -- 172.21.15.7:0/2946206825 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc0c6820 con 0x7fcacc0c1880 2024-09-13T15:04:19.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.697+0000 7fcaca800640 1 --2- 172.21.15.7:0/2946206825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcacc0c1880 0x7fcacc0c7320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009bd0 tx=0x7fcac4020700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59fa97b7be146615 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.697+0000 7fcac8a00640 1 -- 172.21.15.7:0/2946206825 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac40ae3f0 con 0x7fcacc0c1880 2024-09-13T15:04:19.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.697+0000 7fcac8a00640 1 -- 172.21.15.7:0/2946206825 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac40ae550 con 0x7fcacc0c1880 2024-09-13T15:04:19.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.697+0000 7fcac8a00640 1 -- 172.21.15.7:0/2946206825 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac40ae8e0 con 0x7fcacc0c1880 2024-09-13T15:04:19.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.697+0000 7fcad0c00640 1 -- 172.21.15.7:0/2946206825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcacc0c1880 msgr2=0x7fcacc0c7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.697+0000 7fcad0c00640 1 --2- 172.21.15.7:0/2946206825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcacc0c1880 0x7fcacc0c7320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcac4009bd0 tx=0x7fcac4020700 comp rx=0 tx=0).stop 2024-09-13T15:04:19.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.701+0000 7fcad0c00640 1 -- 172.21.15.7:0/2946206825 shutdown_connections 2024-09-13T15:04:19.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.701+0000 7fcad0c00640 1 --2- 172.21.15.7:0/2946206825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcacc0c1880 0x7fcacc0c7320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.701+0000 7fcad0c00640 1 --2- 172.21.15.7:0/2946206825 >> v2:172.21.15.7:3300/0 conn(0x7fcacc14f250 0x7fcacc0c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.701+0000 7fcad0c00640 1 -- 172.21.15.7:0/2946206825 >> 172.21.15.7:0/2946206825 conn(0x7fcacc065d40 msgr2=0x7fcacc066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:19.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.701+0000 7fcad0c00640 1 -- 172.21.15.7:0/2946206825 shutdown_connections 2024-09-13T15:04:19.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.701+0000 7fcad0c00640 1 -- 172.21.15.7:0/2946206825 wait complete. 2024-09-13T15:04:19.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.701+0000 7fcad0c00640 1 Processor -- start 2024-09-13T15:04:19.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.701+0000 7fcad0c00640 1 -- start start 2024-09-13T15:04:19.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.705+0000 7fcad0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcacc06cd50 0x7fcacc1ee120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.705+0000 7fcad0c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcacc0c1880 0x7fcacc1ea950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.705+0000 7fcad0c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcacc14f250 0x7fcacc1eae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.705+0000 7fcad0c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc0ca5c0 con 0x7fcacc06cd50 2024-09-13T15:04:19.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.705+0000 7fcac9400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcacc0c1880 0x7fcacc1ea950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.705+0000 7fcad0c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc143ea0 con 0x7fcacc14f250 2024-09-13T15:04:19.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.705+0000 7fcad0c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc141ef0 con 0x7fcacc0c1880 2024-09-13T15:04:19.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.705+0000 7fcaca800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcacc14f250 0x7fcacc1eae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.705+0000 7fcaca800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcacc14f250 0x7fcacc1eae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:46552/0 (socket says 172.21.15.7:46552) 2024-09-13T15:04:19.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.705+0000 7fcaca800640 1 -- 172.21.15.7:0/1444088097 learned_addr learned my addr 172.21.15.7:0/1444088097 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:19.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.705+0000 7fcaca800640 1 -- 172.21.15.7:0/1444088097 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcacc0c1880 msgr2=0x7fcacc1ea950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.705+0000 7fcac9e00640 1 --2- 172.21.15.7:0/1444088097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcacc06cd50 0x7fcacc1ee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.705+0000 7fcaca800640 1 --2- 172.21.15.7:0/1444088097 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcacc0c1880 0x7fcacc1ea950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.705+0000 7fcaca800640 1 -- 172.21.15.7:0/1444088097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcacc06cd50 msgr2=0x7fcacc1ee120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.705+0000 7fcaca800640 1 --2- 172.21.15.7:0/1444088097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcacc06cd50 0x7fcacc1ee120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.705+0000 7fcaca800640 1 -- 172.21.15.7:0/1444088097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac4009830 con 0x7fcacc14f250 2024-09-13T15:04:19.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.705+0000 7fcac9e00640 1 --2- 172.21.15.7:0/1444088097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcacc06cd50 0x7fcacc1ee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:04:19.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.709+0000 7fcaca800640 1 --2- 172.21.15.7:0/1444088097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcacc14f250 0x7fcacc1eae90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcac401edb0 tx=0x7fcac401d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.709+0000 7fcac2000640 1 -- 172.21.15.7:0/1444088097 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac40b73f0 con 0x7fcacc14f250 2024-09-13T15:04:19.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.709+0000 7fcac9400640 1 --2- 172.21.15.7:0/1444088097 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcacc0c1880 0x7fcacc1ea950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:04:19.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.709+0000 7fcac2000640 1 -- 172.21.15.7:0/1444088097 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac40b7550 con 0x7fcacc14f250 2024-09-13T15:04:19.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.709+0000 7fcac2000640 1 -- 172.21.15.7:0/1444088097 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac40b78e0 con 0x7fcacc14f250 2024-09-13T15:04:19.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.709+0000 7fcad0c00640 1 -- 172.21.15.7:0/1444088097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcacc1eed60 con 0x7fcacc14f250 2024-09-13T15:04:19.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.709+0000 7fcad0c00640 1 -- 172.21.15.7:0/1444088097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcacc1eea80 con 0x7fcacc14f250 2024-09-13T15:04:19.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.713+0000 7fcad0c00640 1 -- 172.21.15.7:0/1444088097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcacc06c910 con 0x7fcacc14f250 2024-09-13T15:04:19.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.713+0000 7fcac2000640 1 -- 172.21.15.7:0/1444088097 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcac40b7a40 con 0x7fcacc14f250 2024-09-13T15:04:19.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.713+0000 7fcac2000640 1 --2- 172.21.15.7:0/1444088097 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcaac066690 0x7fcaac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.713+0000 7fcac2000640 1 -- 172.21.15.7:0/1444088097 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcac40f4160 con 0x7fcacc14f250 2024-09-13T15:04:19.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.713+0000 7fcac9e00640 1 --2- 172.21.15.7:0/1444088097 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcaac066690 0x7fcaac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.717+0000 7fcac9e00640 1 --2- 172.21.15.7:0/1444088097 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcaac066690 0x7fcaac068b50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcab800a8b0 tx=0x7fcab8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.729+0000 7fcac2000640 1 -- 172.21.15.7:0/1444088097 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcac40f0530 con 0x7fcacc14f250 2024-09-13T15:04:19.739 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-09-13T15:04:19.733+0000 7ff9aa000640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-13T15:04:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.745+0000 7f2f0c400640 1 Processor -- start 2024-09-13T15:04:19.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.749+0000 7f2f0c400640 1 -- start start 2024-09-13T15:04:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.749+0000 7f2f0c400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2f04151590 0x7f2f04157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.749+0000 7f2f0c400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f040c6130 0x7f2f040717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.749+0000 7f2f09000640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2f040c7ea0 0x7f2f0415a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:52128/0 (socket says 172.21.15.7:52128) 2024-09-13T15:04:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.749+0000 7f2f09000640 1 -- 172.21.15.7:0/1758180892 learned_addr learned my addr 172.21.15.7:0/1758180892 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.749+0000 7f2f0a400640 1 --2- 172.21.15.7:0/1758180892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f040c6130 0x7f2f040717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.749+0000 7f2f0c400640 1 -- 172.21.15.7:0/1758180892 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f04151970 con 0x7f2f040c7ea0 2024-09-13T15:04:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.749+0000 7f2f0c400640 1 -- 172.21.15.7:0/1758180892 --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0415b030 con 0x7f2f04151590 2024-09-13T15:04:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.749+0000 7f2f0c400640 1 -- 172.21.15.7:0/1758180892 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0415b310 con 0x7f2f040c6130 2024-09-13T15:04:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.753+0000 7f2f03e00640 1 -- 172.21.15.7:0/1758180892 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476333960 0 0) 0x7f2f04151970 con 0x7f2f040c7ea0 2024-09-13T15:04:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.753+0000 7f2f03e00640 1 -- 172.21.15.7:0/1758180892 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eec003530 con 0x7f2f040c7ea0 2024-09-13T15:04:19.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.753+0000 7f2f0a400640 1 -- 172.21.15.7:0/1758180892 >> v2:172.21.15.7:3300/0 conn(0x7f2f04151590 msgr2=0x7f2f04157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.753+0000 7f2f0a400640 1 --2- 172.21.15.7:0/1758180892 >> v2:172.21.15.7:3300/0 conn(0x7f2f04151590 0x7f2f04157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.753+0000 7f2f0a400640 1 -- 172.21.15.7:0/1758180892 >> v1:172.21.15.77:6789/0 conn(0x7f2f040c7ea0 legacy=0x7f2f0415a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.753+0000 7f2f0a400640 1 -- 172.21.15.7:0/1758180892 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f04157340 con 0x7f2f040c6130 2024-09-13T15:04:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.757+0000 7f2f0a400640 1 --2- 172.21.15.7:0/1758180892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f040c6130 0x7f2f040717a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009d90 tx=0x7f2efc01c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab12399d46c2bb0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.757+0000 7f2f03e00640 1 -- 172.21.15.7:0/1758180892 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0a5910 con 0x7f2f040c6130 2024-09-13T15:04:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.757+0000 7f2f03e00640 1 -- 172.21.15.7:0/1758180892 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc0a5a70 con 0x7f2f040c6130 2024-09-13T15:04:19.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.757+0000 7f2f03e00640 1 -- 172.21.15.7:0/1758180892 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0a5e00 con 0x7f2f040c6130 2024-09-13T15:04:19.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.757+0000 7ffac0600640 1 Processor -- start 2024-09-13T15:04:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.757+0000 7f2f0c400640 1 -- 172.21.15.7:0/1758180892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f040c6130 msgr2=0x7f2f040717a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.757+0000 7f2f0c400640 1 --2- 172.21.15.7:0/1758180892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f040c6130 0x7f2f040717a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009d90 tx=0x7f2efc01c960 comp rx=0 tx=0).stop 2024-09-13T15:04:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.757+0000 7f2f0c400640 1 -- 172.21.15.7:0/1758180892 shutdown_connections 2024-09-13T15:04:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.757+0000 7f2f0c400640 1 --2- 172.21.15.7:0/1758180892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f040c6130 0x7f2f040717a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.757+0000 7f2f0c400640 1 --2- 172.21.15.7:0/1758180892 >> v2:172.21.15.7:3300/0 conn(0x7f2f04151590 0x7f2f04157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.757+0000 7f2f0c400640 1 -- 172.21.15.7:0/1758180892 >> 172.21.15.7:0/1758180892 conn(0x7f2f040c7380 msgr2=0x7f2f040c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.757+0000 7ffac0600640 1 -- start start 2024-09-13T15:04:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.757+0000 7f2f0c400640 1 -- 172.21.15.7:0/1758180892 shutdown_connections 2024-09-13T15:04:19.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.757+0000 7f2f0c400640 1 -- 172.21.15.7:0/1758180892 wait complete. 2024-09-13T15:04:19.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.761+0000 7f2f0c400640 1 Processor -- start 2024-09-13T15:04:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.761+0000 7ffac0600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffab815d210 0x7ffab80c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.761+0000 7ffac0600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffab80c5ec0 0x7ffab806d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.761+0000 7ffac0600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab815d6a0 con 0x7ffab8157460 2024-09-13T15:04:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.761+0000 7ffac0600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab806cef0 con 0x7ffab815d210 2024-09-13T15:04:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.761+0000 7ffac0600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab80723c0 con 0x7ffab80c5ec0 2024-09-13T15:04:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.761+0000 7ffabdc00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ffab8157460 0x7ffab80c7420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:52144/0 (socket says 172.21.15.7:52144) 2024-09-13T15:04:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.761+0000 7ffabd200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffab815d210 0x7ffab80c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.761+0000 7ffabd200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffab815d210 0x7ffab80c56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41330/0 (socket says 172.21.15.7:41330) 2024-09-13T15:04:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.761+0000 7ffabd200640 1 -- 172.21.15.7:0/3356046797 learned_addr learned my addr 172.21.15.7:0/3356046797 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:19.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.761+0000 7ffabe600640 1 --2- 172.21.15.7:0/3356046797 >> v2:172.21.15.77:3300/0 conn(0x7ffab80c5ec0 0x7ffab806d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.765+0000 7f2f0c400640 1 -- start start 2024-09-13T15:04:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.765+0000 7ffabd200640 1 -- 172.21.15.7:0/3356046797 >> v2:172.21.15.77:3300/0 conn(0x7ffab80c5ec0 msgr2=0x7ffab806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:19.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.765+0000 7ffabd200640 1 --2- 172.21.15.7:0/3356046797 >> v2:172.21.15.77:3300/0 conn(0x7ffab80c5ec0 0x7ffab806d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.765+0000 7ffabd200640 1 -- 172.21.15.7:0/3356046797 >> v1:172.21.15.77:6789/0 conn(0x7ffab8157460 legacy=0x7ffab80c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.765+0000 7ffabd200640 1 -- 172.21.15.7:0/3356046797 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab815d940 con 0x7ffab815d210 2024-09-13T15:04:19.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.765+0000 7ffabe600640 1 --2- 172.21.15.7:0/3356046797 >> v2:172.21.15.77:3300/0 conn(0x7ffab80c5ec0 0x7ffab806d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.765+0000 7f2f0c400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f040c6130 0x7f2f0415c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.765+0000 7f2f0c400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f040c7ea0 0x7f2f040c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.765+0000 7f2f0c400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f04151590 0x7f2f041ff320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.765+0000 7f2f09a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f040c6130 0x7f2f0415c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.765+0000 7f2f09000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f040c7ea0 0x7f2f040c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.765+0000 7f2f09a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f040c6130 0x7f2f0415c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:53546/0 (socket says 172.21.15.7:53546) 2024-09-13T15:04:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.765+0000 7f2f09a00640 1 -- 172.21.15.7:0/2287397310 learned_addr learned my addr 172.21.15.7:0/2287397310 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.765+0000 7f2f0c400640 1 -- 172.21.15.7:0/2287397310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f041fef00 con 0x7f2f040c7ea0 2024-09-13T15:04:19.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.765+0000 7f2f0c400640 1 -- 172.21.15.7:0/2287397310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0415c6c0 con 0x7f2f04151590 2024-09-13T15:04:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.765+0000 7f2f0c400640 1 -- 172.21.15.7:0/2287397310 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f040c2370 con 0x7f2f040c6130 2024-09-13T15:04:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.765+0000 7f2f0a400640 1 --2- 172.21.15.7:0/2287397310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f04151590 0x7f2f041ff320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.769+0000 7f2f09a00640 1 -- 172.21.15.7:0/2287397310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f04151590 msgr2=0x7f2f041ff320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.769+0000 7f2f09a00640 1 --2- 172.21.15.7:0/2287397310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f04151590 0x7f2f041ff320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.769+0000 7f2f09a00640 1 -- 172.21.15.7:0/2287397310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f040c7ea0 msgr2=0x7f2f040c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.769+0000 7f2f09a00640 1 --2- 172.21.15.7:0/2287397310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f040c7ea0 0x7f2f040c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.769+0000 7f2f09a00640 1 -- 172.21.15.7:0/2287397310 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc009a70 con 0x7f2f040c6130 2024-09-13T15:04:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.769+0000 7f2f09a00640 1 --2- 172.21.15.7:0/2287397310 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f040c6130 0x7f2f0415c180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800b580 tx=0x7f2ef800ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.769+0000 7f2f01600640 1 -- 172.21.15.7:0/2287397310 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8010870 con 0x7f2f040c6130 2024-09-13T15:04:19.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.769+0000 7f2f01600640 1 -- 172.21.15.7:0/2287397310 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef80109f0 con 0x7f2f040c6130 2024-09-13T15:04:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.769+0000 7f2f01600640 1 -- 172.21.15.7:0/2287397310 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8010da0 con 0x7f2f040c6130 2024-09-13T15:04:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.769+0000 7f2f0c400640 1 -- 172.21.15.7:0/2287397310 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f042030e0 con 0x7f2f040c6130 2024-09-13T15:04:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.769+0000 7f2f0c400640 1 -- 172.21.15.7:0/2287397310 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f04202840 con 0x7f2f040c6130 2024-09-13T15:04:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.769+0000 7ffabd200640 1 --2- 172.21.15.7:0/3356046797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffab815d210 0x7ffab80c56b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffab8074230 tx=0x7ffaac01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490ae4c23036b799 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.769+0000 7ffab7e00640 1 -- 172.21.15.7:0/3356046797 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0ac640 con 0x7ffab815d210 2024-09-13T15:04:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.769+0000 7f2f0c400640 1 -- 172.21.15.7:0/2287397310 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f040c2c60 con 0x7f2f040c6130 2024-09-13T15:04:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.769+0000 7ffab7e00640 1 -- 172.21.15.7:0/3356046797 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac0ac7a0 con 0x7ffab815d210 2024-09-13T15:04:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.769+0000 7ffab7e00640 1 -- 172.21.15.7:0/3356046797 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0acb30 con 0x7ffab815d210 2024-09-13T15:04:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.773+0000 7ffac0600640 1 -- 172.21.15.7:0/3356046797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffab815d210 msgr2=0x7ffab80c56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.773+0000 7ffac0600640 1 --2- 172.21.15.7:0/3356046797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffab815d210 0x7ffab80c56b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffab8074230 tx=0x7ffaac01c440 comp rx=0 tx=0).stop 2024-09-13T15:04:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.773+0000 7ffac0600640 1 -- 172.21.15.7:0/3356046797 shutdown_connections 2024-09-13T15:04:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.773+0000 7ffac0600640 1 --2- 172.21.15.7:0/3356046797 >> v2:172.21.15.77:3300/0 conn(0x7ffab80c5ec0 0x7ffab806d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.773+0000 7ffac0600640 1 --2- 172.21.15.7:0/3356046797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffab815d210 0x7ffab80c56b0 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ffab8074230 tx=0x7ffaac01c440 comp rx=0 tx=0).stop 2024-09-13T15:04:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.773+0000 7ffac0600640 1 -- 172.21.15.7:0/3356046797 >> 172.21.15.7:0/3356046797 conn(0x7ffab8065d40 msgr2=0x7ffab8066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:19.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.773+0000 7f2f01600640 1 -- 172.21.15.7:0/2287397310 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2ef8019450 con 0x7f2f040c6130 2024-09-13T15:04:19.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.773+0000 7f2f01600640 1 --2- 172.21.15.7:0/2287397310 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2ee4066690 0x7f2ee4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.773+0000 7f2f01600640 1 -- 172.21.15.7:0/2287397310 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2ef8084760 con 0x7f2f040c6130 2024-09-13T15:04:19.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.773+0000 7ffac0600640 1 -- 172.21.15.7:0/3356046797 shutdown_connections 2024-09-13T15:04:19.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.773+0000 7ffac0600640 1 -- 172.21.15.7:0/3356046797 wait complete. 2024-09-13T15:04:19.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.773+0000 7ffac0600640 1 Processor -- start 2024-09-13T15:04:19.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.773+0000 7f2f09000640 1 --2- 172.21.15.7:0/2287397310 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2ee4066690 0x7f2ee4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7ffac0600640 1 -- start start 2024-09-13T15:04:19.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7f2f09000640 1 --2- 172.21.15.7:0/2287397310 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2ee4066690 0x7f2ee4068b50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2f04155960 tx=0x7f2ef0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7ffac0600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab80c5ec0 0x7ffab8154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7ffac0600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffab8157460 0x7ffab81f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7ffac0600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffab815a890 0x7ffab81f4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7ffabdc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab80c5ec0 0x7ffab8154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7ffac0600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab81537f0 con 0x7ffab8157460 2024-09-13T15:04:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7ffac0600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8154650 con 0x7ffab80c5ec0 2024-09-13T15:04:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7ffabdc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab80c5ec0 0x7ffab8154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:46576/0 (socket says 172.21.15.7:46576) 2024-09-13T15:04:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7ffabdc00640 1 -- 172.21.15.7:0/2800214950 learned_addr learned my addr 172.21.15.7:0/2800214950 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7ffac0600640 1 -- 172.21.15.7:0/2800214950 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab81f70b0 con 0x7ffab815a890 2024-09-13T15:04:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7ffabd200640 1 --2- 172.21.15.7:0/2800214950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffab8157460 0x7ffab81f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7ffabe600640 1 --2- 172.21.15.7:0/2800214950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffab815a890 0x7ffab81f4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7ffabd200640 1 -- 172.21.15.7:0/2800214950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffab815a890 msgr2=0x7ffab81f4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7ffabd200640 1 --2- 172.21.15.7:0/2800214950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffab815a890 0x7ffab81f4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7ffabd200640 1 -- 172.21.15.7:0/2800214950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab80c5ec0 msgr2=0x7ffab8154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7ffabd200640 1 --2- 172.21.15.7:0/2800214950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab80c5ec0 0x7ffab8154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.777+0000 7ffabd200640 1 -- 172.21.15.7:0/2800214950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab0009a70 con 0x7ffab8157460 2024-09-13T15:04:19.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.781+0000 7ffabd200640 1 --2- 172.21.15.7:0/2800214950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffab8157460 0x7ffab81f6380 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffab8066920 tx=0x7ffaac01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.781+0000 7ffab5600640 1 -- 172.21.15.7:0/2800214950 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac004230 con 0x7ffab8157460 2024-09-13T15:04:19.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.781+0000 7ffac0600640 1 -- 172.21.15.7:0/2800214950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac0094d0 con 0x7ffab8157460 2024-09-13T15:04:19.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.781+0000 7ffac0600640 1 -- 172.21.15.7:0/2800214950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab8152d10 con 0x7ffab8157460 2024-09-13T15:04:19.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.781+0000 7ffac0600640 1 -- 172.21.15.7:0/2800214950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab8157840 con 0x7ffab8157460 2024-09-13T15:04:19.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.781+0000 7ffab5600640 1 -- 172.21.15.7:0/2800214950 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac004390 con 0x7ffab8157460 2024-09-13T15:04:19.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.785+0000 7ffab5600640 1 -- 172.21.15.7:0/2800214950 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0ab8f0 con 0x7ffab8157460 2024-09-13T15:04:19.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.785+0000 7ffab5600640 1 -- 172.21.15.7:0/2800214950 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffaac0b3070 con 0x7ffab8157460 2024-09-13T15:04:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.785+0000 7ffab5600640 1 --2- 172.21.15.7:0/2800214950 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa98066690 0x7ffa98068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.785+0000 7ffab5600640 1 -- 172.21.15.7:0/2800214950 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffaac11e6c0 con 0x7ffab8157460 2024-09-13T15:04:19.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.789+0000 7ffabdc00640 1 --2- 172.21.15.7:0/2800214950 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa98066690 0x7ffa98068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.785+0000 7f2f01600640 1 -- 172.21.15.7:0/2287397310 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2ef8051720 con 0x7f2f040c6130 2024-09-13T15:04:19.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.789+0000 7ffabdc00640 1 --2- 172.21.15.7:0/2800214950 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa98066690 0x7ffa98068b50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4000c10 tx=0x7ffaa4009b90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.793+0000 7ffab5600640 1 -- 172.21.15.7:0/2800214950 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffaac0eb860 con 0x7ffab8157460 2024-09-13T15:04:19.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.841+0000 7f33c0a00640 1 Processor -- start 2024-09-13T15:04:19.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.841+0000 7f33c0a00640 1 -- start start 2024-09-13T15:04:19.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.845+0000 7f33c0a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33bc14f0f0 0x7f33bc06f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.845+0000 7f33c0a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f33bc154ed0 0x7f33bc0c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.845+0000 7f33c0a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33bc155410 con 0x7f33bc06f7a0 2024-09-13T15:04:19.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.845+0000 7f33c0a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33bc155f30 con 0x7f33bc154ed0 2024-09-13T15:04:19.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.845+0000 7f33c0a00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33bc0c6370 con 0x7f33bc14f0f0 2024-09-13T15:04:19.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.845+0000 7f9abec00640 1 Processor -- start 2024-09-13T15:04:19.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.845+0000 7f9abec00640 1 -- start start 2024-09-13T15:04:19.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.845+0000 7fddbe200640 1 Processor -- start 2024-09-13T15:04:19.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.845+0000 7fddbe200640 1 -- start start 2024-09-13T15:04:19.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.845+0000 7f33bb400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33bc14f0f0 0x7f33bc06f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.845+0000 7f33bb400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33bc14f0f0 0x7f33bc06f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:46582/0 (socket says 172.21.15.7:46582) 2024-09-13T15:04:19.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.845+0000 7f33bb400640 1 -- 172.21.15.7:0/2827462637 learned_addr learned my addr 172.21.15.7:0/2827462637 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:19.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f33baa00640 1 --2- 172.21.15.7:0/2827462637 >> v2:172.21.15.7:3300/0 conn(0x7f33bc154ed0 0x7f33bc0c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9abec00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9ab814f0f0 0x7f9ab806f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9abec00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ab8154ed0 0x7f9ab80c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9abce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ab8154ed0 0x7f9ab80c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9abce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ab8154ed0 0x7f9ab80c70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:53566/0 (socket says 172.21.15.7:53566) 2024-09-13T15:04:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9abe200640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9ab806f7a0 0x7f9ab806ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:52160/0 (socket says 172.21.15.7:52160) 2024-09-13T15:04:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9abce00640 1 -- 172.21.15.7:0/2998106594 learned_addr learned my addr 172.21.15.7:0/2998106594 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9abec00640 1 -- 172.21.15.7:0/2998106594 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab8155410 con 0x7f9ab806f7a0 2024-09-13T15:04:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9abec00640 1 -- 172.21.15.7:0/2998106594 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ab8155f30 con 0x7f9ab814f0f0 2024-09-13T15:04:19.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9abec00640 1 -- 172.21.15.7:0/2998106594 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80c6370 con 0x7f9ab8154ed0 2024-09-13T15:04:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9ab7e00640 1 -- 172.21.15.7:0/2998106594 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8286212 0 0) 0x7f9ab8155410 con 0x7f9ab806f7a0 2024-09-13T15:04:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9abd800640 1 --2- 172.21.15.7:0/2998106594 >> v2:172.21.15.77:3300/0 conn(0x7f9ab814f0f0 0x7f9ab806f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9ab7e00640 1 -- 172.21.15.7:0/2998106594 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9aa0003530 con 0x7f9ab806f7a0 2024-09-13T15:04:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9ab7e00640 1 -- 172.21.15.7:0/2998106594 <== mon.1 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3371438877 0 0) 0x7f9aa0003530 con 0x7f9ab806f7a0 2024-09-13T15:04:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9ab7e00640 1 -- 172.21.15.7:0/2998106594 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ab8154ed0 msgr2=0x7f9ab80c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9ab7e00640 1 --2- 172.21.15.7:0/2998106594 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ab8154ed0 0x7f9ab80c70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9ab7e00640 1 -- 172.21.15.7:0/2998106594 >> v2:172.21.15.77:3300/0 conn(0x7f9ab814f0f0 msgr2=0x7f9ab806f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9ab7e00640 1 --2- 172.21.15.7:0/2998106594 >> v2:172.21.15.77:3300/0 conn(0x7f9ab814f0f0 0x7f9ab806f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9ab7e00640 1 -- 172.21.15.7:0/2998106594 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab81556b0 con 0x7f9ab806f7a0 2024-09-13T15:04:19.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9ab7e00640 1 -- 172.21.15.7:0/2998106594 <== mon.1 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f9aa4001680 con 0x7f9ab806f7a0 2024-09-13T15:04:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9ab7e00640 1 -- 172.21.15.7:0/2998106594 >> v1:172.21.15.77:6789/0 conn(0x7f9ab806f7a0 legacy=0x7f9ab806ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9ab7e00640 1 --2- 172.21.15.7:0/2998106594 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9aa0003980 0x7f9aa0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9ab7e00640 1 --2- 172.21.15.7:0/2998106594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9aa0004370 0x7f9aa0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9ab7e00640 1 --2- 172.21.15.7:0/2998106594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9aa0004ec0 0x7f9aa000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9ab7e00640 1 -- 172.21.15.7:0/2998106594 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8155f30 con 0x7f9aa0004ec0 2024-09-13T15:04:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9ab7e00640 1 -- 172.21.15.7:0/2998106594 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80c6370 con 0x7f9aa0004370 2024-09-13T15:04:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9ab7e00640 1 -- 172.21.15.7:0/2998106594 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa000bed0 con 0x7f9aa0003980 2024-09-13T15:04:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f9abd800640 1 --2- 172.21.15.7:0/2998106594 >> v2:172.21.15.77:3300/0 conn(0x7f9ab814f0f0 0x7f9ab806f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:19.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7fddbe200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fddb806d9f0 0x7fddb8155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7fddbe200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fddb814f620 0x7fddb806c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7fddbe200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb8070510 con 0x7fddb80c6a60 2024-09-13T15:04:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7fddbe200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb806d330 con 0x7fddb806d9f0 2024-09-13T15:04:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7fddbe200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb80c7890 con 0x7fddb814f620 2024-09-13T15:04:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7fddbd800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fddb814f620 0x7fddb806c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7fddbd800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fddb814f620 0x7fddb806c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:46604/0 (socket says 172.21.15.7:46604) 2024-09-13T15:04:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7fddbd800640 1 -- 172.21.15.7:0/4112818027 learned_addr learned my addr 172.21.15.7:0/4112818027 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7fddbd800640 1 -- 172.21.15.7:0/4112818027 >> v2:172.21.15.7:3300/0 conn(0x7fddb806d9f0 msgr2=0x7fddb8155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7fddbd800640 1 --2- 172.21.15.7:0/4112818027 >> v2:172.21.15.7:3300/0 conn(0x7fddb806d9f0 0x7fddb8155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f33bb400640 1 -- 172.21.15.7:0/2827462637 >> v2:172.21.15.7:3300/0 conn(0x7f33bc154ed0 msgr2=0x7f33bc0c70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:19.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f33bb400640 1 --2- 172.21.15.7:0/2827462637 >> v2:172.21.15.7:3300/0 conn(0x7f33bc154ed0 0x7f33bc0c70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f33bb400640 1 -- 172.21.15.7:0/2827462637 >> v1:172.21.15.7:6789/0 conn(0x7f33bc06f7a0 legacy=0x7f33bc06ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:19.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.849+0000 7f33bb400640 1 -- 172.21.15.7:0/2827462637 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc1556b0 con 0x7f33bc14f0f0 2024-09-13T15:04:19.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.853+0000 7f9abe200640 1 --2- 172.21.15.7:0/2998106594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9aa0004ec0 0x7f9aa000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.853+0000 7f9abe200640 1 -- 172.21.15.7:0/2998106594 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9aa0003980 msgr2=0x7f9aa0003da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:04:19.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.853+0000 7f9abd800640 1 --2- 172.21.15.7:0/2998106594 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9aa0003980 0x7f9aa0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.853+0000 7f33bb400640 1 --2- 172.21.15.7:0/2827462637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33bc14f0f0 0x7f33bc06f200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f33bc06d9d0 tx=0x7f33ac021200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f65dbe09af5bdbbd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.853+0000 7f9abe200640 1 --2- 172.21.15.7:0/2998106594 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9aa0003980 0x7f9aa0003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.853+0000 7f9abe200640 1 -- 172.21.15.7:0/2998106594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9aa0004370 msgr2=0x7f9aa0004850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:04:19.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.853+0000 7f9abe200640 1 --2- 172.21.15.7:0/2998106594 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9aa0004370 0x7f9aa0004850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.853+0000 7f9abe200640 1 -- 172.21.15.7:0/2998106594 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab81556b0 con 0x7f9aa0004ec0 2024-09-13T15:04:19.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.853+0000 7f33ba000640 1 -- 172.21.15.7:0/2827462637 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0b3410 con 0x7f33bc14f0f0 2024-09-13T15:04:19.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.853+0000 7f33ba000640 1 -- 172.21.15.7:0/2827462637 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac0ad030 con 0x7f33bc14f0f0 2024-09-13T15:04:19.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.853+0000 7f33ba000640 1 -- 172.21.15.7:0/2827462637 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0b3790 con 0x7f33bc14f0f0 2024-09-13T15:04:19.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.853+0000 7fddbd800640 1 -- 172.21.15.7:0/4112818027 >> v1:172.21.15.7:6789/0 conn(0x7fddb80c6a60 legacy=0x7fddb80c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:19.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.853+0000 7fddbd800640 1 -- 172.21.15.7:0/4112818027 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb80707f0 con 0x7fddb814f620 2024-09-13T15:04:19.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.857+0000 7f33c0a00640 1 -- 172.21.15.7:0/2827462637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33bc14f0f0 msgr2=0x7f33bc06f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.857+0000 7f33c0a00640 1 --2- 172.21.15.7:0/2827462637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33bc14f0f0 0x7f33bc06f200 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f33bc06d9d0 tx=0x7f33ac021200 comp rx=0 tx=0).stop 2024-09-13T15:04:19.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.857+0000 7f33c0a00640 1 -- 172.21.15.7:0/2827462637 shutdown_connections 2024-09-13T15:04:19.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.857+0000 7f33c0a00640 1 --2- 172.21.15.7:0/2827462637 >> v2:172.21.15.7:3300/0 conn(0x7f33bc154ed0 0x7f33bc0c70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.857+0000 7f33c0a00640 1 --2- 172.21.15.7:0/2827462637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33bc14f0f0 0x7f33bc06f200 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.857+0000 7f33c0a00640 1 -- 172.21.15.7:0/2827462637 >> 172.21.15.7:0/2827462637 conn(0x7f33bc06b7d0 msgr2=0x7f33bc065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:19.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.857+0000 7f33c0a00640 1 -- 172.21.15.7:0/2827462637 shutdown_connections 2024-09-13T15:04:19.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.857+0000 7fddbd800640 1 --2- 172.21.15.7:0/4112818027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb814f620 0x7fddb806c750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fddb8072330 tx=0x7fdda401ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cac1a866352a3ff3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.857+0000 7fddb7400640 1 -- 172.21.15.7:0/4112818027 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda40a89d0 con 0x7fddb814f620 2024-09-13T15:04:19.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.857+0000 7fddb7400640 1 -- 172.21.15.7:0/4112818027 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda40a8b30 con 0x7fddb814f620 2024-09-13T15:04:19.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.857+0000 7fddb7400640 1 -- 172.21.15.7:0/4112818027 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda40b0440 con 0x7fddb814f620 2024-09-13T15:04:19.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.861+0000 7fddbe200640 1 -- 172.21.15.7:0/4112818027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb814f620 msgr2=0x7fddb806c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.861+0000 7fddbe200640 1 --2- 172.21.15.7:0/4112818027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb814f620 0x7fddb806c750 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fddb8072330 tx=0x7fdda401ecd0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.861+0000 7fddbe200640 1 -- 172.21.15.7:0/4112818027 shutdown_connections 2024-09-13T15:04:19.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.861+0000 7fddbe200640 1 --2- 172.21.15.7:0/4112818027 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb814f620 0x7fddb806c750 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.861+0000 7fddbe200640 1 --2- 172.21.15.7:0/4112818027 >> v2:172.21.15.7:3300/0 conn(0x7fddb806d9f0 0x7fddb8155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.861+0000 7fddbe200640 1 -- 172.21.15.7:0/4112818027 >> 172.21.15.7:0/4112818027 conn(0x7fddb806b7d0 msgr2=0x7fddb8065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:19.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.857+0000 7f33c0a00640 1 -- 172.21.15.7:0/2827462637 wait complete. 2024-09-13T15:04:19.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.861+0000 7f33c0a00640 1 Processor -- start 2024-09-13T15:04:19.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.861+0000 7f9abe200640 1 --2- 172.21.15.7:0/2998106594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9aa0004ec0 0x7f9aa000b990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400c190 tx=0x7f9aa4021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f7cac4ce66dc04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.861+0000 7f33c0a00640 1 -- start start 2024-09-13T15:04:19.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f33c0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33bc06f7a0 0x7f33bc1ee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7fddbe200640 1 -- 172.21.15.7:0/4112818027 shutdown_connections 2024-09-13T15:04:19.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7fddbe200640 1 -- 172.21.15.7:0/4112818027 wait complete. 2024-09-13T15:04:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f33c0a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33bc14f0f0 0x7f33bc0c3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f33c0a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33bc154ed0 0x7f33bc14f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f33c0a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc1ee600 con 0x7f33bc06f7a0 2024-09-13T15:04:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f33c0a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc0c1760 con 0x7f33bc154ed0 2024-09-13T15:04:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f33c0a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc0c1480 con 0x7f33bc14f0f0 2024-09-13T15:04:19.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f9ab7e00640 1 -- 172.21.15.7:0/2998106594 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40a9d00 con 0x7f9aa0004ec0 2024-09-13T15:04:19.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f33baa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33bc14f0f0 0x7f33bc0c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f33bb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33bc06f7a0 0x7f33bc1ee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f33baa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33bc14f0f0 0x7f33bc0c3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:53584/0 (socket says 172.21.15.7:53584) 2024-09-13T15:04:19.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f33baa00640 1 -- 172.21.15.7:0/673435056 learned_addr learned my addr 172.21.15.7:0/673435056 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:19.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f33bbe00640 1 --2- 172.21.15.7:0/673435056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33bc154ed0 0x7f33bc14f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f33baa00640 1 -- 172.21.15.7:0/673435056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33bc154ed0 msgr2=0x7f33bc14f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f33baa00640 1 --2- 172.21.15.7:0/673435056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33bc154ed0 0x7f33bc14f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f33baa00640 1 -- 172.21.15.7:0/673435056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33bc06f7a0 msgr2=0x7f33bc1ee0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f33baa00640 1 --2- 172.21.15.7:0/673435056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33bc06f7a0 0x7f33bc1ee0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f33baa00640 1 -- 172.21.15.7:0/673435056 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac008550 con 0x7f33bc14f0f0 2024-09-13T15:04:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f9ab7e00640 1 -- 172.21.15.7:0/2998106594 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa40a9e80 con 0x7f9aa0004ec0 2024-09-13T15:04:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f9ab7e00640 1 -- 172.21.15.7:0/2998106594 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4007310 con 0x7f9aa0004ec0 2024-09-13T15:04:19.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f33baa00640 1 --2- 172.21.15.7:0/673435056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33bc14f0f0 0x7f33bc0c3860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f33b4007e40 tx=0x7f33b400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f9abec00640 1 -- 172.21.15.7:0/2998106594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9aa0004ec0 msgr2=0x7f9aa000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f9abec00640 1 --2- 172.21.15.7:0/2998106594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9aa0004ec0 0x7f9aa000b990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400c190 tx=0x7f9aa4021000 comp rx=0 tx=0).stop 2024-09-13T15:04:19.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7fddbe200640 1 Processor -- start 2024-09-13T15:04:19.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f9abe200640 1 -- 172.21.15.7:0/2998106594 reap_dead start 2024-09-13T15:04:19.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f9abec00640 1 -- 172.21.15.7:0/2998106594 shutdown_connections 2024-09-13T15:04:19.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7f9abec00640 1 -- 172.21.15.7:0/2998106594 >> 172.21.15.7:0/2998106594 conn(0x7f9ab806b7d0 msgr2=0x7f9ab8065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:19.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.865+0000 7fddbe200640 1 -- start start 2024-09-13T15:04:19.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7f9abec00640 1 -- 172.21.15.7:0/2998106594 shutdown_connections 2024-09-13T15:04:19.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7f9abec00640 1 -- 172.21.15.7:0/2998106594 wait complete. 2024-09-13T15:04:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7fddbe200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddb80c6a60 0x7fddb80c88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7fddbe200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddb814f620 0x7fddb8150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7fddbce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddb80c6a60 0x7fddb80c88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7fddbce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddb80c6a60 0x7fddb80c88b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:53586/0 (socket says 172.21.15.7:53586) 2024-09-13T15:04:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7fddb7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddb814f620 0x7fddb8150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7fddb7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddb814f620 0x7fddb8150d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41384/0 (socket says 172.21.15.7:41384) 2024-09-13T15:04:19.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7fddbce00640 1 -- 172.21.15.7:0/330841129 learned_addr learned my addr 172.21.15.7:0/330841129 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:19.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7fddbe200640 1 --2- 172.21.15.7:0/330841129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb81f2230 0x7fddb81f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7f9abec00640 1 Processor -- start 2024-09-13T15:04:19.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7fddbd800640 1 --2- 172.21.15.7:0/330841129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb81f2230 0x7fddb81f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7fddbe200640 1 -- 172.21.15.7:0/330841129 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80c90a0 con 0x7fddb814f620 2024-09-13T15:04:19.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7fddbe200640 1 -- 172.21.15.7:0/330841129 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80c98b0 con 0x7fddb81f2230 2024-09-13T15:04:19.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7fddbe200640 1 -- 172.21.15.7:0/330841129 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80c92f0 con 0x7fddb80c6a60 2024-09-13T15:04:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7f33b3400640 1 -- 172.21.15.7:0/673435056 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b4014620 con 0x7f33bc14f0f0 2024-09-13T15:04:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7f33b3400640 1 -- 172.21.15.7:0/673435056 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b400ee90 con 0x7f33bc14f0f0 2024-09-13T15:04:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7f33b3400640 1 -- 172.21.15.7:0/673435056 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b40149c0 con 0x7f33bc14f0f0 2024-09-13T15:04:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.869+0000 7f33c0a00640 1 -- 172.21.15.7:0/673435056 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33bc1ea1d0 con 0x7f33bc14f0f0 2024-09-13T15:04:19.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7f33c0a00640 1 -- 172.21.15.7:0/673435056 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33bc1ea790 con 0x7f33bc14f0f0 2024-09-13T15:04:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7f9abec00640 1 -- start start 2024-09-13T15:04:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7fddbce00640 1 -- 172.21.15.7:0/330841129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb81f2230 msgr2=0x7fddb81f26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7fddbce00640 1 --2- 172.21.15.7:0/330841129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb81f2230 0x7fddb81f26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7fddbce00640 1 -- 172.21.15.7:0/330841129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddb814f620 msgr2=0x7fddb8150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7fddbce00640 1 --2- 172.21.15.7:0/330841129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddb814f620 0x7fddb8150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7fddbce00640 1 -- 172.21.15.7:0/330841129 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda40094d0 con 0x7fddb80c6a60 2024-09-13T15:04:19.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7f33b3400640 1 -- 172.21.15.7:0/673435056 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f33b4014b20 con 0x7f33bc14f0f0 2024-09-13T15:04:19.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7fddbd800640 1 --2- 172.21.15.7:0/330841129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb81f2230 0x7fddb81f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:19.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7fddbce00640 1 --2- 172.21.15.7:0/330841129 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddb80c6a60 0x7fddb80c88b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fddb000ba80 tx=0x7fddb000bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7fddb7e00640 1 --2- 172.21.15.7:0/330841129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddb814f620 0x7fddb8150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:19.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7f9abec00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab81de560 0x7f9ab81f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7f9abec00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ab80c3d00 0x7f9ab81df350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7f9abd800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab81de560 0x7f9ab81f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7fddb4c00640 1 -- 172.21.15.7:0/330841129 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb000cc00 con 0x7fddb80c6a60 2024-09-13T15:04:19.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7fddb4c00640 1 -- 172.21.15.7:0/330841129 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb000cd60 con 0x7fddb80c6a60 2024-09-13T15:04:19.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7fddb4c00640 1 -- 172.21.15.7:0/330841129 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0014680 con 0x7fddb80c6a60 2024-09-13T15:04:19.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7f33c0a00640 1 -- 172.21.15.7:0/673435056 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33bc152cb0 con 0x7f33bc14f0f0 2024-09-13T15:04:19.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7f9abd800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab81de560 0x7f9ab81f2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:46624/0 (socket says 172.21.15.7:46624) 2024-09-13T15:04:19.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7f9abd800640 1 -- 172.21.15.7:0/3484861592 learned_addr learned my addr 172.21.15.7:0/3484861592 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:19.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7f9abec00640 1 --2- 172.21.15.7:0/3484861592 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ab81de940 0x7f9ab81df890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7f9abec00640 1 -- 172.21.15.7:0/3484861592 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80c38e0 con 0x7f9ab80c3d00 2024-09-13T15:04:19.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7f9abe200640 1 --2- 172.21.15.7:0/3484861592 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ab81de940 0x7f9ab81df890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7f33b3400640 1 --2- 172.21.15.7:0/673435056 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f339c0666c0 0x7f339c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7f9abec00640 1 -- 172.21.15.7:0/3484861592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab80c2250 con 0x7f9ab81de560 2024-09-13T15:04:19.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7f33b3400640 1 -- 172.21.15.7:0/673435056 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f33b4084dd0 con 0x7f33bc14f0f0 2024-09-13T15:04:19.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.873+0000 7fddbe200640 1 -- 172.21.15.7:0/330841129 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb80c95d0 con 0x7fddb80c6a60 2024-09-13T15:04:19.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.877+0000 7fddbe200640 1 -- 172.21.15.7:0/330841129 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb80ca8d0 con 0x7fddb80c6a60 2024-09-13T15:04:19.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.877+0000 7f9abec00640 1 -- 172.21.15.7:0/3484861592 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab81e9fd0 con 0x7f9ab81de940 2024-09-13T15:04:19.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.877+0000 7f33bb400640 1 --2- 172.21.15.7:0/673435056 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f339c0666c0 0x7f339c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.877+0000 7fddbe200640 1 -- 172.21.15.7:0/330841129 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb80c6ff0 con 0x7fddb80c6a60 2024-09-13T15:04:19.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.877+0000 7f9abce00640 1 --2- 172.21.15.7:0/3484861592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ab80c3d00 0x7f9ab81df350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.877+0000 7f9abe200640 1 -- 172.21.15.7:0/3484861592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab81de560 msgr2=0x7f9ab81f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.877+0000 7f9abe200640 1 --2- 172.21.15.7:0/3484861592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab81de560 0x7f9ab81f2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.877+0000 7f9abe200640 1 -- 172.21.15.7:0/3484861592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ab80c3d00 msgr2=0x7f9ab81df350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.877+0000 7f9abe200640 1 --2- 172.21.15.7:0/3484861592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ab80c3d00 0x7f9ab81df350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.877+0000 7f9abe200640 1 -- 172.21.15.7:0/3484861592 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab81e9cf0 con 0x7f9ab81de940 2024-09-13T15:04:19.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.877+0000 7f9abd800640 1 --2- 172.21.15.7:0/3484861592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab81de560 0x7f9ab81f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:19.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.877+0000 7f33bb400640 1 --2- 172.21.15.7:0/673435056 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f339c0666c0 0x7f339c068b80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0b5000 tx=0x7f33ac0ac000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.877+0000 7f7d51200640 1 Processor -- start 2024-09-13T15:04:19.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.877+0000 7f9abe200640 1 --2- 172.21.15.7:0/3484861592 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ab81de940 0x7f9ab81df890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4009000 tx=0x7f9aa0005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.877+0000 7f7d51200640 1 -- start start 2024-09-13T15:04:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.881+0000 7f7d51200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7d4c143080 0x7f7d4c15dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.881+0000 7f7d51200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d4c160920 0x7f7d4c0c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.881+0000 7f7d51200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7d4c0c9f20 0x7f7d4c06a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.881+0000 7f7d51200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c15d330 con 0x7f7d4c0c9f20 2024-09-13T15:04:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.881+0000 7f7d51200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c15e260 con 0x7f7d4c143080 2024-09-13T15:04:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.881+0000 7f7d51200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0c72a0 con 0x7f7d4c160920 2024-09-13T15:04:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.881+0000 7f7d4a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7d4c0c9f20 0x7f7d4c06a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.881+0000 7f7d49400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d4c160920 0x7f7d4c0c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.881+0000 7f7d49e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7d4c143080 0x7f7d4c15dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.881+0000 7f7d4a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7d4c0c9f20 0x7f7d4c06a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41392/0 (socket says 172.21.15.7:41392) 2024-09-13T15:04:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.881+0000 7f7d4a800640 1 -- 172.21.15.7:0/715078421 learned_addr learned my addr 172.21.15.7:0/715078421 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.881+0000 7f7d4a800640 1 -- 172.21.15.7:0/715078421 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d4c160920 msgr2=0x7f7d4c0c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:19.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.881+0000 7f7d4a800640 1 --2- 172.21.15.7:0/715078421 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d4c160920 0x7f7d4c0c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.881+0000 7f7d4a800640 1 -- 172.21.15.7:0/715078421 >> v2:172.21.15.77:3300/0 conn(0x7f7d4c143080 msgr2=0x7f7d4c15dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:19.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.881+0000 7f7d4a800640 1 --2- 172.21.15.7:0/715078421 >> v2:172.21.15.77:3300/0 conn(0x7f7d4c143080 0x7f7d4c15dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.881+0000 7f7d4a800640 1 -- 172.21.15.7:0/715078421 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c0c6a00 con 0x7f7d4c0c9f20 2024-09-13T15:04:19.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.881+0000 7f7d49400640 1 --2- 172.21.15.7:0/715078421 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d4c160920 0x7f7d4c0c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:19.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.885+0000 7f7d4a800640 1 --2- 172.21.15.7:0/715078421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c0c9f20 0x7f7d4c06a4c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c06eef0 tx=0x7f7d4401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36518532eaba54c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.885+0000 7f7d48a00640 1 -- 172.21.15.7:0/715078421 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440af400 con 0x7f7d4c0c9f20 2024-09-13T15:04:19.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.885+0000 7f7d48a00640 1 -- 172.21.15.7:0/715078421 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d440ab050 con 0x7f7d4c0c9f20 2024-09-13T15:04:19.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.885+0000 7f7d48a00640 1 -- 172.21.15.7:0/715078421 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440af780 con 0x7f7d4c0c9f20 2024-09-13T15:04:19.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f7d51200640 1 -- 172.21.15.7:0/715078421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c0c9f20 msgr2=0x7f7d4c06a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f7d51200640 1 --2- 172.21.15.7:0/715078421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c0c9f20 0x7f7d4c06a4c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c06eef0 tx=0x7f7d4401f1e0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f7d51200640 1 -- 172.21.15.7:0/715078421 shutdown_connections 2024-09-13T15:04:19.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f7d51200640 1 --2- 172.21.15.7:0/715078421 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c0c9f20 0x7f7d4c06a4c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f7d51200640 1 --2- 172.21.15.7:0/715078421 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d4c160920 0x7f7d4c0c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f7d51200640 1 --2- 172.21.15.7:0/715078421 >> v2:172.21.15.77:3300/0 conn(0x7f7d4c143080 0x7f7d4c15dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f7d51200640 1 -- 172.21.15.7:0/715078421 >> 172.21.15.7:0/715078421 conn(0x7f7d4c06ce10 msgr2=0x7f7d4c06e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:19.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f7d51200640 1 -- 172.21.15.7:0/715078421 shutdown_connections 2024-09-13T15:04:19.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f7d51200640 1 -- 172.21.15.7:0/715078421 wait complete. 2024-09-13T15:04:19.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f9ab5600640 1 -- 172.21.15.7:0/3484861592 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40b6070 con 0x7f9ab81de940 2024-09-13T15:04:19.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f33b3400640 1 -- 172.21.15.7:0/673435056 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f33b4051d90 con 0x7f33bc14f0f0 2024-09-13T15:04:19.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f9ab5600640 1 -- 172.21.15.7:0/3484861592 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa40a9d00 con 0x7f9ab81de940 2024-09-13T15:04:19.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f9ab5600640 1 -- 172.21.15.7:0/3484861592 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4013230 con 0x7f9ab81de940 2024-09-13T15:04:19.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f9abec00640 1 -- 172.21.15.7:0/3484861592 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab80c3120 con 0x7f9ab81de940 2024-09-13T15:04:19.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f9abec00640 1 -- 172.21.15.7:0/3484861592 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab81e35b0 con 0x7f9ab81de940 2024-09-13T15:04:19.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f9aaaa00640 1 -- 172.21.15.7:0/3484861592 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a94005260 con 0x7f9ab81de940 2024-09-13T15:04:19.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f7d51200640 1 Processor -- start 2024-09-13T15:04:19.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.889+0000 7f7d51200640 1 -- start start 2024-09-13T15:04:19.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.893+0000 7fddb4c00640 1 -- 172.21.15.7:0/330841129 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fddb00147e0 con 0x7fddb80c6a60 2024-09-13T15:04:19.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.893+0000 7f7d51200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d4c0c9f20 0x7f7d4c0712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.893+0000 7f7d51200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c143080 0x7f7d4c1f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.893+0000 7f7d51200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d4c160920 0x7f7d4c1f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.893+0000 7f7d51200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c143b10 con 0x7f7d4c143080 2024-09-13T15:04:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.893+0000 7f7d51200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c145b00 con 0x7f7d4c0c9f20 2024-09-13T15:04:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.893+0000 7f7d51200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c1449a0 con 0x7f7d4c160920 2024-09-13T15:04:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.893+0000 7f7d49e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d4c0c9f20 0x7f7d4c0712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.893+0000 7f7d49e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d4c0c9f20 0x7f7d4c0712d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:46640/0 (socket says 172.21.15.7:46640) 2024-09-13T15:04:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.893+0000 7f7d49e00640 1 -- 172.21.15.7:0/248992375 learned_addr learned my addr 172.21.15.7:0/248992375 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.893+0000 7f7d4a800640 1 --2- 172.21.15.7:0/248992375 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d4c160920 0x7f7d4c1f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.893+0000 7fddb4c00640 1 --2- 172.21.15.7:0/330841129 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdd980666e0 0x7fdd98068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.893+0000 7fddb4c00640 1 -- 172.21.15.7:0/330841129 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fddb0084ba0 con 0x7fddb80c6a60 2024-09-13T15:04:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.893+0000 7f7d49400640 1 --2- 172.21.15.7:0/248992375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c143080 0x7f7d4c1f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.897+0000 7fddb7e00640 1 --2- 172.21.15.7:0/330841129 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdd980666e0 0x7fdd98068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.897+0000 7f7d49e00640 1 -- 172.21.15.7:0/248992375 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d4c160920 msgr2=0x7f7d4c1f6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.897+0000 7f7d49e00640 1 --2- 172.21.15.7:0/248992375 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d4c160920 0x7f7d4c1f6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.897+0000 7f7d49e00640 1 -- 172.21.15.7:0/248992375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c143080 msgr2=0x7f7d4c1f65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.897+0000 7f7d49e00640 1 --2- 172.21.15.7:0/248992375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c143080 0x7f7d4c1f65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.897+0000 7f7d49e00640 1 -- 172.21.15.7:0/248992375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d38009420 con 0x7f7d4c0c9f20 2024-09-13T15:04:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.897+0000 7f7d49e00640 1 --2- 172.21.15.7:0/248992375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d4c0c9f20 0x7f7d4c0712d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00e930 tx=0x7f7d3c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.897+0000 7fddb7e00640 1 --2- 172.21.15.7:0/330841129 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdd980666e0 0x7fdd98068ba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fddb81f3090 tx=0x7fdda8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.897+0000 7f7d42000640 1 -- 172.21.15.7:0/248992375 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c009690 con 0x7f7d4c0c9f20 2024-09-13T15:04:19.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.897+0000 7f7d42000640 1 -- 172.21.15.7:0/248992375 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3c00ca00 con 0x7f7d4c0c9f20 2024-09-13T15:04:19.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.897+0000 7f7d42000640 1 -- 172.21.15.7:0/248992375 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c00cd70 con 0x7f7d4c0c9f20 2024-09-13T15:04:19.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.897+0000 7f7d51200640 1 -- 172.21.15.7:0/248992375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d44009b30 con 0x7f7d4c0c9f20 2024-09-13T15:04:19.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.897+0000 7f7d51200640 1 -- 172.21.15.7:0/248992375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c145260 con 0x7f7d4c0c9f20 2024-09-13T15:04:19.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.897+0000 7f7d51200640 1 -- 172.21.15.7:0/248992375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c1579d0 con 0x7f7d4c0c9f20 2024-09-13T15:04:19.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.901+0000 7f7d42000640 1 -- 172.21.15.7:0/248992375 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7d3c013470 con 0x7f7d4c0c9f20 2024-09-13T15:04:19.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.901+0000 7f7d42000640 1 --2- 172.21.15.7:0/248992375 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d2c0666c0 0x7f7d2c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.901+0000 7f7d42000640 1 -- 172.21.15.7:0/248992375 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7d3c084fd0 con 0x7f7d4c0c9f20 2024-09-13T15:04:19.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.905+0000 7fddb4c00640 1 -- 172.21.15.7:0/330841129 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fddb0051ce0 con 0x7fddb80c6a60 2024-09-13T15:04:19.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.905+0000 7f7d49400640 1 --2- 172.21.15.7:0/248992375 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d2c0666c0 0x7f7d2c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.905+0000 7f7d49400640 1 --2- 172.21.15.7:0/248992375 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d2c0666c0 0x7f7d2c068b80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c1f0890 tx=0x7f7d38009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.905+0000 7f9ab5600640 1 -- 172.21.15.7:0/3484861592 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9aa4013390 con 0x7f9ab81de940 2024-09-13T15:04:19.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.909+0000 7f9ab5600640 1 --2- 172.21.15.7:0/3484861592 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9a98066690 0x7f9a98068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:19.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.909+0000 7f9ab5600640 1 -- 172.21.15.7:0/3484861592 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9aa411e0d0 con 0x7f9ab81de940 2024-09-13T15:04:19.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.909+0000 7f9abd800640 1 --2- 172.21.15.7:0/3484861592 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9a98066690 0x7f9a98068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:19.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.909+0000 7f9abd800640 1 --2- 172.21.15.7:0/3484861592 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9a98066690 0x7f9a98068b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0003bf0 tx=0x7f9ab0007730 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:19.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.913+0000 7f7d42000640 1 -- 172.21.15.7:0/248992375 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7d3c051fc0 con 0x7f7d4c0c9f20 2024-09-13T15:04:19.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.917+0000 7f9ab5600640 1 -- 172.21.15.7:0/3484861592 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9aa40eb060 con 0x7f9ab81de940 2024-09-13T15:04:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.997+0000 7f65bb200640 1 -- 172.21.15.7:0/197102107 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f65bc0c7380 con 0x7f65bc0c6840 2024-09-13T15:04:20.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:19.997+0000 7f65b2000640 1 -- 172.21.15.7:0/197102107 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f65ac018020 con 0x7f65bc0c6840 2024-09-13T15:04:20.000 INFO:teuthology.orchestra.run.smithi007.stdout:60129542177 2024-09-13T15:04:20.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.009+0000 7f65bb200640 1 -- 172.21.15.7:0/197102107 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6598066690 msgr2=0x7f6598068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.009+0000 7f65bb200640 1 --2- 172.21.15.7:0/197102107 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6598066690 0x7f6598068b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f65a4009bd0 tx=0x7f65a4008040 comp rx=0 tx=0).stop 2024-09-13T15:04:20.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.009+0000 7f65bb200640 1 -- 172.21.15.7:0/197102107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65bc0c6840 msgr2=0x7f65bc13fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.009+0000 7f65bb200640 1 --2- 172.21.15.7:0/197102107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65bc0c6840 0x7f65bc13fb90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f65ac009e90 tx=0x7f65ac00c430 comp rx=0 tx=0).stop 2024-09-13T15:04:20.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.009+0000 7f65bb200640 1 -- 172.21.15.7:0/197102107 shutdown_connections 2024-09-13T15:04:20.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.009+0000 7f65bb200640 1 --2- 172.21.15.7:0/197102107 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6598066690 0x7f6598068b50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.009+0000 7f65bb200640 1 --2- 172.21.15.7:0/197102107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65bc13c8b0 0x7f65bc13e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.009+0000 7f65bb200640 1 --2- 172.21.15.7:0/197102107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65bc0c6840 0x7f65bc13fb90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.009+0000 7f65bb200640 1 --2- 172.21.15.7:0/197102107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65bc0c63f0 0x7f65bc139ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.009+0000 7f65bb200640 1 -- 172.21.15.7:0/197102107 >> 172.21.15.7:0/197102107 conn(0x7f65bc0733a0 msgr2=0x7f65bc13ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:20.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.009+0000 7f65bb200640 1 -- 172.21.15.7:0/197102107 shutdown_connections 2024-09-13T15:04:20.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.009+0000 7f65bb200640 1 -- 172.21.15.7:0/197102107 wait complete. 2024-09-13T15:04:20.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542177 for osd.3 2024-09-13T15:04:20.044 DEBUG:teuthology.parallel:result is None 2024-09-13T15:04:20.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.061+0000 7fcad0c00640 1 -- 172.21.15.7:0/1444088097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fcacc0c4180 con 0x7fcacc14f250 2024-09-13T15:04:20.064 INFO:teuthology.orchestra.run.smithi007.stdout:60129542178 2024-09-13T15:04:20.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.061+0000 7fcac2000640 1 -- 172.21.15.7:0/1444088097 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcac40f06d0 con 0x7fcacc14f250 2024-09-13T15:04:20.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.069+0000 7fcad0c00640 1 -- 172.21.15.7:0/1444088097 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcaac066690 msgr2=0x7fcaac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.069+0000 7fcad0c00640 1 --2- 172.21.15.7:0/1444088097 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcaac066690 0x7fcaac068b50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcab800a8b0 tx=0x7fcab8008040 comp rx=0 tx=0).stop 2024-09-13T15:04:20.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.069+0000 7fcad0c00640 1 -- 172.21.15.7:0/1444088097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcacc14f250 msgr2=0x7fcacc1eae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.069+0000 7fcad0c00640 1 --2- 172.21.15.7:0/1444088097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcacc14f250 0x7fcacc1eae90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcac401edb0 tx=0x7fcac401d4a0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.069+0000 7fcad0c00640 1 -- 172.21.15.7:0/1444088097 shutdown_connections 2024-09-13T15:04:20.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.069+0000 7fcad0c00640 1 --2- 172.21.15.7:0/1444088097 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcaac066690 0x7fcaac068b50 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcab800a8b0 tx=0x7fcab8008040 comp rx=0 tx=0).stop 2024-09-13T15:04:20.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.069+0000 7fcad0c00640 1 --2- 172.21.15.7:0/1444088097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcacc14f250 0x7fcacc1eae90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.069+0000 7fcad0c00640 1 --2- 172.21.15.7:0/1444088097 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcacc0c1880 0x7fcacc1ea950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.069+0000 7fcad0c00640 1 --2- 172.21.15.7:0/1444088097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcacc06cd50 0x7fcacc1ee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.069+0000 7fcad0c00640 1 -- 172.21.15.7:0/1444088097 >> 172.21.15.7:0/1444088097 conn(0x7fcacc065d40 msgr2=0x7fcacc06f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:20.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.069+0000 7fcad0c00640 1 -- 172.21.15.7:0/1444088097 shutdown_connections 2024-09-13T15:04:20.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.069+0000 7fcad0c00640 1 -- 172.21.15.7:0/1444088097 wait complete. 2024-09-13T15:04:20.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.093+0000 7ffac0600640 1 -- 172.21.15.7:0/2800214950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ffab80c4c80 con 0x7ffab8157460 2024-09-13T15:04:20.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.093+0000 7ffab5600640 1 -- 172.21.15.7:0/2800214950 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffaac0eee80 con 0x7ffab8157460 2024-09-13T15:04:20.097 INFO:teuthology.orchestra.run.smithi007.stdout:60129542178 2024-09-13T15:04:20.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.097+0000 7ffac0600640 1 -- 172.21.15.7:0/2800214950 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa98066690 msgr2=0x7ffa98068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.097+0000 7ffac0600640 1 --2- 172.21.15.7:0/2800214950 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa98066690 0x7ffa98068b50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4000c10 tx=0x7ffaa4009b90 comp rx=0 tx=0).stop 2024-09-13T15:04:20.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.097+0000 7ffac0600640 1 -- 172.21.15.7:0/2800214950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffab8157460 msgr2=0x7ffab81f6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.097+0000 7ffac0600640 1 --2- 172.21.15.7:0/2800214950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffab8157460 0x7ffab81f6380 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ffab8066920 tx=0x7ffaac01ac80 comp rx=0 tx=0).stop 2024-09-13T15:04:20.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542178 for osd.5 2024-09-13T15:04:20.102 DEBUG:teuthology.parallel:result is None 2024-09-13T15:04:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.097+0000 7ffac0600640 1 -- 172.21.15.7:0/2800214950 shutdown_connections 2024-09-13T15:04:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.097+0000 7ffac0600640 1 --2- 172.21.15.7:0/2800214950 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa98066690 0x7ffa98068b50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.097+0000 7ffac0600640 1 --2- 172.21.15.7:0/2800214950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffab815a890 0x7ffab81f4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.097+0000 7ffac0600640 1 --2- 172.21.15.7:0/2800214950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffab8157460 0x7ffab81f6380 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.097+0000 7ffac0600640 1 --2- 172.21.15.7:0/2800214950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffab80c5ec0 0x7ffab8154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.097+0000 7ffac0600640 1 -- 172.21.15.7:0/2800214950 >> 172.21.15.7:0/2800214950 conn(0x7ffab8065d40 msgr2=0x7ffab80cb140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.097+0000 7ffac0600640 1 -- 172.21.15.7:0/2800214950 shutdown_connections 2024-09-13T15:04:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.097+0000 7ffac0600640 1 -- 172.21.15.7:0/2800214950 wait complete. 2024-09-13T15:04:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.117+0000 7f2f0c400640 1 -- 172.21.15.7:0/2287397310 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2f041fec60 con 0x7f2f040c6130 2024-09-13T15:04:20.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.117+0000 7f2f01600640 1 -- 172.21.15.7:0/2287397310 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ef8014020 con 0x7f2f040c6130 2024-09-13T15:04:20.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542178 for osd.2 2024-09-13T15:04:20.122 INFO:teuthology.orchestra.run.smithi007.stdout:60129542179 2024-09-13T15:04:20.122 DEBUG:teuthology.parallel:result is None 2024-09-13T15:04:20.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.121+0000 7f2f0c400640 1 -- 172.21.15.7:0/2287397310 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2ee4066690 msgr2=0x7f2ee4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.121+0000 7f2f0c400640 1 --2- 172.21.15.7:0/2287397310 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2ee4066690 0x7f2ee4068b50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2f04155960 tx=0x7f2ef0009040 comp rx=0 tx=0).stop 2024-09-13T15:04:20.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.121+0000 7f2f0c400640 1 -- 172.21.15.7:0/2287397310 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f040c6130 msgr2=0x7f2f0415c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.121+0000 7f2f0c400640 1 --2- 172.21.15.7:0/2287397310 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f040c6130 0x7f2f0415c180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800b580 tx=0x7f2ef800ba40 comp rx=0 tx=0).stop 2024-09-13T15:04:20.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.121+0000 7f2f0c400640 1 -- 172.21.15.7:0/2287397310 shutdown_connections 2024-09-13T15:04:20.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.121+0000 7f2f0c400640 1 --2- 172.21.15.7:0/2287397310 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2ee4066690 0x7f2ee4068b50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.121+0000 7f2f0c400640 1 --2- 172.21.15.7:0/2287397310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f04151590 0x7f2f041ff320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.121+0000 7f2f0c400640 1 --2- 172.21.15.7:0/2287397310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f040c7ea0 0x7f2f040c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.121+0000 7f2f0c400640 1 --2- 172.21.15.7:0/2287397310 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2f040c6130 0x7f2f0415c180 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.121+0000 7f2f0c400640 1 -- 172.21.15.7:0/2287397310 >> 172.21.15.7:0/2287397310 conn(0x7f2f040c7380 msgr2=0x7f2f040c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:20.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.121+0000 7f2f0c400640 1 -- 172.21.15.7:0/2287397310 shutdown_connections 2024-09-13T15:04:20.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.121+0000 7f2f0c400640 1 -- 172.21.15.7:0/2287397310 wait complete. 2024-09-13T15:04:20.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542179 for osd.6 2024-09-13T15:04:20.145 DEBUG:teuthology.parallel:result is None 2024-09-13T15:04:20.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.173+0000 7f9aaaa00640 1 -- 172.21.15.7:0/3484861592 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9a940057e0 con 0x7f9ab81de940 2024-09-13T15:04:20.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.173+0000 7f9ab5600640 1 -- 172.21.15.7:0/3484861592 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9aa4001c50 con 0x7f9ab81de940 2024-09-13T15:04:20.176 INFO:teuthology.orchestra.run.smithi007.stdout:60129542178 2024-09-13T15:04:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.173+0000 7f9aaaa00640 1 -- 172.21.15.7:0/3484861592 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9a98066690 msgr2=0x7f9a98068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.173+0000 7f9aaaa00640 1 --2- 172.21.15.7:0/3484861592 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9a98066690 0x7f9a98068b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9ab0003bf0 tx=0x7f9ab0007730 comp rx=0 tx=0).stop 2024-09-13T15:04:20.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.173+0000 7f9aaaa00640 1 -- 172.21.15.7:0/3484861592 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ab81de940 msgr2=0x7f9ab81df890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.173+0000 7f9aaaa00640 1 --2- 172.21.15.7:0/3484861592 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ab81de940 0x7f9ab81df890 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4009000 tx=0x7f9aa0005800 comp rx=0 tx=0).stop 2024-09-13T15:04:20.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.177+0000 7f9aaaa00640 1 -- 172.21.15.7:0/3484861592 shutdown_connections 2024-09-13T15:04:20.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.177+0000 7f9aaaa00640 1 --2- 172.21.15.7:0/3484861592 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9a98066690 0x7f9a98068b50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.177+0000 7f9aaaa00640 1 --2- 172.21.15.7:0/3484861592 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ab81de940 0x7f9ab81df890 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.177+0000 7f9aaaa00640 1 --2- 172.21.15.7:0/3484861592 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ab80c3d00 0x7f9ab81df350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.177+0000 7f9aaaa00640 1 --2- 172.21.15.7:0/3484861592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ab81de560 0x7f9ab81f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.177+0000 7f9aaaa00640 1 -- 172.21.15.7:0/3484861592 >> 172.21.15.7:0/3484861592 conn(0x7f9ab806b7d0 msgr2=0x7f9ab806fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:20.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.177+0000 7f9aaaa00640 1 -- 172.21.15.7:0/3484861592 shutdown_connections 2024-09-13T15:04:20.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.177+0000 7f9aaaa00640 1 -- 172.21.15.7:0/3484861592 wait complete. 2024-09-13T15:04:20.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.185+0000 7fddbe200640 1 -- 172.21.15.7:0/330841129 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fddb814fa70 con 0x7fddb80c6a60 2024-09-13T15:04:20.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.185+0000 7fddb4c00640 1 -- 172.21.15.7:0/330841129 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fddb0055300 con 0x7fddb80c6a60 2024-09-13T15:04:20.187 INFO:teuthology.orchestra.run.smithi007.stdout:60129542178 2024-09-13T15:04:20.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.185+0000 7fddbe200640 1 -- 172.21.15.7:0/330841129 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdd980666e0 msgr2=0x7fdd98068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.185+0000 7fddbe200640 1 --2- 172.21.15.7:0/330841129 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdd980666e0 0x7fdd98068ba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fddb81f3090 tx=0x7fdda8009040 comp rx=0 tx=0).stop 2024-09-13T15:04:20.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.185+0000 7fddbe200640 1 -- 172.21.15.7:0/330841129 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddb80c6a60 msgr2=0x7fddb80c88b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.185+0000 7fddbe200640 1 --2- 172.21.15.7:0/330841129 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddb80c6a60 0x7fddb80c88b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fddb000ba80 tx=0x7fddb000bf40 comp rx=0 tx=0).stop 2024-09-13T15:04:20.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.185+0000 7fddbe200640 1 -- 172.21.15.7:0/330841129 shutdown_connections 2024-09-13T15:04:20.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.185+0000 7fddbe200640 1 --2- 172.21.15.7:0/330841129 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdd980666e0 0x7fdd98068ba0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.185+0000 7fddbe200640 1 --2- 172.21.15.7:0/330841129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddb81f2230 0x7fddb81f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.185+0000 7fddbe200640 1 --2- 172.21.15.7:0/330841129 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddb814f620 0x7fddb8150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.185+0000 7fddbe200640 1 --2- 172.21.15.7:0/330841129 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fddb80c6a60 0x7fddb80c88b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.185+0000 7fddbe200640 1 -- 172.21.15.7:0/330841129 >> 172.21.15.7:0/330841129 conn(0x7fddb806b7d0 msgr2=0x7fddb814aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:20.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.185+0000 7fddbe200640 1 -- 172.21.15.7:0/330841129 shutdown_connections 2024-09-13T15:04:20.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.185+0000 7fddbe200640 1 -- 172.21.15.7:0/330841129 wait complete. 2024-09-13T15:04:20.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542178 for osd.7 2024-09-13T15:04:20.202 DEBUG:teuthology.parallel:result is None 2024-09-13T15:04:20.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542178 for osd.0 2024-09-13T15:04:20.211 DEBUG:teuthology.parallel:result is None 2024-09-13T15:04:20.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.221+0000 7f33c0a00640 1 -- 172.21.15.7:0/673435056 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f33bc066000 con 0x7f33bc14f0f0 2024-09-13T15:04:20.226 INFO:teuthology.orchestra.run.smithi007.stdout:60129542177 2024-09-13T15:04:20.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.225+0000 7f33b3400640 1 -- 172.21.15.7:0/673435056 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f33b40553b0 con 0x7f33bc14f0f0 2024-09-13T15:04:20.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.225+0000 7f33c0a00640 1 -- 172.21.15.7:0/673435056 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f339c0666c0 msgr2=0x7f339c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.225+0000 7f33c0a00640 1 --2- 172.21.15.7:0/673435056 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f339c0666c0 0x7f339c068b80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0b5000 tx=0x7f33ac0ac000 comp rx=0 tx=0).stop 2024-09-13T15:04:20.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.225+0000 7f33c0a00640 1 -- 172.21.15.7:0/673435056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33bc14f0f0 msgr2=0x7f33bc0c3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.225+0000 7f33c0a00640 1 --2- 172.21.15.7:0/673435056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33bc14f0f0 0x7f33bc0c3860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f33b4007e40 tx=0x7f33b400e4b0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.225+0000 7f33c0a00640 1 -- 172.21.15.7:0/673435056 shutdown_connections 2024-09-13T15:04:20.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.225+0000 7f33c0a00640 1 --2- 172.21.15.7:0/673435056 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f339c0666c0 0x7f339c068b80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.225+0000 7f33c0a00640 1 --2- 172.21.15.7:0/673435056 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33bc154ed0 0x7f33bc14f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.225+0000 7f33c0a00640 1 --2- 172.21.15.7:0/673435056 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33bc14f0f0 0x7f33bc0c3860 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.225+0000 7f33c0a00640 1 --2- 172.21.15.7:0/673435056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33bc06f7a0 0x7f33bc1ee0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.225+0000 7f33c0a00640 1 -- 172.21.15.7:0/673435056 >> 172.21.15.7:0/673435056 conn(0x7f33bc06b7d0 msgr2=0x7f33bc154610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:20.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.225+0000 7f33c0a00640 1 -- 172.21.15.7:0/673435056 shutdown_connections 2024-09-13T15:04:20.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.225+0000 7f33c0a00640 1 -- 172.21.15.7:0/673435056 wait complete. 2024-09-13T15:04:20.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.253+0000 7f7d51200640 1 -- 172.21.15.7:0/248992375 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7d4c1f61d0 con 0x7f7d4c0c9f20 2024-09-13T15:04:20.257 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542177 got 60129542177 for osd.1 2024-09-13T15:04:20.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.253+0000 7f7d42000640 1 -- 172.21.15.7:0/248992375 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d3c021020 con 0x7f7d4c0c9f20 2024-09-13T15:04:20.257 INFO:teuthology.orchestra.run.smithi007.stdout:60129542178 2024-09-13T15:04:20.257 DEBUG:teuthology.parallel:result is None 2024-09-13T15:04:20.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.257+0000 7f7d51200640 1 -- 172.21.15.7:0/248992375 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d2c0666c0 msgr2=0x7f7d2c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.257+0000 7f7d51200640 1 --2- 172.21.15.7:0/248992375 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d2c0666c0 0x7f7d2c068b80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c1f0890 tx=0x7f7d38009190 comp rx=0 tx=0).stop 2024-09-13T15:04:20.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.257+0000 7f7d51200640 1 -- 172.21.15.7:0/248992375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d4c0c9f20 msgr2=0x7f7d4c0712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.257+0000 7f7d51200640 1 --2- 172.21.15.7:0/248992375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d4c0c9f20 0x7f7d4c0712d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00e930 tx=0x7f7d3c00edf0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.257+0000 7f7d51200640 1 -- 172.21.15.7:0/248992375 shutdown_connections 2024-09-13T15:04:20.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.257+0000 7f7d51200640 1 --2- 172.21.15.7:0/248992375 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d2c0666c0 0x7f7d2c068b80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.257+0000 7f7d51200640 1 --2- 172.21.15.7:0/248992375 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d4c160920 0x7f7d4c1f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.257+0000 7f7d51200640 1 --2- 172.21.15.7:0/248992375 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d4c143080 0x7f7d4c1f65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.257+0000 7f7d51200640 1 --2- 172.21.15.7:0/248992375 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d4c0c9f20 0x7f7d4c0712d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.257+0000 7f7d51200640 1 -- 172.21.15.7:0/248992375 >> 172.21.15.7:0/248992375 conn(0x7f7d4c06ce10 msgr2=0x7f7d4c13fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:20.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.257+0000 7f7d51200640 1 -- 172.21.15.7:0/248992375 shutdown_connections 2024-09-13T15:04:20.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.257+0000 7f7d51200640 1 -- 172.21.15.7:0/248992375 wait complete. 2024-09-13T15:04:20.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542178 for osd.4 2024-09-13T15:04:20.278 DEBUG:teuthology.parallel:result is None 2024-09-13T15:04:20.278 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T15:04:20.278 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:04:20.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.457+0000 7f9c75600640 1 Processor -- start 2024-09-13T15:04:20.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.457+0000 7f9c75600640 1 -- start start 2024-09-13T15:04:20.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.461+0000 7f9c75600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9c70153170 0x7f9c7006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:20.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.461+0000 7f9c75600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c700c9f30 0x7f9c700c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:20.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.461+0000 7f9c75600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9c700c7a20 0x7f9c70159590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:20.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.461+0000 7f9c75600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c70159170 con 0x7f9c700c7a20 2024-09-13T15:04:20.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.461+0000 7f9c75600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7015c7f0 con 0x7f9c70153170 2024-09-13T15:04:20.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.461+0000 7f9c75600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7015cad0 con 0x7f9c700c9f30 2024-09-13T15:04:20.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.461+0000 7f9c74c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9c700c7a20 0x7f9c70159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:20.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.461+0000 7f9c74c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9c700c7a20 0x7f9c70159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41404/0 (socket says 172.21.15.7:41404) 2024-09-13T15:04:20.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.461+0000 7f9c74c00640 1 -- 172.21.15.7:0/3322880602 learned_addr learned my addr 172.21.15.7:0/3322880602 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:20.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.461+0000 7f9c6fe00640 1 --2- 172.21.15.7:0/3322880602 >> v2:172.21.15.77:3300/0 conn(0x7f9c70153170 0x7f9c7006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:20.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.461+0000 7f9c67400640 1 --2- 172.21.15.7:0/3322880602 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c700c9f30 0x7f9c700c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:20.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.461+0000 7f9c74c00640 1 -- 172.21.15.7:0/3322880602 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c700c9f30 msgr2=0x7f9c700c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:20.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.461+0000 7f9c74c00640 1 --2- 172.21.15.7:0/3322880602 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c700c9f30 0x7f9c700c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.461+0000 7f9c74c00640 1 -- 172.21.15.7:0/3322880602 >> v2:172.21.15.77:3300/0 conn(0x7f9c70153170 msgr2=0x7f9c7006db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:20.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.461+0000 7f9c74c00640 1 --2- 172.21.15.7:0/3322880602 >> v2:172.21.15.77:3300/0 conn(0x7f9c70153170 0x7f9c7006db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.461+0000 7f9c74c00640 1 -- 172.21.15.7:0/3322880602 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7015cdb0 con 0x7f9c700c7a20 2024-09-13T15:04:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.465+0000 7f9c74c00640 1 --2- 172.21.15.7:0/3322880602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c700c7a20 0x7f9c70159590 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9c70066bd0 tx=0x7f9c6801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45740a70f4e42581 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.465+0000 7f9c6f400640 1 -- 172.21.15.7:0/3322880602 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c680a89d0 con 0x7f9c700c7a20 2024-09-13T15:04:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.465+0000 7f9c6f400640 1 -- 172.21.15.7:0/3322880602 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c680a8b30 con 0x7f9c700c7a20 2024-09-13T15:04:20.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.465+0000 7f9c6f400640 1 -- 172.21.15.7:0/3322880602 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c680b0440 con 0x7f9c700c7a20 2024-09-13T15:04:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.465+0000 7f9c75600640 1 -- 172.21.15.7:0/3322880602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c700c7a20 msgr2=0x7f9c70159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.465+0000 7f9c75600640 1 --2- 172.21.15.7:0/3322880602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c700c7a20 0x7f9c70159590 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9c70066bd0 tx=0x7f9c6801ed10 comp rx=0 tx=0).stop 2024-09-13T15:04:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.465+0000 7f9c75600640 1 -- 172.21.15.7:0/3322880602 shutdown_connections 2024-09-13T15:04:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.465+0000 7f9c75600640 1 --2- 172.21.15.7:0/3322880602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c700c7a20 0x7f9c70159590 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.465+0000 7f9c75600640 1 --2- 172.21.15.7:0/3322880602 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c700c9f30 0x7f9c700c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.465+0000 7f9c75600640 1 --2- 172.21.15.7:0/3322880602 >> v2:172.21.15.77:3300/0 conn(0x7f9c70153170 0x7f9c7006db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.465+0000 7f9c75600640 1 -- 172.21.15.7:0/3322880602 >> 172.21.15.7:0/3322880602 conn(0x7f9c70065d40 msgr2=0x7f9c70066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.465+0000 7f9c75600640 1 -- 172.21.15.7:0/3322880602 shutdown_connections 2024-09-13T15:04:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.465+0000 7f9c75600640 1 -- 172.21.15.7:0/3322880602 wait complete. 2024-09-13T15:04:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.465+0000 7f9c75600640 1 Processor -- start 2024-09-13T15:04:20.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.465+0000 7f9c75600640 1 -- start start 2024-09-13T15:04:20.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.465+0000 7f9c75600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c700c7a20 0x7f9c700c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:20.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.465+0000 7f9c75600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c700c9f30 0x7f9c701efd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:20.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c75600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c70153170 0x7f9c701f0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:20.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c75600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c70156280 con 0x7f9c70153170 2024-09-13T15:04:20.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c75600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c70155700 con 0x7f9c700c7a20 2024-09-13T15:04:20.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c75600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c701559e0 con 0x7f9c700c9f30 2024-09-13T15:04:20.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c74c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c70153170 0x7f9c701f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:20.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c74c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c70153170 0x7f9c701f0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41418/0 (socket says 172.21.15.7:41418) 2024-09-13T15:04:20.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c74c00640 1 -- 172.21.15.7:0/3340960881 learned_addr learned my addr 172.21.15.7:0/3340960881 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:20.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c6fe00640 1 --2- 172.21.15.7:0/3340960881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c700c7a20 0x7f9c700c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:20.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c67400640 1 --2- 172.21.15.7:0/3340960881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c700c9f30 0x7f9c701efd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:20.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c74c00640 1 -- 172.21.15.7:0/3340960881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c700c9f30 msgr2=0x7f9c701efd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c74c00640 1 --2- 172.21.15.7:0/3340960881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c700c9f30 0x7f9c701efd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c74c00640 1 -- 172.21.15.7:0/3340960881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c700c7a20 msgr2=0x7f9c700c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c74c00640 1 --2- 172.21.15.7:0/3340960881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c700c7a20 0x7f9c700c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c74c00640 1 -- 172.21.15.7:0/3340960881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c680094d0 con 0x7f9c70153170 2024-09-13T15:04:20.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c74c00640 1 --2- 172.21.15.7:0/3340960881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c70153170 0x7f9c701f0250 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9c680b3040 tx=0x7f9c6801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:20.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c6cc00640 1 -- 172.21.15.7:0/3340960881 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c680b0da0 con 0x7f9c70153170 2024-09-13T15:04:20.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c6cc00640 1 -- 172.21.15.7:0/3340960881 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c680bb470 con 0x7f9c70153170 2024-09-13T15:04:20.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c75600640 1 -- 172.21.15.7:0/3340960881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c70155cc0 con 0x7f9c70153170 2024-09-13T15:04:20.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c6cc00640 1 -- 172.21.15.7:0/3340960881 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c680bb7e0 con 0x7f9c70153170 2024-09-13T15:04:20.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c75600640 1 -- 172.21.15.7:0/3340960881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c70150640 con 0x7f9c70153170 2024-09-13T15:04:20.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c75600640 1 -- 172.21.15.7:0/3340960881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c70153550 con 0x7f9c70153170 2024-09-13T15:04:20.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c6cc00640 1 -- 172.21.15.7:0/3340960881 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9c680b7070 con 0x7f9c70153170 2024-09-13T15:04:20.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.469+0000 7f9c6cc00640 1 --2- 172.21.15.7:0/3340960881 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9c4c0666c0 0x7f9c4c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:20.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.473+0000 7f9c6cc00640 1 -- 172.21.15.7:0/3340960881 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9c681229c0 con 0x7f9c70153170 2024-09-13T15:04:20.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.473+0000 7f9c6fe00640 1 --2- 172.21.15.7:0/3340960881 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9c4c0666c0 0x7f9c4c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:20.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.473+0000 7f9c6fe00640 1 --2- 172.21.15.7:0/3340960881 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9c4c0666c0 0x7f9c4c068b80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9c60003fd0 tx=0x7f9c600039a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:20.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.473+0000 7f9c6cc00640 1 -- 172.21.15.7:0/3340960881 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9c680ef7c0 con 0x7f9c70153170 2024-09-13T15:04:20.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.633+0000 7f9c75600640 1 -- 172.21.15.7:0/3340960881 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c7015c4d0 con 0x7f9c4c0666c0 2024-09-13T15:04:20.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.661+0000 7f9c6cc00640 1 -- 172.21.15.7:0/3340960881 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368930 (secure 0 0 0) 0x7f9c600046c0 con 0x7f9c4c0666c0 2024-09-13T15:04:20.669 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:20.671 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T15:04:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.665+0000 7f9c75600640 1 -- 172.21.15.7:0/3340960881 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9c4c0666c0 msgr2=0x7f9c4c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.665+0000 7f9c75600640 1 --2- 172.21.15.7:0/3340960881 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9c4c0666c0 0x7f9c4c068b80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9c60003fd0 tx=0x7f9c600039a0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.665+0000 7f9c75600640 1 -- 172.21.15.7:0/3340960881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c70153170 msgr2=0x7f9c701f0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.665+0000 7f9c75600640 1 --2- 172.21.15.7:0/3340960881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c70153170 0x7f9c701f0250 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9c680b3040 tx=0x7f9c6801bab0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.665+0000 7f9c75600640 1 -- 172.21.15.7:0/3340960881 shutdown_connections 2024-09-13T15:04:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.665+0000 7f9c75600640 1 --2- 172.21.15.7:0/3340960881 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9c4c0666c0 0x7f9c4c068b80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.665+0000 7f9c75600640 1 --2- 172.21.15.7:0/3340960881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c70153170 0x7f9c701f0250 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.665+0000 7f9c75600640 1 --2- 172.21.15.7:0/3340960881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9c700c9f30 0x7f9c701efd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.665+0000 7f9c75600640 1 --2- 172.21.15.7:0/3340960881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9c700c7a20 0x7f9c700c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.665+0000 7f9c75600640 1 -- 172.21.15.7:0/3340960881 >> 172.21.15.7:0/3340960881 conn(0x7f9c70065d40 msgr2=0x7f9c701509a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:20.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.665+0000 7f9c75600640 1 -- 172.21.15.7:0/3340960881 shutdown_connections 2024-09-13T15:04:20.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.665+0000 7f9c75600640 1 -- 172.21.15.7:0/3340960881 wait complete. 2024-09-13T15:04:20.688 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2024-09-13T15:04:18.685399+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596319,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":247,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231908,"kb_used_data":3488,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":754742812,"statfs":{"total":773094113280,"available":772856639488,"internally_reserved":0,"allocated":3571712,"data_stored":2127008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":233819704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1358,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004610"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742671+0000","last_change":"2024-09-13T15:01:44.418856+0000","last_active":"2024-09-13T15:02:33.742671+0000","last_peered":"2024-09-13T15:02:33.742671+0000","last_clean":"2024-09-13T15:02:33.742671+0000","last_became_active":"2024-09-13T15:01:44.418641+0000","last_became_peered":"2024-09-13T15:01:44.418641+0000","last_unstale":"2024-09-13T15:02:33.742671+0000","last_undegraded":"2024-09-13T15:02:33.742671+0000","last_fullsized":"2024-09-13T15:02:33.742671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:40.178824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738513+0000","last_change":"2024-09-13T15:01:44.809371+0000","last_active":"2024-09-13T15:02:33.738513+0000","last_peered":"2024-09-13T15:02:33.738513+0000","last_clean":"2024-09-13T15:02:33.738513+0000","last_became_active":"2024-09-13T15:01:44.809091+0000","last_became_peered":"2024-09-13T15:01:44.809091+0000","last_unstale":"2024-09-13T15:02:33.738513+0000","last_undegraded":"2024-09-13T15:02:33.738513+0000","last_fullsized":"2024-09-13T15:02:33.738513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:22.412025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737520+0000","last_change":"2024-09-13T15:01:48.910757+0000","last_active":"2024-09-13T15:02:33.737520+0000","last_peered":"2024-09-13T15:02:33.737520+0000","last_clean":"2024-09-13T15:02:33.737520+0000","last_became_active":"2024-09-13T15:01:48.910262+0000","last_became_peered":"2024-09-13T15:01:48.910262+0000","last_unstale":"2024-09-13T15:02:33.737520+0000","last_undegraded":"2024-09-13T15:02:33.737520+0000","last_fullsized":"2024-09-13T15:02:33.737520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:39.290557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738791+0000","last_change":"2024-09-13T15:01:44.404818+0000","last_active":"2024-09-13T15:02:33.738791+0000","last_peered":"2024-09-13T15:02:33.738791+0000","last_clean":"2024-09-13T15:02:33.738791+0000","last_became_active":"2024-09-13T15:01:44.401666+0000","last_became_peered":"2024-09-13T15:01:44.401666+0000","last_unstale":"2024-09-13T15:02:33.738791+0000","last_undegraded":"2024-09-13T15:02:33.738791+0000","last_fullsized":"2024-09-13T15:02:33.738791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:31.818163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742417+0000","last_change":"2024-09-13T15:01:44.850292+0000","last_active":"2024-09-13T15:02:33.742417+0000","last_peered":"2024-09-13T15:02:33.742417+0000","last_clean":"2024-09-13T15:02:33.742417+0000","last_became_active":"2024-09-13T15:01:44.849825+0000","last_became_peered":"2024-09-13T15:01:44.849825+0000","last_unstale":"2024-09-13T15:02:33.742417+0000","last_undegraded":"2024-09-13T15:02:33.742417+0000","last_fullsized":"2024-09-13T15:02:33.742417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:22.582742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.746607+0000","last_change":"2024-09-13T15:01:48.850426+0000","last_active":"2024-09-13T15:02:33.746607+0000","last_peered":"2024-09-13T15:02:33.746607+0000","last_clean":"2024-09-13T15:02:33.746607+0000","last_became_active":"2024-09-13T15:01:48.848750+0000","last_became_peered":"2024-09-13T15:01:48.848750+0000","last_unstale":"2024-09-13T15:02:33.746607+0000","last_undegraded":"2024-09-13T15:02:33.746607+0000","last_fullsized":"2024-09-13T15:02:33.746607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:55.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117554+0000","last_change":"2024-09-13T15:01:44.437850+0000","last_active":"2024-09-13T15:02:34.117554+0000","last_peered":"2024-09-13T15:02:34.117554+0000","last_clean":"2024-09-13T15:02:34.117554+0000","last_became_active":"2024-09-13T15:01:44.437168+0000","last_became_peered":"2024-09-13T15:01:44.437168+0000","last_unstale":"2024-09-13T15:02:34.117554+0000","last_undegraded":"2024-09-13T15:02:34.117554+0000","last_fullsized":"2024-09-13T15:02:34.117554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:23.540408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745120+0000","last_change":"2024-09-13T15:01:44.845989+0000","last_active":"2024-09-13T15:02:33.745120+0000","last_peered":"2024-09-13T15:02:33.745120+0000","last_clean":"2024-09-13T15:02:33.745120+0000","last_became_active":"2024-09-13T15:01:44.845395+0000","last_became_peered":"2024-09-13T15:01:44.845395+0000","last_unstale":"2024-09-13T15:02:33.745120+0000","last_undegraded":"2024-09-13T15:02:33.745120+0000","last_fullsized":"2024-09-13T15:02:33.745120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:52.267507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748880+0000","last_change":"2024-09-13T15:01:48.865388+0000","last_active":"2024-09-13T15:02:33.748880+0000","last_peered":"2024-09-13T15:02:33.748880+0000","last_clean":"2024-09-13T15:02:33.748880+0000","last_became_active":"2024-09-13T15:01:48.864314+0000","last_became_peered":"2024-09-13T15:01:48.864314+0000","last_unstale":"2024-09-13T15:02:33.748880+0000","last_undegraded":"2024-09-13T15:02:33.748880+0000","last_fullsized":"2024-09-13T15:02:33.748880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:18.637430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116848+0000","last_change":"2024-09-13T15:01:44.424080+0000","last_active":"2024-09-13T15:02:34.116848+0000","last_peered":"2024-09-13T15:02:34.116848+0000","last_clean":"2024-09-13T15:02:34.116848+0000","last_became_active":"2024-09-13T15:01:44.423381+0000","last_became_peered":"2024-09-13T15:01:44.423381+0000","last_unstale":"2024-09-13T15:02:34.116848+0000","last_undegraded":"2024-09-13T15:02:34.116848+0000","last_fullsized":"2024-09-13T15:02:34.116848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:38:20.455380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.754463+0000","last_change":"2024-09-13T15:01:44.849670+0000","last_active":"2024-09-13T15:02:32.754463+0000","last_peered":"2024-09-13T15:02:32.754463+0000","last_clean":"2024-09-13T15:02:32.754463+0000","last_became_active":"2024-09-13T15:01:44.849038+0000","last_became_peered":"2024-09-13T15:01:44.849038+0000","last_unstale":"2024-09-13T15:02:32.754463+0000","last_undegraded":"2024-09-13T15:02:32.754463+0000","last_fullsized":"2024-09-13T15:02:32.754463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:45.570774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.747610+0000","last_change":"2024-09-13T15:01:48.854953+0000","last_active":"2024-09-13T15:02:33.747610+0000","last_peered":"2024-09-13T15:02:33.747610+0000","last_clean":"2024-09-13T15:02:33.747610+0000","last_became_active":"2024-09-13T15:01:48.853858+0000","last_became_peered":"2024-09-13T15:01:48.853858+0000","last_unstale":"2024-09-13T15:02:33.747610+0000","last_undegraded":"2024-09-13T15:02:33.747610+0000","last_fullsized":"2024-09-13T15:02:33.747610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:07.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742073+0000","last_change":"2024-09-13T15:01:44.824391+0000","last_active":"2024-09-13T15:02:33.742073+0000","last_peered":"2024-09-13T15:02:33.742073+0000","last_clean":"2024-09-13T15:02:33.742073+0000","last_became_active":"2024-09-13T15:01:44.823690+0000","last_became_peered":"2024-09-13T15:01:44.823690+0000","last_unstale":"2024-09-13T15:02:33.742073+0000","last_undegraded":"2024-09-13T15:02:33.742073+0000","last_fullsized":"2024-09-13T15:02:33.742073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.596789+0000","last_change":"2024-09-13T15:01:44.421523+0000","last_active":"2024-09-13T15:04:17.596789+0000","last_peered":"2024-09-13T15:04:17.596789+0000","last_clean":"2024-09-13T15:04:17.596789+0000","last_became_active":"2024-09-13T15:01:44.419965+0000","last_became_peered":"2024-09-13T15:01:44.419965+0000","last_unstale":"2024-09-13T15:04:17.596789+0000","last_undegraded":"2024-09-13T15:04:17.596789+0000","last_fullsized":"2024-09-13T15:04:17.596789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:34.918774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749714+0000","last_change":"2024-09-13T15:01:48.850895+0000","last_active":"2024-09-13T15:02:33.749714+0000","last_peered":"2024-09-13T15:02:33.749714+0000","last_clean":"2024-09-13T15:02:33.749714+0000","last_became_active":"2024-09-13T15:01:48.849856+0000","last_became_peered":"2024-09-13T15:01:48.849856+0000","last_unstale":"2024-09-13T15:02:33.749714+0000","last_undegraded":"2024-09-13T15:02:33.749714+0000","last_fullsized":"2024-09-13T15:02:33.749714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:59.616442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738227+0000","last_change":"2024-09-13T15:01:44.806026+0000","last_active":"2024-09-13T15:02:33.738227+0000","last_peered":"2024-09-13T15:02:33.738227+0000","last_clean":"2024-09-13T15:02:33.738227+0000","last_became_active":"2024-09-13T15:01:44.805767+0000","last_became_peered":"2024-09-13T15:01:44.805767+0000","last_unstale":"2024-09-13T15:02:33.738227+0000","last_undegraded":"2024-09-13T15:02:33.738227+0000","last_fullsized":"2024-09-13T15:02:33.738227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:50.696113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743085+0000","last_change":"2024-09-13T15:01:44.401897+0000","last_active":"2024-09-13T15:02:33.743085+0000","last_peered":"2024-09-13T15:02:33.743085+0000","last_clean":"2024-09-13T15:02:33.743085+0000","last_became_active":"2024-09-13T15:01:44.401559+0000","last_became_peered":"2024-09-13T15:01:44.401559+0000","last_unstale":"2024-09-13T15:02:33.743085+0000","last_undegraded":"2024-09-13T15:02:33.743085+0000","last_fullsized":"2024-09-13T15:02:33.743085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:58.535567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749109+0000","last_change":"2024-09-13T15:01:48.858808+0000","last_active":"2024-09-13T15:02:33.749109+0000","last_peered":"2024-09-13T15:02:33.749109+0000","last_clean":"2024-09-13T15:02:33.749109+0000","last_became_active":"2024-09-13T15:01:48.857802+0000","last_became_peered":"2024-09-13T15:01:48.857802+0000","last_unstale":"2024-09-13T15:02:33.749109+0000","last_undegraded":"2024-09-13T15:02:33.749109+0000","last_fullsized":"2024-09-13T15:02:33.749109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:41.628058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737738+0000","last_change":"2024-09-13T15:01:44.808674+0000","last_active":"2024-09-13T15:02:33.737738+0000","last_peered":"2024-09-13T15:02:33.737738+0000","last_clean":"2024-09-13T15:02:33.737738+0000","last_became_active":"2024-09-13T15:01:44.808420+0000","last_became_peered":"2024-09-13T15:01:44.808420+0000","last_unstale":"2024-09-13T15:02:33.737738+0000","last_undegraded":"2024-09-13T15:02:33.737738+0000","last_fullsized":"2024-09-13T15:02:33.737738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:33.447973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.610200+0000","last_change":"2024-09-13T15:01:44.406717+0000","last_active":"2024-09-13T15:04:17.610200+0000","last_peered":"2024-09-13T15:04:17.610200+0000","last_clean":"2024-09-13T15:04:17.610200+0000","last_became_active":"2024-09-13T15:01:44.406354+0000","last_became_peered":"2024-09-13T15:01:44.406354+0000","last_unstale":"2024-09-13T15:04:17.610200+0000","last_undegraded":"2024-09-13T15:04:17.610200+0000","last_fullsized":"2024-09-13T15:04:17.610200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:49.413632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741522+0000","last_change":"2024-09-13T15:01:48.909879+0000","last_active":"2024-09-13T15:02:33.741522+0000","last_peered":"2024-09-13T15:02:33.741522+0000","last_clean":"2024-09-13T15:02:33.741522+0000","last_became_active":"2024-09-13T15:01:48.909494+0000","last_became_peered":"2024-09-13T15:01:48.909494+0000","last_unstale":"2024-09-13T15:02:33.741522+0000","last_undegraded":"2024-09-13T15:02:33.741522+0000","last_fullsized":"2024-09-13T15:02:33.741522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:54.415920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748317+0000","last_change":"2024-09-13T15:01:44.825065+0000","last_active":"2024-09-13T15:02:33.748317+0000","last_peered":"2024-09-13T15:02:33.748317+0000","last_clean":"2024-09-13T15:02:33.748317+0000","last_became_active":"2024-09-13T15:01:44.824392+0000","last_became_peered":"2024-09-13T15:01:44.824392+0000","last_unstale":"2024-09-13T15:02:33.748317+0000","last_undegraded":"2024-09-13T15:02:33.748317+0000","last_fullsized":"2024-09-13T15:02:33.748317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:49.717211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.600924+0000","last_change":"2024-09-13T15:01:44.421119+0000","last_active":"2024-09-13T15:04:17.600924+0000","last_peered":"2024-09-13T15:04:17.600924+0000","last_clean":"2024-09-13T15:04:17.600924+0000","last_became_active":"2024-09-13T15:01:44.419082+0000","last_became_peered":"2024-09-13T15:01:44.419082+0000","last_unstale":"2024-09-13T15:04:17.600924+0000","last_undegraded":"2024-09-13T15:04:17.600924+0000","last_fullsized":"2024-09-13T15:04:17.600924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.011350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749456+0000","last_change":"2024-09-13T15:01:48.856387+0000","last_active":"2024-09-13T15:02:33.749456+0000","last_peered":"2024-09-13T15:02:33.749456+0000","last_clean":"2024-09-13T15:02:33.749456+0000","last_became_active":"2024-09-13T15:01:48.855433+0000","last_became_peered":"2024-09-13T15:01:48.855433+0000","last_unstale":"2024-09-13T15:02:33.749456+0000","last_undegraded":"2024-09-13T15:02:33.749456+0000","last_fullsized":"2024-09-13T15:02:33.749456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:58.309929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744608+0000","last_change":"2024-09-13T15:01:44.807909+0000","last_active":"2024-09-13T15:02:33.744608+0000","last_peered":"2024-09-13T15:02:33.744608+0000","last_clean":"2024-09-13T15:02:33.744608+0000","last_became_active":"2024-09-13T15:01:44.807643+0000","last_became_peered":"2024-09-13T15:01:44.807643+0000","last_unstale":"2024-09-13T15:02:33.744608+0000","last_undegraded":"2024-09-13T15:02:33.744608+0000","last_fullsized":"2024-09-13T15:02:33.744608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:30.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.594985+0000","last_change":"2024-09-13T15:01:44.430200+0000","last_active":"2024-09-13T15:04:17.594985+0000","last_peered":"2024-09-13T15:04:17.594985+0000","last_clean":"2024-09-13T15:04:17.594985+0000","last_became_active":"2024-09-13T15:01:44.429510+0000","last_became_peered":"2024-09-13T15:01:44.429510+0000","last_unstale":"2024-09-13T15:04:17.594985+0000","last_undegraded":"2024-09-13T15:04:17.594985+0000","last_fullsized":"2024-09-13T15:04:17.594985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:52.921485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748075+0000","last_change":"2024-09-13T15:01:48.912116+0000","last_active":"2024-09-13T15:02:33.748075+0000","last_peered":"2024-09-13T15:02:33.748075+0000","last_clean":"2024-09-13T15:02:33.748075+0000","last_became_active":"2024-09-13T15:01:48.911578+0000","last_became_peered":"2024-09-13T15:01:48.911578+0000","last_unstale":"2024-09-13T15:02:33.748075+0000","last_undegraded":"2024-09-13T15:02:33.748075+0000","last_fullsized":"2024-09-13T15:02:33.748075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:50.826715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738926+0000","last_change":"2024-09-13T15:01:44.838344+0000","last_active":"2024-09-13T15:02:33.738926+0000","last_peered":"2024-09-13T15:02:33.738926+0000","last_clean":"2024-09-13T15:02:33.738926+0000","last_became_active":"2024-09-13T15:01:44.838128+0000","last_became_peered":"2024-09-13T15:01:44.838128+0000","last_unstale":"2024-09-13T15:02:33.738926+0000","last_undegraded":"2024-09-13T15:02:33.738926+0000","last_fullsized":"2024-09-13T15:02:33.738926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:09:50.373976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742357+0000","last_change":"2024-09-13T15:01:44.430749+0000","last_active":"2024-09-13T15:02:33.742357+0000","last_peered":"2024-09-13T15:02:33.742357+0000","last_clean":"2024-09-13T15:02:33.742357+0000","last_became_active":"2024-09-13T15:01:44.430548+0000","last_became_peered":"2024-09-13T15:01:44.430548+0000","last_unstale":"2024-09-13T15:02:33.742357+0000","last_undegraded":"2024-09-13T15:02:33.742357+0000","last_fullsized":"2024-09-13T15:02:33.742357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:30.312447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737398+0000","last_change":"2024-09-13T15:01:48.911224+0000","last_active":"2024-09-13T15:02:33.737398+0000","last_peered":"2024-09-13T15:02:33.737398+0000","last_clean":"2024-09-13T15:02:33.737398+0000","last_became_active":"2024-09-13T15:01:48.910150+0000","last_became_peered":"2024-09-13T15:01:48.910150+0000","last_unstale":"2024-09-13T15:02:33.737398+0000","last_undegraded":"2024-09-13T15:02:33.737398+0000","last_fullsized":"2024-09-13T15:02:33.737398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:41.244267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743138+0000","last_change":"2024-09-13T15:01:44.812200+0000","last_active":"2024-09-13T15:02:33.743138+0000","last_peered":"2024-09-13T15:02:33.743138+0000","last_clean":"2024-09-13T15:02:33.743138+0000","last_became_active":"2024-09-13T15:01:44.811915+0000","last_became_peered":"2024-09-13T15:01:44.811915+0000","last_unstale":"2024-09-13T15:02:33.743138+0000","last_undegraded":"2024-09-13T15:02:33.743138+0000","last_fullsized":"2024-09-13T15:02:33.743138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:07.944520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'1","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:03:48.892402+0000","last_change":"2024-09-13T15:01:44.423119+0000","last_active":"2024-09-13T15:03:48.892402+0000","last_peered":"2024-09-13T15:03:48.892402+0000","last_clean":"2024-09-13T15:03:48.892402+0000","last_became_active":"2024-09-13T15:01:44.422297+0000","last_became_peered":"2024-09-13T15:01:44.422297+0000","last_unstale":"2024-09-13T15:03:48.892402+0000","last_undegraded":"2024-09-13T15:03:48.892402+0000","last_fullsized":"2024-09-13T15:03:48.892402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:09.798196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743841+0000","last_change":"2024-09-13T15:01:48.908569+0000","last_active":"2024-09-13T15:02:33.743841+0000","last_peered":"2024-09-13T15:02:33.743841+0000","last_clean":"2024-09-13T15:02:33.743841+0000","last_became_active":"2024-09-13T15:01:48.908118+0000","last_became_peered":"2024-09-13T15:01:48.908118+0000","last_unstale":"2024-09-13T15:02:33.743841+0000","last_undegraded":"2024-09-13T15:02:33.743841+0000","last_fullsized":"2024-09-13T15:02:33.743841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:06.459855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743852+0000","last_change":"2024-09-13T15:01:44.850837+0000","last_active":"2024-09-13T15:02:33.743852+0000","last_peered":"2024-09-13T15:02:33.743852+0000","last_clean":"2024-09-13T15:02:33.743852+0000","last_became_active":"2024-09-13T15:01:44.850263+0000","last_became_peered":"2024-09-13T15:01:44.850263+0000","last_unstale":"2024-09-13T15:02:33.743852+0000","last_undegraded":"2024-09-13T15:02:33.743852+0000","last_fullsized":"2024-09-13T15:02:33.743852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:16.956369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743192+0000","last_change":"2024-09-13T15:01:44.399163+0000","last_active":"2024-09-13T15:02:33.743192+0000","last_peered":"2024-09-13T15:02:33.743192+0000","last_clean":"2024-09-13T15:02:33.743192+0000","last_became_active":"2024-09-13T15:01:44.398881+0000","last_became_peered":"2024-09-13T15:01:44.398881+0000","last_unstale":"2024-09-13T15:02:33.743192+0000","last_undegraded":"2024-09-13T15:02:33.743192+0000","last_fullsized":"2024-09-13T15:02:33.743192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:49.622676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743584+0000","last_change":"2024-09-13T15:01:48.852798+0000","last_active":"2024-09-13T15:02:33.743584+0000","last_peered":"2024-09-13T15:02:33.743584+0000","last_clean":"2024-09-13T15:02:33.743584+0000","last_became_active":"2024-09-13T15:01:48.851948+0000","last_became_peered":"2024-09-13T15:01:48.851948+0000","last_unstale":"2024-09-13T15:02:33.743584+0000","last_undegraded":"2024-09-13T15:02:33.743584+0000","last_fullsized":"2024-09-13T15:02:33.743584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:20.061043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749414+0000","last_change":"2024-09-13T15:01:44.824074+0000","last_active":"2024-09-13T15:02:33.749414+0000","last_peered":"2024-09-13T15:02:33.749414+0000","last_clean":"2024-09-13T15:02:33.749414+0000","last_became_active":"2024-09-13T15:01:44.821475+0000","last_became_peered":"2024-09-13T15:01:44.821475+0000","last_unstale":"2024-09-13T15:02:33.749414+0000","last_undegraded":"2024-09-13T15:02:33.749414+0000","last_fullsized":"2024-09-13T15:02:33.749414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:21.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742662+0000","last_change":"2024-09-13T15:01:44.433502+0000","last_active":"2024-09-13T15:02:33.742662+0000","last_peered":"2024-09-13T15:02:33.742662+0000","last_clean":"2024-09-13T15:02:33.742662+0000","last_became_active":"2024-09-13T15:01:44.432902+0000","last_became_peered":"2024-09-13T15:01:44.432902+0000","last_unstale":"2024-09-13T15:02:33.742662+0000","last_undegraded":"2024-09-13T15:02:33.742662+0000","last_fullsized":"2024-09-13T15:02:33.742662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:59.189559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743046+0000","last_change":"2024-09-13T15:01:48.846695+0000","last_active":"2024-09-13T15:02:33.743046+0000","last_peered":"2024-09-13T15:02:33.743046+0000","last_clean":"2024-09-13T15:02:33.743046+0000","last_became_active":"2024-09-13T15:01:48.846301+0000","last_became_peered":"2024-09-13T15:01:48.846301+0000","last_unstale":"2024-09-13T15:02:33.743046+0000","last_undegraded":"2024-09-13T15:02:33.743046+0000","last_fullsized":"2024-09-13T15:02:33.743046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:17.532499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741535+0000","last_change":"2024-09-13T15:01:44.814483+0000","last_active":"2024-09-13T15:02:33.741535+0000","last_peered":"2024-09-13T15:02:33.741535+0000","last_clean":"2024-09-13T15:02:33.741535+0000","last_became_active":"2024-09-13T15:01:44.814192+0000","last_became_peered":"2024-09-13T15:01:44.814192+0000","last_unstale":"2024-09-13T15:02:33.741535+0000","last_undegraded":"2024-09-13T15:02:33.741535+0000","last_fullsized":"2024-09-13T15:02:33.741535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:32:30.303635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:03:48.878857+0000","last_change":"2024-09-13T15:01:44.399314+0000","last_active":"2024-09-13T15:03:48.878857+0000","last_peered":"2024-09-13T15:03:48.878857+0000","last_clean":"2024-09-13T15:03:48.878857+0000","last_became_active":"2024-09-13T15:01:44.398904+0000","last_became_peered":"2024-09-13T15:01:44.398904+0000","last_unstale":"2024-09-13T15:03:48.878857+0000","last_undegraded":"2024-09-13T15:03:48.878857+0000","last_fullsized":"2024-09-13T15:03:48.878857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.645179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741624+0000","last_change":"2024-09-13T15:01:48.859142+0000","last_active":"2024-09-13T15:02:33.741624+0000","last_peered":"2024-09-13T15:02:33.741624+0000","last_clean":"2024-09-13T15:02:33.741624+0000","last_became_active":"2024-09-13T15:01:48.858649+0000","last_became_peered":"2024-09-13T15:01:48.858649+0000","last_unstale":"2024-09-13T15:02:33.741624+0000","last_undegraded":"2024-09-13T15:02:33.741624+0000","last_fullsized":"2024-09-13T15:02:33.741624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:27.314012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743419+0000","last_change":"2024-09-13T15:01:44.826501+0000","last_active":"2024-09-13T15:02:33.743419+0000","last_peered":"2024-09-13T15:02:33.743419+0000","last_clean":"2024-09-13T15:02:33.743419+0000","last_became_active":"2024-09-13T15:01:44.826222+0000","last_became_peered":"2024-09-13T15:01:44.826222+0000","last_unstale":"2024-09-13T15:02:33.743419+0000","last_undegraded":"2024-09-13T15:02:33.743419+0000","last_fullsized":"2024-09-13T15:02:33.743419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:00.543916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'1","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:03:43.891043+0000","last_change":"2024-09-13T15:01:44.421891+0000","last_active":"2024-09-13T15:03:43.891043+0000","last_peered":"2024-09-13T15:03:43.891043+0000","last_clean":"2024-09-13T15:03:43.891043+0000","last_became_active":"2024-09-13T15:01:44.419660+0000","last_became_peered":"2024-09-13T15:01:44.419660+0000","last_unstale":"2024-09-13T15:03:43.891043+0000","last_undegraded":"2024-09-13T15:03:43.891043+0000","last_fullsized":"2024-09-13T15:03:43.891043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:27.554128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.120816+0000","last_change":"2024-09-13T15:02:34.119111+0000","last_active":"2024-09-13T15:02:34.120816+0000","last_peered":"2024-09-13T15:02:34.120816+0000","last_clean":"2024-09-13T15:02:34.120816+0000","last_became_active":"2024-09-13T15:02:34.118461+0000","last_became_peered":"2024-09-13T15:02:34.118461+0000","last_unstale":"2024-09-13T15:02:34.120816+0000","last_undegraded":"2024-09-13T15:02:34.120816+0000","last_fullsized":"2024-09-13T15:02:34.120816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:35.096846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738701+0000","last_change":"2024-09-13T15:01:44.850498+0000","last_active":"2024-09-13T15:02:33.738701+0000","last_peered":"2024-09-13T15:02:33.738701+0000","last_clean":"2024-09-13T15:02:33.738701+0000","last_became_active":"2024-09-13T15:01:44.850234+0000","last_became_peered":"2024-09-13T15:01:44.850234+0000","last_unstale":"2024-09-13T15:02:33.738701+0000","last_undegraded":"2024-09-13T15:02:33.738701+0000","last_fullsized":"2024-09-13T15:02:33.738701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:37.202494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.599901+0000","last_change":"2024-09-13T15:01:44.411997+0000","last_active":"2024-09-13T15:04:17.599901+0000","last_peered":"2024-09-13T15:04:17.599901+0000","last_clean":"2024-09-13T15:04:17.599901+0000","last_became_active":"2024-09-13T15:01:44.410675+0000","last_became_peered":"2024-09-13T15:01:44.410675+0000","last_unstale":"2024-09-13T15:04:17.599901+0000","last_undegraded":"2024-09-13T15:04:17.599901+0000","last_fullsized":"2024-09-13T15:04:17.599901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:50:55.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116345+0000","last_change":"2024-09-13T15:01:40.834440+0000","last_active":"2024-09-13T15:02:34.116345+0000","last_peered":"2024-09-13T15:02:34.116345+0000","last_clean":"2024-09-13T15:02:34.116345+0000","last_became_active":"2024-09-13T15:01:40.832279+0000","last_became_peered":"2024-09-13T15:01:40.832279+0000","last_unstale":"2024-09-13T15:02:34.116345+0000","last_undegraded":"2024-09-13T15:02:34.116345+0000","last_fullsized":"2024-09-13T15:02:34.116345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_clean_scrub_stamp":"2024-09-13T15:01:39.264455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:11.875506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743545+0000","last_change":"2024-09-13T15:01:48.919580+0000","last_active":"2024-09-13T15:02:33.743545+0000","last_peered":"2024-09-13T15:02:33.743545+0000","last_clean":"2024-09-13T15:02:33.743545+0000","last_became_active":"2024-09-13T15:01:48.918678+0000","last_became_peered":"2024-09-13T15:01:48.918678+0000","last_unstale":"2024-09-13T15:02:33.743545+0000","last_undegraded":"2024-09-13T15:02:33.743545+0000","last_fullsized":"2024-09-13T15:02:33.743545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:02.840528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116879+0000","last_change":"2024-09-13T15:01:44.849975+0000","last_active":"2024-09-13T15:02:34.116879+0000","last_peered":"2024-09-13T15:02:34.116879+0000","last_clean":"2024-09-13T15:02:34.116879+0000","last_became_active":"2024-09-13T15:01:44.849457+0000","last_became_peered":"2024-09-13T15:01:44.849457+0000","last_unstale":"2024-09-13T15:02:34.116879+0000","last_undegraded":"2024-09-13T15:02:34.116879+0000","last_fullsized":"2024-09-13T15:02:34.116879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:51.139153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742016+0000","last_change":"2024-09-13T15:01:44.420906+0000","last_active":"2024-09-13T15:02:33.742016+0000","last_peered":"2024-09-13T15:02:33.742016+0000","last_clean":"2024-09-13T15:02:33.742016+0000","last_became_active":"2024-09-13T15:01:44.420601+0000","last_became_peered":"2024-09-13T15:01:44.420601+0000","last_unstale":"2024-09-13T15:02:33.742016+0000","last_undegraded":"2024-09-13T15:02:33.742016+0000","last_fullsized":"2024-09-13T15:02:33.742016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:33.245745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741847+0000","last_change":"2024-09-13T15:01:48.911047+0000","last_active":"2024-09-13T15:02:33.741847+0000","last_peered":"2024-09-13T15:02:33.741847+0000","last_clean":"2024-09-13T15:02:33.741847+0000","last_became_active":"2024-09-13T15:01:48.910479+0000","last_became_peered":"2024-09-13T15:01:48.910479+0000","last_unstale":"2024-09-13T15:02:33.741847+0000","last_undegraded":"2024-09-13T15:02:33.741847+0000","last_fullsized":"2024-09-13T15:02:33.741847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:06.558889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745346+0000","last_change":"2024-09-13T15:01:44.838098+0000","last_active":"2024-09-13T15:02:33.745346+0000","last_peered":"2024-09-13T15:02:33.745346+0000","last_clean":"2024-09-13T15:02:33.745346+0000","last_became_active":"2024-09-13T15:01:44.837429+0000","last_became_peered":"2024-09-13T15:01:44.837429+0000","last_unstale":"2024-09-13T15:02:33.745346+0000","last_undegraded":"2024-09-13T15:02:33.745346+0000","last_fullsized":"2024-09-13T15:02:33.745346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:37.795841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742419+0000","last_change":"2024-09-13T15:01:44.406999+0000","last_active":"2024-09-13T15:02:33.742419+0000","last_peered":"2024-09-13T15:02:33.742419+0000","last_clean":"2024-09-13T15:02:33.742419+0000","last_became_active":"2024-09-13T15:01:44.406719+0000","last_became_peered":"2024-09-13T15:01:44.406719+0000","last_unstale":"2024-09-13T15:02:33.742419+0000","last_undegraded":"2024-09-13T15:02:33.742419+0000","last_fullsized":"2024-09-13T15:02:33.742419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:33.397091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743939+0000","last_change":"2024-09-13T15:01:48.857931+0000","last_active":"2024-09-13T15:02:33.743939+0000","last_peered":"2024-09-13T15:02:33.743939+0000","last_clean":"2024-09-13T15:02:33.743939+0000","last_became_active":"2024-09-13T15:01:48.857542+0000","last_became_peered":"2024-09-13T15:01:48.857542+0000","last_unstale":"2024-09-13T15:02:33.743939+0000","last_undegraded":"2024-09-13T15:02:33.743939+0000","last_fullsized":"2024-09-13T15:02:33.743939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:32.805405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118403+0000","last_change":"2024-09-13T15:01:44.835470+0000","last_active":"2024-09-13T15:02:34.118403+0000","last_peered":"2024-09-13T15:02:34.118403+0000","last_clean":"2024-09-13T15:02:34.118403+0000","last_became_active":"2024-09-13T15:01:44.831166+0000","last_became_peered":"2024-09-13T15:01:44.831166+0000","last_unstale":"2024-09-13T15:02:34.118403+0000","last_undegraded":"2024-09-13T15:02:34.118403+0000","last_fullsized":"2024-09-13T15:02:34.118403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:05.887592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742413+0000","last_change":"2024-09-13T15:01:44.403111+0000","last_active":"2024-09-13T15:02:33.742413+0000","last_peered":"2024-09-13T15:02:33.742413+0000","last_clean":"2024-09-13T15:02:33.742413+0000","last_became_active":"2024-09-13T15:01:44.401799+0000","last_became_peered":"2024-09-13T15:01:44.401799+0000","last_unstale":"2024-09-13T15:02:33.742413+0000","last_undegraded":"2024-09-13T15:02:33.742413+0000","last_fullsized":"2024-09-13T15:02:33.742413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:54.589470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740292+0000","last_change":"2024-09-13T15:01:48.912490+0000","last_active":"2024-09-13T15:02:33.740292+0000","last_peered":"2024-09-13T15:02:33.740292+0000","last_clean":"2024-09-13T15:02:33.740292+0000","last_became_active":"2024-09-13T15:01:48.911474+0000","last_became_peered":"2024-09-13T15:01:48.911474+0000","last_unstale":"2024-09-13T15:02:33.740292+0000","last_undegraded":"2024-09-13T15:02:33.740292+0000","last_fullsized":"2024-09-13T15:02:33.740292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:54.295921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117960+0000","last_change":"2024-09-13T15:01:44.818472+0000","last_active":"2024-09-13T15:02:34.117960+0000","last_peered":"2024-09-13T15:02:34.117960+0000","last_clean":"2024-09-13T15:02:34.117960+0000","last_became_active":"2024-09-13T15:01:44.817718+0000","last_became_peered":"2024-09-13T15:01:44.817718+0000","last_unstale":"2024-09-13T15:02:34.117960+0000","last_undegraded":"2024-09-13T15:02:34.117960+0000","last_fullsized":"2024-09-13T15:02:34.117960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:21.310696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.750292+0000","last_change":"2024-09-13T15:01:44.410376+0000","last_active":"2024-09-13T15:02:33.750292+0000","last_peered":"2024-09-13T15:02:33.750292+0000","last_clean":"2024-09-13T15:02:33.750292+0000","last_became_active":"2024-09-13T15:01:44.409585+0000","last_became_peered":"2024-09-13T15:01:44.409585+0000","last_unstale":"2024-09-13T15:02:33.750292+0000","last_undegraded":"2024-09-13T15:02:33.750292+0000","last_fullsized":"2024-09-13T15:02:33.750292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:45.845804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.747358+0000","last_change":"2024-09-13T15:01:48.861130+0000","last_active":"2024-09-13T15:02:33.747358+0000","last_peered":"2024-09-13T15:02:33.747358+0000","last_clean":"2024-09-13T15:02:33.747358+0000","last_became_active":"2024-09-13T15:01:48.860317+0000","last_became_peered":"2024-09-13T15:01:48.860317+0000","last_unstale":"2024-09-13T15:02:33.747358+0000","last_undegraded":"2024-09-13T15:02:33.747358+0000","last_fullsized":"2024-09-13T15:02:33.747358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:45.317747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116786+0000","last_change":"2024-09-13T15:01:44.835494+0000","last_active":"2024-09-13T15:02:34.116786+0000","last_peered":"2024-09-13T15:02:34.116786+0000","last_clean":"2024-09-13T15:02:34.116786+0000","last_became_active":"2024-09-13T15:01:44.831150+0000","last_became_peered":"2024-09-13T15:01:44.831150+0000","last_unstale":"2024-09-13T15:02:34.116786+0000","last_undegraded":"2024-09-13T15:02:34.116786+0000","last_fullsized":"2024-09-13T15:02:34.116786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:29.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'10","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.607551+0000","last_change":"2024-09-13T15:01:44.390278+0000","last_active":"2024-09-13T15:04:17.607551+0000","last_peered":"2024-09-13T15:04:17.607551+0000","last_clean":"2024-09-13T15:04:17.607551+0000","last_became_active":"2024-09-13T15:01:44.389946+0000","last_became_peered":"2024-09-13T15:01:44.389946+0000","last_unstale":"2024-09-13T15:04:17.607551+0000","last_undegraded":"2024-09-13T15:04:17.607551+0000","last_fullsized":"2024-09-13T15:04:17.607551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:53.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744367+0000","last_change":"2024-09-13T15:01:48.848009+0000","last_active":"2024-09-13T15:02:33.744367+0000","last_peered":"2024-09-13T15:02:33.744367+0000","last_clean":"2024-09-13T15:02:33.744367+0000","last_became_active":"2024-09-13T15:01:48.847605+0000","last_became_peered":"2024-09-13T15:01:48.847605+0000","last_unstale":"2024-09-13T15:02:33.744367+0000","last_undegraded":"2024-09-13T15:02:33.744367+0000","last_fullsized":"2024-09-13T15:02:33.744367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:32.053010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741353+0000","last_change":"2024-09-13T15:01:44.808572+0000","last_active":"2024-09-13T15:02:33.741353+0000","last_peered":"2024-09-13T15:02:33.741353+0000","last_clean":"2024-09-13T15:02:33.741353+0000","last_became_active":"2024-09-13T15:01:44.808140+0000","last_became_peered":"2024-09-13T15:01:44.808140+0000","last_unstale":"2024-09-13T15:02:33.741353+0000","last_undegraded":"2024-09-13T15:02:33.741353+0000","last_fullsized":"2024-09-13T15:02:33.741353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:15.497720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742109+0000","last_change":"2024-09-13T15:01:44.428794+0000","last_active":"2024-09-13T15:02:33.742109+0000","last_peered":"2024-09-13T15:02:33.742109+0000","last_clean":"2024-09-13T15:02:33.742109+0000","last_became_active":"2024-09-13T15:01:44.428271+0000","last_became_peered":"2024-09-13T15:01:44.428271+0000","last_unstale":"2024-09-13T15:02:33.742109+0000","last_undegraded":"2024-09-13T15:02:33.742109+0000","last_fullsized":"2024-09-13T15:02:33.742109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:53.225826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738469+0000","last_change":"2024-09-13T15:01:48.916354+0000","last_active":"2024-09-13T15:02:33.738469+0000","last_peered":"2024-09-13T15:02:33.738469+0000","last_clean":"2024-09-13T15:02:33.738469+0000","last_became_active":"2024-09-13T15:01:48.916008+0000","last_became_peered":"2024-09-13T15:01:48.916008+0000","last_unstale":"2024-09-13T15:02:33.738469+0000","last_undegraded":"2024-09-13T15:02:33.738469+0000","last_fullsized":"2024-09-13T15:02:33.738469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:58.115410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116589+0000","last_change":"2024-09-13T15:01:44.826700+0000","last_active":"2024-09-13T15:02:34.116589+0000","last_peered":"2024-09-13T15:02:34.116589+0000","last_clean":"2024-09-13T15:02:34.116589+0000","last_became_active":"2024-09-13T15:01:44.825996+0000","last_became_peered":"2024-09-13T15:01:44.825996+0000","last_unstale":"2024-09-13T15:02:34.116589+0000","last_undegraded":"2024-09-13T15:02:34.116589+0000","last_fullsized":"2024-09-13T15:02:34.116589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:11.963837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.604521+0000","last_change":"2024-09-13T15:01:44.409339+0000","last_active":"2024-09-13T15:04:17.604521+0000","last_peered":"2024-09-13T15:04:17.604521+0000","last_clean":"2024-09-13T15:04:17.604521+0000","last_became_active":"2024-09-13T15:01:44.408644+0000","last_became_peered":"2024-09-13T15:01:44.408644+0000","last_unstale":"2024-09-13T15:04:17.604521+0000","last_undegraded":"2024-09-13T15:04:17.604521+0000","last_fullsized":"2024-09-13T15:04:17.604521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:29.297950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737959+0000","last_change":"2024-09-13T15:01:48.916478+0000","last_active":"2024-09-13T15:02:33.737959+0000","last_peered":"2024-09-13T15:02:33.737959+0000","last_clean":"2024-09-13T15:02:33.737959+0000","last_became_active":"2024-09-13T15:01:48.916198+0000","last_became_peered":"2024-09-13T15:01:48.916198+0000","last_unstale":"2024-09-13T15:02:33.737959+0000","last_undegraded":"2024-09-13T15:02:33.737959+0000","last_fullsized":"2024-09-13T15:02:33.737959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:26.311460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743617+0000","last_change":"2024-09-13T15:01:44.831833+0000","last_active":"2024-09-13T15:02:33.743617+0000","last_peered":"2024-09-13T15:02:33.743617+0000","last_clean":"2024-09-13T15:02:33.743617+0000","last_became_active":"2024-09-13T15:01:44.831583+0000","last_became_peered":"2024-09-13T15:01:44.831583+0000","last_unstale":"2024-09-13T15:02:33.743617+0000","last_undegraded":"2024-09-13T15:02:33.743617+0000","last_fullsized":"2024-09-13T15:02:33.743617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.715951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.603434+0000","last_change":"2024-09-13T15:01:44.408752+0000","last_active":"2024-09-13T15:04:17.603434+0000","last_peered":"2024-09-13T15:04:17.603434+0000","last_clean":"2024-09-13T15:04:17.603434+0000","last_became_active":"2024-09-13T15:01:44.408453+0000","last_became_peered":"2024-09-13T15:01:44.408453+0000","last_unstale":"2024-09-13T15:04:17.603434+0000","last_undegraded":"2024-09-13T15:04:17.603434+0000","last_fullsized":"2024-09-13T15:04:17.603434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:31.587404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743419+0000","last_change":"2024-09-13T15:01:48.916681+0000","last_active":"2024-09-13T15:02:33.743419+0000","last_peered":"2024-09-13T15:02:33.743419+0000","last_clean":"2024-09-13T15:02:33.743419+0000","last_became_active":"2024-09-13T15:01:48.916185+0000","last_became_peered":"2024-09-13T15:01:48.916185+0000","last_unstale":"2024-09-13T15:02:33.743419+0000","last_undegraded":"2024-09-13T15:02:33.743419+0000","last_fullsized":"2024-09-13T15:02:33.743419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:33.862835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116757+0000","last_change":"2024-09-13T15:01:44.817007+0000","last_active":"2024-09-13T15:02:34.116757+0000","last_peered":"2024-09-13T15:02:34.116757+0000","last_clean":"2024-09-13T15:02:34.116757+0000","last_became_active":"2024-09-13T15:01:44.815435+0000","last_became_peered":"2024-09-13T15:01:44.815435+0000","last_unstale":"2024-09-13T15:02:34.116757+0000","last_undegraded":"2024-09-13T15:02:34.116757+0000","last_fullsized":"2024-09-13T15:02:34.116757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:25.887993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'12","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.598910+0000","last_change":"2024-09-13T15:01:44.435688+0000","last_active":"2024-09-13T15:04:17.598910+0000","last_peered":"2024-09-13T15:04:17.598910+0000","last_clean":"2024-09-13T15:04:17.598910+0000","last_became_active":"2024-09-13T15:01:44.435222+0000","last_became_peered":"2024-09-13T15:01:44.435222+0000","last_unstale":"2024-09-13T15:04:17.598910+0000","last_undegraded":"2024-09-13T15:04:17.598910+0000","last_fullsized":"2024-09-13T15:04:17.598910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:24.705633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742810+0000","last_change":"2024-09-13T15:01:48.847694+0000","last_active":"2024-09-13T15:02:33.742810+0000","last_peered":"2024-09-13T15:02:33.742810+0000","last_clean":"2024-09-13T15:02:33.742810+0000","last_became_active":"2024-09-13T15:01:48.846835+0000","last_became_peered":"2024-09-13T15:01:48.846835+0000","last_unstale":"2024-09-13T15:02:33.742810+0000","last_undegraded":"2024-09-13T15:02:33.742810+0000","last_fullsized":"2024-09-13T15:02:33.742810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:49.763472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749658+0000","last_change":"2024-09-13T15:01:44.835315+0000","last_active":"2024-09-13T15:02:33.749658+0000","last_peered":"2024-09-13T15:02:33.749658+0000","last_clean":"2024-09-13T15:02:33.749658+0000","last_became_active":"2024-09-13T15:01:44.834643+0000","last_became_peered":"2024-09-13T15:01:44.834643+0000","last_unstale":"2024-09-13T15:02:33.749658+0000","last_undegraded":"2024-09-13T15:02:33.749658+0000","last_fullsized":"2024-09-13T15:02:33.749658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:15.535195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:08.884570+0000","last_change":"2024-09-13T15:01:44.424966+0000","last_active":"2024-09-13T15:04:08.884570+0000","last_peered":"2024-09-13T15:04:08.884570+0000","last_clean":"2024-09-13T15:04:08.884570+0000","last_became_active":"2024-09-13T15:01:44.424714+0000","last_became_peered":"2024-09-13T15:01:44.424714+0000","last_unstale":"2024-09-13T15:04:08.884570+0000","last_undegraded":"2024-09-13T15:04:08.884570+0000","last_fullsized":"2024-09-13T15:04:08.884570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:46.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.756425+0000","last_change":"2024-09-13T15:02:33.753482+0000","last_active":"2024-09-13T15:02:33.756425+0000","last_peered":"2024-09-13T15:02:33.756425+0000","last_clean":"2024-09-13T15:02:33.756425+0000","last_became_active":"2024-09-13T15:02:33.752505+0000","last_became_peered":"2024-09-13T15:02:33.752505+0000","last_unstale":"2024-09-13T15:02:33.756425+0000","last_undegraded":"2024-09-13T15:02:33.756425+0000","last_fullsized":"2024-09-13T15:02:33.756425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:59.041586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742572+0000","last_change":"2024-09-13T15:01:44.837032+0000","last_active":"2024-09-13T15:02:33.742572+0000","last_peered":"2024-09-13T15:02:33.742572+0000","last_clean":"2024-09-13T15:02:33.742572+0000","last_became_active":"2024-09-13T15:01:44.836750+0000","last_became_peered":"2024-09-13T15:01:44.836750+0000","last_unstale":"2024-09-13T15:02:33.742572+0000","last_undegraded":"2024-09-13T15:02:33.742572+0000","last_fullsized":"2024-09-13T15:02:33.742572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:04.491426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.594750+0000","last_change":"2024-09-13T15:01:44.437854+0000","last_active":"2024-09-13T15:04:17.594750+0000","last_peered":"2024-09-13T15:04:17.594750+0000","last_clean":"2024-09-13T15:04:17.594750+0000","last_became_active":"2024-09-13T15:01:44.437433+0000","last_became_peered":"2024-09-13T15:01:44.437433+0000","last_unstale":"2024-09-13T15:04:17.594750+0000","last_undegraded":"2024-09-13T15:04:17.594750+0000","last_fullsized":"2024-09-13T15:04:17.594750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:47.302388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737553+0000","last_change":"2024-09-13T15:01:48.841829+0000","last_active":"2024-09-13T15:02:33.737553+0000","last_peered":"2024-09-13T15:02:33.737553+0000","last_clean":"2024-09-13T15:02:33.737553+0000","last_became_active":"2024-09-13T15:01:48.841267+0000","last_became_peered":"2024-09-13T15:01:48.841267+0000","last_unstale":"2024-09-13T15:02:33.737553+0000","last_undegraded":"2024-09-13T15:02:33.737553+0000","last_fullsized":"2024-09-13T15:02:33.737553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:25.029615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.746815+0000","last_change":"2024-09-13T15:01:44.844701+0000","last_active":"2024-09-13T15:02:33.746815+0000","last_peered":"2024-09-13T15:02:33.746815+0000","last_clean":"2024-09-13T15:02:33.746815+0000","last_became_active":"2024-09-13T15:01:44.843982+0000","last_became_peered":"2024-09-13T15:01:44.843982+0000","last_unstale":"2024-09-13T15:02:33.746815+0000","last_undegraded":"2024-09-13T15:02:33.746815+0000","last_fullsized":"2024-09-13T15:02:33.746815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.601800+0000","last_change":"2024-09-13T15:01:44.436081+0000","last_active":"2024-09-13T15:04:17.601800+0000","last_peered":"2024-09-13T15:04:17.601800+0000","last_clean":"2024-09-13T15:04:17.601800+0000","last_became_active":"2024-09-13T15:01:44.435367+0000","last_became_peered":"2024-09-13T15:01:44.435367+0000","last_unstale":"2024-09-13T15:04:17.601800+0000","last_undegraded":"2024-09-13T15:04:17.601800+0000","last_fullsized":"2024-09-13T15:04:17.601800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:57:57.065719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737590+0000","last_change":"2024-09-13T15:01:48.910562+0000","last_active":"2024-09-13T15:02:33.737590+0000","last_peered":"2024-09-13T15:02:33.737590+0000","last_clean":"2024-09-13T15:02:33.737590+0000","last_became_active":"2024-09-13T15:01:48.909681+0000","last_became_peered":"2024-09-13T15:01:48.909681+0000","last_unstale":"2024-09-13T15:02:33.737590+0000","last_undegraded":"2024-09-13T15:02:33.737590+0000","last_fullsized":"2024-09-13T15:02:33.737590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:35.989769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.120759+0000","last_change":"2024-09-13T15:02:34.118951+0000","last_active":"2024-09-13T15:02:34.120759+0000","last_peered":"2024-09-13T15:02:34.120759+0000","last_clean":"2024-09-13T15:02:34.120759+0000","last_became_active":"2024-09-13T15:02:34.118477+0000","last_became_peered":"2024-09-13T15:02:34.118477+0000","last_unstale":"2024-09-13T15:02:34.120759+0000","last_undegraded":"2024-09-13T15:02:34.120759+0000","last_fullsized":"2024-09-13T15:02:34.120759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:13.697114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741807+0000","last_change":"2024-09-13T15:01:44.808417+0000","last_active":"2024-09-13T15:02:33.741807+0000","last_peered":"2024-09-13T15:02:33.741807+0000","last_clean":"2024-09-13T15:02:33.741807+0000","last_became_active":"2024-09-13T15:01:44.807641+0000","last_became_peered":"2024-09-13T15:01:44.807641+0000","last_unstale":"2024-09-13T15:02:33.741807+0000","last_undegraded":"2024-09-13T15:02:33.741807+0000","last_fullsized":"2024-09-13T15:02:33.741807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:58.296966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:08.897338+0000","last_change":"2024-09-13T15:01:44.433582+0000","last_active":"2024-09-13T15:04:08.897338+0000","last_peered":"2024-09-13T15:04:08.897338+0000","last_clean":"2024-09-13T15:04:08.897338+0000","last_became_active":"2024-09-13T15:01:44.433124+0000","last_became_peered":"2024-09-13T15:01:44.433124+0000","last_unstale":"2024-09-13T15:04:08.897338+0000","last_undegraded":"2024-09-13T15:04:08.897338+0000","last_fullsized":"2024-09-13T15:04:08.897338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:04.476996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744178+0000","last_change":"2024-09-13T15:01:48.855090+0000","last_active":"2024-09-13T15:02:33.744178+0000","last_peered":"2024-09-13T15:02:33.744178+0000","last_clean":"2024-09-13T15:02:33.744178+0000","last_became_active":"2024-09-13T15:01:48.852925+0000","last_became_peered":"2024-09-13T15:01:48.852925+0000","last_unstale":"2024-09-13T15:02:33.744178+0000","last_undegraded":"2024-09-13T15:02:33.744178+0000","last_fullsized":"2024-09-13T15:02:33.744178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.176480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748607+0000","last_change":"2024-09-13T15:02:33.746356+0000","last_active":"2024-09-13T15:02:33.748607+0000","last_peered":"2024-09-13T15:02:33.748607+0000","last_clean":"2024-09-13T15:02:33.748607+0000","last_became_active":"2024-09-13T15:02:33.746005+0000","last_became_peered":"2024-09-13T15:02:33.746005+0000","last_unstale":"2024-09-13T15:02:33.748607+0000","last_undegraded":"2024-09-13T15:02:33.748607+0000","last_fullsized":"2024-09-13T15:02:33.748607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:41.159781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737817+0000","last_change":"2024-09-13T15:01:44.436900+0000","last_active":"2024-09-13T15:02:33.737817+0000","last_peered":"2024-09-13T15:02:33.737817+0000","last_clean":"2024-09-13T15:02:33.737817+0000","last_became_active":"2024-09-13T15:01:44.436646+0000","last_became_peered":"2024-09-13T15:01:44.436646+0000","last_unstale":"2024-09-13T15:02:33.737817+0000","last_undegraded":"2024-09-13T15:02:33.737817+0000","last_fullsized":"2024-09-13T15:02:33.737817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:52.505856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742710+0000","last_change":"2024-09-13T15:01:44.430115+0000","last_active":"2024-09-13T15:02:33.742710+0000","last_peered":"2024-09-13T15:02:33.742710+0000","last_clean":"2024-09-13T15:02:33.742710+0000","last_became_active":"2024-09-13T15:01:44.429339+0000","last_became_peered":"2024-09-13T15:01:44.429339+0000","last_unstale":"2024-09-13T15:02:33.742710+0000","last_undegraded":"2024-09-13T15:02:33.742710+0000","last_fullsized":"2024-09-13T15:02:33.742710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:47.224125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744095+0000","last_change":"2024-09-13T15:01:44.822034+0000","last_active":"2024-09-13T15:02:33.744095+0000","last_peered":"2024-09-13T15:02:33.744095+0000","last_clean":"2024-09-13T15:02:33.744095+0000","last_became_active":"2024-09-13T15:01:44.821734+0000","last_became_peered":"2024-09-13T15:01:44.821734+0000","last_unstale":"2024-09-13T15:02:33.744095+0000","last_undegraded":"2024-09-13T15:02:33.744095+0000","last_fullsized":"2024-09-13T15:02:33.744095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:57:44.629046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741811+0000","last_change":"2024-09-13T15:01:48.858033+0000","last_active":"2024-09-13T15:02:33.741811+0000","last_peered":"2024-09-13T15:02:33.741811+0000","last_clean":"2024-09-13T15:02:33.741811+0000","last_became_active":"2024-09-13T15:01:48.857584+0000","last_became_peered":"2024-09-13T15:01:48.857584+0000","last_unstale":"2024-09-13T15:02:33.741811+0000","last_undegraded":"2024-09-13T15:02:33.741811+0000","last_fullsized":"2024-09-13T15:02:33.741811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:04.797167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'5","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.610821+0000","last_change":"2024-09-13T15:01:44.422582+0000","last_active":"2024-09-13T15:04:17.610821+0000","last_peered":"2024-09-13T15:04:17.610821+0000","last_clean":"2024-09-13T15:04:17.610821+0000","last_became_active":"2024-09-13T15:01:44.422367+0000","last_became_peered":"2024-09-13T15:01:44.422367+0000","last_unstale":"2024-09-13T15:04:17.610821+0000","last_undegraded":"2024-09-13T15:04:17.610821+0000","last_fullsized":"2024-09-13T15:04:17.610821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.902724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748800+0000","last_change":"2024-09-13T15:01:44.820841+0000","last_active":"2024-09-13T15:02:33.748800+0000","last_peered":"2024-09-13T15:02:33.748800+0000","last_clean":"2024-09-13T15:02:33.748800+0000","last_became_active":"2024-09-13T15:01:44.816584+0000","last_became_peered":"2024-09-13T15:01:44.816584+0000","last_unstale":"2024-09-13T15:02:33.748800+0000","last_undegraded":"2024-09-13T15:02:33.748800+0000","last_fullsized":"2024-09-13T15:02:33.748800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:26.763818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.737009+0000","last_change":"2024-09-13T15:01:48.840771+0000","last_active":"2024-09-13T15:02:32.737009+0000","last_peered":"2024-09-13T15:02:32.737009+0000","last_clean":"2024-09-13T15:02:32.737009+0000","last_became_active":"2024-09-13T15:01:48.840397+0000","last_became_peered":"2024-09-13T15:01:48.840397+0000","last_unstale":"2024-09-13T15:02:32.737009+0000","last_undegraded":"2024-09-13T15:02:32.737009+0000","last_fullsized":"2024-09-13T15:02:32.737009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:59.700088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741113+0000","last_change":"2024-09-13T15:01:44.809497+0000","last_active":"2024-09-13T15:02:33.741113+0000","last_peered":"2024-09-13T15:02:33.741113+0000","last_clean":"2024-09-13T15:02:33.741113+0000","last_became_active":"2024-09-13T15:01:44.808669+0000","last_became_peered":"2024-09-13T15:01:44.808669+0000","last_unstale":"2024-09-13T15:02:33.741113+0000","last_undegraded":"2024-09-13T15:02:33.741113+0000","last_fullsized":"2024-09-13T15:02:33.741113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:45.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744117+0000","last_change":"2024-09-13T15:01:44.836353+0000","last_active":"2024-09-13T15:02:33.744117+0000","last_peered":"2024-09-13T15:02:33.744117+0000","last_clean":"2024-09-13T15:02:33.744117+0000","last_became_active":"2024-09-13T15:01:44.836102+0000","last_became_peered":"2024-09-13T15:01:44.836102+0000","last_unstale":"2024-09-13T15:02:33.744117+0000","last_undegraded":"2024-09-13T15:02:33.744117+0000","last_fullsized":"2024-09-13T15:02:33.744117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:14.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741973+0000","last_change":"2024-09-13T15:01:44.849091+0000","last_active":"2024-09-13T15:02:33.741973+0000","last_peered":"2024-09-13T15:02:33.741973+0000","last_clean":"2024-09-13T15:02:33.741973+0000","last_became_active":"2024-09-13T15:01:44.846506+0000","last_became_peered":"2024-09-13T15:01:44.846506+0000","last_unstale":"2024-09-13T15:02:33.741973+0000","last_undegraded":"2024-09-13T15:02:33.741973+0000","last_fullsized":"2024-09-13T15:02:33.741973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:38.026998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743939+0000","last_change":"2024-09-13T15:01:44.809873+0000","last_active":"2024-09-13T15:02:33.743939+0000","last_peered":"2024-09-13T15:02:33.743939+0000","last_clean":"2024-09-13T15:02:33.743939+0000","last_became_active":"2024-09-13T15:01:44.809585+0000","last_became_peered":"2024-09-13T15:01:44.809585+0000","last_unstale":"2024-09-13T15:02:33.743939+0000","last_undegraded":"2024-09-13T15:02:33.743939+0000","last_fullsized":"2024-09-13T15:02:33.743939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:20.272320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738378+0000","last_change":"2024-09-13T15:01:44.816761+0000","last_active":"2024-09-13T15:02:33.738378+0000","last_peered":"2024-09-13T15:02:33.738378+0000","last_clean":"2024-09-13T15:02:33.738378+0000","last_became_active":"2024-09-13T15:01:44.816480+0000","last_became_peered":"2024-09-13T15:01:44.816480+0000","last_unstale":"2024-09-13T15:02:33.738378+0000","last_undegraded":"2024-09-13T15:02:33.738378+0000","last_fullsized":"2024-09-13T15:02:33.738378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:46.000440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742115+0000","last_change":"2024-09-13T15:01:44.808373+0000","last_active":"2024-09-13T15:02:33.742115+0000","last_peered":"2024-09-13T15:02:33.742115+0000","last_clean":"2024-09-13T15:02:33.742115+0000","last_became_active":"2024-09-13T15:01:44.807622+0000","last_became_peered":"2024-09-13T15:01:44.807622+0000","last_unstale":"2024-09-13T15:02:33.742115+0000","last_undegraded":"2024-09-13T15:02:33.742115+0000","last_fullsized":"2024-09-13T15:02:33.742115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:38.584426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745064+0000","last_change":"2024-09-13T15:01:44.832521+0000","last_active":"2024-09-13T15:02:33.745064+0000","last_peered":"2024-09-13T15:02:33.745064+0000","last_clean":"2024-09-13T15:02:33.745064+0000","last_became_active":"2024-09-13T15:01:44.831889+0000","last_became_peered":"2024-09-13T15:01:44.831889+0000","last_unstale":"2024-09-13T15:02:33.745064+0000","last_undegraded":"2024-09-13T15:02:33.745064+0000","last_fullsized":"2024-09-13T15:02:33.745064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:07.563684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738576+0000","last_change":"2024-09-13T15:01:44.817583+0000","last_active":"2024-09-13T15:02:33.738576+0000","last_peered":"2024-09-13T15:02:33.738576+0000","last_clean":"2024-09-13T15:02:33.738576+0000","last_became_active":"2024-09-13T15:01:44.817350+0000","last_became_peered":"2024-09-13T15:01:44.817350+0000","last_unstale":"2024-09-13T15:02:33.738576+0000","last_undegraded":"2024-09-13T15:02:33.738576+0000","last_fullsized":"2024-09-13T15:02:33.738576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:10.913776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740529+0000","last_change":"2024-09-13T15:01:44.838372+0000","last_active":"2024-09-13T15:02:33.740529+0000","last_peered":"2024-09-13T15:02:33.740529+0000","last_clean":"2024-09-13T15:02:33.740529+0000","last_became_active":"2024-09-13T15:01:44.837588+0000","last_became_peered":"2024-09-13T15:01:44.837588+0000","last_unstale":"2024-09-13T15:02:33.740529+0000","last_undegraded":"2024-09-13T15:02:33.740529+0000","last_fullsized":"2024-09-13T15:02:33.740529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:05:12.877936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737718+0000","last_change":"2024-09-13T15:01:44.828159+0000","last_active":"2024-09-13T15:02:33.737718+0000","last_peered":"2024-09-13T15:02:33.737718+0000","last_clean":"2024-09-13T15:02:33.737718+0000","last_became_active":"2024-09-13T15:01:44.827910+0000","last_became_peered":"2024-09-13T15:01:44.827910+0000","last_unstale":"2024-09-13T15:02:33.737718+0000","last_undegraded":"2024-09-13T15:02:33.737718+0000","last_fullsized":"2024-09-13T15:02:33.737718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:07:32.776119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.119204+0000","last_change":"2024-09-13T15:02:34.119204+0000","last_active":"2024-09-13T15:02:34.119204+0000","last_peered":"2024-09-13T15:02:34.119204+0000","last_clean":"2024-09-13T15:02:34.119204+0000","last_became_active":"2024-09-13T15:02:34.118621+0000","last_became_peered":"2024-09-13T15:02:34.118621+0000","last_unstale":"2024-09-13T15:02:34.119204+0000","last_undegraded":"2024-09-13T15:02:34.119204+0000","last_fullsized":"2024-09-13T15:02:34.119204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:33.356064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743857+0000","last_change":"2024-09-13T15:01:44.831717+0000","last_active":"2024-09-13T15:02:33.743857+0000","last_peered":"2024-09-13T15:02:33.743857+0000","last_clean":"2024-09-13T15:02:33.743857+0000","last_became_active":"2024-09-13T15:01:44.831495+0000","last_became_peered":"2024-09-13T15:01:44.831495+0000","last_unstale":"2024-09-13T15:02:33.743857+0000","last_undegraded":"2024-09-13T15:02:33.743857+0000","last_fullsized":"2024-09-13T15:02:33.743857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:48.753543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743869+0000","last_change":"2024-09-13T15:01:44.829698+0000","last_active":"2024-09-13T15:02:33.743869+0000","last_peered":"2024-09-13T15:02:33.743869+0000","last_clean":"2024-09-13T15:02:33.743869+0000","last_became_active":"2024-09-13T15:01:44.828999+0000","last_became_peered":"2024-09-13T15:01:44.828999+0000","last_unstale":"2024-09-13T15:02:33.743869+0000","last_undegraded":"2024-09-13T15:02:33.743869+0000","last_fullsized":"2024-09-13T15:02:33.743869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:30.591718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117647+0000","last_change":"2024-09-13T15:01:44.817554+0000","last_active":"2024-09-13T15:02:34.117647+0000","last_peered":"2024-09-13T15:02:34.117647+0000","last_clean":"2024-09-13T15:02:34.117647+0000","last_became_active":"2024-09-13T15:01:44.816258+0000","last_became_peered":"2024-09-13T15:01:44.816258+0000","last_unstale":"2024-09-13T15:02:34.117647+0000","last_undegraded":"2024-09-13T15:02:34.117647+0000","last_fullsized":"2024-09-13T15:02:34.117647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:07.927802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742322+0000","last_change":"2024-09-13T15:01:44.809979+0000","last_active":"2024-09-13T15:02:33.742322+0000","last_peered":"2024-09-13T15:02:33.742322+0000","last_clean":"2024-09-13T15:02:33.742322+0000","last_became_active":"2024-09-13T15:01:44.809687+0000","last_became_peered":"2024-09-13T15:01:44.809687+0000","last_unstale":"2024-09-13T15:02:33.742322+0000","last_undegraded":"2024-09-13T15:02:33.742322+0000","last_fullsized":"2024-09-13T15:02:33.742322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:45.583840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.119233+0000","last_change":"2024-09-13T15:02:34.119233+0000","last_active":"2024-09-13T15:02:34.119233+0000","last_peered":"2024-09-13T15:02:34.119233+0000","last_clean":"2024-09-13T15:02:34.119233+0000","last_became_active":"2024-09-13T15:02:34.118798+0000","last_became_peered":"2024-09-13T15:02:34.118798+0000","last_unstale":"2024-09-13T15:02:34.119233+0000","last_undegraded":"2024-09-13T15:02:34.119233+0000","last_fullsized":"2024-09-13T15:02:34.119233+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:12.367569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740392+0000","last_change":"2024-09-13T15:01:44.848904+0000","last_active":"2024-09-13T15:02:33.740392+0000","last_peered":"2024-09-13T15:02:33.740392+0000","last_clean":"2024-09-13T15:02:33.740392+0000","last_became_active":"2024-09-13T15:01:44.846074+0000","last_became_peered":"2024-09-13T15:01:44.846074+0000","last_unstale":"2024-09-13T15:02:33.740392+0000","last_undegraded":"2024-09-13T15:02:33.740392+0000","last_fullsized":"2024-09-13T15:02:33.740392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:37.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741904+0000","last_change":"2024-09-13T15:01:44.828243+0000","last_active":"2024-09-13T15:02:33.741904+0000","last_peered":"2024-09-13T15:02:33.741904+0000","last_clean":"2024-09-13T15:02:33.741904+0000","last_became_active":"2024-09-13T15:01:44.828024+0000","last_became_peered":"2024-09-13T15:01:44.828024+0000","last_unstale":"2024-09-13T15:02:33.741904+0000","last_undegraded":"2024-09-13T15:02:33.741904+0000","last_fullsized":"2024-09-13T15:02:33.741904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:28:47.388087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743573+0000","last_change":"2024-09-13T15:01:44.808879+0000","last_active":"2024-09-13T15:02:33.743573+0000","last_peered":"2024-09-13T15:02:33.743573+0000","last_clean":"2024-09-13T15:02:33.743573+0000","last_became_active":"2024-09-13T15:01:44.808609+0000","last_became_peered":"2024-09-13T15:01:44.808609+0000","last_unstale":"2024-09-13T15:02:33.743573+0000","last_undegraded":"2024-09-13T15:02:33.743573+0000","last_fullsized":"2024-09-13T15:02:33.743573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:59.817452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738213+0000","last_change":"2024-09-13T15:01:44.811171+0000","last_active":"2024-09-13T15:02:33.738213+0000","last_peered":"2024-09-13T15:02:33.738213+0000","last_clean":"2024-09-13T15:02:33.738213+0000","last_became_active":"2024-09-13T15:01:44.809918+0000","last_became_peered":"2024-09-13T15:01:44.809918+0000","last_unstale":"2024-09-13T15:02:33.738213+0000","last_undegraded":"2024-09-13T15:02:33.738213+0000","last_fullsized":"2024-09-13T15:02:33.738213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:48.359429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749385+0000","last_change":"2024-09-13T15:01:44.833663+0000","last_active":"2024-09-13T15:02:33.749385+0000","last_peered":"2024-09-13T15:02:33.749385+0000","last_clean":"2024-09-13T15:02:33.749385+0000","last_became_active":"2024-09-13T15:01:44.828737+0000","last_became_peered":"2024-09-13T15:01:44.828737+0000","last_unstale":"2024-09-13T15:02:33.749385+0000","last_undegraded":"2024-09-13T15:02:33.749385+0000","last_fullsized":"2024-09-13T15:02:33.749385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:08.579890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744005+0000","last_change":"2024-09-13T15:01:44.851143+0000","last_active":"2024-09-13T15:02:33.744005+0000","last_peered":"2024-09-13T15:02:33.744005+0000","last_clean":"2024-09-13T15:02:33.744005+0000","last_became_active":"2024-09-13T15:01:44.850410+0000","last_became_peered":"2024-09-13T15:01:44.850410+0000","last_unstale":"2024-09-13T15:02:33.744005+0000","last_undegraded":"2024-09-13T15:02:33.744005+0000","last_fullsized":"2024-09-13T15:02:33.744005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:11.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744851+0000","last_change":"2024-09-13T15:01:44.840082+0000","last_active":"2024-09-13T15:02:33.744851+0000","last_peered":"2024-09-13T15:02:33.744851+0000","last_clean":"2024-09-13T15:02:33.744851+0000","last_became_active":"2024-09-13T15:01:44.839371+0000","last_became_peered":"2024-09-13T15:01:44.839371+0000","last_unstale":"2024-09-13T15:02:33.744851+0000","last_undegraded":"2024-09-13T15:02:33.744851+0000","last_fullsized":"2024-09-13T15:02:33.744851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:13.433036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118361+0000","last_change":"2024-09-13T15:01:44.850416+0000","last_active":"2024-09-13T15:02:34.118361+0000","last_peered":"2024-09-13T15:02:34.118361+0000","last_clean":"2024-09-13T15:02:34.118361+0000","last_became_active":"2024-09-13T15:01:44.849766+0000","last_became_peered":"2024-09-13T15:01:44.849766+0000","last_unstale":"2024-09-13T15:02:34.118361+0000","last_undegraded":"2024-09-13T15:02:34.118361+0000","last_fullsized":"2024-09-13T15:02:34.118361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:11.985610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737522+0000","last_change":"2024-09-13T15:01:44.837060+0000","last_active":"2024-09-13T15:02:33.737522+0000","last_peered":"2024-09-13T15:02:33.737522+0000","last_clean":"2024-09-13T15:02:33.737522+0000","last_became_active":"2024-09-13T15:01:44.836770+0000","last_became_peered":"2024-09-13T15:01:44.836770+0000","last_unstale":"2024-09-13T15:02:33.737522+0000","last_undegraded":"2024-09-13T15:02:33.737522+0000","last_fullsized":"2024-09-13T15:02:33.737522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:45.915852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116554+0000","last_change":"2024-09-13T15:01:44.815867+0000","last_active":"2024-09-13T15:02:34.116554+0000","last_peered":"2024-09-13T15:02:34.116554+0000","last_clean":"2024-09-13T15:02:34.116554+0000","last_became_active":"2024-09-13T15:01:44.815116+0000","last_became_peered":"2024-09-13T15:01:44.815116+0000","last_unstale":"2024-09-13T15:02:34.116554+0000","last_undegraded":"2024-09-13T15:02:34.116554+0000","last_fullsized":"2024-09-13T15:02:34.116554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:02.814724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741454+0000","last_change":"2024-09-13T15:01:44.850022+0000","last_active":"2024-09-13T15:02:33.741454+0000","last_peered":"2024-09-13T15:02:33.741454+0000","last_clean":"2024-09-13T15:02:33.741454+0000","last_became_active":"2024-09-13T15:01:44.849533+0000","last_became_peered":"2024-09-13T15:01:44.849533+0000","last_unstale":"2024-09-13T15:02:33.741454+0000","last_undegraded":"2024-09-13T15:02:33.741454+0000","last_fullsized":"2024-09-13T15:02:33.741454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:09.837692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-09-13T15:02:32.751363+0000","last_change":"2024-09-13T15:01:44.817139+0000","last_active":"2024-09-13T15:02:32.751363+0000","last_peered":"2024-09-13T15:02:32.751363+0000","last_clean":"2024-09-13T15:02:32.751363+0000","last_became_active":"2024-09-13T15:01:44.816416+0000","last_became_peered":"2024-09-13T15:01:44.816416+0000","last_unstale":"2024-09-13T15:02:32.751363+0000","last_undegraded":"2024-09-13T15:02:32.751363+0000","last_fullsized":"2024-09-13T15:02:32.751363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:38.382210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749061+0000","last_change":"2024-09-13T15:02:33.747735+0000","last_active":"2024-09-13T15:02:33.749061+0000","last_peered":"2024-09-13T15:02:33.749061+0000","last_clean":"2024-09-13T15:02:33.749061+0000","last_became_active":"2024-09-13T15:02:33.747405+0000","last_became_peered":"2024-09-13T15:02:33.747405+0000","last_unstale":"2024-09-13T15:02:33.749061+0000","last_undegraded":"2024-09-13T15:02:33.749061+0000","last_fullsized":"2024-09-13T15:02:33.749061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:20.616184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742170+0000","last_change":"2024-09-13T15:01:44.808264+0000","last_active":"2024-09-13T15:02:33.742170+0000","last_peered":"2024-09-13T15:02:33.742170+0000","last_clean":"2024-09-13T15:02:33.742170+0000","last_became_active":"2024-09-13T15:01:44.807776+0000","last_became_peered":"2024-09-13T15:01:44.807776+0000","last_unstale":"2024-09-13T15:02:33.742170+0000","last_undegraded":"2024-09-13T15:02:33.742170+0000","last_fullsized":"2024-09-13T15:02:33.742170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:17.637800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742252+0000","last_change":"2024-09-13T15:01:44.804985+0000","last_active":"2024-09-13T15:02:33.742252+0000","last_peered":"2024-09-13T15:02:33.742252+0000","last_clean":"2024-09-13T15:02:33.742252+0000","last_became_active":"2024-09-13T15:01:44.803977+0000","last_became_peered":"2024-09-13T15:01:44.803977+0000","last_unstale":"2024-09-13T15:02:33.742252+0000","last_undegraded":"2024-09-13T15:02:33.742252+0000","last_fullsized":"2024-09-13T15:02:33.742252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:12.999738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118211+0000","last_change":"2024-09-13T15:01:44.824666+0000","last_active":"2024-09-13T15:02:34.118211+0000","last_peered":"2024-09-13T15:02:34.118211+0000","last_clean":"2024-09-13T15:02:34.118211+0000","last_became_active":"2024-09-13T15:01:44.815381+0000","last_became_peered":"2024-09-13T15:01:44.815381+0000","last_unstale":"2024-09-13T15:02:34.118211+0000","last_undegraded":"2024-09-13T15:02:34.118211+0000","last_fullsized":"2024-09-13T15:02:34.118211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:12:17.680247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5951,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":11902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542178,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":901120,"data_stored":708672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.94599999999999995,"15min":0.94099999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4079999999999999,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.877,"15min":0.877},"min":{"1min":0.57999999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.73499999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.873,"15min":0.877},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.147,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.028,"15min":1.036},"min":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.60199999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0009999999999999,"15min":1.0089999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.4570000000000001,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.98699999999999999,"15min":0.995},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.321,"5min":1.452,"15min":1.452},"last":0.95199999999999996}]},{"osd":3,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.92200000000000004,"15min":0.93000000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.1220000000000001,"5min":1.232,"15min":1.232},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.1020000000000001,"15min":1.1140000000000001},"min":{"1min":0.79000000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.496,"5min":1.7,"15min":1.7},"last":0.92800000000000005}]},{"osd":4,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3700000000000001,"5min":1.643,"15min":1.643},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.03,"15min":1.046},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.137,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.98299999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.153,"15min":1.165},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.579,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.01},{"interface":"front","average":{"1min":1.095,"5min":1.1040000000000001,"15min":1.1060000000000001},"min":{"1min":0.86799999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.4359999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.1819999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.179,"15min":1.1890000000000001},"min":{"1min":0.81299999999999994,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4970000000000001,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.1399999999999999,"15min":1.157},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.266,"5min":1.641,"15min":1.641},"last":1.1399999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542179,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":120921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.84399999999999997,"15min":0.83799999999999997},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1200000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.89200000000000002,"15min":0.90600000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.099,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.80700000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.85599999999999998,"15min":0.85399999999999998},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90400000000000003,"15min":0.90300000000000002},"min":{"1min":0.63200000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1499999999999999,"5min":1.167,"15min":1.167},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.85699999999999998,"15min":0.86299999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.097,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89300000000000002,"15min":0.88600000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91500000000000004,"15min":0.91600000000000004},"min":{"1min":0.74399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1339999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.749},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95299999999999996,"15min":0.95499999999999996},"min":{"1min":0.77600000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.175,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.90700000000000003}]},{"osd":4,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.93600000000000005,"15min":0.94099999999999995},"min":{"1min":0.68700000000000006,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1220000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.997,"15min":1.0069999999999999},"min":{"1min":0.70299999999999996,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.093}]},{"osd":5,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.95799999999999996,"15min":0.96299999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.014},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.038,"15min":1.048},"min":{"1min":0.67100000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.123}]},{"osd":7,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.024,"15min":1.032},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.167,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.1000000000000001,"15min":1.111},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.2949999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.94399999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542178,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":117126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.86899999999999999,"15min":0.872},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.86899999999999999,"15min":0.86299999999999999},"min":{"1min":0.71599999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.282,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.93700000000000006,"15min":0.94499999999999995},"min":{"1min":0.63700000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3839999999999999,"5min":1.401,"15min":1.401},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.89200000000000002,"15min":0.89600000000000002},"min":{"1min":0.65700000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93500000000000005,"15min":0.94499999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95099999999999996,"15min":0.94899999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.81000000000000005}]},{"osd":3,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.94499999999999995,"15min":0.94799999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.2849999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97199999999999998,"15min":0.97099999999999997},"min":{"1min":0.72699999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.97699999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.85299999999999998,"15min":0.85599999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2330000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.0600000000000001,"15min":1.079},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.2669999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.78300000000000003}]},{"osd":6,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.028,"15min":1.044},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.202,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.004,"5min":1.083,"15min":1.0960000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.496,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.0489999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.085,"15min":1.087},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.86599999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.145,"15min":1.153},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.5609999999999999,"5min":1.988,"15min":1.988},"last":1.1200000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542178,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":117162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.90000000000000002,"15min":0.90600000000000003},"min":{"1min":0.60399999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.071,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.83099999999999996,"15min":0.82699999999999996},"min":{"1min":0.63200000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.139,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.57999999999999996}]},{"osd":1,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.92200000000000004,"15min":0.92600000000000005},"min":{"1min":0.68200000000000005,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.131,"5min":1.224,"15min":1.224},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.871,"15min":0.87},"min":{"1min":0.623,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.157,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.4330000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.93700000000000006,"15min":0.94299999999999995},"min":{"1min":0.70299999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.0780000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.95799999999999996,"15min":0.96199999999999997},"min":{"1min":0.67500000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1240000000000001,"5min":1.669,"15min":1.669},"last":1.3160000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90200000000000002,"15min":0.90600000000000003},"min":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.099,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.0069999999999999,"15min":1.0189999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.2230000000000001,"5min":1.881,"15min":1.881},"last":0.95199999999999996}]},{"osd":5,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":1.0169999999999999,"15min":1.05},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.028,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.494},{"interface":"front","average":{"1min":0.88,"5min":0.96999999999999997,"15min":0.98499999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.1819999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.1060000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.0109999999999999,"15min":1.0269999999999999},"min":{"1min":0.64000000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.107,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.534},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.083,"15min":1.0960000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.367,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.0309999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.046,"15min":1.054},"min":{"1min":0.751,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.2569999999999999,"5min":1.623,"15min":1.623},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.2090000000000001,"15min":1.2210000000000001},"min":{"1min":0.96099999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3180000000000001,"5min":1.996,"15min":1.996},"last":1.3919999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542177,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":299008,"data_stored":120831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.501,"15min":0.501},"min":{"1min":0.371,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64900000000000002,"5min":0.747,"15min":0.747},"last":0.308},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.66300000000000003,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.42799999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.374,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.71499999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.76600000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81200000000000006,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.61399999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97599999999999998,"5min":1.179,"15min":1.179},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85999999999999999,"15min":0.86399999999999999},"min":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.034,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.79200000000000004}]},{"osd":5,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.873,"15min":0.876},"min":{"1min":0.68500000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0740000000000001,"5min":1.284,"15min":1.284},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.87,"5min":0.93300000000000005,"15min":0.94299999999999995},"min":{"1min":0.70599999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.212,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.72399999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.89400000000000002,"15min":0.90700000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0269999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.94099999999999995,"15min":0.95099999999999996},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.1539999999999999,"5min":1.21,"15min":1.21},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.95299999999999996,"15min":0.96899999999999997},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.1499999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.96399999999999997,"15min":0.98799999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0640000000000001,"5min":1.228,"15min":1.228},"last":0.64400000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542178,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":117036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48599999999999999,"15min":0.48799999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.33700000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76600000000000001,"5min":1.157,"15min":1.157},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.41599999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.71199999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.44700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73899999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.48599999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.42499999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.96699999999999997,"15min":0.98099999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.1899999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.94799999999999995,"15min":0.96299999999999997},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.123,"5min":1.675,"15min":1.675},"last":0.93600000000000005}]},{"osd":5,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.92300000000000004,"15min":0.93000000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.0920000000000001,"5min":1.296,"15min":1.296},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.877,"15min":0.88700000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.79300000000000004}]},{"osd":6,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.88,"15min":0.88400000000000001},"min":{"1min":0.69599999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.753},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.93500000000000005,"15min":0.94199999999999995},"min":{"1min":0.748,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.1859999999999999,"5min":1.373,"15min":1.373},"last":0.98399999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.82099999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.98699999999999999,"15min":0.995},"min":{"1min":0.78800000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2010000000000001,"5min":1.353,"15min":1.353},"last":0.83799999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":117196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.32500000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.57699999999999996,"5min":0.871,"15min":0.871},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69799999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.37,"15min":0.37},"max":{"1min":0.64600000000000002,"5min":1.071,"15min":1.071},"last":0.433},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68700000000000006,"5min":1.107,"15min":1.107},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.84799999999999998,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.61599999999999999,"15min":0.63},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68899999999999995,"5min":1.323,"15min":1.323},"last":0.61099999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.90600000000000003,"15min":0.91800000000000004},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.0169999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.88400000000000001,"15min":0.89300000000000002},"min":{"1min":0.68799999999999994,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1830000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.879,"15min":0.89000000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0289999999999999,"5min":1.228,"15min":1.228},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.91300000000000003,"15min":0.93100000000000005},"min":{"1min":0.70699999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.96899999999999997,"5min":1.365,"15min":1.365},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.90400000000000003,"15min":0.91400000000000003},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":0.999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.94499999999999995,"15min":0.96499999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":0.98199999999999998,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.94799999999999995,"15min":0.96699999999999997},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":0.95499999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.93500000000000005,"15min":0.94899999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2170000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.95299999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542178,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":897024,"data_stored":708064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.66800000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":4.6269999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.58699999999999997,"15min":0.60199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68899999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":4.5439999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.623,"15min":0.64100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.64400000000000002,"5min":1.669,"15min":1.669},"last":4.7309999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.64600000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56299999999999994,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69399999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.72499999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":9.6600000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88900000000000001},"min":{"1min":0.67100000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.0980000000000001,"5min":1.274,"15min":1.274},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.90400000000000003,"15min":0.91200000000000003},"min":{"1min":0.67500000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0580000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":2.444}]},{"osd":5,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.88300000000000001,"15min":0.88900000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":5.0679999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.026,"5min":1.165,"15min":1.165},"last":4.3150000000000004}]},{"osd":6,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.95199999999999996,"15min":0.96699999999999997},"min":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.0940000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":4.6909999999999998},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.91200000000000003,"15min":0.92500000000000004},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.1259999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":0.93899999999999995},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":4.4130000000000003},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.93200000000000005,"15min":0.94599999999999995},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.038,"5min":1.141,"15min":1.141},"last":0.52700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:04:20.694 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:04:20.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.873+0000 7f3f4aa00640 1 Processor -- start 2024-09-13T15:04:20.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.873+0000 7f3f4aa00640 1 -- start start 2024-09-13T15:04:20.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.873+0000 7f3f4aa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3f440c7e60 0x7f3f44159830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:20.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.873+0000 7f3f4aa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f44159d70 0x7f3f44155c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:20.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.873+0000 7f3f4aa00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f4406e9d0 con 0x7f3f44159450 2024-09-13T15:04:20.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.873+0000 7f3f4aa00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f440c6330 con 0x7f3f440c7e60 2024-09-13T15:04:20.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.873+0000 7f3f4aa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f440c6610 con 0x7f3f44159d70 2024-09-13T15:04:20.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.877+0000 7f3f48c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3f440c7e60 0x7f3f44159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:20.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.877+0000 7f3f48c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3f440c7e60 0x7f3f44159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41432/0 (socket says 172.21.15.7:41432) 2024-09-13T15:04:20.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.877+0000 7f3f48c00640 1 -- 172.21.15.7:0/826262329 learned_addr learned my addr 172.21.15.7:0/826262329 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:20.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.877+0000 7f3f4a000640 1 --2- 172.21.15.7:0/826262329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f44159d70 0x7f3f44155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:20.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.877+0000 7f3f48c00640 1 -- 172.21.15.7:0/826262329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f44159d70 msgr2=0x7f3f44155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:20.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.877+0000 7f3f48c00640 1 --2- 172.21.15.7:0/826262329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f44159d70 0x7f3f44155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.877+0000 7f3f48c00640 1 -- 172.21.15.7:0/826262329 >> v1:172.21.15.77:6789/0 conn(0x7f3f44159450 legacy=0x7f3f440c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.877+0000 7f3f48c00640 1 -- 172.21.15.7:0/826262329 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f440c68f0 con 0x7f3f440c7e60 2024-09-13T15:04:20.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.877+0000 7f3f4a000640 1 --2- 172.21.15.7:0/826262329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f44159d70 0x7f3f44155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:20.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.877+0000 7f3f48c00640 1 --2- 172.21.15.7:0/826262329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f440c7e60 0x7f3f44159830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009870 tx=0x7f3f3001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c21c51d49a22612 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:20.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.877+0000 7f3f43e00640 1 -- 172.21.15.7:0/826262329 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f300a8a50 con 0x7f3f440c7e60 2024-09-13T15:04:20.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.877+0000 7f3f43e00640 1 -- 172.21.15.7:0/826262329 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f300a8bb0 con 0x7f3f440c7e60 2024-09-13T15:04:20.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f43e00640 1 -- 172.21.15.7:0/826262329 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f300b0440 con 0x7f3f440c7e60 2024-09-13T15:04:20.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4aa00640 1 -- 172.21.15.7:0/826262329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f440c7e60 msgr2=0x7f3f44159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4aa00640 1 --2- 172.21.15.7:0/826262329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f440c7e60 0x7f3f44159830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009870 tx=0x7f3f3001ed50 comp rx=0 tx=0).stop 2024-09-13T15:04:20.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4aa00640 1 -- 172.21.15.7:0/826262329 shutdown_connections 2024-09-13T15:04:20.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4aa00640 1 --2- 172.21.15.7:0/826262329 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f44159d70 0x7f3f44155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4aa00640 1 --2- 172.21.15.7:0/826262329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f440c7e60 0x7f3f44159830 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4aa00640 1 -- 172.21.15.7:0/826262329 >> 172.21.15.7:0/826262329 conn(0x7f3f440c8390 msgr2=0x7f3f440c8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:20.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4aa00640 1 -- 172.21.15.7:0/826262329 shutdown_connections 2024-09-13T15:04:20.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4aa00640 1 -- 172.21.15.7:0/826262329 wait complete. 2024-09-13T15:04:20.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4aa00640 1 Processor -- start 2024-09-13T15:04:20.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4aa00640 1 -- start start 2024-09-13T15:04:20.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4aa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f440c7e60 0x7f3f441490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:20.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4aa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f44159450 0x7f3f44152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:20.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4aa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f44153270 0x7f3f441efd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:20.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4aa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4414faa0 con 0x7f3f44153270 2024-09-13T15:04:20.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4aa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f441536f0 con 0x7f3f440c7e60 2024-09-13T15:04:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4aa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44147ef0 con 0x7f3f44159450 2024-09-13T15:04:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f44153270 0x7f3f441efd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f44153270 0x7f3f441efd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41434/0 (socket says 172.21.15.7:41434) 2024-09-13T15:04:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f4a000640 1 -- 172.21.15.7:0/1692285013 learned_addr learned my addr 172.21.15.7:0/1692285013 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f48c00640 1 --2- 172.21.15.7:0/1692285013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f44159450 0x7f3f44152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.881+0000 7f3f49600640 1 --2- 172.21.15.7:0/1692285013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f440c7e60 0x7f3f441490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.885+0000 7f3f4a000640 1 -- 172.21.15.7:0/1692285013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f44159450 msgr2=0x7f3f44152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.885+0000 7f3f4a000640 1 --2- 172.21.15.7:0/1692285013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f44159450 0x7f3f44152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.885+0000 7f3f4a000640 1 -- 172.21.15.7:0/1692285013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f440c7e60 msgr2=0x7f3f441490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.885+0000 7f3f4a000640 1 --2- 172.21.15.7:0/1692285013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f440c7e60 0x7f3f441490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.885+0000 7f3f4a000640 1 -- 172.21.15.7:0/1692285013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f300094d0 con 0x7f3f44153270 2024-09-13T15:04:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.885+0000 7f3f49600640 1 --2- 172.21.15.7:0/1692285013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f440c7e60 0x7f3f441490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.885+0000 7f3f4a000640 1 --2- 172.21.15.7:0/1692285013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f44153270 0x7f3f441efd30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c007ef0 tx=0x7f3f3c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:20.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.885+0000 7f3f41600640 1 -- 172.21.15.7:0/1692285013 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c015600 con 0x7f3f44153270 2024-09-13T15:04:20.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.885+0000 7f3f41600640 1 -- 172.21.15.7:0/1692285013 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c00f040 con 0x7f3f44153270 2024-09-13T15:04:20.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.885+0000 7f3f41600640 1 -- 172.21.15.7:0/1692285013 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c0159a0 con 0x7f3f44153270 2024-09-13T15:04:20.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.885+0000 7f3f4aa00640 1 -- 172.21.15.7:0/1692285013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f44072330 con 0x7f3f44153270 2024-09-13T15:04:20.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.885+0000 7f3f4aa00640 1 -- 172.21.15.7:0/1692285013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f440ca9f0 con 0x7f3f44153270 2024-09-13T15:04:20.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.885+0000 7f3f4aa00640 1 -- 172.21.15.7:0/1692285013 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f4414f820 con 0x7f3f44153270 2024-09-13T15:04:20.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.885+0000 7f3f41600640 1 -- 172.21.15.7:0/1692285013 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3f3c01e3b0 con 0x7f3f44153270 2024-09-13T15:04:20.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.885+0000 7f3f41600640 1 --2- 172.21.15.7:0/1692285013 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3f24066690 0x7f3f24068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:20.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.885+0000 7f3f41600640 1 -- 172.21.15.7:0/1692285013 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3f3c0846d0 con 0x7f3f44153270 2024-09-13T15:04:20.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.889+0000 7f3f49600640 1 --2- 172.21.15.7:0/1692285013 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3f24066690 0x7f3f24068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:20.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.889+0000 7f3f49600640 1 --2- 172.21.15.7:0/1692285013 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3f24066690 0x7f3f24068b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3f38000f70 tx=0x7f3f38009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:20.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:20.889+0000 7f3f41600640 1 -- 172.21.15.7:0/1692285013 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3f3c0517c0 con 0x7f3f44153270 2024-09-13T15:04:21.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.049+0000 7f3f4aa00640 1 -- 172.21.15.7:0/1692285013 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f440721b0 con 0x7f3f24066690 2024-09-13T15:04:21.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.077+0000 7f3f41600640 1 -- 172.21.15.7:0/1692285013 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368836 (secure 0 0 0) 0x7f3f380013f0 con 0x7f3f24066690 2024-09-13T15:04:21.085 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:21.089 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T15:04:21.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.081+0000 7f3f4aa00640 1 -- 172.21.15.7:0/1692285013 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3f24066690 msgr2=0x7f3f24068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:21.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.081+0000 7f3f4aa00640 1 --2- 172.21.15.7:0/1692285013 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3f24066690 0x7f3f24068b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3f38000f70 tx=0x7f3f38009040 comp rx=0 tx=0).stop 2024-09-13T15:04:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.081+0000 7f3f4aa00640 1 -- 172.21.15.7:0/1692285013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f44153270 msgr2=0x7f3f441efd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.081+0000 7f3f4aa00640 1 --2- 172.21.15.7:0/1692285013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f44153270 0x7f3f441efd30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c007ef0 tx=0x7f3f3c00d4a0 comp rx=0 tx=0).stop 2024-09-13T15:04:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.081+0000 7f3f4aa00640 1 -- 172.21.15.7:0/1692285013 shutdown_connections 2024-09-13T15:04:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.081+0000 7f3f4aa00640 1 --2- 172.21.15.7:0/1692285013 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3f24066690 0x7f3f24068b50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.081+0000 7f3f4aa00640 1 --2- 172.21.15.7:0/1692285013 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f44153270 0x7f3f441efd30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.081+0000 7f3f4aa00640 1 --2- 172.21.15.7:0/1692285013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f44159450 0x7f3f44152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.081+0000 7f3f4aa00640 1 --2- 172.21.15.7:0/1692285013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f440c7e60 0x7f3f441490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.081+0000 7f3f4aa00640 1 -- 172.21.15.7:0/1692285013 >> 172.21.15.7:0/1692285013 conn(0x7f3f440c8390 msgr2=0x7f3f4406dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.081+0000 7f3f4aa00640 1 -- 172.21.15.7:0/1692285013 shutdown_connections 2024-09-13T15:04:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.085+0000 7f3f4aa00640 1 -- 172.21.15.7:0/1692285013 wait complete. 2024-09-13T15:04:21.104 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-09-13T15:04:20.686512+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596319,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":247,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":194,"ondisk_log_size":194,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231928,"kb_used_data":3512,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":754742792,"statfs":{"total":773094113280,"available":772856619008,"internally_reserved":0,"allocated":3596288,"data_stored":2128926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":233819704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1358,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005134"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742671+0000","last_change":"2024-09-13T15:01:44.418856+0000","last_active":"2024-09-13T15:02:33.742671+0000","last_peered":"2024-09-13T15:02:33.742671+0000","last_clean":"2024-09-13T15:02:33.742671+0000","last_became_active":"2024-09-13T15:01:44.418641+0000","last_became_peered":"2024-09-13T15:01:44.418641+0000","last_unstale":"2024-09-13T15:02:33.742671+0000","last_undegraded":"2024-09-13T15:02:33.742671+0000","last_fullsized":"2024-09-13T15:02:33.742671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:40.178824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738513+0000","last_change":"2024-09-13T15:01:44.809371+0000","last_active":"2024-09-13T15:02:33.738513+0000","last_peered":"2024-09-13T15:02:33.738513+0000","last_clean":"2024-09-13T15:02:33.738513+0000","last_became_active":"2024-09-13T15:01:44.809091+0000","last_became_peered":"2024-09-13T15:01:44.809091+0000","last_unstale":"2024-09-13T15:02:33.738513+0000","last_undegraded":"2024-09-13T15:02:33.738513+0000","last_fullsized":"2024-09-13T15:02:33.738513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:22.412025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737520+0000","last_change":"2024-09-13T15:01:48.910757+0000","last_active":"2024-09-13T15:02:33.737520+0000","last_peered":"2024-09-13T15:02:33.737520+0000","last_clean":"2024-09-13T15:02:33.737520+0000","last_became_active":"2024-09-13T15:01:48.910262+0000","last_became_peered":"2024-09-13T15:01:48.910262+0000","last_unstale":"2024-09-13T15:02:33.737520+0000","last_undegraded":"2024-09-13T15:02:33.737520+0000","last_fullsized":"2024-09-13T15:02:33.737520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:39.290557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738791+0000","last_change":"2024-09-13T15:01:44.404818+0000","last_active":"2024-09-13T15:02:33.738791+0000","last_peered":"2024-09-13T15:02:33.738791+0000","last_clean":"2024-09-13T15:02:33.738791+0000","last_became_active":"2024-09-13T15:01:44.401666+0000","last_became_peered":"2024-09-13T15:01:44.401666+0000","last_unstale":"2024-09-13T15:02:33.738791+0000","last_undegraded":"2024-09-13T15:02:33.738791+0000","last_fullsized":"2024-09-13T15:02:33.738791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:31.818163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742417+0000","last_change":"2024-09-13T15:01:44.850292+0000","last_active":"2024-09-13T15:02:33.742417+0000","last_peered":"2024-09-13T15:02:33.742417+0000","last_clean":"2024-09-13T15:02:33.742417+0000","last_became_active":"2024-09-13T15:01:44.849825+0000","last_became_peered":"2024-09-13T15:01:44.849825+0000","last_unstale":"2024-09-13T15:02:33.742417+0000","last_undegraded":"2024-09-13T15:02:33.742417+0000","last_fullsized":"2024-09-13T15:02:33.742417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:22.582742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.746607+0000","last_change":"2024-09-13T15:01:48.850426+0000","last_active":"2024-09-13T15:02:33.746607+0000","last_peered":"2024-09-13T15:02:33.746607+0000","last_clean":"2024-09-13T15:02:33.746607+0000","last_became_active":"2024-09-13T15:01:48.848750+0000","last_became_peered":"2024-09-13T15:01:48.848750+0000","last_unstale":"2024-09-13T15:02:33.746607+0000","last_undegraded":"2024-09-13T15:02:33.746607+0000","last_fullsized":"2024-09-13T15:02:33.746607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:55.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117554+0000","last_change":"2024-09-13T15:01:44.437850+0000","last_active":"2024-09-13T15:02:34.117554+0000","last_peered":"2024-09-13T15:02:34.117554+0000","last_clean":"2024-09-13T15:02:34.117554+0000","last_became_active":"2024-09-13T15:01:44.437168+0000","last_became_peered":"2024-09-13T15:01:44.437168+0000","last_unstale":"2024-09-13T15:02:34.117554+0000","last_undegraded":"2024-09-13T15:02:34.117554+0000","last_fullsized":"2024-09-13T15:02:34.117554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:23.540408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745120+0000","last_change":"2024-09-13T15:01:44.845989+0000","last_active":"2024-09-13T15:02:33.745120+0000","last_peered":"2024-09-13T15:02:33.745120+0000","last_clean":"2024-09-13T15:02:33.745120+0000","last_became_active":"2024-09-13T15:01:44.845395+0000","last_became_peered":"2024-09-13T15:01:44.845395+0000","last_unstale":"2024-09-13T15:02:33.745120+0000","last_undegraded":"2024-09-13T15:02:33.745120+0000","last_fullsized":"2024-09-13T15:02:33.745120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:52.267507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748880+0000","last_change":"2024-09-13T15:01:48.865388+0000","last_active":"2024-09-13T15:02:33.748880+0000","last_peered":"2024-09-13T15:02:33.748880+0000","last_clean":"2024-09-13T15:02:33.748880+0000","last_became_active":"2024-09-13T15:01:48.864314+0000","last_became_peered":"2024-09-13T15:01:48.864314+0000","last_unstale":"2024-09-13T15:02:33.748880+0000","last_undegraded":"2024-09-13T15:02:33.748880+0000","last_fullsized":"2024-09-13T15:02:33.748880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:18.637430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116848+0000","last_change":"2024-09-13T15:01:44.424080+0000","last_active":"2024-09-13T15:02:34.116848+0000","last_peered":"2024-09-13T15:02:34.116848+0000","last_clean":"2024-09-13T15:02:34.116848+0000","last_became_active":"2024-09-13T15:01:44.423381+0000","last_became_peered":"2024-09-13T15:01:44.423381+0000","last_unstale":"2024-09-13T15:02:34.116848+0000","last_undegraded":"2024-09-13T15:02:34.116848+0000","last_fullsized":"2024-09-13T15:02:34.116848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:38:20.455380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743629+0000","last_change":"2024-09-13T15:01:44.849670+0000","last_active":"2024-09-13T15:02:33.743629+0000","last_peered":"2024-09-13T15:02:33.743629+0000","last_clean":"2024-09-13T15:02:33.743629+0000","last_became_active":"2024-09-13T15:01:44.849038+0000","last_became_peered":"2024-09-13T15:01:44.849038+0000","last_unstale":"2024-09-13T15:02:33.743629+0000","last_undegraded":"2024-09-13T15:02:33.743629+0000","last_fullsized":"2024-09-13T15:02:33.743629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:45.570774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.747610+0000","last_change":"2024-09-13T15:01:48.854953+0000","last_active":"2024-09-13T15:02:33.747610+0000","last_peered":"2024-09-13T15:02:33.747610+0000","last_clean":"2024-09-13T15:02:33.747610+0000","last_became_active":"2024-09-13T15:01:48.853858+0000","last_became_peered":"2024-09-13T15:01:48.853858+0000","last_unstale":"2024-09-13T15:02:33.747610+0000","last_undegraded":"2024-09-13T15:02:33.747610+0000","last_fullsized":"2024-09-13T15:02:33.747610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:07.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742073+0000","last_change":"2024-09-13T15:01:44.824391+0000","last_active":"2024-09-13T15:02:33.742073+0000","last_peered":"2024-09-13T15:02:33.742073+0000","last_clean":"2024-09-13T15:02:33.742073+0000","last_became_active":"2024-09-13T15:01:44.823690+0000","last_became_peered":"2024-09-13T15:01:44.823690+0000","last_unstale":"2024-09-13T15:02:33.742073+0000","last_undegraded":"2024-09-13T15:02:33.742073+0000","last_fullsized":"2024-09-13T15:02:33.742073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.596789+0000","last_change":"2024-09-13T15:01:44.421523+0000","last_active":"2024-09-13T15:04:17.596789+0000","last_peered":"2024-09-13T15:04:17.596789+0000","last_clean":"2024-09-13T15:04:17.596789+0000","last_became_active":"2024-09-13T15:01:44.419965+0000","last_became_peered":"2024-09-13T15:01:44.419965+0000","last_unstale":"2024-09-13T15:04:17.596789+0000","last_undegraded":"2024-09-13T15:04:17.596789+0000","last_fullsized":"2024-09-13T15:04:17.596789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:34.918774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749714+0000","last_change":"2024-09-13T15:01:48.850895+0000","last_active":"2024-09-13T15:02:33.749714+0000","last_peered":"2024-09-13T15:02:33.749714+0000","last_clean":"2024-09-13T15:02:33.749714+0000","last_became_active":"2024-09-13T15:01:48.849856+0000","last_became_peered":"2024-09-13T15:01:48.849856+0000","last_unstale":"2024-09-13T15:02:33.749714+0000","last_undegraded":"2024-09-13T15:02:33.749714+0000","last_fullsized":"2024-09-13T15:02:33.749714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:59.616442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738227+0000","last_change":"2024-09-13T15:01:44.806026+0000","last_active":"2024-09-13T15:02:33.738227+0000","last_peered":"2024-09-13T15:02:33.738227+0000","last_clean":"2024-09-13T15:02:33.738227+0000","last_became_active":"2024-09-13T15:01:44.805767+0000","last_became_peered":"2024-09-13T15:01:44.805767+0000","last_unstale":"2024-09-13T15:02:33.738227+0000","last_undegraded":"2024-09-13T15:02:33.738227+0000","last_fullsized":"2024-09-13T15:02:33.738227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:50.696113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743085+0000","last_change":"2024-09-13T15:01:44.401897+0000","last_active":"2024-09-13T15:02:33.743085+0000","last_peered":"2024-09-13T15:02:33.743085+0000","last_clean":"2024-09-13T15:02:33.743085+0000","last_became_active":"2024-09-13T15:01:44.401559+0000","last_became_peered":"2024-09-13T15:01:44.401559+0000","last_unstale":"2024-09-13T15:02:33.743085+0000","last_undegraded":"2024-09-13T15:02:33.743085+0000","last_fullsized":"2024-09-13T15:02:33.743085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:58.535567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749109+0000","last_change":"2024-09-13T15:01:48.858808+0000","last_active":"2024-09-13T15:02:33.749109+0000","last_peered":"2024-09-13T15:02:33.749109+0000","last_clean":"2024-09-13T15:02:33.749109+0000","last_became_active":"2024-09-13T15:01:48.857802+0000","last_became_peered":"2024-09-13T15:01:48.857802+0000","last_unstale":"2024-09-13T15:02:33.749109+0000","last_undegraded":"2024-09-13T15:02:33.749109+0000","last_fullsized":"2024-09-13T15:02:33.749109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:41.628058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737738+0000","last_change":"2024-09-13T15:01:44.808674+0000","last_active":"2024-09-13T15:02:33.737738+0000","last_peered":"2024-09-13T15:02:33.737738+0000","last_clean":"2024-09-13T15:02:33.737738+0000","last_became_active":"2024-09-13T15:01:44.808420+0000","last_became_peered":"2024-09-13T15:01:44.808420+0000","last_unstale":"2024-09-13T15:02:33.737738+0000","last_undegraded":"2024-09-13T15:02:33.737738+0000","last_fullsized":"2024-09-13T15:02:33.737738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:33.447973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.610200+0000","last_change":"2024-09-13T15:01:44.406717+0000","last_active":"2024-09-13T15:04:17.610200+0000","last_peered":"2024-09-13T15:04:17.610200+0000","last_clean":"2024-09-13T15:04:17.610200+0000","last_became_active":"2024-09-13T15:01:44.406354+0000","last_became_peered":"2024-09-13T15:01:44.406354+0000","last_unstale":"2024-09-13T15:04:17.610200+0000","last_undegraded":"2024-09-13T15:04:17.610200+0000","last_fullsized":"2024-09-13T15:04:17.610200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:49.413632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741522+0000","last_change":"2024-09-13T15:01:48.909879+0000","last_active":"2024-09-13T15:02:33.741522+0000","last_peered":"2024-09-13T15:02:33.741522+0000","last_clean":"2024-09-13T15:02:33.741522+0000","last_became_active":"2024-09-13T15:01:48.909494+0000","last_became_peered":"2024-09-13T15:01:48.909494+0000","last_unstale":"2024-09-13T15:02:33.741522+0000","last_undegraded":"2024-09-13T15:02:33.741522+0000","last_fullsized":"2024-09-13T15:02:33.741522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:54.415920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748317+0000","last_change":"2024-09-13T15:01:44.825065+0000","last_active":"2024-09-13T15:02:33.748317+0000","last_peered":"2024-09-13T15:02:33.748317+0000","last_clean":"2024-09-13T15:02:33.748317+0000","last_became_active":"2024-09-13T15:01:44.824392+0000","last_became_peered":"2024-09-13T15:01:44.824392+0000","last_unstale":"2024-09-13T15:02:33.748317+0000","last_undegraded":"2024-09-13T15:02:33.748317+0000","last_fullsized":"2024-09-13T15:02:33.748317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:49.717211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.600924+0000","last_change":"2024-09-13T15:01:44.421119+0000","last_active":"2024-09-13T15:04:17.600924+0000","last_peered":"2024-09-13T15:04:17.600924+0000","last_clean":"2024-09-13T15:04:17.600924+0000","last_became_active":"2024-09-13T15:01:44.419082+0000","last_became_peered":"2024-09-13T15:01:44.419082+0000","last_unstale":"2024-09-13T15:04:17.600924+0000","last_undegraded":"2024-09-13T15:04:17.600924+0000","last_fullsized":"2024-09-13T15:04:17.600924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.011350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749456+0000","last_change":"2024-09-13T15:01:48.856387+0000","last_active":"2024-09-13T15:02:33.749456+0000","last_peered":"2024-09-13T15:02:33.749456+0000","last_clean":"2024-09-13T15:02:33.749456+0000","last_became_active":"2024-09-13T15:01:48.855433+0000","last_became_peered":"2024-09-13T15:01:48.855433+0000","last_unstale":"2024-09-13T15:02:33.749456+0000","last_undegraded":"2024-09-13T15:02:33.749456+0000","last_fullsized":"2024-09-13T15:02:33.749456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:58.309929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744608+0000","last_change":"2024-09-13T15:01:44.807909+0000","last_active":"2024-09-13T15:02:33.744608+0000","last_peered":"2024-09-13T15:02:33.744608+0000","last_clean":"2024-09-13T15:02:33.744608+0000","last_became_active":"2024-09-13T15:01:44.807643+0000","last_became_peered":"2024-09-13T15:01:44.807643+0000","last_unstale":"2024-09-13T15:02:33.744608+0000","last_undegraded":"2024-09-13T15:02:33.744608+0000","last_fullsized":"2024-09-13T15:02:33.744608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:30.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.594985+0000","last_change":"2024-09-13T15:01:44.430200+0000","last_active":"2024-09-13T15:04:17.594985+0000","last_peered":"2024-09-13T15:04:17.594985+0000","last_clean":"2024-09-13T15:04:17.594985+0000","last_became_active":"2024-09-13T15:01:44.429510+0000","last_became_peered":"2024-09-13T15:01:44.429510+0000","last_unstale":"2024-09-13T15:04:17.594985+0000","last_undegraded":"2024-09-13T15:04:17.594985+0000","last_fullsized":"2024-09-13T15:04:17.594985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:52.921485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748075+0000","last_change":"2024-09-13T15:01:48.912116+0000","last_active":"2024-09-13T15:02:33.748075+0000","last_peered":"2024-09-13T15:02:33.748075+0000","last_clean":"2024-09-13T15:02:33.748075+0000","last_became_active":"2024-09-13T15:01:48.911578+0000","last_became_peered":"2024-09-13T15:01:48.911578+0000","last_unstale":"2024-09-13T15:02:33.748075+0000","last_undegraded":"2024-09-13T15:02:33.748075+0000","last_fullsized":"2024-09-13T15:02:33.748075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:50.826715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738926+0000","last_change":"2024-09-13T15:01:44.838344+0000","last_active":"2024-09-13T15:02:33.738926+0000","last_peered":"2024-09-13T15:02:33.738926+0000","last_clean":"2024-09-13T15:02:33.738926+0000","last_became_active":"2024-09-13T15:01:44.838128+0000","last_became_peered":"2024-09-13T15:01:44.838128+0000","last_unstale":"2024-09-13T15:02:33.738926+0000","last_undegraded":"2024-09-13T15:02:33.738926+0000","last_fullsized":"2024-09-13T15:02:33.738926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:09:50.373976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742357+0000","last_change":"2024-09-13T15:01:44.430749+0000","last_active":"2024-09-13T15:02:33.742357+0000","last_peered":"2024-09-13T15:02:33.742357+0000","last_clean":"2024-09-13T15:02:33.742357+0000","last_became_active":"2024-09-13T15:01:44.430548+0000","last_became_peered":"2024-09-13T15:01:44.430548+0000","last_unstale":"2024-09-13T15:02:33.742357+0000","last_undegraded":"2024-09-13T15:02:33.742357+0000","last_fullsized":"2024-09-13T15:02:33.742357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:30.312447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737398+0000","last_change":"2024-09-13T15:01:48.911224+0000","last_active":"2024-09-13T15:02:33.737398+0000","last_peered":"2024-09-13T15:02:33.737398+0000","last_clean":"2024-09-13T15:02:33.737398+0000","last_became_active":"2024-09-13T15:01:48.910150+0000","last_became_peered":"2024-09-13T15:01:48.910150+0000","last_unstale":"2024-09-13T15:02:33.737398+0000","last_undegraded":"2024-09-13T15:02:33.737398+0000","last_fullsized":"2024-09-13T15:02:33.737398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:41.244267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743138+0000","last_change":"2024-09-13T15:01:44.812200+0000","last_active":"2024-09-13T15:02:33.743138+0000","last_peered":"2024-09-13T15:02:33.743138+0000","last_clean":"2024-09-13T15:02:33.743138+0000","last_became_active":"2024-09-13T15:01:44.811915+0000","last_became_peered":"2024-09-13T15:01:44.811915+0000","last_unstale":"2024-09-13T15:02:33.743138+0000","last_undegraded":"2024-09-13T15:02:33.743138+0000","last_fullsized":"2024-09-13T15:02:33.743138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:07.944520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'1","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:03:48.892402+0000","last_change":"2024-09-13T15:01:44.423119+0000","last_active":"2024-09-13T15:03:48.892402+0000","last_peered":"2024-09-13T15:03:48.892402+0000","last_clean":"2024-09-13T15:03:48.892402+0000","last_became_active":"2024-09-13T15:01:44.422297+0000","last_became_peered":"2024-09-13T15:01:44.422297+0000","last_unstale":"2024-09-13T15:03:48.892402+0000","last_undegraded":"2024-09-13T15:03:48.892402+0000","last_fullsized":"2024-09-13T15:03:48.892402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:09.798196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743841+0000","last_change":"2024-09-13T15:01:48.908569+0000","last_active":"2024-09-13T15:02:33.743841+0000","last_peered":"2024-09-13T15:02:33.743841+0000","last_clean":"2024-09-13T15:02:33.743841+0000","last_became_active":"2024-09-13T15:01:48.908118+0000","last_became_peered":"2024-09-13T15:01:48.908118+0000","last_unstale":"2024-09-13T15:02:33.743841+0000","last_undegraded":"2024-09-13T15:02:33.743841+0000","last_fullsized":"2024-09-13T15:02:33.743841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:06.459855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743852+0000","last_change":"2024-09-13T15:01:44.850837+0000","last_active":"2024-09-13T15:02:33.743852+0000","last_peered":"2024-09-13T15:02:33.743852+0000","last_clean":"2024-09-13T15:02:33.743852+0000","last_became_active":"2024-09-13T15:01:44.850263+0000","last_became_peered":"2024-09-13T15:01:44.850263+0000","last_unstale":"2024-09-13T15:02:33.743852+0000","last_undegraded":"2024-09-13T15:02:33.743852+0000","last_fullsized":"2024-09-13T15:02:33.743852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:16.956369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743192+0000","last_change":"2024-09-13T15:01:44.399163+0000","last_active":"2024-09-13T15:02:33.743192+0000","last_peered":"2024-09-13T15:02:33.743192+0000","last_clean":"2024-09-13T15:02:33.743192+0000","last_became_active":"2024-09-13T15:01:44.398881+0000","last_became_peered":"2024-09-13T15:01:44.398881+0000","last_unstale":"2024-09-13T15:02:33.743192+0000","last_undegraded":"2024-09-13T15:02:33.743192+0000","last_fullsized":"2024-09-13T15:02:33.743192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:49.622676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743584+0000","last_change":"2024-09-13T15:01:48.852798+0000","last_active":"2024-09-13T15:02:33.743584+0000","last_peered":"2024-09-13T15:02:33.743584+0000","last_clean":"2024-09-13T15:02:33.743584+0000","last_became_active":"2024-09-13T15:01:48.851948+0000","last_became_peered":"2024-09-13T15:01:48.851948+0000","last_unstale":"2024-09-13T15:02:33.743584+0000","last_undegraded":"2024-09-13T15:02:33.743584+0000","last_fullsized":"2024-09-13T15:02:33.743584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:20.061043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749414+0000","last_change":"2024-09-13T15:01:44.824074+0000","last_active":"2024-09-13T15:02:33.749414+0000","last_peered":"2024-09-13T15:02:33.749414+0000","last_clean":"2024-09-13T15:02:33.749414+0000","last_became_active":"2024-09-13T15:01:44.821475+0000","last_became_peered":"2024-09-13T15:01:44.821475+0000","last_unstale":"2024-09-13T15:02:33.749414+0000","last_undegraded":"2024-09-13T15:02:33.749414+0000","last_fullsized":"2024-09-13T15:02:33.749414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:21.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742662+0000","last_change":"2024-09-13T15:01:44.433502+0000","last_active":"2024-09-13T15:02:33.742662+0000","last_peered":"2024-09-13T15:02:33.742662+0000","last_clean":"2024-09-13T15:02:33.742662+0000","last_became_active":"2024-09-13T15:01:44.432902+0000","last_became_peered":"2024-09-13T15:01:44.432902+0000","last_unstale":"2024-09-13T15:02:33.742662+0000","last_undegraded":"2024-09-13T15:02:33.742662+0000","last_fullsized":"2024-09-13T15:02:33.742662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:59.189559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743046+0000","last_change":"2024-09-13T15:01:48.846695+0000","last_active":"2024-09-13T15:02:33.743046+0000","last_peered":"2024-09-13T15:02:33.743046+0000","last_clean":"2024-09-13T15:02:33.743046+0000","last_became_active":"2024-09-13T15:01:48.846301+0000","last_became_peered":"2024-09-13T15:01:48.846301+0000","last_unstale":"2024-09-13T15:02:33.743046+0000","last_undegraded":"2024-09-13T15:02:33.743046+0000","last_fullsized":"2024-09-13T15:02:33.743046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:17.532499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741535+0000","last_change":"2024-09-13T15:01:44.814483+0000","last_active":"2024-09-13T15:02:33.741535+0000","last_peered":"2024-09-13T15:02:33.741535+0000","last_clean":"2024-09-13T15:02:33.741535+0000","last_became_active":"2024-09-13T15:01:44.814192+0000","last_became_peered":"2024-09-13T15:01:44.814192+0000","last_unstale":"2024-09-13T15:02:33.741535+0000","last_undegraded":"2024-09-13T15:02:33.741535+0000","last_fullsized":"2024-09-13T15:02:33.741535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:32:30.303635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:03:48.878857+0000","last_change":"2024-09-13T15:01:44.399314+0000","last_active":"2024-09-13T15:03:48.878857+0000","last_peered":"2024-09-13T15:03:48.878857+0000","last_clean":"2024-09-13T15:03:48.878857+0000","last_became_active":"2024-09-13T15:01:44.398904+0000","last_became_peered":"2024-09-13T15:01:44.398904+0000","last_unstale":"2024-09-13T15:03:48.878857+0000","last_undegraded":"2024-09-13T15:03:48.878857+0000","last_fullsized":"2024-09-13T15:03:48.878857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.645179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741624+0000","last_change":"2024-09-13T15:01:48.859142+0000","last_active":"2024-09-13T15:02:33.741624+0000","last_peered":"2024-09-13T15:02:33.741624+0000","last_clean":"2024-09-13T15:02:33.741624+0000","last_became_active":"2024-09-13T15:01:48.858649+0000","last_became_peered":"2024-09-13T15:01:48.858649+0000","last_unstale":"2024-09-13T15:02:33.741624+0000","last_undegraded":"2024-09-13T15:02:33.741624+0000","last_fullsized":"2024-09-13T15:02:33.741624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:27.314012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743419+0000","last_change":"2024-09-13T15:01:44.826501+0000","last_active":"2024-09-13T15:02:33.743419+0000","last_peered":"2024-09-13T15:02:33.743419+0000","last_clean":"2024-09-13T15:02:33.743419+0000","last_became_active":"2024-09-13T15:01:44.826222+0000","last_became_peered":"2024-09-13T15:01:44.826222+0000","last_unstale":"2024-09-13T15:02:33.743419+0000","last_undegraded":"2024-09-13T15:02:33.743419+0000","last_fullsized":"2024-09-13T15:02:33.743419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:00.543916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'1","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:03:43.891043+0000","last_change":"2024-09-13T15:01:44.421891+0000","last_active":"2024-09-13T15:03:43.891043+0000","last_peered":"2024-09-13T15:03:43.891043+0000","last_clean":"2024-09-13T15:03:43.891043+0000","last_became_active":"2024-09-13T15:01:44.419660+0000","last_became_peered":"2024-09-13T15:01:44.419660+0000","last_unstale":"2024-09-13T15:03:43.891043+0000","last_undegraded":"2024-09-13T15:03:43.891043+0000","last_fullsized":"2024-09-13T15:03:43.891043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:27.554128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.120816+0000","last_change":"2024-09-13T15:02:34.119111+0000","last_active":"2024-09-13T15:02:34.120816+0000","last_peered":"2024-09-13T15:02:34.120816+0000","last_clean":"2024-09-13T15:02:34.120816+0000","last_became_active":"2024-09-13T15:02:34.118461+0000","last_became_peered":"2024-09-13T15:02:34.118461+0000","last_unstale":"2024-09-13T15:02:34.120816+0000","last_undegraded":"2024-09-13T15:02:34.120816+0000","last_fullsized":"2024-09-13T15:02:34.120816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:35.096846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738701+0000","last_change":"2024-09-13T15:01:44.850498+0000","last_active":"2024-09-13T15:02:33.738701+0000","last_peered":"2024-09-13T15:02:33.738701+0000","last_clean":"2024-09-13T15:02:33.738701+0000","last_became_active":"2024-09-13T15:01:44.850234+0000","last_became_peered":"2024-09-13T15:01:44.850234+0000","last_unstale":"2024-09-13T15:02:33.738701+0000","last_undegraded":"2024-09-13T15:02:33.738701+0000","last_fullsized":"2024-09-13T15:02:33.738701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:37.202494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.599901+0000","last_change":"2024-09-13T15:01:44.411997+0000","last_active":"2024-09-13T15:04:17.599901+0000","last_peered":"2024-09-13T15:04:17.599901+0000","last_clean":"2024-09-13T15:04:17.599901+0000","last_became_active":"2024-09-13T15:01:44.410675+0000","last_became_peered":"2024-09-13T15:01:44.410675+0000","last_unstale":"2024-09-13T15:04:17.599901+0000","last_undegraded":"2024-09-13T15:04:17.599901+0000","last_fullsized":"2024-09-13T15:04:17.599901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:50:55.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116345+0000","last_change":"2024-09-13T15:01:40.834440+0000","last_active":"2024-09-13T15:02:34.116345+0000","last_peered":"2024-09-13T15:02:34.116345+0000","last_clean":"2024-09-13T15:02:34.116345+0000","last_became_active":"2024-09-13T15:01:40.832279+0000","last_became_peered":"2024-09-13T15:01:40.832279+0000","last_unstale":"2024-09-13T15:02:34.116345+0000","last_undegraded":"2024-09-13T15:02:34.116345+0000","last_fullsized":"2024-09-13T15:02:34.116345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_clean_scrub_stamp":"2024-09-13T15:01:39.264455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:11.875506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743545+0000","last_change":"2024-09-13T15:01:48.919580+0000","last_active":"2024-09-13T15:02:33.743545+0000","last_peered":"2024-09-13T15:02:33.743545+0000","last_clean":"2024-09-13T15:02:33.743545+0000","last_became_active":"2024-09-13T15:01:48.918678+0000","last_became_peered":"2024-09-13T15:01:48.918678+0000","last_unstale":"2024-09-13T15:02:33.743545+0000","last_undegraded":"2024-09-13T15:02:33.743545+0000","last_fullsized":"2024-09-13T15:02:33.743545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:02.840528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116879+0000","last_change":"2024-09-13T15:01:44.849975+0000","last_active":"2024-09-13T15:02:34.116879+0000","last_peered":"2024-09-13T15:02:34.116879+0000","last_clean":"2024-09-13T15:02:34.116879+0000","last_became_active":"2024-09-13T15:01:44.849457+0000","last_became_peered":"2024-09-13T15:01:44.849457+0000","last_unstale":"2024-09-13T15:02:34.116879+0000","last_undegraded":"2024-09-13T15:02:34.116879+0000","last_fullsized":"2024-09-13T15:02:34.116879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:51.139153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742016+0000","last_change":"2024-09-13T15:01:44.420906+0000","last_active":"2024-09-13T15:02:33.742016+0000","last_peered":"2024-09-13T15:02:33.742016+0000","last_clean":"2024-09-13T15:02:33.742016+0000","last_became_active":"2024-09-13T15:01:44.420601+0000","last_became_peered":"2024-09-13T15:01:44.420601+0000","last_unstale":"2024-09-13T15:02:33.742016+0000","last_undegraded":"2024-09-13T15:02:33.742016+0000","last_fullsized":"2024-09-13T15:02:33.742016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:33.245745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741847+0000","last_change":"2024-09-13T15:01:48.911047+0000","last_active":"2024-09-13T15:02:33.741847+0000","last_peered":"2024-09-13T15:02:33.741847+0000","last_clean":"2024-09-13T15:02:33.741847+0000","last_became_active":"2024-09-13T15:01:48.910479+0000","last_became_peered":"2024-09-13T15:01:48.910479+0000","last_unstale":"2024-09-13T15:02:33.741847+0000","last_undegraded":"2024-09-13T15:02:33.741847+0000","last_fullsized":"2024-09-13T15:02:33.741847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:06.558889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745346+0000","last_change":"2024-09-13T15:01:44.838098+0000","last_active":"2024-09-13T15:02:33.745346+0000","last_peered":"2024-09-13T15:02:33.745346+0000","last_clean":"2024-09-13T15:02:33.745346+0000","last_became_active":"2024-09-13T15:01:44.837429+0000","last_became_peered":"2024-09-13T15:01:44.837429+0000","last_unstale":"2024-09-13T15:02:33.745346+0000","last_undegraded":"2024-09-13T15:02:33.745346+0000","last_fullsized":"2024-09-13T15:02:33.745346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:37.795841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742419+0000","last_change":"2024-09-13T15:01:44.406999+0000","last_active":"2024-09-13T15:02:33.742419+0000","last_peered":"2024-09-13T15:02:33.742419+0000","last_clean":"2024-09-13T15:02:33.742419+0000","last_became_active":"2024-09-13T15:01:44.406719+0000","last_became_peered":"2024-09-13T15:01:44.406719+0000","last_unstale":"2024-09-13T15:02:33.742419+0000","last_undegraded":"2024-09-13T15:02:33.742419+0000","last_fullsized":"2024-09-13T15:02:33.742419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:33.397091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743939+0000","last_change":"2024-09-13T15:01:48.857931+0000","last_active":"2024-09-13T15:02:33.743939+0000","last_peered":"2024-09-13T15:02:33.743939+0000","last_clean":"2024-09-13T15:02:33.743939+0000","last_became_active":"2024-09-13T15:01:48.857542+0000","last_became_peered":"2024-09-13T15:01:48.857542+0000","last_unstale":"2024-09-13T15:02:33.743939+0000","last_undegraded":"2024-09-13T15:02:33.743939+0000","last_fullsized":"2024-09-13T15:02:33.743939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:32.805405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118403+0000","last_change":"2024-09-13T15:01:44.835470+0000","last_active":"2024-09-13T15:02:34.118403+0000","last_peered":"2024-09-13T15:02:34.118403+0000","last_clean":"2024-09-13T15:02:34.118403+0000","last_became_active":"2024-09-13T15:01:44.831166+0000","last_became_peered":"2024-09-13T15:01:44.831166+0000","last_unstale":"2024-09-13T15:02:34.118403+0000","last_undegraded":"2024-09-13T15:02:34.118403+0000","last_fullsized":"2024-09-13T15:02:34.118403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:05.887592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"25'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742413+0000","last_change":"2024-09-13T15:01:44.403111+0000","last_active":"2024-09-13T15:02:33.742413+0000","last_peered":"2024-09-13T15:02:33.742413+0000","last_clean":"2024-09-13T15:02:33.742413+0000","last_became_active":"2024-09-13T15:01:44.401799+0000","last_became_peered":"2024-09-13T15:01:44.401799+0000","last_unstale":"2024-09-13T15:02:33.742413+0000","last_undegraded":"2024-09-13T15:02:33.742413+0000","last_fullsized":"2024-09-13T15:02:33.742413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:54.589470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740292+0000","last_change":"2024-09-13T15:01:48.912490+0000","last_active":"2024-09-13T15:02:33.740292+0000","last_peered":"2024-09-13T15:02:33.740292+0000","last_clean":"2024-09-13T15:02:33.740292+0000","last_became_active":"2024-09-13T15:01:48.911474+0000","last_became_peered":"2024-09-13T15:01:48.911474+0000","last_unstale":"2024-09-13T15:02:33.740292+0000","last_undegraded":"2024-09-13T15:02:33.740292+0000","last_fullsized":"2024-09-13T15:02:33.740292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:54.295921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117960+0000","last_change":"2024-09-13T15:01:44.818472+0000","last_active":"2024-09-13T15:02:34.117960+0000","last_peered":"2024-09-13T15:02:34.117960+0000","last_clean":"2024-09-13T15:02:34.117960+0000","last_became_active":"2024-09-13T15:01:44.817718+0000","last_became_peered":"2024-09-13T15:01:44.817718+0000","last_unstale":"2024-09-13T15:02:34.117960+0000","last_undegraded":"2024-09-13T15:02:34.117960+0000","last_fullsized":"2024-09-13T15:02:34.117960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:21.310696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"25'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.750292+0000","last_change":"2024-09-13T15:01:44.410376+0000","last_active":"2024-09-13T15:02:33.750292+0000","last_peered":"2024-09-13T15:02:33.750292+0000","last_clean":"2024-09-13T15:02:33.750292+0000","last_became_active":"2024-09-13T15:01:44.409585+0000","last_became_peered":"2024-09-13T15:01:44.409585+0000","last_unstale":"2024-09-13T15:02:33.750292+0000","last_undegraded":"2024-09-13T15:02:33.750292+0000","last_fullsized":"2024-09-13T15:02:33.750292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:45.845804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.747358+0000","last_change":"2024-09-13T15:01:48.861130+0000","last_active":"2024-09-13T15:02:33.747358+0000","last_peered":"2024-09-13T15:02:33.747358+0000","last_clean":"2024-09-13T15:02:33.747358+0000","last_became_active":"2024-09-13T15:01:48.860317+0000","last_became_peered":"2024-09-13T15:01:48.860317+0000","last_unstale":"2024-09-13T15:02:33.747358+0000","last_undegraded":"2024-09-13T15:02:33.747358+0000","last_fullsized":"2024-09-13T15:02:33.747358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:45.317747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116786+0000","last_change":"2024-09-13T15:01:44.835494+0000","last_active":"2024-09-13T15:02:34.116786+0000","last_peered":"2024-09-13T15:02:34.116786+0000","last_clean":"2024-09-13T15:02:34.116786+0000","last_became_active":"2024-09-13T15:01:44.831150+0000","last_became_peered":"2024-09-13T15:01:44.831150+0000","last_unstale":"2024-09-13T15:02:34.116786+0000","last_undegraded":"2024-09-13T15:02:34.116786+0000","last_fullsized":"2024-09-13T15:02:34.116786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:29.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'10","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.607551+0000","last_change":"2024-09-13T15:01:44.390278+0000","last_active":"2024-09-13T15:04:17.607551+0000","last_peered":"2024-09-13T15:04:17.607551+0000","last_clean":"2024-09-13T15:04:17.607551+0000","last_became_active":"2024-09-13T15:01:44.389946+0000","last_became_peered":"2024-09-13T15:01:44.389946+0000","last_unstale":"2024-09-13T15:04:17.607551+0000","last_undegraded":"2024-09-13T15:04:17.607551+0000","last_fullsized":"2024-09-13T15:04:17.607551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:53.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744367+0000","last_change":"2024-09-13T15:01:48.848009+0000","last_active":"2024-09-13T15:02:33.744367+0000","last_peered":"2024-09-13T15:02:33.744367+0000","last_clean":"2024-09-13T15:02:33.744367+0000","last_became_active":"2024-09-13T15:01:48.847605+0000","last_became_peered":"2024-09-13T15:01:48.847605+0000","last_unstale":"2024-09-13T15:02:33.744367+0000","last_undegraded":"2024-09-13T15:02:33.744367+0000","last_fullsized":"2024-09-13T15:02:33.744367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:32.053010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741353+0000","last_change":"2024-09-13T15:01:44.808572+0000","last_active":"2024-09-13T15:02:33.741353+0000","last_peered":"2024-09-13T15:02:33.741353+0000","last_clean":"2024-09-13T15:02:33.741353+0000","last_became_active":"2024-09-13T15:01:44.808140+0000","last_became_peered":"2024-09-13T15:01:44.808140+0000","last_unstale":"2024-09-13T15:02:33.741353+0000","last_undegraded":"2024-09-13T15:02:33.741353+0000","last_fullsized":"2024-09-13T15:02:33.741353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:15.497720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742109+0000","last_change":"2024-09-13T15:01:44.428794+0000","last_active":"2024-09-13T15:02:33.742109+0000","last_peered":"2024-09-13T15:02:33.742109+0000","last_clean":"2024-09-13T15:02:33.742109+0000","last_became_active":"2024-09-13T15:01:44.428271+0000","last_became_peered":"2024-09-13T15:01:44.428271+0000","last_unstale":"2024-09-13T15:02:33.742109+0000","last_undegraded":"2024-09-13T15:02:33.742109+0000","last_fullsized":"2024-09-13T15:02:33.742109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:53.225826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738469+0000","last_change":"2024-09-13T15:01:48.916354+0000","last_active":"2024-09-13T15:02:33.738469+0000","last_peered":"2024-09-13T15:02:33.738469+0000","last_clean":"2024-09-13T15:02:33.738469+0000","last_became_active":"2024-09-13T15:01:48.916008+0000","last_became_peered":"2024-09-13T15:01:48.916008+0000","last_unstale":"2024-09-13T15:02:33.738469+0000","last_undegraded":"2024-09-13T15:02:33.738469+0000","last_fullsized":"2024-09-13T15:02:33.738469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:58.115410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116589+0000","last_change":"2024-09-13T15:01:44.826700+0000","last_active":"2024-09-13T15:02:34.116589+0000","last_peered":"2024-09-13T15:02:34.116589+0000","last_clean":"2024-09-13T15:02:34.116589+0000","last_became_active":"2024-09-13T15:01:44.825996+0000","last_became_peered":"2024-09-13T15:01:44.825996+0000","last_unstale":"2024-09-13T15:02:34.116589+0000","last_undegraded":"2024-09-13T15:02:34.116589+0000","last_fullsized":"2024-09-13T15:02:34.116589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:11.963837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.604521+0000","last_change":"2024-09-13T15:01:44.409339+0000","last_active":"2024-09-13T15:04:17.604521+0000","last_peered":"2024-09-13T15:04:17.604521+0000","last_clean":"2024-09-13T15:04:17.604521+0000","last_became_active":"2024-09-13T15:01:44.408644+0000","last_became_peered":"2024-09-13T15:01:44.408644+0000","last_unstale":"2024-09-13T15:04:17.604521+0000","last_undegraded":"2024-09-13T15:04:17.604521+0000","last_fullsized":"2024-09-13T15:04:17.604521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:29.297950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737959+0000","last_change":"2024-09-13T15:01:48.916478+0000","last_active":"2024-09-13T15:02:33.737959+0000","last_peered":"2024-09-13T15:02:33.737959+0000","last_clean":"2024-09-13T15:02:33.737959+0000","last_became_active":"2024-09-13T15:01:48.916198+0000","last_became_peered":"2024-09-13T15:01:48.916198+0000","last_unstale":"2024-09-13T15:02:33.737959+0000","last_undegraded":"2024-09-13T15:02:33.737959+0000","last_fullsized":"2024-09-13T15:02:33.737959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:26.311460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743617+0000","last_change":"2024-09-13T15:01:44.831833+0000","last_active":"2024-09-13T15:02:33.743617+0000","last_peered":"2024-09-13T15:02:33.743617+0000","last_clean":"2024-09-13T15:02:33.743617+0000","last_became_active":"2024-09-13T15:01:44.831583+0000","last_became_peered":"2024-09-13T15:01:44.831583+0000","last_unstale":"2024-09-13T15:02:33.743617+0000","last_undegraded":"2024-09-13T15:02:33.743617+0000","last_fullsized":"2024-09-13T15:02:33.743617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.715951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.603434+0000","last_change":"2024-09-13T15:01:44.408752+0000","last_active":"2024-09-13T15:04:17.603434+0000","last_peered":"2024-09-13T15:04:17.603434+0000","last_clean":"2024-09-13T15:04:17.603434+0000","last_became_active":"2024-09-13T15:01:44.408453+0000","last_became_peered":"2024-09-13T15:01:44.408453+0000","last_unstale":"2024-09-13T15:04:17.603434+0000","last_undegraded":"2024-09-13T15:04:17.603434+0000","last_fullsized":"2024-09-13T15:04:17.603434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:31.587404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743419+0000","last_change":"2024-09-13T15:01:48.916681+0000","last_active":"2024-09-13T15:02:33.743419+0000","last_peered":"2024-09-13T15:02:33.743419+0000","last_clean":"2024-09-13T15:02:33.743419+0000","last_became_active":"2024-09-13T15:01:48.916185+0000","last_became_peered":"2024-09-13T15:01:48.916185+0000","last_unstale":"2024-09-13T15:02:33.743419+0000","last_undegraded":"2024-09-13T15:02:33.743419+0000","last_fullsized":"2024-09-13T15:02:33.743419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:33.862835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116757+0000","last_change":"2024-09-13T15:01:44.817007+0000","last_active":"2024-09-13T15:02:34.116757+0000","last_peered":"2024-09-13T15:02:34.116757+0000","last_clean":"2024-09-13T15:02:34.116757+0000","last_became_active":"2024-09-13T15:01:44.815435+0000","last_became_peered":"2024-09-13T15:01:44.815435+0000","last_unstale":"2024-09-13T15:02:34.116757+0000","last_undegraded":"2024-09-13T15:02:34.116757+0000","last_fullsized":"2024-09-13T15:02:34.116757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:25.887993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'12","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.598910+0000","last_change":"2024-09-13T15:01:44.435688+0000","last_active":"2024-09-13T15:04:17.598910+0000","last_peered":"2024-09-13T15:04:17.598910+0000","last_clean":"2024-09-13T15:04:17.598910+0000","last_became_active":"2024-09-13T15:01:44.435222+0000","last_became_peered":"2024-09-13T15:01:44.435222+0000","last_unstale":"2024-09-13T15:04:17.598910+0000","last_undegraded":"2024-09-13T15:04:17.598910+0000","last_fullsized":"2024-09-13T15:04:17.598910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:24.705633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742810+0000","last_change":"2024-09-13T15:01:48.847694+0000","last_active":"2024-09-13T15:02:33.742810+0000","last_peered":"2024-09-13T15:02:33.742810+0000","last_clean":"2024-09-13T15:02:33.742810+0000","last_became_active":"2024-09-13T15:01:48.846835+0000","last_became_peered":"2024-09-13T15:01:48.846835+0000","last_unstale":"2024-09-13T15:02:33.742810+0000","last_undegraded":"2024-09-13T15:02:33.742810+0000","last_fullsized":"2024-09-13T15:02:33.742810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:49.763472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749658+0000","last_change":"2024-09-13T15:01:44.835315+0000","last_active":"2024-09-13T15:02:33.749658+0000","last_peered":"2024-09-13T15:02:33.749658+0000","last_clean":"2024-09-13T15:02:33.749658+0000","last_became_active":"2024-09-13T15:01:44.834643+0000","last_became_peered":"2024-09-13T15:01:44.834643+0000","last_unstale":"2024-09-13T15:02:33.749658+0000","last_undegraded":"2024-09-13T15:02:33.749658+0000","last_fullsized":"2024-09-13T15:02:33.749658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:15.535195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:08.884570+0000","last_change":"2024-09-13T15:01:44.424966+0000","last_active":"2024-09-13T15:04:08.884570+0000","last_peered":"2024-09-13T15:04:08.884570+0000","last_clean":"2024-09-13T15:04:08.884570+0000","last_became_active":"2024-09-13T15:01:44.424714+0000","last_became_peered":"2024-09-13T15:01:44.424714+0000","last_unstale":"2024-09-13T15:04:08.884570+0000","last_undegraded":"2024-09-13T15:04:08.884570+0000","last_fullsized":"2024-09-13T15:04:08.884570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:46.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.756425+0000","last_change":"2024-09-13T15:02:33.753482+0000","last_active":"2024-09-13T15:02:33.756425+0000","last_peered":"2024-09-13T15:02:33.756425+0000","last_clean":"2024-09-13T15:02:33.756425+0000","last_became_active":"2024-09-13T15:02:33.752505+0000","last_became_peered":"2024-09-13T15:02:33.752505+0000","last_unstale":"2024-09-13T15:02:33.756425+0000","last_undegraded":"2024-09-13T15:02:33.756425+0000","last_fullsized":"2024-09-13T15:02:33.756425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:59.041586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742572+0000","last_change":"2024-09-13T15:01:44.837032+0000","last_active":"2024-09-13T15:02:33.742572+0000","last_peered":"2024-09-13T15:02:33.742572+0000","last_clean":"2024-09-13T15:02:33.742572+0000","last_became_active":"2024-09-13T15:01:44.836750+0000","last_became_peered":"2024-09-13T15:01:44.836750+0000","last_unstale":"2024-09-13T15:02:33.742572+0000","last_undegraded":"2024-09-13T15:02:33.742572+0000","last_fullsized":"2024-09-13T15:02:33.742572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:04.491426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.594750+0000","last_change":"2024-09-13T15:01:44.437854+0000","last_active":"2024-09-13T15:04:17.594750+0000","last_peered":"2024-09-13T15:04:17.594750+0000","last_clean":"2024-09-13T15:04:17.594750+0000","last_became_active":"2024-09-13T15:01:44.437433+0000","last_became_peered":"2024-09-13T15:01:44.437433+0000","last_unstale":"2024-09-13T15:04:17.594750+0000","last_undegraded":"2024-09-13T15:04:17.594750+0000","last_fullsized":"2024-09-13T15:04:17.594750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:47.302388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737553+0000","last_change":"2024-09-13T15:01:48.841829+0000","last_active":"2024-09-13T15:02:33.737553+0000","last_peered":"2024-09-13T15:02:33.737553+0000","last_clean":"2024-09-13T15:02:33.737553+0000","last_became_active":"2024-09-13T15:01:48.841267+0000","last_became_peered":"2024-09-13T15:01:48.841267+0000","last_unstale":"2024-09-13T15:02:33.737553+0000","last_undegraded":"2024-09-13T15:02:33.737553+0000","last_fullsized":"2024-09-13T15:02:33.737553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:25.029615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.746815+0000","last_change":"2024-09-13T15:01:44.844701+0000","last_active":"2024-09-13T15:02:33.746815+0000","last_peered":"2024-09-13T15:02:33.746815+0000","last_clean":"2024-09-13T15:02:33.746815+0000","last_became_active":"2024-09-13T15:01:44.843982+0000","last_became_peered":"2024-09-13T15:01:44.843982+0000","last_unstale":"2024-09-13T15:02:33.746815+0000","last_undegraded":"2024-09-13T15:02:33.746815+0000","last_fullsized":"2024-09-13T15:02:33.746815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.601800+0000","last_change":"2024-09-13T15:01:44.436081+0000","last_active":"2024-09-13T15:04:17.601800+0000","last_peered":"2024-09-13T15:04:17.601800+0000","last_clean":"2024-09-13T15:04:17.601800+0000","last_became_active":"2024-09-13T15:01:44.435367+0000","last_became_peered":"2024-09-13T15:01:44.435367+0000","last_unstale":"2024-09-13T15:04:17.601800+0000","last_undegraded":"2024-09-13T15:04:17.601800+0000","last_fullsized":"2024-09-13T15:04:17.601800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:57:57.065719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737590+0000","last_change":"2024-09-13T15:01:48.910562+0000","last_active":"2024-09-13T15:02:33.737590+0000","last_peered":"2024-09-13T15:02:33.737590+0000","last_clean":"2024-09-13T15:02:33.737590+0000","last_became_active":"2024-09-13T15:01:48.909681+0000","last_became_peered":"2024-09-13T15:01:48.909681+0000","last_unstale":"2024-09-13T15:02:33.737590+0000","last_undegraded":"2024-09-13T15:02:33.737590+0000","last_fullsized":"2024-09-13T15:02:33.737590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:35.989769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.120759+0000","last_change":"2024-09-13T15:02:34.118951+0000","last_active":"2024-09-13T15:02:34.120759+0000","last_peered":"2024-09-13T15:02:34.120759+0000","last_clean":"2024-09-13T15:02:34.120759+0000","last_became_active":"2024-09-13T15:02:34.118477+0000","last_became_peered":"2024-09-13T15:02:34.118477+0000","last_unstale":"2024-09-13T15:02:34.120759+0000","last_undegraded":"2024-09-13T15:02:34.120759+0000","last_fullsized":"2024-09-13T15:02:34.120759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:13.697114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741807+0000","last_change":"2024-09-13T15:01:44.808417+0000","last_active":"2024-09-13T15:02:33.741807+0000","last_peered":"2024-09-13T15:02:33.741807+0000","last_clean":"2024-09-13T15:02:33.741807+0000","last_became_active":"2024-09-13T15:01:44.807641+0000","last_became_peered":"2024-09-13T15:01:44.807641+0000","last_unstale":"2024-09-13T15:02:33.741807+0000","last_undegraded":"2024-09-13T15:02:33.741807+0000","last_fullsized":"2024-09-13T15:02:33.741807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:58.296966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:08.897338+0000","last_change":"2024-09-13T15:01:44.433582+0000","last_active":"2024-09-13T15:04:08.897338+0000","last_peered":"2024-09-13T15:04:08.897338+0000","last_clean":"2024-09-13T15:04:08.897338+0000","last_became_active":"2024-09-13T15:01:44.433124+0000","last_became_peered":"2024-09-13T15:01:44.433124+0000","last_unstale":"2024-09-13T15:04:08.897338+0000","last_undegraded":"2024-09-13T15:04:08.897338+0000","last_fullsized":"2024-09-13T15:04:08.897338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:04.476996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744178+0000","last_change":"2024-09-13T15:01:48.855090+0000","last_active":"2024-09-13T15:02:33.744178+0000","last_peered":"2024-09-13T15:02:33.744178+0000","last_clean":"2024-09-13T15:02:33.744178+0000","last_became_active":"2024-09-13T15:01:48.852925+0000","last_became_peered":"2024-09-13T15:01:48.852925+0000","last_unstale":"2024-09-13T15:02:33.744178+0000","last_undegraded":"2024-09-13T15:02:33.744178+0000","last_fullsized":"2024-09-13T15:02:33.744178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.176480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748607+0000","last_change":"2024-09-13T15:02:33.746356+0000","last_active":"2024-09-13T15:02:33.748607+0000","last_peered":"2024-09-13T15:02:33.748607+0000","last_clean":"2024-09-13T15:02:33.748607+0000","last_became_active":"2024-09-13T15:02:33.746005+0000","last_became_peered":"2024-09-13T15:02:33.746005+0000","last_unstale":"2024-09-13T15:02:33.748607+0000","last_undegraded":"2024-09-13T15:02:33.748607+0000","last_fullsized":"2024-09-13T15:02:33.748607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:41.159781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737817+0000","last_change":"2024-09-13T15:01:44.436900+0000","last_active":"2024-09-13T15:02:33.737817+0000","last_peered":"2024-09-13T15:02:33.737817+0000","last_clean":"2024-09-13T15:02:33.737817+0000","last_became_active":"2024-09-13T15:01:44.436646+0000","last_became_peered":"2024-09-13T15:01:44.436646+0000","last_unstale":"2024-09-13T15:02:33.737817+0000","last_undegraded":"2024-09-13T15:02:33.737817+0000","last_fullsized":"2024-09-13T15:02:33.737817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:52.505856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"25'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742710+0000","last_change":"2024-09-13T15:01:44.430115+0000","last_active":"2024-09-13T15:02:33.742710+0000","last_peered":"2024-09-13T15:02:33.742710+0000","last_clean":"2024-09-13T15:02:33.742710+0000","last_became_active":"2024-09-13T15:01:44.429339+0000","last_became_peered":"2024-09-13T15:01:44.429339+0000","last_unstale":"2024-09-13T15:02:33.742710+0000","last_undegraded":"2024-09-13T15:02:33.742710+0000","last_fullsized":"2024-09-13T15:02:33.742710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:47.224125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744095+0000","last_change":"2024-09-13T15:01:44.822034+0000","last_active":"2024-09-13T15:02:33.744095+0000","last_peered":"2024-09-13T15:02:33.744095+0000","last_clean":"2024-09-13T15:02:33.744095+0000","last_became_active":"2024-09-13T15:01:44.821734+0000","last_became_peered":"2024-09-13T15:01:44.821734+0000","last_unstale":"2024-09-13T15:02:33.744095+0000","last_undegraded":"2024-09-13T15:02:33.744095+0000","last_fullsized":"2024-09-13T15:02:33.744095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:57:44.629046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741811+0000","last_change":"2024-09-13T15:01:48.858033+0000","last_active":"2024-09-13T15:02:33.741811+0000","last_peered":"2024-09-13T15:02:33.741811+0000","last_clean":"2024-09-13T15:02:33.741811+0000","last_became_active":"2024-09-13T15:01:48.857584+0000","last_became_peered":"2024-09-13T15:01:48.857584+0000","last_unstale":"2024-09-13T15:02:33.741811+0000","last_undegraded":"2024-09-13T15:02:33.741811+0000","last_fullsized":"2024-09-13T15:02:33.741811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:04.797167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'5","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.610821+0000","last_change":"2024-09-13T15:01:44.422582+0000","last_active":"2024-09-13T15:04:17.610821+0000","last_peered":"2024-09-13T15:04:17.610821+0000","last_clean":"2024-09-13T15:04:17.610821+0000","last_became_active":"2024-09-13T15:01:44.422367+0000","last_became_peered":"2024-09-13T15:01:44.422367+0000","last_unstale":"2024-09-13T15:04:17.610821+0000","last_undegraded":"2024-09-13T15:04:17.610821+0000","last_fullsized":"2024-09-13T15:04:17.610821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.902724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748800+0000","last_change":"2024-09-13T15:01:44.820841+0000","last_active":"2024-09-13T15:02:33.748800+0000","last_peered":"2024-09-13T15:02:33.748800+0000","last_clean":"2024-09-13T15:02:33.748800+0000","last_became_active":"2024-09-13T15:01:44.816584+0000","last_became_peered":"2024-09-13T15:01:44.816584+0000","last_unstale":"2024-09-13T15:02:33.748800+0000","last_undegraded":"2024-09-13T15:02:33.748800+0000","last_fullsized":"2024-09-13T15:02:33.748800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:26.763818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738483+0000","last_change":"2024-09-13T15:01:48.840771+0000","last_active":"2024-09-13T15:02:33.738483+0000","last_peered":"2024-09-13T15:02:33.738483+0000","last_clean":"2024-09-13T15:02:33.738483+0000","last_became_active":"2024-09-13T15:01:48.840397+0000","last_became_peered":"2024-09-13T15:01:48.840397+0000","last_unstale":"2024-09-13T15:02:33.738483+0000","last_undegraded":"2024-09-13T15:02:33.738483+0000","last_fullsized":"2024-09-13T15:02:33.738483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:59.700088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741113+0000","last_change":"2024-09-13T15:01:44.809497+0000","last_active":"2024-09-13T15:02:33.741113+0000","last_peered":"2024-09-13T15:02:33.741113+0000","last_clean":"2024-09-13T15:02:33.741113+0000","last_became_active":"2024-09-13T15:01:44.808669+0000","last_became_peered":"2024-09-13T15:01:44.808669+0000","last_unstale":"2024-09-13T15:02:33.741113+0000","last_undegraded":"2024-09-13T15:02:33.741113+0000","last_fullsized":"2024-09-13T15:02:33.741113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:45.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744117+0000","last_change":"2024-09-13T15:01:44.836353+0000","last_active":"2024-09-13T15:02:33.744117+0000","last_peered":"2024-09-13T15:02:33.744117+0000","last_clean":"2024-09-13T15:02:33.744117+0000","last_became_active":"2024-09-13T15:01:44.836102+0000","last_became_peered":"2024-09-13T15:01:44.836102+0000","last_unstale":"2024-09-13T15:02:33.744117+0000","last_undegraded":"2024-09-13T15:02:33.744117+0000","last_fullsized":"2024-09-13T15:02:33.744117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:14.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741973+0000","last_change":"2024-09-13T15:01:44.849091+0000","last_active":"2024-09-13T15:02:33.741973+0000","last_peered":"2024-09-13T15:02:33.741973+0000","last_clean":"2024-09-13T15:02:33.741973+0000","last_became_active":"2024-09-13T15:01:44.846506+0000","last_became_peered":"2024-09-13T15:01:44.846506+0000","last_unstale":"2024-09-13T15:02:33.741973+0000","last_undegraded":"2024-09-13T15:02:33.741973+0000","last_fullsized":"2024-09-13T15:02:33.741973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:38.026998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743939+0000","last_change":"2024-09-13T15:01:44.809873+0000","last_active":"2024-09-13T15:02:33.743939+0000","last_peered":"2024-09-13T15:02:33.743939+0000","last_clean":"2024-09-13T15:02:33.743939+0000","last_became_active":"2024-09-13T15:01:44.809585+0000","last_became_peered":"2024-09-13T15:01:44.809585+0000","last_unstale":"2024-09-13T15:02:33.743939+0000","last_undegraded":"2024-09-13T15:02:33.743939+0000","last_fullsized":"2024-09-13T15:02:33.743939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:20.272320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738378+0000","last_change":"2024-09-13T15:01:44.816761+0000","last_active":"2024-09-13T15:02:33.738378+0000","last_peered":"2024-09-13T15:02:33.738378+0000","last_clean":"2024-09-13T15:02:33.738378+0000","last_became_active":"2024-09-13T15:01:44.816480+0000","last_became_peered":"2024-09-13T15:01:44.816480+0000","last_unstale":"2024-09-13T15:02:33.738378+0000","last_undegraded":"2024-09-13T15:02:33.738378+0000","last_fullsized":"2024-09-13T15:02:33.738378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:46.000440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742115+0000","last_change":"2024-09-13T15:01:44.808373+0000","last_active":"2024-09-13T15:02:33.742115+0000","last_peered":"2024-09-13T15:02:33.742115+0000","last_clean":"2024-09-13T15:02:33.742115+0000","last_became_active":"2024-09-13T15:01:44.807622+0000","last_became_peered":"2024-09-13T15:01:44.807622+0000","last_unstale":"2024-09-13T15:02:33.742115+0000","last_undegraded":"2024-09-13T15:02:33.742115+0000","last_fullsized":"2024-09-13T15:02:33.742115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:38.584426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745064+0000","last_change":"2024-09-13T15:01:44.832521+0000","last_active":"2024-09-13T15:02:33.745064+0000","last_peered":"2024-09-13T15:02:33.745064+0000","last_clean":"2024-09-13T15:02:33.745064+0000","last_became_active":"2024-09-13T15:01:44.831889+0000","last_became_peered":"2024-09-13T15:01:44.831889+0000","last_unstale":"2024-09-13T15:02:33.745064+0000","last_undegraded":"2024-09-13T15:02:33.745064+0000","last_fullsized":"2024-09-13T15:02:33.745064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:07.563684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738576+0000","last_change":"2024-09-13T15:01:44.817583+0000","last_active":"2024-09-13T15:02:33.738576+0000","last_peered":"2024-09-13T15:02:33.738576+0000","last_clean":"2024-09-13T15:02:33.738576+0000","last_became_active":"2024-09-13T15:01:44.817350+0000","last_became_peered":"2024-09-13T15:01:44.817350+0000","last_unstale":"2024-09-13T15:02:33.738576+0000","last_undegraded":"2024-09-13T15:02:33.738576+0000","last_fullsized":"2024-09-13T15:02:33.738576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:10.913776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740529+0000","last_change":"2024-09-13T15:01:44.838372+0000","last_active":"2024-09-13T15:02:33.740529+0000","last_peered":"2024-09-13T15:02:33.740529+0000","last_clean":"2024-09-13T15:02:33.740529+0000","last_became_active":"2024-09-13T15:01:44.837588+0000","last_became_peered":"2024-09-13T15:01:44.837588+0000","last_unstale":"2024-09-13T15:02:33.740529+0000","last_undegraded":"2024-09-13T15:02:33.740529+0000","last_fullsized":"2024-09-13T15:02:33.740529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:05:12.877936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737718+0000","last_change":"2024-09-13T15:01:44.828159+0000","last_active":"2024-09-13T15:02:33.737718+0000","last_peered":"2024-09-13T15:02:33.737718+0000","last_clean":"2024-09-13T15:02:33.737718+0000","last_became_active":"2024-09-13T15:01:44.827910+0000","last_became_peered":"2024-09-13T15:01:44.827910+0000","last_unstale":"2024-09-13T15:02:33.737718+0000","last_undegraded":"2024-09-13T15:02:33.737718+0000","last_fullsized":"2024-09-13T15:02:33.737718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:07:32.776119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.119204+0000","last_change":"2024-09-13T15:02:34.119204+0000","last_active":"2024-09-13T15:02:34.119204+0000","last_peered":"2024-09-13T15:02:34.119204+0000","last_clean":"2024-09-13T15:02:34.119204+0000","last_became_active":"2024-09-13T15:02:34.118621+0000","last_became_peered":"2024-09-13T15:02:34.118621+0000","last_unstale":"2024-09-13T15:02:34.119204+0000","last_undegraded":"2024-09-13T15:02:34.119204+0000","last_fullsized":"2024-09-13T15:02:34.119204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:33.356064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743857+0000","last_change":"2024-09-13T15:01:44.831717+0000","last_active":"2024-09-13T15:02:33.743857+0000","last_peered":"2024-09-13T15:02:33.743857+0000","last_clean":"2024-09-13T15:02:33.743857+0000","last_became_active":"2024-09-13T15:01:44.831495+0000","last_became_peered":"2024-09-13T15:01:44.831495+0000","last_unstale":"2024-09-13T15:02:33.743857+0000","last_undegraded":"2024-09-13T15:02:33.743857+0000","last_fullsized":"2024-09-13T15:02:33.743857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:48.753543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743869+0000","last_change":"2024-09-13T15:01:44.829698+0000","last_active":"2024-09-13T15:02:33.743869+0000","last_peered":"2024-09-13T15:02:33.743869+0000","last_clean":"2024-09-13T15:02:33.743869+0000","last_became_active":"2024-09-13T15:01:44.828999+0000","last_became_peered":"2024-09-13T15:01:44.828999+0000","last_unstale":"2024-09-13T15:02:33.743869+0000","last_undegraded":"2024-09-13T15:02:33.743869+0000","last_fullsized":"2024-09-13T15:02:33.743869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:30.591718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117647+0000","last_change":"2024-09-13T15:01:44.817554+0000","last_active":"2024-09-13T15:02:34.117647+0000","last_peered":"2024-09-13T15:02:34.117647+0000","last_clean":"2024-09-13T15:02:34.117647+0000","last_became_active":"2024-09-13T15:01:44.816258+0000","last_became_peered":"2024-09-13T15:01:44.816258+0000","last_unstale":"2024-09-13T15:02:34.117647+0000","last_undegraded":"2024-09-13T15:02:34.117647+0000","last_fullsized":"2024-09-13T15:02:34.117647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:07.927802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742322+0000","last_change":"2024-09-13T15:01:44.809979+0000","last_active":"2024-09-13T15:02:33.742322+0000","last_peered":"2024-09-13T15:02:33.742322+0000","last_clean":"2024-09-13T15:02:33.742322+0000","last_became_active":"2024-09-13T15:01:44.809687+0000","last_became_peered":"2024-09-13T15:01:44.809687+0000","last_unstale":"2024-09-13T15:02:33.742322+0000","last_undegraded":"2024-09-13T15:02:33.742322+0000","last_fullsized":"2024-09-13T15:02:33.742322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:45.583840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.119233+0000","last_change":"2024-09-13T15:02:34.119233+0000","last_active":"2024-09-13T15:02:34.119233+0000","last_peered":"2024-09-13T15:02:34.119233+0000","last_clean":"2024-09-13T15:02:34.119233+0000","last_became_active":"2024-09-13T15:02:34.118798+0000","last_became_peered":"2024-09-13T15:02:34.118798+0000","last_unstale":"2024-09-13T15:02:34.119233+0000","last_undegraded":"2024-09-13T15:02:34.119233+0000","last_fullsized":"2024-09-13T15:02:34.119233+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:12.367569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740392+0000","last_change":"2024-09-13T15:01:44.848904+0000","last_active":"2024-09-13T15:02:33.740392+0000","last_peered":"2024-09-13T15:02:33.740392+0000","last_clean":"2024-09-13T15:02:33.740392+0000","last_became_active":"2024-09-13T15:01:44.846074+0000","last_became_peered":"2024-09-13T15:01:44.846074+0000","last_unstale":"2024-09-13T15:02:33.740392+0000","last_undegraded":"2024-09-13T15:02:33.740392+0000","last_fullsized":"2024-09-13T15:02:33.740392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:37.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741904+0000","last_change":"2024-09-13T15:01:44.828243+0000","last_active":"2024-09-13T15:02:33.741904+0000","last_peered":"2024-09-13T15:02:33.741904+0000","last_clean":"2024-09-13T15:02:33.741904+0000","last_became_active":"2024-09-13T15:01:44.828024+0000","last_became_peered":"2024-09-13T15:01:44.828024+0000","last_unstale":"2024-09-13T15:02:33.741904+0000","last_undegraded":"2024-09-13T15:02:33.741904+0000","last_fullsized":"2024-09-13T15:02:33.741904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:28:47.388087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743573+0000","last_change":"2024-09-13T15:01:44.808879+0000","last_active":"2024-09-13T15:02:33.743573+0000","last_peered":"2024-09-13T15:02:33.743573+0000","last_clean":"2024-09-13T15:02:33.743573+0000","last_became_active":"2024-09-13T15:01:44.808609+0000","last_became_peered":"2024-09-13T15:01:44.808609+0000","last_unstale":"2024-09-13T15:02:33.743573+0000","last_undegraded":"2024-09-13T15:02:33.743573+0000","last_fullsized":"2024-09-13T15:02:33.743573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:59.817452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738213+0000","last_change":"2024-09-13T15:01:44.811171+0000","last_active":"2024-09-13T15:02:33.738213+0000","last_peered":"2024-09-13T15:02:33.738213+0000","last_clean":"2024-09-13T15:02:33.738213+0000","last_became_active":"2024-09-13T15:01:44.809918+0000","last_became_peered":"2024-09-13T15:01:44.809918+0000","last_unstale":"2024-09-13T15:02:33.738213+0000","last_undegraded":"2024-09-13T15:02:33.738213+0000","last_fullsized":"2024-09-13T15:02:33.738213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:48.359429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749385+0000","last_change":"2024-09-13T15:01:44.833663+0000","last_active":"2024-09-13T15:02:33.749385+0000","last_peered":"2024-09-13T15:02:33.749385+0000","last_clean":"2024-09-13T15:02:33.749385+0000","last_became_active":"2024-09-13T15:01:44.828737+0000","last_became_peered":"2024-09-13T15:01:44.828737+0000","last_unstale":"2024-09-13T15:02:33.749385+0000","last_undegraded":"2024-09-13T15:02:33.749385+0000","last_fullsized":"2024-09-13T15:02:33.749385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:08.579890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744005+0000","last_change":"2024-09-13T15:01:44.851143+0000","last_active":"2024-09-13T15:02:33.744005+0000","last_peered":"2024-09-13T15:02:33.744005+0000","last_clean":"2024-09-13T15:02:33.744005+0000","last_became_active":"2024-09-13T15:01:44.850410+0000","last_became_peered":"2024-09-13T15:01:44.850410+0000","last_unstale":"2024-09-13T15:02:33.744005+0000","last_undegraded":"2024-09-13T15:02:33.744005+0000","last_fullsized":"2024-09-13T15:02:33.744005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:11.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744851+0000","last_change":"2024-09-13T15:01:44.840082+0000","last_active":"2024-09-13T15:02:33.744851+0000","last_peered":"2024-09-13T15:02:33.744851+0000","last_clean":"2024-09-13T15:02:33.744851+0000","last_became_active":"2024-09-13T15:01:44.839371+0000","last_became_peered":"2024-09-13T15:01:44.839371+0000","last_unstale":"2024-09-13T15:02:33.744851+0000","last_undegraded":"2024-09-13T15:02:33.744851+0000","last_fullsized":"2024-09-13T15:02:33.744851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:13.433036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118361+0000","last_change":"2024-09-13T15:01:44.850416+0000","last_active":"2024-09-13T15:02:34.118361+0000","last_peered":"2024-09-13T15:02:34.118361+0000","last_clean":"2024-09-13T15:02:34.118361+0000","last_became_active":"2024-09-13T15:01:44.849766+0000","last_became_peered":"2024-09-13T15:01:44.849766+0000","last_unstale":"2024-09-13T15:02:34.118361+0000","last_undegraded":"2024-09-13T15:02:34.118361+0000","last_fullsized":"2024-09-13T15:02:34.118361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:11.985610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737522+0000","last_change":"2024-09-13T15:01:44.837060+0000","last_active":"2024-09-13T15:02:33.737522+0000","last_peered":"2024-09-13T15:02:33.737522+0000","last_clean":"2024-09-13T15:02:33.737522+0000","last_became_active":"2024-09-13T15:01:44.836770+0000","last_became_peered":"2024-09-13T15:01:44.836770+0000","last_unstale":"2024-09-13T15:02:33.737522+0000","last_undegraded":"2024-09-13T15:02:33.737522+0000","last_fullsized":"2024-09-13T15:02:33.737522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:45.915852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116554+0000","last_change":"2024-09-13T15:01:44.815867+0000","last_active":"2024-09-13T15:02:34.116554+0000","last_peered":"2024-09-13T15:02:34.116554+0000","last_clean":"2024-09-13T15:02:34.116554+0000","last_became_active":"2024-09-13T15:01:44.815116+0000","last_became_peered":"2024-09-13T15:01:44.815116+0000","last_unstale":"2024-09-13T15:02:34.116554+0000","last_undegraded":"2024-09-13T15:02:34.116554+0000","last_fullsized":"2024-09-13T15:02:34.116554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:02.814724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741454+0000","last_change":"2024-09-13T15:01:44.850022+0000","last_active":"2024-09-13T15:02:33.741454+0000","last_peered":"2024-09-13T15:02:33.741454+0000","last_clean":"2024-09-13T15:02:33.741454+0000","last_became_active":"2024-09-13T15:01:44.849533+0000","last_became_peered":"2024-09-13T15:01:44.849533+0000","last_unstale":"2024-09-13T15:02:33.741454+0000","last_undegraded":"2024-09-13T15:02:33.741454+0000","last_fullsized":"2024-09-13T15:02:33.741454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:09.837692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116378+0000","last_change":"2024-09-13T15:01:44.817139+0000","last_active":"2024-09-13T15:02:34.116378+0000","last_peered":"2024-09-13T15:02:34.116378+0000","last_clean":"2024-09-13T15:02:34.116378+0000","last_became_active":"2024-09-13T15:01:44.816416+0000","last_became_peered":"2024-09-13T15:01:44.816416+0000","last_unstale":"2024-09-13T15:02:34.116378+0000","last_undegraded":"2024-09-13T15:02:34.116378+0000","last_fullsized":"2024-09-13T15:02:34.116378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:38.382210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749061+0000","last_change":"2024-09-13T15:02:33.747735+0000","last_active":"2024-09-13T15:02:33.749061+0000","last_peered":"2024-09-13T15:02:33.749061+0000","last_clean":"2024-09-13T15:02:33.749061+0000","last_became_active":"2024-09-13T15:02:33.747405+0000","last_became_peered":"2024-09-13T15:02:33.747405+0000","last_unstale":"2024-09-13T15:02:33.749061+0000","last_undegraded":"2024-09-13T15:02:33.749061+0000","last_fullsized":"2024-09-13T15:02:33.749061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:20.616184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742170+0000","last_change":"2024-09-13T15:01:44.808264+0000","last_active":"2024-09-13T15:02:33.742170+0000","last_peered":"2024-09-13T15:02:33.742170+0000","last_clean":"2024-09-13T15:02:33.742170+0000","last_became_active":"2024-09-13T15:01:44.807776+0000","last_became_peered":"2024-09-13T15:01:44.807776+0000","last_unstale":"2024-09-13T15:02:33.742170+0000","last_undegraded":"2024-09-13T15:02:33.742170+0000","last_fullsized":"2024-09-13T15:02:33.742170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:17.637800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742252+0000","last_change":"2024-09-13T15:01:44.804985+0000","last_active":"2024-09-13T15:02:33.742252+0000","last_peered":"2024-09-13T15:02:33.742252+0000","last_clean":"2024-09-13T15:02:33.742252+0000","last_became_active":"2024-09-13T15:01:44.803977+0000","last_became_peered":"2024-09-13T15:01:44.803977+0000","last_unstale":"2024-09-13T15:02:33.742252+0000","last_undegraded":"2024-09-13T15:02:33.742252+0000","last_fullsized":"2024-09-13T15:02:33.742252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:12.999738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118211+0000","last_change":"2024-09-13T15:01:44.824666+0000","last_active":"2024-09-13T15:02:34.118211+0000","last_peered":"2024-09-13T15:02:34.118211+0000","last_clean":"2024-09-13T15:02:34.118211+0000","last_became_active":"2024-09-13T15:01:44.815381+0000","last_became_peered":"2024-09-13T15:01:44.815381+0000","last_unstale":"2024-09-13T15:02:34.118211+0000","last_undegraded":"2024-09-13T15:02:34.118211+0000","last_fullsized":"2024-09-13T15:02:34.118211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:12:17.680247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5951,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":88,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":11902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542179,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343944,"statfs":{"total":96636764160,"available":96608198656,"internally_reserved":0,"allocated":901120,"data_stored":708672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.94599999999999995,"15min":0.94099999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4079999999999999,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.877,"15min":0.877},"min":{"1min":0.57999999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.85199999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.873,"15min":0.877},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.147,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.028,"15min":1.036},"min":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.70799999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0009999999999999,"15min":1.0089999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.4570000000000001,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.98699999999999999,"15min":0.995},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.321,"5min":1.452,"15min":1.452},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.92200000000000004,"15min":0.93000000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.1220000000000001,"5min":1.232,"15min":1.232},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.1020000000000001,"15min":1.1140000000000001},"min":{"1min":0.79000000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.496,"5min":1.7,"15min":1.7},"last":0.625}]},{"osd":4,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3700000000000001,"5min":1.643,"15min":1.643},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.03,"15min":1.046},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.137,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.747}]},{"osd":5,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.153,"15min":1.165},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.579,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.095,"5min":1.1040000000000001,"15min":1.1060000000000001},"min":{"1min":0.86799999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.4359999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.88600000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.179,"15min":1.1890000000000001},"min":{"1min":0.81299999999999994,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4970000000000001,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.1399999999999999,"15min":1.157},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.266,"5min":1.641,"15min":1.641},"last":1.173}]}]},{"osd":6,"up_from":14,"seq":60129542180,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":120921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.84399999999999997,"15min":0.83799999999999997},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1200000000000001,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.89200000000000002,"15min":0.90600000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.099,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.61899999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.85599999999999998,"15min":0.85399999999999998},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.90400000000000003,"15min":0.90300000000000002},"min":{"1min":0.63200000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.1499999999999999,"5min":1.167,"15min":1.167},"last":0.79000000000000004}]},{"osd":2,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.85699999999999998,"15min":0.86299999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.097,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.89300000000000002,"15min":0.88600000000000001},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91500000000000004,"15min":0.91600000000000004},"min":{"1min":0.74399999999999999,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1339999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95299999999999996,"15min":0.95499999999999996},"min":{"1min":0.77600000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.175,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.85299999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.93600000000000005,"15min":0.94099999999999995},"min":{"1min":0.68700000000000006,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.1220000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.997,"15min":1.0069999999999999},"min":{"1min":0.70299999999999996,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.96099999999999997}]},{"osd":5,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.95799999999999996,"15min":0.96299999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.038,"15min":1.048},"min":{"1min":0.67100000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.90000000000000002}]},{"osd":7,"last update":"Fri Sep 13 15:03:40 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":1.024,"15min":1.032},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.167,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.1000000000000001,"15min":1.111},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.2949999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.92700000000000005}]}]},{"osd":5,"up_from":14,"seq":60129542179,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":117798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.86899999999999999,"15min":0.872},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.86899999999999999,"15min":0.86299999999999999},"min":{"1min":0.71599999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.282,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.60099999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.93700000000000006,"15min":0.94499999999999995},"min":{"1min":0.63700000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3839999999999999,"5min":1.401,"15min":1.401},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.89200000000000002,"15min":0.89600000000000002},"min":{"1min":0.65700000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.91300000000000003}]},{"osd":2,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93500000000000005,"15min":0.94499999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95099999999999996,"15min":0.94899999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.878}]},{"osd":3,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.94499999999999995,"15min":0.94799999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.2849999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97199999999999998,"15min":0.97099999999999997},"min":{"1min":0.72699999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.94799999999999995}]},{"osd":4,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.85299999999999998,"15min":0.85599999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2330000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.0600000000000001,"15min":1.079},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.2669999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.0389999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.028,"15min":1.044},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.202,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.004,"5min":1.083,"15min":1.0960000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.496,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.1379999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.085,"15min":1.087},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.099,"5min":1.145,"15min":1.153},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.5609999999999999,"5min":1.988,"15min":1.988},"last":1.0629999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":117162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.90000000000000002,"15min":0.90600000000000003},"min":{"1min":0.60399999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.071,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.83099999999999996,"15min":0.82699999999999996},"min":{"1min":0.63200000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.139,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.57999999999999996}]},{"osd":1,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.92200000000000004,"15min":0.92600000000000005},"min":{"1min":0.68200000000000005,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.131,"5min":1.224,"15min":1.224},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.871,"15min":0.87},"min":{"1min":0.623,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.157,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.4330000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.93700000000000006,"15min":0.94299999999999995},"min":{"1min":0.70299999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.0780000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.95799999999999996,"15min":0.96199999999999997},"min":{"1min":0.67500000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1240000000000001,"5min":1.669,"15min":1.669},"last":1.3160000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90200000000000002,"15min":0.90600000000000003},"min":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.099,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.0069999999999999,"15min":1.0189999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.2230000000000001,"5min":1.881,"15min":1.881},"last":0.95199999999999996}]},{"osd":5,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":1.0169999999999999,"15min":1.05},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.028,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.494},{"interface":"front","average":{"1min":0.88,"5min":0.96999999999999997,"15min":0.98499999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.1819999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.1060000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.0109999999999999,"15min":1.0269999999999999},"min":{"1min":0.64000000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.107,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.534},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.083,"15min":1.0960000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.367,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":1.0309999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.046,"15min":1.054},"min":{"1min":0.751,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.2569999999999999,"5min":1.623,"15min":1.623},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.2090000000000001,"15min":1.2210000000000001},"min":{"1min":0.96099999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3180000000000001,"5min":1.996,"15min":1.996},"last":1.3919999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542178,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31412,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340428,"statfs":{"total":96636764160,"available":96604598272,"internally_reserved":0,"allocated":307200,"data_stored":121405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.501,"15min":0.501},"min":{"1min":0.371,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64900000000000002,"5min":0.747,"15min":0.747},"last":0.308},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.66300000000000003,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.42799999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.374,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.71499999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.76600000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81200000000000006,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.61399999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97599999999999998,"5min":1.179,"15min":1.179},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85999999999999999,"15min":0.86399999999999999},"min":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.034,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.79200000000000004}]},{"osd":5,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.873,"15min":0.876},"min":{"1min":0.68500000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0740000000000001,"5min":1.284,"15min":1.284},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.87,"5min":0.93300000000000005,"15min":0.94299999999999995},"min":{"1min":0.70599999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.212,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.72399999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.89400000000000002,"15min":0.90700000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0269999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.94099999999999995,"15min":0.95099999999999996},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.1539999999999999,"5min":1.21,"15min":1.21},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.95299999999999996,"15min":0.96899999999999997},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.1499999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.96399999999999997,"15min":0.98799999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0640000000000001,"5min":1.228,"15min":1.228},"last":0.64400000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542179,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":117036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48599999999999999,"15min":0.48799999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.33700000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76600000000000001,"5min":1.157,"15min":1.157},"last":0.52100000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.41599999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.71199999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.44700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73899999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.48599999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.42499999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.96699999999999997,"15min":0.98099999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.1899999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.94799999999999995,"15min":0.96299999999999997},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.123,"5min":1.675,"15min":1.675},"last":0.93600000000000005}]},{"osd":5,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.92300000000000004,"15min":0.93000000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.0920000000000001,"5min":1.296,"15min":1.296},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.877,"15min":0.88700000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.79300000000000004}]},{"osd":6,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.88,"15min":0.88400000000000001},"min":{"1min":0.69599999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.753},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.93500000000000005,"15min":0.94199999999999995},"min":{"1min":0.748,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.1859999999999999,"5min":1.373,"15min":1.373},"last":0.98399999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.82099999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.98699999999999999,"15min":0.995},"min":{"1min":0.78800000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2010000000000001,"5min":1.353,"15min":1.353},"last":0.83799999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":117868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.32500000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.57699999999999996,"5min":0.871,"15min":0.871},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69799999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.37,"15min":0.37},"max":{"1min":0.64600000000000002,"5min":1.071,"15min":1.071},"last":0.433},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68700000000000006,"5min":1.107,"15min":1.107},"last":0.53400000000000003}]},{"osd":3,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.84799999999999998,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.61599999999999999,"15min":0.63},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68899999999999995,"5min":1.323,"15min":1.323},"last":0.61099999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.90600000000000003,"15min":0.91800000000000004},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.0169999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.88400000000000001,"15min":0.89300000000000002},"min":{"1min":0.68799999999999994,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1830000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.66700000000000004}]},{"osd":5,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.879,"15min":0.89000000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0289999999999999,"5min":1.228,"15min":1.228},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.91300000000000003,"15min":0.93100000000000005},"min":{"1min":0.70699999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.96899999999999997,"5min":1.365,"15min":1.365},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.90400000000000003,"15min":0.91400000000000003},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":0.999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.94499999999999995,"15min":0.96499999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":0.98199999999999998,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.94799999999999995,"15min":0.96699999999999997},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":0.95499999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.93500000000000005,"15min":0.94899999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2170000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.95299999999999996}]}]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31988,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339852,"statfs":{"total":96636764160,"available":96604008448,"internally_reserved":0,"allocated":897024,"data_stored":708064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.66800000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":4.6269999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.58699999999999997,"15min":0.60199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68899999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":4.5439999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.623,"15min":0.64100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.64400000000000002,"5min":1.669,"15min":1.669},"last":4.7309999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.64600000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56299999999999994,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69399999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.72499999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":9.6600000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88900000000000001},"min":{"1min":0.67100000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.0980000000000001,"5min":1.274,"15min":1.274},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.90400000000000003,"15min":0.91200000000000003},"min":{"1min":0.67500000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0580000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":2.444}]},{"osd":5,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.88300000000000001,"15min":0.88900000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":5.0679999999999996},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.026,"5min":1.165,"15min":1.165},"last":4.3150000000000004}]},{"osd":6,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.95199999999999996,"15min":0.96699999999999997},"min":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.0940000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":4.6909999999999998},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.91200000000000003,"15min":0.92500000000000004},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.1259999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":0.93899999999999995},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":4.4130000000000003},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.93200000000000005,"15min":0.94599999999999995},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.038,"5min":1.141,"15min":1.141},"last":0.52700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:04:21.110 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T15:04:21.110 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T15:04:21.110 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T15:04:21.110 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T15:04:21.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.281+0000 7f0eb1a00640 1 Processor -- start 2024-09-13T15:04:21.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.281+0000 7f0eb1a00640 1 -- start start 2024-09-13T15:04:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.281+0000 7f0eb1a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0eac1534b0 0x7f0eac15cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0eb1a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0eac15d400 0x7f0eac0c9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0eb1a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0eac0c3b30 0x7f0eac0c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0eb1a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eac06ba90 con 0x7f0eac15d400 2024-09-13T15:04:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0eb1a00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eac06fec0 con 0x7f0eac1534b0 2024-09-13T15:04:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0eb1a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac06a570 con 0x7f0eac0c3b30 2024-09-13T15:04:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0ea2000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0eac15d400 0x7f0eac0c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:21.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0ea2000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0eac15d400 0x7f0eac0c9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41446/0 (socket says 172.21.15.7:41446) 2024-09-13T15:04:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0ea2000640 1 -- 172.21.15.7:0/3309097232 learned_addr learned my addr 172.21.15.7:0/3309097232 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0eab400640 1 --2- 172.21.15.7:0/3309097232 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0eac0c3b30 0x7f0eac0c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0eaaa00640 1 --2- 172.21.15.7:0/3309097232 >> v2:172.21.15.77:3300/0 conn(0x7f0eac1534b0 0x7f0eac15cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0ea2000640 1 -- 172.21.15.7:0/3309097232 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0eac0c3b30 msgr2=0x7f0eac0c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0ea2000640 1 --2- 172.21.15.7:0/3309097232 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0eac0c3b30 0x7f0eac0c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0ea2000640 1 -- 172.21.15.7:0/3309097232 >> v2:172.21.15.77:3300/0 conn(0x7f0eac1534b0 msgr2=0x7f0eac15cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0ea2000640 1 --2- 172.21.15.7:0/3309097232 >> v2:172.21.15.77:3300/0 conn(0x7f0eac1534b0 0x7f0eac15cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0ea2000640 1 -- 172.21.15.7:0/3309097232 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac153890 con 0x7f0eac15d400 2024-09-13T15:04:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0ea2000640 1 --2- 172.21.15.7:0/3309097232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eac15d400 0x7f0eac0c9890 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0ca440 tx=0x7f0e9401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a2516d6e985623 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0eaa000640 1 -- 172.21.15.7:0/3309097232 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940ab5f0 con 0x7f0eac15d400 2024-09-13T15:04:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0eaa000640 1 -- 172.21.15.7:0/3309097232 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e940ab750 con 0x7f0eac15d400 2024-09-13T15:04:21.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.285+0000 7f0eaa000640 1 -- 172.21.15.7:0/3309097232 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940abae0 con 0x7f0eac15d400 2024-09-13T15:04:21.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eb1a00640 1 -- 172.21.15.7:0/3309097232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eac15d400 msgr2=0x7f0eac0c9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:21.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eb1a00640 1 --2- 172.21.15.7:0/3309097232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eac15d400 0x7f0eac0c9890 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0ca440 tx=0x7f0e9401c520 comp rx=0 tx=0).stop 2024-09-13T15:04:21.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eb1a00640 1 -- 172.21.15.7:0/3309097232 shutdown_connections 2024-09-13T15:04:21.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eb1a00640 1 --2- 172.21.15.7:0/3309097232 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0eac0c3b30 0x7f0eac0c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:21.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eb1a00640 1 --2- 172.21.15.7:0/3309097232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eac15d400 0x7f0eac0c9890 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:21.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eb1a00640 1 --2- 172.21.15.7:0/3309097232 >> v2:172.21.15.77:3300/0 conn(0x7f0eac1534b0 0x7f0eac15cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:21.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eb1a00640 1 -- 172.21.15.7:0/3309097232 >> 172.21.15.7:0/3309097232 conn(0x7f0eac071730 msgr2=0x7f0eac071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:21.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eb1a00640 1 -- 172.21.15.7:0/3309097232 shutdown_connections 2024-09-13T15:04:21.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eb1a00640 1 -- 172.21.15.7:0/3309097232 wait complete. 2024-09-13T15:04:21.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eb1a00640 1 Processor -- start 2024-09-13T15:04:21.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eb1a00640 1 -- start start 2024-09-13T15:04:21.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eb1a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eac0c3b30 0x7f0eac1ea770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:21.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eb1a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eac1534b0 0x7f0eac0c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:21.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eb1a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0eac15d400 0x7f0eac156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:21.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eb1a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac1512a0 con 0x7f0eac0c3b30 2024-09-13T15:04:21.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eb1a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac1488d0 con 0x7f0eac1534b0 2024-09-13T15:04:21.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eb1a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac1f2a20 con 0x7f0eac15d400 2024-09-13T15:04:21.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eaaa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eac0c3b30 0x7f0eac1ea770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:21.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eaaa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eac0c3b30 0x7f0eac1ea770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41454/0 (socket says 172.21.15.7:41454) 2024-09-13T15:04:21.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eaaa00640 1 -- 172.21.15.7:0/2346745977 learned_addr learned my addr 172.21.15.7:0/2346745977 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:21.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0ea2000640 1 --2- 172.21.15.7:0/2346745977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eac1534b0 0x7f0eac0c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:21.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eab400640 1 --2- 172.21.15.7:0/2346745977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0eac15d400 0x7f0eac156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:21.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eaaa00640 1 -- 172.21.15.7:0/2346745977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0eac15d400 msgr2=0x7f0eac156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:21.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eaaa00640 1 --2- 172.21.15.7:0/2346745977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0eac15d400 0x7f0eac156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:21.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eaaa00640 1 -- 172.21.15.7:0/2346745977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eac1534b0 msgr2=0x7f0eac0c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:21.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eaaa00640 1 --2- 172.21.15.7:0/2346745977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eac1534b0 0x7f0eac0c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:21.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0eaaa00640 1 -- 172.21.15.7:0/2346745977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e940094d0 con 0x7f0eac0c3b30 2024-09-13T15:04:21.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.289+0000 7f0ea2000640 1 --2- 172.21.15.7:0/2346745977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eac1534b0 0x7f0eac0c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:21.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.293+0000 7f0eaaa00640 1 --2- 172.21.15.7:0/2346745977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eac0c3b30 0x7f0eac1ea770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00d800 tx=0x7f0e9c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:21.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.293+0000 7f0ea3400640 1 -- 172.21.15.7:0/2346745977 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c00b6c0 con 0x7f0eac0c3b30 2024-09-13T15:04:21.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.293+0000 7f0ea3400640 1 -- 172.21.15.7:0/2346745977 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9c00b820 con 0x7f0eac0c3b30 2024-09-13T15:04:21.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.293+0000 7f0ea3400640 1 -- 172.21.15.7:0/2346745977 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9c00bb90 con 0x7f0eac0c3b30 2024-09-13T15:04:21.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.293+0000 7f0eb1a00640 1 -- 172.21.15.7:0/2346745977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eac148b70 con 0x7f0eac0c3b30 2024-09-13T15:04:21.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.293+0000 7f0eb1a00640 1 -- 172.21.15.7:0/2346745977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac149130 con 0x7f0eac0c3b30 2024-09-13T15:04:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.293+0000 7f0eb1a00640 1 -- 172.21.15.7:0/2346745977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eac1492f0 con 0x7f0eac0c3b30 2024-09-13T15:04:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.293+0000 7f0ea3400640 1 -- 172.21.15.7:0/2346745977 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0e9c00bcf0 con 0x7f0eac0c3b30 2024-09-13T15:04:21.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.293+0000 7f0ea3400640 1 --2- 172.21.15.7:0/2346745977 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e880666c0 0x7f0e88068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.293+0000 7f0ea3400640 1 -- 172.21.15.7:0/2346745977 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e9c084b00 con 0x7f0eac0c3b30 2024-09-13T15:04:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.293+0000 7f0ea2000640 1 --2- 172.21.15.7:0/2346745977 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e880666c0 0x7f0e88068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.297+0000 7f0ea2000640 1 --2- 172.21.15.7:0/2346745977 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e880666c0 0x7f0e88068b80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0e940af000 tx=0x7f0e94004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:21.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.297+0000 7f0ea3400640 1 -- 172.21.15.7:0/2346745977 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0e9c086e60 con 0x7f0eac0c3b30 2024-09-13T15:04:21.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.497+0000 7f0eb1a00640 1 -- 172.21.15.7:0/2346745977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0eac0c9700 con 0x7f0eac0c3b30 2024-09-13T15:04:21.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.497+0000 7f0ea3400640 1 -- 172.21.15.7:0/2346745977 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+196 (secure 0 0 0) 0x7f0e9c055530 con 0x7f0eac0c3b30 2024-09-13T15:04:21.498 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:21.498 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-09-13T15:04:21.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.497+0000 7f0eb1a00640 1 -- 172.21.15.7:0/2346745977 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e880666c0 msgr2=0x7f0e88068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:21.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.497+0000 7f0eb1a00640 1 --2- 172.21.15.7:0/2346745977 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e880666c0 0x7f0e88068b80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0e940af000 tx=0x7f0e94004740 comp rx=0 tx=0).stop 2024-09-13T15:04:21.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.497+0000 7f0eb1a00640 1 -- 172.21.15.7:0/2346745977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eac0c3b30 msgr2=0x7f0eac1ea770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:21.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.497+0000 7f0eb1a00640 1 --2- 172.21.15.7:0/2346745977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eac0c3b30 0x7f0eac1ea770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00d800 tx=0x7f0e9c00dcc0 comp rx=0 tx=0).stop 2024-09-13T15:04:21.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.497+0000 7f0eb1a00640 1 -- 172.21.15.7:0/2346745977 shutdown_connections 2024-09-13T15:04:21.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.497+0000 7f0eb1a00640 1 --2- 172.21.15.7:0/2346745977 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e880666c0 0x7f0e88068b80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:21.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.497+0000 7f0eb1a00640 1 --2- 172.21.15.7:0/2346745977 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0eac15d400 0x7f0eac156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:21.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.497+0000 7f0eb1a00640 1 --2- 172.21.15.7:0/2346745977 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0eac1534b0 0x7f0eac0c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:21.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.497+0000 7f0eb1a00640 1 --2- 172.21.15.7:0/2346745977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0eac0c3b30 0x7f0eac1ea770 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:21.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.497+0000 7f0eb1a00640 1 -- 172.21.15.7:0/2346745977 >> 172.21.15.7:0/2346745977 conn(0x7f0eac071730 msgr2=0x7f0eac0c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:21.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.497+0000 7f0eb1a00640 1 -- 172.21.15.7:0/2346745977 shutdown_connections 2024-09-13T15:04:21.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:21.497+0000 7f0eb1a00640 1 -- 172.21.15.7:0/2346745977 wait complete. 2024-09-13T15:04:24.519 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T15:04:24.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.669+0000 7f9009600640 1 Processor -- start 2024-09-13T15:04:24.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.669+0000 7f9009600640 1 -- start start 2024-09-13T15:04:24.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.673+0000 7f9009600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f90040cb580 0x7f90040c9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:24.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.673+0000 7f9009600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90040cabe0 con 0x7f9004150f30 2024-09-13T15:04:24.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.673+0000 7f9009600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90040cba70 con 0x7f90040c9ab0 2024-09-13T15:04:24.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.673+0000 7f9009600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9004156cf0 con 0x7f90040cb580 2024-09-13T15:04:24.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.673+0000 7f8ffbe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f90040cb580 0x7f90040c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:24.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.673+0000 7f9003e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9004150f30 0x7f90040b2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:32850/0 (socket says 172.21.15.7:32850) 2024-09-13T15:04:24.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.673+0000 7f9003e00640 1 -- 172.21.15.7:0/2443453680 learned_addr learned my addr 172.21.15.7:0/2443453680 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:24.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.673+0000 7f8ffbe00640 1 -- 172.21.15.7:0/2443453680 >> v1:172.21.15.77:6789/0 conn(0x7f90040c9ab0 legacy=0x7f90040c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:24.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.673+0000 7f8ffbe00640 1 -- 172.21.15.7:0/2443453680 >> v1:172.21.15.7:6789/0 conn(0x7f9004150f30 legacy=0x7f90040b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:24.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.673+0000 7f8ffbe00640 1 -- 172.21.15.7:0/2443453680 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90040cbd50 con 0x7f90040cb580 2024-09-13T15:04:24.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f8ffbe00640 1 --2- 172.21.15.7:0/2443453680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90040cb580 0x7f90040c9570 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0097c0 tx=0x7f8fec01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a4d317a1ab5d6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:24.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9003400640 1 -- 172.21.15.7:0/2443453680 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0a8990 con 0x7f90040cb580 2024-09-13T15:04:24.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9003400640 1 -- 172.21.15.7:0/2443453680 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec0a8af0 con 0x7f90040cb580 2024-09-13T15:04:24.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9003400640 1 -- 172.21.15.7:0/2443453680 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0a8e80 con 0x7f90040cb580 2024-09-13T15:04:24.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9009600640 1 -- 172.21.15.7:0/2443453680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90040cb580 msgr2=0x7f90040c9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:24.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9009600640 1 --2- 172.21.15.7:0/2443453680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90040cb580 0x7f90040c9570 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0097c0 tx=0x7f8fec01ec90 comp rx=0 tx=0).stop 2024-09-13T15:04:24.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9009600640 1 -- 172.21.15.7:0/2443453680 shutdown_connections 2024-09-13T15:04:24.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9009600640 1 --2- 172.21.15.7:0/2443453680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90040cb580 0x7f90040c9570 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:24.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9009600640 1 -- 172.21.15.7:0/2443453680 >> 172.21.15.7:0/2443453680 conn(0x7f9004065d40 msgr2=0x7f9004066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:24.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9009600640 1 -- 172.21.15.7:0/2443453680 shutdown_connections 2024-09-13T15:04:24.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9009600640 1 -- 172.21.15.7:0/2443453680 wait complete. 2024-09-13T15:04:24.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9009600640 1 Processor -- start 2024-09-13T15:04:24.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9009600640 1 -- start start 2024-09-13T15:04:24.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9009600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90040c9ab0 0x7f90041efba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:24.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9009600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90040cb580 0x7f900414a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:24.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9009600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9004150f30 0x7f900414a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:24.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9009600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90041ed840 con 0x7f90040c9ab0 2024-09-13T15:04:24.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9009600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9004147330 con 0x7f90040cb580 2024-09-13T15:04:24.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9009600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9004148870 con 0x7f9004150f30 2024-09-13T15:04:24.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.677+0000 7f9003e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90040c9ab0 0x7f90041efba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:24.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f9003e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90040c9ab0 0x7f90041efba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41468/0 (socket says 172.21.15.7:41468) 2024-09-13T15:04:24.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f9003e00640 1 -- 172.21.15.7:0/515174565 learned_addr learned my addr 172.21.15.7:0/515174565 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:24.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f8ffbe00640 1 --2- 172.21.15.7:0/515174565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90040cb580 0x7f900414a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:24.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f9008c00640 1 --2- 172.21.15.7:0/515174565 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9004150f30 0x7f900414a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:24.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f9003e00640 1 -- 172.21.15.7:0/515174565 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9004150f30 msgr2=0x7f900414a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:24.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f9003e00640 1 --2- 172.21.15.7:0/515174565 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9004150f30 0x7f900414a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:24.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f9003e00640 1 -- 172.21.15.7:0/515174565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90040cb580 msgr2=0x7f900414a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:24.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f9003e00640 1 --2- 172.21.15.7:0/515174565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90040cb580 0x7f900414a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:24.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f9003e00640 1 -- 172.21.15.7:0/515174565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec009420 con 0x7f90040c9ab0 2024-09-13T15:04:24.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f8ffbe00640 1 --2- 172.21.15.7:0/515174565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90040cb580 0x7f900414a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:24.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f9003e00640 1 --2- 172.21.15.7:0/515174565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90040c9ab0 0x7f90041efba0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400c430 tx=0x7f8ff400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:24.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f9000c00640 1 -- 172.21.15.7:0/515174565 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4005cf0 con 0x7f90040c9ab0 2024-09-13T15:04:24.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f9000c00640 1 -- 172.21.15.7:0/515174565 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff4005e50 con 0x7f90040c9ab0 2024-09-13T15:04:24.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f9009600640 1 -- 172.21.15.7:0/515174565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90041444b0 con 0x7f90040c9ab0 2024-09-13T15:04:24.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f9000c00640 1 -- 172.21.15.7:0/515174565 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff40072d0 con 0x7f90040c9ab0 2024-09-13T15:04:24.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f9009600640 1 -- 172.21.15.7:0/515174565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9004144800 con 0x7f90040c9ab0 2024-09-13T15:04:24.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f9009600640 1 -- 172.21.15.7:0/515174565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9004144640 con 0x7f90040c9ab0 2024-09-13T15:04:24.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f9000c00640 1 -- 172.21.15.7:0/515174565 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8ff4007430 con 0x7f90040c9ab0 2024-09-13T15:04:24.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.681+0000 7f9000c00640 1 --2- 172.21.15.7:0/515174565 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8fe0066690 0x7f8fe0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:24.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.685+0000 7f9000c00640 1 -- 172.21.15.7:0/515174565 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8ff4083910 con 0x7f90040c9ab0 2024-09-13T15:04:24.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.685+0000 7f8ffbe00640 1 --2- 172.21.15.7:0/515174565 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8fe0066690 0x7f8fe0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:24.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.685+0000 7f8ffbe00640 1 --2- 172.21.15.7:0/515174565 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8fe0066690 0x7f8fe0068b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0b2000 tx=0x7f8fec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:24.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.689+0000 7f9000c00640 1 -- 172.21.15.7:0/515174565 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8ff4050960 con 0x7f90040c9ab0 2024-09-13T15:04:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.889+0000 7f9009600640 1 -- 172.21.15.7:0/515174565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f90040b2fe0 con 0x7f90040c9ab0 2024-09-13T15:04:24.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.889+0000 7f9000c00640 1 -- 172.21.15.7:0/515174565 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+196 (secure 0 0 0) 0x7f8ff4053f80 con 0x7f90040c9ab0 2024-09-13T15:04:24.891 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:24.891 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-09-13T15:04:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.889+0000 7f9009600640 1 -- 172.21.15.7:0/515174565 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8fe0066690 msgr2=0x7f8fe0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.889+0000 7f9009600640 1 --2- 172.21.15.7:0/515174565 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8fe0066690 0x7f8fe0068b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0b2000 tx=0x7f8fec008040 comp rx=0 tx=0).stop 2024-09-13T15:04:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.889+0000 7f9009600640 1 -- 172.21.15.7:0/515174565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90040c9ab0 msgr2=0x7f90041efba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.889+0000 7f9009600640 1 --2- 172.21.15.7:0/515174565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90040c9ab0 0x7f90041efba0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8ff400c430 tx=0x7f8ff400c8f0 comp rx=0 tx=0).stop 2024-09-13T15:04:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.889+0000 7f9009600640 1 -- 172.21.15.7:0/515174565 shutdown_connections 2024-09-13T15:04:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.889+0000 7f9009600640 1 --2- 172.21.15.7:0/515174565 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8fe0066690 0x7f8fe0068b50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.889+0000 7f9009600640 1 --2- 172.21.15.7:0/515174565 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9004150f30 0x7f900414a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.889+0000 7f9009600640 1 --2- 172.21.15.7:0/515174565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90040cb580 0x7f900414a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:24.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.889+0000 7f9009600640 1 --2- 172.21.15.7:0/515174565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90040c9ab0 0x7f90041efba0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:24.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.889+0000 7f9009600640 1 -- 172.21.15.7:0/515174565 >> 172.21.15.7:0/515174565 conn(0x7f9004065d40 msgr2=0x7f9004154950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:24.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.889+0000 7f9009600640 1 -- 172.21.15.7:0/515174565 shutdown_connections 2024-09-13T15:04:24.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:24.889+0000 7f9009600640 1 -- 172.21.15.7:0/515174565 wait complete. 2024-09-13T15:04:27.915 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T15:04:28.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.061+0000 7f37a5200640 1 Processor -- start 2024-09-13T15:04:28.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.061+0000 7f37a5200640 1 -- start start 2024-09-13T15:04:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.065+0000 7f37a5200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37a01534b0 0x7f37a015cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.065+0000 7f37a5200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f37a015d400 0x7f37a00c9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.065+0000 7f37a5200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f37a00c3b30 0x7f37a00c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.065+0000 7f37a5200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a006ba90 con 0x7f37a00c3b30 2024-09-13T15:04:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.065+0000 7f37a5200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a006fec0 con 0x7f37a015d400 2024-09-13T15:04:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.065+0000 7f37a5200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a006a570 con 0x7f37a01534b0 2024-09-13T15:04:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.065+0000 7f379e800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f37a00c3b30 0x7f37a00c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.065+0000 7f379e800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f37a00c3b30 0x7f37a00c9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41484/0 (socket says 172.21.15.7:41484) 2024-09-13T15:04:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.065+0000 7f379e800640 1 -- 172.21.15.7:0/4013003505 learned_addr learned my addr 172.21.15.7:0/4013003505 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.065+0000 7f379de00640 1 --2- 172.21.15.7:0/4013003505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37a01534b0 0x7f37a015cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.065+0000 7f3797e00640 1 --2- 172.21.15.7:0/4013003505 >> v2:172.21.15.77:3300/0 conn(0x7f37a015d400 0x7f37a00c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.065+0000 7f379e800640 1 -- 172.21.15.7:0/4013003505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37a01534b0 msgr2=0x7f37a015cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:28.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.065+0000 7f379e800640 1 --2- 172.21.15.7:0/4013003505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37a01534b0 0x7f37a015cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:28.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.065+0000 7f379e800640 1 -- 172.21.15.7:0/4013003505 >> v2:172.21.15.77:3300/0 conn(0x7f37a015d400 msgr2=0x7f37a00c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:28.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.065+0000 7f379e800640 1 --2- 172.21.15.7:0/4013003505 >> v2:172.21.15.77:3300/0 conn(0x7f37a015d400 0x7f37a00c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:28.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.065+0000 7f379e800640 1 -- 172.21.15.7:0/4013003505 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a0153890 con 0x7f37a00c3b30 2024-09-13T15:04:28.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.065+0000 7f3797e00640 1 --2- 172.21.15.7:0/4013003505 >> v2:172.21.15.77:3300/0 conn(0x7f37a015d400 0x7f37a00c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:28.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f379e800640 1 --2- 172.21.15.7:0/4013003505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a00c3b30 0x7f37a00c9dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f37a0070070 tx=0x7f379801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad9135417a49397 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:28.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f379d400640 1 -- 172.21.15.7:0/4013003505 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37980a5780 con 0x7f37a00c3b30 2024-09-13T15:04:28.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f379d400640 1 -- 172.21.15.7:0/4013003505 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37980a58e0 con 0x7f37a00c3b30 2024-09-13T15:04:28.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f379d400640 1 -- 172.21.15.7:0/4013003505 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37980a5c70 con 0x7f37a00c3b30 2024-09-13T15:04:28.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f37a5200640 1 -- 172.21.15.7:0/4013003505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a00c3b30 msgr2=0x7f37a00c9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:28.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f37a5200640 1 --2- 172.21.15.7:0/4013003505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a00c3b30 0x7f37a00c9dd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f37a0070070 tx=0x7f379801c9f0 comp rx=0 tx=0).stop 2024-09-13T15:04:28.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f37a5200640 1 -- 172.21.15.7:0/4013003505 shutdown_connections 2024-09-13T15:04:28.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f37a5200640 1 --2- 172.21.15.7:0/4013003505 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a00c3b30 0x7f37a00c9dd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:28.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f37a5200640 1 --2- 172.21.15.7:0/4013003505 >> v2:172.21.15.77:3300/0 conn(0x7f37a015d400 0x7f37a00c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:28.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f37a5200640 1 --2- 172.21.15.7:0/4013003505 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37a01534b0 0x7f37a015cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:28.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f37a5200640 1 -- 172.21.15.7:0/4013003505 >> 172.21.15.7:0/4013003505 conn(0x7f37a0071730 msgr2=0x7f37a0071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:28.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f37a5200640 1 -- 172.21.15.7:0/4013003505 shutdown_connections 2024-09-13T15:04:28.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f37a5200640 1 -- 172.21.15.7:0/4013003505 wait complete. 2024-09-13T15:04:28.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f37a5200640 1 Processor -- start 2024-09-13T15:04:28.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f37a5200640 1 -- start start 2024-09-13T15:04:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f37a5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a00c3b30 0x7f37a0071ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f37a5200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37a01534b0 0x7f37a0146a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.069+0000 7f37a5200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37a015d400 0x7f37a00cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f37a5200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a01f2eb0 con 0x7f37a00c3b30 2024-09-13T15:04:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f37a5200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00cb420 con 0x7f37a015d400 2024-09-13T15:04:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f37a5200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a01f2bf0 con 0x7f37a01534b0 2024-09-13T15:04:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f379de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a00c3b30 0x7f37a0071ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f379de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a00c3b30 0x7f37a0071ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41498/0 (socket says 172.21.15.7:41498) 2024-09-13T15:04:28.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f379de00640 1 -- 172.21.15.7:0/3933525830 learned_addr learned my addr 172.21.15.7:0/3933525830 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:28.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f379e800640 1 --2- 172.21.15.7:0/3933525830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37a015d400 0x7f37a00cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:28.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f3797e00640 1 --2- 172.21.15.7:0/3933525830 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37a01534b0 0x7f37a0146a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:28.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f379de00640 1 -- 172.21.15.7:0/3933525830 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37a01534b0 msgr2=0x7f37a0146a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:28.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f379de00640 1 --2- 172.21.15.7:0/3933525830 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37a01534b0 0x7f37a0146a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:28.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f379de00640 1 -- 172.21.15.7:0/3933525830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37a015d400 msgr2=0x7f37a00cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:28.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f379de00640 1 --2- 172.21.15.7:0/3933525830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37a015d400 0x7f37a00cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:28.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f379de00640 1 -- 172.21.15.7:0/3933525830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3798009b30 con 0x7f37a00c3b30 2024-09-13T15:04:28.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f379de00640 1 --2- 172.21.15.7:0/3933525830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a00c3b30 0x7f37a0071ce0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f379000e8b0 tx=0x7f379000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:28.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f3796000640 1 -- 172.21.15.7:0/3933525830 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379000c940 con 0x7f37a00c3b30 2024-09-13T15:04:28.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f3796000640 1 -- 172.21.15.7:0/3933525830 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379000caa0 con 0x7f37a00c3b30 2024-09-13T15:04:28.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f3796000640 1 -- 172.21.15.7:0/3933525830 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379000ce30 con 0x7f37a00c3b30 2024-09-13T15:04:28.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f37a5200640 1 -- 172.21.15.7:0/3933525830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a00cae60 con 0x7f37a00c3b30 2024-09-13T15:04:28.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f37a5200640 1 -- 172.21.15.7:0/3933525830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a00cb720 con 0x7f37a00c3b30 2024-09-13T15:04:28.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f37a5200640 1 -- 172.21.15.7:0/3933525830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a0067650 con 0x7f37a00c3b30 2024-09-13T15:04:28.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.073+0000 7f3796000640 1 -- 172.21.15.7:0/3933525830 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3790013470 con 0x7f37a00c3b30 2024-09-13T15:04:28.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.077+0000 7f3796000640 1 --2- 172.21.15.7:0/3933525830 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f377c066690 0x7f377c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:28.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.077+0000 7f3796000640 1 -- 172.21.15.7:0/3933525830 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f37900847f0 con 0x7f37a00c3b30 2024-09-13T15:04:28.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.077+0000 7f3797e00640 1 --2- 172.21.15.7:0/3933525830 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f377c066690 0x7f377c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:28.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.077+0000 7f3797e00640 1 --2- 172.21.15.7:0/3933525830 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f377c066690 0x7f377c068b50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f37a015c090 tx=0x7f3788008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:28.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.081+0000 7f3796000640 1 -- 172.21.15.7:0/3933525830 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3790051700 con 0x7f37a00c3b30 2024-09-13T15:04:28.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.273+0000 7f37a5200640 1 -- 172.21.15.7:0/3933525830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f37a00c9ec0 con 0x7f37a00c3b30 2024-09-13T15:04:28.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.277+0000 7f3796000640 1 -- 172.21.15.7:0/3933525830 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+196 (secure 0 0 0) 0x7f3790054d20 con 0x7f37a00c3b30 2024-09-13T15:04:28.278 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:28.278 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-09-13T15:04:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.277+0000 7f37a5200640 1 -- 172.21.15.7:0/3933525830 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f377c066690 msgr2=0x7f377c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.277+0000 7f37a5200640 1 --2- 172.21.15.7:0/3933525830 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f377c066690 0x7f377c068b50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f37a015c090 tx=0x7f3788008040 comp rx=0 tx=0).stop 2024-09-13T15:04:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.277+0000 7f37a5200640 1 -- 172.21.15.7:0/3933525830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a00c3b30 msgr2=0x7f37a0071ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.277+0000 7f37a5200640 1 --2- 172.21.15.7:0/3933525830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a00c3b30 0x7f37a0071ce0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f379000e8b0 tx=0x7f379000ed70 comp rx=0 tx=0).stop 2024-09-13T15:04:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.277+0000 7f37a5200640 1 -- 172.21.15.7:0/3933525830 shutdown_connections 2024-09-13T15:04:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.277+0000 7f37a5200640 1 --2- 172.21.15.7:0/3933525830 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f377c066690 0x7f377c068b50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.277+0000 7f37a5200640 1 --2- 172.21.15.7:0/3933525830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f37a015d400 0x7f37a00cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.277+0000 7f37a5200640 1 --2- 172.21.15.7:0/3933525830 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f37a01534b0 0x7f37a0146a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.277+0000 7f37a5200640 1 --2- 172.21.15.7:0/3933525830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f37a00c3b30 0x7f37a0071ce0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:28.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.277+0000 7f37a5200640 1 -- 172.21.15.7:0/3933525830 >> 172.21.15.7:0/3933525830 conn(0x7f37a0071730 msgr2=0x7f37a015b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:28.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.277+0000 7f37a5200640 1 -- 172.21.15.7:0/3933525830 shutdown_connections 2024-09-13T15:04:28.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:28.277+0000 7f37a5200640 1 -- 172.21.15.7:0/3933525830 wait complete. 2024-09-13T15:04:31.299 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T15:04:31.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.449+0000 7f90aec00640 1 Processor -- start 2024-09-13T15:04:31.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.449+0000 7f90aec00640 1 -- start start 2024-09-13T15:04:31.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.449+0000 7f90aec00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90a8071a70 0x7f90a81576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:31.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.449+0000 7f90aec00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a80c5530 con 0x7f90a80b0bf0 2024-09-13T15:04:31.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.449+0000 7f90aec00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a81583b0 con 0x7f90a806ddb0 2024-09-13T15:04:31.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.449+0000 7f90aec00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8156f40 con 0x7f90a8071a70 2024-09-13T15:04:31.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.449+0000 7f909fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f90a80b0bf0 0x7f90a8150cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44152/0 (socket says 172.21.15.7:44152) 2024-09-13T15:04:31.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.449+0000 7f909fe00640 1 -- 172.21.15.7:0/3382791119 learned_addr learned my addr 172.21.15.7:0/3382791119 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:31.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.449+0000 7f90a7e00640 1 --2- 172.21.15.7:0/3382791119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90a8071a70 0x7f90a81576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:31.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7400640 1 -- 172.21.15.7:0/3382791119 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290747969 0 0) 0x7f90a80c5530 con 0x7f90a80b0bf0 2024-09-13T15:04:31.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7400640 1 -- 172.21.15.7:0/3382791119 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f908c003530 con 0x7f90a80b0bf0 2024-09-13T15:04:31.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7400640 1 -- 172.21.15.7:0/3382791119 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811049223 0 0) 0x7f90a81583b0 con 0x7f90a806ddb0 2024-09-13T15:04:31.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7400640 1 -- 172.21.15.7:0/3382791119 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90a80c5530 con 0x7f90a806ddb0 2024-09-13T15:04:31.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7400640 1 -- 172.21.15.7:0/3382791119 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 813002034 0 0) 0x7f908c003530 con 0x7f90a80b0bf0 2024-09-13T15:04:31.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7400640 1 -- 172.21.15.7:0/3382791119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90a8071a70 msgr2=0x7f90a81576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:31.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7400640 1 --2- 172.21.15.7:0/3382791119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90a8071a70 0x7f90a81576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:31.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7400640 1 -- 172.21.15.7:0/3382791119 >> v1:172.21.15.77:6789/0 conn(0x7f90a806ddb0 legacy=0x7f90a8161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:31.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7400640 1 -- 172.21.15.7:0/3382791119 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a80b10c0 con 0x7f90a80b0bf0 2024-09-13T15:04:31.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7400640 1 -- 172.21.15.7:0/3382791119 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f9090001680 con 0x7f90a80b0bf0 2024-09-13T15:04:31.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7400640 1 -- 172.21.15.7:0/3382791119 >> v1:172.21.15.7:6789/0 conn(0x7f90a80b0bf0 legacy=0x7f90a8150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:31.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7400640 1 --2- 172.21.15.7:0/3382791119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90a8071a70 0x7f908c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:31.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7400640 1 --2- 172.21.15.7:0/3382791119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f908c0040a0 0x7f908c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:31.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7400640 1 --2- 172.21.15.7:0/3382791119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f908c004d10 0x7f908c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:31.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7400640 1 -- 172.21.15.7:0/3382791119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8156f40 con 0x7f908c0040a0 2024-09-13T15:04:31.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7400640 1 -- 172.21.15.7:0/3382791119 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908c00ba70 con 0x7f908c004d10 2024-09-13T15:04:31.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7400640 1 -- 172.21.15.7:0/3382791119 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908c00bc30 con 0x7f90a8071a70 2024-09-13T15:04:31.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f909fe00640 1 --2- 172.21.15.7:0/3382791119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f908c0040a0 0x7f908c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:31.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90a7e00640 1 --2- 172.21.15.7:0/3382791119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90a8071a70 0x7f908c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:31.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f90acc00640 1 --2- 172.21.15.7:0/3382791119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f908c004d10 0x7f908c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:31.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f909fe00640 1 -- 172.21.15.7:0/3382791119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90a8071a70 msgr2=0x7f908c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:31.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f909fe00640 1 --2- 172.21.15.7:0/3382791119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90a8071a70 0x7f908c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:31.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f909fe00640 1 -- 172.21.15.7:0/3382791119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f908c004d10 msgr2=0x7f908c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:31.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f909fe00640 1 --2- 172.21.15.7:0/3382791119 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f908c004d10 0x7f908c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:31.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.453+0000 7f909fe00640 1 -- 172.21.15.7:0/3382791119 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f908c003530 con 0x7f908c0040a0 2024-09-13T15:04:31.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f909fe00640 1 --2- 172.21.15.7:0/3382791119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f908c0040a0 0x7f908c0047d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f90a80b0ff0 tx=0x7f909001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a27bae26438b34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:31.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90a7400640 1 -- 172.21.15.7:0/3382791119 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90900058e0 con 0x7f908c0040a0 2024-09-13T15:04:31.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90a7400640 1 -- 172.21.15.7:0/3382791119 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9090005a40 con 0x7f908c0040a0 2024-09-13T15:04:31.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90a7400640 1 -- 172.21.15.7:0/3382791119 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090005e50 con 0x7f908c0040a0 2024-09-13T15:04:31.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90aec00640 1 -- 172.21.15.7:0/3382791119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f908c0040a0 msgr2=0x7f908c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:31.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90aec00640 1 --2- 172.21.15.7:0/3382791119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f908c0040a0 0x7f908c0047d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f90a80b0ff0 tx=0x7f909001cba0 comp rx=0 tx=0).stop 2024-09-13T15:04:31.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90acc00640 1 -- 172.21.15.7:0/3382791119 reap_dead start 2024-09-13T15:04:31.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90aec00640 1 -- 172.21.15.7:0/3382791119 shutdown_connections 2024-09-13T15:04:31.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90aec00640 1 -- 172.21.15.7:0/3382791119 >> 172.21.15.7:0/3382791119 conn(0x7f90a8065d40 msgr2=0x7f90a8066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:31.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90aec00640 1 -- 172.21.15.7:0/3382791119 shutdown_connections 2024-09-13T15:04:31.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90aec00640 1 -- 172.21.15.7:0/3382791119 wait complete. 2024-09-13T15:04:31.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90aec00640 1 Processor -- start 2024-09-13T15:04:31.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90aec00640 1 -- start start 2024-09-13T15:04:31.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90aec00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f908c0040a0 0x7f90a80c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:31.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90aec00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a8144270 0x7f90a814b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:31.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90aec00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90a80c6c90 0x7f90a81436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:31.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90aec00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a80c5e20 con 0x7f90a80c6c90 2024-09-13T15:04:31.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90aec00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a80c6100 con 0x7f90a8144270 2024-09-13T15:04:31.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90aec00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a81ef970 con 0x7f908c0040a0 2024-09-13T15:04:31.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90acc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90a80c6c90 0x7f90a81436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:31.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.457+0000 7f90a7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f908c0040a0 0x7f90a80c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:31.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90a7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f908c0040a0 0x7f90a80c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:42090/0 (socket says 172.21.15.7:42090) 2024-09-13T15:04:31.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90acc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90a80c6c90 0x7f90a81436b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60330/0 (socket says 172.21.15.7:60330) 2024-09-13T15:04:31.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90a7e00640 1 -- 172.21.15.7:0/265592242 learned_addr learned my addr 172.21.15.7:0/265592242 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:31.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f909fe00640 1 --2- 172.21.15.7:0/265592242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a8144270 0x7f90a814b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:31.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90acc00640 1 -- 172.21.15.7:0/265592242 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f908c0040a0 msgr2=0x7f90a80c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:31.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90acc00640 1 --2- 172.21.15.7:0/265592242 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f908c0040a0 0x7f90a80c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:31.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90acc00640 1 -- 172.21.15.7:0/265592242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a8144270 msgr2=0x7f90a814b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:31.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90acc00640 1 --2- 172.21.15.7:0/265592242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a8144270 0x7f90a814b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:31.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90acc00640 1 -- 172.21.15.7:0/265592242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a81efc50 con 0x7f90a80c6c90 2024-09-13T15:04:31.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90acc00640 1 --2- 172.21.15.7:0/265592242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90a80c6c90 0x7f90a81436b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f90a80c1180 tx=0x7f90a0012c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:31.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90a4c00640 1 -- 172.21.15.7:0/265592242 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0010b20 con 0x7f90a80c6c90 2024-09-13T15:04:31.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90a4c00640 1 -- 172.21.15.7:0/265592242 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a0010c80 con 0x7f90a80c6c90 2024-09-13T15:04:31.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90a4c00640 1 -- 172.21.15.7:0/265592242 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0012e80 con 0x7f90a80c6c90 2024-09-13T15:04:31.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90aec00640 1 -- 172.21.15.7:0/265592242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a81eff30 con 0x7f90a80c6c90 2024-09-13T15:04:31.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90aec00640 1 -- 172.21.15.7:0/265592242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a8147070 con 0x7f90a80c6c90 2024-09-13T15:04:31.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90aec00640 1 -- 172.21.15.7:0/265592242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a8067650 con 0x7f90a80c6c90 2024-09-13T15:04:31.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90a4c00640 1 -- 172.21.15.7:0/265592242 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f90a0016480 con 0x7f90a80c6c90 2024-09-13T15:04:31.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90a4c00640 1 --2- 172.21.15.7:0/265592242 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f90840666c0 0x7f9084068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:31.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.461+0000 7f90a4c00640 1 -- 172.21.15.7:0/265592242 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f90a0087950 con 0x7f90a80c6c90 2024-09-13T15:04:31.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.465+0000 7f90a7e00640 1 --2- 172.21.15.7:0/265592242 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f90840666c0 0x7f9084068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:31.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.465+0000 7f90a7e00640 1 --2- 172.21.15.7:0/265592242 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f90840666c0 0x7f9084068b80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9098009c10 tx=0x7f9098009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:31.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.465+0000 7f90a4c00640 1 -- 172.21.15.7:0/265592242 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f90a00549a0 con 0x7f90a80c6c90 2024-09-13T15:04:31.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.661+0000 7f90aec00640 1 -- 172.21.15.7:0/265592242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f90a8157180 con 0x7f90a80c6c90 2024-09-13T15:04:31.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.661+0000 7f90a4c00640 1 -- 172.21.15.7:0/265592242 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f90a0057fc0 con 0x7f90a80c6c90 2024-09-13T15:04:31.664 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:31.664 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T15:04:31.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.665+0000 7f90aec00640 1 -- 172.21.15.7:0/265592242 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f90840666c0 msgr2=0x7f9084068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:31.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.665+0000 7f90aec00640 1 --2- 172.21.15.7:0/265592242 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f90840666c0 0x7f9084068b80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9098009c10 tx=0x7f9098009190 comp rx=0 tx=0).stop 2024-09-13T15:04:31.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.665+0000 7f90aec00640 1 -- 172.21.15.7:0/265592242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90a80c6c90 msgr2=0x7f90a81436b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:31.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.665+0000 7f90aec00640 1 --2- 172.21.15.7:0/265592242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90a80c6c90 0x7f90a81436b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f90a80c1180 tx=0x7f90a0012c90 comp rx=0 tx=0).stop 2024-09-13T15:04:31.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.665+0000 7f90aec00640 1 -- 172.21.15.7:0/265592242 shutdown_connections 2024-09-13T15:04:31.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.665+0000 7f90aec00640 1 --2- 172.21.15.7:0/265592242 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f90840666c0 0x7f9084068b80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:31.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.665+0000 7f90aec00640 1 --2- 172.21.15.7:0/265592242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90a80c6c90 0x7f90a81436b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:31.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.665+0000 7f90aec00640 1 --2- 172.21.15.7:0/265592242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90a8144270 0x7f90a814b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:31.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.665+0000 7f90aec00640 1 --2- 172.21.15.7:0/265592242 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f908c0040a0 0x7f90a80c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:31.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.665+0000 7f90aec00640 1 -- 172.21.15.7:0/265592242 >> 172.21.15.7:0/265592242 conn(0x7f90a8065d40 msgr2=0x7f90a80bfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:31.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.665+0000 7f90aec00640 1 -- 172.21.15.7:0/265592242 shutdown_connections 2024-09-13T15:04:31.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.665+0000 7f90aec00640 1 -- 172.21.15.7:0/265592242 wait complete. 2024-09-13T15:04:31.686 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T15:04:31.687 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:04:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.825+0000 7f1089c00640 1 Processor -- start 2024-09-13T15:04:31.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.825+0000 7f1089c00640 1 -- start start 2024-09-13T15:04:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.825+0000 7f1089c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f10840c67c0 0x7f10840c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.825+0000 7f1089c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f10840ca0c0 0x7f10840ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.825+0000 7f1089c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10840ca510 con 0x7f10840c9ca0 2024-09-13T15:04:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.825+0000 7f1089c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1084159150 con 0x7f10840c67c0 2024-09-13T15:04:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.825+0000 7f1089c00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1084159360 con 0x7f10840ca0c0 2024-09-13T15:04:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.825+0000 7f1082a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f10840c67c0 0x7f10840c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.825+0000 7f1082a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f10840c67c0 0x7f10840c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60344/0 (socket says 172.21.15.7:60344) 2024-09-13T15:04:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.825+0000 7f1082a00640 1 -- 172.21.15.7:0/1090467743 learned_addr learned my addr 172.21.15.7:0/1090467743 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.825+0000 7f1083400640 1 --2- 172.21.15.7:0/1090467743 >> v2:172.21.15.77:3300/0 conn(0x7f10840ca0c0 0x7f10840ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.829+0000 7f1082a00640 1 -- 172.21.15.7:0/1090467743 >> v2:172.21.15.77:3300/0 conn(0x7f10840ca0c0 msgr2=0x7f10840ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.829+0000 7f1082a00640 1 --2- 172.21.15.7:0/1090467743 >> v2:172.21.15.77:3300/0 conn(0x7f10840ca0c0 0x7f10840ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.829+0000 7f1082a00640 1 -- 172.21.15.7:0/1090467743 >> v1:172.21.15.77:6789/0 conn(0x7f10840c9ca0 legacy=0x7f108406f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.829+0000 7f1082a00640 1 -- 172.21.15.7:0/1090467743 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1084159600 con 0x7f10840c67c0 2024-09-13T15:04:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.829+0000 7f1083400640 1 --2- 172.21.15.7:0/1090467743 >> v2:172.21.15.77:3300/0 conn(0x7f10840ca0c0 0x7f10840ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.829+0000 7f1082a00640 1 --2- 172.21.15.7:0/1090467743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10840c67c0 0x7f10840c8fb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f108406eae0 tx=0x7f107401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186065465fb0b489 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.829+0000 7f1082000640 1 -- 172.21.15.7:0/1090467743 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10740a8a10 con 0x7f10840c67c0 2024-09-13T15:04:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.829+0000 7f1082000640 1 -- 172.21.15.7:0/1090467743 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10740a8b70 con 0x7f10840c67c0 2024-09-13T15:04:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.829+0000 7f1082000640 1 -- 172.21.15.7:0/1090467743 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10740b0440 con 0x7f10840c67c0 2024-09-13T15:04:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.829+0000 7f1089c00640 1 -- 172.21.15.7:0/1090467743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10840c67c0 msgr2=0x7f10840c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.829+0000 7f1089c00640 1 --2- 172.21.15.7:0/1090467743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10840c67c0 0x7f10840c8fb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f108406eae0 tx=0x7f107401ed10 comp rx=0 tx=0).stop 2024-09-13T15:04:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.829+0000 7f1089c00640 1 -- 172.21.15.7:0/1090467743 shutdown_connections 2024-09-13T15:04:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.829+0000 7f1089c00640 1 --2- 172.21.15.7:0/1090467743 >> v2:172.21.15.77:3300/0 conn(0x7f10840ca0c0 0x7f10840ccdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.829+0000 7f1089c00640 1 --2- 172.21.15.7:0/1090467743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10840c67c0 0x7f10840c8fb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.829+0000 7f1089c00640 1 -- 172.21.15.7:0/1090467743 >> 172.21.15.7:0/1090467743 conn(0x7f108406cf60 msgr2=0x7f10840717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1089c00640 1 -- 172.21.15.7:0/1090467743 shutdown_connections 2024-09-13T15:04:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1089c00640 1 -- 172.21.15.7:0/1090467743 wait complete. 2024-09-13T15:04:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1089c00640 1 Processor -- start 2024-09-13T15:04:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1089c00640 1 -- start start 2024-09-13T15:04:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1089c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10840c67c0 0x7f1084152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1089c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10840c9ca0 0x7f10841e1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1089c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10840ca0c0 0x7f10841e1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1089c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10841df1d0 con 0x7f10840c67c0 2024-09-13T15:04:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1089c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10841f2670 con 0x7f10840c9ca0 2024-09-13T15:04:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1089c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108406a3f0 con 0x7f10840ca0c0 2024-09-13T15:04:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1082a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10840c67c0 0x7f1084152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1082a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10840c67c0 0x7f1084152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60360/0 (socket says 172.21.15.7:60360) 2024-09-13T15:04:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1082a00640 1 -- 172.21.15.7:0/1678462590 learned_addr learned my addr 172.21.15.7:0/1678462590 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f107a000640 1 --2- 172.21.15.7:0/1678462590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10840c9ca0 0x7f10841e1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1083400640 1 --2- 172.21.15.7:0/1678462590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10840ca0c0 0x7f10841e1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1082a00640 1 -- 172.21.15.7:0/1678462590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10840ca0c0 msgr2=0x7f10841e1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1082a00640 1 --2- 172.21.15.7:0/1678462590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10840ca0c0 0x7f10841e1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1082a00640 1 -- 172.21.15.7:0/1678462590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10840c9ca0 msgr2=0x7f10841e1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1082a00640 1 --2- 172.21.15.7:0/1678462590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10840c9ca0 0x7f10841e1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1082a00640 1 -- 172.21.15.7:0/1678462590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10740094d0 con 0x7f10840c67c0 2024-09-13T15:04:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f1082a00640 1 --2- 172.21.15.7:0/1678462590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10840c67c0 0x7f1084152c70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f107401b920 tx=0x7f107401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.833+0000 7f107b400640 1 -- 172.21.15.7:0/1678462590 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10740ba600 con 0x7f10840c67c0 2024-09-13T15:04:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.837+0000 7f107b400640 1 -- 172.21.15.7:0/1678462590 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10740ba760 con 0x7f10840c67c0 2024-09-13T15:04:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.837+0000 7f107b400640 1 -- 172.21.15.7:0/1678462590 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10740bab10 con 0x7f10840c67c0 2024-09-13T15:04:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.837+0000 7f1089c00640 1 -- 172.21.15.7:0/1678462590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10841e0a60 con 0x7f10840c67c0 2024-09-13T15:04:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.837+0000 7f1089c00640 1 -- 172.21.15.7:0/1678462590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10841f2860 con 0x7f10840c67c0 2024-09-13T15:04:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.837+0000 7f1089c00640 1 -- 172.21.15.7:0/1678462590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10840c8fb0 con 0x7f10840c67c0 2024-09-13T15:04:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.837+0000 7f107b400640 1 -- 172.21.15.7:0/1678462590 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f10740bac70 con 0x7f10840c67c0 2024-09-13T15:04:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.837+0000 7f107b400640 1 --2- 172.21.15.7:0/1678462590 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1060066690 0x7f1060068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.837+0000 7f107b400640 1 -- 172.21.15.7:0/1678462590 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1074122ae0 con 0x7f10840c67c0 2024-09-13T15:04:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.837+0000 7f107a000640 1 --2- 172.21.15.7:0/1678462590 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1060066690 0x7f1060068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.841+0000 7f107a000640 1 --2- 172.21.15.7:0/1678462590 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1060066690 0x7f1060068b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1084157980 tx=0x7f106c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:31.841+0000 7f107b400640 1 -- 172.21.15.7:0/1678462590 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f10740efa80 con 0x7f10840c67c0 2024-09-13T15:04:32.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.005+0000 7f1089c00640 1 -- 172.21.15.7:0/1678462590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10840c5830 con 0x7f10840c67c0 2024-09-13T15:04:32.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.005+0000 7f107b400640 1 -- 172.21.15.7:0/1678462590 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18616 (secure 0 0 0) 0x7f10740f30a0 con 0x7f10840c67c0 2024-09-13T15:04:32.009 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:32.009 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:02:33.732864+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:04:32.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.009+0000 7f1089c00640 1 -- 172.21.15.7:0/1678462590 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1060066690 msgr2=0x7f1060068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.009+0000 7f1089c00640 1 --2- 172.21.15.7:0/1678462590 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1060066690 0x7f1060068b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1084157980 tx=0x7f106c009040 comp rx=0 tx=0).stop 2024-09-13T15:04:32.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.009+0000 7f1089c00640 1 -- 172.21.15.7:0/1678462590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10840c67c0 msgr2=0x7f1084152c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.009+0000 7f1089c00640 1 --2- 172.21.15.7:0/1678462590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10840c67c0 0x7f1084152c70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f107401b920 tx=0x7f107401bab0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.009+0000 7f1089c00640 1 -- 172.21.15.7:0/1678462590 shutdown_connections 2024-09-13T15:04:32.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.009+0000 7f1089c00640 1 --2- 172.21.15.7:0/1678462590 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1060066690 0x7f1060068b50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.009+0000 7f1089c00640 1 --2- 172.21.15.7:0/1678462590 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10840ca0c0 0x7f10841e1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.009+0000 7f1089c00640 1 --2- 172.21.15.7:0/1678462590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10840c9ca0 0x7f10841e1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.009+0000 7f1089c00640 1 --2- 172.21.15.7:0/1678462590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10840c67c0 0x7f1084152c70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.009+0000 7f1089c00640 1 -- 172.21.15.7:0/1678462590 >> 172.21.15.7:0/1678462590 conn(0x7f108406cf60 msgr2=0x7f10840c4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:32.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.009+0000 7f1089c00640 1 -- 172.21.15.7:0/1678462590 shutdown_connections 2024-09-13T15:04:32.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.009+0000 7f1089c00640 1 -- 172.21.15.7:0/1678462590 wait complete. 2024-09-13T15:04:32.030 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:01:38.710958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:01:43.178724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:01:43.774877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:01:46.843203+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:04:32.030 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:04:32.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.173+0000 7f50c8c00640 1 Processor -- start 2024-09-13T15:04:32.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.173+0000 7f50c8c00640 1 -- start start 2024-09-13T15:04:32.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.173+0000 7f50c8c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f50c414fdd0 0x7f50c4156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.173+0000 7f50c8c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50c41501b0 0x7f50c40c7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.173+0000 7f50c8c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c40c6880 con 0x7f50c40c16f0 2024-09-13T15:04:32.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.173+0000 7f50c8c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c40721e0 con 0x7f50c414fdd0 2024-09-13T15:04:32.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.173+0000 7f50c8c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c406f860 con 0x7f50c41501b0 2024-09-13T15:04:32.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.173+0000 7f50c2800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f50c40c16f0 0x7f50c40c55d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44160/0 (socket says 172.21.15.7:44160) 2024-09-13T15:04:32.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.173+0000 7f50c1e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f50c414fdd0 0x7f50c4156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.173+0000 7f50c2800640 1 -- 172.21.15.7:0/483398690 learned_addr learned my addr 172.21.15.7:0/483398690 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:32.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.173+0000 7f50c1400640 1 --2- 172.21.15.7:0/483398690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50c41501b0 0x7f50c40c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.173+0000 7f50c0a00640 1 -- 172.21.15.7:0/483398690 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825945308 0 0) 0x7f50c40c6880 con 0x7f50c40c16f0 2024-09-13T15:04:32.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.173+0000 7f50c0a00640 1 -- 172.21.15.7:0/483398690 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50a8003530 con 0x7f50c40c16f0 2024-09-13T15:04:32.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.173+0000 7f50c1e00640 1 -- 172.21.15.7:0/483398690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50c41501b0 msgr2=0x7f50c40c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:32.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.173+0000 7f50c1e00640 1 --2- 172.21.15.7:0/483398690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50c41501b0 0x7f50c40c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.173+0000 7f50c1e00640 1 -- 172.21.15.7:0/483398690 >> v1:172.21.15.7:6789/0 conn(0x7f50c40c16f0 legacy=0x7f50c40c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.173+0000 7f50c1e00640 1 -- 172.21.15.7:0/483398690 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c40c6ad0 con 0x7f50c414fdd0 2024-09-13T15:04:32.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.177+0000 7f50c1e00640 1 --2- 172.21.15.7:0/483398690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c414fdd0 0x7f50c4156780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f50b40097c0 tx=0x7f50b401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d8fbfbe5ab3144 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:32.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.177+0000 7f50c0a00640 1 -- 172.21.15.7:0/483398690 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b40ac600 con 0x7f50c414fdd0 2024-09-13T15:04:32.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.177+0000 7f50c0a00640 1 -- 172.21.15.7:0/483398690 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b40a8050 con 0x7f50c414fdd0 2024-09-13T15:04:32.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.177+0000 7f50c0a00640 1 -- 172.21.15.7:0/483398690 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b40ac980 con 0x7f50c414fdd0 2024-09-13T15:04:32.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.177+0000 7f50c8c00640 1 -- 172.21.15.7:0/483398690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c414fdd0 msgr2=0x7f50c4156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.177+0000 7f50c8c00640 1 --2- 172.21.15.7:0/483398690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c414fdd0 0x7f50c4156780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f50b40097c0 tx=0x7f50b401c4a0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.177+0000 7f50c8c00640 1 -- 172.21.15.7:0/483398690 shutdown_connections 2024-09-13T15:04:32.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.177+0000 7f50c8c00640 1 --2- 172.21.15.7:0/483398690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50c41501b0 0x7f50c40c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.177+0000 7f50c8c00640 1 --2- 172.21.15.7:0/483398690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c414fdd0 0x7f50c4156780 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.177+0000 7f50c8c00640 1 -- 172.21.15.7:0/483398690 >> 172.21.15.7:0/483398690 conn(0x7f50c4065d40 msgr2=0x7f50c4066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:32.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.177+0000 7f50c8c00640 1 -- 172.21.15.7:0/483398690 shutdown_connections 2024-09-13T15:04:32.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.177+0000 7f50c8c00640 1 -- 172.21.15.7:0/483398690 wait complete. 2024-09-13T15:04:32.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.177+0000 7f50c8c00640 1 Processor -- start 2024-09-13T15:04:32.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.177+0000 7f50c8c00640 1 -- start start 2024-09-13T15:04:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c40c16f0 0x7f50c414eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c8c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50c414fdd0 0x7f50c4147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c8c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50c41501b0 0x7f50c414b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c8c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c41f1370 con 0x7f50c40c16f0 2024-09-13T15:04:32.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c8c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c41eeae0 con 0x7f50c414fdd0 2024-09-13T15:04:32.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c8c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c41f1580 con 0x7f50c41501b0 2024-09-13T15:04:32.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c40c16f0 0x7f50c414eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c40c16f0 0x7f50c414eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60384/0 (socket says 172.21.15.7:60384) 2024-09-13T15:04:32.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c1e00640 1 -- 172.21.15.7:0/3099588068 learned_addr learned my addr 172.21.15.7:0/3099588068 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:32.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c2800640 1 --2- 172.21.15.7:0/3099588068 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50c41501b0 0x7f50c414b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c1400640 1 --2- 172.21.15.7:0/3099588068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50c414fdd0 0x7f50c4147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c1e00640 1 -- 172.21.15.7:0/3099588068 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50c41501b0 msgr2=0x7f50c414b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c1e00640 1 --2- 172.21.15.7:0/3099588068 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50c41501b0 0x7f50c414b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c1e00640 1 -- 172.21.15.7:0/3099588068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50c414fdd0 msgr2=0x7f50c4147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c1e00640 1 --2- 172.21.15.7:0/3099588068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50c414fdd0 0x7f50c4147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c1e00640 1 -- 172.21.15.7:0/3099588068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b4009420 con 0x7f50c40c16f0 2024-09-13T15:04:32.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c1400640 1 --2- 172.21.15.7:0/3099588068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50c414fdd0 0x7f50c4147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:32.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c1e00640 1 --2- 172.21.15.7:0/3099588068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c40c16f0 0x7f50c414eac0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f50b401a0d0 tx=0x7f50b401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:32.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50ba000640 1 -- 172.21.15.7:0/3099588068 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b40b7450 con 0x7f50c40c16f0 2024-09-13T15:04:32.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50ba000640 1 -- 172.21.15.7:0/3099588068 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b40b75d0 con 0x7f50c40c16f0 2024-09-13T15:04:32.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50ba000640 1 -- 172.21.15.7:0/3099588068 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b40b7980 con 0x7f50c40c16f0 2024-09-13T15:04:32.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c8c00640 1 -- 172.21.15.7:0/3099588068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c41f1860 con 0x7f50c40c16f0 2024-09-13T15:04:32.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c8c00640 1 -- 172.21.15.7:0/3099588068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c41f1e20 con 0x7f50c40c16f0 2024-09-13T15:04:32.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.181+0000 7f50c8c00640 1 -- 172.21.15.7:0/3099588068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c4067260 con 0x7f50c40c16f0 2024-09-13T15:04:32.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.185+0000 7f50ba000640 1 -- 172.21.15.7:0/3099588068 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50b40b3070 con 0x7f50c40c16f0 2024-09-13T15:04:32.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.185+0000 7f50ba000640 1 --2- 172.21.15.7:0/3099588068 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f50a40666c0 0x7f50a4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.185+0000 7f50ba000640 1 -- 172.21.15.7:0/3099588068 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f50b411e780 con 0x7f50c40c16f0 2024-09-13T15:04:32.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.185+0000 7f50c1400640 1 --2- 172.21.15.7:0/3099588068 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f50a40666c0 0x7f50a4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.185+0000 7f50c1400640 1 --2- 172.21.15.7:0/3099588068 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f50a40666c0 0x7f50a4068b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f50c4148480 tx=0x7f50b000b3a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:32.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.189+0000 7f50ba000640 1 -- 172.21.15.7:0/3099588068 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f50b40eb600 con 0x7f50c40c16f0 2024-09-13T15:04:32.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.349+0000 7f50c8c00640 1 -- 172.21.15.7:0/3099588068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f50c406dc60 con 0x7f50c40c16f0 2024-09-13T15:04:32.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.349+0000 7f50ba000640 1 -- 172.21.15.7:0/3099588068 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f50b40eec20 con 0x7f50c40c16f0 2024-09-13T15:04:32.352 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T15:04:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.353+0000 7f50c8c00640 1 -- 172.21.15.7:0/3099588068 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f50a40666c0 msgr2=0x7f50a4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.353+0000 7f50c8c00640 1 --2- 172.21.15.7:0/3099588068 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f50a40666c0 0x7f50a4068b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f50c4148480 tx=0x7f50b000b3a0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.353+0000 7f50c8c00640 1 -- 172.21.15.7:0/3099588068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c40c16f0 msgr2=0x7f50c414eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.353+0000 7f50c8c00640 1 --2- 172.21.15.7:0/3099588068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c40c16f0 0x7f50c414eac0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f50b401a0d0 tx=0x7f50b401ace0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.353+0000 7f50c8c00640 1 -- 172.21.15.7:0/3099588068 shutdown_connections 2024-09-13T15:04:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.353+0000 7f50c8c00640 1 --2- 172.21.15.7:0/3099588068 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f50a40666c0 0x7f50a4068b80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.353+0000 7f50c8c00640 1 --2- 172.21.15.7:0/3099588068 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50c41501b0 0x7f50c414b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.353+0000 7f50c8c00640 1 --2- 172.21.15.7:0/3099588068 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50c414fdd0 0x7f50c4147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.353+0000 7f50c8c00640 1 --2- 172.21.15.7:0/3099588068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c40c16f0 0x7f50c414eac0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.353+0000 7f50c8c00640 1 -- 172.21.15.7:0/3099588068 >> 172.21.15.7:0/3099588068 conn(0x7f50c4065d40 msgr2=0x7f50c4153960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:32.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.353+0000 7f50c8c00640 1 -- 172.21.15.7:0/3099588068 shutdown_connections 2024-09-13T15:04:32.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.353+0000 7f50c8c00640 1 -- 172.21.15.7:0/3099588068 wait complete. 2024-09-13T15:04:32.373 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:04:32.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.513+0000 7f3f9f400640 1 Processor -- start 2024-09-13T15:04:32.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.513+0000 7f3f9f400640 1 -- start start 2024-09-13T15:04:32.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.517+0000 7f3f9f400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f981501b0 0x7f3f98156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.517+0000 7f3f9f400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f980c6880 con 0x7f3f980c16f0 2024-09-13T15:04:32.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.517+0000 7f3f9f400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f980721e0 con 0x7f3f9814fdd0 2024-09-13T15:04:32.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.517+0000 7f3f9f400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9806f860 con 0x7f3f981501b0 2024-09-13T15:04:32.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.517+0000 7f3f9d400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3f980c16f0 0x7f3f980c55d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44170/0 (socket says 172.21.15.7:44170) 2024-09-13T15:04:32.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.517+0000 7f3f9d400640 1 -- 172.21.15.7:0/186629475 learned_addr learned my addr 172.21.15.7:0/186629475 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:32.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.517+0000 7f3f97e00640 1 --2- 172.21.15.7:0/186629475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f981501b0 0x7f3f98156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.517+0000 7f3f97400640 1 -- 172.21.15.7:0/186629475 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282994932 0 0) 0x7f3f980c6880 con 0x7f3f980c16f0 2024-09-13T15:04:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.517+0000 7f3f97400640 1 -- 172.21.15.7:0/186629475 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f80005740 con 0x7f3f980c16f0 2024-09-13T15:04:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.517+0000 7f3f97400640 1 -- 172.21.15.7:0/186629475 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497729135 0 0) 0x7f3f980721e0 con 0x7f3f9814fdd0 2024-09-13T15:04:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.517+0000 7f3f97400640 1 -- 172.21.15.7:0/186629475 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f980c6880 con 0x7f3f9814fdd0 2024-09-13T15:04:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.517+0000 7f3f97e00640 1 -- 172.21.15.7:0/186629475 >> v1:172.21.15.77:6789/0 conn(0x7f3f9814fdd0 legacy=0x7f3f980c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.517+0000 7f3f97e00640 1 -- 172.21.15.7:0/186629475 >> v1:172.21.15.7:6789/0 conn(0x7f3f980c16f0 legacy=0x7f3f980c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.517+0000 7f3f97e00640 1 -- 172.21.15.7:0/186629475 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f980c6ad0 con 0x7f3f981501b0 2024-09-13T15:04:32.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.521+0000 7f3f97e00640 1 --2- 172.21.15.7:0/186629475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f981501b0 0x7f3f98156780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3f840097f0 tx=0x7f3f8401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcffc692448fd107 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:32.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.521+0000 7f3f97400640 1 -- 172.21.15.7:0/186629475 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f840ac640 con 0x7f3f981501b0 2024-09-13T15:04:32.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.521+0000 7f3f97400640 1 -- 172.21.15.7:0/186629475 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f840ac7a0 con 0x7f3f981501b0 2024-09-13T15:04:32.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.521+0000 7f3f97400640 1 -- 172.21.15.7:0/186629475 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f840acb30 con 0x7f3f981501b0 2024-09-13T15:04:32.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.521+0000 7f3f9f400640 1 -- 172.21.15.7:0/186629475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f981501b0 msgr2=0x7f3f98156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.521+0000 7f3f9f400640 1 --2- 172.21.15.7:0/186629475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f981501b0 0x7f3f98156780 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3f840097f0 tx=0x7f3f8401c4e0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.521+0000 7f3f9f400640 1 -- 172.21.15.7:0/186629475 shutdown_connections 2024-09-13T15:04:32.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.521+0000 7f3f9f400640 1 --2- 172.21.15.7:0/186629475 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f981501b0 0x7f3f98156780 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.521+0000 7f3f9f400640 1 -- 172.21.15.7:0/186629475 >> 172.21.15.7:0/186629475 conn(0x7f3f98065d40 msgr2=0x7f3f98066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:32.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.521+0000 7f3f9f400640 1 -- 172.21.15.7:0/186629475 shutdown_connections 2024-09-13T15:04:32.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.521+0000 7f3f9f400640 1 -- 172.21.15.7:0/186629475 wait complete. 2024-09-13T15:04:32.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.521+0000 7f3f9f400640 1 Processor -- start 2024-09-13T15:04:32.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.521+0000 7f3f9f400640 1 -- start start 2024-09-13T15:04:32.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f9f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f980c16f0 0x7f3f981f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f9f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f9814fdd0 0x7f3f98147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f9f400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f981501b0 0x7f3f981498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f9f400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f98144790 con 0x7f3f9814fdd0 2024-09-13T15:04:32.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f9f400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f981f57b0 con 0x7f3f980c16f0 2024-09-13T15:04:32.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f9f400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f981f5a90 con 0x7f3f981501b0 2024-09-13T15:04:32.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f97e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f9814fdd0 0x7f3f98147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f97e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f9814fdd0 0x7f3f98147bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60396/0 (socket says 172.21.15.7:60396) 2024-09-13T15:04:32.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f97e00640 1 -- 172.21.15.7:0/21454208 learned_addr learned my addr 172.21.15.7:0/21454208 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:32.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f9ca00640 1 --2- 172.21.15.7:0/21454208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f980c16f0 0x7f3f981f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f9d400640 1 --2- 172.21.15.7:0/21454208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f981501b0 0x7f3f981498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f97e00640 1 -- 172.21.15.7:0/21454208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f981501b0 msgr2=0x7f3f981498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f97e00640 1 --2- 172.21.15.7:0/21454208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f981501b0 0x7f3f981498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f97e00640 1 -- 172.21.15.7:0/21454208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f980c16f0 msgr2=0x7f3f981f1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f97e00640 1 --2- 172.21.15.7:0/21454208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f980c16f0 0x7f3f981f1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f97e00640 1 -- 172.21.15.7:0/21454208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f84009420 con 0x7f3f9814fdd0 2024-09-13T15:04:32.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f9ca00640 1 --2- 172.21.15.7:0/21454208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f980c16f0 0x7f3f981f1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:32.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f97e00640 1 --2- 172.21.15.7:0/21454208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f9814fdd0 0x7f3f98147bd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3f840097f0 tx=0x7f3f84019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:32.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f94c00640 1 -- 172.21.15.7:0/21454208 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f840b5600 con 0x7f3f9814fdd0 2024-09-13T15:04:32.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f94c00640 1 -- 172.21.15.7:0/21454208 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f840b5760 con 0x7f3f9814fdd0 2024-09-13T15:04:32.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f9f400640 1 -- 172.21.15.7:0/21454208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f981f5d70 con 0x7f3f9814fdd0 2024-09-13T15:04:32.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f94c00640 1 -- 172.21.15.7:0/21454208 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f840b5b10 con 0x7f3f9814fdd0 2024-09-13T15:04:32.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f9f400640 1 -- 172.21.15.7:0/21454208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f981490d0 con 0x7f3f9814fdd0 2024-09-13T15:04:32.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f9f400640 1 -- 172.21.15.7:0/21454208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f98156780 con 0x7f3f9814fdd0 2024-09-13T15:04:32.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.525+0000 7f3f94c00640 1 -- 172.21.15.7:0/21454208 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3f840b3040 con 0x7f3f9814fdd0 2024-09-13T15:04:32.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.529+0000 7f3f94c00640 1 --2- 172.21.15.7:0/21454208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3f780666c0 0x7f3f78068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.529+0000 7f3f94c00640 1 -- 172.21.15.7:0/21454208 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3f8411e840 con 0x7f3f9814fdd0 2024-09-13T15:04:32.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.529+0000 7f3f9ca00640 1 --2- 172.21.15.7:0/21454208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3f780666c0 0x7f3f78068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.529+0000 7f3f9ca00640 1 --2- 172.21.15.7:0/21454208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3f780666c0 0x7f3f78068b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0011f0 tx=0x7f3f8c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:32.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.533+0000 7f3f94c00640 1 -- 172.21.15.7:0/21454208 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3f840eb6c0 con 0x7f3f9814fdd0 2024-09-13T15:04:32.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.693+0000 7f3f9f400640 1 -- 172.21.15.7:0/21454208 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f980c6270 con 0x7f3f9814fdd0 2024-09-13T15:04:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.693+0000 7f3f94c00640 1 -- 172.21.15.7:0/21454208 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3f840eece0 con 0x7f3f9814fdd0 2024-09-13T15:04:32.695 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T15:04:32.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.693+0000 7f3f9f400640 1 -- 172.21.15.7:0/21454208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3f780666c0 msgr2=0x7f3f78068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.693+0000 7f3f9f400640 1 --2- 172.21.15.7:0/21454208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3f780666c0 0x7f3f78068b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0011f0 tx=0x7f3f8c009040 comp rx=0 tx=0).stop 2024-09-13T15:04:32.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.693+0000 7f3f9f400640 1 -- 172.21.15.7:0/21454208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f9814fdd0 msgr2=0x7f3f98147bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.693+0000 7f3f9f400640 1 --2- 172.21.15.7:0/21454208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f9814fdd0 0x7f3f98147bd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3f840097f0 tx=0x7f3f84019280 comp rx=0 tx=0).stop 2024-09-13T15:04:32.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.693+0000 7f3f9f400640 1 -- 172.21.15.7:0/21454208 shutdown_connections 2024-09-13T15:04:32.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.693+0000 7f3f9f400640 1 --2- 172.21.15.7:0/21454208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3f780666c0 0x7f3f78068b80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.693+0000 7f3f9f400640 1 --2- 172.21.15.7:0/21454208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3f981501b0 0x7f3f981498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.693+0000 7f3f9f400640 1 --2- 172.21.15.7:0/21454208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f9814fdd0 0x7f3f98147bd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.693+0000 7f3f9f400640 1 --2- 172.21.15.7:0/21454208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f980c16f0 0x7f3f981f1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.693+0000 7f3f9f400640 1 -- 172.21.15.7:0/21454208 >> 172.21.15.7:0/21454208 conn(0x7f3f98065d40 msgr2=0x7f3f980c73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:32.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.693+0000 7f3f9f400640 1 -- 172.21.15.7:0/21454208 shutdown_connections 2024-09-13T15:04:32.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.693+0000 7f3f9f400640 1 -- 172.21.15.7:0/21454208 wait complete. 2024-09-13T15:04:32.715 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:04:32.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.857+0000 7f5c7f200640 1 Processor -- start 2024-09-13T15:04:32.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.857+0000 7f5c7f200640 1 -- start start 2024-09-13T15:04:32.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c7f200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5c7806e3e0 0x7f5c780c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c7f200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c780733a0 0x7f5c780737f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c7f200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c78159b70 con 0x7f5c780c5430 2024-09-13T15:04:32.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c7f200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c780c67d0 con 0x7f5c7806e3e0 2024-09-13T15:04:32.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c7f200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7806e810 con 0x7f5c780733a0 2024-09-13T15:04:32.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5c780c5430 0x7f5c7815c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44184/0 (socket says 172.21.15.7:44184) 2024-09-13T15:04:32.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77e00640 1 -- 172.21.15.7:0/3158869731 learned_addr learned my addr 172.21.15.7:0/3158869731 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:32.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c6fe00640 1 --2- 172.21.15.7:0/3158869731 >> v2:172.21.15.77:3300/0 conn(0x7f5c7806e3e0 0x7f5c780c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c7d200640 1 --2- 172.21.15.7:0/3158869731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c780733a0 0x7f5c780737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77400640 1 -- 172.21.15.7:0/3158869731 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1870431653 0 0) 0x7f5c78159b70 con 0x7f5c780c5430 2024-09-13T15:04:32.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77400640 1 -- 172.21.15.7:0/3158869731 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c5c003530 con 0x7f5c780c5430 2024-09-13T15:04:32.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77400640 1 -- 172.21.15.7:0/3158869731 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 316357706 0 0) 0x7f5c5c003530 con 0x7f5c780c5430 2024-09-13T15:04:32.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77400640 1 -- 172.21.15.7:0/3158869731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c780733a0 msgr2=0x7f5c780737f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:32.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77400640 1 --2- 172.21.15.7:0/3158869731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c780733a0 0x7f5c780737f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77400640 1 -- 172.21.15.7:0/3158869731 >> v2:172.21.15.77:3300/0 conn(0x7f5c7806e3e0 msgr2=0x7f5c780c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:32.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77400640 1 --2- 172.21.15.7:0/3158869731 >> v2:172.21.15.77:3300/0 conn(0x7f5c7806e3e0 0x7f5c780c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77400640 1 -- 172.21.15.7:0/3158869731 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c780c62a0 con 0x7f5c780c5430 2024-09-13T15:04:32.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77400640 1 -- 172.21.15.7:0/3158869731 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f5c68001680 con 0x7f5c780c5430 2024-09-13T15:04:32.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77400640 1 -- 172.21.15.7:0/3158869731 >> v1:172.21.15.7:6789/0 conn(0x7f5c780c5430 legacy=0x7f5c7815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77400640 1 --2- 172.21.15.7:0/3158869731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c780733a0 0x7f5c5c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77400640 1 --2- 172.21.15.7:0/3158869731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c5c003f00 0x7f5c5c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77400640 1 --2- 172.21.15.7:0/3158869731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c5c004d10 0x7f5c5c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77400640 1 -- 172.21.15.7:0/3158869731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c780c67d0 con 0x7f5c5c004d10 2024-09-13T15:04:32.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77400640 1 -- 172.21.15.7:0/3158869731 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c7806e810 con 0x7f5c5c003f00 2024-09-13T15:04:32.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77400640 1 -- 172.21.15.7:0/3158869731 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5c00b9c0 con 0x7f5c780733a0 2024-09-13T15:04:32.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c7d200640 1 --2- 172.21.15.7:0/3158869731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c5c004d10 0x7f5c5c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c6fe00640 1 --2- 172.21.15.7:0/3158869731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c5c003f00 0x7f5c5c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c77e00640 1 --2- 172.21.15.7:0/3158869731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c780733a0 0x7f5c5c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c7d200640 1 -- 172.21.15.7:0/3158869731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c780733a0 msgr2=0x7f5c5c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:32.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c7d200640 1 --2- 172.21.15.7:0/3158869731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c780733a0 0x7f5c5c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c7d200640 1 -- 172.21.15.7:0/3158869731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c5c003f00 msgr2=0x7f5c5c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:32.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c7d200640 1 --2- 172.21.15.7:0/3158869731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c5c003f00 0x7f5c5c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.861+0000 7f5c7d200640 1 -- 172.21.15.7:0/3158869731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c003530 con 0x7f5c5c004d10 2024-09-13T15:04:32.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.865+0000 7f5c7d200640 1 --2- 172.21.15.7:0/3158869731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c5c004d10 0x7f5c5c005190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009fc0 tx=0x7f5c7001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115709ec8d3ec14 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:32.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.865+0000 7f5c77400640 1 -- 172.21.15.7:0/3158869731 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c700a5c90 con 0x7f5c5c004d10 2024-09-13T15:04:32.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.865+0000 7f5c77400640 1 -- 172.21.15.7:0/3158869731 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7000f040 con 0x7f5c5c004d10 2024-09-13T15:04:32.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.865+0000 7f5c77400640 1 -- 172.21.15.7:0/3158869731 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c700ad440 con 0x7f5c5c004d10 2024-09-13T15:04:32.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.865+0000 7f5c7f200640 1 -- 172.21.15.7:0/3158869731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c5c004d10 msgr2=0x7f5c5c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.865+0000 7f5c7f200640 1 --2- 172.21.15.7:0/3158869731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c5c004d10 0x7f5c5c005190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5c70009fc0 tx=0x7f5c7001cc80 comp rx=0 tx=0).stop 2024-09-13T15:04:32.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.865+0000 7f5c7d200640 1 -- 172.21.15.7:0/3158869731 reap_dead start 2024-09-13T15:04:32.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.865+0000 7f5c7f200640 1 -- 172.21.15.7:0/3158869731 shutdown_connections 2024-09-13T15:04:32.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.865+0000 7f5c7f200640 1 -- 172.21.15.7:0/3158869731 >> 172.21.15.7:0/3158869731 conn(0x7f5c780cb360 msgr2=0x7f5c780cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:32.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.865+0000 7f5c7f200640 1 -- 172.21.15.7:0/3158869731 shutdown_connections 2024-09-13T15:04:32.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.865+0000 7f5c7f200640 1 -- 172.21.15.7:0/3158869731 wait complete. 2024-09-13T15:04:32.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.865+0000 7f5c7f200640 1 Processor -- start 2024-09-13T15:04:32.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.865+0000 7f5c7f200640 1 -- start start 2024-09-13T15:04:32.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c7f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c5c004d10 0x7f5c7813c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c7f200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c780c3b90 0x7f5c78152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c7f200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c78139960 0x7f5c7813df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c7f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c78158bd0 con 0x7f5c5c004d10 2024-09-13T15:04:32.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c7f200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c780ca550 con 0x7f5c78139960 2024-09-13T15:04:32.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c7f200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c78158de0 con 0x7f5c780c3b90 2024-09-13T15:04:32.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c77e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c5c004d10 0x7f5c7813c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c77e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c5c004d10 0x7f5c7813c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60416/0 (socket says 172.21.15.7:60416) 2024-09-13T15:04:32.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c77e00640 1 -- 172.21.15.7:0/614005153 learned_addr learned my addr 172.21.15.7:0/614005153 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:32.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c6fe00640 1 --2- 172.21.15.7:0/614005153 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c780c3b90 0x7f5c78152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c7d200640 1 --2- 172.21.15.7:0/614005153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c78139960 0x7f5c7813df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c77e00640 1 -- 172.21.15.7:0/614005153 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c780c3b90 msgr2=0x7f5c78152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c77e00640 1 --2- 172.21.15.7:0/614005153 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c780c3b90 0x7f5c78152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c77e00640 1 -- 172.21.15.7:0/614005153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c78139960 msgr2=0x7f5c7813df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:32.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c77e00640 1 --2- 172.21.15.7:0/614005153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c78139960 0x7f5c7813df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:32.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c77e00640 1 -- 172.21.15.7:0/614005153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c780c9cb0 con 0x7f5c5c004d10 2024-09-13T15:04:32.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c7d200640 1 --2- 172.21.15.7:0/614005153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c78139960 0x7f5c7813df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:32.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c77e00640 1 --2- 172.21.15.7:0/614005153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c5c004d10 0x7f5c7813c2c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5c68007310 tx=0x7f5c68007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:32.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c74c00640 1 -- 172.21.15.7:0/614005153 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6800fa80 con 0x7f5c5c004d10 2024-09-13T15:04:32.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c74c00640 1 -- 172.21.15.7:0/614005153 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c6800fc00 con 0x7f5c5c004d10 2024-09-13T15:04:32.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c7f200640 1 -- 172.21.15.7:0/614005153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c780c9f90 con 0x7f5c5c004d10 2024-09-13T15:04:32.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c74c00640 1 -- 172.21.15.7:0/614005153 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c680133f0 con 0x7f5c5c004d10 2024-09-13T15:04:32.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c7f200640 1 -- 172.21.15.7:0/614005153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c781503e0 con 0x7f5c5c004d10 2024-09-13T15:04:32.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c7f200640 1 -- 172.21.15.7:0/614005153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c780c89b0 con 0x7f5c5c004d10 2024-09-13T15:04:32.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.869+0000 7f5c74c00640 1 -- 172.21.15.7:0/614005153 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5c68013550 con 0x7f5c5c004d10 2024-09-13T15:04:32.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.873+0000 7f5c74c00640 1 --2- 172.21.15.7:0/614005153 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5c54066690 0x7f5c54068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:32.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.873+0000 7f5c74c00640 1 -- 172.21.15.7:0/614005153 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5c680848e0 con 0x7f5c5c004d10 2024-09-13T15:04:32.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.873+0000 7f5c6fe00640 1 --2- 172.21.15.7:0/614005153 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5c54066690 0x7f5c54068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:32.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.873+0000 7f5c6fe00640 1 --2- 172.21.15.7:0/614005153 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5c54066690 0x7f5c54068b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5c780c8c60 tx=0x7f5c60008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:32.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:32.877+0000 7f5c74c00640 1 -- 172.21.15.7:0/614005153 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5c68051880 con 0x7f5c5c004d10 2024-09-13T15:04:33.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.037+0000 7f5c7f200640 1 -- 172.21.15.7:0/614005153 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c781594d0 con 0x7f5c5c004d10 2024-09-13T15:04:33.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.037+0000 7f5c74c00640 1 -- 172.21.15.7:0/614005153 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c68054ea0 con 0x7f5c5c004d10 2024-09-13T15:04:33.041 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-13T15:04:33.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.041+0000 7f5c7f200640 1 -- 172.21.15.7:0/614005153 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5c54066690 msgr2=0x7f5c54068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.041+0000 7f5c7f200640 1 --2- 172.21.15.7:0/614005153 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5c54066690 0x7f5c54068b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5c780c8c60 tx=0x7f5c60008040 comp rx=0 tx=0).stop 2024-09-13T15:04:33.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.041+0000 7f5c7f200640 1 -- 172.21.15.7:0/614005153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c5c004d10 msgr2=0x7f5c7813c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.041+0000 7f5c7f200640 1 --2- 172.21.15.7:0/614005153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c5c004d10 0x7f5c7813c2c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5c68007310 tx=0x7f5c68007710 comp rx=0 tx=0).stop 2024-09-13T15:04:33.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.041+0000 7f5c7f200640 1 -- 172.21.15.7:0/614005153 shutdown_connections 2024-09-13T15:04:33.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.041+0000 7f5c7f200640 1 --2- 172.21.15.7:0/614005153 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5c54066690 0x7f5c54068b50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.041+0000 7f5c7f200640 1 --2- 172.21.15.7:0/614005153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5c78139960 0x7f5c7813df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.041+0000 7f5c7f200640 1 --2- 172.21.15.7:0/614005153 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5c780c3b90 0x7f5c78152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.041+0000 7f5c7f200640 1 --2- 172.21.15.7:0/614005153 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5c5c004d10 0x7f5c7813c2c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.041+0000 7f5c7f200640 1 -- 172.21.15.7:0/614005153 >> 172.21.15.7:0/614005153 conn(0x7f5c780cb360 msgr2=0x7f5c780c3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:33.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.041+0000 7f5c7f200640 1 -- 172.21.15.7:0/614005153 shutdown_connections 2024-09-13T15:04:33.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.041+0000 7f5c7f200640 1 -- 172.21.15.7:0/614005153 wait complete. 2024-09-13T15:04:33.062 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:04:33.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.205+0000 7f2962e00640 1 Processor -- start 2024-09-13T15:04:33.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.205+0000 7f2962e00640 1 -- start start 2024-09-13T15:04:33.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.205+0000 7f2962e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f295c14fdd0 0x7f295c156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.205+0000 7f2962e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f295c0c16f0 0x7f295c0c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.205+0000 7f2962e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f295c0c6880 con 0x7f295c1501b0 2024-09-13T15:04:33.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.205+0000 7f2962e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295c0721e0 con 0x7f295c0c16f0 2024-09-13T15:04:33.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.205+0000 7f2962e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295c06f860 con 0x7f295c14fdd0 2024-09-13T15:04:33.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.205+0000 7f2953400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f295c1501b0 0x7f295c0c7420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44190/0 (socket says 172.21.15.7:44190) 2024-09-13T15:04:33.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.205+0000 7f2953400640 1 -- 172.21.15.7:0/1070115347 learned_addr learned my addr 172.21.15.7:0/1070115347 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:33.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.205+0000 7f2960e00640 1 --2- 172.21.15.7:0/1070115347 >> v2:172.21.15.7:3300/0 conn(0x7f295c0c16f0 0x7f295c0c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.205+0000 7f295be00640 1 --2- 172.21.15.7:0/1070115347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f295c14fdd0 0x7f295c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.205+0000 7f295b400640 1 -- 172.21.15.7:0/1070115347 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662467182 0 0) 0x7f295c0c6880 con 0x7f295c1501b0 2024-09-13T15:04:33.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.205+0000 7f295b400640 1 -- 172.21.15.7:0/1070115347 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2940003530 con 0x7f295c1501b0 2024-09-13T15:04:33.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.205+0000 7f2960e00640 1 -- 172.21.15.7:0/1070115347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f295c14fdd0 msgr2=0x7f295c156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:33.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.205+0000 7f2960e00640 1 --2- 172.21.15.7:0/1070115347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f295c14fdd0 0x7f295c156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.205+0000 7f2960e00640 1 -- 172.21.15.7:0/1070115347 >> v1:172.21.15.7:6789/0 conn(0x7f295c1501b0 legacy=0x7f295c0c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.205+0000 7f2960e00640 1 -- 172.21.15.7:0/1070115347 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295c0c6ad0 con 0x7f295c0c16f0 2024-09-13T15:04:33.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.209+0000 7f2960e00640 1 --2- 172.21.15.7:0/1070115347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f295c0c16f0 0x7f295c0c55d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f295400bfa0 tx=0x7f295401eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f742f6333d5b5527 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:33.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.209+0000 7f295b400640 1 -- 172.21.15.7:0/1070115347 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295400b2d0 con 0x7f295c0c16f0 2024-09-13T15:04:33.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.209+0000 7f295b400640 1 -- 172.21.15.7:0/1070115347 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29540a7940 con 0x7f295c0c16f0 2024-09-13T15:04:33.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.209+0000 7f295b400640 1 -- 172.21.15.7:0/1070115347 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29540a7cd0 con 0x7f295c0c16f0 2024-09-13T15:04:33.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.209+0000 7f2962e00640 1 -- 172.21.15.7:0/1070115347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f295c0c16f0 msgr2=0x7f295c0c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.209+0000 7f2962e00640 1 --2- 172.21.15.7:0/1070115347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f295c0c16f0 0x7f295c0c55d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f295400bfa0 tx=0x7f295401eb70 comp rx=0 tx=0).stop 2024-09-13T15:04:33.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.209+0000 7f2962e00640 1 -- 172.21.15.7:0/1070115347 shutdown_connections 2024-09-13T15:04:33.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.209+0000 7f2962e00640 1 --2- 172.21.15.7:0/1070115347 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f295c0c16f0 0x7f295c0c55d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.209+0000 7f2962e00640 1 --2- 172.21.15.7:0/1070115347 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f295c14fdd0 0x7f295c156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.209+0000 7f2962e00640 1 -- 172.21.15.7:0/1070115347 >> 172.21.15.7:0/1070115347 conn(0x7f295c065d40 msgr2=0x7f295c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:33.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.209+0000 7f2962e00640 1 -- 172.21.15.7:0/1070115347 shutdown_connections 2024-09-13T15:04:33.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.209+0000 7f2962e00640 1 -- 172.21.15.7:0/1070115347 wait complete. 2024-09-13T15:04:33.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.209+0000 7f2962e00640 1 Processor -- start 2024-09-13T15:04:33.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.209+0000 7f2962e00640 1 -- start start 2024-09-13T15:04:33.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f2962e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f295c0c16f0 0x7f295c0c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f2962e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f295c14fdd0 0x7f295c152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f2962e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f295c1501b0 0x7f295c13e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f2962e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295c1517c0 con 0x7f295c0c16f0 2024-09-13T15:04:33.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f2962e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295c153630 con 0x7f295c14fdd0 2024-09-13T15:04:33.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f2962e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295c0cac20 con 0x7f295c1501b0 2024-09-13T15:04:33.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f295be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f295c0c16f0 0x7f295c0c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f295be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f295c0c16f0 0x7f295c0c7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60424/0 (socket says 172.21.15.7:60424) 2024-09-13T15:04:33.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f295be00640 1 -- 172.21.15.7:0/2098757843 learned_addr learned my addr 172.21.15.7:0/2098757843 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:33.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f2953400640 1 --2- 172.21.15.7:0/2098757843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f295c14fdd0 0x7f295c152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f2960e00640 1 --2- 172.21.15.7:0/2098757843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f295c1501b0 0x7f295c13e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f295be00640 1 -- 172.21.15.7:0/2098757843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f295c1501b0 msgr2=0x7f295c13e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f295be00640 1 --2- 172.21.15.7:0/2098757843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f295c1501b0 0x7f295c13e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f295be00640 1 -- 172.21.15.7:0/2098757843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f295c14fdd0 msgr2=0x7f295c152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f295be00640 1 --2- 172.21.15.7:0/2098757843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f295c14fdd0 0x7f295c152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f295be00640 1 -- 172.21.15.7:0/2098757843 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295400bc80 con 0x7f295c0c16f0 2024-09-13T15:04:33.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f2953400640 1 --2- 172.21.15.7:0/2098757843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f295c14fdd0 0x7f295c152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:33.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f295be00640 1 --2- 172.21.15.7:0/2098757843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f295c0c16f0 0x7f295c0c7680 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f294c00e930 tx=0x7f294c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:33.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f2958c00640 1 -- 172.21.15.7:0/2098757843 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c009690 con 0x7f295c0c16f0 2024-09-13T15:04:33.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f2958c00640 1 -- 172.21.15.7:0/2098757843 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294c00ca00 con 0x7f295c0c16f0 2024-09-13T15:04:33.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f2962e00640 1 -- 172.21.15.7:0/2098757843 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295c0c8d60 con 0x7f295c0c16f0 2024-09-13T15:04:33.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f2958c00640 1 -- 172.21.15.7:0/2098757843 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c00cd70 con 0x7f295c0c16f0 2024-09-13T15:04:33.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f2962e00640 1 -- 172.21.15.7:0/2098757843 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295c0cb1c0 con 0x7f295c0c16f0 2024-09-13T15:04:33.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.213+0000 7f2962e00640 1 -- 172.21.15.7:0/2098757843 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f295c152690 con 0x7f295c0c16f0 2024-09-13T15:04:33.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.217+0000 7f2958c00640 1 -- 172.21.15.7:0/2098757843 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f294c013470 con 0x7f295c0c16f0 2024-09-13T15:04:33.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.217+0000 7f2958c00640 1 --2- 172.21.15.7:0/2098757843 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f29380666c0 0x7f2938068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.217+0000 7f2958c00640 1 -- 172.21.15.7:0/2098757843 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f294c0847b0 con 0x7f295c0c16f0 2024-09-13T15:04:33.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.217+0000 7f2953400640 1 --2- 172.21.15.7:0/2098757843 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f29380666c0 0x7f2938068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.217+0000 7f2953400640 1 --2- 172.21.15.7:0/2098757843 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f29380666c0 0x7f2938068b80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f295c0c88b0 tx=0x7f2944009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:33.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.221+0000 7f2958c00640 1 -- 172.21.15.7:0/2098757843 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f294c051830 con 0x7f295c0c16f0 2024-09-13T15:04:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.385+0000 7f2962e00640 1 -- 172.21.15.7:0/2098757843 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f295c0c55d0 con 0x7f295c0c16f0 2024-09-13T15:04:33.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.385+0000 7f2958c00640 1 -- 172.21.15.7:0/2098757843 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f294c054e50 con 0x7f295c0c16f0 2024-09-13T15:04:33.388 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T15:04:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.389+0000 7f2962e00640 1 -- 172.21.15.7:0/2098757843 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f29380666c0 msgr2=0x7f2938068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.389+0000 7f2962e00640 1 --2- 172.21.15.7:0/2098757843 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f29380666c0 0x7f2938068b80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f295c0c88b0 tx=0x7f2944009040 comp rx=0 tx=0).stop 2024-09-13T15:04:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.389+0000 7f2962e00640 1 -- 172.21.15.7:0/2098757843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f295c0c16f0 msgr2=0x7f295c0c7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.389+0000 7f2962e00640 1 --2- 172.21.15.7:0/2098757843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f295c0c16f0 0x7f295c0c7680 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f294c00e930 tx=0x7f294c00edf0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.389+0000 7f2962e00640 1 -- 172.21.15.7:0/2098757843 shutdown_connections 2024-09-13T15:04:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.389+0000 7f2962e00640 1 --2- 172.21.15.7:0/2098757843 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f29380666c0 0x7f2938068b80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.389+0000 7f2962e00640 1 --2- 172.21.15.7:0/2098757843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f295c1501b0 0x7f295c13e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.389+0000 7f2962e00640 1 --2- 172.21.15.7:0/2098757843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f295c14fdd0 0x7f295c152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.389+0000 7f2962e00640 1 --2- 172.21.15.7:0/2098757843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f295c0c16f0 0x7f295c0c7680 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.389+0000 7f2962e00640 1 -- 172.21.15.7:0/2098757843 >> 172.21.15.7:0/2098757843 conn(0x7f295c065d40 msgr2=0x7f295c154300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:33.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.389+0000 7f2962e00640 1 -- 172.21.15.7:0/2098757843 shutdown_connections 2024-09-13T15:04:33.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.389+0000 7f2962e00640 1 -- 172.21.15.7:0/2098757843 wait complete. 2024-09-13T15:04:33.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:04:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.545+0000 7f1340a00640 1 Processor -- start 2024-09-13T15:04:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.545+0000 7f1340a00640 1 -- start start 2024-09-13T15:04:33.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.549+0000 7f1340a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f133c06da80 0x7f133c0c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.549+0000 7f1340a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f133c0c7900 0x7f133c152e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.549+0000 7f1340a00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133c0c6770 con 0x7f133c06de60 2024-09-13T15:04:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.549+0000 7f1340a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c15a060 con 0x7f133c06da80 2024-09-13T15:04:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.549+0000 7f1340a00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c159240 con 0x7f133c0c7900 2024-09-13T15:04:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.549+0000 7f1339e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f133c06da80 0x7f133c0c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.549+0000 7f1339e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f133c06da80 0x7f133c0c73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60426/0 (socket says 172.21.15.7:60426) 2024-09-13T15:04:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.549+0000 7f1339e00640 1 -- 172.21.15.7:0/4159613659 learned_addr learned my addr 172.21.15.7:0/4159613659 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.549+0000 7f133a800640 1 --2- 172.21.15.7:0/4159613659 >> v2:172.21.15.77:3300/0 conn(0x7f133c0c7900 0x7f133c152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.549+0000 7f1339e00640 1 -- 172.21.15.7:0/4159613659 >> v2:172.21.15.77:3300/0 conn(0x7f133c0c7900 msgr2=0x7f133c152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.549+0000 7f1339e00640 1 --2- 172.21.15.7:0/4159613659 >> v2:172.21.15.77:3300/0 conn(0x7f133c0c7900 0x7f133c152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.549+0000 7f1339e00640 1 -- 172.21.15.7:0/4159613659 >> v1:172.21.15.77:6789/0 conn(0x7f133c06de60 legacy=0x7f133c15ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.549+0000 7f1339e00640 1 -- 172.21.15.7:0/4159613659 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c1594e0 con 0x7f133c06da80 2024-09-13T15:04:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1339e00640 1 --2- 172.21.15.7:0/4159613659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06da80 0x7f133c0c73c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f133c0c6b50 tx=0x7f132c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3012778fd885f43c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1339400640 1 -- 172.21.15.7:0/4159613659 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c0aa650 con 0x7f133c06da80 2024-09-13T15:04:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1339400640 1 -- 172.21.15.7:0/4159613659 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c0aa7b0 con 0x7f133c06da80 2024-09-13T15:04:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1339400640 1 -- 172.21.15.7:0/4159613659 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c0aab40 con 0x7f133c06da80 2024-09-13T15:04:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1340a00640 1 -- 172.21.15.7:0/4159613659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06da80 msgr2=0x7f133c0c73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1340a00640 1 --2- 172.21.15.7:0/4159613659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06da80 0x7f133c0c73c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f133c0c6b50 tx=0x7f132c01c4f0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1340a00640 1 -- 172.21.15.7:0/4159613659 shutdown_connections 2024-09-13T15:04:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1340a00640 1 --2- 172.21.15.7:0/4159613659 >> v2:172.21.15.77:3300/0 conn(0x7f133c0c7900 0x7f133c152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1340a00640 1 --2- 172.21.15.7:0/4159613659 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06da80 0x7f133c0c73c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1340a00640 1 -- 172.21.15.7:0/4159613659 >> 172.21.15.7:0/4159613659 conn(0x7f133c06c330 msgr2=0x7f133c0cb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1340a00640 1 -- 172.21.15.7:0/4159613659 shutdown_connections 2024-09-13T15:04:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1340a00640 1 -- 172.21.15.7:0/4159613659 wait complete. 2024-09-13T15:04:33.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1340a00640 1 Processor -- start 2024-09-13T15:04:33.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1340a00640 1 -- start start 2024-09-13T15:04:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1340a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06da80 0x7f133c14fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1340a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f133c06de60 0x7f133c0c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1340a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f133c0c7900 0x7f133c1f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1340a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c150220 con 0x7f133c06da80 2024-09-13T15:04:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1340a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c150730 con 0x7f133c06de60 2024-09-13T15:04:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.553+0000 7f1340a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c1f2360 con 0x7f133c0c7900 2024-09-13T15:04:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1339e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06da80 0x7f133c14fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1339e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06da80 0x7f133c14fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60430/0 (socket says 172.21.15.7:60430) 2024-09-13T15:04:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1339e00640 1 -- 172.21.15.7:0/1511608445 learned_addr learned my addr 172.21.15.7:0/1511608445 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1331400640 1 --2- 172.21.15.7:0/1511608445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f133c06de60 0x7f133c0c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f133a800640 1 --2- 172.21.15.7:0/1511608445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f133c0c7900 0x7f133c1f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1339e00640 1 -- 172.21.15.7:0/1511608445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f133c0c7900 msgr2=0x7f133c1f2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1339e00640 1 --2- 172.21.15.7:0/1511608445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f133c0c7900 0x7f133c1f2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1339e00640 1 -- 172.21.15.7:0/1511608445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f133c06de60 msgr2=0x7f133c0c3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1339e00640 1 --2- 172.21.15.7:0/1511608445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f133c06de60 0x7f133c0c3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1339e00640 1 -- 172.21.15.7:0/1511608445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c0094d0 con 0x7f133c06da80 2024-09-13T15:04:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1339e00640 1 --2- 172.21.15.7:0/1511608445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06da80 0x7f133c14fab0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f132c019100 tx=0x7f132c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1332a00640 1 -- 172.21.15.7:0/1511608445 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c0b3800 con 0x7f133c06da80 2024-09-13T15:04:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1332a00640 1 -- 172.21.15.7:0/1511608445 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c0b3980 con 0x7f133c06da80 2024-09-13T15:04:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1332a00640 1 -- 172.21.15.7:0/1511608445 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c0b3d30 con 0x7f133c06da80 2024-09-13T15:04:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1340a00640 1 -- 172.21.15.7:0/1511608445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c150450 con 0x7f133c06da80 2024-09-13T15:04:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1340a00640 1 -- 172.21.15.7:0/1511608445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c152660 con 0x7f133c06da80 2024-09-13T15:04:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1340a00640 1 -- 172.21.15.7:0/1511608445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c1521e0 con 0x7f133c06da80 2024-09-13T15:04:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1332a00640 1 -- 172.21.15.7:0/1511608445 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f132c0b2380 con 0x7f133c06da80 2024-09-13T15:04:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1332a00640 1 --2- 172.21.15.7:0/1511608445 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f13180666c0 0x7f1318068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.557+0000 7f1332a00640 1 -- 172.21.15.7:0/1511608445 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f132c11e8c0 con 0x7f133c06da80 2024-09-13T15:04:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.561+0000 7f1331400640 1 --2- 172.21.15.7:0/1511608445 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f13180666c0 0x7f1318068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.561+0000 7f1331400640 1 --2- 172.21.15.7:0/1511608445 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f13180666c0 0x7f1318068b80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f133c06e930 tx=0x7f1324009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:33.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.565+0000 7f1332a00640 1 -- 172.21.15.7:0/1511608445 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f133c1521e0 con 0x7f133c06da80 2024-09-13T15:04:33.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.757+0000 7f1340a00640 1 -- 172.21.15.7:0/1511608445 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f133c1521e0 con 0x7f133c06da80 2024-09-13T15:04:33.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.757+0000 7f1332a00640 1 -- 172.21.15.7:0/1511608445 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6300 (secure 0 0 0) 0x7f133c1521e0 con 0x7f133c06da80 2024-09-13T15:04:33.760 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:33.760 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:04:30.914501+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"e","rank":4,"incarnation":17,"state":"up:creating","state_seq":1,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:04:33.760 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 17 2024-09-13T15:04:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.761+0000 7f1340a00640 1 -- 172.21.15.7:0/1511608445 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f13180666c0 msgr2=0x7f1318068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.761+0000 7f1340a00640 1 --2- 172.21.15.7:0/1511608445 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f13180666c0 0x7f1318068b80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f133c06e930 tx=0x7f1324009040 comp rx=0 tx=0).stop 2024-09-13T15:04:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.761+0000 7f1340a00640 1 -- 172.21.15.7:0/1511608445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06da80 msgr2=0x7f133c14fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.761+0000 7f1340a00640 1 --2- 172.21.15.7:0/1511608445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06da80 0x7f133c14fab0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f132c019100 tx=0x7f132c01ad30 comp rx=0 tx=0).stop 2024-09-13T15:04:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.761+0000 7f1340a00640 1 -- 172.21.15.7:0/1511608445 shutdown_connections 2024-09-13T15:04:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.761+0000 7f1340a00640 1 --2- 172.21.15.7:0/1511608445 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f13180666c0 0x7f1318068b80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.761+0000 7f1340a00640 1 --2- 172.21.15.7:0/1511608445 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f133c0c7900 0x7f133c1f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.761+0000 7f1340a00640 1 --2- 172.21.15.7:0/1511608445 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f133c06de60 0x7f133c0c3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.761+0000 7f1340a00640 1 --2- 172.21.15.7:0/1511608445 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f133c06da80 0x7f133c14fab0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.761+0000 7f1340a00640 1 -- 172.21.15.7:0/1511608445 >> 172.21.15.7:0/1511608445 conn(0x7f133c06c330 msgr2=0x7f133c0c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.761+0000 7f1340a00640 1 -- 172.21.15.7:0/1511608445 shutdown_connections 2024-09-13T15:04:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.761+0000 7f1340a00640 1 -- 172.21.15.7:0/1511608445 wait complete. 2024-09-13T15:04:33.782 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:04:33.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.921+0000 7fba29600640 1 Processor -- start 2024-09-13T15:04:33.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.921+0000 7fba29600640 1 -- start start 2024-09-13T15:04:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.921+0000 7fba29600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba24153300 0x7fba2406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.921+0000 7fba29600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fba2406bbd0 0x7fba240c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.921+0000 7fba29600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2406a0d0 con 0x7fba241536e0 2024-09-13T15:04:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.921+0000 7fba29600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba2406a650 con 0x7fba2406bbd0 2024-09-13T15:04:33.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.921+0000 7fba29600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2406c0c0 con 0x7fba24153300 2024-09-13T15:04:33.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.921+0000 7fba22a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba24153300 0x7fba2406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.921+0000 7fba22a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba24153300 0x7fba2406d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:42222/0 (socket says 172.21.15.7:42222) 2024-09-13T15:04:33.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.921+0000 7fba22a00640 1 -- 172.21.15.7:0/337167841 learned_addr learned my addr 172.21.15.7:0/337167841 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:33.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.921+0000 7fba23400640 1 --2- 172.21.15.7:0/337167841 >> v2:172.21.15.77:3300/0 conn(0x7fba2406bbd0 0x7fba240c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.925+0000 7fba22a00640 1 -- 172.21.15.7:0/337167841 >> v2:172.21.15.77:3300/0 conn(0x7fba2406bbd0 msgr2=0x7fba240c3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:33.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.925+0000 7fba22a00640 1 --2- 172.21.15.7:0/337167841 >> v2:172.21.15.77:3300/0 conn(0x7fba2406bbd0 0x7fba240c3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.925+0000 7fba22a00640 1 -- 172.21.15.7:0/337167841 >> v1:172.21.15.77:6789/0 conn(0x7fba241536e0 legacy=0x7fba2415d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.925+0000 7fba22a00640 1 -- 172.21.15.7:0/337167841 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2406a370 con 0x7fba24153300 2024-09-13T15:04:33.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.925+0000 7fba22a00640 1 --2- 172.21.15.7:0/337167841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba24153300 0x7fba2406d9e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fba14009870 tx=0x7fba1401ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d4c8e3164e63794 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:33.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.925+0000 7fba21600640 1 -- 172.21.15.7:0/337167841 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140a8a50 con 0x7fba24153300 2024-09-13T15:04:33.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.925+0000 7fba21600640 1 -- 172.21.15.7:0/337167841 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba140a8bb0 con 0x7fba24153300 2024-09-13T15:04:33.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.925+0000 7fba21600640 1 -- 172.21.15.7:0/337167841 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140b0440 con 0x7fba24153300 2024-09-13T15:04:33.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba29600640 1 -- 172.21.15.7:0/337167841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba24153300 msgr2=0x7fba2406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba29600640 1 --2- 172.21.15.7:0/337167841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba24153300 0x7fba2406d9e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fba14009870 tx=0x7fba1401ed50 comp rx=0 tx=0).stop 2024-09-13T15:04:33.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba29600640 1 -- 172.21.15.7:0/337167841 shutdown_connections 2024-09-13T15:04:33.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba29600640 1 --2- 172.21.15.7:0/337167841 >> v2:172.21.15.77:3300/0 conn(0x7fba2406bbd0 0x7fba240c3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba29600640 1 --2- 172.21.15.7:0/337167841 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba24153300 0x7fba2406d9e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba29600640 1 -- 172.21.15.7:0/337167841 >> 172.21.15.7:0/337167841 conn(0x7fba24071730 msgr2=0x7fba24071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:33.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba29600640 1 -- 172.21.15.7:0/337167841 shutdown_connections 2024-09-13T15:04:33.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba29600640 1 -- 172.21.15.7:0/337167841 wait complete. 2024-09-13T15:04:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba29600640 1 Processor -- start 2024-09-13T15:04:33.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba29600640 1 -- start start 2024-09-13T15:04:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba29600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba2406bbd0 0x7fba2415b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba29600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba24153300 0x7fba24154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba29600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba241536e0 0x7fba24155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba29600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba24153af0 con 0x7fba24153300 2024-09-13T15:04:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba29600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba241f2de0 con 0x7fba241536e0 2024-09-13T15:04:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba29600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba24153d00 con 0x7fba2406bbd0 2024-09-13T15:04:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba22000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba24153300 0x7fba24154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba22000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba24153300 0x7fba24154ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60434/0 (socket says 172.21.15.7:60434) 2024-09-13T15:04:33.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba22000640 1 -- 172.21.15.7:0/434407953 learned_addr learned my addr 172.21.15.7:0/434407953 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba22a00640 1 --2- 172.21.15.7:0/434407953 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba2406bbd0 0x7fba2415b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba23400640 1 --2- 172.21.15.7:0/434407953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba241536e0 0x7fba24155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba22000640 1 -- 172.21.15.7:0/434407953 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba2406bbd0 msgr2=0x7fba2415b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba22000640 1 --2- 172.21.15.7:0/434407953 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba2406bbd0 0x7fba2415b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba22000640 1 -- 172.21.15.7:0/434407953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba241536e0 msgr2=0x7fba24155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba22000640 1 --2- 172.21.15.7:0/434407953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba241536e0 0x7fba24155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.929+0000 7fba22000640 1 -- 172.21.15.7:0/434407953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140094d0 con 0x7fba24153300 2024-09-13T15:04:33.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.933+0000 7fba22000640 1 --2- 172.21.15.7:0/434407953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba24153300 0x7fba24154ac0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fba1000c390 tx=0x7fba1000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:33.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.933+0000 7fba1aa00640 1 -- 172.21.15.7:0/434407953 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba100052d0 con 0x7fba24153300 2024-09-13T15:04:33.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.933+0000 7fba1aa00640 1 -- 172.21.15.7:0/434407953 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba10005430 con 0x7fba24153300 2024-09-13T15:04:33.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.933+0000 7fba1aa00640 1 -- 172.21.15.7:0/434407953 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba10003840 con 0x7fba24153300 2024-09-13T15:04:33.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.933+0000 7fba29600640 1 -- 172.21.15.7:0/434407953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba24153fe0 con 0x7fba24153300 2024-09-13T15:04:33.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.933+0000 7fba29600640 1 -- 172.21.15.7:0/434407953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba241545a0 con 0x7fba24153300 2024-09-13T15:04:33.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.933+0000 7fba29600640 1 -- 172.21.15.7:0/434407953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba24067650 con 0x7fba24153300 2024-09-13T15:04:33.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.933+0000 7fba1aa00640 1 -- 172.21.15.7:0/434407953 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fba100039a0 con 0x7fba24153300 2024-09-13T15:04:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.933+0000 7fba1aa00640 1 --2- 172.21.15.7:0/434407953 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fba04066690 0x7fba04068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:33.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.933+0000 7fba1aa00640 1 -- 172.21.15.7:0/434407953 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fba10083a40 con 0x7fba24153300 2024-09-13T15:04:33.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.933+0000 7fba22a00640 1 --2- 172.21.15.7:0/434407953 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fba04066690 0x7fba04068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:33.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.937+0000 7fba22a00640 1 --2- 172.21.15.7:0/434407953 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fba04066690 0x7fba04068b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fba14009870 tx=0x7fba14009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:33.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:33.937+0000 7fba1aa00640 1 -- 172.21.15.7:0/434407953 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fba10050a00 con 0x7fba24153300 2024-09-13T15:04:34.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.101+0000 7fba29600640 1 -- 172.21.15.7:0/434407953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba240c30f0 con 0x7fba24153300 2024-09-13T15:04:34.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.105+0000 7fba1aa00640 1 -- 172.21.15.7:0/434407953 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18616 (secure 0 0 0) 0x7fba10054020 con 0x7fba24153300 2024-09-13T15:04:34.106 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:34.106 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:02:33.732864+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:04:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.105+0000 7fba29600640 1 -- 172.21.15.7:0/434407953 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fba04066690 msgr2=0x7fba04068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.105+0000 7fba29600640 1 --2- 172.21.15.7:0/434407953 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fba04066690 0x7fba04068b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fba14009870 tx=0x7fba14009040 comp rx=0 tx=0).stop 2024-09-13T15:04:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.105+0000 7fba29600640 1 -- 172.21.15.7:0/434407953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba24153300 msgr2=0x7fba24154ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.105+0000 7fba29600640 1 --2- 172.21.15.7:0/434407953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba24153300 0x7fba24154ac0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fba1000c390 tx=0x7fba1000c850 comp rx=0 tx=0).stop 2024-09-13T15:04:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.105+0000 7fba29600640 1 -- 172.21.15.7:0/434407953 shutdown_connections 2024-09-13T15:04:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.105+0000 7fba29600640 1 --2- 172.21.15.7:0/434407953 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fba04066690 0x7fba04068b50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.105+0000 7fba29600640 1 --2- 172.21.15.7:0/434407953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba241536e0 0x7fba24155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.105+0000 7fba29600640 1 --2- 172.21.15.7:0/434407953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba24153300 0x7fba24154ac0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.105+0000 7fba29600640 1 --2- 172.21.15.7:0/434407953 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba2406bbd0 0x7fba2415b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.105+0000 7fba29600640 1 -- 172.21.15.7:0/434407953 >> 172.21.15.7:0/434407953 conn(0x7fba24071730 msgr2=0x7fba240cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.105+0000 7fba29600640 1 -- 172.21.15.7:0/434407953 shutdown_connections 2024-09-13T15:04:34.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.105+0000 7fba29600640 1 -- 172.21.15.7:0/434407953 wait complete. 2024-09-13T15:04:34.130 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:01:38.710958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:01:43.178724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:01:43.774877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:01:46.843203+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:04:34.130 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:04:34.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.269+0000 7f21c6800640 1 Processor -- start 2024-09-13T15:04:34.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.269+0000 7f21c6800640 1 -- start start 2024-09-13T15:04:34.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.273+0000 7f21c6800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f21c00c5430 0x7f21c006e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.273+0000 7f21c6800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21c00733a0 0x7f21c00737b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.273+0000 7f21c6800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c0159b70 con 0x7f21c00c5d60 2024-09-13T15:04:34.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.273+0000 7f21c6800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c00c67d0 con 0x7f21c00733a0 2024-09-13T15:04:34.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.273+0000 7f21c6800640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c0073cf0 con 0x7f21c00c5430 2024-09-13T15:04:34.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.273+0000 7f21b6a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f21c00c5d60 0x7f21c015c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44202/0 (socket says 172.21.15.7:44202) 2024-09-13T15:04:34.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.273+0000 7f21b6a00640 1 -- 172.21.15.7:0/1416369396 learned_addr learned my addr 172.21.15.7:0/1416369396 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:34.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.273+0000 7f21bfe00640 1 --2- 172.21.15.7:0/1416369396 >> v2:172.21.15.7:3300/0 conn(0x7f21c00733a0 0x7f21c00737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.273+0000 7f21bf400640 1 --2- 172.21.15.7:0/1416369396 >> v2:172.21.15.77:3300/0 conn(0x7f21c00c5430 0x7f21c006e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.273+0000 7f21bea00640 1 -- 172.21.15.7:0/1416369396 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595838853 0 0) 0x7f21c0159b70 con 0x7f21c00c5d60 2024-09-13T15:04:34.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.273+0000 7f21bea00640 1 -- 172.21.15.7:0/1416369396 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21a4003530 con 0x7f21c00c5d60 2024-09-13T15:04:34.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.273+0000 7f21bfe00640 1 -- 172.21.15.7:0/1416369396 >> v2:172.21.15.77:3300/0 conn(0x7f21c00c5430 msgr2=0x7f21c006e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:34.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.273+0000 7f21bfe00640 1 --2- 172.21.15.7:0/1416369396 >> v2:172.21.15.77:3300/0 conn(0x7f21c00c5430 0x7f21c006e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.273+0000 7f21bfe00640 1 -- 172.21.15.7:0/1416369396 >> v1:172.21.15.7:6789/0 conn(0x7f21c00c5d60 legacy=0x7f21c015c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.273+0000 7f21bfe00640 1 -- 172.21.15.7:0/1416369396 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c015a000 con 0x7f21c00733a0 2024-09-13T15:04:34.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.277+0000 7f21bfe00640 1 --2- 172.21.15.7:0/1416369396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c00733a0 0x7f21c00737b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f21c006e970 tx=0x7f21b801f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93225e4b1e320525 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:34.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.277+0000 7f21bea00640 1 -- 172.21.15.7:0/1416369396 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b80af600 con 0x7f21c00733a0 2024-09-13T15:04:34.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.277+0000 7f21bea00640 1 -- 172.21.15.7:0/1416369396 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b80ab050 con 0x7f21c00733a0 2024-09-13T15:04:34.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.277+0000 7f21bea00640 1 -- 172.21.15.7:0/1416369396 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b80af980 con 0x7f21c00733a0 2024-09-13T15:04:34.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.277+0000 7f21c6800640 1 -- 172.21.15.7:0/1416369396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c00733a0 msgr2=0x7f21c00737b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.277+0000 7f21c6800640 1 --2- 172.21.15.7:0/1416369396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c00733a0 0x7f21c00737b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f21c006e970 tx=0x7f21b801f110 comp rx=0 tx=0).stop 2024-09-13T15:04:34.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.277+0000 7f21c6800640 1 -- 172.21.15.7:0/1416369396 shutdown_connections 2024-09-13T15:04:34.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.277+0000 7f21c6800640 1 --2- 172.21.15.7:0/1416369396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c00733a0 0x7f21c00737b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.277+0000 7f21c6800640 1 --2- 172.21.15.7:0/1416369396 >> v2:172.21.15.77:3300/0 conn(0x7f21c00c5430 0x7f21c006e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.277+0000 7f21c6800640 1 -- 172.21.15.7:0/1416369396 >> 172.21.15.7:0/1416369396 conn(0x7f21c00cb360 msgr2=0x7f21c00cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:34.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.277+0000 7f21c6800640 1 -- 172.21.15.7:0/1416369396 shutdown_connections 2024-09-13T15:04:34.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.277+0000 7f21c6800640 1 -- 172.21.15.7:0/1416369396 wait complete. 2024-09-13T15:04:34.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.277+0000 7f21c6800640 1 Processor -- start 2024-09-13T15:04:34.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.277+0000 7f21c6800640 1 -- start start 2024-09-13T15:04:34.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21c6800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21c00733a0 0x7f21c0154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21c6800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c00c5430 0x7f21c01e60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21c6800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21c00c5d60 0x7f21c01efea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21c6800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c01537e0 con 0x7f21c00c5430 2024-09-13T15:04:34.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21c6800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0153ac0 con 0x7f21c00733a0 2024-09-13T15:04:34.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21c6800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0070ba0 con 0x7f21c00c5d60 2024-09-13T15:04:34.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21b6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c00c5430 0x7f21c01e60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21b6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c00c5430 0x7f21c01e60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60456/0 (socket says 172.21.15.7:60456) 2024-09-13T15:04:34.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21b6a00640 1 -- 172.21.15.7:0/2648470328 learned_addr learned my addr 172.21.15.7:0/2648470328 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:34.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21bfe00640 1 --2- 172.21.15.7:0/2648470328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21c00c5d60 0x7f21c01efea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21bf400640 1 --2- 172.21.15.7:0/2648470328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21c00733a0 0x7f21c0154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21b6a00640 1 -- 172.21.15.7:0/2648470328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21c00c5d60 msgr2=0x7f21c01efea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21b6a00640 1 --2- 172.21.15.7:0/2648470328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21c00c5d60 0x7f21c01efea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21b6a00640 1 -- 172.21.15.7:0/2648470328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21c00733a0 msgr2=0x7f21c0154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21b6a00640 1 --2- 172.21.15.7:0/2648470328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21c00733a0 0x7f21c0154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21b6a00640 1 -- 172.21.15.7:0/2648470328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b8009a70 con 0x7f21c00c5430 2024-09-13T15:04:34.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21b6a00640 1 --2- 172.21.15.7:0/2648470328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c00c5430 0x7f21c01e60c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f21a800c450 tx=0x7f21a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:34.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21b7e00640 1 -- 172.21.15.7:0/2648470328 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8005cf0 con 0x7f21c00c5430 2024-09-13T15:04:34.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21b7e00640 1 -- 172.21.15.7:0/2648470328 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a8005e50 con 0x7f21c00c5430 2024-09-13T15:04:34.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21b7e00640 1 -- 172.21.15.7:0/2648470328 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8007270 con 0x7f21c00c5430 2024-09-13T15:04:34.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21c6800640 1 -- 172.21.15.7:0/2648470328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c0152bc0 con 0x7f21c00c5430 2024-09-13T15:04:34.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21c6800640 1 -- 172.21.15.7:0/2648470328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c015b080 con 0x7f21c00c5430 2024-09-13T15:04:34.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21c6800640 1 -- 172.21.15.7:0/2648470328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c0159800 con 0x7f21c00c5430 2024-09-13T15:04:34.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.281+0000 7f21b7e00640 1 -- 172.21.15.7:0/2648470328 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f21a80073d0 con 0x7f21c00c5430 2024-09-13T15:04:34.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.285+0000 7f21b7e00640 1 --2- 172.21.15.7:0/2648470328 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f219c066690 0x7f219c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.285+0000 7f21b7e00640 1 -- 172.21.15.7:0/2648470328 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f21a8083a20 con 0x7f21c00c5430 2024-09-13T15:04:34.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.285+0000 7f21bf400640 1 --2- 172.21.15.7:0/2648470328 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f219c066690 0x7f219c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.285+0000 7f21bf400640 1 --2- 172.21.15.7:0/2648470328 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f219c066690 0x7f219c068b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009b60 tx=0x7f21b0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:34.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.289+0000 7f21b7e00640 1 -- 172.21.15.7:0/2648470328 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f21a80509e0 con 0x7f21c00c5430 2024-09-13T15:04:34.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.449+0000 7f21c6800640 1 -- 172.21.15.7:0/2648470328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21c006d470 con 0x7f21c00c5430 2024-09-13T15:04:34.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.449+0000 7f21b7e00640 1 -- 172.21.15.7:0/2648470328 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21a80170a0 con 0x7f21c00c5430 2024-09-13T15:04:34.453 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T15:04:34.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.453+0000 7f21c6800640 1 -- 172.21.15.7:0/2648470328 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f219c066690 msgr2=0x7f219c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.453+0000 7f21c6800640 1 --2- 172.21.15.7:0/2648470328 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f219c066690 0x7f219c068b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f21b0009b60 tx=0x7f21b0009190 comp rx=0 tx=0).stop 2024-09-13T15:04:34.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.453+0000 7f21c6800640 1 -- 172.21.15.7:0/2648470328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c00c5430 msgr2=0x7f21c01e60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.453+0000 7f21c6800640 1 --2- 172.21.15.7:0/2648470328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c00c5430 0x7f21c01e60c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f21a800c450 tx=0x7f21a800c910 comp rx=0 tx=0).stop 2024-09-13T15:04:34.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.453+0000 7f21c6800640 1 -- 172.21.15.7:0/2648470328 shutdown_connections 2024-09-13T15:04:34.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.453+0000 7f21c6800640 1 --2- 172.21.15.7:0/2648470328 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f219c066690 0x7f219c068b50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.453+0000 7f21c6800640 1 --2- 172.21.15.7:0/2648470328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21c00c5d60 0x7f21c01efea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.453+0000 7f21c6800640 1 --2- 172.21.15.7:0/2648470328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21c00c5430 0x7f21c01e60c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.453+0000 7f21c6800640 1 --2- 172.21.15.7:0/2648470328 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21c00733a0 0x7f21c0154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.453+0000 7f21c6800640 1 -- 172.21.15.7:0/2648470328 >> 172.21.15.7:0/2648470328 conn(0x7f21c00cb360 msgr2=0x7f21c00c3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:34.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.453+0000 7f21c6800640 1 -- 172.21.15.7:0/2648470328 shutdown_connections 2024-09-13T15:04:34.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.453+0000 7f21c6800640 1 -- 172.21.15.7:0/2648470328 wait complete. 2024-09-13T15:04:34.474 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:04:34.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.613+0000 7f18b8800640 1 Processor -- start 2024-09-13T15:04:34.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.613+0000 7f18b8800640 1 -- start start 2024-09-13T15:04:34.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.617+0000 7f18b8800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f18b01501b0 0x7f18b0156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.617+0000 7f18b8800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f18b00c16f0 0x7f18b00c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.617+0000 7f18b8800640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b00c6880 con 0x7f18b014fdd0 2024-09-13T15:04:34.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.617+0000 7f18b8800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b00721e0 con 0x7f18b00c16f0 2024-09-13T15:04:34.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.617+0000 7f18b8800640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b006f860 con 0x7f18b01501b0 2024-09-13T15:04:34.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.617+0000 7f18b6800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f18b00c16f0 0x7f18b00c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.617+0000 7f18b6800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f18b00c16f0 0x7f18b00c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60462/0 (socket says 172.21.15.7:60462) 2024-09-13T15:04:34.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.617+0000 7f18b6800640 1 -- 172.21.15.7:0/3792529456 learned_addr learned my addr 172.21.15.7:0/3792529456 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:34.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.617+0000 7f18b5400640 1 --2- 172.21.15.7:0/3792529456 >> v2:172.21.15.77:3300/0 conn(0x7f18b01501b0 0x7f18b0156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.617+0000 7f18b6800640 1 -- 172.21.15.7:0/3792529456 >> v2:172.21.15.77:3300/0 conn(0x7f18b01501b0 msgr2=0x7f18b0156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:34.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.617+0000 7f18b6800640 1 --2- 172.21.15.7:0/3792529456 >> v2:172.21.15.77:3300/0 conn(0x7f18b01501b0 0x7f18b0156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.617+0000 7f18b6800640 1 -- 172.21.15.7:0/3792529456 >> v1:172.21.15.77:6789/0 conn(0x7f18b014fdd0 legacy=0x7f18b00c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.617+0000 7f18b6800640 1 -- 172.21.15.7:0/3792529456 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b00c6ad0 con 0x7f18b00c16f0 2024-09-13T15:04:34.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.621+0000 7f18b6800640 1 --2- 172.21.15.7:0/3792529456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b00c16f0 0x7f18b00c55d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f18b00c8520 tx=0x7f18ac01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=252aa5f811428b1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:34.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.621+0000 7f18b4a00640 1 -- 172.21.15.7:0/3792529456 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac00b2d0 con 0x7f18b00c16f0 2024-09-13T15:04:34.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.621+0000 7f18b4a00640 1 -- 172.21.15.7:0/3792529456 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ac00b430 con 0x7f18b00c16f0 2024-09-13T15:04:34.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.621+0000 7f18b4a00640 1 -- 172.21.15.7:0/3792529456 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0a7be0 con 0x7f18b00c16f0 2024-09-13T15:04:34.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.621+0000 7f18b8800640 1 -- 172.21.15.7:0/3792529456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b00c16f0 msgr2=0x7f18b00c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.621+0000 7f18b8800640 1 --2- 172.21.15.7:0/3792529456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b00c16f0 0x7f18b00c55d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f18b00c8520 tx=0x7f18ac01ebf0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.621+0000 7f18b8800640 1 -- 172.21.15.7:0/3792529456 shutdown_connections 2024-09-13T15:04:34.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.621+0000 7f18b8800640 1 --2- 172.21.15.7:0/3792529456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b00c16f0 0x7f18b00c55d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.621+0000 7f18b8800640 1 --2- 172.21.15.7:0/3792529456 >> v2:172.21.15.77:3300/0 conn(0x7f18b01501b0 0x7f18b0156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.621+0000 7f18b8800640 1 -- 172.21.15.7:0/3792529456 >> 172.21.15.7:0/3792529456 conn(0x7f18b0065d40 msgr2=0x7f18b0066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:34.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.621+0000 7f18b8800640 1 -- 172.21.15.7:0/3792529456 shutdown_connections 2024-09-13T15:04:34.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.621+0000 7f18b8800640 1 -- 172.21.15.7:0/3792529456 wait complete. 2024-09-13T15:04:34.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.621+0000 7f18b8800640 1 Processor -- start 2024-09-13T15:04:34.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.621+0000 7f18b8800640 1 -- start start 2024-09-13T15:04:34.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b8800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b00c16f0 0x7f18b014d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b8800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18b014fdd0 0x7f18b014f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b8800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18b01501b0 0x7f18b00c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b8800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b00c8790 con 0x7f18b00c16f0 2024-09-13T15:04:34.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b8800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b00c8f80 con 0x7f18b014fdd0 2024-09-13T15:04:34.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b8800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b00caea0 con 0x7f18b01501b0 2024-09-13T15:04:34.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b00c16f0 0x7f18b014d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b00c16f0 0x7f18b014d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60464/0 (socket says 172.21.15.7:60464) 2024-09-13T15:04:34.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b5e00640 1 -- 172.21.15.7:0/3200161913 learned_addr learned my addr 172.21.15.7:0/3200161913 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:34.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b5400640 1 --2- 172.21.15.7:0/3200161913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18b014fdd0 0x7f18b014f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b6800640 1 --2- 172.21.15.7:0/3200161913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18b01501b0 0x7f18b00c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b5e00640 1 -- 172.21.15.7:0/3200161913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18b01501b0 msgr2=0x7f18b00c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b5e00640 1 --2- 172.21.15.7:0/3200161913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18b01501b0 0x7f18b00c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b5e00640 1 -- 172.21.15.7:0/3200161913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18b014fdd0 msgr2=0x7f18b014f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b5e00640 1 --2- 172.21.15.7:0/3200161913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18b014fdd0 0x7f18b014f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b5e00640 1 -- 172.21.15.7:0/3200161913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac00bd40 con 0x7f18b00c16f0 2024-09-13T15:04:34.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b5400640 1 --2- 172.21.15.7:0/3200161913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18b014fdd0 0x7f18b014f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:34.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b5e00640 1 --2- 172.21.15.7:0/3200161913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b00c16f0 0x7f18b014d370 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f18a400c500 tx=0x7f18a400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:34.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18aa000640 1 -- 172.21.15.7:0/3200161913 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4005220 con 0x7f18b00c16f0 2024-09-13T15:04:34.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18aa000640 1 -- 172.21.15.7:0/3200161913 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a4005380 con 0x7f18b00c16f0 2024-09-13T15:04:34.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18aa000640 1 -- 172.21.15.7:0/3200161913 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4007270 con 0x7f18b00c16f0 2024-09-13T15:04:34.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b8800640 1 -- 172.21.15.7:0/3200161913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b00c89c0 con 0x7f18b00c16f0 2024-09-13T15:04:34.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b8800640 1 -- 172.21.15.7:0/3200161913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b00cb0f0 con 0x7f18b00c16f0 2024-09-13T15:04:34.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18b8800640 1 -- 172.21.15.7:0/3200161913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b00c55d0 con 0x7f18b00c16f0 2024-09-13T15:04:34.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.625+0000 7f18aa000640 1 -- 172.21.15.7:0/3200161913 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f18a40073d0 con 0x7f18b00c16f0 2024-09-13T15:04:34.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.629+0000 7f18aa000640 1 --2- 172.21.15.7:0/3200161913 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1894066690 0x7f1894068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.629+0000 7f18aa000640 1 -- 172.21.15.7:0/3200161913 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f18a4083f00 con 0x7f18b00c16f0 2024-09-13T15:04:34.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.629+0000 7f18b5400640 1 --2- 172.21.15.7:0/3200161913 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1894066690 0x7f1894068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.629+0000 7f18b5400640 1 --2- 172.21.15.7:0/3200161913 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1894066690 0x7f1894068b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f18b014cca0 tx=0x7f18a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:34.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.633+0000 7f18aa000640 1 -- 172.21.15.7:0/3200161913 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f18a4050e20 con 0x7f18b00c16f0 2024-09-13T15:04:34.738 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-09-13T15:04:34.737+0000 7ff9aa000640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-13T15:04:34.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.793+0000 7f18b8800640 1 -- 172.21.15.7:0/3200161913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18b0154570 con 0x7f18b00c16f0 2024-09-13T15:04:34.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.793+0000 7f18aa000640 1 -- 172.21.15.7:0/3200161913 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f18a4054440 con 0x7f18b00c16f0 2024-09-13T15:04:34.797 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T15:04:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.797+0000 7f18b8800640 1 -- 172.21.15.7:0/3200161913 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1894066690 msgr2=0x7f1894068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.797+0000 7f18b8800640 1 --2- 172.21.15.7:0/3200161913 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1894066690 0x7f1894068b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f18b014cca0 tx=0x7f18a0008040 comp rx=0 tx=0).stop 2024-09-13T15:04:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.797+0000 7f18b8800640 1 -- 172.21.15.7:0/3200161913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b00c16f0 msgr2=0x7f18b014d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.797+0000 7f18b8800640 1 --2- 172.21.15.7:0/3200161913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b00c16f0 0x7f18b014d370 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f18a400c500 tx=0x7f18a400c9c0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.797+0000 7f18b8800640 1 -- 172.21.15.7:0/3200161913 shutdown_connections 2024-09-13T15:04:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.797+0000 7f18b8800640 1 --2- 172.21.15.7:0/3200161913 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1894066690 0x7f1894068b50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.797+0000 7f18b8800640 1 --2- 172.21.15.7:0/3200161913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18b01501b0 0x7f18b00c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.797+0000 7f18b8800640 1 --2- 172.21.15.7:0/3200161913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18b014fdd0 0x7f18b014f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.797+0000 7f18b8800640 1 --2- 172.21.15.7:0/3200161913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18b00c16f0 0x7f18b014d370 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.797+0000 7f18b8800640 1 -- 172.21.15.7:0/3200161913 >> 172.21.15.7:0/3200161913 conn(0x7f18b0065d40 msgr2=0x7f18b0152e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.797+0000 7f18b8800640 1 -- 172.21.15.7:0/3200161913 shutdown_connections 2024-09-13T15:04:34.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.797+0000 7f18b8800640 1 -- 172.21.15.7:0/3200161913 wait complete. 2024-09-13T15:04:34.818 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:04:34.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f5045a00640 1 Processor -- start 2024-09-13T15:04:34.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f5045a00640 1 -- start start 2024-09-13T15:04:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f5045a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f504014fdd0 0x7f5040156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f5045a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f50400c16f0 0x7f50400c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f5045a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50400c6880 con 0x7f50401501b0 2024-09-13T15:04:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f5045a00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50400721e0 con 0x7f50400c16f0 2024-09-13T15:04:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f5045a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504006f860 con 0x7f504014fdd0 2024-09-13T15:04:34.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f5037e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f50401501b0 0x7f50400c7420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44216/0 (socket says 172.21.15.7:44216) 2024-09-13T15:04:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f5037e00640 1 -- 172.21.15.7:0/2181123013 learned_addr learned my addr 172.21.15.7:0/2181123013 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f503ea00640 1 --2- 172.21.15.7:0/2181123013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f504014fdd0 0x7f5040156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f503f400640 1 --2- 172.21.15.7:0/2181123013 >> v2:172.21.15.77:3300/0 conn(0x7f50400c16f0 0x7f50400c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f503e000640 1 -- 172.21.15.7:0/2181123013 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138666316 0 0) 0x7f50400c6880 con 0x7f50401501b0 2024-09-13T15:04:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f503e000640 1 -- 172.21.15.7:0/2181123013 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5024003530 con 0x7f50401501b0 2024-09-13T15:04:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f503e000640 1 -- 172.21.15.7:0/2181123013 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2026352369 0 0) 0x7f5024003530 con 0x7f50401501b0 2024-09-13T15:04:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f503ea00640 1 -- 172.21.15.7:0/2181123013 >> v2:172.21.15.77:3300/0 conn(0x7f50400c16f0 msgr2=0x7f50400c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f503ea00640 1 --2- 172.21.15.7:0/2181123013 >> v2:172.21.15.77:3300/0 conn(0x7f50400c16f0 0x7f50400c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f503ea00640 1 -- 172.21.15.7:0/2181123013 >> v1:172.21.15.7:6789/0 conn(0x7f50401501b0 legacy=0x7f50400c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.961+0000 7f503ea00640 1 -- 172.21.15.7:0/2181123013 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50400c6ad0 con 0x7f504014fdd0 2024-09-13T15:04:34.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.965+0000 7f503ea00640 1 --2- 172.21.15.7:0/2181123013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f504014fdd0 0x7f5040156780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f50300097c0 tx=0x7f503001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5705acad0f39b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:34.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.965+0000 7f503e000640 1 -- 172.21.15.7:0/2181123013 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5028001680 con 0x7f504014fdd0 2024-09-13T15:04:34.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.965+0000 7f503e000640 1 -- 172.21.15.7:0/2181123013 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50300a7050 con 0x7f504014fdd0 2024-09-13T15:04:34.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.965+0000 7f503e000640 1 -- 172.21.15.7:0/2181123013 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50300ab620 con 0x7f504014fdd0 2024-09-13T15:04:34.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.965+0000 7f5045a00640 1 -- 172.21.15.7:0/2181123013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f504014fdd0 msgr2=0x7f5040156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.965+0000 7f5045a00640 1 --2- 172.21.15.7:0/2181123013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f504014fdd0 0x7f5040156780 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f50300097c0 tx=0x7f503001c3c0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.965+0000 7f5045a00640 1 -- 172.21.15.7:0/2181123013 shutdown_connections 2024-09-13T15:04:34.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.965+0000 7f5045a00640 1 --2- 172.21.15.7:0/2181123013 >> v2:172.21.15.77:3300/0 conn(0x7f50400c16f0 0x7f50400c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.965+0000 7f5045a00640 1 --2- 172.21.15.7:0/2181123013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f504014fdd0 0x7f5040156780 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.965+0000 7f5045a00640 1 -- 172.21.15.7:0/2181123013 >> 172.21.15.7:0/2181123013 conn(0x7f5040065d40 msgr2=0x7f5040066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:34.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.965+0000 7f5045a00640 1 -- 172.21.15.7:0/2181123013 shutdown_connections 2024-09-13T15:04:34.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.965+0000 7f5045a00640 1 -- 172.21.15.7:0/2181123013 wait complete. 2024-09-13T15:04:34.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5045a00640 1 Processor -- start 2024-09-13T15:04:34.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5045a00640 1 -- start start 2024-09-13T15:04:34.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5045a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50400c16f0 0x7f50401f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5045a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f504014fdd0 0x7f50401f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5045a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50401501b0 0x7f5040151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5045a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5040151210 con 0x7f504014fdd0 2024-09-13T15:04:34.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5045a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5040155b10 con 0x7f50401501b0 2024-09-13T15:04:34.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5045a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5040155830 con 0x7f50400c16f0 2024-09-13T15:04:34.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5037e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f504014fdd0 0x7f50401f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5037e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f504014fdd0 0x7f50401f5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60474/0 (socket says 172.21.15.7:60474) 2024-09-13T15:04:34.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5037e00640 1 -- 172.21.15.7:0/57085225 learned_addr learned my addr 172.21.15.7:0/57085225 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:34.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f503f400640 1 --2- 172.21.15.7:0/57085225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50401501b0 0x7f5040151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f503ea00640 1 --2- 172.21.15.7:0/57085225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50400c16f0 0x7f50401f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5037e00640 1 -- 172.21.15.7:0/57085225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50400c16f0 msgr2=0x7f50401f50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5037e00640 1 --2- 172.21.15.7:0/57085225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50400c16f0 0x7f50401f50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5037e00640 1 -- 172.21.15.7:0/57085225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50401501b0 msgr2=0x7f5040151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:34.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5037e00640 1 --2- 172.21.15.7:0/57085225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50401501b0 0x7f5040151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:34.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5037e00640 1 -- 172.21.15.7:0/57085225 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5030009420 con 0x7f504014fdd0 2024-09-13T15:04:34.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f503f400640 1 --2- 172.21.15.7:0/57085225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50401501b0 0x7f5040151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:34.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5037e00640 1 --2- 172.21.15.7:0/57085225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f504014fdd0 0x7f50401f5600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f50280011f0 tx=0x7f502800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:34.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5036a00640 1 -- 172.21.15.7:0/57085225 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5028005ae0 con 0x7f504014fdd0 2024-09-13T15:04:34.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5036a00640 1 -- 172.21.15.7:0/57085225 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5028005c40 con 0x7f504014fdd0 2024-09-13T15:04:34.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5036a00640 1 -- 172.21.15.7:0/57085225 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5028007070 con 0x7f504014fdd0 2024-09-13T15:04:34.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5045a00640 1 -- 172.21.15.7:0/57085225 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5040147530 con 0x7f504014fdd0 2024-09-13T15:04:34.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5045a00640 1 -- 172.21.15.7:0/57085225 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504014af00 con 0x7f504014fdd0 2024-09-13T15:04:34.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.969+0000 7f5045a00640 1 -- 172.21.15.7:0/57085225 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5040151380 con 0x7f504014fdd0 2024-09-13T15:04:34.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.973+0000 7f5036a00640 1 -- 172.21.15.7:0/57085225 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f50280071d0 con 0x7f504014fdd0 2024-09-13T15:04:34.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.973+0000 7f5036a00640 1 --2- 172.21.15.7:0/57085225 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f501c0666c0 0x7f501c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:34.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.973+0000 7f5036a00640 1 -- 172.21.15.7:0/57085225 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5028084210 con 0x7f504014fdd0 2024-09-13T15:04:34.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.973+0000 7f503ea00640 1 --2- 172.21.15.7:0/57085225 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f501c0666c0 0x7f501c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:34.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.973+0000 7f503ea00640 1 --2- 172.21.15.7:0/57085225 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f501c0666c0 0x7f501c068b80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f50300ad000 tx=0x7f50300a4f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:34.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:34.977+0000 7f5036a00640 1 -- 172.21.15.7:0/57085225 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5040151380 con 0x7f504014fdd0 2024-09-13T15:04:35.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.137+0000 7f5045a00640 1 -- 172.21.15.7:0/57085225 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5040151350 con 0x7f504014fdd0 2024-09-13T15:04:35.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.137+0000 7f5036a00640 1 -- 172.21.15.7:0/57085225 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f50280511b0 con 0x7f504014fdd0 2024-09-13T15:04:35.141 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-13T15:04:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.141+0000 7f5045a00640 1 -- 172.21.15.7:0/57085225 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f501c0666c0 msgr2=0x7f501c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.141+0000 7f5045a00640 1 --2- 172.21.15.7:0/57085225 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f501c0666c0 0x7f501c068b80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f50300ad000 tx=0x7f50300a4f90 comp rx=0 tx=0).stop 2024-09-13T15:04:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.141+0000 7f5045a00640 1 -- 172.21.15.7:0/57085225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f504014fdd0 msgr2=0x7f50401f5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.141+0000 7f5045a00640 1 --2- 172.21.15.7:0/57085225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f504014fdd0 0x7f50401f5600 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f50280011f0 tx=0x7f502800cbe0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.141+0000 7f5045a00640 1 -- 172.21.15.7:0/57085225 shutdown_connections 2024-09-13T15:04:35.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.141+0000 7f5045a00640 1 --2- 172.21.15.7:0/57085225 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f501c0666c0 0x7f501c068b80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.141+0000 7f5045a00640 1 --2- 172.21.15.7:0/57085225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50401501b0 0x7f5040151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.141+0000 7f5045a00640 1 --2- 172.21.15.7:0/57085225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f504014fdd0 0x7f50401f5600 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.141+0000 7f5045a00640 1 --2- 172.21.15.7:0/57085225 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f50400c16f0 0x7f50401f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.141+0000 7f5045a00640 1 -- 172.21.15.7:0/57085225 >> 172.21.15.7:0/57085225 conn(0x7f5040065d40 msgr2=0x7f5040153960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.141+0000 7f5045a00640 1 -- 172.21.15.7:0/57085225 shutdown_connections 2024-09-13T15:04:35.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.141+0000 7f5045a00640 1 -- 172.21.15.7:0/57085225 wait complete. 2024-09-13T15:04:35.162 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:04:35.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.301+0000 7f0135000640 1 Processor -- start 2024-09-13T15:04:35.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.301+0000 7f0135000640 1 -- start start 2024-09-13T15:04:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.305+0000 7f0135000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0130150d90 0x7f0130157590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.305+0000 7f0135000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01300c1880 0x7f0130071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.305+0000 7f0135000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0130157100 con 0x7f0130157ad0 2024-09-13T15:04:35.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.305+0000 7f0135000640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0130066b00 con 0x7f0130150d90 2024-09-13T15:04:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.305+0000 7f0135000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013015a3a0 con 0x7f01300c1880 2024-09-13T15:04:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.305+0000 7f012e800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01300c1880 0x7f0130071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.305+0000 7f012de00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0130150d90 0x7f0130157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.305+0000 7f012e800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01300c1880 0x7f0130071810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:42274/0 (socket says 172.21.15.7:42274) 2024-09-13T15:04:35.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.305+0000 7f012e800640 1 -- 172.21.15.7:0/3080412018 learned_addr learned my addr 172.21.15.7:0/3080412018 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.305+0000 7f012d400640 1 --1- 172.21.15.7:0/3080412018 >> v1:172.21.15.77:6789/0 conn(0x7f0130157ad0 0x7f01300c56f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:56552/0 (socket says 172.21.15.7:56552) 2024-09-13T15:04:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.305+0000 7f012de00640 1 -- 172.21.15.7:0/3080412018 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01300c1880 msgr2=0x7f0130071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.305+0000 7f012de00640 1 --2- 172.21.15.7:0/3080412018 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01300c1880 0x7f0130071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.305+0000 7f012de00640 1 -- 172.21.15.7:0/3080412018 >> v1:172.21.15.77:6789/0 conn(0x7f0130157ad0 legacy=0x7f01300c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:35.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.305+0000 7f012de00640 1 -- 172.21.15.7:0/3080412018 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0130156db0 con 0x7f0130150d90 2024-09-13T15:04:35.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.309+0000 7f012de00640 1 --2- 172.21.15.7:0/3080412018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0130150d90 0x7f0130157590 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f01200097c0 tx=0x7f012001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86465d6f5229245c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:35.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.309+0000 7f012ca00640 1 -- 172.21.15.7:0/3080412018 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01200a8990 con 0x7f0130150d90 2024-09-13T15:04:35.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.309+0000 7f012ca00640 1 -- 172.21.15.7:0/3080412018 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01200a8af0 con 0x7f0130150d90 2024-09-13T15:04:35.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.309+0000 7f012ca00640 1 -- 172.21.15.7:0/3080412018 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01200a8e80 con 0x7f0130150d90 2024-09-13T15:04:35.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.309+0000 7f0135000640 1 -- 172.21.15.7:0/3080412018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0130150d90 msgr2=0x7f0130157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:35.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.309+0000 7f0135000640 1 --2- 172.21.15.7:0/3080412018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0130150d90 0x7f0130157590 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f01200097c0 tx=0x7f012001ec90 comp rx=0 tx=0).stop 2024-09-13T15:04:35.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.309+0000 7f0135000640 1 -- 172.21.15.7:0/3080412018 shutdown_connections 2024-09-13T15:04:35.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.309+0000 7f0135000640 1 --2- 172.21.15.7:0/3080412018 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f01300c1880 0x7f0130071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.309+0000 7f0135000640 1 --2- 172.21.15.7:0/3080412018 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0130150d90 0x7f0130157590 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.309+0000 7f0135000640 1 -- 172.21.15.7:0/3080412018 >> 172.21.15.7:0/3080412018 conn(0x7f0130065d40 msgr2=0x7f0130066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:35.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.309+0000 7f0135000640 1 -- 172.21.15.7:0/3080412018 shutdown_connections 2024-09-13T15:04:35.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.309+0000 7f0135000640 1 -- 172.21.15.7:0/3080412018 wait complete. 2024-09-13T15:04:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.309+0000 7f0135000640 1 Processor -- start 2024-09-13T15:04:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.309+0000 7f0135000640 1 -- start start 2024-09-13T15:04:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f0135000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01300c1880 0x7f01300c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f0135000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0130150d90 0x7f01301ee940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f0135000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0130157ad0 0x7f01301eee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f0135000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013014bbf0 con 0x7f0130150d90 2024-09-13T15:04:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f0135000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01301ef3c0 con 0x7f01300c1880 2024-09-13T15:04:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f0135000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013014b270 con 0x7f0130157ad0 2024-09-13T15:04:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f012d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0130150d90 0x7f01301ee940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f012d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0130150d90 0x7f01301ee940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60486/0 (socket says 172.21.15.7:60486) 2024-09-13T15:04:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f012d400640 1 -- 172.21.15.7:0/3909946160 learned_addr learned my addr 172.21.15.7:0/3909946160 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f012de00640 1 --2- 172.21.15.7:0/3909946160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01300c1880 0x7f01300c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f012e800640 1 --2- 172.21.15.7:0/3909946160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0130157ad0 0x7f01301eee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f012d400640 1 -- 172.21.15.7:0/3909946160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0130157ad0 msgr2=0x7f01301eee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f012d400640 1 --2- 172.21.15.7:0/3909946160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0130157ad0 0x7f01301eee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f012d400640 1 -- 172.21.15.7:0/3909946160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01300c1880 msgr2=0x7f01300c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f012d400640 1 --2- 172.21.15.7:0/3909946160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01300c1880 0x7f01300c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f012d400640 1 -- 172.21.15.7:0/3909946160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0120009420 con 0x7f0130150d90 2024-09-13T15:04:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f012e800640 1 --2- 172.21.15.7:0/3909946160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0130157ad0 0x7f01301eee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f012d400640 1 --2- 172.21.15.7:0/3909946160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0130150d90 0x7f01301ee940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f011c00c430 tx=0x7f011c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f0126000640 1 -- 172.21.15.7:0/3909946160 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c0074e0 con 0x7f0130150d90 2024-09-13T15:04:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f0126000640 1 -- 172.21.15.7:0/3909946160 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c007640 con 0x7f0130150d90 2024-09-13T15:04:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f0135000640 1 -- 172.21.15.7:0/3909946160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01300bfd00 con 0x7f0130150d90 2024-09-13T15:04:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f0126000640 1 -- 172.21.15.7:0/3909946160 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c004a10 con 0x7f0130150d90 2024-09-13T15:04:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f0135000640 1 -- 172.21.15.7:0/3909946160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013014b530 con 0x7f0130150d90 2024-09-13T15:04:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.313+0000 7f0135000640 1 -- 172.21.15.7:0/3909946160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0130151170 con 0x7f0130150d90 2024-09-13T15:04:35.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.317+0000 7f0126000640 1 -- 172.21.15.7:0/3909946160 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f011c004b70 con 0x7f0130150d90 2024-09-13T15:04:35.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.317+0000 7f0126000640 1 --2- 172.21.15.7:0/3909946160 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0110066690 0x7f0110068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:35.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.317+0000 7f0126000640 1 -- 172.21.15.7:0/3909946160 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f011c083fd0 con 0x7f0130150d90 2024-09-13T15:04:35.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.317+0000 7f012de00640 1 --2- 172.21.15.7:0/3909946160 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0110066690 0x7f0110068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:35.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.317+0000 7f012de00640 1 --2- 172.21.15.7:0/3909946160 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0110066690 0x7f0110068b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f01200b2000 tx=0x7f0120008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:35.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.321+0000 7f0126000640 1 -- 172.21.15.7:0/3909946160 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f011c050e50 con 0x7f0130150d90 2024-09-13T15:04:35.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.485+0000 7f0135000640 1 -- 172.21.15.7:0/3909946160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f01300c54d0 con 0x7f0130150d90 2024-09-13T15:04:35.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.485+0000 7f0126000640 1 -- 172.21.15.7:0/3909946160 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f011c054470 con 0x7f0130150d90 2024-09-13T15:04:35.487 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T15:04:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.485+0000 7f0135000640 1 -- 172.21.15.7:0/3909946160 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0110066690 msgr2=0x7f0110068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.485+0000 7f0135000640 1 --2- 172.21.15.7:0/3909946160 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0110066690 0x7f0110068b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f01200b2000 tx=0x7f0120008040 comp rx=0 tx=0).stop 2024-09-13T15:04:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.485+0000 7f0135000640 1 -- 172.21.15.7:0/3909946160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0130150d90 msgr2=0x7f01301ee940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.485+0000 7f0135000640 1 --2- 172.21.15.7:0/3909946160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0130150d90 0x7f01301ee940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f011c00c430 tx=0x7f011c00c8f0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.485+0000 7f0135000640 1 -- 172.21.15.7:0/3909946160 shutdown_connections 2024-09-13T15:04:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.485+0000 7f0135000640 1 --2- 172.21.15.7:0/3909946160 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0110066690 0x7f0110068b50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.485+0000 7f0135000640 1 --2- 172.21.15.7:0/3909946160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0130157ad0 0x7f01301eee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.485+0000 7f0135000640 1 --2- 172.21.15.7:0/3909946160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0130150d90 0x7f01301ee940 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.485+0000 7f0135000640 1 --2- 172.21.15.7:0/3909946160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01300c1880 0x7f01300c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.485+0000 7f0135000640 1 -- 172.21.15.7:0/3909946160 >> 172.21.15.7:0/3909946160 conn(0x7f0130065d40 msgr2=0x7f01300c07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.485+0000 7f0135000640 1 -- 172.21.15.7:0/3909946160 shutdown_connections 2024-09-13T15:04:35.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.485+0000 7f0135000640 1 -- 172.21.15.7:0/3909946160 wait complete. 2024-09-13T15:04:35.508 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:04:35.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.645+0000 7f320fa00640 1 Processor -- start 2024-09-13T15:04:35.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.645+0000 7f320fa00640 1 -- start start 2024-09-13T15:04:35.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.649+0000 7f320fa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32080c8e40 0x7f3208152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:35.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.649+0000 7f320fa00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3208159400 con 0x7f32080c9c40 2024-09-13T15:04:35.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.649+0000 7f320fa00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32081596e0 con 0x7f32080ca020 2024-09-13T15:04:35.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.649+0000 7f320fa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32081599c0 con 0x7f32080c8e40 2024-09-13T15:04:35.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.649+0000 7f320d000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f32080c9c40 0x7f32080662d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44232/0 (socket says 172.21.15.7:44232) 2024-09-13T15:04:35.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.649+0000 7f320d000640 1 -- 172.21.15.7:0/3817210691 learned_addr learned my addr 172.21.15.7:0/3817210691 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:35.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.649+0000 7f320da00640 1 --2- 172.21.15.7:0/3817210691 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32080c8e40 0x7f3208152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:35.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.649+0000 7f3207e00640 1 -- 172.21.15.7:0/3817210691 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419664237 0 0) 0x7f3208159400 con 0x7f32080c9c40 2024-09-13T15:04:35.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.649+0000 7f3207e00640 1 -- 172.21.15.7:0/3817210691 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31ec003530 con 0x7f32080c9c40 2024-09-13T15:04:35.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.649+0000 7f3207e00640 1 -- 172.21.15.7:0/3817210691 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847338918 0 0) 0x7f32081596e0 con 0x7f32080ca020 2024-09-13T15:04:35.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.649+0000 7f3207e00640 1 -- 172.21.15.7:0/3817210691 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3208159400 con 0x7f32080ca020 2024-09-13T15:04:35.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.649+0000 7f3207e00640 1 -- 172.21.15.7:0/3817210691 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3666665740 0 0) 0x7f31ec003530 con 0x7f32080c9c40 2024-09-13T15:04:35.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.649+0000 7f320da00640 1 -- 172.21.15.7:0/3817210691 >> v1:172.21.15.77:6789/0 conn(0x7f32080ca020 legacy=0x7f32080c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:35.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.649+0000 7f320da00640 1 -- 172.21.15.7:0/3817210691 >> v1:172.21.15.7:6789/0 conn(0x7f32080c9c40 legacy=0x7f32080662d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:35.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.649+0000 7f320da00640 1 -- 172.21.15.7:0/3817210691 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3208159ca0 con 0x7f32080c8e40 2024-09-13T15:04:35.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f320da00640 1 --2- 172.21.15.7:0/3817210691 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32080c8e40 0x7f3208152b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3200009dc0 tx=0x7f320001f0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76881c4b69d49227 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:35.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f3207e00640 1 -- 172.21.15.7:0/3817210691 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f8001680 con 0x7f32080c8e40 2024-09-13T15:04:35.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f3207e00640 1 -- 172.21.15.7:0/3817210691 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32000a8c30 con 0x7f32080c8e40 2024-09-13T15:04:35.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f3207e00640 1 -- 172.21.15.7:0/3817210691 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32000b0440 con 0x7f32080c8e40 2024-09-13T15:04:35.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f320fa00640 1 -- 172.21.15.7:0/3817210691 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32080c8e40 msgr2=0x7f3208152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:35.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f320fa00640 1 --2- 172.21.15.7:0/3817210691 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32080c8e40 0x7f3208152b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3200009dc0 tx=0x7f320001f0a0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f320fa00640 1 -- 172.21.15.7:0/3817210691 shutdown_connections 2024-09-13T15:04:35.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f320fa00640 1 --2- 172.21.15.7:0/3817210691 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32080c8e40 0x7f3208152b90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f320fa00640 1 -- 172.21.15.7:0/3817210691 >> 172.21.15.7:0/3817210691 conn(0x7f320806e1f0 msgr2=0x7f320806e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:35.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f320fa00640 1 -- 172.21.15.7:0/3817210691 shutdown_connections 2024-09-13T15:04:35.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f320fa00640 1 -- 172.21.15.7:0/3817210691 wait complete. 2024-09-13T15:04:35.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f320fa00640 1 Processor -- start 2024-09-13T15:04:35.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f320fa00640 1 -- start start 2024-09-13T15:04:35.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f320fa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32080c8e40 0x7f32080c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:35.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f320fa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32080c9c40 0x7f32080cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:35.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f320fa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32080ca020 0x7f3208071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:35.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f320fa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32080cc570 con 0x7f32080ca020 2024-09-13T15:04:35.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f320fa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32081eeae0 con 0x7f32080c8e40 2024-09-13T15:04:35.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.653+0000 7f320fa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32080cc770 con 0x7f32080c9c40 2024-09-13T15:04:35.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f320da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32080ca020 0x7f3208071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:35.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f320da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32080ca020 0x7f3208071e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60494/0 (socket says 172.21.15.7:60494) 2024-09-13T15:04:35.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f320da00640 1 -- 172.21.15.7:0/2130554094 learned_addr learned my addr 172.21.15.7:0/2130554094 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:35.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f320d000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32080c8e40 0x7f32080c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:35.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f31ffe00640 1 --2- 172.21.15.7:0/2130554094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32080c9c40 0x7f32080cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:35.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f320da00640 1 -- 172.21.15.7:0/2130554094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32080c9c40 msgr2=0x7f32080cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:35.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f320da00640 1 --2- 172.21.15.7:0/2130554094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32080c9c40 0x7f32080cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f320da00640 1 -- 172.21.15.7:0/2130554094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32080c8e40 msgr2=0x7f32080c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:35.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f320da00640 1 --2- 172.21.15.7:0/2130554094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32080c8e40 0x7f32080c5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f320da00640 1 -- 172.21.15.7:0/2130554094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3200009a70 con 0x7f32080ca020 2024-09-13T15:04:35.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f320da00640 1 --2- 172.21.15.7:0/2130554094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32080ca020 0x7f3208071e80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f320001d750 tx=0x7f320001be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:35.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f3205600640 1 -- 172.21.15.7:0/2130554094 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32000c2070 con 0x7f32080ca020 2024-09-13T15:04:35.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f3205600640 1 -- 172.21.15.7:0/2130554094 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3200009450 con 0x7f32080ca020 2024-09-13T15:04:35.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f3205600640 1 -- 172.21.15.7:0/2130554094 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32000ba410 con 0x7f32080ca020 2024-09-13T15:04:35.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f320fa00640 1 -- 172.21.15.7:0/2130554094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32081eed60 con 0x7f32080ca020 2024-09-13T15:04:35.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f320fa00640 1 -- 172.21.15.7:0/2130554094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32081ef320 con 0x7f32080ca020 2024-09-13T15:04:35.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f320fa00640 1 -- 172.21.15.7:0/2130554094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3208067650 con 0x7f32080ca020 2024-09-13T15:04:35.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f3205600640 1 -- 172.21.15.7:0/2130554094 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f32000b7050 con 0x7f32080ca020 2024-09-13T15:04:35.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.657+0000 7f3205600640 1 --2- 172.21.15.7:0/2130554094 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f31e40666c0 0x7f31e4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:35.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.661+0000 7f3205600640 1 -- 172.21.15.7:0/2130554094 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3200121d70 con 0x7f32080ca020 2024-09-13T15:04:35.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.661+0000 7f320d000640 1 --2- 172.21.15.7:0/2130554094 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f31e40666c0 0x7f31e4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:35.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.661+0000 7f320d000640 1 --2- 172.21.15.7:0/2130554094 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f31e40666c0 0x7f31e4068b80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f31f8000fe0 tx=0x7f31f80016a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:35.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.665+0000 7f3205600640 1 -- 172.21.15.7:0/2130554094 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f32000eed30 con 0x7f32080ca020 2024-09-13T15:04:35.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.857+0000 7f320fa00640 1 -- 172.21.15.7:0/2130554094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f320814fe50 con 0x7f32080ca020 2024-09-13T15:04:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.857+0000 7f3205600640 1 -- 172.21.15.7:0/2130554094 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6300 (secure 0 0 0) 0x7f32000f2350 con 0x7f32080ca020 2024-09-13T15:04:35.861 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:35.861 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:04:30.914501+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"e","rank":4,"incarnation":17,"state":"up:creating","state_seq":1,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:04:35.861 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 17 2024-09-13T15:04:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.861+0000 7f320fa00640 1 -- 172.21.15.7:0/2130554094 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f31e40666c0 msgr2=0x7f31e4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.861+0000 7f320fa00640 1 --2- 172.21.15.7:0/2130554094 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f31e40666c0 0x7f31e4068b80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f31f8000fe0 tx=0x7f31f80016a0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.861+0000 7f320fa00640 1 -- 172.21.15.7:0/2130554094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32080ca020 msgr2=0x7f3208071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.861+0000 7f320fa00640 1 --2- 172.21.15.7:0/2130554094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32080ca020 0x7f3208071e80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f320001d750 tx=0x7f320001be40 comp rx=0 tx=0).stop 2024-09-13T15:04:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.861+0000 7f320fa00640 1 -- 172.21.15.7:0/2130554094 shutdown_connections 2024-09-13T15:04:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.861+0000 7f320fa00640 1 --2- 172.21.15.7:0/2130554094 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f31e40666c0 0x7f31e4068b80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.861+0000 7f320fa00640 1 --2- 172.21.15.7:0/2130554094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32080ca020 0x7f3208071e80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.861+0000 7f320fa00640 1 --2- 172.21.15.7:0/2130554094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f32080c9c40 0x7f32080cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.861+0000 7f320fa00640 1 --2- 172.21.15.7:0/2130554094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32080c8e40 0x7f32080c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.861+0000 7f320fa00640 1 -- 172.21.15.7:0/2130554094 >> 172.21.15.7:0/2130554094 conn(0x7f320806e1f0 msgr2=0x7f320814edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.861+0000 7f320fa00640 1 -- 172.21.15.7:0/2130554094 shutdown_connections 2024-09-13T15:04:35.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:35.861+0000 7f320fa00640 1 -- 172.21.15.7:0/2130554094 wait complete. 2024-09-13T15:04:35.882 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:04:36.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.025+0000 7f7c83800640 1 Processor -- start 2024-09-13T15:04:36.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.025+0000 7f7c83800640 1 -- start start 2024-09-13T15:04:36.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c83800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7c7c0c9c40 0x7f7c7c0662d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:36.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c83800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7c7c0ca020 0x7f7c7c0c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:36.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c83800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c7c0c6ff0 0x7f7c7c0c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:36.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c83800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c159400 con 0x7f7c7c0c9c40 2024-09-13T15:04:36.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c83800640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c1596e0 con 0x7f7c7c0ca020 2024-09-13T15:04:36.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c83800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c1599c0 con 0x7f7c7c0c6ff0 2024-09-13T15:04:36.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c80e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7c7c0c9c40 0x7f7c7c0662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:36.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c80e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7c7c0c9c40 0x7f7c7c0662d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60504/0 (socket says 172.21.15.7:60504) 2024-09-13T15:04:36.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c80e00640 1 -- 172.21.15.7:0/2750543102 learned_addr learned my addr 172.21.15.7:0/2750543102 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:36.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c73e00640 1 --2- 172.21.15.7:0/2750543102 >> v2:172.21.15.77:3300/0 conn(0x7f7c7c0ca020 0x7f7c7c0c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:36.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c81800640 1 --2- 172.21.15.7:0/2750543102 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c7c0c6ff0 0x7f7c7c0c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:36.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c80e00640 1 -- 172.21.15.7:0/2750543102 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c7c0c6ff0 msgr2=0x7f7c7c0c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c80e00640 1 --2- 172.21.15.7:0/2750543102 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c7c0c6ff0 0x7f7c7c0c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c80e00640 1 -- 172.21.15.7:0/2750543102 >> v2:172.21.15.77:3300/0 conn(0x7f7c7c0ca020 msgr2=0x7f7c7c0c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c80e00640 1 --2- 172.21.15.7:0/2750543102 >> v2:172.21.15.77:3300/0 conn(0x7f7c7c0ca020 0x7f7c7c0c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c80e00640 1 -- 172.21.15.7:0/2750543102 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c159ca0 con 0x7f7c7c0c9c40 2024-09-13T15:04:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c81800640 1 --2- 172.21.15.7:0/2750543102 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c7c0c6ff0 0x7f7c7c0c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:36.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.029+0000 7f7c73e00640 1 --2- 172.21.15.7:0/2750543102 >> v2:172.21.15.77:3300/0 conn(0x7f7c7c0ca020 0x7f7c7c0c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:36.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.033+0000 7f7c80e00640 1 --2- 172.21.15.7:0/2750543102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c7c0c9c40 0x7f7c7c0662d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c06d920 tx=0x7f7c6c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505ab7a3a63318c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:36.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.033+0000 7f7c7be00640 1 -- 172.21.15.7:0/2750543102 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c0a89d0 con 0x7f7c7c0c9c40 2024-09-13T15:04:36.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.033+0000 7f7c7be00640 1 -- 172.21.15.7:0/2750543102 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c0a8b30 con 0x7f7c7c0c9c40 2024-09-13T15:04:36.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.033+0000 7f7c7be00640 1 -- 172.21.15.7:0/2750543102 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c0b0440 con 0x7f7c7c0c9c40 2024-09-13T15:04:36.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.033+0000 7f7c83800640 1 -- 172.21.15.7:0/2750543102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c7c0c9c40 msgr2=0x7f7c7c0662d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:36.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.033+0000 7f7c83800640 1 --2- 172.21.15.7:0/2750543102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c7c0c9c40 0x7f7c7c0662d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c06d920 tx=0x7f7c6c01ed10 comp rx=0 tx=0).stop 2024-09-13T15:04:36.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.033+0000 7f7c83800640 1 -- 172.21.15.7:0/2750543102 shutdown_connections 2024-09-13T15:04:36.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.033+0000 7f7c83800640 1 --2- 172.21.15.7:0/2750543102 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c7c0c6ff0 0x7f7c7c0c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.033+0000 7f7c83800640 1 --2- 172.21.15.7:0/2750543102 >> v2:172.21.15.77:3300/0 conn(0x7f7c7c0ca020 0x7f7c7c0c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.033+0000 7f7c83800640 1 --2- 172.21.15.7:0/2750543102 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c7c0c9c40 0x7f7c7c0662d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.033+0000 7f7c83800640 1 -- 172.21.15.7:0/2750543102 >> 172.21.15.7:0/2750543102 conn(0x7f7c7c06e1f0 msgr2=0x7f7c7c06e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:36.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.033+0000 7f7c83800640 1 -- 172.21.15.7:0/2750543102 shutdown_connections 2024-09-13T15:04:36.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.033+0000 7f7c83800640 1 -- 172.21.15.7:0/2750543102 wait complete. 2024-09-13T15:04:36.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.033+0000 7f7c83800640 1 Processor -- start 2024-09-13T15:04:36.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.033+0000 7f7c83800640 1 -- start start 2024-09-13T15:04:36.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c83800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c7c0c6ff0 0x7f7c7c0c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c83800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c7c0c9c40 0x7f7c7c15b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c83800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c7c0ca020 0x7f7c7c146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c83800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0c39d0 con 0x7f7c7c0c6ff0 2024-09-13T15:04:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c83800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0c3c70 con 0x7f7c7c0c9c40 2024-09-13T15:04:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c83800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c15a270 con 0x7f7c7c0ca020 2024-09-13T15:04:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c80e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c7c0c6ff0 0x7f7c7c0c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c80e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c7c0c6ff0 0x7f7c7c0c33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60510/0 (socket says 172.21.15.7:60510) 2024-09-13T15:04:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c80e00640 1 -- 172.21.15.7:0/1092637294 learned_addr learned my addr 172.21.15.7:0/1092637294 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c81800640 1 --2- 172.21.15.7:0/1092637294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c7c0ca020 0x7f7c7c146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c73e00640 1 --2- 172.21.15.7:0/1092637294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c7c0c9c40 0x7f7c7c15b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c80e00640 1 -- 172.21.15.7:0/1092637294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c7c0ca020 msgr2=0x7f7c7c146f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c80e00640 1 --2- 172.21.15.7:0/1092637294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c7c0ca020 0x7f7c7c146f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c80e00640 1 -- 172.21.15.7:0/1092637294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c7c0c9c40 msgr2=0x7f7c7c15b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:36.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c80e00640 1 --2- 172.21.15.7:0/1092637294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c7c0c9c40 0x7f7c7c15b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c80e00640 1 -- 172.21.15.7:0/1092637294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c0094d0 con 0x7f7c7c0c6ff0 2024-09-13T15:04:36.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c80e00640 1 --2- 172.21.15.7:0/1092637294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c7c0c6ff0 0x7f7c7c0c33e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c01d3c0 tx=0x7f7c6c01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:36.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c79600640 1 -- 172.21.15.7:0/1092637294 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c0ba600 con 0x7f7c7c0c6ff0 2024-09-13T15:04:36.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c79600640 1 -- 172.21.15.7:0/1092637294 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c0ba760 con 0x7f7c7c0c6ff0 2024-09-13T15:04:36.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c79600640 1 -- 172.21.15.7:0/1092637294 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c0bab10 con 0x7f7c7c0c6ff0 2024-09-13T15:04:36.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c83800640 1 -- 172.21.15.7:0/1092637294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7c15a550 con 0x7f7c7c0c6ff0 2024-09-13T15:04:36.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c83800640 1 -- 172.21.15.7:0/1092637294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c15ab10 con 0x7f7c7c0c6ff0 2024-09-13T15:04:36.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c83800640 1 -- 172.21.15.7:0/1092637294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c067650 con 0x7f7c7c0c6ff0 2024-09-13T15:04:36.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.037+0000 7f7c79600640 1 -- 172.21.15.7:0/1092637294 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c6c0bac70 con 0x7f7c7c0c6ff0 2024-09-13T15:04:36.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.041+0000 7f7c79600640 1 --2- 172.21.15.7:0/1092637294 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c580666c0 0x7f7c58068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:36.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.041+0000 7f7c79600640 1 -- 172.21.15.7:0/1092637294 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7c6c122ac0 con 0x7f7c7c0c6ff0 2024-09-13T15:04:36.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.041+0000 7f7c73e00640 1 --2- 172.21.15.7:0/1092637294 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c580666c0 0x7f7c58068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:36.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.041+0000 7f7c73e00640 1 --2- 172.21.15.7:0/1092637294 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c580666c0 0x7f7c58068b80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c157760 tx=0x7f7c64008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:36.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.045+0000 7f7c79600640 1 -- 172.21.15.7:0/1092637294 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7c6c124e60 con 0x7f7c7c0c6ff0 2024-09-13T15:04:36.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.205+0000 7f7c83800640 1 -- 172.21.15.7:0/1092637294 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c7c0662d0 con 0x7f7c7c0c6ff0 2024-09-13T15:04:36.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.209+0000 7f7c79600640 1 -- 172.21.15.7:0/1092637294 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18616 (secure 0 0 0) 0x7f7c6c0b5090 con 0x7f7c7c0c6ff0 2024-09-13T15:04:36.210 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:36.210 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:02:33.732864+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:04:36.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.209+0000 7f7c83800640 1 -- 172.21.15.7:0/1092637294 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c580666c0 msgr2=0x7f7c58068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:36.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.209+0000 7f7c83800640 1 --2- 172.21.15.7:0/1092637294 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c580666c0 0x7f7c58068b80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c157760 tx=0x7f7c64008040 comp rx=0 tx=0).stop 2024-09-13T15:04:36.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.209+0000 7f7c83800640 1 -- 172.21.15.7:0/1092637294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c7c0c6ff0 msgr2=0x7f7c7c0c33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:36.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.209+0000 7f7c83800640 1 --2- 172.21.15.7:0/1092637294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c7c0c6ff0 0x7f7c7c0c33e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c01d3c0 tx=0x7f7c6c01bab0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.209+0000 7f7c83800640 1 -- 172.21.15.7:0/1092637294 shutdown_connections 2024-09-13T15:04:36.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.209+0000 7f7c83800640 1 --2- 172.21.15.7:0/1092637294 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c580666c0 0x7f7c58068b80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.209+0000 7f7c83800640 1 --2- 172.21.15.7:0/1092637294 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c7c0ca020 0x7f7c7c146f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.209+0000 7f7c83800640 1 --2- 172.21.15.7:0/1092637294 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c7c0c9c40 0x7f7c7c15b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.209+0000 7f7c83800640 1 --2- 172.21.15.7:0/1092637294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c7c0c6ff0 0x7f7c7c0c33e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.209+0000 7f7c83800640 1 -- 172.21.15.7:0/1092637294 >> 172.21.15.7:0/1092637294 conn(0x7f7c7c06e1f0 msgr2=0x7f7c7c0c62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:36.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.209+0000 7f7c83800640 1 -- 172.21.15.7:0/1092637294 shutdown_connections 2024-09-13T15:04:36.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.209+0000 7f7c83800640 1 -- 172.21.15.7:0/1092637294 wait complete. 2024-09-13T15:04:36.232 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:04:36.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.369+0000 7f3ea6000640 1 Processor -- start 2024-09-13T15:04:36.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.369+0000 7f3ea6000640 1 -- start start 2024-09-13T15:04:36.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.373+0000 7f3ea6000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ea006da80 0x7f3ea00c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:36.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.373+0000 7f3ea6000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3ea00c7900 0x7f3ea0152e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:36.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.373+0000 7f3ea6000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea00c6770 con 0x7f3ea006de60 2024-09-13T15:04:36.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.373+0000 7f3ea6000640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea015a060 con 0x7f3ea00c7900 2024-09-13T15:04:36.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.373+0000 7f3ea6000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea0159240 con 0x7f3ea006da80 2024-09-13T15:04:36.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.373+0000 7f3e97e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3ea006de60 0x7f3ea015ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44246/0 (socket says 172.21.15.7:44246) 2024-09-13T15:04:36.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.373+0000 7f3e97e00640 1 -- 172.21.15.7:0/1450661942 learned_addr learned my addr 172.21.15.7:0/1450661942 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:36.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.373+0000 7f3e9fe00640 1 --2- 172.21.15.7:0/1450661942 >> v2:172.21.15.77:3300/0 conn(0x7f3ea00c7900 0x7f3ea0152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:36.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.373+0000 7f3e9f400640 1 --2- 172.21.15.7:0/1450661942 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ea006da80 0x7f3ea00c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:36.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.373+0000 7f3e9ea00640 1 -- 172.21.15.7:0/1450661942 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812498216 0 0) 0x7f3ea00c6770 con 0x7f3ea006de60 2024-09-13T15:04:36.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.373+0000 7f3e9ea00640 1 -- 172.21.15.7:0/1450661942 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e84003530 con 0x7f3ea006de60 2024-09-13T15:04:36.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.373+0000 7f3e9ea00640 1 -- 172.21.15.7:0/1450661942 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2729656867 0 0) 0x7f3e84003530 con 0x7f3ea006de60 2024-09-13T15:04:36.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.373+0000 7f3e9f400640 1 -- 172.21.15.7:0/1450661942 >> v2:172.21.15.77:3300/0 conn(0x7f3ea00c7900 msgr2=0x7f3ea0152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:36.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.373+0000 7f3e9f400640 1 --2- 172.21.15.7:0/1450661942 >> v2:172.21.15.77:3300/0 conn(0x7f3ea00c7900 0x7f3ea0152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.373+0000 7f3e9f400640 1 -- 172.21.15.7:0/1450661942 >> v1:172.21.15.7:6789/0 conn(0x7f3ea006de60 legacy=0x7f3ea015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:36.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.373+0000 7f3e9f400640 1 -- 172.21.15.7:0/1450661942 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea01594e0 con 0x7f3ea006da80 2024-09-13T15:04:36.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.373+0000 7f3e9fe00640 1 --2- 172.21.15.7:0/1450661942 >> v2:172.21.15.77:3300/0 conn(0x7f3ea00c7900 0x7f3ea0152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:36.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3e9f400640 1 --2- 172.21.15.7:0/1450661942 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ea006da80 0x7f3ea00c73c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3e900097c0 tx=0x7f3e9001c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=921203cc71291ffd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3e9ea00640 1 -- 172.21.15.7:0/1450661942 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e88001680 con 0x7f3ea006da80 2024-09-13T15:04:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3e9ea00640 1 -- 172.21.15.7:0/1450661942 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e900a7050 con 0x7f3ea006da80 2024-09-13T15:04:36.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3e9ea00640 1 -- 172.21.15.7:0/1450661942 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e900ab600 con 0x7f3ea006da80 2024-09-13T15:04:36.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3ea6000640 1 -- 172.21.15.7:0/1450661942 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ea006da80 msgr2=0x7f3ea00c73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:36.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3ea6000640 1 --2- 172.21.15.7:0/1450661942 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ea006da80 0x7f3ea00c73c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3e900097c0 tx=0x7f3e9001c390 comp rx=0 tx=0).stop 2024-09-13T15:04:36.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3ea6000640 1 -- 172.21.15.7:0/1450661942 shutdown_connections 2024-09-13T15:04:36.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3ea6000640 1 --2- 172.21.15.7:0/1450661942 >> v2:172.21.15.77:3300/0 conn(0x7f3ea00c7900 0x7f3ea0152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3ea6000640 1 --2- 172.21.15.7:0/1450661942 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ea006da80 0x7f3ea00c73c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3ea6000640 1 -- 172.21.15.7:0/1450661942 >> 172.21.15.7:0/1450661942 conn(0x7f3ea006c330 msgr2=0x7f3ea00cb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:36.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3ea6000640 1 -- 172.21.15.7:0/1450661942 shutdown_connections 2024-09-13T15:04:36.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3ea6000640 1 -- 172.21.15.7:0/1450661942 wait complete. 2024-09-13T15:04:36.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3ea6000640 1 Processor -- start 2024-09-13T15:04:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3ea6000640 1 -- start start 2024-09-13T15:04:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3ea6000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ea006da80 0x7f3ea01f1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3ea6000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea006de60 0x7f3ea01f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3ea6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ea00c7900 0x7f3ea014e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3ea6000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea01f28c0 con 0x7f3ea00c7900 2024-09-13T15:04:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3ea6000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea01f1e40 con 0x7f3ea006de60 2024-09-13T15:04:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.377+0000 7f3ea6000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea00c40d0 con 0x7f3ea006da80 2024-09-13T15:04:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3e9fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ea00c7900 0x7f3ea014e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3e9fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ea00c7900 0x7f3ea014e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60522/0 (socket says 172.21.15.7:60522) 2024-09-13T15:04:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3e9fe00640 1 -- 172.21.15.7:0/650593044 learned_addr learned my addr 172.21.15.7:0/650593044 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3e9f400640 1 --2- 172.21.15.7:0/650593044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ea006da80 0x7f3ea01f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:36.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3e97e00640 1 --2- 172.21.15.7:0/650593044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea006de60 0x7f3ea01f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:36.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3e9fe00640 1 -- 172.21.15.7:0/650593044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ea006da80 msgr2=0x7f3ea01f1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:36.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3e9fe00640 1 --2- 172.21.15.7:0/650593044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ea006da80 0x7f3ea01f1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3e9fe00640 1 -- 172.21.15.7:0/650593044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea006de60 msgr2=0x7f3ea01f5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:36.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3e9fe00640 1 --2- 172.21.15.7:0/650593044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea006de60 0x7f3ea01f5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3e9fe00640 1 -- 172.21.15.7:0/650593044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e98009a70 con 0x7f3ea00c7900 2024-09-13T15:04:36.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3e9fe00640 1 --2- 172.21.15.7:0/650593044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ea00c7900 0x7f3ea014e680 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009e10 tx=0x7f3e9800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:36.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3e97400640 1 -- 172.21.15.7:0/650593044 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e98009cb0 con 0x7f3ea00c7900 2024-09-13T15:04:36.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3e97400640 1 -- 172.21.15.7:0/650593044 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9800f040 con 0x7f3ea00c7900 2024-09-13T15:04:36.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3e97400640 1 -- 172.21.15.7:0/650593044 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e980146a0 con 0x7f3ea00c7900 2024-09-13T15:04:36.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3ea6000640 1 -- 172.21.15.7:0/650593044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e90009420 con 0x7f3ea00c7900 2024-09-13T15:04:36.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3ea6000640 1 -- 172.21.15.7:0/650593044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea01f53c0 con 0x7f3ea00c7900 2024-09-13T15:04:36.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3ea6000640 1 -- 172.21.15.7:0/650593044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea01f5550 con 0x7f3ea00c7900 2024-09-13T15:04:36.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.381+0000 7f3e97400640 1 -- 172.21.15.7:0/650593044 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3e98014800 con 0x7f3ea00c7900 2024-09-13T15:04:36.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.385+0000 7f3e97400640 1 --2- 172.21.15.7:0/650593044 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3e7c066690 0x7f3e7c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:36.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.385+0000 7f3e97400640 1 -- 172.21.15.7:0/650593044 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3e98085470 con 0x7f3ea00c7900 2024-09-13T15:04:36.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.385+0000 7f3e9f400640 1 --2- 172.21.15.7:0/650593044 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3e7c066690 0x7f3e7c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:36.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.385+0000 7f3e9f400640 1 --2- 172.21.15.7:0/650593044 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3e7c066690 0x7f3e7c068b50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3e900ad000 tx=0x7f3e90008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:36.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.389+0000 7f3e97400640 1 -- 172.21.15.7:0/650593044 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3e98052430 con 0x7f3ea00c7900 2024-09-13T15:04:36.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.585+0000 7f3ea6000640 1 -- 172.21.15.7:0/650593044 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ea00c73c0 con 0x7f3ea00c7900 2024-09-13T15:04:36.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.585+0000 7f3e97400640 1 -- 172.21.15.7:0/650593044 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+6300 (secure 0 0 0) 0x7f3e98055a50 con 0x7f3ea00c7900 2024-09-13T15:04:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:36.587 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:04:30.914501+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"e","rank":4,"incarnation":17,"state":"up:creating","state_seq":1,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:04:36.588 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 17 2024-09-13T15:04:36.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.585+0000 7f3ea6000640 1 -- 172.21.15.7:0/650593044 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3e7c066690 msgr2=0x7f3e7c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:36.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.585+0000 7f3ea6000640 1 --2- 172.21.15.7:0/650593044 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3e7c066690 0x7f3e7c068b50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3e900ad000 tx=0x7f3e90008040 comp rx=0 tx=0).stop 2024-09-13T15:04:36.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.585+0000 7f3ea6000640 1 -- 172.21.15.7:0/650593044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ea00c7900 msgr2=0x7f3ea014e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:36.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.585+0000 7f3ea6000640 1 --2- 172.21.15.7:0/650593044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ea00c7900 0x7f3ea014e680 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009e10 tx=0x7f3e9800c490 comp rx=0 tx=0).stop 2024-09-13T15:04:36.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.585+0000 7f3ea6000640 1 -- 172.21.15.7:0/650593044 shutdown_connections 2024-09-13T15:04:36.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.585+0000 7f3ea6000640 1 --2- 172.21.15.7:0/650593044 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3e7c066690 0x7f3e7c068b50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.585+0000 7f3ea6000640 1 --2- 172.21.15.7:0/650593044 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ea00c7900 0x7f3ea014e680 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.585+0000 7f3ea6000640 1 --2- 172.21.15.7:0/650593044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ea006de60 0x7f3ea01f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.585+0000 7f3ea6000640 1 --2- 172.21.15.7:0/650593044 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ea006da80 0x7f3ea01f1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:36.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.585+0000 7f3ea6000640 1 -- 172.21.15.7:0/650593044 >> 172.21.15.7:0/650593044 conn(0x7f3ea006c330 msgr2=0x7f3ea015ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:36.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.585+0000 7f3ea6000640 1 -- 172.21.15.7:0/650593044 shutdown_connections 2024-09-13T15:04:36.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:36.585+0000 7f3ea6000640 1 -- 172.21.15.7:0/650593044 wait complete. 2024-09-13T15:04:37.214 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:01:44.789559+0000', 'modified': '2024-09-13T15:04:30.914501+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4276, 'mds_1': 4267, 'mds_2': 4252, 'mds_3': 4238, 'mds_4': 4232}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4232': {'gid': 4232, 'name': 'e', 'rank': 4, 'incarnation': 17, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.7:6833/2907495549', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6832', 'nonce': 2907495549}, {'type': 'v1', 'addr': '172.21.15.7:6833', 'nonce': 2907495549}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4238': {'gid': 4238, 'name': 'a', 'rank': 3, 'incarnation': 15, 'state': 'up:active', 'state_seq': 44, 'addr': '172.21.15.7:6837/3369648543', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 3369648543}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 3369648543}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4252': {'gid': 4252, 'name': 'd', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 43, 'addr': '172.21.15.77:6835/2367107997', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6834', 'nonce': 2367107997}, {'type': 'v1', 'addr': '172.21.15.77:6835', 'nonce': 2367107997}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4267': {'gid': 4267, 'name': 'f', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 41, 'addr': '172.21.15.77:6839/2233000674', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6837', 'nonce': 2233000674}, {'type': 'v1', 'addr': '172.21.15.77:6839', 'nonce': 2233000674}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4276': {'gid': 4276, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6836/2396967179', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 2396967179}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 2396967179}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:04:37.214 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4232:up:creating 2024-09-13T15:04:38.215 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:04:38.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.365+0000 7f8e32a00640 1 Processor -- start 2024-09-13T15:04:38.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.365+0000 7f8e32a00640 1 -- start start 2024-09-13T15:04:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.365+0000 7f8e32a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8e2c0c00f0 0x7f8e2c0c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.365+0000 7f8e32a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8e2c0b0cb0 0x7f8e2c14f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.365+0000 7f8e32a00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2c06fd10 con 0x7f8e2c0c04d0 2024-09-13T15:04:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.365+0000 7f8e32a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2c071000 con 0x7f8e2c0c00f0 2024-09-13T15:04:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.365+0000 7f8e32a00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2c155ec0 con 0x7f8e2c0b0cb0 2024-09-13T15:04:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.365+0000 7f8e2be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8e2c0c00f0 0x7f8e2c0c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.365+0000 7f8e2be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8e2c0c00f0 0x7f8e2c0c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35930/0 (socket says 172.21.15.7:35930) 2024-09-13T15:04:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.365+0000 7f8e2be00640 1 -- 172.21.15.7:0/3264095127 learned_addr learned my addr 172.21.15.7:0/3264095127 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:38.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.365+0000 7f8e30a00640 1 --2- 172.21.15.7:0/3264095127 >> v2:172.21.15.77:3300/0 conn(0x7f8e2c0b0cb0 0x7f8e2c14f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:38.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.365+0000 7f8e2be00640 1 -- 172.21.15.7:0/3264095127 >> v2:172.21.15.77:3300/0 conn(0x7f8e2c0b0cb0 msgr2=0x7f8e2c14f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:38.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.365+0000 7f8e2be00640 1 --2- 172.21.15.7:0/3264095127 >> v2:172.21.15.77:3300/0 conn(0x7f8e2c0b0cb0 0x7f8e2c14f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:38.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.365+0000 7f8e2be00640 1 -- 172.21.15.7:0/3264095127 >> v1:172.21.15.77:6789/0 conn(0x7f8e2c0c04d0 legacy=0x7f8e2c06f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:38.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.365+0000 7f8e2be00640 1 -- 172.21.15.7:0/3264095127 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c06ff60 con 0x7f8e2c0c00f0 2024-09-13T15:04:38.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.369+0000 7f8e2be00640 1 --2- 172.21.15.7:0/3264095127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e2c0c00f0 0x7f8e2c0c5530 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0c68a0 tx=0x7f8e1c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2f372beee53b1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:38.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.369+0000 7f8e2b400640 1 -- 172.21.15.7:0/3264095127 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c0a8a10 con 0x7f8e2c0c00f0 2024-09-13T15:04:38.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.369+0000 7f8e2b400640 1 -- 172.21.15.7:0/3264095127 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1c0a8b70 con 0x7f8e2c0c00f0 2024-09-13T15:04:38.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.369+0000 7f8e2b400640 1 -- 172.21.15.7:0/3264095127 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c0b0440 con 0x7f8e2c0c00f0 2024-09-13T15:04:38.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.369+0000 7f8e32a00640 1 -- 172.21.15.7:0/3264095127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e2c0c00f0 msgr2=0x7f8e2c0c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:38.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.369+0000 7f8e32a00640 1 --2- 172.21.15.7:0/3264095127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e2c0c00f0 0x7f8e2c0c5530 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0c68a0 tx=0x7f8e1c01ed10 comp rx=0 tx=0).stop 2024-09-13T15:04:38.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.369+0000 7f8e32a00640 1 -- 172.21.15.7:0/3264095127 shutdown_connections 2024-09-13T15:04:38.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.369+0000 7f8e32a00640 1 --2- 172.21.15.7:0/3264095127 >> v2:172.21.15.77:3300/0 conn(0x7f8e2c0b0cb0 0x7f8e2c14f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.369+0000 7f8e32a00640 1 --2- 172.21.15.7:0/3264095127 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e2c0c00f0 0x7f8e2c0c5530 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.369+0000 7f8e32a00640 1 -- 172.21.15.7:0/3264095127 >> 172.21.15.7:0/3264095127 conn(0x7f8e2c065d40 msgr2=0x7f8e2c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.369+0000 7f8e32a00640 1 -- 172.21.15.7:0/3264095127 shutdown_connections 2024-09-13T15:04:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.369+0000 7f8e32a00640 1 -- 172.21.15.7:0/3264095127 wait complete. 2024-09-13T15:04:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e32a00640 1 Processor -- start 2024-09-13T15:04:38.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e32a00640 1 -- start start 2024-09-13T15:04:38.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e32a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e2c0b0cb0 0x7f8e2c0ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:38.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e32a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e2c0c00f0 0x7f8e2c1521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:38.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e32a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e2c0c04d0 0x7f8e2c14b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:38.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e32a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c1511e0 con 0x7f8e2c0c04d0 2024-09-13T15:04:38.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e32a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c0af090 con 0x7f8e2c0c00f0 2024-09-13T15:04:38.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e32a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c151c90 con 0x7f8e2c0b0cb0 2024-09-13T15:04:38.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e30a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e2c0c04d0 0x7f8e2c14b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:38.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e30a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e2c0c04d0 0x7f8e2c14b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35934/0 (socket says 172.21.15.7:35934) 2024-09-13T15:04:38.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e30a00640 1 -- 172.21.15.7:0/1815175444 learned_addr learned my addr 172.21.15.7:0/1815175444 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e2be00640 1 --2- 172.21.15.7:0/1815175444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e2c0b0cb0 0x7f8e2c0ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e23400640 1 --2- 172.21.15.7:0/1815175444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e2c0c00f0 0x7f8e2c1521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e30a00640 1 -- 172.21.15.7:0/1815175444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e2c0b0cb0 msgr2=0x7f8e2c0ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e30a00640 1 --2- 172.21.15.7:0/1815175444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e2c0b0cb0 0x7f8e2c0ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e30a00640 1 -- 172.21.15.7:0/1815175444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e2c0c00f0 msgr2=0x7f8e2c1521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e30a00640 1 --2- 172.21.15.7:0/1815175444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e2c0c00f0 0x7f8e2c1521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e30a00640 1 -- 172.21.15.7:0/1815175444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1c0094d0 con 0x7f8e2c0c04d0 2024-09-13T15:04:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e2be00640 1 --2- 172.21.15.7:0/1815175444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e2c0b0cb0 0x7f8e2c0ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e30a00640 1 --2- 172.21.15.7:0/1815175444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e2c0c04d0 0x7f8e2c14b9b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009d30 tx=0x7f8e2400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e28c00640 1 -- 172.21.15.7:0/1815175444 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e24009ba0 con 0x7f8e2c0c04d0 2024-09-13T15:04:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e28c00640 1 -- 172.21.15.7:0/1815175444 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2400f040 con 0x7f8e2c0c04d0 2024-09-13T15:04:38.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e28c00640 1 -- 172.21.15.7:0/1815175444 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240146c0 con 0x7f8e2c0c04d0 2024-09-13T15:04:38.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e32a00640 1 -- 172.21.15.7:0/1815175444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2c151ee0 con 0x7f8e2c0c04d0 2024-09-13T15:04:38.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e32a00640 1 -- 172.21.15.7:0/1815175444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2c150b20 con 0x7f8e2c0c04d0 2024-09-13T15:04:38.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.373+0000 7f8e32a00640 1 -- 172.21.15.7:0/1815175444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2c067650 con 0x7f8e2c0c04d0 2024-09-13T15:04:38.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.377+0000 7f8e28c00640 1 -- 172.21.15.7:0/1815175444 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e24014820 con 0x7f8e2c0c04d0 2024-09-13T15:04:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.377+0000 7f8e28c00640 1 --2- 172.21.15.7:0/1815175444 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8e080666c0 0x7f8e08068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.377+0000 7f8e28c00640 1 -- 172.21.15.7:0/1815175444 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8e24085380 con 0x7f8e2c0c04d0 2024-09-13T15:04:38.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.377+0000 7f8e2be00640 1 --2- 172.21.15.7:0/1815175444 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8e080666c0 0x7f8e08068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:38.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.377+0000 7f8e2be00640 1 --2- 172.21.15.7:0/1815175444 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8e080666c0 0x7f8e08068b80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0b2000 tx=0x7f8e1c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:38.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.381+0000 7f8e28c00640 1 -- 172.21.15.7:0/1815175444 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8e24052200 con 0x7f8e2c0c04d0 2024-09-13T15:04:38.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.577+0000 7f8e32a00640 1 -- 172.21.15.7:0/1815175444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e2c151320 con 0x7f8e2c0c04d0 2024-09-13T15:04:38.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.577+0000 7f8e28c00640 1 -- 172.21.15.7:0/1815175444 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6299 (secure 0 0 0) 0x7f8e2c151320 con 0x7f8e2c0c04d0 2024-09-13T15:04:38.580 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:38.580 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:04:36.936420+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"e","rank":4,"incarnation":17,"state":"up:active","state_seq":46,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:04:38.580 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 18 2024-09-13T15:04:38.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.581+0000 7f8e32a00640 1 -- 172.21.15.7:0/1815175444 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8e080666c0 msgr2=0x7f8e08068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:38.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.581+0000 7f8e32a00640 1 --2- 172.21.15.7:0/1815175444 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8e080666c0 0x7f8e08068b80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c0b2000 tx=0x7f8e1c008040 comp rx=0 tx=0).stop 2024-09-13T15:04:38.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.581+0000 7f8e32a00640 1 -- 172.21.15.7:0/1815175444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e2c0c04d0 msgr2=0x7f8e2c14b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:38.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.581+0000 7f8e32a00640 1 --2- 172.21.15.7:0/1815175444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e2c0c04d0 0x7f8e2c14b9b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009d30 tx=0x7f8e2400c490 comp rx=0 tx=0).stop 2024-09-13T15:04:38.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.581+0000 7f8e32a00640 1 -- 172.21.15.7:0/1815175444 shutdown_connections 2024-09-13T15:04:38.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.581+0000 7f8e32a00640 1 --2- 172.21.15.7:0/1815175444 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8e080666c0 0x7f8e08068b80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:38.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.581+0000 7f8e32a00640 1 --2- 172.21.15.7:0/1815175444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e2c0c04d0 0x7f8e2c14b9b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:38.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.581+0000 7f8e32a00640 1 --2- 172.21.15.7:0/1815175444 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e2c0c00f0 0x7f8e2c1521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:38.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.581+0000 7f8e32a00640 1 --2- 172.21.15.7:0/1815175444 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e2c0b0cb0 0x7f8e2c0ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:38.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.581+0000 7f8e32a00640 1 -- 172.21.15.7:0/1815175444 >> 172.21.15.7:0/1815175444 conn(0x7f8e2c065d40 msgr2=0x7f8e2c0c7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:38.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.581+0000 7f8e32a00640 1 -- 172.21.15.7:0/1815175444 shutdown_connections 2024-09-13T15:04:38.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:38.581+0000 7f8e32a00640 1 -- 172.21.15.7:0/1815175444 wait complete. 2024-09-13T15:04:39.205 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T15:01:44.789559+0000', 'modified': '2024-09-13T15:04:36.936420+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4276, 'mds_1': 4267, 'mds_2': 4252, 'mds_3': 4238, 'mds_4': 4232}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4232': {'gid': 4232, 'name': 'e', 'rank': 4, 'incarnation': 17, 'state': 'up:active', 'state_seq': 46, 'addr': '172.21.15.7:6833/2907495549', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6832', 'nonce': 2907495549}, {'type': 'v1', 'addr': '172.21.15.7:6833', 'nonce': 2907495549}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4238': {'gid': 4238, 'name': 'a', 'rank': 3, 'incarnation': 15, 'state': 'up:active', 'state_seq': 44, 'addr': '172.21.15.7:6837/3369648543', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6835', 'nonce': 3369648543}, {'type': 'v1', 'addr': '172.21.15.7:6837', 'nonce': 3369648543}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4252': {'gid': 4252, 'name': 'd', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 43, 'addr': '172.21.15.77:6835/2367107997', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6834', 'nonce': 2367107997}, {'type': 'v1', 'addr': '172.21.15.77:6835', 'nonce': 2367107997}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4267': {'gid': 4267, 'name': 'f', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 41, 'addr': '172.21.15.77:6839/2233000674', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6837', 'nonce': 2233000674}, {'type': 'v1', 'addr': '172.21.15.77:6839', 'nonce': 2233000674}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4276': {'gid': 4276, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.7:6836/2396967179', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6834', 'nonce': 2396967179}, {'type': 'v1', 'addr': '172.21.15.7:6836', 'nonce': 2396967179}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T15:04:39.206 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-13T15:04:39.206 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-09-13T15:04:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.353+0000 7fdd57c00640 1 Processor -- start 2024-09-13T15:04:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.353+0000 7fdd57c00640 1 -- start start 2024-09-13T15:04:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.353+0000 7fdd57c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdd50153600 0x7fdd500c8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.353+0000 7fdd57c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd50159180 con 0x7fdd500ccd40 2024-09-13T15:04:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.353+0000 7fdd57c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd50159460 con 0x7fdd500cd120 2024-09-13T15:04:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.353+0000 7fdd57c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5015a070 con 0x7fdd50153600 2024-09-13T15:04:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.353+0000 7fdd55200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fdd500ccd40 0x7fdd50152ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:32880/0 (socket says 172.21.15.7:32880) 2024-09-13T15:04:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.353+0000 7fdd4fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdd50153600 0x7fdd500c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.353+0000 7fdd55200640 1 -- 172.21.15.7:0/2553712974 learned_addr learned my addr 172.21.15.7:0/2553712974 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.353+0000 7fdd4fe00640 1 -- 172.21.15.7:0/2553712974 >> v1:172.21.15.77:6789/0 conn(0x7fdd500cd120 legacy=0x7fdd5006f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.353+0000 7fdd4fe00640 1 -- 172.21.15.7:0/2553712974 >> v1:172.21.15.7:6789/0 conn(0x7fdd500ccd40 legacy=0x7fdd50152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.353+0000 7fdd4fe00640 1 -- 172.21.15.7:0/2553712974 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd50159740 con 0x7fdd50153600 2024-09-13T15:04:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.357+0000 7fdd4fe00640 1 --2- 172.21.15.7:0/2553712974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd50153600 0x7fdd500c8020 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0097c0 tx=0x7fdd3c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6defeb7f8d1988d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.357+0000 7fdd4f400640 1 -- 172.21.15.7:0/2553712974 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0ab600 con 0x7fdd50153600 2024-09-13T15:04:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.357+0000 7fdd4f400640 1 -- 172.21.15.7:0/2553712974 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c0a7050 con 0x7fdd50153600 2024-09-13T15:04:39.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.357+0000 7fdd4f400640 1 -- 172.21.15.7:0/2553712974 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0ab980 con 0x7fdd50153600 2024-09-13T15:04:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.357+0000 7fdd57c00640 1 -- 172.21.15.7:0/2553712974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd50153600 msgr2=0x7fdd500c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.357+0000 7fdd57c00640 1 --2- 172.21.15.7:0/2553712974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd50153600 0x7fdd500c8020 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0097c0 tx=0x7fdd3c01c4a0 comp rx=0 tx=0).stop 2024-09-13T15:04:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.357+0000 7fdd57c00640 1 -- 172.21.15.7:0/2553712974 shutdown_connections 2024-09-13T15:04:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.357+0000 7fdd57c00640 1 --2- 172.21.15.7:0/2553712974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd50153600 0x7fdd500c8020 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.357+0000 7fdd57c00640 1 -- 172.21.15.7:0/2553712974 >> 172.21.15.7:0/2553712974 conn(0x7fdd500717a0 msgr2=0x7fdd50071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.357+0000 7fdd57c00640 1 -- 172.21.15.7:0/2553712974 shutdown_connections 2024-09-13T15:04:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.357+0000 7fdd57c00640 1 -- 172.21.15.7:0/2553712974 wait complete. 2024-09-13T15:04:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.357+0000 7fdd57c00640 1 Processor -- start 2024-09-13T15:04:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd57c00640 1 -- start start 2024-09-13T15:04:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd57c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd500ccd40 0x7fdd50144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd57c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd500cd120 0x7fdd50141780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd57c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd50153600 0x7fdd50143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd57c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5014ff10 con 0x7fdd500cd120 2024-09-13T15:04:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd57c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd501503d0 con 0x7fdd500ccd40 2024-09-13T15:04:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd57c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500c4680 con 0x7fdd50153600 2024-09-13T15:04:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd500cd120 0x7fdd50141780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd500cd120 0x7fdd50141780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35962/0 (socket says 172.21.15.7:35962) 2024-09-13T15:04:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd4fe00640 1 -- 172.21.15.7:0/3104493949 learned_addr learned my addr 172.21.15.7:0/3104493949 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd55200640 1 --2- 172.21.15.7:0/3104493949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd500ccd40 0x7fdd50144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd55c00640 1 --2- 172.21.15.7:0/3104493949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd50153600 0x7fdd50143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd4fe00640 1 -- 172.21.15.7:0/3104493949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd50153600 msgr2=0x7fdd50143820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd4fe00640 1 --2- 172.21.15.7:0/3104493949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd50153600 0x7fdd50143820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd4fe00640 1 -- 172.21.15.7:0/3104493949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd500ccd40 msgr2=0x7fdd50144f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd4fe00640 1 --2- 172.21.15.7:0/3104493949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd500ccd40 0x7fdd50144f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd4fe00640 1 -- 172.21.15.7:0/3104493949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3c009420 con 0x7fdd500cd120 2024-09-13T15:04:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd55c00640 1 --2- 172.21.15.7:0/3104493949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd50153600 0x7fdd50143820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:04:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd4fe00640 1 --2- 172.21.15.7:0/3104493949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd500cd120 0x7fdd50141780 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0ae040 tx=0x7fdd3c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd4cc00640 1 -- 172.21.15.7:0/3104493949 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0b4900 con 0x7fdd500cd120 2024-09-13T15:04:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd4cc00640 1 -- 172.21.15.7:0/3104493949 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c0b4a80 con 0x7fdd500cd120 2024-09-13T15:04:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd4cc00640 1 -- 172.21.15.7:0/3104493949 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0b4e30 con 0x7fdd500cd120 2024-09-13T15:04:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd57c00640 1 -- 172.21.15.7:0/3104493949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd501454c0 con 0x7fdd500cd120 2024-09-13T15:04:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.361+0000 7fdd57c00640 1 -- 172.21.15.7:0/3104493949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd500c4030 con 0x7fdd500cd120 2024-09-13T15:04:39.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd4cc00640 1 -- 172.21.15.7:0/3104493949 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdd3c0b2040 con 0x7fdd500cd120 2024-09-13T15:04:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd4cc00640 1 --2- 172.21.15.7:0/3104493949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdd300666c0 0x7fdd30068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd4cc00640 1 -- 172.21.15.7:0/3104493949 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdd3c11e980 con 0x7fdd500cd120 2024-09-13T15:04:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd5b009000 1 Processor -- start 2024-09-13T15:04:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd55200640 1 --2- 172.21.15.7:0/3104493949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdd300666c0 0x7fdd30068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd5b009000 1 -- start start 2024-09-13T15:04:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd5b009000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722f4330 0x5558722eb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd5b009000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722eb730 0x5558722ebb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd5b009000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722ec050 0x5558722ec430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd5b009000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558721b5e80 con 0x5558722eb730 2024-09-13T15:04:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd5b009000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x555872143af0 con 0x5558722f4330 2024-09-13T15:04:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd5b009000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558721410c0 con 0x5558722ec050 2024-09-13T15:04:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd55200640 1 --2- 172.21.15.7:0/3104493949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdd300666c0 0x7fdd30068b80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdd44005890 tx=0x7fdd44009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722eb730 0x5558722ebb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722eb730 0x5558722ebb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35968/0 (socket says 172.21.15.7:35968) 2024-09-13T15:04:39.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd4fe00640 1 -- 172.21.15.7:0/3898230560 learned_addr learned my addr 172.21.15.7:0/3898230560 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd55200640 1 --2- 172.21.15.7:0/3898230560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722f4330 0x5558722eb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.365+0000 7fdd55c00640 1 --2- 172.21.15.7:0/3898230560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722ec050 0x5558722ec430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd4fe00640 1 -- 172.21.15.7:0/3898230560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722ec050 msgr2=0x5558722ec430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd4fe00640 1 --2- 172.21.15.7:0/3898230560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722ec050 0x5558722ec430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd4fe00640 1 -- 172.21.15.7:0/3898230560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722f4330 msgr2=0x5558722eb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd4fe00640 1 --2- 172.21.15.7:0/3898230560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722f4330 0x5558722eb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd4fe00640 1 -- 172.21.15.7:0/3898230560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555871e38890 con 0x5558722eb730 2024-09-13T15:04:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd4fe00640 1 --2- 172.21.15.7:0/3898230560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722eb730 0x5558722ebb10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c01c760 tx=0x7fdd3c0efc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41db6a4e51052b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd41600640 1 -- 172.21.15.7:0/3898230560 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0f3380 con 0x5558722eb730 2024-09-13T15:04:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd41600640 1 -- 172.21.15.7:0/3898230560 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c0f7940 con 0x5558722eb730 2024-09-13T15:04:39.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd41600640 1 -- 172.21.15.7:0/3898230560 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0bcdc0 con 0x5558722eb730 2024-09-13T15:04:39.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 1 -- 172.21.15.7:0/3898230560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722eb730 msgr2=0x5558722ebb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:39.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 1 --2- 172.21.15.7:0/3898230560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722eb730 0x5558722ebb10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c01c760 tx=0x7fdd3c0efc50 comp rx=0 tx=0).stop 2024-09-13T15:04:39.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 1 -- 172.21.15.7:0/3898230560 shutdown_connections 2024-09-13T15:04:39.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 1 --2- 172.21.15.7:0/3898230560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722ec050 0x5558722ec430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:39.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 1 --2- 172.21.15.7:0/3898230560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722eb730 0x5558722ebb10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:39.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 1 --2- 172.21.15.7:0/3898230560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722f4330 0x5558722eb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:39.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 1 -- 172.21.15.7:0/3898230560 >> 172.21.15.7:0/3898230560 conn(0x55587232d500 msgr2=0x55587232f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:39.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 1 -- 172.21.15.7:0/3898230560 shutdown_connections 2024-09-13T15:04:39.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 1 -- 172.21.15.7:0/3898230560 wait complete. 2024-09-13T15:04:39.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 1 -- start start 2024-09-13T15:04:39.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 1 Processor -- start 2024-09-13T15:04:39.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722eb730 0x555872339910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:39.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722ec050 0x5558722f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:39.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722f4330 0x5558722f3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:39.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55587213c9b0 con 0x5558722eb730 2024-09-13T15:04:39.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558720dbc00 con 0x5558722f4330 2024-09-13T15:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x5558720fa070 con 0x5558722ec050 2024-09-13T15:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd5b009000 10 client.0 _ll_register_callbacks cb 0x5558722d9ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd55200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722eb730 0x555872339910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd55200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722eb730 0x555872339910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35976/0 (socket says 172.21.15.7:35976) 2024-09-13T15:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd55200640 1 -- 172.21.15.7:0/2699179760 learned_addr learned my addr 172.21.15.7:0/2699179760 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd55c00640 1 --2- 172.21.15.7:0/2699179760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722f4330 0x5558722f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd4fe00640 1 --2- 172.21.15.7:0/2699179760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722ec050 0x5558722f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd55200640 1 -- 172.21.15.7:0/2699179760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722ec050 msgr2=0x5558722f2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd55200640 1 --2- 172.21.15.7:0/2699179760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722ec050 0x5558722f2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd55200640 1 -- 172.21.15.7:0/2699179760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722f4330 msgr2=0x5558722f3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd55200640 1 --2- 172.21.15.7:0/2699179760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722f4330 0x5558722f3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.369+0000 7fdd55200640 1 -- 172.21.15.7:0/2699179760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd500c4030 con 0x5558722eb730 2024-09-13T15:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd55200640 1 --2- 172.21.15.7:0/2699179760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722eb730 0x555872339910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdd44005f90 tx=0x7fdd44005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a26915f4b8b472d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd36000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T15:04:39.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd36000640 1 -- 172.21.15.7:0/2699179760 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44007560 con 0x5558722eb730 2024-09-13T15:04:39.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd36000640 1 -- 172.21.15.7:0/2699179760 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdd440076c0 con 0x5558722eb730 2024-09-13T15:04:39.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd5b009000 1 -- 172.21.15.7:0/2699179760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5558720f95f0 con 0x5558722eb730 2024-09-13T15:04:39.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd36000640 1 -- 172.21.15.7:0/2699179760 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd44013420 con 0x5558722eb730 2024-09-13T15:04:39.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd5b009000 10 client.4854 fetch_fsmap learned FSMap version 18 2024-09-13T15:04:39.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd5b009000 1 -- 172.21.15.7:0/2699179760 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x555872101ab0 con 0x5558722eb730 2024-09-13T15:04:39.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd36000640 1 -- 172.21.15.7:0/2699179760 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5558720f95f0 con 0x5558722eb730 2024-09-13T15:04:39.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd36000640 1 -- 172.21.15.7:0/2699179760 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 18) v1 ==== 4260+0+0 (secure 0 0 0) 0x7fdd44020070 con 0x5558722eb730 2024-09-13T15:04:39.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd5b009000 10 client.4854 fetch_fsmap finished waiting for FSMap version 18 2024-09-13T15:04:39.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd5b009000 10 client.4854 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-13T15:04:39.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd5b009000 20 client.4854 populate_metadata read hostname 'smithi007' 2024-09-13T15:04:39.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd5b009000 1 --2- 172.21.15.7:0/2699179760 >> [v2:172.21.15.7:6832/2907495549,v1:172.21.15.7:6833/2907495549] conn(0x5558722f36c0 0x555872337b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:39.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd5b009000 4 client.4854 mds_command: new command op to 4232 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:04:39.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd5b009000 1 -- 172.21.15.7:0/2699179760 --> [v2:172.21.15.7:6832/2907495549,v1:172.21.15.7:6833/2907495549] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555872139790 con 0x5558722f36c0 2024-09-13T15:04:39.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd4fe00640 1 --2- 172.21.15.7:0/2699179760 >> [v2:172.21.15.7:6832/2907495549,v1:172.21.15.7:6833/2907495549] conn(0x5558722f36c0 0x555872337b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:39.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd4fe00640 1 --2- 172.21.15.7:0/2699179760 >> [v2:172.21.15.7:6832/2907495549,v1:172.21.15.7:6833/2907495549] conn(0x5558722f36c0 0x555872337b70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7ed8c98d99cf75d server_cookie=5d9207e946442c93 in_seq=0 out_seq=0 2024-09-13T15:04:39.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:39.373+0000 7fdd36000640 10 client.4854 ms_handle_connect on v2:172.21.15.7:6832/2907495549 2024-09-13T15:04:39.738 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-09-13T15:04:39.737+0000 7ff9aa000640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-13T15:04:41.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.945+0000 7fdd36000640 1 -- 172.21.15.7:0/2699179760 <== mds.4 v2:172.21.15.7:6832/2907495549 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555872139790 con 0x5558722f36c0 2024-09-13T15:04:41.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.945+0000 7fdd36000640 10 client.4854 handle_command_reply: tid=0 2024-09-13T15:04:41.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.945+0000 7fdd5b009000 1 client.4854 shutdown 2024-09-13T15:04:41.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.949+0000 7fdd5b009000 1 -- 172.21.15.7:0/2699179760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722eb730 msgr2=0x555872339910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:41.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.949+0000 7fdd5b009000 1 --2- 172.21.15.7:0/2699179760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722eb730 0x555872339910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdd44005f90 tx=0x7fdd44005800 comp rx=0 tx=0).stop 2024-09-13T15:04:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.949+0000 7fdd5b009000 1 -- 172.21.15.7:0/2699179760 shutdown_connections 2024-09-13T15:04:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.949+0000 7fdd5b009000 1 --2- 172.21.15.7:0/2699179760 >> [v2:172.21.15.7:6832/2907495549,v1:172.21.15.7:6833/2907495549] conn(0x5558722f36c0 0x555872337b70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.949+0000 7fdd5b009000 1 --2- 172.21.15.7:0/2699179760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722f4330 0x5558722f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.949+0000 7fdd5b009000 1 --2- 172.21.15.7:0/2699179760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722ec050 0x5558722f2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.949+0000 7fdd5b009000 1 --2- 172.21.15.7:0/2699179760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722eb730 0x555872339910 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.949+0000 7fdd5b009000 1 -- 172.21.15.7:0/2699179760 >> 172.21.15.7:0/2699179760 conn(0x55587232d500 msgr2=0x55587232f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.949+0000 7fdd36000640 0 client.4854 ms_handle_reset on v2:172.21.15.7:6832/2907495549 2024-09-13T15:04:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.949+0000 7fdd5b009000 1 -- 172.21.15.7:0/2699179760 shutdown_connections 2024-09-13T15:04:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.949+0000 7fdd5b009000 1 -- 172.21.15.7:0/2699179760 wait complete. 2024-09-13T15:04:41.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.949+0000 7fdd5b009000 20 client.4854 trim_cache size 0 max 16384 2024-09-13T15:04:41.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd5b009000 1 Processor -- start 2024-09-13T15:04:41.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd5b009000 1 -- start start 2024-09-13T15:04:41.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd5b009000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722eb730 0x55587238e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:41.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd5b009000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722ec050 0x55587238ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:41.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd5b009000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722f4330 0x55587238f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:41.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd5b009000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x555871df9940 con 0x5558722ec050 2024-09-13T15:04:41.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd5b009000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x555872139db0 con 0x5558722f4330 2024-09-13T15:04:41.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd5b009000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x55587213a1c0 con 0x5558722eb730 2024-09-13T15:04:41.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722ec050 0x55587238ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:41.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722ec050 0x55587238ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35992/0 (socket says 172.21.15.7:35992) 2024-09-13T15:04:41.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd4fe00640 1 -- 172.21.15.7:0/3567097560 learned_addr learned my addr 172.21.15.7:0/3567097560 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:41.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd55200640 1 --2- 172.21.15.7:0/3567097560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722eb730 0x55587238e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:41.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd55c00640 1 --2- 172.21.15.7:0/3567097560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722f4330 0x55587238f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:41.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd4fe00640 1 -- 172.21.15.7:0/3567097560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722eb730 msgr2=0x55587238e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:41.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd4fe00640 1 --2- 172.21.15.7:0/3567097560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722eb730 0x55587238e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd4fe00640 1 -- 172.21.15.7:0/3567097560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722f4330 msgr2=0x55587238f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:41.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd4fe00640 1 --2- 172.21.15.7:0/3567097560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722f4330 0x55587238f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd4fe00640 1 -- 172.21.15.7:0/3567097560 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558720e7c00 con 0x5558722ec050 2024-09-13T15:04:41.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd55200640 1 --2- 172.21.15.7:0/3567097560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722eb730 0x55587238e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:41.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.965+0000 7fdd55c00640 1 --2- 172.21.15.7:0/3567097560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722f4330 0x55587238f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:41.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd4fe00640 1 --2- 172.21.15.7:0/3567097560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722ec050 0x55587238ebc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c01ca10 tx=0x7fdd3c11e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a284f28105dfc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:41.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd42000640 1 -- 172.21.15.7:0/3567097560 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0f3400 con 0x5558722ec050 2024-09-13T15:04:41.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd42000640 1 -- 172.21.15.7:0/3567097560 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c009110 con 0x5558722ec050 2024-09-13T15:04:41.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd42000640 1 -- 172.21.15.7:0/3567097560 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0f7940 con 0x5558722ec050 2024-09-13T15:04:41.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 1 -- 172.21.15.7:0/3567097560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722ec050 msgr2=0x55587238ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:41.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 1 --2- 172.21.15.7:0/3567097560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722ec050 0x55587238ebc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c01ca10 tx=0x7fdd3c11e050 comp rx=0 tx=0).stop 2024-09-13T15:04:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 1 -- 172.21.15.7:0/3567097560 shutdown_connections 2024-09-13T15:04:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 1 --2- 172.21.15.7:0/3567097560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722f4330 0x55587238f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 1 --2- 172.21.15.7:0/3567097560 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722ec050 0x55587238ebc0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 1 --2- 172.21.15.7:0/3567097560 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722eb730 0x55587238e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 1 -- 172.21.15.7:0/3567097560 >> 172.21.15.7:0/3567097560 conn(0x55587232d500 msgr2=0x5558722f2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 1 -- 172.21.15.7:0/3567097560 shutdown_connections 2024-09-13T15:04:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 1 -- 172.21.15.7:0/3567097560 wait complete. 2024-09-13T15:04:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 1 -- start start 2024-09-13T15:04:41.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 1 Processor -- start 2024-09-13T15:04:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722eb730 0x55587238db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722ec050 0x55587233f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722f4330 0x55587233fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55587213b840 con 0x5558722ec050 2024-09-13T15:04:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558720f5f80 con 0x5558722eb730 2024-09-13T15:04:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x55587217f5f0 con 0x5558722f4330 2024-09-13T15:04:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd5b009000 10 client.0 _ll_register_callbacks cb 0x5558722b9e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:04:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722ec050 0x55587233f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd55200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722eb730 0x55587238db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd4fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722ec050 0x55587233f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36006/0 (socket says 172.21.15.7:36006) 2024-09-13T15:04:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd4fe00640 1 -- 172.21.15.7:0/3893942614 learned_addr learned my addr 172.21.15.7:0/3893942614 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:41.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.969+0000 7fdd55c00640 1 --2- 172.21.15.7:0/3893942614 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722f4330 0x55587233fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:41.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd4fe00640 1 -- 172.21.15.7:0/3893942614 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722f4330 msgr2=0x55587233fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:41.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd4fe00640 1 --2- 172.21.15.7:0/3893942614 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722f4330 0x55587233fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd4fe00640 1 -- 172.21.15.7:0/3893942614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722eb730 msgr2=0x55587238db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:41.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd4fe00640 1 --2- 172.21.15.7:0/3893942614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722eb730 0x55587238db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd4fe00640 1 -- 172.21.15.7:0/3893942614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd3c10ca90 con 0x5558722ec050 2024-09-13T15:04:41.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd4fe00640 1 --2- 172.21.15.7:0/3893942614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722ec050 0x55587233f870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c01c760 tx=0x7fdd3c01c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0db923ffb75f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:41.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd36000640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T15:04:41.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd36000640 1 -- 172.21.15.7:0/3893942614 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c0f7940 con 0x5558722ec050 2024-09-13T15:04:41.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd36000640 1 -- 172.21.15.7:0/3893942614 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdd3c0bcdc0 con 0x5558722ec050 2024-09-13T15:04:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 1 -- 172.21.15.7:0/3893942614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55587210c460 con 0x5558722ec050 2024-09-13T15:04:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd36000640 1 -- 172.21.15.7:0/3893942614 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd3c0ed8f0 con 0x5558722ec050 2024-09-13T15:04:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 10 client.4860 fetch_fsmap learned FSMap version 18 2024-09-13T15:04:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 1 -- 172.21.15.7:0/3893942614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x555871e38cc0 con 0x5558722ec050 2024-09-13T15:04:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd36000640 1 -- 172.21.15.7:0/3893942614 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c112020 con 0x5558722ec050 2024-09-13T15:04:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd36000640 1 -- 172.21.15.7:0/3893942614 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 18) v1 ==== 4260+0+0 (secure 0 0 0) 0x7fdd3c0ebc60 con 0x5558722ec050 2024-09-13T15:04:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 10 client.4860 fetch_fsmap finished waiting for FSMap version 18 2024-09-13T15:04:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 10 client.4860 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-13T15:04:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 20 client.4860 populate_metadata read hostname 'smithi007' 2024-09-13T15:04:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 1 --2- 172.21.15.7:0/3893942614 >> [v2:172.21.15.7:6832/2907495549,v1:172.21.15.7:6833/2907495549] conn(0x55587233e470 0x55587233e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 4 client.4860 mds_command: new command op to 4232 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:04:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 1 -- 172.21.15.7:0/3893942614 --> [v2:172.21.15.7:6832/2907495549,v1:172.21.15.7:6833/2907495549] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5558721059c0 con 0x55587233e470 2024-09-13T15:04:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd55200640 1 --2- 172.21.15.7:0/3893942614 >> [v2:172.21.15.7:6832/2907495549,v1:172.21.15.7:6833/2907495549] conn(0x55587233e470 0x55587233e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:41.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd55200640 1 --2- 172.21.15.7:0/3893942614 >> [v2:172.21.15.7:6832/2907495549,v1:172.21.15.7:6833/2907495549] conn(0x55587233e470 0x55587233e850 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2bf4dedd82d474ea server_cookie=6e273baf6ae3c877 in_seq=0 out_seq=0 2024-09-13T15:04:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd36000640 10 client.4860 ms_handle_connect on v2:172.21.15.7:6832/2907495549 2024-09-13T15:04:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd36000640 1 -- 172.21.15.7:0/3893942614 <== mds.4 v2:172.21.15.7:6832/2907495549 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5558721059c0 con 0x55587233e470 2024-09-13T15:04:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd36000640 10 client.4860 handle_command_reply: tid=0 2024-09-13T15:04:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 1 client.4860 shutdown 2024-09-13T15:04:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 1 -- 172.21.15.7:0/3893942614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722ec050 msgr2=0x55587233f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 1 --2- 172.21.15.7:0/3893942614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722ec050 0x55587233f870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c01c760 tx=0x7fdd3c01c6f0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 1 -- 172.21.15.7:0/3893942614 shutdown_connections 2024-09-13T15:04:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 1 --2- 172.21.15.7:0/3893942614 >> [v2:172.21.15.7:6832/2907495549,v1:172.21.15.7:6833/2907495549] conn(0x55587233e470 0x55587233e850 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 1 --2- 172.21.15.7:0/3893942614 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x5558722f4330 0x55587233fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 1 --2- 172.21.15.7:0/3893942614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5558722ec050 0x55587233f870 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 1 --2- 172.21.15.7:0/3893942614 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5558722eb730 0x55587238db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 1 -- 172.21.15.7:0/3893942614 >> 172.21.15.7:0/3893942614 conn(0x55587232d500 msgr2=0x5558722f2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:41.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd36000640 0 client.4860 ms_handle_reset on v2:172.21.15.7:6832/2907495549 2024-09-13T15:04:41.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 1 -- 172.21.15.7:0/3893942614 shutdown_connections 2024-09-13T15:04:41.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.973+0000 7fdd5b009000 1 -- 172.21.15.7:0/3893942614 wait complete. 2024-09-13T15:04:41.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.977+0000 7fdd5b009000 20 client.4860 trim_cache size 0 max 16384 2024-09-13T15:04:41.982 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T15:04:41.982 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "92e6844f-41e8-44ce-a6e6-13b9cf520744", 2024-09-13T15:04:41.982 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 4, 2024-09-13T15:04:41.982 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4232, 2024-09-13T15:04:41.982 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-13T15:04:41.982 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-13T15:04:41.982 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-13T15:04:41.983 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 11.056040498, 2024-09-13T15:04:41.983 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 18, 2024-09-13T15:04:41.983 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 27, 2024-09-13T15:04:41.983 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 27, 2024-09-13T15:04:41.983 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 183.24753633399999 2024-09-13T15:04:41.983 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T15:04:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.977+0000 7fdd57c00640 1 -- 172.21.15.7:0/3104493949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdd300666c0 msgr2=0x7fdd30068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.977+0000 7fdd57c00640 1 --2- 172.21.15.7:0/3104493949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdd300666c0 0x7fdd30068b80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdd44005890 tx=0x7fdd44009040 comp rx=0 tx=0).stop 2024-09-13T15:04:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.977+0000 7fdd57c00640 1 -- 172.21.15.7:0/3104493949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd500cd120 msgr2=0x7fdd50141780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.977+0000 7fdd57c00640 1 --2- 172.21.15.7:0/3104493949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd500cd120 0x7fdd50141780 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0ae040 tx=0x7fdd3c019240 comp rx=0 tx=0).stop 2024-09-13T15:04:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.977+0000 7fdd57c00640 1 -- 172.21.15.7:0/3104493949 shutdown_connections 2024-09-13T15:04:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.977+0000 7fdd57c00640 1 --2- 172.21.15.7:0/3104493949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdd300666c0 0x7fdd30068b80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.977+0000 7fdd57c00640 1 --2- 172.21.15.7:0/3104493949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdd50153600 0x7fdd50143820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.977+0000 7fdd57c00640 1 --2- 172.21.15.7:0/3104493949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd500cd120 0x7fdd50141780 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.977+0000 7fdd57c00640 1 --2- 172.21.15.7:0/3104493949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd500ccd40 0x7fdd50144f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.977+0000 7fdd57c00640 1 -- 172.21.15.7:0/3104493949 >> 172.21.15.7:0/3104493949 conn(0x7fdd500717a0 msgr2=0x7fdd501424c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.977+0000 7fdd57c00640 1 -- 172.21.15.7:0/3104493949 shutdown_connections 2024-09-13T15:04:41.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:41.977+0000 7fdd57c00640 1 -- 172.21.15.7:0/3104493949 wait complete. 2024-09-13T15:04:42.002 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T15:04:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.149+0000 7f7c7da00640 1 Processor -- start 2024-09-13T15:04:42.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.149+0000 7f7c7da00640 1 -- start start 2024-09-13T15:04:42.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.149+0000 7f7c7da00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c78151590 0x7f7c78157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.149+0000 7f7c7da00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7c780c6130 0x7f7c780717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.149+0000 7f7c7da00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c780c6580 con 0x7f7c780c7ea0 2024-09-13T15:04:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.149+0000 7f7c7da00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c78151970 con 0x7f7c780c6130 2024-09-13T15:04:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.149+0000 7f7c7da00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7815b030 con 0x7f7c78151590 2024-09-13T15:04:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.149+0000 7f7c77400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7c780c6130 0x7f7c780717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.149+0000 7f7c76000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7c780c7ea0 0x7f7c7815a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:32892/0 (socket says 172.21.15.7:32892) 2024-09-13T15:04:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.149+0000 7f7c76000640 1 -- 172.21.15.7:0/3720719829 learned_addr learned my addr 172.21.15.7:0/3720719829 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.149+0000 7f7c76a00640 1 --2- 172.21.15.7:0/3720719829 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c78151590 0x7f7c78157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.149+0000 7f7c77400640 1 -- 172.21.15.7:0/3720719829 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c78151590 msgr2=0x7f7c78157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.149+0000 7f7c77400640 1 --2- 172.21.15.7:0/3720719829 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c78151590 0x7f7c78157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.149+0000 7f7c77400640 1 -- 172.21.15.7:0/3720719829 >> v1:172.21.15.7:6789/0 conn(0x7f7c780c7ea0 legacy=0x7f7c7815a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.149+0000 7f7c75600640 1 -- 172.21.15.7:0/3720719829 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919695693 0 0) 0x7f7c780c6580 con 0x7f7c780c7ea0 2024-09-13T15:04:42.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.149+0000 7f7c77400640 1 -- 172.21.15.7:0/3720719829 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7815b310 con 0x7f7c780c6130 2024-09-13T15:04:42.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.153+0000 7f7c77400640 1 --2- 172.21.15.7:0/3720719829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c780c6130 0x7f7c780717a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009d90 tx=0x7f7c7001f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e721cd101bb835d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.153+0000 7f7c75600640 1 -- 172.21.15.7:0/3720719829 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c700af600 con 0x7f7c780c6130 2024-09-13T15:04:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.153+0000 7f7c75600640 1 -- 172.21.15.7:0/3720719829 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c700ab050 con 0x7f7c780c6130 2024-09-13T15:04:42.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.153+0000 7f7c75600640 1 -- 172.21.15.7:0/3720719829 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c700af980 con 0x7f7c780c6130 2024-09-13T15:04:42.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.153+0000 7f7c7da00640 1 -- 172.21.15.7:0/3720719829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c780c6130 msgr2=0x7f7c780717a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.153+0000 7f7c7da00640 1 --2- 172.21.15.7:0/3720719829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c780c6130 0x7f7c780717a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009d90 tx=0x7f7c7001f150 comp rx=0 tx=0).stop 2024-09-13T15:04:42.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.153+0000 7f7c7da00640 1 -- 172.21.15.7:0/3720719829 shutdown_connections 2024-09-13T15:04:42.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.153+0000 7f7c7da00640 1 --2- 172.21.15.7:0/3720719829 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c780c6130 0x7f7c780717a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.153+0000 7f7c7da00640 1 --2- 172.21.15.7:0/3720719829 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c78151590 0x7f7c78157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.153+0000 7f7c7da00640 1 -- 172.21.15.7:0/3720719829 >> 172.21.15.7:0/3720719829 conn(0x7f7c780c7380 msgr2=0x7f7c780c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.153+0000 7f7c7da00640 1 -- 172.21.15.7:0/3720719829 shutdown_connections 2024-09-13T15:04:42.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.153+0000 7f7c7da00640 1 -- 172.21.15.7:0/3720719829 wait complete. 2024-09-13T15:04:42.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.153+0000 7f7c7da00640 1 Processor -- start 2024-09-13T15:04:42.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.153+0000 7f7c7da00640 1 -- start start 2024-09-13T15:04:42.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c7da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c780c6130 0x7f7c781532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c7da00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c780c7ea0 0x7f7c78159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c7da00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c78151590 0x7f7c7815a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c7da00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c781548d0 con 0x7f7c780c6130 2024-09-13T15:04:42.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c7da00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c78153be0 con 0x7f7c78151590 2024-09-13T15:04:42.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c7da00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c780ca000 con 0x7f7c780c7ea0 2024-09-13T15:04:42.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c76a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c780c6130 0x7f7c781532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c76a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c780c6130 0x7f7c781532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36024/0 (socket says 172.21.15.7:36024) 2024-09-13T15:04:42.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c76a00640 1 -- 172.21.15.7:0/3506713490 learned_addr learned my addr 172.21.15.7:0/3506713490 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c76000640 1 --2- 172.21.15.7:0/3506713490 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c780c7ea0 0x7f7c78159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c77400640 1 --2- 172.21.15.7:0/3506713490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c78151590 0x7f7c7815a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c76a00640 1 -- 172.21.15.7:0/3506713490 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c780c7ea0 msgr2=0x7f7c78159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c76a00640 1 --2- 172.21.15.7:0/3506713490 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c780c7ea0 0x7f7c78159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c76a00640 1 -- 172.21.15.7:0/3506713490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c78151590 msgr2=0x7f7c7815a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c76a00640 1 --2- 172.21.15.7:0/3506713490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c78151590 0x7f7c7815a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c76a00640 1 -- 172.21.15.7:0/3506713490 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c70009a70 con 0x7f7c780c6130 2024-09-13T15:04:42.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c76a00640 1 --2- 172.21.15.7:0/3506713490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c780c6130 0x7f7c781532b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800e870 tx=0x7f7c6800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c6ea00640 1 -- 172.21.15.7:0/3506713490 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68009510 con 0x7f7c780c6130 2024-09-13T15:04:42.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c6ea00640 1 -- 172.21.15.7:0/3506713490 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6800eec0 con 0x7f7c780c6130 2024-09-13T15:04:42.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c7da00640 1 -- 172.21.15.7:0/3506713490 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c781537f0 con 0x7f7c780c6130 2024-09-13T15:04:42.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c6ea00640 1 -- 172.21.15.7:0/3506713490 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800cae0 con 0x7f7c780c6130 2024-09-13T15:04:42.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.157+0000 7f7c7da00640 1 -- 172.21.15.7:0/3506713490 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c78159390 con 0x7f7c780c6130 2024-09-13T15:04:42.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c6ea00640 1 -- 172.21.15.7:0/3506713490 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c6800cc40 con 0x7f7c780c6130 2024-09-13T15:04:42.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c6ea00640 1 --2- 172.21.15.7:0/3506713490 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c58066690 0x7f7c58068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c6ea00640 1 -- 172.21.15.7:0/3506713490 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7c680845d0 con 0x7f7c780c6130 2024-09-13T15:04:42.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c80d94000 1 Processor -- start 2024-09-13T15:04:42.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c80d94000 1 -- start start 2024-09-13T15:04:42.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c76000640 1 --2- 172.21.15.7:0/3506713490 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c58066690 0x7f7c58068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c80d94000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e6950c330 0x558e695031f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c76000640 1 --2- 172.21.15.7:0/3506713490 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c58066690 0x7f7c58068b50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7c780c4450 tx=0x7f7c64007c10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c80d94000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69503730 0x558e69503b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c80d94000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e69504050 0x558e69504430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c80d94000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e693cde80 con 0x558e69503730 2024-09-13T15:04:42.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c80d94000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e6935baf0 con 0x558e69504050 2024-09-13T15:04:42.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c80d94000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e693590c0 con 0x558e6950c330 2024-09-13T15:04:42.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c76000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69503730 0x558e69503b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c76000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69503730 0x558e69503b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36032/0 (socket says 172.21.15.7:36032) 2024-09-13T15:04:42.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c76000640 1 -- 172.21.15.7:0/2101976805 learned_addr learned my addr 172.21.15.7:0/2101976805 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c76a00640 1 --2- 172.21.15.7:0/2101976805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e6950c330 0x558e695031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c77400640 1 --2- 172.21.15.7:0/2101976805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e69504050 0x558e69504430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c76000640 1 -- 172.21.15.7:0/2101976805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e6950c330 msgr2=0x558e695031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c76000640 1 --2- 172.21.15.7:0/2101976805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e6950c330 0x558e695031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c76000640 1 -- 172.21.15.7:0/2101976805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e69504050 msgr2=0x558e69504430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c76000640 1 --2- 172.21.15.7:0/2101976805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e69504050 0x558e69504430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.161+0000 7f7c76000640 1 -- 172.21.15.7:0/2101976805 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e69050890 con 0x558e69503730 2024-09-13T15:04:42.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c76000640 1 --2- 172.21.15.7:0/2101976805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69503730 0x558e69503b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7c64005dd0 tx=0x7f7c64012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efde1b23fe1b0c96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c63400640 1 -- 172.21.15.7:0/2101976805 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64015110 con 0x558e69503730 2024-09-13T15:04:42.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c63400640 1 -- 172.21.15.7:0/2101976805 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c64015270 con 0x558e69503730 2024-09-13T15:04:42.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c63400640 1 -- 172.21.15.7:0/2101976805 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64015bc0 con 0x558e69503730 2024-09-13T15:04:42.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 1 -- 172.21.15.7:0/2101976805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69503730 msgr2=0x558e69503b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 1 --2- 172.21.15.7:0/2101976805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69503730 0x558e69503b10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7c64005dd0 tx=0x7f7c64012000 comp rx=0 tx=0).stop 2024-09-13T15:04:42.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 1 -- 172.21.15.7:0/2101976805 shutdown_connections 2024-09-13T15:04:42.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 1 --2- 172.21.15.7:0/2101976805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e69504050 0x558e69504430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 1 --2- 172.21.15.7:0/2101976805 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69503730 0x558e69503b10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 1 --2- 172.21.15.7:0/2101976805 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e6950c330 0x558e695031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 1 -- 172.21.15.7:0/2101976805 >> 172.21.15.7:0/2101976805 conn(0x558e69545500 msgr2=0x558e695478f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 1 -- 172.21.15.7:0/2101976805 shutdown_connections 2024-09-13T15:04:42.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 1 -- 172.21.15.7:0/2101976805 wait complete. 2024-09-13T15:04:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 1 -- start start 2024-09-13T15:04:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 1 Processor -- start 2024-09-13T15:04:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e69503730 0x558e69544950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69504050 0x558e69544e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e6950c330 0x558e6950ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e693549b0 con 0x558e69504050 2024-09-13T15:04:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e692f3c00 con 0x558e6950c330 2024-09-13T15:04:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e69312070 con 0x558e69503730 2024-09-13T15:04:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c80d94000 10 client.0 _ll_register_callbacks cb 0x558e694f1ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:04:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c76000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69504050 0x558e69544e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c76000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69504050 0x558e69544e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36034/0 (socket says 172.21.15.7:36034) 2024-09-13T15:04:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c76000640 1 -- 172.21.15.7:0/3248711913 learned_addr learned my addr 172.21.15.7:0/3248711913 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c76a00640 1 --2- 172.21.15.7:0/3248711913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e69503730 0x558e69544950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c77400640 1 --2- 172.21.15.7:0/3248711913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e6950c330 0x558e6950ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c76000640 1 -- 172.21.15.7:0/3248711913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e69503730 msgr2=0x558e69544950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c76000640 1 --2- 172.21.15.7:0/3248711913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e69503730 0x558e69544950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c76000640 1 -- 172.21.15.7:0/3248711913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e6950c330 msgr2=0x558e6950ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c76000640 1 --2- 172.21.15.7:0/3248711913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e6950c330 0x558e6950ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.165+0000 7f7c76000640 1 -- 172.21.15.7:0/3248711913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6400f040 con 0x558e69504050 2024-09-13T15:04:42.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c76000640 1 --2- 172.21.15.7:0/3248711913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69504050 0x558e69544e90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7c64007270 tx=0x7f7c64011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a24fdc09c8c9044 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c57e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T15:04:42.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c57e00640 1 -- 172.21.15.7:0/3248711913 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64028040 con 0x558e69504050 2024-09-13T15:04:42.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 1 -- 172.21.15.7:0/3248711913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e693115f0 con 0x558e69504050 2024-09-13T15:04:42.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c57e00640 1 -- 172.21.15.7:0/3248711913 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7c64015c90 con 0x558e69504050 2024-09-13T15:04:42.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c57e00640 1 -- 172.21.15.7:0/3248711913 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c64015e50 con 0x558e69504050 2024-09-13T15:04:42.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 10 client.4875 fetch_fsmap learned FSMap version 18 2024-09-13T15:04:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 1 -- 172.21.15.7:0/3248711913 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x558e69319ab0 con 0x558e69504050 2024-09-13T15:04:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c57e00640 1 -- 172.21.15.7:0/3248711913 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e693115f0 con 0x558e69504050 2024-09-13T15:04:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c57e00640 1 -- 172.21.15.7:0/3248711913 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 18) v1 ==== 4260+0+0 (secure 0 0 0) 0x7f7c6402e470 con 0x558e69504050 2024-09-13T15:04:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 10 client.4875 fetch_fsmap finished waiting for FSMap version 18 2024-09-13T15:04:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 10 client.4875 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T15:04:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 20 client.4875 populate_metadata read hostname 'smithi007' 2024-09-13T15:04:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 1 --2- 172.21.15.7:0/3248711913 >> [v2:172.21.15.7:6835/3369648543,v1:172.21.15.7:6837/3369648543] conn(0x558e69543ab0 0x558e69543e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 4 client.4875 mds_command: new command op to 4238 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:04:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 1 -- 172.21.15.7:0/3248711913 --> [v2:172.21.15.7:6835/3369648543,v1:172.21.15.7:6837/3369648543] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e69351790 con 0x558e69543ab0 2024-09-13T15:04:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c76a00640 1 --2- 172.21.15.7:0/3248711913 >> [v2:172.21.15.7:6835/3369648543,v1:172.21.15.7:6837/3369648543] conn(0x558e69543ab0 0x558e69543e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c76a00640 1 --2- 172.21.15.7:0/3248711913 >> [v2:172.21.15.7:6835/3369648543,v1:172.21.15.7:6837/3369648543] conn(0x558e69543ab0 0x558e69543e90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cba42d56e0ac0186 server_cookie=1fba0f96e1c328d8 in_seq=0 out_seq=0 2024-09-13T15:04:42.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c57e00640 10 client.4875 ms_handle_connect on v2:172.21.15.7:6835/3369648543 2024-09-13T15:04:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c57e00640 1 -- 172.21.15.7:0/3248711913 <== mds.3 v2:172.21.15.7:6835/3369648543 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558e69351790 con 0x558e69543ab0 2024-09-13T15:04:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c57e00640 10 client.4875 handle_command_reply: tid=0 2024-09-13T15:04:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 1 client.4875 shutdown 2024-09-13T15:04:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 1 -- 172.21.15.7:0/3248711913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69504050 msgr2=0x558e69544e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 1 --2- 172.21.15.7:0/3248711913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69504050 0x558e69544e90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7c64007270 tx=0x7f7c64011000 comp rx=0 tx=0).stop 2024-09-13T15:04:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 1 -- 172.21.15.7:0/3248711913 shutdown_connections 2024-09-13T15:04:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 1 --2- 172.21.15.7:0/3248711913 >> [v2:172.21.15.7:6835/3369648543,v1:172.21.15.7:6837/3369648543] conn(0x558e69543ab0 0x558e69543e90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 1 --2- 172.21.15.7:0/3248711913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e6950c330 0x558e6950ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 1 --2- 172.21.15.7:0/3248711913 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69504050 0x558e69544e90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c57e00640 0 client.4875 ms_handle_reset on v2:172.21.15.7:6835/3369648543 2024-09-13T15:04:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 1 --2- 172.21.15.7:0/3248711913 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e69503730 0x558e69544950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 1 -- 172.21.15.7:0/3248711913 >> 172.21.15.7:0/3248711913 conn(0x558e69545500 msgr2=0x558e695478f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 1 -- 172.21.15.7:0/3248711913 shutdown_connections 2024-09-13T15:04:42.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 1 -- 172.21.15.7:0/3248711913 wait complete. 2024-09-13T15:04:42.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.169+0000 7f7c80d94000 20 client.4875 trim_cache size 0 max 16384 2024-09-13T15:04:42.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.185+0000 7f7c80d94000 1 Processor -- start 2024-09-13T15:04:42.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.185+0000 7f7c80d94000 1 -- start start 2024-09-13T15:04:42.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.185+0000 7f7c80d94000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e69503730 0x558e69565360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.185+0000 7f7c80d94000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69504050 0x558e69550940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.185+0000 7f7c80d94000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e6950c330 0x558e69550e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.185+0000 7f7c80d94000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e69011940 con 0x558e69504050 2024-09-13T15:04:42.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.185+0000 7f7c80d94000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e693494d0 con 0x558e69503730 2024-09-13T15:04:42.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.185+0000 7f7c80d94000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e6955c6e0 con 0x558e6950c330 2024-09-13T15:04:42.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.185+0000 7f7c76000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69504050 0x558e69550940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.185+0000 7f7c76000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69504050 0x558e69550940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36036/0 (socket says 172.21.15.7:36036) 2024-09-13T15:04:42.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.185+0000 7f7c76000640 1 -- 172.21.15.7:0/3021784217 learned_addr learned my addr 172.21.15.7:0/3021784217 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.185+0000 7f7c76a00640 1 --2- 172.21.15.7:0/3021784217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e69503730 0x558e69565360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.185+0000 7f7c77400640 1 --2- 172.21.15.7:0/3021784217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e6950c330 0x558e69550e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76000640 1 -- 172.21.15.7:0/3021784217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e6950c330 msgr2=0x558e69550e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76000640 1 --2- 172.21.15.7:0/3021784217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e6950c330 0x558e69550e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76000640 1 -- 172.21.15.7:0/3021784217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e69503730 msgr2=0x558e69565360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76000640 1 --2- 172.21.15.7:0/3021784217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e69503730 0x558e69565360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76000640 1 -- 172.21.15.7:0/3021784217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e692ffc00 con 0x558e69504050 2024-09-13T15:04:42.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76a00640 1 --2- 172.21.15.7:0/3021784217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e69503730 0x558e69565360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:42.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76000640 1 --2- 172.21.15.7:0/3021784217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69504050 0x558e69550940 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7c64007120 tx=0x7f7c64017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cace14fd1452e8a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c63e00640 1 -- 172.21.15.7:0/3021784217 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64028040 con 0x558e69504050 2024-09-13T15:04:42.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c63e00640 1 -- 172.21.15.7:0/3021784217 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6400b070 con 0x558e69504050 2024-09-13T15:04:42.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c63e00640 1 -- 172.21.15.7:0/3021784217 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c640150d0 con 0x558e69504050 2024-09-13T15:04:42.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 1 -- 172.21.15.7:0/3021784217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69504050 msgr2=0x558e69550940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 1 --2- 172.21.15.7:0/3021784217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69504050 0x558e69550940 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7c64007120 tx=0x7f7c64017070 comp rx=0 tx=0).stop 2024-09-13T15:04:42.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 1 -- 172.21.15.7:0/3021784217 shutdown_connections 2024-09-13T15:04:42.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 1 --2- 172.21.15.7:0/3021784217 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e6950c330 0x558e69550e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 1 --2- 172.21.15.7:0/3021784217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69504050 0x558e69550940 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 1 --2- 172.21.15.7:0/3021784217 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e69503730 0x558e69565360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 1 -- 172.21.15.7:0/3021784217 >> 172.21.15.7:0/3021784217 conn(0x558e69545500 msgr2=0x558e6950a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 1 -- 172.21.15.7:0/3021784217 shutdown_connections 2024-09-13T15:04:42.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 1 -- 172.21.15.7:0/3021784217 wait complete. 2024-09-13T15:04:42.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 1 -- start start 2024-09-13T15:04:42.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 1 Processor -- start 2024-09-13T15:04:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69503730 0x558e695b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e69504050 0x558e695b1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e6950c330 0x558e69563240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e69357510 con 0x558e69503730 2024-09-13T15:04:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e6935cd80 con 0x558e6950c330 2024-09-13T15:04:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e69356fa0 con 0x558e69504050 2024-09-13T15:04:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c80d94000 10 client.0 _ll_register_callbacks cb 0x558e694d1e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:04:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69503730 0x558e695b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69503730 0x558e695b0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36040/0 (socket says 172.21.15.7:36040) 2024-09-13T15:04:42.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76a00640 1 -- 172.21.15.7:0/3866471395 learned_addr learned my addr 172.21.15.7:0/3866471395 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c77400640 1 --2- 172.21.15.7:0/3866471395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e6950c330 0x558e69563240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76000640 1 --2- 172.21.15.7:0/3866471395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e69504050 0x558e695b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76a00640 1 -- 172.21.15.7:0/3866471395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e69504050 msgr2=0x558e695b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76a00640 1 --2- 172.21.15.7:0/3866471395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e69504050 0x558e695b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76a00640 1 -- 172.21.15.7:0/3866471395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e6950c330 msgr2=0x558e69563240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76a00640 1 --2- 172.21.15.7:0/3866471395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e6950c330 0x558e69563240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76a00640 1 -- 172.21.15.7:0/3866471395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e69319ab0 con 0x558e69503730 2024-09-13T15:04:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76000640 1 --2- 172.21.15.7:0/3866471395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e69504050 0x558e695b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:04:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c76a00640 1 --2- 172.21.15.7:0/3866471395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69503730 0x558e695b0b20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7c680827d0 tx=0x7f7c68055120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a2998d2195489d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.189+0000 7f7c57e00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T15:04:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c57e00640 1 -- 172.21.15.7:0/3866471395 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68081040 con 0x558e69503730 2024-09-13T15:04:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c57e00640 1 -- 172.21.15.7:0/3866471395 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7c680519e0 con 0x558e69503730 2024-09-13T15:04:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 1 -- 172.21.15.7:0/3866471395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e69506d20 con 0x558e69503730 2024-09-13T15:04:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c57e00640 1 -- 172.21.15.7:0/3866471395 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c68051ba0 con 0x558e69503730 2024-09-13T15:04:42.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 10 client.4881 fetch_fsmap learned FSMap version 18 2024-09-13T15:04:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 1 -- 172.21.15.7:0/3866471395 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x558e69050cc0 con 0x558e69503730 2024-09-13T15:04:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c57e00640 1 -- 172.21.15.7:0/3866471395 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e69506d20 con 0x558e69503730 2024-09-13T15:04:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c57e00640 1 -- 172.21.15.7:0/3866471395 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 18) v1 ==== 4260+0+0 (secure 0 0 0) 0x7f7c68011070 con 0x558e69503730 2024-09-13T15:04:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 10 client.4881 fetch_fsmap finished waiting for FSMap version 18 2024-09-13T15:04:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 10 client.4881 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T15:04:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 20 client.4881 populate_metadata read hostname 'smithi007' 2024-09-13T15:04:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 1 --2- 172.21.15.7:0/3866471395 >> [v2:172.21.15.7:6835/3369648543,v1:172.21.15.7:6837/3369648543] conn(0x558e69563780 0x558e69563b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 4 client.4881 mds_command: new command op to 4238 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:04:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 1 -- 172.21.15.7:0/3866471395 --> [v2:172.21.15.7:6835/3369648543,v1:172.21.15.7:6837/3369648543] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558e69324460 con 0x558e69563780 2024-09-13T15:04:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c76000640 1 --2- 172.21.15.7:0/3866471395 >> [v2:172.21.15.7:6835/3369648543,v1:172.21.15.7:6837/3369648543] conn(0x558e69563780 0x558e69563b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c57e00640 10 client.4881 ms_handle_connect on v2:172.21.15.7:6835/3369648543 2024-09-13T15:04:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c76000640 1 --2- 172.21.15.7:0/3866471395 >> [v2:172.21.15.7:6835/3369648543,v1:172.21.15.7:6837/3369648543] conn(0x558e69563780 0x558e69563b60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fc78baebc290a154 server_cookie=347693f5d7fe6039 in_seq=0 out_seq=0 2024-09-13T15:04:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c57e00640 1 -- 172.21.15.7:0/3866471395 <== mds.3 v2:172.21.15.7:6835/3369648543 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x558e69324460 con 0x558e69563780 2024-09-13T15:04:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c57e00640 10 client.4881 handle_command_reply: tid=0 2024-09-13T15:04:42.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 1 client.4881 shutdown 2024-09-13T15:04:42.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 1 -- 172.21.15.7:0/3866471395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69503730 msgr2=0x558e695b0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 1 --2- 172.21.15.7:0/3866471395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69503730 0x558e695b0b20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7c680827d0 tx=0x7f7c68055120 comp rx=0 tx=0).stop 2024-09-13T15:04:42.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 1 -- 172.21.15.7:0/3866471395 shutdown_connections 2024-09-13T15:04:42.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 1 --2- 172.21.15.7:0/3866471395 >> [v2:172.21.15.7:6835/3369648543,v1:172.21.15.7:6837/3369648543] conn(0x558e69563780 0x558e69563b60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 1 --2- 172.21.15.7:0/3866471395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558e6950c330 0x558e69563240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 1 --2- 172.21.15.7:0/3866471395 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x558e69504050 0x558e695b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c57e00640 0 client.4881 ms_handle_reset on v2:172.21.15.7:6835/3369648543 2024-09-13T15:04:42.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 1 --2- 172.21.15.7:0/3866471395 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558e69503730 0x558e695b0b20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 1 -- 172.21.15.7:0/3866471395 >> 172.21.15.7:0/3866471395 conn(0x558e69545500 msgr2=0x558e6950a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 1 -- 172.21.15.7:0/3866471395 shutdown_connections 2024-09-13T15:04:42.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 1 -- 172.21.15.7:0/3866471395 wait complete. 2024-09-13T15:04:42.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c80d94000 20 client.4881 trim_cache size 0 max 16384 2024-09-13T15:04:42.201 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T15:04:42.201 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "92e6844f-41e8-44ce-a6e6-13b9cf520744", 2024-09-13T15:04:42.201 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 3, 2024-09-13T15:04:42.201 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4238, 2024-09-13T15:04:42.201 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-13T15:04:42.201 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-13T15:04:42.201 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-13T15:04:42.201 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 17.294332742000002, 2024-09-13T15:04:42.201 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 18, 2024-09-13T15:04:42.201 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 27, 2024-09-13T15:04:42.201 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 27, 2024-09-13T15:04:42.201 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 183.45820864699999 2024-09-13T15:04:42.201 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T15:04:42.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c7da00640 1 -- 172.21.15.7:0/3506713490 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c58066690 msgr2=0x7f7c58068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c7da00640 1 --2- 172.21.15.7:0/3506713490 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c58066690 0x7f7c58068b50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7c780c4450 tx=0x7f7c64007c10 comp rx=0 tx=0).stop 2024-09-13T15:04:42.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c7da00640 1 -- 172.21.15.7:0/3506713490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c780c6130 msgr2=0x7f7c781532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c7da00640 1 --2- 172.21.15.7:0/3506713490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c780c6130 0x7f7c781532b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800e870 tx=0x7f7c6800ec70 comp rx=0 tx=0).stop 2024-09-13T15:04:42.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c7da00640 1 -- 172.21.15.7:0/3506713490 shutdown_connections 2024-09-13T15:04:42.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c7da00640 1 --2- 172.21.15.7:0/3506713490 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c58066690 0x7f7c58068b50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c7da00640 1 --2- 172.21.15.7:0/3506713490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c78151590 0x7f7c7815a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c7da00640 1 --2- 172.21.15.7:0/3506713490 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c780c7ea0 0x7f7c78159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c7da00640 1 --2- 172.21.15.7:0/3506713490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c780c6130 0x7f7c781532b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c7da00640 1 -- 172.21.15.7:0/3506713490 >> 172.21.15.7:0/3506713490 conn(0x7f7c780c7380 msgr2=0x7f7c780c7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c7da00640 1 -- 172.21.15.7:0/3506713490 shutdown_connections 2024-09-13T15:04:42.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.193+0000 7f7c7da00640 1 -- 172.21.15.7:0/3506713490 wait complete. 2024-09-13T15:04:42.216 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T15:04:42.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.357+0000 7fa8a6600640 1 Processor -- start 2024-09-13T15:04:42.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.357+0000 7fa8a6600640 1 -- start start 2024-09-13T15:04:42.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.357+0000 7fa8a6600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa8a0153320 0x7fa8a00663b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.357+0000 7fa8a6600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00c2e10 con 0x7fa8a015c6b0 2024-09-13T15:04:42.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.357+0000 7fa8a6600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a01593d0 con 0x7fa8a00c8a00 2024-09-13T15:04:42.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.357+0000 7fa8a6600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a01596b0 con 0x7fa8a0153320 2024-09-13T15:04:42.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.357+0000 7fa89fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa8a015c6b0 0x7fa8a015cac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:32904/0 (socket says 172.21.15.7:32904) 2024-09-13T15:04:42.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.357+0000 7fa89fe00640 1 -- 172.21.15.7:0/686856213 learned_addr learned my addr 172.21.15.7:0/686856213 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:42.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.357+0000 7fa89f400640 1 --2- 172.21.15.7:0/686856213 >> v2:172.21.15.77:3300/0 conn(0x7fa8a0153320 0x7fa8a00663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.357+0000 7fa89e000640 1 -- 172.21.15.7:0/686856213 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009469445 0 0) 0x7fa8a00c2e10 con 0x7fa8a015c6b0 2024-09-13T15:04:42.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.357+0000 7fa89e000640 1 -- 172.21.15.7:0/686856213 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa884003530 con 0x7fa8a015c6b0 2024-09-13T15:04:42.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.357+0000 7fa89f400640 1 -- 172.21.15.7:0/686856213 >> v1:172.21.15.77:6789/0 conn(0x7fa8a00c8a00 legacy=0x7fa8a00c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.357+0000 7fa89f400640 1 -- 172.21.15.7:0/686856213 >> v1:172.21.15.7:6789/0 conn(0x7fa8a015c6b0 legacy=0x7fa8a015cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.357+0000 7fa89f400640 1 -- 172.21.15.7:0/686856213 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a0159990 con 0x7fa8a0153320 2024-09-13T15:04:42.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.361+0000 7fa89f400640 1 --2- 172.21.15.7:0/686856213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a0153320 0x7fa8a00663b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa8900097c0 tx=0x7fa89001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d911ed72ebc454f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.361+0000 7fa89e000640 1 -- 172.21.15.7:0/686856213 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8900a8990 con 0x7fa8a0153320 2024-09-13T15:04:42.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.361+0000 7fa89e000640 1 -- 172.21.15.7:0/686856213 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8900a8af0 con 0x7fa8a0153320 2024-09-13T15:04:42.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.361+0000 7fa89e000640 1 -- 172.21.15.7:0/686856213 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8900a8e60 con 0x7fa8a0153320 2024-09-13T15:04:42.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.361+0000 7fa8a6600640 1 -- 172.21.15.7:0/686856213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a0153320 msgr2=0x7fa8a00663b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.361+0000 7fa8a6600640 1 --2- 172.21.15.7:0/686856213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a0153320 0x7fa8a00663b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa8900097c0 tx=0x7fa89001ec90 comp rx=0 tx=0).stop 2024-09-13T15:04:42.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.361+0000 7fa8a6600640 1 -- 172.21.15.7:0/686856213 shutdown_connections 2024-09-13T15:04:42.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.361+0000 7fa8a6600640 1 --2- 172.21.15.7:0/686856213 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a0153320 0x7fa8a00663b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.361+0000 7fa8a6600640 1 -- 172.21.15.7:0/686856213 >> 172.21.15.7:0/686856213 conn(0x7fa8a006e1d0 msgr2=0x7fa8a006e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.361+0000 7fa8a6600640 1 -- 172.21.15.7:0/686856213 shutdown_connections 2024-09-13T15:04:42.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.361+0000 7fa8a6600640 1 -- 172.21.15.7:0/686856213 wait complete. 2024-09-13T15:04:42.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa8a6600640 1 Processor -- start 2024-09-13T15:04:42.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa8a6600640 1 -- start start 2024-09-13T15:04:42.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa8a6600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a00c8a00 0x7fa8a00c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa8a6600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8a0153320 0x7fa8a0151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa8a6600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8a015c6b0 0x7fa8a0152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa8a6600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a015b0f0 con 0x7fa8a015c6b0 2024-09-13T15:04:42.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa8a6600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00cc260 con 0x7fa8a00c8a00 2024-09-13T15:04:42.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa8a6600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a0071610 con 0x7fa8a0153320 2024-09-13T15:04:42.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa89fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8a015c6b0 0x7fa8a0152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa89fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8a015c6b0 0x7fa8a0152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36054/0 (socket says 172.21.15.7:36054) 2024-09-13T15:04:42.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa89fe00640 1 -- 172.21.15.7:0/746247911 learned_addr learned my addr 172.21.15.7:0/746247911 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa89f400640 1 --2- 172.21.15.7:0/746247911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a00c8a00 0x7fa8a00c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa89ea00640 1 --2- 172.21.15.7:0/746247911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8a0153320 0x7fa8a0151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa89fe00640 1 -- 172.21.15.7:0/746247911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8a0153320 msgr2=0x7fa8a0151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa89fe00640 1 --2- 172.21.15.7:0/746247911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8a0153320 0x7fa8a0151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa89fe00640 1 -- 172.21.15.7:0/746247911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a00c8a00 msgr2=0x7fa8a00c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa89fe00640 1 --2- 172.21.15.7:0/746247911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a00c8a00 0x7fa8a00c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa89fe00640 1 -- 172.21.15.7:0/746247911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa890009420 con 0x7fa8a015c6b0 2024-09-13T15:04:42.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa89fe00640 1 --2- 172.21.15.7:0/746247911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8a015c6b0 0x7fa8a0152340 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa89800cb40 tx=0x7fa89800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa897400640 1 -- 172.21.15.7:0/746247911 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800ac40 con 0x7fa8a015c6b0 2024-09-13T15:04:42.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa897400640 1 -- 172.21.15.7:0/746247911 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89800ada0 con 0x7fa8a015c6b0 2024-09-13T15:04:42.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa8a6600640 1 -- 172.21.15.7:0/746247911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a015c100 con 0x7fa8a015c6b0 2024-09-13T15:04:42.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa897400640 1 -- 172.21.15.7:0/746247911 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898012620 con 0x7fa8a015c6b0 2024-09-13T15:04:42.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.365+0000 7fa8a6600640 1 -- 172.21.15.7:0/746247911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a00cbca0 con 0x7fa8a015c6b0 2024-09-13T15:04:42.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa897400640 1 -- 172.21.15.7:0/746247911 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa898007070 con 0x7fa8a015c6b0 2024-09-13T15:04:42.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa897400640 1 --2- 172.21.15.7:0/746247911 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa880066690 0x7fa880068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa897400640 1 -- 172.21.15.7:0/746247911 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa8980845c0 con 0x7fa8a015c6b0 2024-09-13T15:04:42.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa8a9b2e000 1 Processor -- start 2024-09-13T15:04:42.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa89f400640 1 --2- 172.21.15.7:0/746247911 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa880066690 0x7fa880068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa8a9b2e000 1 -- start start 2024-09-13T15:04:42.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa8a9b2e000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6501f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa8a9b2e000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c650730 0x55e72c650b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa8a9b2e000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c651050 0x55e72c651430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa8a9b2e000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e72c51ae80 con 0x55e72c659330 2024-09-13T15:04:42.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa8a9b2e000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e72c4a8af0 con 0x55e72c651050 2024-09-13T15:04:42.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa8a9b2e000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e72c4a60c0 con 0x55e72c650730 2024-09-13T15:04:42.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa89f400640 1 --2- 172.21.15.7:0/746247911 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa880066690 0x7fa880068b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa8900b2000 tx=0x7fa8900aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa89f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa89f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36070/0 (socket says 172.21.15.7:36070) 2024-09-13T15:04:42.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa89f400640 1 -- 172.21.15.7:0/4136563074 learned_addr learned my addr 172.21.15.7:0/4136563074 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa89fe00640 1 --2- 172.21.15.7:0/4136563074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c651050 0x55e72c651430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa89ea00640 1 --2- 172.21.15.7:0/4136563074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c650730 0x55e72c650b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa89f400640 1 -- 172.21.15.7:0/4136563074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c650730 msgr2=0x55e72c650b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa89f400640 1 --2- 172.21.15.7:0/4136563074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c650730 0x55e72c650b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa89f400640 1 -- 172.21.15.7:0/4136563074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c651050 msgr2=0x55e72c651430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa89f400640 1 --2- 172.21.15.7:0/4136563074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c651050 0x55e72c651430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.369+0000 7fa89f400640 1 -- 172.21.15.7:0/4136563074 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e72c19d890 con 0x55e72c659330 2024-09-13T15:04:42.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa89f400640 1 --2- 172.21.15.7:0/4136563074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6501f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa890000c10 tx=0x7fa890004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1450c8a8b608d258 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa88be00640 1 -- 172.21.15.7:0/4136563074 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8900039e0 con 0x55e72c659330 2024-09-13T15:04:42.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa88be00640 1 -- 172.21.15.7:0/4136563074 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa890003b40 con 0x55e72c659330 2024-09-13T15:04:42.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa88be00640 1 -- 172.21.15.7:0/4136563074 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa890003eb0 con 0x55e72c659330 2024-09-13T15:04:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/4136563074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 msgr2=0x55e72c6501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/4136563074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6501f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa890000c10 tx=0x7fa890004740 comp rx=0 tx=0).stop 2024-09-13T15:04:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/4136563074 shutdown_connections 2024-09-13T15:04:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/4136563074 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c651050 0x55e72c651430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/4136563074 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c650730 0x55e72c650b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/4136563074 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6501f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/4136563074 >> 172.21.15.7:0/4136563074 conn(0x55e72c692500 msgr2=0x55e72c6948f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/4136563074 shutdown_connections 2024-09-13T15:04:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/4136563074 wait complete. 2024-09-13T15:04:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 1 -- start start 2024-09-13T15:04:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 1 Processor -- start 2024-09-13T15:04:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 0x55e72c69e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c651050 0x55e72c657c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c658150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e72c4a19b0 con 0x55e72c659330 2024-09-13T15:04:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e72c440c00 con 0x55e72c650730 2024-09-13T15:04:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e72c45f070 con 0x55e72c651050 2024-09-13T15:04:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa8a9b2e000 10 client.0 _ll_register_callbacks cb 0x55e72c63eae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:04:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa89fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c658150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa89f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 0x55e72c69e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa89f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 0x55e72c69e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:40174/0 (socket says 172.21.15.7:40174) 2024-09-13T15:04:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa89f400640 1 -- 172.21.15.7:0/569092831 learned_addr learned my addr 172.21.15.7:0/569092831 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa89fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c658150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36076/0 (socket says 172.21.15.7:36076) 2024-09-13T15:04:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa89ea00640 1 --2- 172.21.15.7:0/569092831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c651050 0x55e72c657c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa89fe00640 1 -- 172.21.15.7:0/569092831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c651050 msgr2=0x55e72c657c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa89fe00640 1 --2- 172.21.15.7:0/569092831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c651050 0x55e72c657c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa89fe00640 1 -- 172.21.15.7:0/569092831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 msgr2=0x55e72c69e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa89fe00640 1 --2- 172.21.15.7:0/569092831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 0x55e72c69e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa89fe00640 1 -- 172.21.15.7:0/569092831 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a0159990 con 0x55e72c659330 2024-09-13T15:04:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa89ea00640 1 --2- 172.21.15.7:0/569092831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c651050 0x55e72c657c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa89fe00640 1 --2- 172.21.15.7:0/569092831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c658150 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa89800a560 tx=0x7fa898058ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1476fc274d6d7090 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa888c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T15:04:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.373+0000 7fa888c00640 1 -- 172.21.15.7:0/569092831 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8980822a0 con 0x55e72c659330 2024-09-13T15:04:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa888c00640 1 -- 172.21.15.7:0/569092831 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa89805d0f0 con 0x55e72c659330 2024-09-13T15:04:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/569092831 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e72c45e5f0 con 0x55e72c659330 2024-09-13T15:04:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa888c00640 1 -- 172.21.15.7:0/569092831 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa898082400 con 0x55e72c659330 2024-09-13T15:04:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 10 client.4893 fetch_fsmap learned FSMap version 18 2024-09-13T15:04:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/569092831 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55e72c466ab0 con 0x55e72c659330 2024-09-13T15:04:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa888c00640 1 -- 172.21.15.7:0/569092831 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e72c45e5f0 con 0x55e72c659330 2024-09-13T15:04:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa888c00640 1 -- 172.21.15.7:0/569092831 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 18) v1 ==== 4260+0+0 (secure 0 0 0) 0x7fa898004b70 con 0x55e72c659330 2024-09-13T15:04:42.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 10 client.4893 fetch_fsmap finished waiting for FSMap version 18 2024-09-13T15:04:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 10 client.4893 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T15:04:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 20 client.4893 populate_metadata read hostname 'smithi007' 2024-09-13T15:04:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/569092831 >> [v2:172.21.15.77:6834/2367107997,v1:172.21.15.77:6835/2367107997] conn(0x55e72c69ca60 0x55e72c69ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 4 client.4893 mds_command: new command op to 4252 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:04:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/569092831 --> [v2:172.21.15.77:6834/2367107997,v1:172.21.15.77:6835/2367107997] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e72c49e790 con 0x55e72c69ca60 2024-09-13T15:04:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa89f400640 1 --2- 172.21.15.7:0/569092831 >> [v2:172.21.15.77:6834/2367107997,v1:172.21.15.77:6835/2367107997] conn(0x55e72c69ca60 0x55e72c69ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa89f400640 1 --2- 172.21.15.7:0/569092831 >> [v2:172.21.15.77:6834/2367107997,v1:172.21.15.77:6835/2367107997] conn(0x55e72c69ca60 0x55e72c69ce40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2c68ddd27fd38733 server_cookie=63ee6d46e4d858a0 in_seq=0 out_seq=0 2024-09-13T15:04:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa888c00640 10 client.4893 ms_handle_connect on v2:172.21.15.77:6834/2367107997 2024-09-13T15:04:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa888c00640 1 -- 172.21.15.7:0/569092831 <== mds.2 v2:172.21.15.77:6834/2367107997 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e72c49e790 con 0x55e72c69ca60 2024-09-13T15:04:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa888c00640 10 client.4893 handle_command_reply: tid=0 2024-09-13T15:04:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 1 client.4893 shutdown 2024-09-13T15:04:42.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/569092831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 msgr2=0x55e72c658150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/569092831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c658150 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa89800a560 tx=0x7fa898058ff0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/569092831 shutdown_connections 2024-09-13T15:04:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/569092831 >> [v2:172.21.15.77:6834/2367107997,v1:172.21.15.77:6835/2367107997] conn(0x55e72c69ca60 0x55e72c69ce40 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/569092831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c658150 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/569092831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c651050 0x55e72c657c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa888c00640 0 client.4893 ms_handle_reset on v2:172.21.15.77:6834/2367107997 2024-09-13T15:04:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/569092831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 0x55e72c69e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.377+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/569092831 >> 172.21.15.7:0/569092831 conn(0x55e72c692500 msgr2=0x55e72c6948f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.381+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/569092831 shutdown_connections 2024-09-13T15:04:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.381+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/569092831 wait complete. 2024-09-13T15:04:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.381+0000 7fa8a9b2e000 20 client.4893 trim_cache size 0 max 16384 2024-09-13T15:04:42.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.393+0000 7fa8a9b2e000 1 Processor -- start 2024-09-13T15:04:42.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.393+0000 7fa8a9b2e000 1 -- start start 2024-09-13T15:04:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa8a9b2e000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 0x55e72c6a8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa8a9b2e000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c651050 0x55e72c6a91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa8a9b2e000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6a96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa8a9b2e000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e72c15e940 con 0x55e72c659330 2024-09-13T15:04:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa8a9b2e000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e72c468c60 con 0x55e72c650730 2024-09-13T15:04:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa8a9b2e000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e72c64f7d0 con 0x55e72c651050 2024-09-13T15:04:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa89fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6a96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa89fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6a96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36078/0 (socket says 172.21.15.7:36078) 2024-09-13T15:04:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa89fe00640 1 -- 172.21.15.7:0/1305745993 learned_addr learned my addr 172.21.15.7:0/1305745993 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa89f400640 1 --2- 172.21.15.7:0/1305745993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 0x55e72c6a8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa89ea00640 1 --2- 172.21.15.7:0/1305745993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c651050 0x55e72c6a91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa89fe00640 1 -- 172.21.15.7:0/1305745993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c651050 msgr2=0x55e72c6a91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa89fe00640 1 --2- 172.21.15.7:0/1305745993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c651050 0x55e72c6a91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa89fe00640 1 -- 172.21.15.7:0/1305745993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 msgr2=0x55e72c6a8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa89fe00640 1 --2- 172.21.15.7:0/1305745993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 0x55e72c6a8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa89fe00640 1 -- 172.21.15.7:0/1305745993 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e72c44cc00 con 0x55e72c659330 2024-09-13T15:04:42.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa89f400640 1 --2- 172.21.15.7:0/1305745993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 0x55e72c6a8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:42.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa89fe00640 1 --2- 172.21.15.7:0/1305745993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6a96e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa89805d050 tx=0x7fa89801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1a2ef24f9a164a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa894c00640 1 -- 172.21.15.7:0/1305745993 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898001c30 con 0x55e72c659330 2024-09-13T15:04:42.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa894c00640 1 -- 172.21.15.7:0/1305745993 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa898054b10 con 0x55e72c659330 2024-09-13T15:04:42.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa894c00640 1 -- 172.21.15.7:0/1305745993 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8980532f0 con 0x55e72c659330 2024-09-13T15:04:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/1305745993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 msgr2=0x55e72c6a96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/1305745993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6a96e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa89805d050 tx=0x7fa89801d000 comp rx=0 tx=0).stop 2024-09-13T15:04:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/1305745993 shutdown_connections 2024-09-13T15:04:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/1305745993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6a96e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/1305745993 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c651050 0x55e72c6a91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/1305745993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 0x55e72c6a8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/1305745993 >> 172.21.15.7:0/1305745993 conn(0x55e72c692500 msgr2=0x55e72c69b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/1305745993 shutdown_connections 2024-09-13T15:04:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/1305745993 wait complete. 2024-09-13T15:04:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa8a9b2e000 1 -- start start 2024-09-13T15:04:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.397+0000 7fa8a9b2e000 1 Processor -- start 2024-09-13T15:04:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 0x55e72c6f9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c651050 0x55e72c6ac450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6ac990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e72c49d1a0 con 0x55e72c659330 2024-09-13T15:04:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e72c4e45f0 con 0x55e72c650730 2024-09-13T15:04:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e72c4964d0 con 0x55e72c651050 2024-09-13T15:04:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 10 client.0 _ll_register_callbacks cb 0x55e72c61ee00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:04:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa89fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa89fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6ac990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36086/0 (socket says 172.21.15.7:36086) 2024-09-13T15:04:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa89fe00640 1 -- 172.21.15.7:0/3175747430 learned_addr learned my addr 172.21.15.7:0/3175747430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa89f400640 1 --2- 172.21.15.7:0/3175747430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 0x55e72c6f9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa89ea00640 1 --2- 172.21.15.7:0/3175747430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c651050 0x55e72c6ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa89fe00640 1 -- 172.21.15.7:0/3175747430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c651050 msgr2=0x55e72c6ac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa89fe00640 1 --2- 172.21.15.7:0/3175747430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c651050 0x55e72c6ac450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa89fe00640 1 -- 172.21.15.7:0/3175747430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 msgr2=0x55e72c6f9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa89fe00640 1 --2- 172.21.15.7:0/3175747430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 0x55e72c6f9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa89fe00640 1 -- 172.21.15.7:0/3175747430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e72c466ab0 con 0x55e72c659330 2024-09-13T15:04:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa89f400640 1 --2- 172.21.15.7:0/3175747430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 0x55e72c6f9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa89fe00640 1 --2- 172.21.15.7:0/3175747430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6ac990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa898054c80 tx=0x7fa898082560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9c502ee23aff6d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa888c00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T15:04:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa888c00640 1 -- 172.21.15.7:0/3175747430 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898054cf0 con 0x55e72c659330 2024-09-13T15:04:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa888c00640 1 -- 172.21.15.7:0/3175747430 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa8980822a0 con 0x55e72c659330 2024-09-13T15:04:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/3175747430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e72c471460 con 0x55e72c659330 2024-09-13T15:04:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa888c00640 1 -- 172.21.15.7:0/3175747430 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa898004b70 con 0x55e72c659330 2024-09-13T15:04:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 10 client.4899 fetch_fsmap learned FSMap version 18 2024-09-13T15:04:42.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/3175747430 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55e72c19dcc0 con 0x55e72c659330 2024-09-13T15:04:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa888c00640 1 -- 172.21.15.7:0/3175747430 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e72c471460 con 0x55e72c659330 2024-09-13T15:04:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa888c00640 1 -- 172.21.15.7:0/3175747430 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 18) v1 ==== 4260+0+0 (secure 0 0 0) 0x7fa898065050 con 0x55e72c659330 2024-09-13T15:04:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 10 client.4899 fetch_fsmap finished waiting for FSMap version 18 2024-09-13T15:04:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 10 client.4899 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T15:04:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 20 client.4899 populate_metadata read hostname 'smithi007' 2024-09-13T15:04:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/3175747430 >> [v2:172.21.15.77:6834/2367107997,v1:172.21.15.77:6835/2367107997] conn(0x55e72c6aced0 0x55e72c6f26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 4 client.4899 mds_command: new command op to 4252 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:04:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/3175747430 --> [v2:172.21.15.77:6834/2367107997,v1:172.21.15.77:6835/2367107997] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e72c46a9c0 con 0x55e72c6aced0 2024-09-13T15:04:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa89f400640 1 --2- 172.21.15.7:0/3175747430 >> [v2:172.21.15.77:6834/2367107997,v1:172.21.15.77:6835/2367107997] conn(0x55e72c6aced0 0x55e72c6f26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa89f400640 1 --2- 172.21.15.7:0/3175747430 >> [v2:172.21.15.77:6834/2367107997,v1:172.21.15.77:6835/2367107997] conn(0x55e72c6aced0 0x55e72c6f26b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ef74b8dbf2644ef server_cookie=7138e6a6d87bdda8 in_seq=0 out_seq=0 2024-09-13T15:04:42.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa888c00640 10 client.4899 ms_handle_connect on v2:172.21.15.77:6834/2367107997 2024-09-13T15:04:42.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa888c00640 1 -- 172.21.15.7:0/3175747430 <== mds.2 v2:172.21.15.77:6834/2367107997 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55e72c46a9c0 con 0x55e72c6aced0 2024-09-13T15:04:42.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa888c00640 10 client.4899 handle_command_reply: tid=0 2024-09-13T15:04:42.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 client.4899 shutdown 2024-09-13T15:04:42.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/3175747430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 msgr2=0x55e72c6ac990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/3175747430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6ac990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa898054c80 tx=0x7fa898082560 comp rx=0 tx=0).stop 2024-09-13T15:04:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/3175747430 shutdown_connections 2024-09-13T15:04:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/3175747430 >> [v2:172.21.15.77:6834/2367107997,v1:172.21.15.77:6835/2367107997] conn(0x55e72c6aced0 0x55e72c6f26b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/3175747430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e72c659330 0x55e72c6ac990 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/3175747430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55e72c651050 0x55e72c6ac450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa888c00640 0 client.4899 ms_handle_reset on v2:172.21.15.77:6834/2367107997 2024-09-13T15:04:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 --2- 172.21.15.7:0/3175747430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55e72c650730 0x55e72c6f9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/3175747430 >> 172.21.15.7:0/3175747430 conn(0x55e72c692500 msgr2=0x55e72c6adec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/3175747430 shutdown_connections 2024-09-13T15:04:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 1 -- 172.21.15.7:0/3175747430 wait complete. 2024-09-13T15:04:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.401+0000 7fa8a9b2e000 20 client.4899 trim_cache size 0 max 16384 2024-09-13T15:04:42.410 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T15:04:42.410 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "92e6844f-41e8-44ce-a6e6-13b9cf520744", 2024-09-13T15:04:42.410 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 2, 2024-09-13T15:04:42.410 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4252, 2024-09-13T15:04:42.410 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-13T15:04:42.410 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-13T15:04:42.410 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-13T15:04:42.410 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 23.537670440999999, 2024-09-13T15:04:42.410 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 18, 2024-09-13T15:04:42.410 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 27, 2024-09-13T15:04:42.410 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 27, 2024-09-13T15:04:42.410 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 183.70513979500001 2024-09-13T15:04:42.411 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T15:04:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.405+0000 7fa8a6600640 1 -- 172.21.15.7:0/746247911 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa880066690 msgr2=0x7fa880068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.405+0000 7fa8a6600640 1 --2- 172.21.15.7:0/746247911 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa880066690 0x7fa880068b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa8900b2000 tx=0x7fa8900aa070 comp rx=0 tx=0).stop 2024-09-13T15:04:42.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.405+0000 7fa8a6600640 1 -- 172.21.15.7:0/746247911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8a015c6b0 msgr2=0x7fa8a0152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.405+0000 7fa8a6600640 1 --2- 172.21.15.7:0/746247911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8a015c6b0 0x7fa8a0152340 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa89800cb40 tx=0x7fa89800a060 comp rx=0 tx=0).stop 2024-09-13T15:04:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.405+0000 7fa8a6600640 1 -- 172.21.15.7:0/746247911 shutdown_connections 2024-09-13T15:04:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.405+0000 7fa8a6600640 1 --2- 172.21.15.7:0/746247911 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa880066690 0x7fa880068b50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.405+0000 7fa8a6600640 1 --2- 172.21.15.7:0/746247911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8a015c6b0 0x7fa8a0152340 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.405+0000 7fa8a6600640 1 --2- 172.21.15.7:0/746247911 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa8a0153320 0x7fa8a0151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.405+0000 7fa8a6600640 1 --2- 172.21.15.7:0/746247911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8a00c8a00 0x7fa8a00c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.405+0000 7fa8a6600640 1 -- 172.21.15.7:0/746247911 >> 172.21.15.7:0/746247911 conn(0x7fa8a006e1d0 msgr2=0x7fa8a00706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.405+0000 7fa8a6600640 1 -- 172.21.15.7:0/746247911 shutdown_connections 2024-09-13T15:04:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.405+0000 7fa8a6600640 1 -- 172.21.15.7:0/746247911 wait complete. 2024-09-13T15:04:42.425 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-09-13T15:04:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.565+0000 7f9a3c000640 1 Processor -- start 2024-09-13T15:04:42.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.565+0000 7f9a3c000640 1 -- start start 2024-09-13T15:04:42.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.565+0000 7f9a3c000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a340c5660 0x7f9a341598b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.565+0000 7f9a3c000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9a340c6770 0x7f9a34069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.565+0000 7f9a3c000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a34141a70 con 0x7f9a340733a0 2024-09-13T15:04:42.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.565+0000 7f9a3c000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a34141c40 con 0x7f9a340c6770 2024-09-13T15:04:42.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.565+0000 7f9a3c000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a34141e90 con 0x7f9a340c5660 2024-09-13T15:04:42.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.565+0000 7f9a38c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9a340c6770 0x7f9a34069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.565+0000 7f9a3a000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f9a340733a0 0x7f9a3415c590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:32910/0 (socket says 172.21.15.7:32910) 2024-09-13T15:04:42.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.565+0000 7f9a3a000640 1 -- 172.21.15.7:0/1128009401 learned_addr learned my addr 172.21.15.7:0/1128009401 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:42.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.565+0000 7f9a39600640 1 --2- 172.21.15.7:0/1128009401 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a340c5660 0x7f9a341598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.565+0000 7f9a33e00640 1 -- 172.21.15.7:0/1128009401 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262183663 0 0) 0x7f9a34141a70 con 0x7f9a340733a0 2024-09-13T15:04:42.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.565+0000 7f9a33e00640 1 -- 172.21.15.7:0/1128009401 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a1c003530 con 0x7f9a340733a0 2024-09-13T15:04:42.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.565+0000 7f9a38c00640 1 -- 172.21.15.7:0/1128009401 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a340c5660 msgr2=0x7f9a341598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.565+0000 7f9a38c00640 1 --2- 172.21.15.7:0/1128009401 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a340c5660 0x7f9a341598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.565+0000 7f9a38c00640 1 -- 172.21.15.7:0/1128009401 >> v1:172.21.15.7:6789/0 conn(0x7f9a340733a0 legacy=0x7f9a3415c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.565+0000 7f9a38c00640 1 -- 172.21.15.7:0/1128009401 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a34142170 con 0x7f9a340c6770 2024-09-13T15:04:42.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.569+0000 7f9a38c00640 1 --2- 172.21.15.7:0/1128009401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a340c6770 0x7f9a34069f30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9a200097c0 tx=0x7f9a2001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee49abdc9454c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.569+0000 7f9a33e00640 1 -- 172.21.15.7:0/1128009401 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a200a8990 con 0x7f9a340c6770 2024-09-13T15:04:42.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.569+0000 7f9a33e00640 1 -- 172.21.15.7:0/1128009401 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a200a8af0 con 0x7f9a340c6770 2024-09-13T15:04:42.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.569+0000 7f9a33e00640 1 -- 172.21.15.7:0/1128009401 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a200a8e80 con 0x7f9a340c6770 2024-09-13T15:04:42.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.569+0000 7f9a3c000640 1 -- 172.21.15.7:0/1128009401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a340c6770 msgr2=0x7f9a34069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.569+0000 7f9a3c000640 1 --2- 172.21.15.7:0/1128009401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a340c6770 0x7f9a34069f30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9a200097c0 tx=0x7f9a2001ec90 comp rx=0 tx=0).stop 2024-09-13T15:04:42.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.569+0000 7f9a3c000640 1 -- 172.21.15.7:0/1128009401 shutdown_connections 2024-09-13T15:04:42.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.569+0000 7f9a3c000640 1 --2- 172.21.15.7:0/1128009401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a340c6770 0x7f9a34069f30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.569+0000 7f9a3c000640 1 --2- 172.21.15.7:0/1128009401 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a340c5660 0x7f9a341598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.569+0000 7f9a3c000640 1 -- 172.21.15.7:0/1128009401 >> 172.21.15.7:0/1128009401 conn(0x7f9a340cb360 msgr2=0x7f9a340cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.569+0000 7f9a3c000640 1 -- 172.21.15.7:0/1128009401 shutdown_connections 2024-09-13T15:04:42.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.569+0000 7f9a3c000640 1 -- 172.21.15.7:0/1128009401 wait complete. 2024-09-13T15:04:42.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3c000640 1 Processor -- start 2024-09-13T15:04:42.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3c000640 1 -- start start 2024-09-13T15:04:42.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3c000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a340733a0 0x7f9a3413d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3c000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a340c6770 0x7f9a3413c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3c000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a341f1e40 0x7f9a341f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3c000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a341f19f0 con 0x7f9a341f1e40 2024-09-13T15:04:42.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3c000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a341f2830 con 0x7f9a340733a0 2024-09-13T15:04:42.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3c000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3413dd40 con 0x7f9a340c6770 2024-09-13T15:04:42.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a341f1e40 0x7f9a341f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a341f1e40 0x7f9a341f22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36104/0 (socket says 172.21.15.7:36104) 2024-09-13T15:04:42.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3a000640 1 -- 172.21.15.7:0/174340318 learned_addr learned my addr 172.21.15.7:0/174340318 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a39600640 1 --2- 172.21.15.7:0/174340318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a340733a0 0x7f9a3413d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a38c00640 1 --2- 172.21.15.7:0/174340318 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a340c6770 0x7f9a3413c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3a000640 1 -- 172.21.15.7:0/174340318 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a340c6770 msgr2=0x7f9a3413c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3a000640 1 --2- 172.21.15.7:0/174340318 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a340c6770 0x7f9a3413c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3a000640 1 -- 172.21.15.7:0/174340318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a340733a0 msgr2=0x7f9a3413d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3a000640 1 --2- 172.21.15.7:0/174340318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a340733a0 0x7f9a3413d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3a000640 1 -- 172.21.15.7:0/174340318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a20009420 con 0x7f9a341f1e40 2024-09-13T15:04:42.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3a000640 1 --2- 172.21.15.7:0/174340318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a341f1e40 0x7f9a341f22f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00cbe0 tx=0x7f9a2c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a31600640 1 -- 172.21.15.7:0/174340318 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c00ace0 con 0x7f9a341f1e40 2024-09-13T15:04:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a31600640 1 -- 172.21.15.7:0/174340318 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c00ae40 con 0x7f9a341f1e40 2024-09-13T15:04:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a31600640 1 -- 172.21.15.7:0/174340318 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c012600 con 0x7f9a341f1e40 2024-09-13T15:04:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3c000640 1 -- 172.21.15.7:0/174340318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3413ee30 con 0x7f9a341f1e40 2024-09-13T15:04:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.573+0000 7f9a3c000640 1 -- 172.21.15.7:0/174340318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3413dfb0 con 0x7f9a341f1e40 2024-09-13T15:04:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.577+0000 7f9a31600640 1 -- 172.21.15.7:0/174340318 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9a2c007070 con 0x7f9a341f1e40 2024-09-13T15:04:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.577+0000 7f9a31600640 1 --2- 172.21.15.7:0/174340318 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9a140666c0 0x7f9a14068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.577+0000 7f9a31600640 1 -- 172.21.15.7:0/174340318 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9a2c0844d0 con 0x7f9a341f1e40 2024-09-13T15:04:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.577+0000 7f9a39600640 1 --2- 172.21.15.7:0/174340318 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9a140666c0 0x7f9a14068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.577+0000 7f9a3f4b3000 1 Processor -- start 2024-09-13T15:04:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.577+0000 7f9a3f4b3000 1 -- start start 2024-09-13T15:04:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a39600640 1 --2- 172.21.15.7:0/174340318 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9a140666c0 0x7f9a14068b80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009b60 tx=0x7f9a28009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46ea6330 0x559b46e9d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46e9d730 0x559b46e9db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46e9e050 0x559b46e9e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b46d67e80 con 0x559b46e9e050 2024-09-13T15:04:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b46cf5af0 con 0x559b46e9d730 2024-09-13T15:04:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b46cf30c0 con 0x559b46ea6330 2024-09-13T15:04:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46e9e050 0x559b46e9e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46e9e050 0x559b46e9e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36110/0 (socket says 172.21.15.7:36110) 2024-09-13T15:04:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3a000640 1 -- 172.21.15.7:0/2294062743 learned_addr learned my addr 172.21.15.7:0/2294062743 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a39600640 1 --2- 172.21.15.7:0/2294062743 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46ea6330 0x559b46e9d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a38c00640 1 --2- 172.21.15.7:0/2294062743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46e9d730 0x559b46e9db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3a000640 1 -- 172.21.15.7:0/2294062743 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46ea6330 msgr2=0x559b46e9d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3a000640 1 --2- 172.21.15.7:0/2294062743 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46ea6330 0x559b46e9d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3a000640 1 -- 172.21.15.7:0/2294062743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46e9d730 msgr2=0x559b46e9db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3a000640 1 --2- 172.21.15.7:0/2294062743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46e9d730 0x559b46e9db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3a000640 1 -- 172.21.15.7:0/2294062743 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b469ea890 con 0x559b46e9e050 2024-09-13T15:04:42.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3a000640 1 --2- 172.21.15.7:0/2294062743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46e9e050 0x559b46e9e430 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0515c0 tx=0x7f9a2c054aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef7250cab68273d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a26000640 1 -- 172.21.15.7:0/2294062743 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c06c070 con 0x559b46e9e050 2024-09-13T15:04:42.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a26000640 1 -- 172.21.15.7:0/2294062743 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c05d490 con 0x559b46e9e050 2024-09-13T15:04:42.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a26000640 1 -- 172.21.15.7:0/2294062743 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0517d0 con 0x559b46e9e050 2024-09-13T15:04:42.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/2294062743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46e9e050 msgr2=0x559b46e9e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/2294062743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46e9e050 0x559b46e9e430 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0515c0 tx=0x7f9a2c054aa0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/2294062743 shutdown_connections 2024-09-13T15:04:42.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/2294062743 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46e9e050 0x559b46e9e430 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/2294062743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46e9d730 0x559b46e9db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/2294062743 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46ea6330 0x559b46e9d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/2294062743 >> 172.21.15.7:0/2294062743 conn(0x559b46edf500 msgr2=0x559b46ee18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/2294062743 shutdown_connections 2024-09-13T15:04:42.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/2294062743 wait complete. 2024-09-13T15:04:42.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 -- start start 2024-09-13T15:04:42.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 Processor -- start 2024-09-13T15:04:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46e9d730 0x559b46eeb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46e9e050 0x559b46eebd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.581+0000 7f9a3f4b3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46ea6330 0x559b46ea4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a3f4b3000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b46cee9b0 con 0x559b46e9d730 2024-09-13T15:04:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a3f4b3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b46c8dc00 con 0x559b46ea6330 2024-09-13T15:04:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a3f4b3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b46cac070 con 0x559b46e9e050 2024-09-13T15:04:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a3f4b3000 10 client.0 _ll_register_callbacks cb 0x559b46e8bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:04:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a39600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46e9d730 0x559b46eeb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a39600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46e9d730 0x559b46eeb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36124/0 (socket says 172.21.15.7:36124) 2024-09-13T15:04:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a39600640 1 -- 172.21.15.7:0/3863098758 learned_addr learned my addr 172.21.15.7:0/3863098758 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a38c00640 1 --2- 172.21.15.7:0/3863098758 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46e9e050 0x559b46eebd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a3a000640 1 --2- 172.21.15.7:0/3863098758 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46ea6330 0x559b46ea4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a39600640 1 -- 172.21.15.7:0/3863098758 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46e9e050 msgr2=0x559b46eebd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a39600640 1 --2- 172.21.15.7:0/3863098758 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46e9e050 0x559b46eebd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a39600640 1 -- 172.21.15.7:0/3863098758 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46ea6330 msgr2=0x559b46ea4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a39600640 1 --2- 172.21.15.7:0/3863098758 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46ea6330 0x559b46ea4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a39600640 1 -- 172.21.15.7:0/3863098758 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3413dfb0 con 0x559b46e9d730 2024-09-13T15:04:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a39600640 1 --2- 172.21.15.7:0/3863098758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46e9d730 0x559b46eeb830 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9a28003650 tx=0x7f9a280046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7dc4784de6df5f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a1aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T15:04:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a1aa00640 1 -- 172.21.15.7:0/3863098758 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2801c040 con 0x559b46e9d730 2024-09-13T15:04:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/3863098758 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b46cab5f0 con 0x559b46e9d730 2024-09-13T15:04:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a1aa00640 1 -- 172.21.15.7:0/3863098758 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9a28014440 con 0x559b46e9d730 2024-09-13T15:04:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a1aa00640 1 -- 172.21.15.7:0/3863098758 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a28014600 con 0x559b46e9d730 2024-09-13T15:04:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a3f4b3000 10 client.4914 fetch_fsmap learned FSMap version 18 2024-09-13T15:04:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/3863098758 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x559b46cb3ab0 con 0x559b46e9d730 2024-09-13T15:04:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a1aa00640 1 -- 172.21.15.7:0/3863098758 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559b46cab5f0 con 0x559b46e9d730 2024-09-13T15:04:42.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a1aa00640 1 -- 172.21.15.7:0/3863098758 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 18) v1 ==== 4260+0+0 (secure 0 0 0) 0x7f9a28014760 con 0x559b46e9d730 2024-09-13T15:04:42.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a3f4b3000 10 client.4914 fetch_fsmap finished waiting for FSMap version 18 2024-09-13T15:04:42.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a3f4b3000 10 client.4914 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-13T15:04:42.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a3f4b3000 20 client.4914 populate_metadata read hostname 'smithi007' 2024-09-13T15:04:42.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/3863098758 >> [v2:172.21.15.77:6837/2233000674,v1:172.21.15.77:6839/2233000674] conn(0x559b46ea5480 0x559b46ee9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a3f4b3000 4 client.4914 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:04:42.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/3863098758 --> [v2:172.21.15.77:6837/2233000674,v1:172.21.15.77:6839/2233000674] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b46ceb790 con 0x559b46ea5480 2024-09-13T15:04:42.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a38c00640 1 --2- 172.21.15.7:0/3863098758 >> [v2:172.21.15.77:6837/2233000674,v1:172.21.15.77:6839/2233000674] conn(0x559b46ea5480 0x559b46ee9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a38c00640 1 --2- 172.21.15.7:0/3863098758 >> [v2:172.21.15.77:6837/2233000674,v1:172.21.15.77:6839/2233000674] conn(0x559b46ea5480 0x559b46ee9c70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=abe5f523dced05ec server_cookie=b18dbdbf5b149b2c in_seq=0 out_seq=0 2024-09-13T15:04:42.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.585+0000 7f9a1aa00640 10 client.4914 ms_handle_connect on v2:172.21.15.77:6837/2233000674 2024-09-13T15:04:42.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.589+0000 7f9a1aa00640 1 -- 172.21.15.7:0/3863098758 <== mds.1 v2:172.21.15.77:6837/2233000674 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559b46ceb790 con 0x559b46ea5480 2024-09-13T15:04:42.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.589+0000 7f9a1aa00640 10 client.4914 handle_command_reply: tid=0 2024-09-13T15:04:42.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.589+0000 7f9a3f4b3000 1 client.4914 shutdown 2024-09-13T15:04:42.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.589+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/3863098758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46e9d730 msgr2=0x559b46eeb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.589+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/3863098758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46e9d730 0x559b46eeb830 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9a28003650 tx=0x7f9a280046d0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.589+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/3863098758 shutdown_connections 2024-09-13T15:04:42.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.589+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/3863098758 >> [v2:172.21.15.77:6837/2233000674,v1:172.21.15.77:6839/2233000674] conn(0x559b46ea5480 0x559b46ee9c70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.589+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/3863098758 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46ea6330 0x559b46ea4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.589+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/3863098758 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46e9e050 0x559b46eebd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.589+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/3863098758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46e9d730 0x559b46eeb830 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.589+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/3863098758 >> 172.21.15.7:0/3863098758 conn(0x559b46edf500 msgr2=0x559b46ee18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.589+0000 7f9a1aa00640 0 client.4914 ms_handle_reset on v2:172.21.15.77:6837/2233000674 2024-09-13T15:04:42.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.589+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/3863098758 shutdown_connections 2024-09-13T15:04:42.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.589+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/3863098758 wait complete. 2024-09-13T15:04:42.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.589+0000 7f9a3f4b3000 20 client.4914 trim_cache size 0 max 16384 2024-09-13T15:04:42.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3f4b3000 1 Processor -- start 2024-09-13T15:04:42.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3f4b3000 1 -- start start 2024-09-13T15:04:42.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3f4b3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46e9d730 0x559b46ea48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3f4b3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46e9e050 0x559b46ee8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3f4b3000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46ea6330 0x559b46ee8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3f4b3000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b469ab940 con 0x559b46ea6330 2024-09-13T15:04:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3f4b3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b46c757c0 con 0x559b46e9e050 2024-09-13T15:04:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3f4b3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b46d8a9a0 con 0x559b46e9d730 2024-09-13T15:04:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46ea6330 0x559b46ee8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46ea6330 0x559b46ee8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36134/0 (socket says 172.21.15.7:36134) 2024-09-13T15:04:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3a000640 1 -- 172.21.15.7:0/951349707 learned_addr learned my addr 172.21.15.7:0/951349707 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a39600640 1 --2- 172.21.15.7:0/951349707 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46e9d730 0x559b46ea48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a38c00640 1 --2- 172.21.15.7:0/951349707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46e9e050 0x559b46ee8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3a000640 1 -- 172.21.15.7:0/951349707 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46e9d730 msgr2=0x559b46ea48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3a000640 1 --2- 172.21.15.7:0/951349707 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46e9d730 0x559b46ea48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3a000640 1 -- 172.21.15.7:0/951349707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46e9e050 msgr2=0x559b46ee8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3a000640 1 --2- 172.21.15.7:0/951349707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46e9e050 0x559b46ee8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3a000640 1 -- 172.21.15.7:0/951349707 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b46c99c00 con 0x559b46ea6330 2024-09-13T15:04:42.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3a000640 1 --2- 172.21.15.7:0/951349707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46ea6330 0x559b46ee8e70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c054b90 tx=0x7f9a2c01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937250829e407002 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a26a00640 1 -- 172.21.15.7:0/951349707 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c06c040 con 0x559b46ea6330 2024-09-13T15:04:42.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a26a00640 1 -- 172.21.15.7:0/951349707 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c05d490 con 0x559b46ea6330 2024-09-13T15:04:42.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a26a00640 1 -- 172.21.15.7:0/951349707 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0821c0 con 0x559b46ea6330 2024-09-13T15:04:42.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/951349707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46ea6330 msgr2=0x559b46ee8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/951349707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46ea6330 0x559b46ee8e70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c054b90 tx=0x7f9a2c01e000 comp rx=0 tx=0).stop 2024-09-13T15:04:42.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/951349707 shutdown_connections 2024-09-13T15:04:42.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/951349707 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46ea6330 0x559b46ee8e70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/951349707 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46e9e050 0x559b46ee8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/951349707 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46e9d730 0x559b46ea48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/951349707 >> 172.21.15.7:0/951349707 conn(0x559b46edf500 msgr2=0x559b46ea3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/951349707 shutdown_connections 2024-09-13T15:04:42.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.605+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/951349707 wait complete. 2024-09-13T15:04:42.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 1 -- start start 2024-09-13T15:04:42.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 1 Processor -- start 2024-09-13T15:04:42.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46e9d730 0x559b46ef9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46e9e050 0x559b46f45bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46ea6330 0x559b46f46100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b46ca7f80 con 0x559b46ea6330 2024-09-13T15:04:42.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b46cf1510 con 0x559b46e9e050 2024-09-13T15:04:42.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x559b46ef1ee0 con 0x559b46e9d730 2024-09-13T15:04:42.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 10 client.0 _ll_register_callbacks cb 0x559b46e6be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:04:42.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46ea6330 0x559b46f46100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46ea6330 0x559b46f46100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36142/0 (socket says 172.21.15.7:36142) 2024-09-13T15:04:42.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3a000640 1 -- 172.21.15.7:0/3471097539 learned_addr learned my addr 172.21.15.7:0/3471097539 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a39600640 1 --2- 172.21.15.7:0/3471097539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46e9d730 0x559b46ef9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a38c00640 1 --2- 172.21.15.7:0/3471097539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46e9e050 0x559b46f45bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3a000640 1 -- 172.21.15.7:0/3471097539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46e9d730 msgr2=0x559b46ef9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3a000640 1 --2- 172.21.15.7:0/3471097539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46e9d730 0x559b46ef9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3a000640 1 -- 172.21.15.7:0/3471097539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46e9e050 msgr2=0x559b46f45bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3a000640 1 --2- 172.21.15.7:0/3471097539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46e9e050 0x559b46f45bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3a000640 1 -- 172.21.15.7:0/3471097539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559b469ea890 con 0x559b46ea6330 2024-09-13T15:04:42.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3a000640 1 --2- 172.21.15.7:0/3471097539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46ea6330 0x559b46f46100 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c055050 tx=0x7f9a2c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40373f1355403cf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a1aa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T15:04:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a1aa00640 1 -- 172.21.15.7:0/3471097539 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c06c040 con 0x559b46ea6330 2024-09-13T15:04:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a1aa00640 1 -- 172.21.15.7:0/3471097539 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9a2c0840e0 con 0x559b46ea6330 2024-09-13T15:04:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/3471097539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b46cbe460 con 0x559b46ea6330 2024-09-13T15:04:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a1aa00640 1 -- 172.21.15.7:0/3471097539 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a2c084300 con 0x559b46ea6330 2024-09-13T15:04:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 10 client.4920 fetch_fsmap learned FSMap version 18 2024-09-13T15:04:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/3471097539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x559b469eacc0 con 0x559b46ea6330 2024-09-13T15:04:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a1aa00640 1 -- 172.21.15.7:0/3471097539 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559b46cbe460 con 0x559b46ea6330 2024-09-13T15:04:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a1aa00640 1 -- 172.21.15.7:0/3471097539 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 18) v1 ==== 4260+0+0 (secure 0 0 0) 0x7f9a2c0545b0 con 0x559b46ea6330 2024-09-13T15:04:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 10 client.4920 fetch_fsmap finished waiting for FSMap version 18 2024-09-13T15:04:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 10 client.4920 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-13T15:04:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 20 client.4920 populate_metadata read hostname 'smithi007' 2024-09-13T15:04:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/3471097539 >> [v2:172.21.15.77:6837/2233000674,v1:172.21.15.77:6839/2233000674] conn(0x559b46f46640 0x559b46f427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 4 client.4920 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:04:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/3471097539 --> [v2:172.21.15.77:6837/2233000674,v1:172.21.15.77:6839/2233000674] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559b46cb79c0 con 0x559b46f46640 2024-09-13T15:04:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.609+0000 7f9a39600640 1 --2- 172.21.15.7:0/3471097539 >> [v2:172.21.15.77:6837/2233000674,v1:172.21.15.77:6839/2233000674] conn(0x559b46f46640 0x559b46f427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a39600640 1 --2- 172.21.15.7:0/3471097539 >> [v2:172.21.15.77:6837/2233000674,v1:172.21.15.77:6839/2233000674] conn(0x559b46f46640 0x559b46f427a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5ad9626d8035dff0 server_cookie=5ba4e1645d00f927 in_seq=0 out_seq=0 2024-09-13T15:04:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a1aa00640 10 client.4920 ms_handle_connect on v2:172.21.15.77:6837/2233000674 2024-09-13T15:04:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a1aa00640 1 -- 172.21.15.7:0/3471097539 <== mds.1 v2:172.21.15.77:6837/2233000674 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x559b46cb79c0 con 0x559b46f46640 2024-09-13T15:04:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a1aa00640 10 client.4920 handle_command_reply: tid=0 2024-09-13T15:04:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3f4b3000 1 client.4920 shutdown 2024-09-13T15:04:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/3471097539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46ea6330 msgr2=0x559b46f46100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/3471097539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46ea6330 0x559b46f46100 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c055050 tx=0x7f9a2c001260 comp rx=0 tx=0).stop 2024-09-13T15:04:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/3471097539 shutdown_connections 2024-09-13T15:04:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/3471097539 >> [v2:172.21.15.77:6837/2233000674,v1:172.21.15.77:6839/2233000674] conn(0x559b46f46640 0x559b46f427a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/3471097539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b46ea6330 0x559b46f46100 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/3471097539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559b46e9e050 0x559b46f45bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3f4b3000 1 --2- 172.21.15.7:0/3471097539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x559b46e9d730 0x559b46ef9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/3471097539 >> 172.21.15.7:0/3471097539 conn(0x559b46edf500 msgr2=0x559b46ea46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a1aa00640 0 client.4920 ms_handle_reset on v2:172.21.15.77:6837/2233000674 2024-09-13T15:04:42.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/3471097539 shutdown_connections 2024-09-13T15:04:42.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3f4b3000 1 -- 172.21.15.7:0/3471097539 wait complete. 2024-09-13T15:04:42.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3f4b3000 20 client.4920 trim_cache size 0 max 16384 2024-09-13T15:04:42.618 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T15:04:42.618 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "92e6844f-41e8-44ce-a6e6-13b9cf520744", 2024-09-13T15:04:42.619 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 1, 2024-09-13T15:04:42.619 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4267, 2024-09-13T15:04:42.619 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-13T15:04:42.619 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-13T15:04:42.619 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-13T15:04:42.619 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 30.032499673, 2024-09-13T15:04:42.619 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 18, 2024-09-13T15:04:42.619 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 27, 2024-09-13T15:04:42.619 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 27, 2024-09-13T15:04:42.619 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 183.90516872200001 2024-09-13T15:04:42.619 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T15:04:42.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3c000640 1 -- 172.21.15.7:0/174340318 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9a140666c0 msgr2=0x7f9a14068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3c000640 1 --2- 172.21.15.7:0/174340318 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9a140666c0 0x7f9a14068b80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009b60 tx=0x7f9a28009190 comp rx=0 tx=0).stop 2024-09-13T15:04:42.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3c000640 1 -- 172.21.15.7:0/174340318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a341f1e40 msgr2=0x7f9a341f22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3c000640 1 --2- 172.21.15.7:0/174340318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a341f1e40 0x7f9a341f22f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00cbe0 tx=0x7f9a2c00a430 comp rx=0 tx=0).stop 2024-09-13T15:04:42.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3c000640 1 -- 172.21.15.7:0/174340318 shutdown_connections 2024-09-13T15:04:42.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3c000640 1 --2- 172.21.15.7:0/174340318 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9a140666c0 0x7f9a14068b80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3c000640 1 --2- 172.21.15.7:0/174340318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a341f1e40 0x7f9a341f22f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3c000640 1 --2- 172.21.15.7:0/174340318 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9a340c6770 0x7f9a3413c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3c000640 1 --2- 172.21.15.7:0/174340318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9a340733a0 0x7f9a3413d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3c000640 1 -- 172.21.15.7:0/174340318 >> 172.21.15.7:0/174340318 conn(0x7f9a340cb360 msgr2=0x7f9a340c5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3c000640 1 -- 172.21.15.7:0/174340318 shutdown_connections 2024-09-13T15:04:42.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.613+0000 7f9a3c000640 1 -- 172.21.15.7:0/174340318 wait complete. 2024-09-13T15:04:42.634 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T15:04:42.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.773+0000 7f44dc000640 1 Processor -- start 2024-09-13T15:04:42.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.773+0000 7f44dc000640 1 -- start start 2024-09-13T15:04:42.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.773+0000 7f44dc000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44d4151590 0x7f44d4157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.773+0000 7f44dc000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f44d40c6130 0x7f44d40717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.773+0000 7f44dc000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d40c6580 con 0x7f44d40c7ea0 2024-09-13T15:04:42.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.773+0000 7f44dc000640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d4151970 con 0x7f44d40c6130 2024-09-13T15:04:42.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.773+0000 7f44dc000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d415b030 con 0x7f44d4151590 2024-09-13T15:04:42.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.777+0000 7f44d9600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44d4151590 0x7f44d4157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.777+0000 7f44d9600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44d4151590 0x7f44d4157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:60948/0 (socket says 172.21.15.7:60948) 2024-09-13T15:04:42.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.777+0000 7f44d9600640 1 -- 172.21.15.7:0/4055384071 learned_addr learned my addr 172.21.15.7:0/4055384071 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.777+0000 7f44da000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f44d40c6130 0x7f44d40717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.777+0000 7f44d9600640 1 -- 172.21.15.7:0/4055384071 >> v2:172.21.15.77:3300/0 conn(0x7f44d40c6130 msgr2=0x7f44d40717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.777+0000 7f44d9600640 1 --2- 172.21.15.7:0/4055384071 >> v2:172.21.15.77:3300/0 conn(0x7f44d40c6130 0x7f44d40717a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.777+0000 7f44d9600640 1 -- 172.21.15.7:0/4055384071 >> v1:172.21.15.77:6789/0 conn(0x7f44d40c7ea0 legacy=0x7f44d415a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.777+0000 7f44d9600640 1 -- 172.21.15.7:0/4055384071 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d415b310 con 0x7f44d4151590 2024-09-13T15:04:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.777+0000 7f44d9600640 1 --2- 172.21.15.7:0/4055384071 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44d4151590 0x7f44d4157e20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009870 tx=0x7f44c801ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e76bb54302fdbd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44d3e00640 1 -- 172.21.15.7:0/4055384071 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80a8a50 con 0x7f44d4151590 2024-09-13T15:04:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44d3e00640 1 -- 172.21.15.7:0/4055384071 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c80a8bb0 con 0x7f44d4151590 2024-09-13T15:04:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44d3e00640 1 -- 172.21.15.7:0/4055384071 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80b0440 con 0x7f44d4151590 2024-09-13T15:04:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44dc000640 1 -- 172.21.15.7:0/4055384071 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44d4151590 msgr2=0x7f44d4157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44dc000640 1 --2- 172.21.15.7:0/4055384071 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44d4151590 0x7f44d4157e20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009870 tx=0x7f44c801ed50 comp rx=0 tx=0).stop 2024-09-13T15:04:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44dc000640 1 -- 172.21.15.7:0/4055384071 shutdown_connections 2024-09-13T15:04:42.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44dc000640 1 --2- 172.21.15.7:0/4055384071 >> v2:172.21.15.77:3300/0 conn(0x7f44d40c6130 0x7f44d40717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44dc000640 1 --2- 172.21.15.7:0/4055384071 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44d4151590 0x7f44d4157e20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44dc000640 1 -- 172.21.15.7:0/4055384071 >> 172.21.15.7:0/4055384071 conn(0x7f44d40c7380 msgr2=0x7f44d40c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44dc000640 1 -- 172.21.15.7:0/4055384071 shutdown_connections 2024-09-13T15:04:42.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44dc000640 1 -- 172.21.15.7:0/4055384071 wait complete. 2024-09-13T15:04:42.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44dc000640 1 Processor -- start 2024-09-13T15:04:42.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44dc000640 1 -- start start 2024-09-13T15:04:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44dc000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44d40c6130 0x7f44d414fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44dc000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44d40c7ea0 0x7f44d40c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44dc000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44d4151590 0x7f44d40c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44dc000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d41533e0 con 0x7f44d40c6130 2024-09-13T15:04:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44dc000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d41ef8e0 con 0x7f44d40c7ea0 2024-09-13T15:04:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44dc000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d41efe10 con 0x7f44d4151590 2024-09-13T15:04:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44d9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44d40c6130 0x7f44d414fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44d9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44d40c6130 0x7f44d414fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36148/0 (socket says 172.21.15.7:36148) 2024-09-13T15:04:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44d9600640 1 -- 172.21.15.7:0/2847014731 learned_addr learned my addr 172.21.15.7:0/2847014731 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44da000640 1 --2- 172.21.15.7:0/2847014731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44d4151590 0x7f44d40c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44d8c00640 1 --2- 172.21.15.7:0/2847014731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44d40c7ea0 0x7f44d40c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.781+0000 7f44d9600640 1 -- 172.21.15.7:0/2847014731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44d4151590 msgr2=0x7f44d40c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.785+0000 7f44d9600640 1 --2- 172.21.15.7:0/2847014731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44d4151590 0x7f44d40c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.785+0000 7f44d9600640 1 -- 172.21.15.7:0/2847014731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44d40c7ea0 msgr2=0x7f44d40c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.785+0000 7f44d9600640 1 --2- 172.21.15.7:0/2847014731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44d40c7ea0 0x7f44d40c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.785+0000 7f44d9600640 1 -- 172.21.15.7:0/2847014731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c80094d0 con 0x7f44d40c6130 2024-09-13T15:04:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.785+0000 7f44d8c00640 1 --2- 172.21.15.7:0/2847014731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44d40c7ea0 0x7f44d40c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.785+0000 7f44d9600640 1 --2- 172.21.15.7:0/2847014731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44d40c6130 0x7f44d414fcc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f44c801d400 tx=0x7f44c801baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.785+0000 7f44d1600640 1 -- 172.21.15.7:0/2847014731 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80b9620 con 0x7f44d40c6130 2024-09-13T15:04:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.785+0000 7f44d1600640 1 -- 172.21.15.7:0/2847014731 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c80b97a0 con 0x7f44d40c6130 2024-09-13T15:04:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.785+0000 7f44dc000640 1 -- 172.21.15.7:0/2847014731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d40c2750 con 0x7f44d40c6130 2024-09-13T15:04:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.785+0000 7f44d1600640 1 -- 172.21.15.7:0/2847014731 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80b9b50 con 0x7f44d40c6130 2024-09-13T15:04:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.785+0000 7f44dc000640 1 -- 172.21.15.7:0/2847014731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d41508c0 con 0x7f44d40c6130 2024-09-13T15:04:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.785+0000 7f44d1600640 1 -- 172.21.15.7:0/2847014731 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f44c80b7070 con 0x7f44d40c6130 2024-09-13T15:04:42.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.785+0000 7f44d1600640 1 --2- 172.21.15.7:0/2847014731 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f44b4066690 0x7f44b4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.785+0000 7f44d1600640 1 -- 172.21.15.7:0/2847014731 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f44c8121f10 con 0x7f44d40c6130 2024-09-13T15:04:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44d8c00640 1 --2- 172.21.15.7:0/2847014731 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f44b4066690 0x7f44b4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 Processor -- start 2024-09-13T15:04:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 -- start start 2024-09-13T15:04:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44d8c00640 1 --2- 172.21.15.7:0/2847014731 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f44b4066690 0x7f44b4068b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f44d4150f40 tx=0x7f44c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1669360 0x55f1b1660220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1660760 0x55f1b1660b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1661080 0x55f1b1661460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1b152ae80 con 0x55f1b1660760 2024-09-13T15:04:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1b14b8af0 con 0x55f1b1661080 2024-09-13T15:04:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1b14b60c0 con 0x55f1b1669360 2024-09-13T15:04:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44d8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1660760 0x55f1b1660b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44d8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1660760 0x55f1b1660b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36158/0 (socket says 172.21.15.7:36158) 2024-09-13T15:04:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44d8c00640 1 -- 172.21.15.7:0/89450501 learned_addr learned my addr 172.21.15.7:0/89450501 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44d9600640 1 --2- 172.21.15.7:0/89450501 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1669360 0x55f1b1660220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44da000640 1 --2- 172.21.15.7:0/89450501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1661080 0x55f1b1661460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44d8c00640 1 -- 172.21.15.7:0/89450501 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1669360 msgr2=0x55f1b1660220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44d8c00640 1 --2- 172.21.15.7:0/89450501 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1669360 0x55f1b1660220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44d8c00640 1 -- 172.21.15.7:0/89450501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1661080 msgr2=0x55f1b1661460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44d8c00640 1 --2- 172.21.15.7:0/89450501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1661080 0x55f1b1661460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44d8c00640 1 -- 172.21.15.7:0/89450501 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1b11ad890 con 0x55f1b1660760 2024-09-13T15:04:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44da000640 1 --2- 172.21.15.7:0/89450501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1661080 0x55f1b1661460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44d9600640 1 --2- 172.21.15.7:0/89450501 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1669360 0x55f1b1660220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44d8c00640 1 --2- 172.21.15.7:0/89450501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1660760 0x55f1b1660b40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f44c0001dd0 tx=0x7f44c0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8475b42285360ce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44c6000640 1 -- 172.21.15.7:0/89450501 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0003600 con 0x55f1b1660760 2024-09-13T15:04:42.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44c6000640 1 -- 172.21.15.7:0/89450501 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c0003760 con 0x55f1b1660760 2024-09-13T15:04:42.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44c6000640 1 -- 172.21.15.7:0/89450501 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0003ad0 con 0x55f1b1660760 2024-09-13T15:04:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 -- 172.21.15.7:0/89450501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1660760 msgr2=0x55f1b1660b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 --2- 172.21.15.7:0/89450501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1660760 0x55f1b1660b40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f44c0001dd0 tx=0x7f44c0011000 comp rx=0 tx=0).stop 2024-09-13T15:04:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 -- 172.21.15.7:0/89450501 shutdown_connections 2024-09-13T15:04:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 --2- 172.21.15.7:0/89450501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1661080 0x55f1b1661460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 --2- 172.21.15.7:0/89450501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1660760 0x55f1b1660b40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 --2- 172.21.15.7:0/89450501 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1669360 0x55f1b1660220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 -- 172.21.15.7:0/89450501 >> 172.21.15.7:0/89450501 conn(0x55f1b16a2500 msgr2=0x55f1b16a48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 -- 172.21.15.7:0/89450501 shutdown_connections 2024-09-13T15:04:42.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 -- 172.21.15.7:0/89450501 wait complete. 2024-09-13T15:04:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.789+0000 7f44df502000 1 -- start start 2024-09-13T15:04:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44df502000 1 Processor -- start 2024-09-13T15:04:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44df502000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1660760 0x55f1b16ae690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44df502000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1661080 0x55f1b16aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44df502000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1669360 0x55f1b1667b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44df502000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1b14b19b0 con 0x55f1b1669360 2024-09-13T15:04:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44df502000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1b1450c00 con 0x55f1b1660760 2024-09-13T15:04:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44df502000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1b146f070 con 0x55f1b1661080 2024-09-13T15:04:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44df502000 10 client.0 _ll_register_callbacks cb 0x55f1b164eae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:04:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44da000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1669360 0x55f1b1667b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44da000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1669360 0x55f1b1667b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36160/0 (socket says 172.21.15.7:36160) 2024-09-13T15:04:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44da000640 1 -- 172.21.15.7:0/809451863 learned_addr learned my addr 172.21.15.7:0/809451863 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44d8c00640 1 --2- 172.21.15.7:0/809451863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1661080 0x55f1b16aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44d9600640 1 --2- 172.21.15.7:0/809451863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1660760 0x55f1b16ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44da000640 1 -- 172.21.15.7:0/809451863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1661080 msgr2=0x55f1b16aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44da000640 1 --2- 172.21.15.7:0/809451863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1661080 0x55f1b16aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44da000640 1 -- 172.21.15.7:0/809451863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1660760 msgr2=0x55f1b16ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44da000640 1 --2- 172.21.15.7:0/809451863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1660760 0x55f1b16ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44da000640 1 -- 172.21.15.7:0/809451863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c000f040 con 0x55f1b1669360 2024-09-13T15:04:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44d9600640 1 --2- 172.21.15.7:0/809451863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1660760 0x55f1b16ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44da000640 1 --2- 172.21.15.7:0/809451863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1669360 0x55f1b1667b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f44cc007da0 tx=0x7f44cc013680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2933a07dd40d4a56 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44baa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T15:04:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44baa00640 1 -- 172.21.15.7:0/809451863 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc00e040 con 0x55f1b1669360 2024-09-13T15:04:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44baa00640 1 -- 172.21.15.7:0/809451863 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f44cc016630 con 0x55f1b1669360 2024-09-13T15:04:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44df502000 1 -- 172.21.15.7:0/809451863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f1b146e5f0 con 0x55f1b1669360 2024-09-13T15:04:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44baa00640 1 -- 172.21.15.7:0/809451863 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44cc013ec0 con 0x55f1b1669360 2024-09-13T15:04:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44df502000 10 client.4929 fetch_fsmap learned FSMap version 18 2024-09-13T15:04:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44df502000 1 -- 172.21.15.7:0/809451863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55f1b1476ab0 con 0x55f1b1669360 2024-09-13T15:04:42.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44baa00640 1 -- 172.21.15.7:0/809451863 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f1b146e5f0 con 0x55f1b1669360 2024-09-13T15:04:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44baa00640 1 -- 172.21.15.7:0/809451863 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 18) v1 ==== 4260+0+0 (secure 0 0 0) 0x7f44cc014040 con 0x55f1b1669360 2024-09-13T15:04:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44df502000 10 client.4929 fetch_fsmap finished waiting for FSMap version 18 2024-09-13T15:04:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44df502000 10 client.4929 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T15:04:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44df502000 20 client.4929 populate_metadata read hostname 'smithi007' 2024-09-13T15:04:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44df502000 1 --2- 172.21.15.7:0/809451863 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x55f1b1668420 0x55f1b16aca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44df502000 4 client.4929 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T15:04:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44df502000 1 -- 172.21.15.7:0/809451863 --> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f1b14ae790 con 0x55f1b1668420 2024-09-13T15:04:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44d9600640 1 --2- 172.21.15.7:0/809451863 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x55f1b1668420 0x55f1b16aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44d9600640 1 --2- 172.21.15.7:0/809451863 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x55f1b1668420 0x55f1b16aca60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34c1d93af232b578 server_cookie=4b540ff54a784faf in_seq=0 out_seq=0 2024-09-13T15:04:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.793+0000 7f44baa00640 10 client.4929 ms_handle_connect on v2:172.21.15.7:6834/2396967179 2024-09-13T15:04:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.797+0000 7f44baa00640 1 -- 172.21.15.7:0/809451863 <== mds.0 v2:172.21.15.7:6834/2396967179 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f1b14ae790 con 0x55f1b1668420 2024-09-13T15:04:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.797+0000 7f44baa00640 10 client.4929 handle_command_reply: tid=0 2024-09-13T15:04:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.797+0000 7f44df502000 1 client.4929 shutdown 2024-09-13T15:04:42.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.797+0000 7f44df502000 1 -- 172.21.15.7:0/809451863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1669360 msgr2=0x55f1b1667b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.797+0000 7f44df502000 1 --2- 172.21.15.7:0/809451863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1669360 0x55f1b1667b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f44cc007da0 tx=0x7f44cc013680 comp rx=0 tx=0).stop 2024-09-13T15:04:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.797+0000 7f44df502000 1 -- 172.21.15.7:0/809451863 shutdown_connections 2024-09-13T15:04:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.797+0000 7f44df502000 1 --2- 172.21.15.7:0/809451863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1669360 0x55f1b1667b80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.797+0000 7f44df502000 1 --2- 172.21.15.7:0/809451863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1661080 0x55f1b16aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.797+0000 7f44df502000 1 --2- 172.21.15.7:0/809451863 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x55f1b1668420 0x55f1b16aca60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.797+0000 7f44df502000 1 --2- 172.21.15.7:0/809451863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1660760 0x55f1b16ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.797+0000 7f44baa00640 0 client.4929 ms_handle_reset on v2:172.21.15.7:6834/2396967179 2024-09-13T15:04:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.797+0000 7f44df502000 1 -- 172.21.15.7:0/809451863 >> 172.21.15.7:0/809451863 conn(0x55f1b16a2500 msgr2=0x55f1b16a48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.797+0000 7f44df502000 1 -- 172.21.15.7:0/809451863 shutdown_connections 2024-09-13T15:04:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.797+0000 7f44df502000 1 -- 172.21.15.7:0/809451863 wait complete. 2024-09-13T15:04:42.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.797+0000 7f44df502000 20 client.4929 trim_cache size 0 max 16384 2024-09-13T15:04:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44df502000 1 Processor -- start 2024-09-13T15:04:42.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44df502000 1 -- start start 2024-09-13T15:04:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44df502000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1660760 0x55f1b16ab930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44df502000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1661080 0x55f1b16abe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44df502000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1669360 0x55f1b16b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44df502000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1b116e940 con 0x55f1b1661080 2024-09-13T15:04:42.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44df502000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1b14b0840 con 0x55f1b1660760 2024-09-13T15:04:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44df502000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1b14b3fa0 con 0x55f1b1669360 2024-09-13T15:04:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44d8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1661080 0x55f1b16abe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44d8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1661080 0x55f1b16abe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36176/0 (socket says 172.21.15.7:36176) 2024-09-13T15:04:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44d8c00640 1 -- 172.21.15.7:0/450655807 learned_addr learned my addr 172.21.15.7:0/450655807 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44d9600640 1 --2- 172.21.15.7:0/450655807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1660760 0x55f1b16ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44da000640 1 --2- 172.21.15.7:0/450655807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1669360 0x55f1b16b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44d8c00640 1 -- 172.21.15.7:0/450655807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1669360 msgr2=0x55f1b16b9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44d8c00640 1 --2- 172.21.15.7:0/450655807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1669360 0x55f1b16b9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44d8c00640 1 -- 172.21.15.7:0/450655807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1660760 msgr2=0x55f1b16ab930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44d8c00640 1 --2- 172.21.15.7:0/450655807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1660760 0x55f1b16ab930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44d8c00640 1 -- 172.21.15.7:0/450655807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1b145cc00 con 0x55f1b1661080 2024-09-13T15:04:42.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44d8c00640 1 --2- 172.21.15.7:0/450655807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1661080 0x55f1b16abe70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f44c0014000 tx=0x7f44c0017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3541f1032364edcb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44c6a00640 1 -- 172.21.15.7:0/450655807 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0028040 con 0x55f1b1661080 2024-09-13T15:04:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44c6a00640 1 -- 172.21.15.7:0/450655807 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c0019030 con 0x55f1b1661080 2024-09-13T15:04:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44c6a00640 1 -- 172.21.15.7:0/450655807 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0003800 con 0x55f1b1661080 2024-09-13T15:04:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44df502000 1 -- 172.21.15.7:0/450655807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1661080 msgr2=0x55f1b16abe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44df502000 1 --2- 172.21.15.7:0/450655807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1661080 0x55f1b16abe70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f44c0014000 tx=0x7f44c0017070 comp rx=0 tx=0).stop 2024-09-13T15:04:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44df502000 1 -- 172.21.15.7:0/450655807 shutdown_connections 2024-09-13T15:04:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44df502000 1 --2- 172.21.15.7:0/450655807 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1669360 0x55f1b16b9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44df502000 1 --2- 172.21.15.7:0/450655807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1661080 0x55f1b16abe70 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44df502000 1 --2- 172.21.15.7:0/450655807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1660760 0x55f1b16ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44df502000 1 -- 172.21.15.7:0/450655807 >> 172.21.15.7:0/450655807 conn(0x55f1b16a2500 msgr2=0x55f1b16675d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44df502000 1 -- 172.21.15.7:0/450655807 shutdown_connections 2024-09-13T15:04:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.813+0000 7f44df502000 1 -- 172.21.15.7:0/450655807 wait complete. 2024-09-13T15:04:42.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 1 -- start start 2024-09-13T15:04:42.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 1 Processor -- start 2024-09-13T15:04:42.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1660760 0x55f1b16bd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1661080 0x55f1b1709880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1669360 0x55f1b1709dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1b14aedb0 con 0x55f1b1660760 2024-09-13T15:04:42.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1b14f45f0 con 0x55f1b1669360 2024-09-13T15:04:42.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1b14b59b0 con 0x55f1b1661080 2024-09-13T15:04:42.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 10 client.0 _ll_register_callbacks cb 0x55f1b146ecb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T15:04:42.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44d9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1660760 0x55f1b16bd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44d9600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1660760 0x55f1b16bd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36188/0 (socket says 172.21.15.7:36188) 2024-09-13T15:04:42.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44d9600640 1 -- 172.21.15.7:0/2105568514 learned_addr learned my addr 172.21.15.7:0/2105568514 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:42.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44da000640 1 --2- 172.21.15.7:0/2105568514 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1669360 0x55f1b1709dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44d8c00640 1 --2- 172.21.15.7:0/2105568514 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1661080 0x55f1b1709880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44d9600640 1 -- 172.21.15.7:0/2105568514 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1661080 msgr2=0x55f1b1709880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44d9600640 1 --2- 172.21.15.7:0/2105568514 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1661080 0x55f1b1709880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44d9600640 1 -- 172.21.15.7:0/2105568514 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1669360 msgr2=0x55f1b1709dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:42.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44d9600640 1 --2- 172.21.15.7:0/2105568514 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1669360 0x55f1b1709dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44d9600640 1 -- 172.21.15.7:0/2105568514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f1b11ad890 con 0x55f1b1660760 2024-09-13T15:04:42.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44d9600640 1 --2- 172.21.15.7:0/2105568514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1660760 0x55f1b16bd190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009870 tx=0x7f44c80a8aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a77820fa619c2f3c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:42.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44baa00640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-13T15:04:42.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44baa00640 1 -- 172.21.15.7:0/2105568514 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80f69a0 con 0x55f1b1660760 2024-09-13T15:04:42.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44baa00640 1 -- 172.21.15.7:0/2105568514 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f44c80faf60 con 0x55f1b1660760 2024-09-13T15:04:42.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 1 -- 172.21.15.7:0/2105568514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f1b1481460 con 0x55f1b1660760 2024-09-13T15:04:42.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44baa00640 1 -- 172.21.15.7:0/2105568514 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44c80ef280 con 0x55f1b1660760 2024-09-13T15:04:42.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 10 client.4935 fetch_fsmap learned FSMap version 18 2024-09-13T15:04:42.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 1 -- 172.21.15.7:0/2105568514 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55f1b11adcc0 con 0x55f1b1660760 2024-09-13T15:04:42.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44baa00640 1 -- 172.21.15.7:0/2105568514 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f1b1481460 con 0x55f1b1660760 2024-09-13T15:04:42.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44baa00640 1 -- 172.21.15.7:0/2105568514 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 18) v1 ==== 4260+0+0 (secure 0 0 0) 0x7f44c80a8d20 con 0x55f1b1660760 2024-09-13T15:04:42.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 10 client.4935 fetch_fsmap finished waiting for FSMap version 18 2024-09-13T15:04:42.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 10 client.4935 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T15:04:42.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 20 client.4935 populate_metadata read hostname 'smithi007' 2024-09-13T15:04:42.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 1 --2- 172.21.15.7:0/2105568514 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x55f1b170a300 0x55f1b1703f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:42.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 4 client.4935 mds_command: new command op to 4276 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T15:04:42.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44df502000 1 -- 172.21.15.7:0/2105568514 --> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f1b147a9c0 con 0x55f1b170a300 2024-09-13T15:04:42.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44d8c00640 1 --2- 172.21.15.7:0/2105568514 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x55f1b170a300 0x55f1b1703f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:42.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44d8c00640 1 --2- 172.21.15.7:0/2105568514 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x55f1b170a300 0x55f1b1703f20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64eddd55e5066afc server_cookie=1777a03f7f952a94 in_seq=0 out_seq=0 2024-09-13T15:04:42.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44baa00640 10 client.4935 ms_handle_connect on v2:172.21.15.7:6834/2396967179 2024-09-13T15:04:42.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44baa00640 1 -- 172.21.15.7:0/2105568514 <== mds.0 v2:172.21.15.7:6834/2396967179 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f1b147a9c0 con 0x55f1b170a300 2024-09-13T15:04:42.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.817+0000 7f44baa00640 10 client.4935 handle_command_reply: tid=0 2024-09-13T15:04:42.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44df502000 1 client.4935 shutdown 2024-09-13T15:04:42.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44df502000 1 -- 172.21.15.7:0/2105568514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1660760 msgr2=0x55f1b16bd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44df502000 1 --2- 172.21.15.7:0/2105568514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1660760 0x55f1b16bd190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009870 tx=0x7f44c80a8aa0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44df502000 1 -- 172.21.15.7:0/2105568514 shutdown_connections 2024-09-13T15:04:42.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44df502000 1 --2- 172.21.15.7:0/2105568514 >> [v2:172.21.15.7:6834/2396967179,v1:172.21.15.7:6836/2396967179] conn(0x55f1b170a300 0x55f1b1703f20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44df502000 1 --2- 172.21.15.7:0/2105568514 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1b1669360 0x55f1b1709dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44df502000 1 --2- 172.21.15.7:0/2105568514 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x55f1b1661080 0x55f1b1709880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44baa00640 0 client.4935 ms_handle_reset on v2:172.21.15.7:6834/2396967179 2024-09-13T15:04:42.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44df502000 1 --2- 172.21.15.7:0/2105568514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f1b1660760 0x55f1b16bd190 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44df502000 1 -- 172.21.15.7:0/2105568514 >> 172.21.15.7:0/2105568514 conn(0x55f1b16a2500 msgr2=0x55f1b16aa920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44df502000 1 -- 172.21.15.7:0/2105568514 shutdown_connections 2024-09-13T15:04:42.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44df502000 1 -- 172.21.15.7:0/2105568514 wait complete. 2024-09-13T15:04:42.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44df502000 20 client.4935 trim_cache size 0 max 16384 2024-09-13T15:04:42.826 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T15:04:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "92e6844f-41e8-44ce-a6e6-13b9cf520744", 2024-09-13T15:04:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-09-13T15:04:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4276, 2024-09-13T15:04:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-13T15:04:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-13T15:04:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-13T15:04:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 178.02744554200001, 2024-09-13T15:04:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 18, 2024-09-13T15:04:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 27, 2024-09-13T15:04:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 27, 2024-09-13T15:04:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 184.08470903899999 2024-09-13T15:04:42.827 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T15:04:42.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44dc000640 1 -- 172.21.15.7:0/2847014731 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f44b4066690 msgr2=0x7f44b4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44dc000640 1 --2- 172.21.15.7:0/2847014731 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f44b4066690 0x7f44b4068b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f44d4150f40 tx=0x7f44c0009040 comp rx=0 tx=0).stop 2024-09-13T15:04:42.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44dc000640 1 -- 172.21.15.7:0/2847014731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44d40c6130 msgr2=0x7f44d414fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:42.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44dc000640 1 --2- 172.21.15.7:0/2847014731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44d40c6130 0x7f44d414fcc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f44c801d400 tx=0x7f44c801baf0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44dc000640 1 -- 172.21.15.7:0/2847014731 shutdown_connections 2024-09-13T15:04:42.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44dc000640 1 --2- 172.21.15.7:0/2847014731 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f44b4066690 0x7f44b4068b50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44dc000640 1 --2- 172.21.15.7:0/2847014731 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f44d4151590 0x7f44d40c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44dc000640 1 --2- 172.21.15.7:0/2847014731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f44d40c7ea0 0x7f44d40c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44dc000640 1 --2- 172.21.15.7:0/2847014731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f44d40c6130 0x7f44d414fcc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:42.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44dc000640 1 -- 172.21.15.7:0/2847014731 >> 172.21.15.7:0/2847014731 conn(0x7f44d40c7380 msgr2=0x7f44d4070bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:42.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44dc000640 1 -- 172.21.15.7:0/2847014731 shutdown_connections 2024-09-13T15:04:42.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:42.821+0000 7f44dc000640 1 -- 172.21.15.7:0/2847014731 wait complete. 2024-09-13T15:04:42.842 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T15:04:42.852 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T15:04:42.852 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T15:04:42.853 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T15:04:42.853 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T15:04:42.871 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T15:04:42.872 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-13T15:04:42.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:42.872 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-13T15:04:42.882 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-13T15:04:42.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:42.882 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-13T15:04:42.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:42.946 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-09-13T15:04:43.230 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:04:43.234 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:04:43.600 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-13T15:04:43.600 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T15:04:43.600 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T15:04:43.600 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T15:04:43.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f1746000640 1 Processor -- start 2024-09-13T15:04:43.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f1746000640 1 -- start start 2024-09-13T15:04:43.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f1746000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f17400c5ab0 0x7f1740153020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:43.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f1746000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f17400c5e90 0x7f1740153560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:43.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f1746000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f174015cc40 0x7f174015d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:43.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f1746000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17400c8380 con 0x7f17400c5ab0 2024-09-13T15:04:43.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f1746000640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174006cce0 con 0x7f17400c5e90 2024-09-13T15:04:43.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f1746000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174015d630 con 0x7f174015cc40 2024-09-13T15:04:43.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f173f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f17400c5ab0 0x7f1740153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:43.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f173f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f17400c5ab0 0x7f1740153020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36204/0 (socket says 172.21.15.7:36204) 2024-09-13T15:04:43.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f173f400640 1 -- 172.21.15.7:0/1779872174 learned_addr learned my addr 172.21.15.7:0/1779872174 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:43.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f1737e00640 1 --2- 172.21.15.7:0/1779872174 >> v2:172.21.15.77:3300/0 conn(0x7f17400c5e90 0x7f1740153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:43.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f173fe00640 1 --2- 172.21.15.7:0/1779872174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f174015cc40 0x7f174015d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:43.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f173f400640 1 -- 172.21.15.7:0/1779872174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f174015cc40 msgr2=0x7f174015d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:43.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f173f400640 1 --2- 172.21.15.7:0/1779872174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f174015cc40 0x7f174015d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:43.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f173f400640 1 -- 172.21.15.7:0/1779872174 >> v2:172.21.15.77:3300/0 conn(0x7f17400c5e90 msgr2=0x7f1740153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:43.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f173f400640 1 --2- 172.21.15.7:0/1779872174 >> v2:172.21.15.77:3300/0 conn(0x7f17400c5e90 0x7f1740153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:43.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.745+0000 7f173f400640 1 -- 172.21.15.7:0/1779872174 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174006cf30 con 0x7f17400c5ab0 2024-09-13T15:04:43.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.749+0000 7f173f400640 1 --2- 172.21.15.7:0/1779872174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17400c5ab0 0x7f1740153020 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1740072760 tx=0x7f173001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4785219bccdcfd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:43.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.749+0000 7f173ea00640 1 -- 172.21.15.7:0/1779872174 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17300aa610 con 0x7f17400c5ab0 2024-09-13T15:04:43.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.749+0000 7f173ea00640 1 -- 172.21.15.7:0/1779872174 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17300a6040 con 0x7f17400c5ab0 2024-09-13T15:04:43.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.749+0000 7f173ea00640 1 -- 172.21.15.7:0/1779872174 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17300aa990 con 0x7f17400c5ab0 2024-09-13T15:04:43.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.749+0000 7f1746000640 1 -- 172.21.15.7:0/1779872174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17400c5ab0 msgr2=0x7f1740153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:43.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.749+0000 7f1746000640 1 --2- 172.21.15.7:0/1779872174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17400c5ab0 0x7f1740153020 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1740072760 tx=0x7f173001c4f0 comp rx=0 tx=0).stop 2024-09-13T15:04:43.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.749+0000 7f1746000640 1 -- 172.21.15.7:0/1779872174 shutdown_connections 2024-09-13T15:04:43.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.749+0000 7f1746000640 1 --2- 172.21.15.7:0/1779872174 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f174015cc40 0x7f174015d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:43.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.749+0000 7f1746000640 1 --2- 172.21.15.7:0/1779872174 >> v2:172.21.15.77:3300/0 conn(0x7f17400c5e90 0x7f1740153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:43.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.749+0000 7f1746000640 1 --2- 172.21.15.7:0/1779872174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17400c5ab0 0x7f1740153020 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:43.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.749+0000 7f1746000640 1 -- 172.21.15.7:0/1779872174 >> 172.21.15.7:0/1779872174 conn(0x7f1740065d40 msgr2=0x7f1740066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:43.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.749+0000 7f1746000640 1 -- 172.21.15.7:0/1779872174 shutdown_connections 2024-09-13T15:04:43.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.749+0000 7f1746000640 1 -- 172.21.15.7:0/1779872174 wait complete. 2024-09-13T15:04:43.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1746000640 1 Processor -- start 2024-09-13T15:04:43.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1746000640 1 -- start start 2024-09-13T15:04:43.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1746000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17400c5ab0 0x7f17401457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:43.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1746000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17400c5e90 0x7f1740145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:43.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1746000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f174015cc40 0x7f1740143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:43.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1746000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17400ca4f0 con 0x7f17400c5e90 2024-09-13T15:04:43.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1746000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17400c21d0 con 0x7f174015cc40 2024-09-13T15:04:43.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1746000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174014c260 con 0x7f17400c5ab0 2024-09-13T15:04:43.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1737e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17400c5e90 0x7f1740145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1737e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17400c5e90 0x7f1740145cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36210/0 (socket says 172.21.15.7:36210) 2024-09-13T15:04:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1737e00640 1 -- 172.21.15.7:0/1504948699 learned_addr learned my addr 172.21.15.7:0/1504948699 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f173f400640 1 --2- 172.21.15.7:0/1504948699 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17400c5ab0 0x7f17401457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f173fe00640 1 --2- 172.21.15.7:0/1504948699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f174015cc40 0x7f1740143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1737e00640 1 -- 172.21.15.7:0/1504948699 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17400c5ab0 msgr2=0x7f17401457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1737e00640 1 --2- 172.21.15.7:0/1504948699 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17400c5ab0 0x7f17401457b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1737e00640 1 -- 172.21.15.7:0/1504948699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f174015cc40 msgr2=0x7f1740143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1737e00640 1 --2- 172.21.15.7:0/1504948699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f174015cc40 0x7f1740143620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:43.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1737e00640 1 -- 172.21.15.7:0/1504948699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17300094d0 con 0x7f17400c5e90 2024-09-13T15:04:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1737e00640 1 --2- 172.21.15.7:0/1504948699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17400c5e90 0x7f1740145cf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f172800d800 tx=0x7f172800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1737400640 1 -- 172.21.15.7:0/1504948699 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17280096a0 con 0x7f17400c5e90 2024-09-13T15:04:43.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1737400640 1 -- 172.21.15.7:0/1504948699 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1728009800 con 0x7f17400c5e90 2024-09-13T15:04:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1737400640 1 -- 172.21.15.7:0/1504948699 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728009b70 con 0x7f17400c5e90 2024-09-13T15:04:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1746000640 1 -- 172.21.15.7:0/1504948699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1740146320 con 0x7f17400c5e90 2024-09-13T15:04:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.753+0000 7f1746000640 1 -- 172.21.15.7:0/1504948699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174014bf80 con 0x7f17400c5e90 2024-09-13T15:04:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.757+0000 7f1746000640 1 -- 172.21.15.7:0/1504948699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1740067650 con 0x7f17400c5e90 2024-09-13T15:04:43.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.757+0000 7f1737400640 1 -- 172.21.15.7:0/1504948699 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1728009cd0 con 0x7f17400c5e90 2024-09-13T15:04:43.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.757+0000 7f1737400640 1 --2- 172.21.15.7:0/1504948699 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f171c066690 0x7f171c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:43.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.757+0000 7f1737400640 1 -- 172.21.15.7:0/1504948699 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1728084c70 con 0x7f17400c5e90 2024-09-13T15:04:43.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.757+0000 7f173f400640 1 --2- 172.21.15.7:0/1504948699 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f171c066690 0x7f171c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:43.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.757+0000 7f173f400640 1 --2- 172.21.15.7:0/1504948699 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f171c066690 0x7f171c068b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f17300ae000 tx=0x7f17300b5040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:43.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.761+0000 7f1737400640 1 -- 172.21.15.7:0/1504948699 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1728051c30 con 0x7f17400c5e90 2024-09-13T15:04:43.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.957+0000 7f1746000640 1 -- 172.21.15.7:0/1504948699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f17400ca6a0 con 0x7f17400c5e90 2024-09-13T15:04:43.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.957+0000 7f1737400640 1 -- 172.21.15.7:0/1504948699 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+88 (secure 0 0 0) 0x7f17400ca6a0 con 0x7f17400c5e90 2024-09-13T15:04:43.961 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-13T15:04:43.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.961+0000 7f1746000640 1 -- 172.21.15.7:0/1504948699 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f171c066690 msgr2=0x7f171c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:43.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.961+0000 7f1746000640 1 --2- 172.21.15.7:0/1504948699 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f171c066690 0x7f171c068b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f17300ae000 tx=0x7f17300b5040 comp rx=0 tx=0).stop 2024-09-13T15:04:43.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.961+0000 7f1746000640 1 -- 172.21.15.7:0/1504948699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17400c5e90 msgr2=0x7f1740145cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:43.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.961+0000 7f1746000640 1 --2- 172.21.15.7:0/1504948699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17400c5e90 0x7f1740145cf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f172800d800 tx=0x7f172800dcc0 comp rx=0 tx=0).stop 2024-09-13T15:04:43.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.961+0000 7f1746000640 1 -- 172.21.15.7:0/1504948699 shutdown_connections 2024-09-13T15:04:43.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.961+0000 7f1746000640 1 --2- 172.21.15.7:0/1504948699 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f171c066690 0x7f171c068b50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:43.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.961+0000 7f1746000640 1 --2- 172.21.15.7:0/1504948699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f174015cc40 0x7f1740143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:43.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.961+0000 7f1746000640 1 --2- 172.21.15.7:0/1504948699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f17400c5e90 0x7f1740145cf0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:43.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.961+0000 7f1746000640 1 --2- 172.21.15.7:0/1504948699 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f17400c5ab0 0x7f17401457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:43.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.961+0000 7f1746000640 1 -- 172.21.15.7:0/1504948699 >> 172.21.15.7:0/1504948699 conn(0x7f1740065d40 msgr2=0x7f1740070740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:43.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.961+0000 7f1746000640 1 -- 172.21.15.7:0/1504948699 shutdown_connections 2024-09-13T15:04:43.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:43.961+0000 7f1746000640 1 -- 172.21.15.7:0/1504948699 wait complete. 2024-09-13T15:04:43.982 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T15:04:43.982 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T15:04:43.983 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-09-13T15:04:43.983 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T15:04:43.983 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T15:04:43.983 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T15:04:43.983 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T15:04:43.983 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T15:04:43.983 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:04:43.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:43.983 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-09-13T15:04:43.993 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T15:04:43.993 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T15:04:43.993 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T15:04:43.993 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:04:43.993 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-09-13T15:04:43.993 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:04:43.994 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:04:43.994 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-09-13T15:04:43.994 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-09-13T15:04:43.994 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:04:43.994 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-09-13T15:04:43.994 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-09-13T15:04:43.994 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T15:04:43.994 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-09-13T15:04:43.994 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-09-13T15:04:43.994 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-13T15:04:43.994 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42283sec preferred_lft 42283sec 2024-09-13T15:04:43.995 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-09-13T15:04:43.995 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:04:43.995 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T15:04:43.995 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-09-13T15:04:43.995 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-09-13T15:04:43.995 INFO:teuthology.orchestra.run.smithi007.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T15:04:43.995 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 02:42:5c:b8:91:c4 brd ff:ff:ff:ff:ff:ff 2024-09-13T15:04:43.995 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T15:04:43.995 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-13T15:04:43.996 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T15:04:43.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:43.996 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-09-13T15:04:43.996 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-13T15:04:43.996 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add name ceph-brx type bridge 2024-09-13T15:04:43.996 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr flush dev ceph-brx 2024-09-13T15:04:43.996 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set ceph-brx up 2024-09-13T15:04:43.996 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T15:04:43.996 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-13T15:04:44.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:44.107 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T15:04:44.126 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-09-13T15:04:44.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:44.128 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-09-13T15:04:44.182 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-09-13T15:04:44.182 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T15:04:44.182 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-13T15:04:44.182 INFO:teuthology.orchestra.run.smithi007.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T15:04:44.183 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-13T15:04:44.183 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T15:04:44.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:44.183 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-09-13T15:04:44.183 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-13T15:04:44.183 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-13T15:04:44.183 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-13T15:04:44.183 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-13T15:04:44.183 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-13T15:04:44.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:44.279 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-13T15:04:44.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:44.289 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2024-09-13T15:04:44.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:44.338 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-09-13T15:04:44.338 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-13T15:04:44.338 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T15:04:44.338 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T15:04:44.338 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-13T15:04:44.419 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T15:04:44.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:44.419 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-09-13T15:04:44.419 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-13T15:04:44.419 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T15:04:44.419 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T15:04:44.419 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T15:04:44.419 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T15:04:44.420 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T15:04:44.420 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-13T15:04:44.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:44.556 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2024-09-13T15:04:44.556 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-13T15:04:44.556 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-09-13T15:04:44.556 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T15:04:44.556 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-13T15:04:44.594 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:04:44.595 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T15:04:44.649 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T15:04:44.649 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T15:04:44.649 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:04:44.704 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T15:04:44.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:44.704 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T15:04:44.800 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T15:04:44.800 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T15:04:44.800 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-09-13T15:04:45.470 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T15:04:45.470 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T15:04:45.471 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-09-13T15:04:45.471 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-13T15:04:45.471 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T15:04:45.486 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T15:04:45.486 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T15:04:45.486 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-09-13T15:04:45.486 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.77:3300,172.21.15.77:3301" 2024-09-13T15:04:45.486 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T15:04:45.486 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:6789,172.21.15.77:6789,172.21.15.77:6790" 2024-09-13T15:04:45.487 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:6789,172.21.15.77:6789,172.21.15.77:6790:/ 2024-09-13T15:04:45.487 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=92e6844f-41e8-44ce-a6e6-13b9cf520744" will pass to kernel 2024-09-13T15:04:45.490 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T15:04:45.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:45.491 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T15:04:45.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:45.512 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:04:45.565 INFO:teuthology.orchestra.run.smithi007.stdout:client4799 2024-09-13T15:04:45.565 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:04:45.565 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:04:45.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:45.618 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:04:45.672 INFO:teuthology.orchestra.run.smithi007.stdout:client4799 2024-09-13T15:04:45.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:45.673 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T15:04:45.729 INFO:teuthology.orchestra.run.smithi007.stdout:client4799 2024-09-13T15:04:45.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:04:45.729 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/92e6844f-41e8-44ce-a6e6-13b9cf520744.client4799/status') 2024-09-13T15:04:45.799 INFO:teuthology.orchestra.run.smithi007.stdout:instance: client.4799 (3)172.21.15.7:0/1299683001 2024-09-13T15:04:45.799 INFO:teuthology.orchestra.run.smithi007.stdout:blocklisted: false 2024-09-13T15:04:45.799 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records in 2024-09-13T15:04:45.800 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records out 2024-09-13T15:04:45.800 INFO:teuthology.orchestra.run.smithi007.stderr:69 bytes copied, 7.7653e-05 s, 889 kB/s 2024-09-13T15:04:45.802 INFO:teuthology.run_tasks:Running task mds_thrash... 2024-09-13T15:04:45.817 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:04:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:45.997+0000 7fbd1ac00640 1 Processor -- start 2024-09-13T15:04:46.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.001+0000 7fbd1ac00640 1 -- start start 2024-09-13T15:04:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.001+0000 7fbd1ac00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd14150f40 0x7fbd141579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.001+0000 7fbd1ac00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbd14158480 0x7fbd14066180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.001+0000 7fbd1ac00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd140c5d30 con 0x7fbd140666c0 2024-09-13T15:04:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.001+0000 7fbd1ac00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd14156f90 con 0x7fbd14158480 2024-09-13T15:04:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.001+0000 7fbd1ac00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd14157510 con 0x7fbd14150f40 2024-09-13T15:04:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.001+0000 7fbd18c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fbd140666c0 0x7fbd1415a580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:32918/0 (socket says 172.21.15.7:32918) 2024-09-13T15:04:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.001+0000 7fbd18c00640 1 -- 172.21.15.7:0/3365287693 learned_addr learned my addr 172.21.15.7:0/3365287693 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:46.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.001+0000 7fbd13400640 1 --2- 172.21.15.7:0/3365287693 >> v2:172.21.15.77:3300/0 conn(0x7fbd14158480 0x7fbd14066180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.001+0000 7fbd13e00640 1 --2- 172.21.15.7:0/3365287693 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd14150f40 0x7fbd141579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.001+0000 7fbd12a00640 1 -- 172.21.15.7:0/3365287693 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940092060 0 0) 0x7fbd0c0014a0 con 0x7fbd140666c0 2024-09-13T15:04:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.001+0000 7fbd12a00640 1 -- 172.21.15.7:0/3365287693 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcf8003530 con 0x7fbd140666c0 2024-09-13T15:04:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.001+0000 7fbd13400640 1 -- 172.21.15.7:0/3365287693 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd14150f40 msgr2=0x7fbd141579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.001+0000 7fbd13400640 1 --2- 172.21.15.7:0/3365287693 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd14150f40 0x7fbd141579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.001+0000 7fbd13400640 1 -- 172.21.15.7:0/3365287693 >> v1:172.21.15.7:6789/0 conn(0x7fbd140666c0 legacy=0x7fbd1415a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.001+0000 7fbd13400640 1 -- 172.21.15.7:0/3365287693 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd140c5490 con 0x7fbd14158480 2024-09-13T15:04:46.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.005+0000 7fbd13400640 1 --2- 172.21.15.7:0/3365287693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd14158480 0x7fbd14066180 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbd000097c0 tx=0x7fbd0001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8ed337375e816e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:46.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.005+0000 7fbd12a00640 1 -- 172.21.15.7:0/3365287693 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd000ab600 con 0x7fbd14158480 2024-09-13T15:04:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.005+0000 7fbd12a00640 1 -- 172.21.15.7:0/3365287693 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd000a7050 con 0x7fbd14158480 2024-09-13T15:04:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.005+0000 7fbd12a00640 1 -- 172.21.15.7:0/3365287693 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd000ab980 con 0x7fbd14158480 2024-09-13T15:04:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.005+0000 7fbd1ac00640 1 -- 172.21.15.7:0/3365287693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd14158480 msgr2=0x7fbd14066180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.005+0000 7fbd1ac00640 1 --2- 172.21.15.7:0/3365287693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd14158480 0x7fbd14066180 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbd000097c0 tx=0x7fbd0001c470 comp rx=0 tx=0).stop 2024-09-13T15:04:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.005+0000 7fbd1ac00640 1 -- 172.21.15.7:0/3365287693 shutdown_connections 2024-09-13T15:04:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.005+0000 7fbd1ac00640 1 --2- 172.21.15.7:0/3365287693 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd14158480 0x7fbd14066180 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.005+0000 7fbd1ac00640 1 --2- 172.21.15.7:0/3365287693 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd14150f40 0x7fbd141579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.005+0000 7fbd1ac00640 1 -- 172.21.15.7:0/3365287693 >> 172.21.15.7:0/3365287693 conn(0x7fbd1406e110 msgr2=0x7fbd1406e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.005+0000 7fbd1ac00640 1 -- 172.21.15.7:0/3365287693 shutdown_connections 2024-09-13T15:04:46.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.005+0000 7fbd1ac00640 1 -- 172.21.15.7:0/3365287693 wait complete. 2024-09-13T15:04:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.005+0000 7fbd1ac00640 1 Processor -- start 2024-09-13T15:04:46.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.005+0000 7fbd1ac00640 1 -- start start 2024-09-13T15:04:46.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd1ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd140666c0 0x7fbd141f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd1ac00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd14150f40 0x7fbd14144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd1ac00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd14158480 0x7fbd14145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd1ac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd141426a0 con 0x7fbd140666c0 2024-09-13T15:04:46.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd1ac00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd14162690 con 0x7fbd14150f40 2024-09-13T15:04:46.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd1ac00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd14146920 con 0x7fbd14158480 2024-09-13T15:04:46.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd13e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd140666c0 0x7fbd141f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd13e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd140666c0 0x7fbd141f3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36218/0 (socket says 172.21.15.7:36218) 2024-09-13T15:04:46.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd13e00640 1 -- 172.21.15.7:0/2178865115 learned_addr learned my addr 172.21.15.7:0/2178865115 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:46.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd13400640 1 --2- 172.21.15.7:0/2178865115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd14150f40 0x7fbd14144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd18c00640 1 --2- 172.21.15.7:0/2178865115 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd14158480 0x7fbd14145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd13e00640 1 -- 172.21.15.7:0/2178865115 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd14158480 msgr2=0x7fbd14145190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd13e00640 1 --2- 172.21.15.7:0/2178865115 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd14158480 0x7fbd14145190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd13e00640 1 -- 172.21.15.7:0/2178865115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd14150f40 msgr2=0x7fbd14144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd13e00640 1 --2- 172.21.15.7:0/2178865115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd14150f40 0x7fbd14144c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd13e00640 1 -- 172.21.15.7:0/2178865115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd00009420 con 0x7fbd140666c0 2024-09-13T15:04:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd13e00640 1 --2- 172.21.15.7:0/2178865115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd140666c0 0x7fbd141f3000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400e960 tx=0x7fbd0400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd0be00640 1 -- 172.21.15.7:0/2178865115 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd04009690 con 0x7fbd140666c0 2024-09-13T15:04:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd0be00640 1 -- 172.21.15.7:0/2178865115 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0400c9a0 con 0x7fbd140666c0 2024-09-13T15:04:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd0be00640 1 -- 172.21.15.7:0/2178865115 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0400cd10 con 0x7fbd140666c0 2024-09-13T15:04:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd1ac00640 1 -- 172.21.15.7:0/2178865115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd141456d0 con 0x7fbd140666c0 2024-09-13T15:04:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd1ac00640 1 -- 172.21.15.7:0/2178865115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd141501a0 con 0x7fbd140666c0 2024-09-13T15:04:46.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.009+0000 7fbd1ac00640 1 -- 172.21.15.7:0/2178865115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd14141e50 con 0x7fbd140666c0 2024-09-13T15:04:46.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.013+0000 7fbd0be00640 1 -- 172.21.15.7:0/2178865115 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbd04013470 con 0x7fbd140666c0 2024-09-13T15:04:46.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.013+0000 7fbd0be00640 1 --2- 172.21.15.7:0/2178865115 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbcf4066690 0x7fbcf4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.013+0000 7fbd0be00640 1 -- 172.21.15.7:0/2178865115 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbd04084870 con 0x7fbd140666c0 2024-09-13T15:04:46.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.013+0000 7fbd13400640 1 --2- 172.21.15.7:0/2178865115 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbcf4066690 0x7fbcf4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.013+0000 7fbd13400640 1 --2- 172.21.15.7:0/2178865115 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbcf4066690 0x7fbcf4068b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbd000ad000 tx=0x7fbd000a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:46.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.017+0000 7fbd0be00640 1 -- 172.21.15.7:0/2178865115 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbd040516f0 con 0x7fbd140666c0 2024-09-13T15:04:46.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.177+0000 7fbd1ac00640 1 -- 172.21.15.7:0/2178865115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd14067a60 con 0x7fbd140666c0 2024-09-13T15:04:46.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.177+0000 7fbd0be00640 1 -- 172.21.15.7:0/2178865115 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18616 (secure 0 0 0) 0x7fbd04054d10 con 0x7fbd140666c0 2024-09-13T15:04:46.181 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:46.181 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:02:33.732864+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:04:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.181+0000 7fbd1ac00640 1 -- 172.21.15.7:0/2178865115 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbcf4066690 msgr2=0x7fbcf4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.181+0000 7fbd1ac00640 1 --2- 172.21.15.7:0/2178865115 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbcf4066690 0x7fbcf4068b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbd000ad000 tx=0x7fbd000a6000 comp rx=0 tx=0).stop 2024-09-13T15:04:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.181+0000 7fbd1ac00640 1 -- 172.21.15.7:0/2178865115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd140666c0 msgr2=0x7fbd141f3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.181+0000 7fbd1ac00640 1 --2- 172.21.15.7:0/2178865115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd140666c0 0x7fbd141f3000 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbd0400e960 tx=0x7fbd0400ee20 comp rx=0 tx=0).stop 2024-09-13T15:04:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.181+0000 7fbd1ac00640 1 -- 172.21.15.7:0/2178865115 shutdown_connections 2024-09-13T15:04:46.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.181+0000 7fbd1ac00640 1 --2- 172.21.15.7:0/2178865115 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbcf4066690 0x7fbcf4068b50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.181+0000 7fbd1ac00640 1 --2- 172.21.15.7:0/2178865115 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbd14158480 0x7fbd14145190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.181+0000 7fbd1ac00640 1 --2- 172.21.15.7:0/2178865115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbd14150f40 0x7fbd14144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.181+0000 7fbd1ac00640 1 --2- 172.21.15.7:0/2178865115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd140666c0 0x7fbd141f3000 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.181+0000 7fbd1ac00640 1 -- 172.21.15.7:0/2178865115 >> 172.21.15.7:0/2178865115 conn(0x7fbd1406e110 msgr2=0x7fbd140caf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:46.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.181+0000 7fbd1ac00640 1 -- 172.21.15.7:0/2178865115 shutdown_connections 2024-09-13T15:04:46.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.181+0000 7fbd1ac00640 1 -- 172.21.15.7:0/2178865115 wait complete. 2024-09-13T15:04:46.203 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:01:38.710958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:01:43.178724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:01:43.774877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:01:46.843203+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:04:46.204 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:04:46.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f9183e00640 1 Processor -- start 2024-09-13T15:04:46.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f9183e00640 1 -- start start 2024-09-13T15:04:46.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f9183e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f917c150d90 0x7f917c157590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f9183e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917c157100 con 0x7f917c157ad0 2024-09-13T15:04:46.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f9183e00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917c15a3a0 con 0x7f917c0c1880 2024-09-13T15:04:46.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f9183e00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917c066b00 con 0x7f917c150d90 2024-09-13T15:04:46.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f9180a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f917c157ad0 0x7f917c0c56f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:32922/0 (socket says 172.21.15.7:32922) 2024-09-13T15:04:46.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f9180a00640 1 -- 172.21.15.7:0/3068307173 learned_addr learned my addr 172.21.15.7:0/3068307173 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:46.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f9181400640 1 --2- 172.21.15.7:0/3068307173 >> v2:172.21.15.77:3300/0 conn(0x7f917c150d90 0x7f917c157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f917be00640 1 -- 172.21.15.7:0/3068307173 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279757138 0 0) 0x7f917c157100 con 0x7f917c157ad0 2024-09-13T15:04:46.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f917be00640 1 -- 172.21.15.7:0/3068307173 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9164003530 con 0x7f917c157ad0 2024-09-13T15:04:46.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f917be00640 1 -- 172.21.15.7:0/3068307173 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2347282756 0 0) 0x7f9164003530 con 0x7f917c157ad0 2024-09-13T15:04:46.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f917be00640 1 -- 172.21.15.7:0/3068307173 >> v2:172.21.15.77:3300/0 conn(0x7f917c150d90 msgr2=0x7f917c157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:46.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f917be00640 1 --2- 172.21.15.7:0/3068307173 >> v2:172.21.15.77:3300/0 conn(0x7f917c150d90 0x7f917c157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f917be00640 1 -- 172.21.15.7:0/3068307173 >> v1:172.21.15.77:6789/0 conn(0x7f917c0c1880 legacy=0x7f917c071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f917be00640 1 -- 172.21.15.7:0/3068307173 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c156db0 con 0x7f917c157ad0 2024-09-13T15:04:46.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f917be00640 1 -- 172.21.15.7:0/3068307173 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f9168001680 con 0x7f917c157ad0 2024-09-13T15:04:46.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f917be00640 1 -- 172.21.15.7:0/3068307173 >> v1:172.21.15.7:6789/0 conn(0x7f917c157ad0 legacy=0x7f917c0c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f917be00640 1 --2- 172.21.15.7:0/3068307173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9164003980 0x7f9164003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.345+0000 7f917be00640 1 --2- 172.21.15.7:0/3068307173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91640047d0 0x7f9164004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.349+0000 7f917be00640 1 --2- 172.21.15.7:0/3068307173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9164005190 0x7f916400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.349+0000 7f917be00640 1 -- 172.21.15.7:0/3068307173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916400c010 con 0x7f9164005190 2024-09-13T15:04:46.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.349+0000 7f917be00640 1 -- 172.21.15.7:0/3068307173 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916400c180 con 0x7f9164003980 2024-09-13T15:04:46.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.349+0000 7f917be00640 1 -- 172.21.15.7:0/3068307173 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916400c340 con 0x7f91640047d0 2024-09-13T15:04:46.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.349+0000 7f9181400640 1 --2- 172.21.15.7:0/3068307173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9164003980 0x7f9164003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.349+0000 7f9181e00640 1 --2- 172.21.15.7:0/3068307173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9164005190 0x7f916400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.349+0000 7f9180a00640 1 --2- 172.21.15.7:0/3068307173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91640047d0 0x7f9164004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.349+0000 7f9181e00640 1 -- 172.21.15.7:0/3068307173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91640047d0 msgr2=0x7f9164004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:46.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.349+0000 7f9181e00640 1 --2- 172.21.15.7:0/3068307173 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f91640047d0 0x7f9164004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.349+0000 7f9181e00640 1 -- 172.21.15.7:0/3068307173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9164003980 msgr2=0x7f9164003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:46.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.349+0000 7f9181e00640 1 --2- 172.21.15.7:0/3068307173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9164003980 0x7f9164003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.349+0000 7f9181e00640 1 -- 172.21.15.7:0/3068307173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9164003530 con 0x7f9164005190 2024-09-13T15:04:46.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.349+0000 7f9181e00640 1 -- 172.21.15.7:0/3068307173 reap_dead start 2024-09-13T15:04:46.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.349+0000 7f9181e00640 1 --2- 172.21.15.7:0/3068307173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9164005190 0x7f916400b990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9174001e70 tx=0x7f917401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=962c4add931f621c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:46.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.349+0000 7f917be00640 1 -- 172.21.15.7:0/3068307173 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174003b80 con 0x7f9164005190 2024-09-13T15:04:46.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.349+0000 7f917be00640 1 -- 172.21.15.7:0/3068307173 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9174003d20 con 0x7f9164005190 2024-09-13T15:04:46.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.349+0000 7f917be00640 1 -- 172.21.15.7:0/3068307173 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174005260 con 0x7f9164005190 2024-09-13T15:04:46.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9183e00640 1 -- 172.21.15.7:0/3068307173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9164005190 msgr2=0x7f916400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9183e00640 1 --2- 172.21.15.7:0/3068307173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9164005190 0x7f916400b990 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9174001e70 tx=0x7f917401c780 comp rx=0 tx=0).stop 2024-09-13T15:04:46.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9183e00640 1 -- 172.21.15.7:0/3068307173 shutdown_connections 2024-09-13T15:04:46.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9183e00640 1 --2- 172.21.15.7:0/3068307173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9164005190 0x7f916400b990 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9183e00640 1 -- 172.21.15.7:0/3068307173 >> 172.21.15.7:0/3068307173 conn(0x7f917c065d40 msgr2=0x7f917c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:46.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9183e00640 1 -- 172.21.15.7:0/3068307173 shutdown_connections 2024-09-13T15:04:46.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9183e00640 1 -- 172.21.15.7:0/3068307173 wait complete. 2024-09-13T15:04:46.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9183e00640 1 Processor -- start 2024-09-13T15:04:46.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9183e00640 1 -- start start 2024-09-13T15:04:46.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9183e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9164005190 0x7f917c144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9183e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f917c06fd50 0x7f917c1ea690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9183e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f917c1eabd0 0x7f917c146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9183e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c0c5ef0 con 0x7f9164005190 2024-09-13T15:04:46.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9183e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c1ee5d0 con 0x7f917c06fd50 2024-09-13T15:04:46.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9183e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c0716d0 con 0x7f917c1eabd0 2024-09-13T15:04:46.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9181400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9164005190 0x7f917c144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9181400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9164005190 0x7f917c144a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36240/0 (socket says 172.21.15.7:36240) 2024-09-13T15:04:46.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9181400640 1 -- 172.21.15.7:0/3825056196 learned_addr learned my addr 172.21.15.7:0/3825056196 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:46.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9180a00640 1 --2- 172.21.15.7:0/3825056196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f917c06fd50 0x7f917c1ea690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9181e00640 1 --2- 172.21.15.7:0/3825056196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f917c1eabd0 0x7f917c146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9181400640 1 -- 172.21.15.7:0/3825056196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f917c1eabd0 msgr2=0x7f917c146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9181400640 1 --2- 172.21.15.7:0/3825056196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f917c1eabd0 0x7f917c146460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9181400640 1 -- 172.21.15.7:0/3825056196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f917c06fd50 msgr2=0x7f917c1ea690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9181400640 1 --2- 172.21.15.7:0/3825056196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f917c06fd50 0x7f917c1ea690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9181400640 1 -- 172.21.15.7:0/3825056196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c0713f0 con 0x7f9164005190 2024-09-13T15:04:46.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.353+0000 7f9181400640 1 --2- 172.21.15.7:0/3825056196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9164005190 0x7f917c144a10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9170011960 tx=0x7f9170011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:46.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.357+0000 7f9179600640 1 -- 172.21.15.7:0/3825056196 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917000fa70 con 0x7f9164005190 2024-09-13T15:04:46.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.357+0000 7f9179600640 1 -- 172.21.15.7:0/3825056196 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917000fbd0 con 0x7f9164005190 2024-09-13T15:04:46.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.357+0000 7f9179600640 1 -- 172.21.15.7:0/3825056196 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170014440 con 0x7f9164005190 2024-09-13T15:04:46.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.357+0000 7f9183e00640 1 -- 172.21.15.7:0/3825056196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917c1edca0 con 0x7f9164005190 2024-09-13T15:04:46.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.357+0000 7f9183e00640 1 -- 172.21.15.7:0/3825056196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917c1ee260 con 0x7f9164005190 2024-09-13T15:04:46.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.357+0000 7f9183e00640 1 -- 172.21.15.7:0/3825056196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917c157590 con 0x7f9164005190 2024-09-13T15:04:46.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.357+0000 7f9179600640 1 -- 172.21.15.7:0/3825056196 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f91700145a0 con 0x7f9164005190 2024-09-13T15:04:46.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.357+0000 7f9179600640 1 --2- 172.21.15.7:0/3825056196 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f915c066690 0x7f915c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.357+0000 7f9179600640 1 -- 172.21.15.7:0/3825056196 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9170084dd0 con 0x7f9164005190 2024-09-13T15:04:46.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.357+0000 7f9180a00640 1 --2- 172.21.15.7:0/3825056196 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f915c066690 0x7f915c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.361+0000 7f9180a00640 1 --2- 172.21.15.7:0/3825056196 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f915c066690 0x7f915c068b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f91680017b0 tx=0x7f9168001660 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:46.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.361+0000 7f9179600640 1 -- 172.21.15.7:0/3825056196 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9170051c50 con 0x7f9164005190 2024-09-13T15:04:46.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.521+0000 7f9183e00640 1 -- 172.21.15.7:0/3825056196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f917c1503e0 con 0x7f9164005190 2024-09-13T15:04:46.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.521+0000 7f9179600640 1 -- 172.21.15.7:0/3825056196 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9170022070 con 0x7f9164005190 2024-09-13T15:04:46.525 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T15:04:46.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.525+0000 7f9183e00640 1 -- 172.21.15.7:0/3825056196 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f915c066690 msgr2=0x7f915c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.525+0000 7f9183e00640 1 --2- 172.21.15.7:0/3825056196 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f915c066690 0x7f915c068b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f91680017b0 tx=0x7f9168001660 comp rx=0 tx=0).stop 2024-09-13T15:04:46.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.525+0000 7f9183e00640 1 -- 172.21.15.7:0/3825056196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9164005190 msgr2=0x7f917c144a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.525+0000 7f9183e00640 1 --2- 172.21.15.7:0/3825056196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9164005190 0x7f917c144a10 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9170011960 tx=0x7f9170011e20 comp rx=0 tx=0).stop 2024-09-13T15:04:46.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.525+0000 7f9183e00640 1 -- 172.21.15.7:0/3825056196 shutdown_connections 2024-09-13T15:04:46.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.525+0000 7f9183e00640 1 --2- 172.21.15.7:0/3825056196 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f915c066690 0x7f915c068b50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.525+0000 7f9183e00640 1 --2- 172.21.15.7:0/3825056196 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f917c1eabd0 0x7f917c146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.525+0000 7f9183e00640 1 --2- 172.21.15.7:0/3825056196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f917c06fd50 0x7f917c1ea690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.525+0000 7f9183e00640 1 --2- 172.21.15.7:0/3825056196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9164005190 0x7f917c144a10 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.525+0000 7f9183e00640 1 -- 172.21.15.7:0/3825056196 >> 172.21.15.7:0/3825056196 conn(0x7f917c065d40 msgr2=0x7f917c06d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:46.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.525+0000 7f9183e00640 1 -- 172.21.15.7:0/3825056196 shutdown_connections 2024-09-13T15:04:46.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.525+0000 7f9183e00640 1 -- 172.21.15.7:0/3825056196 wait complete. 2024-09-13T15:04:46.547 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:04:46.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.689+0000 7f7d67600640 1 Processor -- start 2024-09-13T15:04:46.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.689+0000 7f7d67600640 1 -- start start 2024-09-13T15:04:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.689+0000 7f7d67600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7d60071810 0x7f7d60071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.689+0000 7f7d67600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d60157100 con 0x7f7d600c1880 2024-09-13T15:04:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.689+0000 7f7d67600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d6015a3a0 con 0x7f7d60150d90 2024-09-13T15:04:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.689+0000 7f7d67600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d60066b00 con 0x7f7d60071810 2024-09-13T15:04:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.689+0000 7f7d5fe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7d600c1880 0x7f7d600c56f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:32932/0 (socket says 172.21.15.7:32932) 2024-09-13T15:04:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.689+0000 7f7d5fe00640 1 -- 172.21.15.7:0/159665720 learned_addr learned my addr 172.21.15.7:0/159665720 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:46.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.689+0000 7f7d65600640 1 --2- 172.21.15.7:0/159665720 >> v2:172.21.15.7:3300/0 conn(0x7f7d60071810 0x7f7d60071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.689+0000 7f7d5f400640 1 -- 172.21.15.7:0/159665720 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235508288 0 0) 0x7f7d60157100 con 0x7f7d600c1880 2024-09-13T15:04:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.689+0000 7f7d5f400640 1 -- 172.21.15.7:0/159665720 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d48003530 con 0x7f7d600c1880 2024-09-13T15:04:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.689+0000 7f7d65600640 1 -- 172.21.15.7:0/159665720 >> v1:172.21.15.77:6789/0 conn(0x7f7d60150d90 legacy=0x7f7d60157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.689+0000 7f7d65600640 1 -- 172.21.15.7:0/159665720 >> v1:172.21.15.7:6789/0 conn(0x7f7d600c1880 legacy=0x7f7d600c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.689+0000 7f7d65600640 1 -- 172.21.15.7:0/159665720 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d60156db0 con 0x7f7d60071810 2024-09-13T15:04:46.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.693+0000 7f7d65600640 1 --2- 172.21.15.7:0/159665720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d60071810 0x7f7d60071c60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009d90 tx=0x7f7d5801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0bf015034e7107 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:46.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.693+0000 7f7d5f400640 1 -- 172.21.15.7:0/159665720 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d580af600 con 0x7f7d60071810 2024-09-13T15:04:46.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.693+0000 7f7d5f400640 1 -- 172.21.15.7:0/159665720 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d580ab050 con 0x7f7d60071810 2024-09-13T15:04:46.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.693+0000 7f7d5f400640 1 -- 172.21.15.7:0/159665720 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d580af980 con 0x7f7d60071810 2024-09-13T15:04:46.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.693+0000 7f7d67600640 1 -- 172.21.15.7:0/159665720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d60071810 msgr2=0x7f7d60071c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.693+0000 7f7d67600640 1 --2- 172.21.15.7:0/159665720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d60071810 0x7f7d60071c60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009d90 tx=0x7f7d5801f150 comp rx=0 tx=0).stop 2024-09-13T15:04:46.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.693+0000 7f7d67600640 1 -- 172.21.15.7:0/159665720 shutdown_connections 2024-09-13T15:04:46.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.693+0000 7f7d67600640 1 --2- 172.21.15.7:0/159665720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d60071810 0x7f7d60071c60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.693+0000 7f7d67600640 1 -- 172.21.15.7:0/159665720 >> 172.21.15.7:0/159665720 conn(0x7f7d60065d40 msgr2=0x7f7d60066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:46.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.693+0000 7f7d67600640 1 -- 172.21.15.7:0/159665720 shutdown_connections 2024-09-13T15:04:46.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.693+0000 7f7d67600640 1 -- 172.21.15.7:0/159665720 wait complete. 2024-09-13T15:04:46.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d67600640 1 Processor -- start 2024-09-13T15:04:46.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d67600640 1 -- start start 2024-09-13T15:04:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d67600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d60071810 0x7f7d6014f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d67600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d600c1880 0x7f7d60070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d67600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d60150d90 0x7f7d6006fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d67600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d600ca220 con 0x7f7d600c1880 2024-09-13T15:04:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d67600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d600ca6b0 con 0x7f7d60071810 2024-09-13T15:04:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d67600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6014e5c0 con 0x7f7d60150d90 2024-09-13T15:04:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d5fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d600c1880 0x7f7d60070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d5fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d600c1880 0x7f7d60070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36254/0 (socket says 172.21.15.7:36254) 2024-09-13T15:04:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d5fe00640 1 -- 172.21.15.7:0/484531265 learned_addr learned my addr 172.21.15.7:0/484531265 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:46.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d64c00640 1 --2- 172.21.15.7:0/484531265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d60071810 0x7f7d6014f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d65600640 1 --2- 172.21.15.7:0/484531265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d60150d90 0x7f7d6006fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d5fe00640 1 -- 172.21.15.7:0/484531265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d60150d90 msgr2=0x7f7d6006fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d5fe00640 1 --2- 172.21.15.7:0/484531265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d60150d90 0x7f7d6006fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d5fe00640 1 -- 172.21.15.7:0/484531265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d60071810 msgr2=0x7f7d6014f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d5fe00640 1 --2- 172.21.15.7:0/484531265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d60071810 0x7f7d6014f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d5fe00640 1 -- 172.21.15.7:0/484531265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d58009a70 con 0x7f7d600c1880 2024-09-13T15:04:46.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d5fe00640 1 --2- 172.21.15.7:0/484531265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d600c1880 0x7f7d60070f70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00c4d0 tx=0x7f7d4c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:46.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d5cc00640 1 -- 172.21.15.7:0/484531265 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c005cf0 con 0x7f7d600c1880 2024-09-13T15:04:46.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d5cc00640 1 -- 172.21.15.7:0/484531265 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4c005e50 con 0x7f7d600c1880 2024-09-13T15:04:46.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d5cc00640 1 -- 172.21.15.7:0/484531265 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c007270 con 0x7f7d600c1880 2024-09-13T15:04:46.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d67600640 1 -- 172.21.15.7:0/484531265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d600c9980 con 0x7f7d600c1880 2024-09-13T15:04:46.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.697+0000 7f7d67600640 1 -- 172.21.15.7:0/484531265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6014e860 con 0x7f7d600c1880 2024-09-13T15:04:46.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.701+0000 7f7d67600640 1 -- 172.21.15.7:0/484531265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d60151170 con 0x7f7d600c1880 2024-09-13T15:04:46.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.701+0000 7f7d5cc00640 1 -- 172.21.15.7:0/484531265 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7d4c0073d0 con 0x7f7d600c1880 2024-09-13T15:04:46.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.701+0000 7f7d5cc00640 1 --2- 172.21.15.7:0/484531265 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d40066690 0x7f7d40068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:46.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.701+0000 7f7d5cc00640 1 -- 172.21.15.7:0/484531265 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7d4c083ad0 con 0x7f7d600c1880 2024-09-13T15:04:46.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.701+0000 7f7d64c00640 1 --2- 172.21.15.7:0/484531265 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d40066690 0x7f7d40068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:46.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.701+0000 7f7d64c00640 1 --2- 172.21.15.7:0/484531265 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d40066690 0x7f7d40068b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7d54007fd0 tx=0x7f7d54009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:46.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.705+0000 7f7d5cc00640 1 -- 172.21.15.7:0/484531265 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7d4c050b20 con 0x7f7d600c1880 2024-09-13T15:04:46.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.869+0000 7f7d67600640 1 -- 172.21.15.7:0/484531265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7d600c6650 con 0x7f7d600c1880 2024-09-13T15:04:46.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.869+0000 7f7d5cc00640 1 -- 172.21.15.7:0/484531265 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7d4c017020 con 0x7f7d600c1880 2024-09-13T15:04:46.872 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T15:04:46.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.873+0000 7f7d67600640 1 -- 172.21.15.7:0/484531265 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d40066690 msgr2=0x7f7d40068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.873+0000 7f7d67600640 1 --2- 172.21.15.7:0/484531265 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d40066690 0x7f7d40068b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7d54007fd0 tx=0x7f7d54009040 comp rx=0 tx=0).stop 2024-09-13T15:04:46.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.873+0000 7f7d67600640 1 -- 172.21.15.7:0/484531265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d600c1880 msgr2=0x7f7d60070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:46.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.873+0000 7f7d67600640 1 --2- 172.21.15.7:0/484531265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d600c1880 0x7f7d60070f70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00c4d0 tx=0x7f7d4c00c990 comp rx=0 tx=0).stop 2024-09-13T15:04:46.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.873+0000 7f7d67600640 1 -- 172.21.15.7:0/484531265 shutdown_connections 2024-09-13T15:04:46.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.873+0000 7f7d67600640 1 --2- 172.21.15.7:0/484531265 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7d40066690 0x7f7d40068b50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.873+0000 7f7d67600640 1 --2- 172.21.15.7:0/484531265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7d60150d90 0x7f7d6006fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.873+0000 7f7d67600640 1 --2- 172.21.15.7:0/484531265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d600c1880 0x7f7d60070f70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.873+0000 7f7d67600640 1 --2- 172.21.15.7:0/484531265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7d60071810 0x7f7d6014f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:46.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.873+0000 7f7d67600640 1 -- 172.21.15.7:0/484531265 >> 172.21.15.7:0/484531265 conn(0x7f7d60065d40 msgr2=0x7f7d60155a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:46.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.873+0000 7f7d67600640 1 -- 172.21.15.7:0/484531265 shutdown_connections 2024-09-13T15:04:46.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:46.873+0000 7f7d67600640 1 -- 172.21.15.7:0/484531265 wait complete. 2024-09-13T15:04:46.893 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:04:47.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.033+0000 7fb355200640 1 Processor -- start 2024-09-13T15:04:47.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.033+0000 7fb355200640 1 -- start start 2024-09-13T15:04:47.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb355200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3500c6d70 0x7fb3500c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb355200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3500c4cc0 con 0x7fb3500c90f0 2024-09-13T15:04:47.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb355200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3500c8100 con 0x7fb35006f610 2024-09-13T15:04:47.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb355200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500c61b0 con 0x7fb3500c6d70 2024-09-13T15:04:47.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34d400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb3500c90f0 0x7fb3500c6660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:32946/0 (socket says 172.21.15.7:32946) 2024-09-13T15:04:47.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34d400640 1 -- 172.21.15.7:0/2271452665 learned_addr learned my addr 172.21.15.7:0/2271452665 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:47.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34e800640 1 --2- 172.21.15.7:0/2271452665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3500c6d70 0x7fb3500c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34ca00640 1 -- 172.21.15.7:0/2271452665 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652553694 0 0) 0x7fb3500c4cc0 con 0x7fb3500c90f0 2024-09-13T15:04:47.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34ca00640 1 -- 172.21.15.7:0/2271452665 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb334003530 con 0x7fb3500c90f0 2024-09-13T15:04:47.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34ca00640 1 -- 172.21.15.7:0/2271452665 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259455132 0 0) 0x7fb3500c8100 con 0x7fb35006f610 2024-09-13T15:04:47.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34ca00640 1 -- 172.21.15.7:0/2271452665 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3500c4cc0 con 0x7fb35006f610 2024-09-13T15:04:47.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34ca00640 1 -- 172.21.15.7:0/2271452665 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2737331378 0 0) 0x7fb334003530 con 0x7fb3500c90f0 2024-09-13T15:04:47.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34ca00640 1 -- 172.21.15.7:0/2271452665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3500c6d70 msgr2=0x7fb3500c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:47.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34ca00640 1 --2- 172.21.15.7:0/2271452665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3500c6d70 0x7fb3500c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34ca00640 1 -- 172.21.15.7:0/2271452665 >> v1:172.21.15.77:6789/0 conn(0x7fb35006f610 legacy=0x7fb350151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34ca00640 1 -- 172.21.15.7:0/2271452665 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3500c8350 con 0x7fb3500c90f0 2024-09-13T15:04:47.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34ca00640 1 -- 172.21.15.7:0/2271452665 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7fb33c001680 con 0x7fb3500c90f0 2024-09-13T15:04:47.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34ca00640 1 -- 172.21.15.7:0/2271452665 >> v1:172.21.15.7:6789/0 conn(0x7fb3500c90f0 legacy=0x7fb3500c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34ca00640 1 --2- 172.21.15.7:0/2271452665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb334003b40 0x7fb334003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34ca00640 1 --2- 172.21.15.7:0/2271452665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3340047d0 0x7fb334004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34ca00640 1 --2- 172.21.15.7:0/2271452665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3500c6d70 0x7fb334005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34ca00640 1 -- 172.21.15.7:0/2271452665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500c61b0 con 0x7fb3340047d0 2024-09-13T15:04:47.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34ca00640 1 -- 172.21.15.7:0/2271452665 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb33400ba70 con 0x7fb334003b40 2024-09-13T15:04:47.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34ca00640 1 -- 172.21.15.7:0/2271452665 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33400bc30 con 0x7fb3500c6d70 2024-09-13T15:04:47.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34d400640 1 --2- 172.21.15.7:0/2271452665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3340047d0 0x7fb334004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34de00640 1 --2- 172.21.15.7:0/2271452665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb334003b40 0x7fb334003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34e800640 1 --2- 172.21.15.7:0/2271452665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3500c6d70 0x7fb334005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34d400640 1 -- 172.21.15.7:0/2271452665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3500c6d70 msgr2=0x7fb334005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:47.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34d400640 1 --2- 172.21.15.7:0/2271452665 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3500c6d70 0x7fb334005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34d400640 1 -- 172.21.15.7:0/2271452665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb334003b40 msgr2=0x7fb334003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:47.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34d400640 1 --2- 172.21.15.7:0/2271452665 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb334003b40 0x7fb334003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.037+0000 7fb34d400640 1 -- 172.21.15.7:0/2271452665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb334003530 con 0x7fb3340047d0 2024-09-13T15:04:47.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.041+0000 7fb34d400640 1 --2- 172.21.15.7:0/2271452665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3340047d0 0x7fb334004c50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb33c007fb0 tx=0x7fb33c01f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5b3dd14f058387 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:47.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.041+0000 7fb34ca00640 1 -- 172.21.15.7:0/2271452665 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c0a8e90 con 0x7fb3340047d0 2024-09-13T15:04:47.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.041+0000 7fb34ca00640 1 -- 172.21.15.7:0/2271452665 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb33c0058e0 con 0x7fb3340047d0 2024-09-13T15:04:47.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.041+0000 7fb34ca00640 1 -- 172.21.15.7:0/2271452665 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb33c005c90 con 0x7fb3340047d0 2024-09-13T15:04:47.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.041+0000 7fb355200640 1 -- 172.21.15.7:0/2271452665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3340047d0 msgr2=0x7fb334004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.041+0000 7fb355200640 1 --2- 172.21.15.7:0/2271452665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3340047d0 0x7fb334004c50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb33c007fb0 tx=0x7fb33c01f270 comp rx=0 tx=0).stop 2024-09-13T15:04:47.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.041+0000 7fb34e800640 1 -- 172.21.15.7:0/2271452665 reap_dead start 2024-09-13T15:04:47.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.041+0000 7fb355200640 1 -- 172.21.15.7:0/2271452665 shutdown_connections 2024-09-13T15:04:47.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.041+0000 7fb355200640 1 -- 172.21.15.7:0/2271452665 >> 172.21.15.7:0/2271452665 conn(0x7fb3500717c0 msgr2=0x7fb350071bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:47.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.041+0000 7fb355200640 1 -- 172.21.15.7:0/2271452665 shutdown_connections 2024-09-13T15:04:47.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.041+0000 7fb355200640 1 -- 172.21.15.7:0/2271452665 wait complete. 2024-09-13T15:04:47.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb355200640 1 Processor -- start 2024-09-13T15:04:47.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb355200640 1 -- start start 2024-09-13T15:04:47.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb355200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3340047d0 0x7fb3501ed0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb355200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3500c32c0 0x7fb3500c4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb355200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3500c4660 0x7fb350156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb355200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb350156ae0 con 0x7fb3340047d0 2024-09-13T15:04:47.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb355200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500c0fa0 con 0x7fb3500c4660 2024-09-13T15:04:47.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb355200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3500c09e0 con 0x7fb3500c32c0 2024-09-13T15:04:47.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb34de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3340047d0 0x7fb3501ed0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb34de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3340047d0 0x7fb3501ed0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36262/0 (socket says 172.21.15.7:36262) 2024-09-13T15:04:47.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb34de00640 1 -- 172.21.15.7:0/2645782860 learned_addr learned my addr 172.21.15.7:0/2645782860 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:47.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb34d400640 1 --2- 172.21.15.7:0/2645782860 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3500c32c0 0x7fb3500c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb34e800640 1 --2- 172.21.15.7:0/2645782860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3500c4660 0x7fb350156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb34de00640 1 -- 172.21.15.7:0/2645782860 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3500c32c0 msgr2=0x7fb3500c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb34de00640 1 --2- 172.21.15.7:0/2645782860 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3500c32c0 0x7fb3500c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb34de00640 1 -- 172.21.15.7:0/2645782860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3500c4660 msgr2=0x7fb350156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb34de00640 1 --2- 172.21.15.7:0/2645782860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3500c4660 0x7fb350156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb34de00640 1 -- 172.21.15.7:0/2645782860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3500c0cc0 con 0x7fb3340047d0 2024-09-13T15:04:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb34d400640 1 --2- 172.21.15.7:0/2645782860 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3500c32c0 0x7fb3500c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:04:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb34e800640 1 --2- 172.21.15.7:0/2645782860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3500c4660 0x7fb350156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:04:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb34de00640 1 --2- 172.21.15.7:0/2645782860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3340047d0 0x7fb3501ed0f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb34000f770 tx=0x7fb34000fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb346000640 1 -- 172.21.15.7:0/2645782860 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb340005110 con 0x7fb3340047d0 2024-09-13T15:04:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb346000640 1 -- 172.21.15.7:0/2645782860 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb340005270 con 0x7fb3340047d0 2024-09-13T15:04:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb355200640 1 -- 172.21.15.7:0/2645782860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3501e26d0 con 0x7fb3340047d0 2024-09-13T15:04:47.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb346000640 1 -- 172.21.15.7:0/2645782860 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3400067e0 con 0x7fb3340047d0 2024-09-13T15:04:47.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb355200640 1 -- 172.21.15.7:0/2645782860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3500cd950 con 0x7fb3340047d0 2024-09-13T15:04:47.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.045+0000 7fb355200640 1 -- 172.21.15.7:0/2645782860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3501e2b80 con 0x7fb3340047d0 2024-09-13T15:04:47.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.049+0000 7fb346000640 1 -- 172.21.15.7:0/2645782860 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb340006940 con 0x7fb3340047d0 2024-09-13T15:04:47.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.049+0000 7fb346000640 1 --2- 172.21.15.7:0/2645782860 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb330066690 0x7fb330068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.049+0000 7fb346000640 1 -- 172.21.15.7:0/2645782860 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb340083ed0 con 0x7fb3340047d0 2024-09-13T15:04:47.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.049+0000 7fb34d400640 1 --2- 172.21.15.7:0/2645782860 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb330066690 0x7fb330068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.049+0000 7fb34d400640 1 --2- 172.21.15.7:0/2645782860 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb330066690 0x7fb330068b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb33c007f80 tx=0x7fb33c0aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:47.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.053+0000 7fb346000640 1 -- 172.21.15.7:0/2645782860 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb3501e2b80 con 0x7fb3340047d0 2024-09-13T15:04:47.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.217+0000 7fb355200640 1 -- 172.21.15.7:0/2645782860 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3501e2b80 con 0x7fb3340047d0 2024-09-13T15:04:47.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.217+0000 7fb346000640 1 -- 172.21.15.7:0/2645782860 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb3501e2b80 con 0x7fb3340047d0 2024-09-13T15:04:47.219 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-13T15:04:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.217+0000 7fb355200640 1 -- 172.21.15.7:0/2645782860 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb330066690 msgr2=0x7fb330068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.217+0000 7fb355200640 1 --2- 172.21.15.7:0/2645782860 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb330066690 0x7fb330068b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb33c007f80 tx=0x7fb33c0aa070 comp rx=0 tx=0).stop 2024-09-13T15:04:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.217+0000 7fb355200640 1 -- 172.21.15.7:0/2645782860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3340047d0 msgr2=0x7fb3501ed0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.217+0000 7fb355200640 1 --2- 172.21.15.7:0/2645782860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3340047d0 0x7fb3501ed0f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb34000f770 tx=0x7fb34000fb70 comp rx=0 tx=0).stop 2024-09-13T15:04:47.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.221+0000 7fb355200640 1 -- 172.21.15.7:0/2645782860 shutdown_connections 2024-09-13T15:04:47.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.221+0000 7fb355200640 1 --2- 172.21.15.7:0/2645782860 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb330066690 0x7fb330068b50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.221+0000 7fb355200640 1 --2- 172.21.15.7:0/2645782860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3500c4660 0x7fb350156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.221+0000 7fb355200640 1 --2- 172.21.15.7:0/2645782860 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb3500c32c0 0x7fb3500c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.221+0000 7fb355200640 1 --2- 172.21.15.7:0/2645782860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb3340047d0 0x7fb3501ed0f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.221+0000 7fb355200640 1 -- 172.21.15.7:0/2645782860 >> 172.21.15.7:0/2645782860 conn(0x7fb3500717c0 msgr2=0x7fb35014f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:47.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.221+0000 7fb355200640 1 -- 172.21.15.7:0/2645782860 shutdown_connections 2024-09-13T15:04:47.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.221+0000 7fb355200640 1 -- 172.21.15.7:0/2645782860 wait complete. 2024-09-13T15:04:47.240 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:04:47.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.381+0000 7fe371200640 1 Processor -- start 2024-09-13T15:04:47.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.381+0000 7fe371200640 1 -- start start 2024-09-13T15:04:47.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.381+0000 7fe371200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe36c14fdd0 0x7fe36c156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.381+0000 7fe371200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe36c0c16f0 0x7fe36c0c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.381+0000 7fe371200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe36c0c6880 con 0x7fe36c1501b0 2024-09-13T15:04:47.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.381+0000 7fe371200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe36c0721e0 con 0x7fe36c0c16f0 2024-09-13T15:04:47.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.381+0000 7fe371200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c06f860 con 0x7fe36c14fdd0 2024-09-13T15:04:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.381+0000 7fe363e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe36c1501b0 0x7fe36c0c7420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:32948/0 (socket says 172.21.15.7:32948) 2024-09-13T15:04:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.381+0000 7fe363e00640 1 -- 172.21.15.7:0/2392356017 learned_addr learned my addr 172.21.15.7:0/2392356017 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.385+0000 7fe36a800640 1 --2- 172.21.15.7:0/2392356017 >> v2:172.21.15.77:3300/0 conn(0x7fe36c0c16f0 0x7fe36c0c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.385+0000 7fe369e00640 1 --2- 172.21.15.7:0/2392356017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe36c14fdd0 0x7fe36c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.385+0000 7fe369400640 1 -- 172.21.15.7:0/2392356017 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306756235 0 0) 0x7fe36c0c6880 con 0x7fe36c1501b0 2024-09-13T15:04:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.385+0000 7fe369400640 1 -- 172.21.15.7:0/2392356017 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe350003530 con 0x7fe36c1501b0 2024-09-13T15:04:47.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.385+0000 7fe369400640 1 -- 172.21.15.7:0/2392356017 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3789536257 0 0) 0x7fe350003530 con 0x7fe36c1501b0 2024-09-13T15:04:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.385+0000 7fe36a800640 1 -- 172.21.15.7:0/2392356017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe36c14fdd0 msgr2=0x7fe36c156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.385+0000 7fe36a800640 1 --2- 172.21.15.7:0/2392356017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe36c14fdd0 0x7fe36c156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.385+0000 7fe36a800640 1 -- 172.21.15.7:0/2392356017 >> v1:172.21.15.7:6789/0 conn(0x7fe36c1501b0 legacy=0x7fe36c0c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.385+0000 7fe36a800640 1 -- 172.21.15.7:0/2392356017 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c0c6ad0 con 0x7fe36c0c16f0 2024-09-13T15:04:47.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.385+0000 7fe36a800640 1 --2- 172.21.15.7:0/2392356017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe36c0c16f0 0x7fe36c0c55d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe364009d90 tx=0x7fe36401c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60357fcf2fe2df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.385+0000 7fe369400640 1 -- 172.21.15.7:0/2392356017 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354001680 con 0x7fe36c0c16f0 2024-09-13T15:04:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe369400640 1 -- 172.21.15.7:0/2392356017 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3640a5690 con 0x7fe36c0c16f0 2024-09-13T15:04:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe369400640 1 -- 172.21.15.7:0/2392356017 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3640a5a00 con 0x7fe36c0c16f0 2024-09-13T15:04:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe371200640 1 -- 172.21.15.7:0/2392356017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe36c0c16f0 msgr2=0x7fe36c0c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe371200640 1 --2- 172.21.15.7:0/2392356017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe36c0c16f0 0x7fe36c0c55d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe364009d90 tx=0x7fe36401c890 comp rx=0 tx=0).stop 2024-09-13T15:04:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe371200640 1 -- 172.21.15.7:0/2392356017 shutdown_connections 2024-09-13T15:04:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe371200640 1 --2- 172.21.15.7:0/2392356017 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe36c0c16f0 0x7fe36c0c55d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe371200640 1 --2- 172.21.15.7:0/2392356017 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe36c14fdd0 0x7fe36c156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe371200640 1 -- 172.21.15.7:0/2392356017 >> 172.21.15.7:0/2392356017 conn(0x7fe36c065d40 msgr2=0x7fe36c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe371200640 1 -- 172.21.15.7:0/2392356017 shutdown_connections 2024-09-13T15:04:47.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe371200640 1 -- 172.21.15.7:0/2392356017 wait complete. 2024-09-13T15:04:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe371200640 1 Processor -- start 2024-09-13T15:04:47.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe371200640 1 -- start start 2024-09-13T15:04:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe371200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe36c0c16f0 0x7fe36c0c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe371200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c14fdd0 0x7fe36c0ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe371200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe36c1501b0 0x7fe36c0cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe371200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c14dff0 con 0x7fe36c14fdd0 2024-09-13T15:04:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe371200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c0c91a0 con 0x7fe36c1501b0 2024-09-13T15:04:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe371200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c148d20 con 0x7fe36c0c16f0 2024-09-13T15:04:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe363e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c14fdd0 0x7fe36c0ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe363e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c14fdd0 0x7fe36c0ca5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36266/0 (socket says 172.21.15.7:36266) 2024-09-13T15:04:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe363e00640 1 -- 172.21.15.7:0/3643059034 learned_addr learned my addr 172.21.15.7:0/3643059034 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe369e00640 1 --2- 172.21.15.7:0/3643059034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe36c0c16f0 0x7fe36c0c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.389+0000 7fe36a800640 1 --2- 172.21.15.7:0/3643059034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe36c1501b0 0x7fe36c0cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.393+0000 7fe363e00640 1 -- 172.21.15.7:0/3643059034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe36c0c16f0 msgr2=0x7fe36c0c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.393+0000 7fe363e00640 1 --2- 172.21.15.7:0/3643059034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe36c0c16f0 0x7fe36c0c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.393+0000 7fe363e00640 1 -- 172.21.15.7:0/3643059034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe36c1501b0 msgr2=0x7fe36c0cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.393+0000 7fe363e00640 1 --2- 172.21.15.7:0/3643059034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe36c1501b0 0x7fe36c0cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.393+0000 7fe363e00640 1 -- 172.21.15.7:0/3643059034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe364009a70 con 0x7fe36c14fdd0 2024-09-13T15:04:47.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.393+0000 7fe363e00640 1 --2- 172.21.15.7:0/3643059034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c14fdd0 0x7fe36c0ca5d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe3540017b0 tx=0x7fe35400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:47.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.393+0000 7fe362000640 1 -- 172.21.15.7:0/3643059034 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354005ae0 con 0x7fe36c14fdd0 2024-09-13T15:04:47.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.393+0000 7fe362000640 1 -- 172.21.15.7:0/3643059034 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe354005c40 con 0x7fe36c14fdd0 2024-09-13T15:04:47.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.393+0000 7fe362000640 1 -- 172.21.15.7:0/3643059034 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354007290 con 0x7fe36c14fdd0 2024-09-13T15:04:47.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.393+0000 7fe371200640 1 -- 172.21.15.7:0/3643059034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36c0c93f0 con 0x7fe36c14fdd0 2024-09-13T15:04:47.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.393+0000 7fe371200640 1 -- 172.21.15.7:0/3643059034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36c0c9a40 con 0x7fe36c14fdd0 2024-09-13T15:04:47.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.393+0000 7fe371200640 1 -- 172.21.15.7:0/3643059034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe36c0c80f0 con 0x7fe36c14fdd0 2024-09-13T15:04:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.393+0000 7fe362000640 1 -- 172.21.15.7:0/3643059034 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe3540073f0 con 0x7fe36c14fdd0 2024-09-13T15:04:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.393+0000 7fe362000640 1 --2- 172.21.15.7:0/3643059034 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe348066690 0x7fe348068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.393+0000 7fe362000640 1 -- 172.21.15.7:0/3643059034 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe354084160 con 0x7fe36c14fdd0 2024-09-13T15:04:47.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.393+0000 7fe369e00640 1 --2- 172.21.15.7:0/3643059034 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe348066690 0x7fe348068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.397+0000 7fe369e00640 1 --2- 172.21.15.7:0/3643059034 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe348066690 0x7fe348068b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe35c009b60 tx=0x7fe35c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:47.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.397+0000 7fe362000640 1 -- 172.21.15.7:0/3643059034 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe36c0c80f0 con 0x7fe36c14fdd0 2024-09-13T15:04:47.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.561+0000 7fe371200640 1 -- 172.21.15.7:0/3643059034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe36c0c80f0 con 0x7fe36c14fdd0 2024-09-13T15:04:47.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.561+0000 7fe362000640 1 -- 172.21.15.7:0/3643059034 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe36c0c80f0 con 0x7fe36c14fdd0 2024-09-13T15:04:47.563 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T15:04:47.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.561+0000 7fe371200640 1 -- 172.21.15.7:0/3643059034 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe348066690 msgr2=0x7fe348068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.561+0000 7fe371200640 1 --2- 172.21.15.7:0/3643059034 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe348066690 0x7fe348068b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe35c009b60 tx=0x7fe35c009190 comp rx=0 tx=0).stop 2024-09-13T15:04:47.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.561+0000 7fe371200640 1 -- 172.21.15.7:0/3643059034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c14fdd0 msgr2=0x7fe36c0ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.561+0000 7fe371200640 1 --2- 172.21.15.7:0/3643059034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c14fdd0 0x7fe36c0ca5d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe3540017b0 tx=0x7fe35400cbe0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.561+0000 7fe371200640 1 -- 172.21.15.7:0/3643059034 shutdown_connections 2024-09-13T15:04:47.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.561+0000 7fe371200640 1 --2- 172.21.15.7:0/3643059034 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe348066690 0x7fe348068b50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.561+0000 7fe371200640 1 --2- 172.21.15.7:0/3643059034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe36c1501b0 0x7fe36c0cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.561+0000 7fe371200640 1 --2- 172.21.15.7:0/3643059034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe36c14fdd0 0x7fe36c0ca5d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.561+0000 7fe371200640 1 --2- 172.21.15.7:0/3643059034 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe36c0c16f0 0x7fe36c0c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.561+0000 7fe371200640 1 -- 172.21.15.7:0/3643059034 >> 172.21.15.7:0/3643059034 conn(0x7fe36c065d40 msgr2=0x7fe36c0c3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:47.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.561+0000 7fe371200640 1 -- 172.21.15.7:0/3643059034 shutdown_connections 2024-09-13T15:04:47.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.561+0000 7fe371200640 1 -- 172.21.15.7:0/3643059034 wait complete. 2024-09-13T15:04:47.583 INFO:tasks.mds_thrash:mds thrasher using random seed: 1726239887 2024-09-13T15:04:47.584 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:04:47.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.721+0000 7fcf0be00640 1 Processor -- start 2024-09-13T15:04:47.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.721+0000 7fcf0be00640 1 -- start start 2024-09-13T15:04:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.725+0000 7fcf0be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcf04071a70 0x7fcf041576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.725+0000 7fcf0be00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf040b0bf0 0x7fcf04150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.725+0000 7fcf0be00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf040c5530 con 0x7fcf0406ddb0 2024-09-13T15:04:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.725+0000 7fcf0be00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf041583b0 con 0x7fcf04071a70 2024-09-13T15:04:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.725+0000 7fcf0be00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf04156f40 con 0x7fcf040b0bf0 2024-09-13T15:04:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.725+0000 7fcf09400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcf04071a70 0x7fcf041576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.725+0000 7fcf09400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fcf04071a70 0x7fcf041576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36282/0 (socket says 172.21.15.7:36282) 2024-09-13T15:04:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.725+0000 7fcf09400640 1 -- 172.21.15.7:0/3579310747 learned_addr learned my addr 172.21.15.7:0/3579310747 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.725+0000 7fcf08a00640 1 --2- 172.21.15.7:0/3579310747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf040b0bf0 0x7fcf04150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.725+0000 7fcf09400640 1 -- 172.21.15.7:0/3579310747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf040b0bf0 msgr2=0x7fcf04150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.725+0000 7fcf09400640 1 --2- 172.21.15.7:0/3579310747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf040b0bf0 0x7fcf04150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.725+0000 7fcf09400640 1 -- 172.21.15.7:0/3579310747 >> v1:172.21.15.77:6789/0 conn(0x7fcf0406ddb0 legacy=0x7fcf0415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.725+0000 7fcf09400640 1 -- 172.21.15.7:0/3579310747 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf040b10c0 con 0x7fcf04071a70 2024-09-13T15:04:47.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.725+0000 7fcf08a00640 1 --2- 172.21.15.7:0/3579310747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf040b0bf0 0x7fcf04150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:47.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf09400640 1 --2- 172.21.15.7:0/3579310747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf04071a70 0x7fcf041576e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009870 tx=0x7fcef801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309c57770df3e28f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:47.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf03e00640 1 -- 172.21.15.7:0/3579310747 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef80a95f0 con 0x7fcf04071a70 2024-09-13T15:04:47.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf03e00640 1 -- 172.21.15.7:0/3579310747 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef80a9750 con 0x7fcf04071a70 2024-09-13T15:04:47.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf03e00640 1 -- 172.21.15.7:0/3579310747 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef80a9ae0 con 0x7fcf04071a70 2024-09-13T15:04:47.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf0be00640 1 -- 172.21.15.7:0/3579310747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf04071a70 msgr2=0x7fcf041576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf0be00640 1 --2- 172.21.15.7:0/3579310747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf04071a70 0x7fcf041576e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009870 tx=0x7fcef801c530 comp rx=0 tx=0).stop 2024-09-13T15:04:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf0be00640 1 -- 172.21.15.7:0/3579310747 shutdown_connections 2024-09-13T15:04:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf0be00640 1 --2- 172.21.15.7:0/3579310747 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf040b0bf0 0x7fcf04150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf0be00640 1 --2- 172.21.15.7:0/3579310747 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf04071a70 0x7fcf041576e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf0be00640 1 -- 172.21.15.7:0/3579310747 >> 172.21.15.7:0/3579310747 conn(0x7fcf04065d40 msgr2=0x7fcf04066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf0be00640 1 -- 172.21.15.7:0/3579310747 shutdown_connections 2024-09-13T15:04:47.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf0be00640 1 -- 172.21.15.7:0/3579310747 wait complete. 2024-09-13T15:04:47.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf0be00640 1 Processor -- start 2024-09-13T15:04:47.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf0be00640 1 -- start start 2024-09-13T15:04:47.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf0be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf0406ddb0 0x7fcf04160400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf0be00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf04071a70 0x7fcf040c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf0be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf040b0bf0 0x7fcf040709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf0be00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf040c7f60 con 0x7fcf040b0bf0 2024-09-13T15:04:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf0be00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf040c2a80 con 0x7fcf0406ddb0 2024-09-13T15:04:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.729+0000 7fcf0be00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf040c76e0 con 0x7fcf04071a70 2024-09-13T15:04:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf09e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf040b0bf0 0x7fcf040709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf09e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf040b0bf0 0x7fcf040709e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36290/0 (socket says 172.21.15.7:36290) 2024-09-13T15:04:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf09e00640 1 -- 172.21.15.7:0/269876228 learned_addr learned my addr 172.21.15.7:0/269876228 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf09400640 1 --2- 172.21.15.7:0/269876228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf0406ddb0 0x7fcf04160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf08a00640 1 --2- 172.21.15.7:0/269876228 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf04071a70 0x7fcf040c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf09e00640 1 -- 172.21.15.7:0/269876228 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf04071a70 msgr2=0x7fcf040c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf09e00640 1 --2- 172.21.15.7:0/269876228 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf04071a70 0x7fcf040c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf09e00640 1 -- 172.21.15.7:0/269876228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf0406ddb0 msgr2=0x7fcf04160400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf09e00640 1 --2- 172.21.15.7:0/269876228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf0406ddb0 0x7fcf04160400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf09e00640 1 -- 172.21.15.7:0/269876228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef80094d0 con 0x7fcf040b0bf0 2024-09-13T15:04:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf09e00640 1 --2- 172.21.15.7:0/269876228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf040b0bf0 0x7fcf040709e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcefc00c730 tx=0x7fcefc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf01600640 1 -- 172.21.15.7:0/269876228 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc003b80 con 0x7fcf040b0bf0 2024-09-13T15:04:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf01600640 1 -- 172.21.15.7:0/269876228 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc003ce0 con 0x7fcf040b0bf0 2024-09-13T15:04:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf01600640 1 -- 172.21.15.7:0/269876228 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc005310 con 0x7fcf040b0bf0 2024-09-13T15:04:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf0be00640 1 -- 172.21.15.7:0/269876228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf040c79a0 con 0x7fcf040b0bf0 2024-09-13T15:04:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf0be00640 1 -- 172.21.15.7:0/269876228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf040c6330 con 0x7fcf040b0bf0 2024-09-13T15:04:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf0be00640 1 -- 172.21.15.7:0/269876228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf04067650 con 0x7fcf040b0bf0 2024-09-13T15:04:47.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.733+0000 7fcf01600640 1 -- 172.21.15.7:0/269876228 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcefc005680 con 0x7fcf040b0bf0 2024-09-13T15:04:47.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.737+0000 7fcf01600640 1 --2- 172.21.15.7:0/269876228 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcee4066690 0x7fcee4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:47.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.737+0000 7fcf01600640 1 -- 172.21.15.7:0/269876228 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcefc084440 con 0x7fcf040b0bf0 2024-09-13T15:04:47.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.737+0000 7fcf09400640 1 --2- 172.21.15.7:0/269876228 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcee4066690 0x7fcee4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:47.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.737+0000 7fcf09400640 1 --2- 172.21.15.7:0/269876228 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcee4066690 0x7fcee4068b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcef80ae000 tx=0x7fcef8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:47.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.741+0000 7fcf01600640 1 -- 172.21.15.7:0/269876228 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcefc051400 con 0x7fcf040b0bf0 2024-09-13T15:04:47.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.901+0000 7fcf0be00640 1 -- 172.21.15.7:0/269876228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf041576e0 con 0x7fcf040b0bf0 2024-09-13T15:04:47.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.905+0000 7fcf01600640 1 -- 172.21.15.7:0/269876228 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18616 (secure 0 0 0) 0x7fcefc054a20 con 0x7fcf040b0bf0 2024-09-13T15:04:47.906 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:47.906 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:02:33.732864+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:04:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.905+0000 7fcf0be00640 1 -- 172.21.15.7:0/269876228 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcee4066690 msgr2=0x7fcee4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.905+0000 7fcf0be00640 1 --2- 172.21.15.7:0/269876228 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcee4066690 0x7fcee4068b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcef80ae000 tx=0x7fcef8009040 comp rx=0 tx=0).stop 2024-09-13T15:04:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.905+0000 7fcf0be00640 1 -- 172.21.15.7:0/269876228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf040b0bf0 msgr2=0x7fcf040709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.905+0000 7fcf0be00640 1 --2- 172.21.15.7:0/269876228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf040b0bf0 0x7fcf040709e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcefc00c730 tx=0x7fcefc00cbf0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.905+0000 7fcf0be00640 1 -- 172.21.15.7:0/269876228 shutdown_connections 2024-09-13T15:04:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.905+0000 7fcf0be00640 1 --2- 172.21.15.7:0/269876228 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcee4066690 0x7fcee4068b50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.905+0000 7fcf0be00640 1 --2- 172.21.15.7:0/269876228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf040b0bf0 0x7fcf040709e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.905+0000 7fcf0be00640 1 --2- 172.21.15.7:0/269876228 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcf04071a70 0x7fcf040c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.905+0000 7fcf0be00640 1 --2- 172.21.15.7:0/269876228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcf0406ddb0 0x7fcf04160400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.905+0000 7fcf0be00640 1 -- 172.21.15.7:0/269876228 >> 172.21.15.7:0/269876228 conn(0x7fcf04065d40 msgr2=0x7fcf04146630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.905+0000 7fcf0be00640 1 -- 172.21.15.7:0/269876228 shutdown_connections 2024-09-13T15:04:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:47.905+0000 7fcf0be00640 1 -- 172.21.15.7:0/269876228 wait complete. 2024-09-13T15:04:47.928 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:01:38.710958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:01:43.178724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:01:43.774877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:01:46.843203+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:04:47.929 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:04:48.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.069+0000 7f8fb6600640 1 Processor -- start 2024-09-13T15:04:48.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.069+0000 7f8fb6600640 1 -- start start 2024-09-13T15:04:48.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.073+0000 7f8fb6600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8fb014fdd0 0x7f8fb0156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.073+0000 7f8fb6600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb01501b0 0x7f8fb00c7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.073+0000 7f8fb6600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb00c6880 con 0x7f8fb00c16f0 2024-09-13T15:04:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.073+0000 7f8fb6600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb00721e0 con 0x7f8fb014fdd0 2024-09-13T15:04:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.073+0000 7f8fb6600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb006f860 con 0x7f8fb01501b0 2024-09-13T15:04:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.073+0000 7f8fafe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f8fb00c16f0 0x7f8fb00c55d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:32960/0 (socket says 172.21.15.7:32960) 2024-09-13T15:04:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.073+0000 7f8fafe00640 1 -- 172.21.15.7:0/831137008 learned_addr learned my addr 172.21.15.7:0/831137008 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.073+0000 7f8faf400640 1 --2- 172.21.15.7:0/831137008 >> v2:172.21.15.77:3300/0 conn(0x7f8fb014fdd0 0x7f8fb0156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.073+0000 7f8fa7e00640 1 --2- 172.21.15.7:0/831137008 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb01501b0 0x7f8fb00c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.073+0000 7f8faea00640 1 -- 172.21.15.7:0/831137008 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453039942 0 0) 0x7f8fb00c6880 con 0x7f8fb00c16f0 2024-09-13T15:04:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.073+0000 7f8faea00640 1 -- 172.21.15.7:0/831137008 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f94003530 con 0x7f8fb00c16f0 2024-09-13T15:04:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.073+0000 7f8faf400640 1 -- 172.21.15.7:0/831137008 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb01501b0 msgr2=0x7f8fb00c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.073+0000 7f8faf400640 1 --2- 172.21.15.7:0/831137008 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb01501b0 0x7f8fb00c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.073+0000 7f8faea00640 1 -- 172.21.15.7:0/831137008 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1799429780 0 0) 0x7f8f94003530 con 0x7f8fb00c16f0 2024-09-13T15:04:48.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.073+0000 7f8faf400640 1 -- 172.21.15.7:0/831137008 >> v1:172.21.15.7:6789/0 conn(0x7f8fb00c16f0 legacy=0x7f8fb00c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.073+0000 7f8faf400640 1 -- 172.21.15.7:0/831137008 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb00c6ad0 con 0x7f8fb014fdd0 2024-09-13T15:04:48.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.077+0000 7f8faf400640 1 --2- 172.21.15.7:0/831137008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb014fdd0 0x7f8fb0156780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00097c0 tx=0x7f8fa001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4ea636d7ca5310a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.077+0000 7f8faea00640 1 -- 172.21.15.7:0/831137008 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8001a00 con 0x7f8fb014fdd0 2024-09-13T15:04:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.077+0000 7f8faea00640 1 -- 172.21.15.7:0/831137008 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa00a7050 con 0x7f8fb014fdd0 2024-09-13T15:04:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.077+0000 7f8faea00640 1 -- 172.21.15.7:0/831137008 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa00ab600 con 0x7f8fb014fdd0 2024-09-13T15:04:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.077+0000 7f8fb6600640 1 -- 172.21.15.7:0/831137008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb014fdd0 msgr2=0x7f8fb0156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.077+0000 7f8fb6600640 1 --2- 172.21.15.7:0/831137008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb014fdd0 0x7f8fb0156780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00097c0 tx=0x7f8fa001c3c0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.077+0000 7f8fb6600640 1 -- 172.21.15.7:0/831137008 shutdown_connections 2024-09-13T15:04:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.077+0000 7f8fb6600640 1 --2- 172.21.15.7:0/831137008 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb01501b0 0x7f8fb00c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.077+0000 7f8fb6600640 1 --2- 172.21.15.7:0/831137008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb014fdd0 0x7f8fb0156780 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.077+0000 7f8fb6600640 1 -- 172.21.15.7:0/831137008 >> 172.21.15.7:0/831137008 conn(0x7f8fb0065d40 msgr2=0x7f8fb0066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.077+0000 7f8fb6600640 1 -- 172.21.15.7:0/831137008 shutdown_connections 2024-09-13T15:04:48.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.077+0000 7f8fb6600640 1 -- 172.21.15.7:0/831137008 wait complete. 2024-09-13T15:04:48.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.077+0000 7f8fb6600640 1 Processor -- start 2024-09-13T15:04:48.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.077+0000 7f8fb6600640 1 -- start start 2024-09-13T15:04:48.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8fb6600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fb00c16f0 0x7f8fb0147df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:48.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8fb6600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb014fdd0 0x7f8fb0144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:48.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8fb6600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb01501b0 0x7f8fb0151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:48.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8fb6600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0148970 con 0x7f8fb00c16f0 2024-09-13T15:04:48.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8fb6600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb0148690 con 0x7f8fb01501b0 2024-09-13T15:04:48.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8fb6600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb01467a0 con 0x7f8fb014fdd0 2024-09-13T15:04:48.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8faf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fb00c16f0 0x7f8fb0147df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:48.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8faf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fb00c16f0 0x7f8fb0147df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36306/0 (socket says 172.21.15.7:36306) 2024-09-13T15:04:48.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8faf400640 1 -- 172.21.15.7:0/2591680476 learned_addr learned my addr 172.21.15.7:0/2591680476 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8fafe00640 1 --2- 172.21.15.7:0/2591680476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb01501b0 0x7f8fb0151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8fa7e00640 1 --2- 172.21.15.7:0/2591680476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb014fdd0 0x7f8fb0144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8faf400640 1 -- 172.21.15.7:0/2591680476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb014fdd0 msgr2=0x7f8fb0144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8faf400640 1 --2- 172.21.15.7:0/2591680476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb014fdd0 0x7f8fb0144770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8faf400640 1 -- 172.21.15.7:0/2591680476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb01501b0 msgr2=0x7f8fb0151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8faf400640 1 --2- 172.21.15.7:0/2591680476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb01501b0 0x7f8fb0151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8faf400640 1 -- 172.21.15.7:0/2591680476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa0009420 con 0x7f8fb00c16f0 2024-09-13T15:04:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8fafe00640 1 --2- 172.21.15.7:0/2591680476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb01501b0 0x7f8fb0151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8faf400640 1 --2- 172.21.15.7:0/2591680476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fb00c16f0 0x7f8fb0147df0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0000c10 tx=0x7f8fa0019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8fa7400640 1 -- 172.21.15.7:0/2591680476 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0003ab0 con 0x7f8fb00c16f0 2024-09-13T15:04:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8fa7400640 1 -- 172.21.15.7:0/2591680476 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa0003c10 con 0x7f8fb00c16f0 2024-09-13T15:04:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8fa7400640 1 -- 172.21.15.7:0/2591680476 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa00ab400 con 0x7f8fb00c16f0 2024-09-13T15:04:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8fb6600640 1 -- 172.21.15.7:0/2591680476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb0146a80 con 0x7f8fb00c16f0 2024-09-13T15:04:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8fb6600640 1 -- 172.21.15.7:0/2591680476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb014fb40 con 0x7f8fb00c16f0 2024-09-13T15:04:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8fb6600640 1 -- 172.21.15.7:0/2591680476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb0161210 con 0x7f8fb00c16f0 2024-09-13T15:04:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.081+0000 7f8fa7400640 1 -- 172.21.15.7:0/2591680476 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8fa00b2040 con 0x7f8fb00c16f0 2024-09-13T15:04:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.085+0000 7f8fa7400640 1 --2- 172.21.15.7:0/2591680476 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8f8c066690 0x7f8f8c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.085+0000 7f8fa7400640 1 -- 172.21.15.7:0/2591680476 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8fa011e390 con 0x7f8fb00c16f0 2024-09-13T15:04:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.085+0000 7f8fa7e00640 1 --2- 172.21.15.7:0/2591680476 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8f8c066690 0x7f8f8c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.085+0000 7f8fa7e00640 1 --2- 172.21.15.7:0/2591680476 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8f8c066690 0x7f8f8c068b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8fb01422d0 tx=0x7f8f98008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.089+0000 7f8fa7400640 1 -- 172.21.15.7:0/2591680476 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8fa00eb2a0 con 0x7f8fb00c16f0 2024-09-13T15:04:48.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.249+0000 7f8fb6600640 1 -- 172.21.15.7:0/2591680476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fb01468e0 con 0x7f8fb00c16f0 2024-09-13T15:04:48.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.249+0000 7f8fa7400640 1 -- 172.21.15.7:0/2591680476 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fb01468e0 con 0x7f8fb00c16f0 2024-09-13T15:04:48.252 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T15:04:48.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.253+0000 7f8fb6600640 1 -- 172.21.15.7:0/2591680476 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8f8c066690 msgr2=0x7f8f8c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.253+0000 7f8fb6600640 1 --2- 172.21.15.7:0/2591680476 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8f8c066690 0x7f8f8c068b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8fb01422d0 tx=0x7f8f98008040 comp rx=0 tx=0).stop 2024-09-13T15:04:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.253+0000 7f8fb6600640 1 -- 172.21.15.7:0/2591680476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fb00c16f0 msgr2=0x7f8fb0147df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.253+0000 7f8fb6600640 1 --2- 172.21.15.7:0/2591680476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fb00c16f0 0x7f8fb0147df0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0000c10 tx=0x7f8fa0019160 comp rx=0 tx=0).stop 2024-09-13T15:04:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.253+0000 7f8fb6600640 1 -- 172.21.15.7:0/2591680476 shutdown_connections 2024-09-13T15:04:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.253+0000 7f8fb6600640 1 --2- 172.21.15.7:0/2591680476 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8f8c066690 0x7f8f8c068b50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.253+0000 7f8fb6600640 1 --2- 172.21.15.7:0/2591680476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8fb01501b0 0x7f8fb0151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.253+0000 7f8fb6600640 1 --2- 172.21.15.7:0/2591680476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8fb014fdd0 0x7f8fb0144770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.253+0000 7f8fb6600640 1 --2- 172.21.15.7:0/2591680476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8fb00c16f0 0x7f8fb0147df0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.253+0000 7f8fb6600640 1 -- 172.21.15.7:0/2591680476 >> 172.21.15.7:0/2591680476 conn(0x7f8fb0065d40 msgr2=0x7f8fb00c3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.253+0000 7f8fb6600640 1 -- 172.21.15.7:0/2591680476 shutdown_connections 2024-09-13T15:04:48.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.253+0000 7f8fb6600640 1 -- 172.21.15.7:0/2591680476 wait complete. 2024-09-13T15:04:48.272 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:04:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.413+0000 7f4a78c00640 1 Processor -- start 2024-09-13T15:04:48.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.413+0000 7f4a78c00640 1 -- start start 2024-09-13T15:04:48.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.417+0000 7f4a78c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a740cb1f0 0x7f4a740c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:48.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.417+0000 7f4a78c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a74066a90 con 0x7f4a7406c780 2024-09-13T15:04:48.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.417+0000 7f4a78c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a740c6de0 con 0x7f4a74153180 2024-09-13T15:04:48.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.417+0000 7f4a78c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7415c610 con 0x7f4a740cb1f0 2024-09-13T15:04:48.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.417+0000 7f4a72a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4a7406c780 0x7f4a740c6190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33212/0 (socket says 172.21.15.7:33212) 2024-09-13T15:04:48.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.417+0000 7f4a72a00640 1 -- 172.21.15.7:0/2022690990 learned_addr learned my addr 172.21.15.7:0/2022690990 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:48.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.417+0000 7f4a73e00640 1 --2- 172.21.15.7:0/2022690990 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a740cb1f0 0x7f4a740c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.417+0000 7f4a72000640 1 -- 172.21.15.7:0/2022690990 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143495693 0 0) 0x7f4a74066a90 con 0x7f4a7406c780 2024-09-13T15:04:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.417+0000 7f4a72000640 1 -- 172.21.15.7:0/2022690990 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a58003530 con 0x7f4a7406c780 2024-09-13T15:04:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.417+0000 7f4a72000640 1 -- 172.21.15.7:0/2022690990 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130685275 0 0) 0x7f4a740c6de0 con 0x7f4a74153180 2024-09-13T15:04:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.417+0000 7f4a72000640 1 -- 172.21.15.7:0/2022690990 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a74066a90 con 0x7f4a74153180 2024-09-13T15:04:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.417+0000 7f4a73e00640 1 -- 172.21.15.7:0/2022690990 >> v1:172.21.15.77:6789/0 conn(0x7f4a74153180 legacy=0x7f4a7406c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.417+0000 7f4a73e00640 1 -- 172.21.15.7:0/2022690990 >> v1:172.21.15.7:6789/0 conn(0x7f4a7406c780 legacy=0x7f4a740c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.417+0000 7f4a73e00640 1 -- 172.21.15.7:0/2022690990 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7415c8b0 con 0x7f4a740cb1f0 2024-09-13T15:04:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a73e00640 1 --2- 172.21.15.7:0/2022690990 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a740cb1f0 0x7f4a740c68a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009dc0 tx=0x7f4a6c01c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c57a2ab899575b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a72000640 1 -- 172.21.15.7:0/2022690990 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0a5990 con 0x7f4a740cb1f0 2024-09-13T15:04:48.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a72000640 1 -- 172.21.15.7:0/2022690990 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6c0a5af0 con 0x7f4a740cb1f0 2024-09-13T15:04:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a72000640 1 -- 172.21.15.7:0/2022690990 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6c0a5e80 con 0x7f4a740cb1f0 2024-09-13T15:04:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a78c00640 1 -- 172.21.15.7:0/2022690990 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a740cb1f0 msgr2=0x7f4a740c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a78c00640 1 --2- 172.21.15.7:0/2022690990 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a740cb1f0 0x7f4a740c68a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c009dc0 tx=0x7f4a6c01c8d0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a78c00640 1 -- 172.21.15.7:0/2022690990 shutdown_connections 2024-09-13T15:04:48.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a78c00640 1 --2- 172.21.15.7:0/2022690990 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a740cb1f0 0x7f4a740c68a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a78c00640 1 -- 172.21.15.7:0/2022690990 >> 172.21.15.7:0/2022690990 conn(0x7f4a740c8390 msgr2=0x7f4a740c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:48.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a78c00640 1 -- 172.21.15.7:0/2022690990 shutdown_connections 2024-09-13T15:04:48.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a78c00640 1 -- 172.21.15.7:0/2022690990 wait complete. 2024-09-13T15:04:48.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a78c00640 1 Processor -- start 2024-09-13T15:04:48.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a78c00640 1 -- start start 2024-09-13T15:04:48.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a78c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a7406c780 0x7f4a740c1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:48.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a78c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a740cb1f0 0x7f4a740bd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:48.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a78c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a74153180 0x7f4a740bdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:48.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a78c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740c1e70 con 0x7f4a7406c780 2024-09-13T15:04:48.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a78c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740c6680 con 0x7f4a74153180 2024-09-13T15:04:48.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a78c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740c68b0 con 0x7f4a740cb1f0 2024-09-13T15:04:48.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a73400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a7406c780 0x7f4a740c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:48.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a73400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a7406c780 0x7f4a740c1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57932/0 (socket says 172.21.15.7:57932) 2024-09-13T15:04:48.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.421+0000 7f4a73400640 1 -- 172.21.15.7:0/2191176337 learned_addr learned my addr 172.21.15.7:0/2191176337 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:48.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.425+0000 7f4a72a00640 1 --2- 172.21.15.7:0/2191176337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a740cb1f0 0x7f4a740bd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:48.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.425+0000 7f4a73e00640 1 --2- 172.21.15.7:0/2191176337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a74153180 0x7f4a740bdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:48.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.425+0000 7f4a73400640 1 -- 172.21.15.7:0/2191176337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a740cb1f0 msgr2=0x7f4a740bd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.425+0000 7f4a73400640 1 --2- 172.21.15.7:0/2191176337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a740cb1f0 0x7f4a740bd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.425+0000 7f4a73400640 1 -- 172.21.15.7:0/2191176337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a74153180 msgr2=0x7f4a740bdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.425+0000 7f4a73400640 1 --2- 172.21.15.7:0/2191176337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a74153180 0x7f4a740bdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.425+0000 7f4a73400640 1 -- 172.21.15.7:0/2191176337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6c009a70 con 0x7f4a7406c780 2024-09-13T15:04:48.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.425+0000 7f4a73400640 1 --2- 172.21.15.7:0/2191176337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a7406c780 0x7f4a740c1930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400c430 tx=0x7f4a6400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:48.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.425+0000 7f4a6b400640 1 -- 172.21.15.7:0/2191176337 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a640052d0 con 0x7f4a7406c780 2024-09-13T15:04:48.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.425+0000 7f4a6b400640 1 -- 172.21.15.7:0/2191176337 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a64005450 con 0x7f4a7406c780 2024-09-13T15:04:48.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.425+0000 7f4a78c00640 1 -- 172.21.15.7:0/2191176337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a740c4dd0 con 0x7f4a7406c780 2024-09-13T15:04:48.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.425+0000 7f4a6b400640 1 -- 172.21.15.7:0/2191176337 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a64003840 con 0x7f4a7406c780 2024-09-13T15:04:48.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.425+0000 7f4a78c00640 1 -- 172.21.15.7:0/2191176337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a740bd1a0 con 0x7f4a7406c780 2024-09-13T15:04:48.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.425+0000 7f4a78c00640 1 -- 172.21.15.7:0/2191176337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a740bcd20 con 0x7f4a7406c780 2024-09-13T15:04:48.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.425+0000 7f4a6b400640 1 -- 172.21.15.7:0/2191176337 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a640039a0 con 0x7f4a7406c780 2024-09-13T15:04:48.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.429+0000 7f4a6b400640 1 --2- 172.21.15.7:0/2191176337 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4a54066690 0x7f4a54068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:48.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.429+0000 7f4a6b400640 1 -- 172.21.15.7:0/2191176337 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4a64083be0 con 0x7f4a7406c780 2024-09-13T15:04:48.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.429+0000 7f4a72a00640 1 --2- 172.21.15.7:0/2191176337 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4a54066690 0x7f4a54068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:48.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.429+0000 7f4a72a00640 1 --2- 172.21.15.7:0/2191176337 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4a54066690 0x7f4a54068b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4a740c2af0 tx=0x7f4a60009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:48.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.433+0000 7f4a6b400640 1 -- 172.21.15.7:0/2191176337 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4a740bcd20 con 0x7f4a7406c780 2024-09-13T15:04:48.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.593+0000 7f4a78c00640 1 -- 172.21.15.7:0/2191176337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a740bcd20 con 0x7f4a7406c780 2024-09-13T15:04:48.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.593+0000 7f4a6b400640 1 -- 172.21.15.7:0/2191176337 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a64017020 con 0x7f4a7406c780 2024-09-13T15:04:48.597 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T15:04:48.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.597+0000 7f4a78c00640 1 -- 172.21.15.7:0/2191176337 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4a54066690 msgr2=0x7f4a54068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.597+0000 7f4a78c00640 1 --2- 172.21.15.7:0/2191176337 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4a54066690 0x7f4a54068b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4a740c2af0 tx=0x7f4a60009040 comp rx=0 tx=0).stop 2024-09-13T15:04:48.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.597+0000 7f4a78c00640 1 -- 172.21.15.7:0/2191176337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a7406c780 msgr2=0x7f4a740c1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.597+0000 7f4a78c00640 1 --2- 172.21.15.7:0/2191176337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a7406c780 0x7f4a740c1930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400c430 tx=0x7f4a6400c8f0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.597+0000 7f4a78c00640 1 -- 172.21.15.7:0/2191176337 shutdown_connections 2024-09-13T15:04:48.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.597+0000 7f4a78c00640 1 --2- 172.21.15.7:0/2191176337 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4a54066690 0x7f4a54068b50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.597+0000 7f4a78c00640 1 --2- 172.21.15.7:0/2191176337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a74153180 0x7f4a740bdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.597+0000 7f4a78c00640 1 --2- 172.21.15.7:0/2191176337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a740cb1f0 0x7f4a740bd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.597+0000 7f4a78c00640 1 --2- 172.21.15.7:0/2191176337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a7406c780 0x7f4a740c1930 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.597+0000 7f4a78c00640 1 -- 172.21.15.7:0/2191176337 >> 172.21.15.7:0/2191176337 conn(0x7f4a740c8390 msgr2=0x7f4a740c9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:48.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.597+0000 7f4a78c00640 1 -- 172.21.15.7:0/2191176337 shutdown_connections 2024-09-13T15:04:48.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.597+0000 7f4a78c00640 1 -- 172.21.15.7:0/2191176337 wait complete. 2024-09-13T15:04:48.618 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:04:48.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.761+0000 7fbe25400640 1 Processor -- start 2024-09-13T15:04:48.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.761+0000 7fbe25400640 1 -- start start 2024-09-13T15:04:48.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.761+0000 7fbe25400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe20150d90 0x7fbe20157590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:48.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.761+0000 7fbe25400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbe20157ad0 0x7fbe200c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:48.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.761+0000 7fbe25400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe20157100 con 0x7fbe200c5c30 2024-09-13T15:04:48.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.761+0000 7fbe25400640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe20066b00 con 0x7fbe20157ad0 2024-09-13T15:04:48.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.761+0000 7fbe25400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2015a3a0 con 0x7fbe20150d90 2024-09-13T15:04:48.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.761+0000 7fbe1e800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe20150d90 0x7fbe20157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:48.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.761+0000 7fbe1de00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbe20157ad0 0x7fbe200c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:48.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.761+0000 7fbe1e800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe20150d90 0x7fbe20157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:49118/0 (socket says 172.21.15.7:49118) 2024-09-13T15:04:48.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.761+0000 7fbe1e800640 1 -- 172.21.15.7:0/160174453 learned_addr learned my addr 172.21.15.7:0/160174453 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:48.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.761+0000 7fbe1f200640 1 --1- 172.21.15.7:0/160174453 >> v1:172.21.15.77:6789/0 conn(0x7fbe200c5c30 0x7fbe20071810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:58244/0 (socket says 172.21.15.7:58244) 2024-09-13T15:04:48.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.761+0000 7fbe1de00640 1 -- 172.21.15.7:0/160174453 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe20150d90 msgr2=0x7fbe20157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:48.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.761+0000 7fbe1de00640 1 --2- 172.21.15.7:0/160174453 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe20150d90 0x7fbe20157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.761+0000 7fbe1de00640 1 -- 172.21.15.7:0/160174453 >> v1:172.21.15.77:6789/0 conn(0x7fbe200c5c30 legacy=0x7fbe20071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.761+0000 7fbe1de00640 1 -- 172.21.15.7:0/160174453 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe20156db0 con 0x7fbe20157ad0 2024-09-13T15:04:48.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.761+0000 7fbe1e800640 1 --2- 172.21.15.7:0/160174453 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe20150d90 0x7fbe20157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:48.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.765+0000 7fbe1de00640 1 --2- 172.21.15.7:0/160174453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe20157ad0 0x7fbe200c56f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0097c0 tx=0x7fbe0c01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efef06562b599f1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:48.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.765+0000 7fbe1d400640 1 -- 172.21.15.7:0/160174453 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0a8990 con 0x7fbe20157ad0 2024-09-13T15:04:48.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.765+0000 7fbe1d400640 1 -- 172.21.15.7:0/160174453 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c0a8af0 con 0x7fbe20157ad0 2024-09-13T15:04:48.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.765+0000 7fbe1d400640 1 -- 172.21.15.7:0/160174453 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0a8e80 con 0x7fbe20157ad0 2024-09-13T15:04:48.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.765+0000 7fbe25400640 1 -- 172.21.15.7:0/160174453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe20157ad0 msgr2=0x7fbe200c56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.765+0000 7fbe25400640 1 --2- 172.21.15.7:0/160174453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe20157ad0 0x7fbe200c56f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0097c0 tx=0x7fbe0c01ec90 comp rx=0 tx=0).stop 2024-09-13T15:04:48.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.765+0000 7fbe25400640 1 -- 172.21.15.7:0/160174453 shutdown_connections 2024-09-13T15:04:48.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.765+0000 7fbe25400640 1 --2- 172.21.15.7:0/160174453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe20157ad0 0x7fbe200c56f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.765+0000 7fbe25400640 1 --2- 172.21.15.7:0/160174453 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe20150d90 0x7fbe20157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.765+0000 7fbe25400640 1 -- 172.21.15.7:0/160174453 >> 172.21.15.7:0/160174453 conn(0x7fbe20065d40 msgr2=0x7fbe20066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:48.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.765+0000 7fbe25400640 1 -- 172.21.15.7:0/160174453 shutdown_connections 2024-09-13T15:04:48.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.765+0000 7fbe25400640 1 -- 172.21.15.7:0/160174453 wait complete. 2024-09-13T15:04:48.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe25400640 1 Processor -- start 2024-09-13T15:04:48.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe25400640 1 -- start start 2024-09-13T15:04:48.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe25400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe200c5c30 0x7fbe201f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:48.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe25400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe20150d90 0x7fbe201591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:48.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe25400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe20157ad0 0x7fbe201596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:48.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe25400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe20154770 con 0x7fbe20157ad0 2024-09-13T15:04:48.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe25400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe20154510 con 0x7fbe200c5c30 2024-09-13T15:04:48.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe25400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe200c8260 con 0x7fbe20150d90 2024-09-13T15:04:48.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe1f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe20157ad0 0x7fbe201596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe1f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe20157ad0 0x7fbe201596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57934/0 (socket says 172.21.15.7:57934) 2024-09-13T15:04:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe1e800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe200c5c30 0x7fbe201f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe1f200640 1 -- 172.21.15.7:0/3786616831 learned_addr learned my addr 172.21.15.7:0/3786616831 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe1de00640 1 --2- 172.21.15.7:0/3786616831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe20150d90 0x7fbe201591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe1f200640 1 -- 172.21.15.7:0/3786616831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe20150d90 msgr2=0x7fbe201591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe1f200640 1 --2- 172.21.15.7:0/3786616831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe20150d90 0x7fbe201591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe1f200640 1 -- 172.21.15.7:0/3786616831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe200c5c30 msgr2=0x7fbe201f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe1f200640 1 --2- 172.21.15.7:0/3786616831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe200c5c30 0x7fbe201f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe1f200640 1 -- 172.21.15.7:0/3786616831 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe100094d0 con 0x7fbe20157ad0 2024-09-13T15:04:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe1f200640 1 --2- 172.21.15.7:0/3786616831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe20157ad0 0x7fbe201596f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800c7a0 tx=0x7fbe1800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:48.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe16a00640 1 -- 172.21.15.7:0/3786616831 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1800a640 con 0x7fbe20157ad0 2024-09-13T15:04:48.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe16a00640 1 -- 172.21.15.7:0/3786616831 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1800a7a0 con 0x7fbe20157ad0 2024-09-13T15:04:48.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe25400640 1 -- 172.21.15.7:0/3786616831 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0c009420 con 0x7fbe20157ad0 2024-09-13T15:04:48.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe16a00640 1 -- 172.21.15.7:0/3786616831 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1800ab10 con 0x7fbe20157ad0 2024-09-13T15:04:48.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.769+0000 7fbe25400640 1 -- 172.21.15.7:0/3786616831 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe200c7ca0 con 0x7fbe20157ad0 2024-09-13T15:04:48.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.773+0000 7fbe25400640 1 -- 172.21.15.7:0/3786616831 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2014b0d0 con 0x7fbe20157ad0 2024-09-13T15:04:48.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.773+0000 7fbe16a00640 1 -- 172.21.15.7:0/3786616831 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbe1800ac70 con 0x7fbe20157ad0 2024-09-13T15:04:48.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.773+0000 7fbe16a00640 1 --2- 172.21.15.7:0/3786616831 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbe000666c0 0x7fbe00068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:48.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.773+0000 7fbe16a00640 1 -- 172.21.15.7:0/3786616831 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbe18083d40 con 0x7fbe20157ad0 2024-09-13T15:04:48.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.773+0000 7fbe1e800640 1 --2- 172.21.15.7:0/3786616831 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbe000666c0 0x7fbe00068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:48.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.773+0000 7fbe1e800640 1 --2- 172.21.15.7:0/3786616831 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbe000666c0 0x7fbe00068b80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbe10006cb0 tx=0x7fbe10009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:48.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.777+0000 7fbe16a00640 1 -- 172.21.15.7:0/3786616831 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbe2014b0d0 con 0x7fbe20157ad0 2024-09-13T15:04:48.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.945+0000 7fbe25400640 1 -- 172.21.15.7:0/3786616831 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbe2014b0d0 con 0x7fbe20157ad0 2024-09-13T15:04:48.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.945+0000 7fbe16a00640 1 -- 172.21.15.7:0/3786616831 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbe2014b0d0 con 0x7fbe20157ad0 2024-09-13T15:04:48.949 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-13T15:04:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.949+0000 7fbe25400640 1 -- 172.21.15.7:0/3786616831 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbe000666c0 msgr2=0x7fbe00068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.949+0000 7fbe25400640 1 --2- 172.21.15.7:0/3786616831 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbe000666c0 0x7fbe00068b80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbe10006cb0 tx=0x7fbe10009240 comp rx=0 tx=0).stop 2024-09-13T15:04:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.949+0000 7fbe25400640 1 -- 172.21.15.7:0/3786616831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe20157ad0 msgr2=0x7fbe201596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.949+0000 7fbe25400640 1 --2- 172.21.15.7:0/3786616831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe20157ad0 0x7fbe201596f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800c7a0 tx=0x7fbe1800cc60 comp rx=0 tx=0).stop 2024-09-13T15:04:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.949+0000 7fbe25400640 1 -- 172.21.15.7:0/3786616831 shutdown_connections 2024-09-13T15:04:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.949+0000 7fbe25400640 1 --2- 172.21.15.7:0/3786616831 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbe000666c0 0x7fbe00068b80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.949+0000 7fbe25400640 1 --2- 172.21.15.7:0/3786616831 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbe20157ad0 0x7fbe201596f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.949+0000 7fbe25400640 1 --2- 172.21.15.7:0/3786616831 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbe20150d90 0x7fbe201591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.949+0000 7fbe25400640 1 --2- 172.21.15.7:0/3786616831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe200c5c30 0x7fbe201f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:48.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.949+0000 7fbe25400640 1 -- 172.21.15.7:0/3786616831 >> 172.21.15.7:0/3786616831 conn(0x7fbe20065d40 msgr2=0x7fbe20155040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:48.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.949+0000 7fbe25400640 1 -- 172.21.15.7:0/3786616831 shutdown_connections 2024-09-13T15:04:48.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:48.949+0000 7fbe25400640 1 -- 172.21.15.7:0/3786616831 wait complete. 2024-09-13T15:04:48.970 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:04:49.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.113+0000 7fe512400640 1 Processor -- start 2024-09-13T15:04:49.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.113+0000 7fe512400640 1 -- start start 2024-09-13T15:04:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.113+0000 7fe512400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe50c1501b0 0x7fe50c156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.113+0000 7fe512400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe50c0c16f0 0x7fe50c0c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.113+0000 7fe512400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe50c0c6880 con 0x7fe50c14fdd0 2024-09-13T15:04:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.113+0000 7fe512400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe50c0721e0 con 0x7fe50c1501b0 2024-09-13T15:04:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.113+0000 7fe512400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c06f860 con 0x7fe50c0c16f0 2024-09-13T15:04:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.113+0000 7fe50aa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe50c1501b0 0x7fe50c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.113+0000 7fe50aa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe50c1501b0 0x7fe50c156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57950/0 (socket says 172.21.15.7:57950) 2024-09-13T15:04:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.113+0000 7fe50aa00640 1 -- 172.21.15.7:0/3870345872 learned_addr learned my addr 172.21.15.7:0/3870345872 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.113+0000 7fe50be00640 1 --2- 172.21.15.7:0/3870345872 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe50c0c16f0 0x7fe50c0c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.113+0000 7fe50aa00640 1 -- 172.21.15.7:0/3870345872 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe50c0c16f0 msgr2=0x7fe50c0c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:49.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.113+0000 7fe50aa00640 1 --2- 172.21.15.7:0/3870345872 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe50c0c16f0 0x7fe50c0c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.113+0000 7fe50aa00640 1 -- 172.21.15.7:0/3870345872 >> v1:172.21.15.77:6789/0 conn(0x7fe50c14fdd0 legacy=0x7fe50c0c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:49.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.113+0000 7fe50aa00640 1 -- 172.21.15.7:0/3870345872 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c0c6ad0 con 0x7fe50c1501b0 2024-09-13T15:04:49.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.117+0000 7fe50aa00640 1 --2- 172.21.15.7:0/3870345872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe50c1501b0 0x7fe50c156780 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009870 tx=0x7fe4f801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8385c697794d40bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:49.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.117+0000 7fe50a000640 1 -- 172.21.15.7:0/3870345872 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f80a9620 con 0x7fe50c1501b0 2024-09-13T15:04:49.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.117+0000 7fe50a000640 1 -- 172.21.15.7:0/3870345872 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f80a9780 con 0x7fe50c1501b0 2024-09-13T15:04:49.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.117+0000 7fe50a000640 1 -- 172.21.15.7:0/3870345872 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f80a9b10 con 0x7fe50c1501b0 2024-09-13T15:04:49.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.117+0000 7fe512400640 1 -- 172.21.15.7:0/3870345872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe50c1501b0 msgr2=0x7fe50c156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:49.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.117+0000 7fe512400640 1 --2- 172.21.15.7:0/3870345872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe50c1501b0 0x7fe50c156780 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009870 tx=0x7fe4f801c560 comp rx=0 tx=0).stop 2024-09-13T15:04:49.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.117+0000 7fe512400640 1 -- 172.21.15.7:0/3870345872 shutdown_connections 2024-09-13T15:04:49.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.117+0000 7fe512400640 1 --2- 172.21.15.7:0/3870345872 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe50c0c16f0 0x7fe50c0c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.117+0000 7fe512400640 1 --2- 172.21.15.7:0/3870345872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe50c1501b0 0x7fe50c156780 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.117+0000 7fe512400640 1 -- 172.21.15.7:0/3870345872 >> 172.21.15.7:0/3870345872 conn(0x7fe50c065d40 msgr2=0x7fe50c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:49.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.117+0000 7fe512400640 1 -- 172.21.15.7:0/3870345872 shutdown_connections 2024-09-13T15:04:49.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.117+0000 7fe512400640 1 -- 172.21.15.7:0/3870345872 wait complete. 2024-09-13T15:04:49.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe512400640 1 Processor -- start 2024-09-13T15:04:49.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe512400640 1 -- start start 2024-09-13T15:04:49.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe512400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe50c0c16f0 0x7fe50c14e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe512400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe50c14fdd0 0x7fe50c145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe512400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe50c1501b0 0x7fe50c14ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe512400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c1f20b0 con 0x7fe50c0c16f0 2024-09-13T15:04:49.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe512400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c1554e0 con 0x7fe50c1501b0 2024-09-13T15:04:49.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe512400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe50c1f1dd0 con 0x7fe50c14fdd0 2024-09-13T15:04:49.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe50b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe50c0c16f0 0x7fe50c14e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe50b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe50c0c16f0 0x7fe50c14e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57954/0 (socket says 172.21.15.7:57954) 2024-09-13T15:04:49.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe50b400640 1 -- 172.21.15.7:0/2903313847 learned_addr learned my addr 172.21.15.7:0/2903313847 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:49.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe50be00640 1 --2- 172.21.15.7:0/2903313847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe50c1501b0 0x7fe50c14ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe50aa00640 1 --2- 172.21.15.7:0/2903313847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe50c14fdd0 0x7fe50c145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe50b400640 1 -- 172.21.15.7:0/2903313847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe50c14fdd0 msgr2=0x7fe50c145300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:49.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe50b400640 1 --2- 172.21.15.7:0/2903313847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe50c14fdd0 0x7fe50c145300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe50b400640 1 -- 172.21.15.7:0/2903313847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe50c1501b0 msgr2=0x7fe50c14ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:49.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe50b400640 1 --2- 172.21.15.7:0/2903313847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe50c1501b0 0x7fe50c14ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe50b400640 1 -- 172.21.15.7:0/2903313847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f80094d0 con 0x7fe50c0c16f0 2024-09-13T15:04:49.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe50b400640 1 --2- 172.21.15.7:0/2903313847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe50c0c16f0 0x7fe50c14e3f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00c500 tx=0x7fe4fc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:49.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe503400640 1 -- 172.21.15.7:0/2903313847 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc005220 con 0x7fe50c0c16f0 2024-09-13T15:04:49.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe503400640 1 -- 172.21.15.7:0/2903313847 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4fc005380 con 0x7fe50c0c16f0 2024-09-13T15:04:49.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe503400640 1 -- 172.21.15.7:0/2903313847 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc007270 con 0x7fe50c0c16f0 2024-09-13T15:04:49.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe512400640 1 -- 172.21.15.7:0/2903313847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50c14d630 con 0x7fe50c0c16f0 2024-09-13T15:04:49.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe512400640 1 -- 172.21.15.7:0/2903313847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50c14dbf0 con 0x7fe50c0c16f0 2024-09-13T15:04:49.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.121+0000 7fe512400640 1 -- 172.21.15.7:0/2903313847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50c14e240 con 0x7fe50c0c16f0 2024-09-13T15:04:49.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.125+0000 7fe503400640 1 -- 172.21.15.7:0/2903313847 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe4fc0073d0 con 0x7fe50c0c16f0 2024-09-13T15:04:49.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.125+0000 7fe503400640 1 --2- 172.21.15.7:0/2903313847 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe4ec066690 0x7fe4ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.125+0000 7fe503400640 1 -- 172.21.15.7:0/2903313847 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe4fc083980 con 0x7fe50c0c16f0 2024-09-13T15:04:49.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.125+0000 7fe50aa00640 1 --2- 172.21.15.7:0/2903313847 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe4ec066690 0x7fe4ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.125+0000 7fe50aa00640 1 --2- 172.21.15.7:0/2903313847 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe4ec066690 0x7fe4ec068b50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80ae000 tx=0x7fe4f8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:49.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.129+0000 7fe503400640 1 -- 172.21.15.7:0/2903313847 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe4fc0508a0 con 0x7fe50c0c16f0 2024-09-13T15:04:49.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.289+0000 7fe512400640 1 -- 172.21.15.7:0/2903313847 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe50c0c55d0 con 0x7fe50c0c16f0 2024-09-13T15:04:49.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.289+0000 7fe503400640 1 -- 172.21.15.7:0/2903313847 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe4fc053ec0 con 0x7fe50c0c16f0 2024-09-13T15:04:49.291 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T15:04:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.289+0000 7fe512400640 1 -- 172.21.15.7:0/2903313847 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe4ec066690 msgr2=0x7fe4ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.289+0000 7fe512400640 1 --2- 172.21.15.7:0/2903313847 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe4ec066690 0x7fe4ec068b50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe4f80ae000 tx=0x7fe4f8009040 comp rx=0 tx=0).stop 2024-09-13T15:04:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.289+0000 7fe512400640 1 -- 172.21.15.7:0/2903313847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe50c0c16f0 msgr2=0x7fe50c14e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.289+0000 7fe512400640 1 --2- 172.21.15.7:0/2903313847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe50c0c16f0 0x7fe50c14e3f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc00c500 tx=0x7fe4fc00c9c0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.289+0000 7fe512400640 1 -- 172.21.15.7:0/2903313847 shutdown_connections 2024-09-13T15:04:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.289+0000 7fe512400640 1 --2- 172.21.15.7:0/2903313847 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe4ec066690 0x7fe4ec068b50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.289+0000 7fe512400640 1 --2- 172.21.15.7:0/2903313847 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe50c1501b0 0x7fe50c14ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.289+0000 7fe512400640 1 --2- 172.21.15.7:0/2903313847 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe50c14fdd0 0x7fe50c145300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.289+0000 7fe512400640 1 --2- 172.21.15.7:0/2903313847 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe50c0c16f0 0x7fe50c14e3f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.289+0000 7fe512400640 1 -- 172.21.15.7:0/2903313847 >> 172.21.15.7:0/2903313847 conn(0x7fe50c065d40 msgr2=0x7fe50c0703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.289+0000 7fe512400640 1 -- 172.21.15.7:0/2903313847 shutdown_connections 2024-09-13T15:04:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.289+0000 7fe512400640 1 -- 172.21.15.7:0/2903313847 wait complete. 2024-09-13T15:04:49.312 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2024-09-13T15:04:49.312 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:04:49.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.449+0000 7f55d7a00640 1 Processor -- start 2024-09-13T15:04:49.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.449+0000 7f55d7a00640 1 -- start start 2024-09-13T15:04:49.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.453+0000 7f55d7a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f55d00c00f0 0x7f55d00c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.453+0000 7f55d7a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f55d00b0cb0 0x7f55d014f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.453+0000 7f55d7a00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d006fd10 con 0x7f55d00c04d0 2024-09-13T15:04:49.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.453+0000 7f55d7a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d0071000 con 0x7f55d00b0cb0 2024-09-13T15:04:49.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.453+0000 7f55d7a00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d0155ec0 con 0x7f55d00c00f0 2024-09-13T15:04:49.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.453+0000 7f55d5a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f55d00b0cb0 0x7f55d014f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.453+0000 7f55d5a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f55d00b0cb0 0x7f55d014f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57966/0 (socket says 172.21.15.7:57966) 2024-09-13T15:04:49.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.453+0000 7f55d5a00640 1 -- 172.21.15.7:0/3979652028 learned_addr learned my addr 172.21.15.7:0/3979652028 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:49.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.453+0000 7f55d5000640 1 --2- 172.21.15.7:0/3979652028 >> v2:172.21.15.77:3300/0 conn(0x7f55d00c00f0 0x7f55d00c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.453+0000 7f55d5a00640 1 -- 172.21.15.7:0/3979652028 >> v2:172.21.15.77:3300/0 conn(0x7f55d00c00f0 msgr2=0x7f55d00c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.453+0000 7f55d5a00640 1 --2- 172.21.15.7:0/3979652028 >> v2:172.21.15.77:3300/0 conn(0x7f55d00c00f0 0x7f55d00c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.453+0000 7f55d5a00640 1 -- 172.21.15.7:0/3979652028 >> v1:172.21.15.77:6789/0 conn(0x7f55d00c04d0 legacy=0x7f55d006f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.453+0000 7f55d5a00640 1 -- 172.21.15.7:0/3979652028 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d006ff60 con 0x7f55d00b0cb0 2024-09-13T15:04:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.453+0000 7f55d5a00640 1 --2- 172.21.15.7:0/3979652028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55d00b0cb0 0x7f55d014f7e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f55d00c86f0 tx=0x7f55c801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb81430938e5e1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.453+0000 7f55cfe00640 1 -- 172.21.15.7:0/3979652028 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c80af400 con 0x7f55d00b0cb0 2024-09-13T15:04:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55cfe00640 1 -- 172.21.15.7:0/3979652028 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c80ab050 con 0x7f55d00b0cb0 2024-09-13T15:04:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55cfe00640 1 -- 172.21.15.7:0/3979652028 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c80af780 con 0x7f55d00b0cb0 2024-09-13T15:04:49.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d7a00640 1 -- 172.21.15.7:0/3979652028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55d00b0cb0 msgr2=0x7f55d014f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:49.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d7a00640 1 --2- 172.21.15.7:0/3979652028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55d00b0cb0 0x7f55d014f7e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f55d00c86f0 tx=0x7f55c801f1e0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d7a00640 1 -- 172.21.15.7:0/3979652028 shutdown_connections 2024-09-13T15:04:49.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d7a00640 1 --2- 172.21.15.7:0/3979652028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55d00b0cb0 0x7f55d014f7e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d7a00640 1 --2- 172.21.15.7:0/3979652028 >> v2:172.21.15.77:3300/0 conn(0x7f55d00c00f0 0x7f55d00c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d7a00640 1 -- 172.21.15.7:0/3979652028 >> 172.21.15.7:0/3979652028 conn(0x7f55d0065d40 msgr2=0x7f55d0066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:49.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d7a00640 1 -- 172.21.15.7:0/3979652028 shutdown_connections 2024-09-13T15:04:49.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d7a00640 1 -- 172.21.15.7:0/3979652028 wait complete. 2024-09-13T15:04:49.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d7a00640 1 Processor -- start 2024-09-13T15:04:49.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d7a00640 1 -- start start 2024-09-13T15:04:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d7a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55d00b0cb0 0x7f55d00c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d7a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55d00c00f0 0x7f55d014a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d7a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55d00c04d0 0x7f55d01465d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d7a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d00c57c0 con 0x7f55d00c00f0 2024-09-13T15:04:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d7a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d0146b10 con 0x7f55d00b0cb0 2024-09-13T15:04:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d7a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d0147230 con 0x7f55d00c04d0 2024-09-13T15:04:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55c7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55d00c00f0 0x7f55d014a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55c7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55d00c00f0 0x7f55d014a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57974/0 (socket says 172.21.15.7:57974) 2024-09-13T15:04:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55c7e00640 1 -- 172.21.15.7:0/3236209677 learned_addr learned my addr 172.21.15.7:0/3236209677 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d5000640 1 --2- 172.21.15.7:0/3236209677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55d00b0cb0 0x7f55d00c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d5a00640 1 --2- 172.21.15.7:0/3236209677 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55d00c04d0 0x7f55d01465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55c7e00640 1 -- 172.21.15.7:0/3236209677 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55d00c04d0 msgr2=0x7f55d01465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55c7e00640 1 --2- 172.21.15.7:0/3236209677 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55d00c04d0 0x7f55d01465d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55c7e00640 1 -- 172.21.15.7:0/3236209677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55d00b0cb0 msgr2=0x7f55d00c5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55c7e00640 1 --2- 172.21.15.7:0/3236209677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55d00b0cb0 0x7f55d00c5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55c7e00640 1 -- 172.21.15.7:0/3236209677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c8009b30 con 0x7f55d00c00f0 2024-09-13T15:04:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.457+0000 7f55d5a00640 1 --2- 172.21.15.7:0/3236209677 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55d00c04d0 0x7f55d01465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.461+0000 7f55c7e00640 1 --2- 172.21.15.7:0/3236209677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55d00c00f0 0x7f55d014a790 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f55b800c500 tx=0x7f55b800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:49.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.461+0000 7f55cd600640 1 -- 172.21.15.7:0/3236209677 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b80052d0 con 0x7f55d00c00f0 2024-09-13T15:04:49.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.461+0000 7f55cd600640 1 -- 172.21.15.7:0/3236209677 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b8005430 con 0x7f55d00c00f0 2024-09-13T15:04:49.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.461+0000 7f55cd600640 1 -- 172.21.15.7:0/3236209677 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b8012830 con 0x7f55d00c00f0 2024-09-13T15:04:49.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.461+0000 7f55d7a00640 1 -- 172.21.15.7:0/3236209677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d01474d0 con 0x7f55d00c00f0 2024-09-13T15:04:49.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.461+0000 7f55d7a00640 1 -- 172.21.15.7:0/3236209677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d00c5450 con 0x7f55d00c00f0 2024-09-13T15:04:49.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.461+0000 7f55d7a00640 1 -- 172.21.15.7:0/3236209677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d0067650 con 0x7f55d00c00f0 2024-09-13T15:04:49.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.461+0000 7f55cd600640 1 -- 172.21.15.7:0/3236209677 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f55b8012990 con 0x7f55d00c00f0 2024-09-13T15:04:49.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.461+0000 7f55cd600640 1 --2- 172.21.15.7:0/3236209677 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f55ac066690 0x7f55ac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.461+0000 7f55cd600640 1 -- 172.21.15.7:0/3236209677 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f55b8084150 con 0x7f55d00c00f0 2024-09-13T15:04:49.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.465+0000 7f55d5000640 1 --2- 172.21.15.7:0/3236209677 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f55ac066690 0x7f55ac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.465+0000 7f55d5000640 1 --2- 172.21.15.7:0/3236209677 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f55ac066690 0x7f55ac068b50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009b60 tx=0x7f55c0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:49.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.465+0000 7f55cd600640 1 -- 172.21.15.7:0/3236209677 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f55b8050fe0 con 0x7f55d00c00f0 2024-09-13T15:04:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.661+0000 7f55d7a00640 1 -- 172.21.15.7:0/3236209677 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55d0156c40 con 0x7f55d00c00f0 2024-09-13T15:04:49.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.661+0000 7f55cd600640 1 -- 172.21.15.7:0/3236209677 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6299 (secure 0 0 0) 0x7f55b8054600 con 0x7f55d00c00f0 2024-09-13T15:04:49.662 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:49.662 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:04:36.936420+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"e","rank":4,"incarnation":17,"state":"up:active","state_seq":46,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:04:49.662 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 18 2024-09-13T15:04:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.661+0000 7f55d7a00640 1 -- 172.21.15.7:0/3236209677 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f55ac066690 msgr2=0x7f55ac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.661+0000 7f55d7a00640 1 --2- 172.21.15.7:0/3236209677 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f55ac066690 0x7f55ac068b50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f55c0009b60 tx=0x7f55c0009190 comp rx=0 tx=0).stop 2024-09-13T15:04:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.661+0000 7f55d7a00640 1 -- 172.21.15.7:0/3236209677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55d00c00f0 msgr2=0x7f55d014a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.661+0000 7f55d7a00640 1 --2- 172.21.15.7:0/3236209677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55d00c00f0 0x7f55d014a790 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f55b800c500 tx=0x7f55b800c9c0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.661+0000 7f55d7a00640 1 -- 172.21.15.7:0/3236209677 shutdown_connections 2024-09-13T15:04:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.661+0000 7f55d7a00640 1 --2- 172.21.15.7:0/3236209677 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f55ac066690 0x7f55ac068b50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.661+0000 7f55d7a00640 1 --2- 172.21.15.7:0/3236209677 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f55d00c04d0 0x7f55d01465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.661+0000 7f55d7a00640 1 --2- 172.21.15.7:0/3236209677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f55d00c00f0 0x7f55d014a790 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.661+0000 7f55d7a00640 1 --2- 172.21.15.7:0/3236209677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f55d00b0cb0 0x7f55d00c5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.661+0000 7f55d7a00640 1 -- 172.21.15.7:0/3236209677 >> 172.21.15.7:0/3236209677 conn(0x7f55d0065d40 msgr2=0x7f55d0068040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.661+0000 7f55d7a00640 1 -- 172.21.15.7:0/3236209677 shutdown_connections 2024-09-13T15:04:49.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.661+0000 7f55d7a00640 1 -- 172.21.15.7:0/3236209677 wait complete. 2024-09-13T15:04:49.683 INFO:tasks.mds_thrash:Ready to start thrashing 2024-09-13T15:04:49.684 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2024-09-13T15:04:49.684 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:04:49.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.825+0000 7ff5e4200640 1 Processor -- start 2024-09-13T15:04:49.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.825+0000 7ff5e4200640 1 -- start start 2024-09-13T15:04:49.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.825+0000 7ff5e4200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff5dc06ede0 0x7ff5dc15c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.825+0000 7ff5e4200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff5dc153680 0x7ff5dc0c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.825+0000 7ff5e4200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5dc15ced0 con 0x7ff5dc1532a0 2024-09-13T15:04:49.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.825+0000 7ff5e4200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5dc15d770 con 0x7ff5dc153680 2024-09-13T15:04:49.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.825+0000 7ff5e4200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5dc159790 con 0x7ff5dc06ede0 2024-09-13T15:04:49.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.825+0000 7ff5e2200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff5dc153680 0x7ff5dc0c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.825+0000 7ff5e2200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff5dc153680 0x7ff5dc0c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57988/0 (socket says 172.21.15.7:57988) 2024-09-13T15:04:49.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.825+0000 7ff5e2200640 1 -- 172.21.15.7:0/3494011183 learned_addr learned my addr 172.21.15.7:0/3494011183 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:49.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.825+0000 7ff5e0e00640 1 --2- 172.21.15.7:0/3494011183 >> v2:172.21.15.77:3300/0 conn(0x7ff5dc06ede0 0x7ff5dc15c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.825+0000 7ff5e2200640 1 -- 172.21.15.7:0/3494011183 >> v2:172.21.15.77:3300/0 conn(0x7ff5dc06ede0 msgr2=0x7ff5dc15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:49.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.825+0000 7ff5e2200640 1 --2- 172.21.15.7:0/3494011183 >> v2:172.21.15.77:3300/0 conn(0x7ff5dc06ede0 0x7ff5dc15c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.825+0000 7ff5e2200640 1 -- 172.21.15.7:0/3494011183 >> v1:172.21.15.77:6789/0 conn(0x7ff5dc1532a0 legacy=0x7ff5dc159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:49.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.825+0000 7ff5e2200640 1 -- 172.21.15.7:0/3494011183 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc15d1b0 con 0x7ff5dc153680 2024-09-13T15:04:49.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.829+0000 7ff5e2200640 1 --2- 172.21.15.7:0/3494011183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc153680 0x7ff5dc0c68f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0c28c0 tx=0x7ff5d401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14ac18c80a99b29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:49.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.829+0000 7ff5dbe00640 1 -- 172.21.15.7:0/3494011183 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d40a5620 con 0x7ff5dc153680 2024-09-13T15:04:49.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.829+0000 7ff5dbe00640 1 -- 172.21.15.7:0/3494011183 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d40a5780 con 0x7ff5dc153680 2024-09-13T15:04:49.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.829+0000 7ff5dbe00640 1 -- 172.21.15.7:0/3494011183 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d40a5b10 con 0x7ff5dc153680 2024-09-13T15:04:49.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.829+0000 7ff5e4200640 1 -- 172.21.15.7:0/3494011183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc153680 msgr2=0x7ff5dc0c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:49.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.829+0000 7ff5e4200640 1 --2- 172.21.15.7:0/3494011183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc153680 0x7ff5dc0c68f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0c28c0 tx=0x7ff5d401c960 comp rx=0 tx=0).stop 2024-09-13T15:04:49.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.829+0000 7ff5e4200640 1 -- 172.21.15.7:0/3494011183 shutdown_connections 2024-09-13T15:04:49.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.829+0000 7ff5e4200640 1 --2- 172.21.15.7:0/3494011183 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc153680 0x7ff5dc0c68f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.829+0000 7ff5e4200640 1 --2- 172.21.15.7:0/3494011183 >> v2:172.21.15.77:3300/0 conn(0x7ff5dc06ede0 0x7ff5dc15c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.829+0000 7ff5e4200640 1 -- 172.21.15.7:0/3494011183 >> 172.21.15.7:0/3494011183 conn(0x7ff5dc06e110 msgr2=0x7ff5dc06e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:49.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.829+0000 7ff5e4200640 1 -- 172.21.15.7:0/3494011183 shutdown_connections 2024-09-13T15:04:49.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.829+0000 7ff5e4200640 1 -- 172.21.15.7:0/3494011183 wait complete. 2024-09-13T15:04:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.829+0000 7ff5e4200640 1 Processor -- start 2024-09-13T15:04:49.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.829+0000 7ff5e4200640 1 -- start start 2024-09-13T15:04:49.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e4200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc06ede0 0x7ff5dc14ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e4200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5dc1532a0 0x7ff5dc1f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e4200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5dc153680 0x7ff5dc14b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e4200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc15ba30 con 0x7ff5dc06ede0 2024-09-13T15:04:49.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e4200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc15b4b0 con 0x7ff5dc153680 2024-09-13T15:04:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e4200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc15b750 con 0x7ff5dc1532a0 2024-09-13T15:04:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e1800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc06ede0 0x7ff5dc14ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e1800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc06ede0 0x7ff5dc14ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57992/0 (socket says 172.21.15.7:57992) 2024-09-13T15:04:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e1800640 1 -- 172.21.15.7:0/895389524 learned_addr learned my addr 172.21.15.7:0/895389524 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e0e00640 1 --2- 172.21.15.7:0/895389524 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5dc1532a0 0x7ff5dc1f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e2200640 1 --2- 172.21.15.7:0/895389524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5dc153680 0x7ff5dc14b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e1800640 1 -- 172.21.15.7:0/895389524 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5dc1532a0 msgr2=0x7ff5dc1f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e1800640 1 --2- 172.21.15.7:0/895389524 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5dc1532a0 0x7ff5dc1f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e1800640 1 -- 172.21.15.7:0/895389524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5dc153680 msgr2=0x7ff5dc14b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e1800640 1 --2- 172.21.15.7:0/895389524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5dc153680 0x7ff5dc14b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e1800640 1 -- 172.21.15.7:0/895389524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d4009b30 con 0x7ff5dc06ede0 2024-09-13T15:04:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e1800640 1 --2- 172.21.15.7:0/895389524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc06ede0 0x7ff5dc14ada0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000c500 tx=0x7ff5d000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:49.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5d9600640 1 -- 172.21.15.7:0/895389524 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0005220 con 0x7ff5dc06ede0 2024-09-13T15:04:49.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5d9600640 1 -- 172.21.15.7:0/895389524 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d0005380 con 0x7ff5dc06ede0 2024-09-13T15:04:49.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5d9600640 1 -- 172.21.15.7:0/895389524 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0007270 con 0x7ff5dc06ede0 2024-09-13T15:04:49.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e4200640 1 -- 172.21.15.7:0/895389524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5dc1f59e0 con 0x7ff5dc06ede0 2024-09-13T15:04:49.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e4200640 1 -- 172.21.15.7:0/895389524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5dc1f5fa0 con 0x7ff5dc06ede0 2024-09-13T15:04:49.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5e4200640 1 -- 172.21.15.7:0/895389524 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5dc06da10 con 0x7ff5dc06ede0 2024-09-13T15:04:49.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.833+0000 7ff5d9600640 1 -- 172.21.15.7:0/895389524 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff5d00073d0 con 0x7ff5dc06ede0 2024-09-13T15:04:49.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.837+0000 7ff5d9600640 1 --2- 172.21.15.7:0/895389524 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff5bc0666c0 0x7ff5bc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:49.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.837+0000 7ff5d9600640 1 -- 172.21.15.7:0/895389524 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff5d0083ed0 con 0x7ff5dc06ede0 2024-09-13T15:04:49.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.837+0000 7ff5e0e00640 1 --2- 172.21.15.7:0/895389524 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff5bc0666c0 0x7ff5bc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:49.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.837+0000 7ff5e0e00640 1 --2- 172.21.15.7:0/895389524 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff5bc0666c0 0x7ff5bc068b80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc13eb00 tx=0x7ff5c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:49.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:49.841+0000 7ff5d9600640 1 -- 172.21.15.7:0/895389524 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff5d0050df0 con 0x7ff5dc06ede0 2024-09-13T15:04:50.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.001+0000 7ff5e4200640 1 -- 172.21.15.7:0/895389524 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5dc166340 con 0x7ff5bc0666c0 2024-09-13T15:04:50.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.029+0000 7ff5d9600640 1 -- 172.21.15.7:0/895389524 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368649 (secure 0 0 0) 0x7ff5c8011950 con 0x7ff5bc0666c0 2024-09-13T15:04:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:50.039 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T15:04:50.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.033+0000 7ff5e4200640 1 -- 172.21.15.7:0/895389524 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff5bc0666c0 msgr2=0x7ff5bc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:50.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.033+0000 7ff5e4200640 1 --2- 172.21.15.7:0/895389524 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff5bc0666c0 0x7ff5bc068b80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc13eb00 tx=0x7ff5c8008040 comp rx=0 tx=0).stop 2024-09-13T15:04:50.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.033+0000 7ff5e4200640 1 -- 172.21.15.7:0/895389524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc06ede0 msgr2=0x7ff5dc14ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:50.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.033+0000 7ff5e4200640 1 --2- 172.21.15.7:0/895389524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc06ede0 0x7ff5dc14ada0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000c500 tx=0x7ff5d000c9c0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.033+0000 7ff5e4200640 1 -- 172.21.15.7:0/895389524 shutdown_connections 2024-09-13T15:04:50.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.033+0000 7ff5e4200640 1 --2- 172.21.15.7:0/895389524 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff5bc0666c0 0x7ff5bc068b80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.033+0000 7ff5e4200640 1 --2- 172.21.15.7:0/895389524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5dc153680 0x7ff5dc14b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.033+0000 7ff5e4200640 1 --2- 172.21.15.7:0/895389524 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff5dc1532a0 0x7ff5dc1f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.033+0000 7ff5e4200640 1 --2- 172.21.15.7:0/895389524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5dc06ede0 0x7ff5dc14ada0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.033+0000 7ff5e4200640 1 -- 172.21.15.7:0/895389524 >> 172.21.15.7:0/895389524 conn(0x7ff5dc06e110 msgr2=0x7ff5dc159ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:50.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.033+0000 7ff5e4200640 1 -- 172.21.15.7:0/895389524 shutdown_connections 2024-09-13T15:04:50.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.033+0000 7ff5e4200640 1 -- 172.21.15.7:0/895389524 wait complete. 2024-09-13T15:04:50.057 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-09-13T15:04:48.698207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600393,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":368,"num_write_kb":2483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232072,"kb_used_data":3656,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":754742648,"statfs":{"total":773094113280,"available":772856471552,"internally_reserved":0,"allocated":3743744,"data_stored":2137074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":233819704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1358,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004624"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.934945+0000","last_change":"2024-09-13T15:01:44.418856+0000","last_active":"2024-09-13T15:04:35.934945+0000","last_peered":"2024-09-13T15:04:35.934945+0000","last_clean":"2024-09-13T15:04:35.934945+0000","last_became_active":"2024-09-13T15:01:44.418641+0000","last_became_peered":"2024-09-13T15:01:44.418641+0000","last_unstale":"2024-09-13T15:04:35.934945+0000","last_undegraded":"2024-09-13T15:04:35.934945+0000","last_fullsized":"2024-09-13T15:04:35.934945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:40.178824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738513+0000","last_change":"2024-09-13T15:01:44.809371+0000","last_active":"2024-09-13T15:02:33.738513+0000","last_peered":"2024-09-13T15:02:33.738513+0000","last_clean":"2024-09-13T15:02:33.738513+0000","last_became_active":"2024-09-13T15:01:44.809091+0000","last_became_peered":"2024-09-13T15:01:44.809091+0000","last_unstale":"2024-09-13T15:02:33.738513+0000","last_undegraded":"2024-09-13T15:02:33.738513+0000","last_fullsized":"2024-09-13T15:02:33.738513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:22.412025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737520+0000","last_change":"2024-09-13T15:01:48.910757+0000","last_active":"2024-09-13T15:02:33.737520+0000","last_peered":"2024-09-13T15:02:33.737520+0000","last_clean":"2024-09-13T15:02:33.737520+0000","last_became_active":"2024-09-13T15:01:48.910262+0000","last_became_peered":"2024-09-13T15:01:48.910262+0000","last_unstale":"2024-09-13T15:02:33.737520+0000","last_undegraded":"2024-09-13T15:02:33.737520+0000","last_fullsized":"2024-09-13T15:02:33.737520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:39.290557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:03:43.915924+0000","last_change":"2024-09-13T15:01:44.404818+0000","last_active":"2024-09-13T15:03:43.915924+0000","last_peered":"2024-09-13T15:03:43.915924+0000","last_clean":"2024-09-13T15:03:43.915924+0000","last_became_active":"2024-09-13T15:01:44.401666+0000","last_became_peered":"2024-09-13T15:01:44.401666+0000","last_unstale":"2024-09-13T15:03:43.915924+0000","last_undegraded":"2024-09-13T15:03:43.915924+0000","last_fullsized":"2024-09-13T15:03:43.915924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:31.818163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742417+0000","last_change":"2024-09-13T15:01:44.850292+0000","last_active":"2024-09-13T15:02:33.742417+0000","last_peered":"2024-09-13T15:02:33.742417+0000","last_clean":"2024-09-13T15:02:33.742417+0000","last_became_active":"2024-09-13T15:01:44.849825+0000","last_became_peered":"2024-09-13T15:01:44.849825+0000","last_unstale":"2024-09-13T15:02:33.742417+0000","last_undegraded":"2024-09-13T15:02:33.742417+0000","last_fullsized":"2024-09-13T15:02:33.742417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:22.582742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.746607+0000","last_change":"2024-09-13T15:01:48.850426+0000","last_active":"2024-09-13T15:02:33.746607+0000","last_peered":"2024-09-13T15:02:33.746607+0000","last_clean":"2024-09-13T15:02:33.746607+0000","last_became_active":"2024-09-13T15:01:48.848750+0000","last_became_peered":"2024-09-13T15:01:48.848750+0000","last_unstale":"2024-09-13T15:02:33.746607+0000","last_undegraded":"2024-09-13T15:02:33.746607+0000","last_fullsized":"2024-09-13T15:02:33.746607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:55.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'12","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.939854+0000","last_change":"2024-09-13T15:01:44.437850+0000","last_active":"2024-09-13T15:04:35.939854+0000","last_peered":"2024-09-13T15:04:35.939854+0000","last_clean":"2024-09-13T15:04:35.939854+0000","last_became_active":"2024-09-13T15:01:44.437168+0000","last_became_peered":"2024-09-13T15:01:44.437168+0000","last_unstale":"2024-09-13T15:04:35.939854+0000","last_undegraded":"2024-09-13T15:04:35.939854+0000","last_fullsized":"2024-09-13T15:04:35.939854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:23.540408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745120+0000","last_change":"2024-09-13T15:01:44.845989+0000","last_active":"2024-09-13T15:02:33.745120+0000","last_peered":"2024-09-13T15:02:33.745120+0000","last_clean":"2024-09-13T15:02:33.745120+0000","last_became_active":"2024-09-13T15:01:44.845395+0000","last_became_peered":"2024-09-13T15:01:44.845395+0000","last_unstale":"2024-09-13T15:02:33.745120+0000","last_undegraded":"2024-09-13T15:02:33.745120+0000","last_fullsized":"2024-09-13T15:02:33.745120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:52.267507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748880+0000","last_change":"2024-09-13T15:01:48.865388+0000","last_active":"2024-09-13T15:02:33.748880+0000","last_peered":"2024-09-13T15:02:33.748880+0000","last_clean":"2024-09-13T15:02:33.748880+0000","last_became_active":"2024-09-13T15:01:48.864314+0000","last_became_peered":"2024-09-13T15:01:48.864314+0000","last_unstale":"2024-09-13T15:02:33.748880+0000","last_undegraded":"2024-09-13T15:02:33.748880+0000","last_fullsized":"2024-09-13T15:02:33.748880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:18.637430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.937176+0000","last_change":"2024-09-13T15:01:44.424080+0000","last_active":"2024-09-13T15:04:35.937176+0000","last_peered":"2024-09-13T15:04:35.937176+0000","last_clean":"2024-09-13T15:04:35.937176+0000","last_became_active":"2024-09-13T15:01:44.423381+0000","last_became_peered":"2024-09-13T15:01:44.423381+0000","last_unstale":"2024-09-13T15:04:35.937176+0000","last_undegraded":"2024-09-13T15:04:35.937176+0000","last_fullsized":"2024-09-13T15:04:35.937176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:38:20.455380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743629+0000","last_change":"2024-09-13T15:01:44.849670+0000","last_active":"2024-09-13T15:02:33.743629+0000","last_peered":"2024-09-13T15:02:33.743629+0000","last_clean":"2024-09-13T15:02:33.743629+0000","last_became_active":"2024-09-13T15:01:44.849038+0000","last_became_peered":"2024-09-13T15:01:44.849038+0000","last_unstale":"2024-09-13T15:02:33.743629+0000","last_undegraded":"2024-09-13T15:02:33.743629+0000","last_fullsized":"2024-09-13T15:02:33.743629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:45.570774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.747610+0000","last_change":"2024-09-13T15:01:48.854953+0000","last_active":"2024-09-13T15:02:33.747610+0000","last_peered":"2024-09-13T15:02:33.747610+0000","last_clean":"2024-09-13T15:02:33.747610+0000","last_became_active":"2024-09-13T15:01:48.853858+0000","last_became_peered":"2024-09-13T15:01:48.853858+0000","last_unstale":"2024-09-13T15:02:33.747610+0000","last_undegraded":"2024-09-13T15:02:33.747610+0000","last_fullsized":"2024-09-13T15:02:33.747610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:07.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742073+0000","last_change":"2024-09-13T15:01:44.824391+0000","last_active":"2024-09-13T15:02:33.742073+0000","last_peered":"2024-09-13T15:02:33.742073+0000","last_clean":"2024-09-13T15:02:33.742073+0000","last_became_active":"2024-09-13T15:01:44.823690+0000","last_became_peered":"2024-09-13T15:01:44.823690+0000","last_unstale":"2024-09-13T15:02:33.742073+0000","last_undegraded":"2024-09-13T15:02:33.742073+0000","last_fullsized":"2024-09-13T15:02:33.742073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.596789+0000","last_change":"2024-09-13T15:01:44.421523+0000","last_active":"2024-09-13T15:04:17.596789+0000","last_peered":"2024-09-13T15:04:17.596789+0000","last_clean":"2024-09-13T15:04:17.596789+0000","last_became_active":"2024-09-13T15:01:44.419965+0000","last_became_peered":"2024-09-13T15:01:44.419965+0000","last_unstale":"2024-09-13T15:04:17.596789+0000","last_undegraded":"2024-09-13T15:04:17.596789+0000","last_fullsized":"2024-09-13T15:04:17.596789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:34.918774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749714+0000","last_change":"2024-09-13T15:01:48.850895+0000","last_active":"2024-09-13T15:02:33.749714+0000","last_peered":"2024-09-13T15:02:33.749714+0000","last_clean":"2024-09-13T15:02:33.749714+0000","last_became_active":"2024-09-13T15:01:48.849856+0000","last_became_peered":"2024-09-13T15:01:48.849856+0000","last_unstale":"2024-09-13T15:02:33.749714+0000","last_undegraded":"2024-09-13T15:02:33.749714+0000","last_fullsized":"2024-09-13T15:02:33.749714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:59.616442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738227+0000","last_change":"2024-09-13T15:01:44.806026+0000","last_active":"2024-09-13T15:02:33.738227+0000","last_peered":"2024-09-13T15:02:33.738227+0000","last_clean":"2024-09-13T15:02:33.738227+0000","last_became_active":"2024-09-13T15:01:44.805767+0000","last_became_peered":"2024-09-13T15:01:44.805767+0000","last_unstale":"2024-09-13T15:02:33.738227+0000","last_undegraded":"2024-09-13T15:02:33.738227+0000","last_fullsized":"2024-09-13T15:02:33.738227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:50.696113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.912198+0000","last_change":"2024-09-13T15:01:44.401897+0000","last_active":"2024-09-13T15:04:29.912198+0000","last_peered":"2024-09-13T15:04:29.912198+0000","last_clean":"2024-09-13T15:04:29.912198+0000","last_became_active":"2024-09-13T15:01:44.401559+0000","last_became_peered":"2024-09-13T15:01:44.401559+0000","last_unstale":"2024-09-13T15:04:29.912198+0000","last_undegraded":"2024-09-13T15:04:29.912198+0000","last_fullsized":"2024-09-13T15:04:29.912198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:58.535567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749109+0000","last_change":"2024-09-13T15:01:48.858808+0000","last_active":"2024-09-13T15:02:33.749109+0000","last_peered":"2024-09-13T15:02:33.749109+0000","last_clean":"2024-09-13T15:02:33.749109+0000","last_became_active":"2024-09-13T15:01:48.857802+0000","last_became_peered":"2024-09-13T15:01:48.857802+0000","last_unstale":"2024-09-13T15:02:33.749109+0000","last_undegraded":"2024-09-13T15:02:33.749109+0000","last_fullsized":"2024-09-13T15:02:33.749109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:41.628058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737738+0000","last_change":"2024-09-13T15:01:44.808674+0000","last_active":"2024-09-13T15:02:33.737738+0000","last_peered":"2024-09-13T15:02:33.737738+0000","last_clean":"2024-09-13T15:02:33.737738+0000","last_became_active":"2024-09-13T15:01:44.808420+0000","last_became_peered":"2024-09-13T15:01:44.808420+0000","last_unstale":"2024-09-13T15:02:33.737738+0000","last_undegraded":"2024-09-13T15:02:33.737738+0000","last_fullsized":"2024-09-13T15:02:33.737738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:33.447973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.933679+0000","last_change":"2024-09-13T15:01:44.406717+0000","last_active":"2024-09-13T15:04:35.933679+0000","last_peered":"2024-09-13T15:04:35.933679+0000","last_clean":"2024-09-13T15:04:35.933679+0000","last_became_active":"2024-09-13T15:01:44.406354+0000","last_became_peered":"2024-09-13T15:01:44.406354+0000","last_unstale":"2024-09-13T15:04:35.933679+0000","last_undegraded":"2024-09-13T15:04:35.933679+0000","last_fullsized":"2024-09-13T15:04:35.933679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:49.413632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741522+0000","last_change":"2024-09-13T15:01:48.909879+0000","last_active":"2024-09-13T15:02:33.741522+0000","last_peered":"2024-09-13T15:02:33.741522+0000","last_clean":"2024-09-13T15:02:33.741522+0000","last_became_active":"2024-09-13T15:01:48.909494+0000","last_became_peered":"2024-09-13T15:01:48.909494+0000","last_unstale":"2024-09-13T15:02:33.741522+0000","last_undegraded":"2024-09-13T15:02:33.741522+0000","last_fullsized":"2024-09-13T15:02:33.741522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:54.415920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748317+0000","last_change":"2024-09-13T15:01:44.825065+0000","last_active":"2024-09-13T15:02:33.748317+0000","last_peered":"2024-09-13T15:02:33.748317+0000","last_clean":"2024-09-13T15:02:33.748317+0000","last_became_active":"2024-09-13T15:01:44.824392+0000","last_became_peered":"2024-09-13T15:01:44.824392+0000","last_unstale":"2024-09-13T15:02:33.748317+0000","last_undegraded":"2024-09-13T15:02:33.748317+0000","last_fullsized":"2024-09-13T15:02:33.748317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:49.717211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.600924+0000","last_change":"2024-09-13T15:01:44.421119+0000","last_active":"2024-09-13T15:04:17.600924+0000","last_peered":"2024-09-13T15:04:17.600924+0000","last_clean":"2024-09-13T15:04:17.600924+0000","last_became_active":"2024-09-13T15:01:44.419082+0000","last_became_peered":"2024-09-13T15:01:44.419082+0000","last_unstale":"2024-09-13T15:04:17.600924+0000","last_undegraded":"2024-09-13T15:04:17.600924+0000","last_fullsized":"2024-09-13T15:04:17.600924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.011350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749456+0000","last_change":"2024-09-13T15:01:48.856387+0000","last_active":"2024-09-13T15:02:33.749456+0000","last_peered":"2024-09-13T15:02:33.749456+0000","last_clean":"2024-09-13T15:02:33.749456+0000","last_became_active":"2024-09-13T15:01:48.855433+0000","last_became_peered":"2024-09-13T15:01:48.855433+0000","last_unstale":"2024-09-13T15:02:33.749456+0000","last_undegraded":"2024-09-13T15:02:33.749456+0000","last_fullsized":"2024-09-13T15:02:33.749456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:58.309929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744608+0000","last_change":"2024-09-13T15:01:44.807909+0000","last_active":"2024-09-13T15:02:33.744608+0000","last_peered":"2024-09-13T15:02:33.744608+0000","last_clean":"2024-09-13T15:02:33.744608+0000","last_became_active":"2024-09-13T15:01:44.807643+0000","last_became_peered":"2024-09-13T15:01:44.807643+0000","last_unstale":"2024-09-13T15:02:33.744608+0000","last_undegraded":"2024-09-13T15:02:33.744608+0000","last_fullsized":"2024-09-13T15:02:33.744608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:30.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.941454+0000","last_change":"2024-09-13T15:01:44.430200+0000","last_active":"2024-09-13T15:04:35.941454+0000","last_peered":"2024-09-13T15:04:35.941454+0000","last_clean":"2024-09-13T15:04:35.941454+0000","last_became_active":"2024-09-13T15:01:44.429510+0000","last_became_peered":"2024-09-13T15:01:44.429510+0000","last_unstale":"2024-09-13T15:04:35.941454+0000","last_undegraded":"2024-09-13T15:04:35.941454+0000","last_fullsized":"2024-09-13T15:04:35.941454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:52.921485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748075+0000","last_change":"2024-09-13T15:01:48.912116+0000","last_active":"2024-09-13T15:02:33.748075+0000","last_peered":"2024-09-13T15:02:33.748075+0000","last_clean":"2024-09-13T15:02:33.748075+0000","last_became_active":"2024-09-13T15:01:48.911578+0000","last_became_peered":"2024-09-13T15:01:48.911578+0000","last_unstale":"2024-09-13T15:02:33.748075+0000","last_undegraded":"2024-09-13T15:02:33.748075+0000","last_fullsized":"2024-09-13T15:02:33.748075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:50.826715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738926+0000","last_change":"2024-09-13T15:01:44.838344+0000","last_active":"2024-09-13T15:02:33.738926+0000","last_peered":"2024-09-13T15:02:33.738926+0000","last_clean":"2024-09-13T15:02:33.738926+0000","last_became_active":"2024-09-13T15:01:44.838128+0000","last_became_peered":"2024-09-13T15:01:44.838128+0000","last_unstale":"2024-09-13T15:02:33.738926+0000","last_undegraded":"2024-09-13T15:02:33.738926+0000","last_fullsized":"2024-09-13T15:02:33.738926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:09:50.373976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.915192+0000","last_change":"2024-09-13T15:01:44.430749+0000","last_active":"2024-09-13T15:04:29.915192+0000","last_peered":"2024-09-13T15:04:29.915192+0000","last_clean":"2024-09-13T15:04:29.915192+0000","last_became_active":"2024-09-13T15:01:44.430548+0000","last_became_peered":"2024-09-13T15:01:44.430548+0000","last_unstale":"2024-09-13T15:04:29.915192+0000","last_undegraded":"2024-09-13T15:04:29.915192+0000","last_fullsized":"2024-09-13T15:04:29.915192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:30.312447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737398+0000","last_change":"2024-09-13T15:01:48.911224+0000","last_active":"2024-09-13T15:02:33.737398+0000","last_peered":"2024-09-13T15:02:33.737398+0000","last_clean":"2024-09-13T15:02:33.737398+0000","last_became_active":"2024-09-13T15:01:48.910150+0000","last_became_peered":"2024-09-13T15:01:48.910150+0000","last_unstale":"2024-09-13T15:02:33.737398+0000","last_undegraded":"2024-09-13T15:02:33.737398+0000","last_fullsized":"2024-09-13T15:02:33.737398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:41.244267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743138+0000","last_change":"2024-09-13T15:01:44.812200+0000","last_active":"2024-09-13T15:02:33.743138+0000","last_peered":"2024-09-13T15:02:33.743138+0000","last_clean":"2024-09-13T15:02:33.743138+0000","last_became_active":"2024-09-13T15:01:44.811915+0000","last_became_peered":"2024-09-13T15:01:44.811915+0000","last_unstale":"2024-09-13T15:02:33.743138+0000","last_undegraded":"2024-09-13T15:02:33.743138+0000","last_fullsized":"2024-09-13T15:02:33.743138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:07.944520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.917182+0000","last_change":"2024-09-13T15:01:44.423119+0000","last_active":"2024-09-13T15:04:29.917182+0000","last_peered":"2024-09-13T15:04:29.917182+0000","last_clean":"2024-09-13T15:04:29.917182+0000","last_became_active":"2024-09-13T15:01:44.422297+0000","last_became_peered":"2024-09-13T15:01:44.422297+0000","last_unstale":"2024-09-13T15:04:29.917182+0000","last_undegraded":"2024-09-13T15:04:29.917182+0000","last_fullsized":"2024-09-13T15:04:29.917182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:09.798196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743841+0000","last_change":"2024-09-13T15:01:48.908569+0000","last_active":"2024-09-13T15:02:33.743841+0000","last_peered":"2024-09-13T15:02:33.743841+0000","last_clean":"2024-09-13T15:02:33.743841+0000","last_became_active":"2024-09-13T15:01:48.908118+0000","last_became_peered":"2024-09-13T15:01:48.908118+0000","last_unstale":"2024-09-13T15:02:33.743841+0000","last_undegraded":"2024-09-13T15:02:33.743841+0000","last_fullsized":"2024-09-13T15:02:33.743841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:06.459855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743852+0000","last_change":"2024-09-13T15:01:44.850837+0000","last_active":"2024-09-13T15:02:33.743852+0000","last_peered":"2024-09-13T15:02:33.743852+0000","last_clean":"2024-09-13T15:02:33.743852+0000","last_became_active":"2024-09-13T15:01:44.850263+0000","last_became_peered":"2024-09-13T15:01:44.850263+0000","last_unstale":"2024-09-13T15:02:33.743852+0000","last_undegraded":"2024-09-13T15:02:33.743852+0000","last_fullsized":"2024-09-13T15:02:33.743852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:16.956369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:03:48.882165+0000","last_change":"2024-09-13T15:01:44.399163+0000","last_active":"2024-09-13T15:03:48.882165+0000","last_peered":"2024-09-13T15:03:48.882165+0000","last_clean":"2024-09-13T15:03:48.882165+0000","last_became_active":"2024-09-13T15:01:44.398881+0000","last_became_peered":"2024-09-13T15:01:44.398881+0000","last_unstale":"2024-09-13T15:03:48.882165+0000","last_undegraded":"2024-09-13T15:03:48.882165+0000","last_fullsized":"2024-09-13T15:03:48.882165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:49.622676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743584+0000","last_change":"2024-09-13T15:01:48.852798+0000","last_active":"2024-09-13T15:02:33.743584+0000","last_peered":"2024-09-13T15:02:33.743584+0000","last_clean":"2024-09-13T15:02:33.743584+0000","last_became_active":"2024-09-13T15:01:48.851948+0000","last_became_peered":"2024-09-13T15:01:48.851948+0000","last_unstale":"2024-09-13T15:02:33.743584+0000","last_undegraded":"2024-09-13T15:02:33.743584+0000","last_fullsized":"2024-09-13T15:02:33.743584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:20.061043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749414+0000","last_change":"2024-09-13T15:01:44.824074+0000","last_active":"2024-09-13T15:02:33.749414+0000","last_peered":"2024-09-13T15:02:33.749414+0000","last_clean":"2024-09-13T15:02:33.749414+0000","last_became_active":"2024-09-13T15:01:44.821475+0000","last_became_peered":"2024-09-13T15:01:44.821475+0000","last_unstale":"2024-09-13T15:02:33.749414+0000","last_undegraded":"2024-09-13T15:02:33.749414+0000","last_fullsized":"2024-09-13T15:02:33.749414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:21.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.935937+0000","last_change":"2024-09-13T15:01:44.433502+0000","last_active":"2024-09-13T15:04:35.935937+0000","last_peered":"2024-09-13T15:04:35.935937+0000","last_clean":"2024-09-13T15:04:35.935937+0000","last_became_active":"2024-09-13T15:01:44.432902+0000","last_became_peered":"2024-09-13T15:01:44.432902+0000","last_unstale":"2024-09-13T15:04:35.935937+0000","last_undegraded":"2024-09-13T15:04:35.935937+0000","last_fullsized":"2024-09-13T15:04:35.935937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:59.189559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743046+0000","last_change":"2024-09-13T15:01:48.846695+0000","last_active":"2024-09-13T15:02:33.743046+0000","last_peered":"2024-09-13T15:02:33.743046+0000","last_clean":"2024-09-13T15:02:33.743046+0000","last_became_active":"2024-09-13T15:01:48.846301+0000","last_became_peered":"2024-09-13T15:01:48.846301+0000","last_unstale":"2024-09-13T15:02:33.743046+0000","last_undegraded":"2024-09-13T15:02:33.743046+0000","last_fullsized":"2024-09-13T15:02:33.743046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:17.532499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741535+0000","last_change":"2024-09-13T15:01:44.814483+0000","last_active":"2024-09-13T15:02:33.741535+0000","last_peered":"2024-09-13T15:02:33.741535+0000","last_clean":"2024-09-13T15:02:33.741535+0000","last_became_active":"2024-09-13T15:01:44.814192+0000","last_became_peered":"2024-09-13T15:01:44.814192+0000","last_unstale":"2024-09-13T15:02:33.741535+0000","last_undegraded":"2024-09-13T15:02:33.741535+0000","last_fullsized":"2024-09-13T15:02:33.741535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:32:30.303635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:23.881464+0000","last_change":"2024-09-13T15:01:44.399314+0000","last_active":"2024-09-13T15:04:23.881464+0000","last_peered":"2024-09-13T15:04:23.881464+0000","last_clean":"2024-09-13T15:04:23.881464+0000","last_became_active":"2024-09-13T15:01:44.398904+0000","last_became_peered":"2024-09-13T15:01:44.398904+0000","last_unstale":"2024-09-13T15:04:23.881464+0000","last_undegraded":"2024-09-13T15:04:23.881464+0000","last_fullsized":"2024-09-13T15:04:23.881464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.645179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741624+0000","last_change":"2024-09-13T15:01:48.859142+0000","last_active":"2024-09-13T15:02:33.741624+0000","last_peered":"2024-09-13T15:02:33.741624+0000","last_clean":"2024-09-13T15:02:33.741624+0000","last_became_active":"2024-09-13T15:01:48.858649+0000","last_became_peered":"2024-09-13T15:01:48.858649+0000","last_unstale":"2024-09-13T15:02:33.741624+0000","last_undegraded":"2024-09-13T15:02:33.741624+0000","last_fullsized":"2024-09-13T15:02:33.741624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:27.314012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743419+0000","last_change":"2024-09-13T15:01:44.826501+0000","last_active":"2024-09-13T15:02:33.743419+0000","last_peered":"2024-09-13T15:02:33.743419+0000","last_clean":"2024-09-13T15:02:33.743419+0000","last_became_active":"2024-09-13T15:01:44.826222+0000","last_became_peered":"2024-09-13T15:01:44.826222+0000","last_unstale":"2024-09-13T15:02:33.743419+0000","last_undegraded":"2024-09-13T15:02:33.743419+0000","last_fullsized":"2024-09-13T15:02:33.743419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:00.543916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:23.881579+0000","last_change":"2024-09-13T15:01:44.421891+0000","last_active":"2024-09-13T15:04:23.881579+0000","last_peered":"2024-09-13T15:04:23.881579+0000","last_clean":"2024-09-13T15:04:23.881579+0000","last_became_active":"2024-09-13T15:01:44.419660+0000","last_became_peered":"2024-09-13T15:01:44.419660+0000","last_unstale":"2024-09-13T15:04:23.881579+0000","last_undegraded":"2024-09-13T15:04:23.881579+0000","last_fullsized":"2024-09-13T15:04:23.881579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:27.554128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.120816+0000","last_change":"2024-09-13T15:02:34.119111+0000","last_active":"2024-09-13T15:02:34.120816+0000","last_peered":"2024-09-13T15:02:34.120816+0000","last_clean":"2024-09-13T15:02:34.120816+0000","last_became_active":"2024-09-13T15:02:34.118461+0000","last_became_peered":"2024-09-13T15:02:34.118461+0000","last_unstale":"2024-09-13T15:02:34.120816+0000","last_undegraded":"2024-09-13T15:02:34.120816+0000","last_fullsized":"2024-09-13T15:02:34.120816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:35.096846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738701+0000","last_change":"2024-09-13T15:01:44.850498+0000","last_active":"2024-09-13T15:02:33.738701+0000","last_peered":"2024-09-13T15:02:33.738701+0000","last_clean":"2024-09-13T15:02:33.738701+0000","last_became_active":"2024-09-13T15:01:44.850234+0000","last_became_peered":"2024-09-13T15:01:44.850234+0000","last_unstale":"2024-09-13T15:02:33.738701+0000","last_undegraded":"2024-09-13T15:02:33.738701+0000","last_fullsized":"2024-09-13T15:02:33.738701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:37.202494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.912171+0000","last_change":"2024-09-13T15:01:44.411997+0000","last_active":"2024-09-13T15:04:29.912171+0000","last_peered":"2024-09-13T15:04:29.912171+0000","last_clean":"2024-09-13T15:04:29.912171+0000","last_became_active":"2024-09-13T15:01:44.410675+0000","last_became_peered":"2024-09-13T15:01:44.410675+0000","last_unstale":"2024-09-13T15:04:29.912171+0000","last_undegraded":"2024-09-13T15:04:29.912171+0000","last_fullsized":"2024-09-13T15:04:29.912171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:50:55.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116345+0000","last_change":"2024-09-13T15:01:40.834440+0000","last_active":"2024-09-13T15:02:34.116345+0000","last_peered":"2024-09-13T15:02:34.116345+0000","last_clean":"2024-09-13T15:02:34.116345+0000","last_became_active":"2024-09-13T15:01:40.832279+0000","last_became_peered":"2024-09-13T15:01:40.832279+0000","last_unstale":"2024-09-13T15:02:34.116345+0000","last_undegraded":"2024-09-13T15:02:34.116345+0000","last_fullsized":"2024-09-13T15:02:34.116345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_clean_scrub_stamp":"2024-09-13T15:01:39.264455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:11.875506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743545+0000","last_change":"2024-09-13T15:01:48.919580+0000","last_active":"2024-09-13T15:02:33.743545+0000","last_peered":"2024-09-13T15:02:33.743545+0000","last_clean":"2024-09-13T15:02:33.743545+0000","last_became_active":"2024-09-13T15:01:48.918678+0000","last_became_peered":"2024-09-13T15:01:48.918678+0000","last_unstale":"2024-09-13T15:02:33.743545+0000","last_undegraded":"2024-09-13T15:02:33.743545+0000","last_fullsized":"2024-09-13T15:02:33.743545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:02.840528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116879+0000","last_change":"2024-09-13T15:01:44.849975+0000","last_active":"2024-09-13T15:02:34.116879+0000","last_peered":"2024-09-13T15:02:34.116879+0000","last_clean":"2024-09-13T15:02:34.116879+0000","last_became_active":"2024-09-13T15:01:44.849457+0000","last_became_peered":"2024-09-13T15:01:44.849457+0000","last_unstale":"2024-09-13T15:02:34.116879+0000","last_undegraded":"2024-09-13T15:02:34.116879+0000","last_fullsized":"2024-09-13T15:02:34.116879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:51.139153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.913440+0000","last_change":"2024-09-13T15:01:44.420906+0000","last_active":"2024-09-13T15:04:29.913440+0000","last_peered":"2024-09-13T15:04:29.913440+0000","last_clean":"2024-09-13T15:04:29.913440+0000","last_became_active":"2024-09-13T15:01:44.420601+0000","last_became_peered":"2024-09-13T15:01:44.420601+0000","last_unstale":"2024-09-13T15:04:29.913440+0000","last_undegraded":"2024-09-13T15:04:29.913440+0000","last_fullsized":"2024-09-13T15:04:29.913440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:33.245745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741847+0000","last_change":"2024-09-13T15:01:48.911047+0000","last_active":"2024-09-13T15:02:33.741847+0000","last_peered":"2024-09-13T15:02:33.741847+0000","last_clean":"2024-09-13T15:02:33.741847+0000","last_became_active":"2024-09-13T15:01:48.910479+0000","last_became_peered":"2024-09-13T15:01:48.910479+0000","last_unstale":"2024-09-13T15:02:33.741847+0000","last_undegraded":"2024-09-13T15:02:33.741847+0000","last_fullsized":"2024-09-13T15:02:33.741847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:06.558889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745346+0000","last_change":"2024-09-13T15:01:44.838098+0000","last_active":"2024-09-13T15:02:33.745346+0000","last_peered":"2024-09-13T15:02:33.745346+0000","last_clean":"2024-09-13T15:02:33.745346+0000","last_became_active":"2024-09-13T15:01:44.837429+0000","last_became_peered":"2024-09-13T15:01:44.837429+0000","last_unstale":"2024-09-13T15:02:33.745346+0000","last_undegraded":"2024-09-13T15:02:33.745346+0000","last_fullsized":"2024-09-13T15:02:33.745346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:37.795841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.913130+0000","last_change":"2024-09-13T15:01:44.406999+0000","last_active":"2024-09-13T15:04:29.913130+0000","last_peered":"2024-09-13T15:04:29.913130+0000","last_clean":"2024-09-13T15:04:29.913130+0000","last_became_active":"2024-09-13T15:01:44.406719+0000","last_became_peered":"2024-09-13T15:01:44.406719+0000","last_unstale":"2024-09-13T15:04:29.913130+0000","last_undegraded":"2024-09-13T15:04:29.913130+0000","last_fullsized":"2024-09-13T15:04:29.913130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:33.397091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743939+0000","last_change":"2024-09-13T15:01:48.857931+0000","last_active":"2024-09-13T15:02:33.743939+0000","last_peered":"2024-09-13T15:02:33.743939+0000","last_clean":"2024-09-13T15:02:33.743939+0000","last_became_active":"2024-09-13T15:01:48.857542+0000","last_became_peered":"2024-09-13T15:01:48.857542+0000","last_unstale":"2024-09-13T15:02:33.743939+0000","last_undegraded":"2024-09-13T15:02:33.743939+0000","last_fullsized":"2024-09-13T15:02:33.743939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:32.805405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118403+0000","last_change":"2024-09-13T15:01:44.835470+0000","last_active":"2024-09-13T15:02:34.118403+0000","last_peered":"2024-09-13T15:02:34.118403+0000","last_clean":"2024-09-13T15:02:34.118403+0000","last_became_active":"2024-09-13T15:01:44.831166+0000","last_became_peered":"2024-09-13T15:01:44.831166+0000","last_unstale":"2024-09-13T15:02:34.118403+0000","last_undegraded":"2024-09-13T15:02:34.118403+0000","last_fullsized":"2024-09-13T15:02:34.118403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:05.887592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.929024+0000","last_change":"2024-09-13T15:01:44.403111+0000","last_active":"2024-09-13T15:04:35.929024+0000","last_peered":"2024-09-13T15:04:35.929024+0000","last_clean":"2024-09-13T15:04:35.929024+0000","last_became_active":"2024-09-13T15:01:44.401799+0000","last_became_peered":"2024-09-13T15:01:44.401799+0000","last_unstale":"2024-09-13T15:04:35.929024+0000","last_undegraded":"2024-09-13T15:04:35.929024+0000","last_fullsized":"2024-09-13T15:04:35.929024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:54.589470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740292+0000","last_change":"2024-09-13T15:01:48.912490+0000","last_active":"2024-09-13T15:02:33.740292+0000","last_peered":"2024-09-13T15:02:33.740292+0000","last_clean":"2024-09-13T15:02:33.740292+0000","last_became_active":"2024-09-13T15:01:48.911474+0000","last_became_peered":"2024-09-13T15:01:48.911474+0000","last_unstale":"2024-09-13T15:02:33.740292+0000","last_undegraded":"2024-09-13T15:02:33.740292+0000","last_fullsized":"2024-09-13T15:02:33.740292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:54.295921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117960+0000","last_change":"2024-09-13T15:01:44.818472+0000","last_active":"2024-09-13T15:02:34.117960+0000","last_peered":"2024-09-13T15:02:34.117960+0000","last_clean":"2024-09-13T15:02:34.117960+0000","last_became_active":"2024-09-13T15:01:44.817718+0000","last_became_peered":"2024-09-13T15:01:44.817718+0000","last_unstale":"2024-09-13T15:02:34.117960+0000","last_undegraded":"2024-09-13T15:02:34.117960+0000","last_fullsized":"2024-09-13T15:02:34.117960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:21.310696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:03:58.897497+0000","last_change":"2024-09-13T15:01:44.410376+0000","last_active":"2024-09-13T15:03:58.897497+0000","last_peered":"2024-09-13T15:03:58.897497+0000","last_clean":"2024-09-13T15:03:58.897497+0000","last_became_active":"2024-09-13T15:01:44.409585+0000","last_became_peered":"2024-09-13T15:01:44.409585+0000","last_unstale":"2024-09-13T15:03:58.897497+0000","last_undegraded":"2024-09-13T15:03:58.897497+0000","last_fullsized":"2024-09-13T15:03:58.897497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:45.845804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.747358+0000","last_change":"2024-09-13T15:01:48.861130+0000","last_active":"2024-09-13T15:02:33.747358+0000","last_peered":"2024-09-13T15:02:33.747358+0000","last_clean":"2024-09-13T15:02:33.747358+0000","last_became_active":"2024-09-13T15:01:48.860317+0000","last_became_peered":"2024-09-13T15:01:48.860317+0000","last_unstale":"2024-09-13T15:02:33.747358+0000","last_undegraded":"2024-09-13T15:02:33.747358+0000","last_fullsized":"2024-09-13T15:02:33.747358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:45.317747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116786+0000","last_change":"2024-09-13T15:01:44.835494+0000","last_active":"2024-09-13T15:02:34.116786+0000","last_peered":"2024-09-13T15:02:34.116786+0000","last_clean":"2024-09-13T15:02:34.116786+0000","last_became_active":"2024-09-13T15:01:44.831150+0000","last_became_peered":"2024-09-13T15:01:44.831150+0000","last_unstale":"2024-09-13T15:02:34.116786+0000","last_undegraded":"2024-09-13T15:02:34.116786+0000","last_fullsized":"2024-09-13T15:02:34.116786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:29.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.912072+0000","last_change":"2024-09-13T15:01:44.390278+0000","last_active":"2024-09-13T15:04:29.912072+0000","last_peered":"2024-09-13T15:04:29.912072+0000","last_clean":"2024-09-13T15:04:29.912072+0000","last_became_active":"2024-09-13T15:01:44.389946+0000","last_became_peered":"2024-09-13T15:01:44.389946+0000","last_unstale":"2024-09-13T15:04:29.912072+0000","last_undegraded":"2024-09-13T15:04:29.912072+0000","last_fullsized":"2024-09-13T15:04:29.912072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:53.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744367+0000","last_change":"2024-09-13T15:01:48.848009+0000","last_active":"2024-09-13T15:02:33.744367+0000","last_peered":"2024-09-13T15:02:33.744367+0000","last_clean":"2024-09-13T15:02:33.744367+0000","last_became_active":"2024-09-13T15:01:48.847605+0000","last_became_peered":"2024-09-13T15:01:48.847605+0000","last_unstale":"2024-09-13T15:02:33.744367+0000","last_undegraded":"2024-09-13T15:02:33.744367+0000","last_fullsized":"2024-09-13T15:02:33.744367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:32.053010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741353+0000","last_change":"2024-09-13T15:01:44.808572+0000","last_active":"2024-09-13T15:02:33.741353+0000","last_peered":"2024-09-13T15:02:33.741353+0000","last_clean":"2024-09-13T15:02:33.741353+0000","last_became_active":"2024-09-13T15:01:44.808140+0000","last_became_peered":"2024-09-13T15:01:44.808140+0000","last_unstale":"2024-09-13T15:02:33.741353+0000","last_undegraded":"2024-09-13T15:02:33.741353+0000","last_fullsized":"2024-09-13T15:02:33.741353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:15.497720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.918281+0000","last_change":"2024-09-13T15:01:44.428794+0000","last_active":"2024-09-13T15:04:29.918281+0000","last_peered":"2024-09-13T15:04:29.918281+0000","last_clean":"2024-09-13T15:04:29.918281+0000","last_became_active":"2024-09-13T15:01:44.428271+0000","last_became_peered":"2024-09-13T15:01:44.428271+0000","last_unstale":"2024-09-13T15:04:29.918281+0000","last_undegraded":"2024-09-13T15:04:29.918281+0000","last_fullsized":"2024-09-13T15:04:29.918281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:53.225826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738469+0000","last_change":"2024-09-13T15:01:48.916354+0000","last_active":"2024-09-13T15:02:33.738469+0000","last_peered":"2024-09-13T15:02:33.738469+0000","last_clean":"2024-09-13T15:02:33.738469+0000","last_became_active":"2024-09-13T15:01:48.916008+0000","last_became_peered":"2024-09-13T15:01:48.916008+0000","last_unstale":"2024-09-13T15:02:33.738469+0000","last_undegraded":"2024-09-13T15:02:33.738469+0000","last_fullsized":"2024-09-13T15:02:33.738469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:58.115410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116589+0000","last_change":"2024-09-13T15:01:44.826700+0000","last_active":"2024-09-13T15:02:34.116589+0000","last_peered":"2024-09-13T15:02:34.116589+0000","last_clean":"2024-09-13T15:02:34.116589+0000","last_became_active":"2024-09-13T15:01:44.825996+0000","last_became_peered":"2024-09-13T15:01:44.825996+0000","last_unstale":"2024-09-13T15:02:34.116589+0000","last_undegraded":"2024-09-13T15:02:34.116589+0000","last_fullsized":"2024-09-13T15:02:34.116589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:11.963837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.912045+0000","last_change":"2024-09-13T15:01:44.409339+0000","last_active":"2024-09-13T15:04:29.912045+0000","last_peered":"2024-09-13T15:04:29.912045+0000","last_clean":"2024-09-13T15:04:29.912045+0000","last_became_active":"2024-09-13T15:01:44.408644+0000","last_became_peered":"2024-09-13T15:01:44.408644+0000","last_unstale":"2024-09-13T15:04:29.912045+0000","last_undegraded":"2024-09-13T15:04:29.912045+0000","last_fullsized":"2024-09-13T15:04:29.912045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:29.297950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737959+0000","last_change":"2024-09-13T15:01:48.916478+0000","last_active":"2024-09-13T15:02:33.737959+0000","last_peered":"2024-09-13T15:02:33.737959+0000","last_clean":"2024-09-13T15:02:33.737959+0000","last_became_active":"2024-09-13T15:01:48.916198+0000","last_became_peered":"2024-09-13T15:01:48.916198+0000","last_unstale":"2024-09-13T15:02:33.737959+0000","last_undegraded":"2024-09-13T15:02:33.737959+0000","last_fullsized":"2024-09-13T15:02:33.737959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:26.311460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743617+0000","last_change":"2024-09-13T15:01:44.831833+0000","last_active":"2024-09-13T15:02:33.743617+0000","last_peered":"2024-09-13T15:02:33.743617+0000","last_clean":"2024-09-13T15:02:33.743617+0000","last_became_active":"2024-09-13T15:01:44.831583+0000","last_became_peered":"2024-09-13T15:01:44.831583+0000","last_unstale":"2024-09-13T15:02:33.743617+0000","last_undegraded":"2024-09-13T15:02:33.743617+0000","last_fullsized":"2024-09-13T15:02:33.743617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.715951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.931315+0000","last_change":"2024-09-13T15:01:44.408752+0000","last_active":"2024-09-13T15:04:35.931315+0000","last_peered":"2024-09-13T15:04:35.931315+0000","last_clean":"2024-09-13T15:04:35.931315+0000","last_became_active":"2024-09-13T15:01:44.408453+0000","last_became_peered":"2024-09-13T15:01:44.408453+0000","last_unstale":"2024-09-13T15:04:35.931315+0000","last_undegraded":"2024-09-13T15:04:35.931315+0000","last_fullsized":"2024-09-13T15:04:35.931315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:31.587404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743419+0000","last_change":"2024-09-13T15:01:48.916681+0000","last_active":"2024-09-13T15:02:33.743419+0000","last_peered":"2024-09-13T15:02:33.743419+0000","last_clean":"2024-09-13T15:02:33.743419+0000","last_became_active":"2024-09-13T15:01:48.916185+0000","last_became_peered":"2024-09-13T15:01:48.916185+0000","last_unstale":"2024-09-13T15:02:33.743419+0000","last_undegraded":"2024-09-13T15:02:33.743419+0000","last_fullsized":"2024-09-13T15:02:33.743419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:33.862835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116757+0000","last_change":"2024-09-13T15:01:44.817007+0000","last_active":"2024-09-13T15:02:34.116757+0000","last_peered":"2024-09-13T15:02:34.116757+0000","last_clean":"2024-09-13T15:02:34.116757+0000","last_became_active":"2024-09-13T15:01:44.815435+0000","last_became_peered":"2024-09-13T15:01:44.815435+0000","last_unstale":"2024-09-13T15:02:34.116757+0000","last_undegraded":"2024-09-13T15:02:34.116757+0000","last_fullsized":"2024-09-13T15:02:34.116757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:25.887993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'14","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.939792+0000","last_change":"2024-09-13T15:01:44.435688+0000","last_active":"2024-09-13T15:04:35.939792+0000","last_peered":"2024-09-13T15:04:35.939792+0000","last_clean":"2024-09-13T15:04:35.939792+0000","last_became_active":"2024-09-13T15:01:44.435222+0000","last_became_peered":"2024-09-13T15:01:44.435222+0000","last_unstale":"2024-09-13T15:04:35.939792+0000","last_undegraded":"2024-09-13T15:04:35.939792+0000","last_fullsized":"2024-09-13T15:04:35.939792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:24.705633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742810+0000","last_change":"2024-09-13T15:01:48.847694+0000","last_active":"2024-09-13T15:02:33.742810+0000","last_peered":"2024-09-13T15:02:33.742810+0000","last_clean":"2024-09-13T15:02:33.742810+0000","last_became_active":"2024-09-13T15:01:48.846835+0000","last_became_peered":"2024-09-13T15:01:48.846835+0000","last_unstale":"2024-09-13T15:02:33.742810+0000","last_undegraded":"2024-09-13T15:02:33.742810+0000","last_fullsized":"2024-09-13T15:02:33.742810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:49.763472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749658+0000","last_change":"2024-09-13T15:01:44.835315+0000","last_active":"2024-09-13T15:02:33.749658+0000","last_peered":"2024-09-13T15:02:33.749658+0000","last_clean":"2024-09-13T15:02:33.749658+0000","last_became_active":"2024-09-13T15:01:44.834643+0000","last_became_peered":"2024-09-13T15:01:44.834643+0000","last_unstale":"2024-09-13T15:02:33.749658+0000","last_undegraded":"2024-09-13T15:02:33.749658+0000","last_fullsized":"2024-09-13T15:02:33.749658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:15.535195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.609255+0000","last_change":"2024-09-13T15:01:44.424966+0000","last_active":"2024-09-13T15:04:17.609255+0000","last_peered":"2024-09-13T15:04:17.609255+0000","last_clean":"2024-09-13T15:04:17.609255+0000","last_became_active":"2024-09-13T15:01:44.424714+0000","last_became_peered":"2024-09-13T15:01:44.424714+0000","last_unstale":"2024-09-13T15:04:17.609255+0000","last_undegraded":"2024-09-13T15:04:17.609255+0000","last_fullsized":"2024-09-13T15:04:17.609255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:46.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.756425+0000","last_change":"2024-09-13T15:02:33.753482+0000","last_active":"2024-09-13T15:02:33.756425+0000","last_peered":"2024-09-13T15:02:33.756425+0000","last_clean":"2024-09-13T15:02:33.756425+0000","last_became_active":"2024-09-13T15:02:33.752505+0000","last_became_peered":"2024-09-13T15:02:33.752505+0000","last_unstale":"2024-09-13T15:02:33.756425+0000","last_undegraded":"2024-09-13T15:02:33.756425+0000","last_fullsized":"2024-09-13T15:02:33.756425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:59.041586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742572+0000","last_change":"2024-09-13T15:01:44.837032+0000","last_active":"2024-09-13T15:02:33.742572+0000","last_peered":"2024-09-13T15:02:33.742572+0000","last_clean":"2024-09-13T15:02:33.742572+0000","last_became_active":"2024-09-13T15:01:44.836750+0000","last_became_peered":"2024-09-13T15:01:44.836750+0000","last_unstale":"2024-09-13T15:02:33.742572+0000","last_undegraded":"2024-09-13T15:02:33.742572+0000","last_fullsized":"2024-09-13T15:02:33.742572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:04.491426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.938284+0000","last_change":"2024-09-13T15:01:44.437854+0000","last_active":"2024-09-13T15:04:35.938284+0000","last_peered":"2024-09-13T15:04:35.938284+0000","last_clean":"2024-09-13T15:04:35.938284+0000","last_became_active":"2024-09-13T15:01:44.437433+0000","last_became_peered":"2024-09-13T15:01:44.437433+0000","last_unstale":"2024-09-13T15:04:35.938284+0000","last_undegraded":"2024-09-13T15:04:35.938284+0000","last_fullsized":"2024-09-13T15:04:35.938284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:47.302388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737553+0000","last_change":"2024-09-13T15:01:48.841829+0000","last_active":"2024-09-13T15:02:33.737553+0000","last_peered":"2024-09-13T15:02:33.737553+0000","last_clean":"2024-09-13T15:02:33.737553+0000","last_became_active":"2024-09-13T15:01:48.841267+0000","last_became_peered":"2024-09-13T15:01:48.841267+0000","last_unstale":"2024-09-13T15:02:33.737553+0000","last_undegraded":"2024-09-13T15:02:33.737553+0000","last_fullsized":"2024-09-13T15:02:33.737553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:25.029615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.746815+0000","last_change":"2024-09-13T15:01:44.844701+0000","last_active":"2024-09-13T15:02:33.746815+0000","last_peered":"2024-09-13T15:02:33.746815+0000","last_clean":"2024-09-13T15:02:33.746815+0000","last_became_active":"2024-09-13T15:01:44.843982+0000","last_became_peered":"2024-09-13T15:01:44.843982+0000","last_unstale":"2024-09-13T15:02:33.746815+0000","last_undegraded":"2024-09-13T15:02:33.746815+0000","last_fullsized":"2024-09-13T15:02:33.746815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.602105+0000","last_change":"2024-09-13T15:01:44.436081+0000","last_active":"2024-09-13T15:04:17.602105+0000","last_peered":"2024-09-13T15:04:17.602105+0000","last_clean":"2024-09-13T15:04:17.602105+0000","last_became_active":"2024-09-13T15:01:44.435367+0000","last_became_peered":"2024-09-13T15:01:44.435367+0000","last_unstale":"2024-09-13T15:04:17.602105+0000","last_undegraded":"2024-09-13T15:04:17.602105+0000","last_fullsized":"2024-09-13T15:04:17.602105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:57:57.065719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737590+0000","last_change":"2024-09-13T15:01:48.910562+0000","last_active":"2024-09-13T15:02:33.737590+0000","last_peered":"2024-09-13T15:02:33.737590+0000","last_clean":"2024-09-13T15:02:33.737590+0000","last_became_active":"2024-09-13T15:01:48.909681+0000","last_became_peered":"2024-09-13T15:01:48.909681+0000","last_unstale":"2024-09-13T15:02:33.737590+0000","last_undegraded":"2024-09-13T15:02:33.737590+0000","last_fullsized":"2024-09-13T15:02:33.737590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:35.989769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.120759+0000","last_change":"2024-09-13T15:02:34.118951+0000","last_active":"2024-09-13T15:02:34.120759+0000","last_peered":"2024-09-13T15:02:34.120759+0000","last_clean":"2024-09-13T15:02:34.120759+0000","last_became_active":"2024-09-13T15:02:34.118477+0000","last_became_peered":"2024-09-13T15:02:34.118477+0000","last_unstale":"2024-09-13T15:02:34.120759+0000","last_undegraded":"2024-09-13T15:02:34.120759+0000","last_fullsized":"2024-09-13T15:02:34.120759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:13.697114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741807+0000","last_change":"2024-09-13T15:01:44.808417+0000","last_active":"2024-09-13T15:02:33.741807+0000","last_peered":"2024-09-13T15:02:33.741807+0000","last_clean":"2024-09-13T15:02:33.741807+0000","last_became_active":"2024-09-13T15:01:44.807641+0000","last_became_peered":"2024-09-13T15:01:44.807641+0000","last_unstale":"2024-09-13T15:02:33.741807+0000","last_undegraded":"2024-09-13T15:02:33.741807+0000","last_fullsized":"2024-09-13T15:02:33.741807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:58.296966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.912543+0000","last_change":"2024-09-13T15:01:44.433582+0000","last_active":"2024-09-13T15:04:29.912543+0000","last_peered":"2024-09-13T15:04:29.912543+0000","last_clean":"2024-09-13T15:04:29.912543+0000","last_became_active":"2024-09-13T15:01:44.433124+0000","last_became_peered":"2024-09-13T15:01:44.433124+0000","last_unstale":"2024-09-13T15:04:29.912543+0000","last_undegraded":"2024-09-13T15:04:29.912543+0000","last_fullsized":"2024-09-13T15:04:29.912543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:04.476996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744178+0000","last_change":"2024-09-13T15:01:48.855090+0000","last_active":"2024-09-13T15:02:33.744178+0000","last_peered":"2024-09-13T15:02:33.744178+0000","last_clean":"2024-09-13T15:02:33.744178+0000","last_became_active":"2024-09-13T15:01:48.852925+0000","last_became_peered":"2024-09-13T15:01:48.852925+0000","last_unstale":"2024-09-13T15:02:33.744178+0000","last_undegraded":"2024-09-13T15:02:33.744178+0000","last_fullsized":"2024-09-13T15:02:33.744178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.176480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748607+0000","last_change":"2024-09-13T15:02:33.746356+0000","last_active":"2024-09-13T15:02:33.748607+0000","last_peered":"2024-09-13T15:02:33.748607+0000","last_clean":"2024-09-13T15:02:33.748607+0000","last_became_active":"2024-09-13T15:02:33.746005+0000","last_became_peered":"2024-09-13T15:02:33.746005+0000","last_unstale":"2024-09-13T15:02:33.748607+0000","last_undegraded":"2024-09-13T15:02:33.748607+0000","last_fullsized":"2024-09-13T15:02:33.748607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:41.159781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:23.881944+0000","last_change":"2024-09-13T15:01:44.436900+0000","last_active":"2024-09-13T15:04:23.881944+0000","last_peered":"2024-09-13T15:04:23.881944+0000","last_clean":"2024-09-13T15:04:23.881944+0000","last_became_active":"2024-09-13T15:01:44.436646+0000","last_became_peered":"2024-09-13T15:01:44.436646+0000","last_unstale":"2024-09-13T15:04:23.881944+0000","last_undegraded":"2024-09-13T15:04:23.881944+0000","last_fullsized":"2024-09-13T15:04:23.881944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:52.505856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.920613+0000","last_change":"2024-09-13T15:01:44.430115+0000","last_active":"2024-09-13T15:04:29.920613+0000","last_peered":"2024-09-13T15:04:29.920613+0000","last_clean":"2024-09-13T15:04:29.920613+0000","last_became_active":"2024-09-13T15:01:44.429339+0000","last_became_peered":"2024-09-13T15:01:44.429339+0000","last_unstale":"2024-09-13T15:04:29.920613+0000","last_undegraded":"2024-09-13T15:04:29.920613+0000","last_fullsized":"2024-09-13T15:04:29.920613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:47.224125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744095+0000","last_change":"2024-09-13T15:01:44.822034+0000","last_active":"2024-09-13T15:02:33.744095+0000","last_peered":"2024-09-13T15:02:33.744095+0000","last_clean":"2024-09-13T15:02:33.744095+0000","last_became_active":"2024-09-13T15:01:44.821734+0000","last_became_peered":"2024-09-13T15:01:44.821734+0000","last_unstale":"2024-09-13T15:02:33.744095+0000","last_undegraded":"2024-09-13T15:02:33.744095+0000","last_fullsized":"2024-09-13T15:02:33.744095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:57:44.629046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741811+0000","last_change":"2024-09-13T15:01:48.858033+0000","last_active":"2024-09-13T15:02:33.741811+0000","last_peered":"2024-09-13T15:02:33.741811+0000","last_clean":"2024-09-13T15:02:33.741811+0000","last_became_active":"2024-09-13T15:01:48.857584+0000","last_became_peered":"2024-09-13T15:01:48.857584+0000","last_unstale":"2024-09-13T15:02:33.741811+0000","last_undegraded":"2024-09-13T15:02:33.741811+0000","last_fullsized":"2024-09-13T15:02:33.741811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:04.797167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'5","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.610821+0000","last_change":"2024-09-13T15:01:44.422582+0000","last_active":"2024-09-13T15:04:17.610821+0000","last_peered":"2024-09-13T15:04:17.610821+0000","last_clean":"2024-09-13T15:04:17.610821+0000","last_became_active":"2024-09-13T15:01:44.422367+0000","last_became_peered":"2024-09-13T15:01:44.422367+0000","last_unstale":"2024-09-13T15:04:17.610821+0000","last_undegraded":"2024-09-13T15:04:17.610821+0000","last_fullsized":"2024-09-13T15:04:17.610821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.902724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748800+0000","last_change":"2024-09-13T15:01:44.820841+0000","last_active":"2024-09-13T15:02:33.748800+0000","last_peered":"2024-09-13T15:02:33.748800+0000","last_clean":"2024-09-13T15:02:33.748800+0000","last_became_active":"2024-09-13T15:01:44.816584+0000","last_became_peered":"2024-09-13T15:01:44.816584+0000","last_unstale":"2024-09-13T15:02:33.748800+0000","last_undegraded":"2024-09-13T15:02:33.748800+0000","last_fullsized":"2024-09-13T15:02:33.748800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:26.763818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738483+0000","last_change":"2024-09-13T15:01:48.840771+0000","last_active":"2024-09-13T15:02:33.738483+0000","last_peered":"2024-09-13T15:02:33.738483+0000","last_clean":"2024-09-13T15:02:33.738483+0000","last_became_active":"2024-09-13T15:01:48.840397+0000","last_became_peered":"2024-09-13T15:01:48.840397+0000","last_unstale":"2024-09-13T15:02:33.738483+0000","last_undegraded":"2024-09-13T15:02:33.738483+0000","last_fullsized":"2024-09-13T15:02:33.738483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:59.700088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741113+0000","last_change":"2024-09-13T15:01:44.809497+0000","last_active":"2024-09-13T15:02:33.741113+0000","last_peered":"2024-09-13T15:02:33.741113+0000","last_clean":"2024-09-13T15:02:33.741113+0000","last_became_active":"2024-09-13T15:01:44.808669+0000","last_became_peered":"2024-09-13T15:01:44.808669+0000","last_unstale":"2024-09-13T15:02:33.741113+0000","last_undegraded":"2024-09-13T15:02:33.741113+0000","last_fullsized":"2024-09-13T15:02:33.741113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:45.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744117+0000","last_change":"2024-09-13T15:01:44.836353+0000","last_active":"2024-09-13T15:02:33.744117+0000","last_peered":"2024-09-13T15:02:33.744117+0000","last_clean":"2024-09-13T15:02:33.744117+0000","last_became_active":"2024-09-13T15:01:44.836102+0000","last_became_peered":"2024-09-13T15:01:44.836102+0000","last_unstale":"2024-09-13T15:02:33.744117+0000","last_undegraded":"2024-09-13T15:02:33.744117+0000","last_fullsized":"2024-09-13T15:02:33.744117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:14.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741973+0000","last_change":"2024-09-13T15:01:44.849091+0000","last_active":"2024-09-13T15:02:33.741973+0000","last_peered":"2024-09-13T15:02:33.741973+0000","last_clean":"2024-09-13T15:02:33.741973+0000","last_became_active":"2024-09-13T15:01:44.846506+0000","last_became_peered":"2024-09-13T15:01:44.846506+0000","last_unstale":"2024-09-13T15:02:33.741973+0000","last_undegraded":"2024-09-13T15:02:33.741973+0000","last_fullsized":"2024-09-13T15:02:33.741973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:38.026998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743939+0000","last_change":"2024-09-13T15:01:44.809873+0000","last_active":"2024-09-13T15:02:33.743939+0000","last_peered":"2024-09-13T15:02:33.743939+0000","last_clean":"2024-09-13T15:02:33.743939+0000","last_became_active":"2024-09-13T15:01:44.809585+0000","last_became_peered":"2024-09-13T15:01:44.809585+0000","last_unstale":"2024-09-13T15:02:33.743939+0000","last_undegraded":"2024-09-13T15:02:33.743939+0000","last_fullsized":"2024-09-13T15:02:33.743939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:20.272320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738378+0000","last_change":"2024-09-13T15:01:44.816761+0000","last_active":"2024-09-13T15:02:33.738378+0000","last_peered":"2024-09-13T15:02:33.738378+0000","last_clean":"2024-09-13T15:02:33.738378+0000","last_became_active":"2024-09-13T15:01:44.816480+0000","last_became_peered":"2024-09-13T15:01:44.816480+0000","last_unstale":"2024-09-13T15:02:33.738378+0000","last_undegraded":"2024-09-13T15:02:33.738378+0000","last_fullsized":"2024-09-13T15:02:33.738378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:46.000440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742115+0000","last_change":"2024-09-13T15:01:44.808373+0000","last_active":"2024-09-13T15:02:33.742115+0000","last_peered":"2024-09-13T15:02:33.742115+0000","last_clean":"2024-09-13T15:02:33.742115+0000","last_became_active":"2024-09-13T15:01:44.807622+0000","last_became_peered":"2024-09-13T15:01:44.807622+0000","last_unstale":"2024-09-13T15:02:33.742115+0000","last_undegraded":"2024-09-13T15:02:33.742115+0000","last_fullsized":"2024-09-13T15:02:33.742115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:38.584426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745064+0000","last_change":"2024-09-13T15:01:44.832521+0000","last_active":"2024-09-13T15:02:33.745064+0000","last_peered":"2024-09-13T15:02:33.745064+0000","last_clean":"2024-09-13T15:02:33.745064+0000","last_became_active":"2024-09-13T15:01:44.831889+0000","last_became_peered":"2024-09-13T15:01:44.831889+0000","last_unstale":"2024-09-13T15:02:33.745064+0000","last_undegraded":"2024-09-13T15:02:33.745064+0000","last_fullsized":"2024-09-13T15:02:33.745064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:07.563684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738576+0000","last_change":"2024-09-13T15:01:44.817583+0000","last_active":"2024-09-13T15:02:33.738576+0000","last_peered":"2024-09-13T15:02:33.738576+0000","last_clean":"2024-09-13T15:02:33.738576+0000","last_became_active":"2024-09-13T15:01:44.817350+0000","last_became_peered":"2024-09-13T15:01:44.817350+0000","last_unstale":"2024-09-13T15:02:33.738576+0000","last_undegraded":"2024-09-13T15:02:33.738576+0000","last_fullsized":"2024-09-13T15:02:33.738576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:10.913776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740529+0000","last_change":"2024-09-13T15:01:44.838372+0000","last_active":"2024-09-13T15:02:33.740529+0000","last_peered":"2024-09-13T15:02:33.740529+0000","last_clean":"2024-09-13T15:02:33.740529+0000","last_became_active":"2024-09-13T15:01:44.837588+0000","last_became_peered":"2024-09-13T15:01:44.837588+0000","last_unstale":"2024-09-13T15:02:33.740529+0000","last_undegraded":"2024-09-13T15:02:33.740529+0000","last_fullsized":"2024-09-13T15:02:33.740529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:05:12.877936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737718+0000","last_change":"2024-09-13T15:01:44.828159+0000","last_active":"2024-09-13T15:02:33.737718+0000","last_peered":"2024-09-13T15:02:33.737718+0000","last_clean":"2024-09-13T15:02:33.737718+0000","last_became_active":"2024-09-13T15:01:44.827910+0000","last_became_peered":"2024-09-13T15:01:44.827910+0000","last_unstale":"2024-09-13T15:02:33.737718+0000","last_undegraded":"2024-09-13T15:02:33.737718+0000","last_fullsized":"2024-09-13T15:02:33.737718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:07:32.776119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.119204+0000","last_change":"2024-09-13T15:02:34.119204+0000","last_active":"2024-09-13T15:02:34.119204+0000","last_peered":"2024-09-13T15:02:34.119204+0000","last_clean":"2024-09-13T15:02:34.119204+0000","last_became_active":"2024-09-13T15:02:34.118621+0000","last_became_peered":"2024-09-13T15:02:34.118621+0000","last_unstale":"2024-09-13T15:02:34.119204+0000","last_undegraded":"2024-09-13T15:02:34.119204+0000","last_fullsized":"2024-09-13T15:02:34.119204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:33.356064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743857+0000","last_change":"2024-09-13T15:01:44.831717+0000","last_active":"2024-09-13T15:02:33.743857+0000","last_peered":"2024-09-13T15:02:33.743857+0000","last_clean":"2024-09-13T15:02:33.743857+0000","last_became_active":"2024-09-13T15:01:44.831495+0000","last_became_peered":"2024-09-13T15:01:44.831495+0000","last_unstale":"2024-09-13T15:02:33.743857+0000","last_undegraded":"2024-09-13T15:02:33.743857+0000","last_fullsized":"2024-09-13T15:02:33.743857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:48.753543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743869+0000","last_change":"2024-09-13T15:01:44.829698+0000","last_active":"2024-09-13T15:02:33.743869+0000","last_peered":"2024-09-13T15:02:33.743869+0000","last_clean":"2024-09-13T15:02:33.743869+0000","last_became_active":"2024-09-13T15:01:44.828999+0000","last_became_peered":"2024-09-13T15:01:44.828999+0000","last_unstale":"2024-09-13T15:02:33.743869+0000","last_undegraded":"2024-09-13T15:02:33.743869+0000","last_fullsized":"2024-09-13T15:02:33.743869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:30.591718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117647+0000","last_change":"2024-09-13T15:01:44.817554+0000","last_active":"2024-09-13T15:02:34.117647+0000","last_peered":"2024-09-13T15:02:34.117647+0000","last_clean":"2024-09-13T15:02:34.117647+0000","last_became_active":"2024-09-13T15:01:44.816258+0000","last_became_peered":"2024-09-13T15:01:44.816258+0000","last_unstale":"2024-09-13T15:02:34.117647+0000","last_undegraded":"2024-09-13T15:02:34.117647+0000","last_fullsized":"2024-09-13T15:02:34.117647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:07.927802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742322+0000","last_change":"2024-09-13T15:01:44.809979+0000","last_active":"2024-09-13T15:02:33.742322+0000","last_peered":"2024-09-13T15:02:33.742322+0000","last_clean":"2024-09-13T15:02:33.742322+0000","last_became_active":"2024-09-13T15:01:44.809687+0000","last_became_peered":"2024-09-13T15:01:44.809687+0000","last_unstale":"2024-09-13T15:02:33.742322+0000","last_undegraded":"2024-09-13T15:02:33.742322+0000","last_fullsized":"2024-09-13T15:02:33.742322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:45.583840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.119233+0000","last_change":"2024-09-13T15:02:34.119233+0000","last_active":"2024-09-13T15:02:34.119233+0000","last_peered":"2024-09-13T15:02:34.119233+0000","last_clean":"2024-09-13T15:02:34.119233+0000","last_became_active":"2024-09-13T15:02:34.118798+0000","last_became_peered":"2024-09-13T15:02:34.118798+0000","last_unstale":"2024-09-13T15:02:34.119233+0000","last_undegraded":"2024-09-13T15:02:34.119233+0000","last_fullsized":"2024-09-13T15:02:34.119233+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:12.367569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740392+0000","last_change":"2024-09-13T15:01:44.848904+0000","last_active":"2024-09-13T15:02:33.740392+0000","last_peered":"2024-09-13T15:02:33.740392+0000","last_clean":"2024-09-13T15:02:33.740392+0000","last_became_active":"2024-09-13T15:01:44.846074+0000","last_became_peered":"2024-09-13T15:01:44.846074+0000","last_unstale":"2024-09-13T15:02:33.740392+0000","last_undegraded":"2024-09-13T15:02:33.740392+0000","last_fullsized":"2024-09-13T15:02:33.740392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:37.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741904+0000","last_change":"2024-09-13T15:01:44.828243+0000","last_active":"2024-09-13T15:02:33.741904+0000","last_peered":"2024-09-13T15:02:33.741904+0000","last_clean":"2024-09-13T15:02:33.741904+0000","last_became_active":"2024-09-13T15:01:44.828024+0000","last_became_peered":"2024-09-13T15:01:44.828024+0000","last_unstale":"2024-09-13T15:02:33.741904+0000","last_undegraded":"2024-09-13T15:02:33.741904+0000","last_fullsized":"2024-09-13T15:02:33.741904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:28:47.388087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743573+0000","last_change":"2024-09-13T15:01:44.808879+0000","last_active":"2024-09-13T15:02:33.743573+0000","last_peered":"2024-09-13T15:02:33.743573+0000","last_clean":"2024-09-13T15:02:33.743573+0000","last_became_active":"2024-09-13T15:01:44.808609+0000","last_became_peered":"2024-09-13T15:01:44.808609+0000","last_unstale":"2024-09-13T15:02:33.743573+0000","last_undegraded":"2024-09-13T15:02:33.743573+0000","last_fullsized":"2024-09-13T15:02:33.743573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:59.817452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738213+0000","last_change":"2024-09-13T15:01:44.811171+0000","last_active":"2024-09-13T15:02:33.738213+0000","last_peered":"2024-09-13T15:02:33.738213+0000","last_clean":"2024-09-13T15:02:33.738213+0000","last_became_active":"2024-09-13T15:01:44.809918+0000","last_became_peered":"2024-09-13T15:01:44.809918+0000","last_unstale":"2024-09-13T15:02:33.738213+0000","last_undegraded":"2024-09-13T15:02:33.738213+0000","last_fullsized":"2024-09-13T15:02:33.738213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:48.359429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749385+0000","last_change":"2024-09-13T15:01:44.833663+0000","last_active":"2024-09-13T15:02:33.749385+0000","last_peered":"2024-09-13T15:02:33.749385+0000","last_clean":"2024-09-13T15:02:33.749385+0000","last_became_active":"2024-09-13T15:01:44.828737+0000","last_became_peered":"2024-09-13T15:01:44.828737+0000","last_unstale":"2024-09-13T15:02:33.749385+0000","last_undegraded":"2024-09-13T15:02:33.749385+0000","last_fullsized":"2024-09-13T15:02:33.749385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:08.579890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744005+0000","last_change":"2024-09-13T15:01:44.851143+0000","last_active":"2024-09-13T15:02:33.744005+0000","last_peered":"2024-09-13T15:02:33.744005+0000","last_clean":"2024-09-13T15:02:33.744005+0000","last_became_active":"2024-09-13T15:01:44.850410+0000","last_became_peered":"2024-09-13T15:01:44.850410+0000","last_unstale":"2024-09-13T15:02:33.744005+0000","last_undegraded":"2024-09-13T15:02:33.744005+0000","last_fullsized":"2024-09-13T15:02:33.744005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:11.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744851+0000","last_change":"2024-09-13T15:01:44.840082+0000","last_active":"2024-09-13T15:02:33.744851+0000","last_peered":"2024-09-13T15:02:33.744851+0000","last_clean":"2024-09-13T15:02:33.744851+0000","last_became_active":"2024-09-13T15:01:44.839371+0000","last_became_peered":"2024-09-13T15:01:44.839371+0000","last_unstale":"2024-09-13T15:02:33.744851+0000","last_undegraded":"2024-09-13T15:02:33.744851+0000","last_fullsized":"2024-09-13T15:02:33.744851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:13.433036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118361+0000","last_change":"2024-09-13T15:01:44.850416+0000","last_active":"2024-09-13T15:02:34.118361+0000","last_peered":"2024-09-13T15:02:34.118361+0000","last_clean":"2024-09-13T15:02:34.118361+0000","last_became_active":"2024-09-13T15:01:44.849766+0000","last_became_peered":"2024-09-13T15:01:44.849766+0000","last_unstale":"2024-09-13T15:02:34.118361+0000","last_undegraded":"2024-09-13T15:02:34.118361+0000","last_fullsized":"2024-09-13T15:02:34.118361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:11.985610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737522+0000","last_change":"2024-09-13T15:01:44.837060+0000","last_active":"2024-09-13T15:02:33.737522+0000","last_peered":"2024-09-13T15:02:33.737522+0000","last_clean":"2024-09-13T15:02:33.737522+0000","last_became_active":"2024-09-13T15:01:44.836770+0000","last_became_peered":"2024-09-13T15:01:44.836770+0000","last_unstale":"2024-09-13T15:02:33.737522+0000","last_undegraded":"2024-09-13T15:02:33.737522+0000","last_fullsized":"2024-09-13T15:02:33.737522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:45.915852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116554+0000","last_change":"2024-09-13T15:01:44.815867+0000","last_active":"2024-09-13T15:02:34.116554+0000","last_peered":"2024-09-13T15:02:34.116554+0000","last_clean":"2024-09-13T15:02:34.116554+0000","last_became_active":"2024-09-13T15:01:44.815116+0000","last_became_peered":"2024-09-13T15:01:44.815116+0000","last_unstale":"2024-09-13T15:02:34.116554+0000","last_undegraded":"2024-09-13T15:02:34.116554+0000","last_fullsized":"2024-09-13T15:02:34.116554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:02.814724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741454+0000","last_change":"2024-09-13T15:01:44.850022+0000","last_active":"2024-09-13T15:02:33.741454+0000","last_peered":"2024-09-13T15:02:33.741454+0000","last_clean":"2024-09-13T15:02:33.741454+0000","last_became_active":"2024-09-13T15:01:44.849533+0000","last_became_peered":"2024-09-13T15:01:44.849533+0000","last_unstale":"2024-09-13T15:02:33.741454+0000","last_undegraded":"2024-09-13T15:02:33.741454+0000","last_fullsized":"2024-09-13T15:02:33.741454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:09.837692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116378+0000","last_change":"2024-09-13T15:01:44.817139+0000","last_active":"2024-09-13T15:02:34.116378+0000","last_peered":"2024-09-13T15:02:34.116378+0000","last_clean":"2024-09-13T15:02:34.116378+0000","last_became_active":"2024-09-13T15:01:44.816416+0000","last_became_peered":"2024-09-13T15:01:44.816416+0000","last_unstale":"2024-09-13T15:02:34.116378+0000","last_undegraded":"2024-09-13T15:02:34.116378+0000","last_fullsized":"2024-09-13T15:02:34.116378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:38.382210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.869812+0000","last_change":"2024-09-13T15:02:33.747735+0000","last_active":"2024-09-13T15:02:33.869812+0000","last_peered":"2024-09-13T15:02:33.869812+0000","last_clean":"2024-09-13T15:02:33.869812+0000","last_became_active":"2024-09-13T15:02:33.747405+0000","last_became_peered":"2024-09-13T15:02:33.747405+0000","last_unstale":"2024-09-13T15:02:33.869812+0000","last_undegraded":"2024-09-13T15:02:33.869812+0000","last_fullsized":"2024-09-13T15:02:33.869812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:20.616184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742170+0000","last_change":"2024-09-13T15:01:44.808264+0000","last_active":"2024-09-13T15:02:33.742170+0000","last_peered":"2024-09-13T15:02:33.742170+0000","last_clean":"2024-09-13T15:02:33.742170+0000","last_became_active":"2024-09-13T15:01:44.807776+0000","last_became_peered":"2024-09-13T15:01:44.807776+0000","last_unstale":"2024-09-13T15:02:33.742170+0000","last_undegraded":"2024-09-13T15:02:33.742170+0000","last_fullsized":"2024-09-13T15:02:33.742170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:17.637800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742252+0000","last_change":"2024-09-13T15:01:44.804985+0000","last_active":"2024-09-13T15:02:33.742252+0000","last_peered":"2024-09-13T15:02:33.742252+0000","last_clean":"2024-09-13T15:02:33.742252+0000","last_became_active":"2024-09-13T15:01:44.803977+0000","last_became_peered":"2024-09-13T15:01:44.803977+0000","last_unstale":"2024-09-13T15:02:33.742252+0000","last_undegraded":"2024-09-13T15:02:33.742252+0000","last_fullsized":"2024-09-13T15:02:33.742252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:12.999738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118211+0000","last_change":"2024-09-13T15:01:44.824666+0000","last_active":"2024-09-13T15:02:34.118211+0000","last_peered":"2024-09-13T15:02:34.118211+0000","last_clean":"2024-09-13T15:02:34.118211+0000","last_became_active":"2024-09-13T15:01:44.815381+0000","last_became_peered":"2024-09-13T15:01:44.815381+0000","last_unstale":"2024-09-13T15:02:34.118211+0000","last_undegraded":"2024-09-13T15:02:34.118211+0000","last_fullsized":"2024-09-13T15:02:34.118211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:12:17.680247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10025,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":20050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542184,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":917504,"data_stored":709456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.94599999999999995,"15min":0.94099999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4079999999999999,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.008},{"interface":"front","average":{"1min":0.878,"5min":0.877,"15min":0.877},"min":{"1min":0.57999999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.753}]},{"osd":1,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.873,"15min":0.877},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.147,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.028,"15min":1.036},"min":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0009999999999999,"15min":1.0089999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.4570000000000001,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.98699999999999999,"15min":0.995},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.321,"5min":1.452,"15min":1.452},"last":1.0660000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.92200000000000004,"15min":0.93000000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.1220000000000001,"5min":1.232,"15min":1.232},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.1020000000000001,"15min":1.1140000000000001},"min":{"1min":0.79000000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.496,"5min":1.7,"15min":1.7},"last":0.878}]},{"osd":4,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3700000000000001,"5min":1.643,"15min":1.643},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.03,"15min":1.046},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.137,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.153,"15min":1.165},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.579,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.095,"5min":1.1040000000000001,"15min":1.1060000000000001},"min":{"1min":0.86799999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.4359999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.153}]},{"osd":6,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.179,"15min":1.1890000000000001},"min":{"1min":0.81299999999999994,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4970000000000001,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.1399999999999999,"15min":1.157},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.266,"5min":1.641,"15min":1.641},"last":0.86099999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542185,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":121573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.878,"15min":0.90100000000000002},"min":{"1min":0.61499999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.224,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.86799999999999999,"15min":0.85799999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.89200000000000002,"15min":0.89900000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.90300000000000002,"15min":0.88900000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.92300000000000004}]},{"osd":3,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91100000000000003,"15min":0.91500000000000004},"min":{"1min":0.63700000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1399999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.94599999999999995,"15min":0.95199999999999996},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.71999999999999997}]},{"osd":4,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.67900000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.97999999999999998,"15min":1.0009999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.115,"5min":1.369,"15min":1.369},"last":1.075}]},{"osd":5,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.95199999999999996,"15min":0.96099999999999997},"min":{"1min":0.69799999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1990000000000001,"5min":1.3,"15min":1.3},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.032,"15min":1.046},"min":{"1min":0.66700000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":1.153}]},{"osd":7,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.016,"15min":1.0289999999999999},"min":{"1min":0.72099999999999997,"5min":0.626,"15min":0.626},"max":{"1min":1.1890000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.089,"15min":1.107},"min":{"1min":0.91200000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.996}]}]},{"osd":5,"up_from":14,"seq":60129542184,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":120872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.86899999999999999,"15min":0.872},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.86899999999999999,"15min":0.86299999999999999},"min":{"1min":0.71599999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.282,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.93700000000000006,"15min":0.94499999999999995},"min":{"1min":0.63700000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3839999999999999,"5min":1.401,"15min":1.401},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.89200000000000002,"15min":0.89600000000000002},"min":{"1min":0.65700000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93500000000000005,"15min":0.94499999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95099999999999996,"15min":0.94899999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.94499999999999995,"15min":0.94799999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.2849999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97199999999999998,"15min":0.97099999999999997},"min":{"1min":0.72699999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.85299999999999998,"15min":0.85599999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2330000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.0600000000000001,"15min":1.079},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.2669999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.0609999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.028,"15min":1.044},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.202,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.196},{"interface":"front","average":{"1min":1.004,"5min":1.083,"15min":1.0960000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.496,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.036}]},{"osd":7,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.085,"15min":1.087},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.111},{"interface":"front","average":{"1min":1.099,"5min":1.145,"15min":1.153},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.5609999999999999,"5min":1.988,"15min":1.988},"last":1.2170000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":118318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.90000000000000002,"15min":0.90600000000000003},"min":{"1min":0.60399999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.071,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.83099999999999996,"15min":0.82699999999999996},"min":{"1min":0.63200000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.139,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.004}]},{"osd":1,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.92200000000000004,"15min":0.92600000000000005},"min":{"1min":0.68200000000000005,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.131,"5min":1.224,"15min":1.224},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.871,"15min":0.87},"min":{"1min":0.623,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.157,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.97399999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.93700000000000006,"15min":0.94299999999999995},"min":{"1min":0.70299999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.0780000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.95799999999999996,"15min":0.96199999999999997},"min":{"1min":0.67500000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1240000000000001,"5min":1.669,"15min":1.669},"last":0.91600000000000004}]},{"osd":3,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90200000000000002,"15min":0.90600000000000003},"min":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.099,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.0069999999999999,"15min":1.0189999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.2230000000000001,"5min":1.881,"15min":1.881},"last":0.628}]},{"osd":5,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":1.0169999999999999,"15min":1.05},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.028,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.96999999999999997,"15min":0.98499999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.1819999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.88700000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.0109999999999999,"15min":1.0269999999999999},"min":{"1min":0.64000000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.107,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.093},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.083,"15min":1.0960000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.367,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.046,"15min":1.054},"min":{"1min":0.751,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.2569999999999999,"5min":1.623,"15min":1.623},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.2090000000000001,"15min":1.2210000000000001},"min":{"1min":0.96099999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3180000000000001,"5min":1.996,"15min":1.996},"last":1.0700000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":319488,"data_stored":121607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.501,"15min":0.501},"min":{"1min":0.371,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64900000000000002,"5min":0.747,"15min":0.747},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.66300000000000003,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.374,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.71499999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.44400000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.76600000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81200000000000006,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.61399999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97599999999999998,"5min":1.179,"15min":1.179},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85999999999999999,"15min":0.86399999999999999},"min":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.034,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.87}]},{"osd":5,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.873,"15min":0.876},"min":{"1min":0.68500000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0740000000000001,"5min":1.284,"15min":1.284},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.87,"5min":0.93300000000000005,"15min":0.94299999999999995},"min":{"1min":0.70599999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.212,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.753}]},{"osd":6,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.89400000000000002,"15min":0.90700000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0269999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.94099999999999995,"15min":0.95099999999999996},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.1539999999999999,"5min":1.21,"15min":1.21},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.95299999999999996,"15min":0.96899999999999997},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.1499999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.96399999999999997,"15min":0.98799999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0640000000000001,"5min":1.228,"15min":1.228},"last":0.90800000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542184,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":319488,"data_stored":118450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48599999999999999,"15min":0.48799999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.33700000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76600000000000001,"5min":1.157,"15min":1.157},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.41599999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.71199999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.44700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73899999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.48599999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.72199999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.96699999999999997,"15min":0.98099999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.1899999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.94799999999999995,"15min":0.96299999999999997},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.123,"5min":1.675,"15min":1.675},"last":1.004}]},{"osd":5,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.92300000000000004,"15min":0.93000000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.0920000000000001,"5min":1.296,"15min":1.296},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.877,"15min":0.88700000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.91100000000000003}]},{"osd":6,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.88,"15min":0.88400000000000001},"min":{"1min":0.69599999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.93500000000000005,"15min":0.94199999999999995},"min":{"1min":0.748,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.1859999999999999,"5min":1.373,"15min":1.373},"last":1.0700000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.82099999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.98699999999999999,"15min":0.995},"min":{"1min":0.78800000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2010000000000001,"5min":1.353,"15min":1.353},"last":1.1240000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":118520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.32500000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.57699999999999996,"5min":0.871,"15min":0.871},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69799999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.38}]},{"osd":2,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.37,"15min":0.37},"max":{"1min":0.64600000000000002,"5min":1.071,"15min":1.071},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68700000000000006,"5min":1.107,"15min":1.107},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.84799999999999998,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.61599999999999999,"15min":0.63},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68899999999999995,"5min":1.323,"15min":1.323},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.90600000000000003,"15min":0.91800000000000004},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.0169999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.88400000000000001,"15min":0.89300000000000002},"min":{"1min":0.68799999999999994,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1830000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.879,"15min":0.89000000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0289999999999999,"5min":1.228,"15min":1.228},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.91300000000000003,"15min":0.93100000000000005},"min":{"1min":0.70699999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.96899999999999997,"5min":1.365,"15min":1.365},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.90400000000000003,"15min":0.91400000000000003},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":0.999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.94499999999999995,"15min":0.96499999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":0.98199999999999998,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.59799999999999998}]},{"osd":7,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.94799999999999995,"15min":0.96699999999999997},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":0.95499999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.93500000000000005,"15min":0.94899999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2170000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.753}]}]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":909312,"data_stored":708278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.66800000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.58699999999999997,"15min":0.60199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68899999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.623,"15min":0.64100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.64400000000000002,"5min":1.669,"15min":1.669},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56299999999999994,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69399999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.72499999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88900000000000001},"min":{"1min":0.67100000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.0980000000000001,"5min":1.274,"15min":1.274},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.90400000000000003,"15min":0.91200000000000003},"min":{"1min":0.67500000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0580000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.754}]},{"osd":5,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.88300000000000001,"15min":0.88900000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.026,"5min":1.165,"15min":1.165},"last":0.89100000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.95199999999999996,"15min":0.96699999999999997},"min":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.0940000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.91200000000000003,"15min":0.92500000000000004},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.044}]},{"osd":7,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":0.93899999999999995},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.93200000000000005,"15min":0.94599999999999995},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.038,"5min":1.141,"15min":1.141},"last":1.0600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:04:50.063 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:04:50.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.237+0000 7fc319c00640 1 Processor -- start 2024-09-13T15:04:50.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.237+0000 7fc319c00640 1 -- start start 2024-09-13T15:04:50.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.241+0000 7fc319c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3140c85f0 0x7fc31415e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:50.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.241+0000 7fc319c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3140c7800 0x7fc3140c3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:50.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.241+0000 7fc319c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31406ef10 con 0x7fc31406fb10 2024-09-13T15:04:50.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.241+0000 7fc319c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31406c0c0 con 0x7fc3140c85f0 2024-09-13T15:04:50.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.241+0000 7fc319c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3140c7f80 con 0x7fc3140c7800 2024-09-13T15:04:50.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.241+0000 7fc30a000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3140c85f0 0x7fc31415e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:50.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.241+0000 7fc312a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc31406fb10 0x7fc31406d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33222/0 (socket says 172.21.15.7:33222) 2024-09-13T15:04:50.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.241+0000 7fc312a00640 1 -- 172.21.15.7:0/2361185809 learned_addr learned my addr 172.21.15.7:0/2361185809 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:50.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.241+0000 7fc313400640 1 --2- 172.21.15.7:0/2361185809 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3140c7800 0x7fc3140c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:50.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.241+0000 7fc30a000640 1 -- 172.21.15.7:0/2361185809 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3140c7800 msgr2=0x7fc3140c3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:50.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.241+0000 7fc30a000640 1 --2- 172.21.15.7:0/2361185809 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3140c7800 0x7fc3140c3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.241+0000 7fc30a000640 1 -- 172.21.15.7:0/2361185809 >> v1:172.21.15.7:6789/0 conn(0x7fc31406fb10 legacy=0x7fc31406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:50.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.241+0000 7fc312000640 1 -- 172.21.15.7:0/2361185809 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281018675 0 0) 0x7fc31406ef10 con 0x7fc31406fb10 2024-09-13T15:04:50.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.241+0000 7fc30a000640 1 -- 172.21.15.7:0/2361185809 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31406bde0 con 0x7fc3140c85f0 2024-09-13T15:04:50.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc30a000640 1 --2- 172.21.15.7:0/2361185809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3140c85f0 0x7fc31415e000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0097c0 tx=0x7fc2fc01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69132410aafe924b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:50.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc312000640 1 -- 172.21.15.7:0/2361185809 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc0a8990 con 0x7fc3140c85f0 2024-09-13T15:04:50.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc312000640 1 -- 172.21.15.7:0/2361185809 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc0a8af0 con 0x7fc3140c85f0 2024-09-13T15:04:50.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc312000640 1 -- 172.21.15.7:0/2361185809 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc0a8e80 con 0x7fc3140c85f0 2024-09-13T15:04:50.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc319c00640 1 -- 172.21.15.7:0/2361185809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3140c85f0 msgr2=0x7fc31415e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:50.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc319c00640 1 --2- 172.21.15.7:0/2361185809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3140c85f0 0x7fc31415e000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc0097c0 tx=0x7fc2fc01ec90 comp rx=0 tx=0).stop 2024-09-13T15:04:50.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc319c00640 1 -- 172.21.15.7:0/2361185809 shutdown_connections 2024-09-13T15:04:50.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc319c00640 1 --2- 172.21.15.7:0/2361185809 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3140c7800 0x7fc3140c3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc319c00640 1 --2- 172.21.15.7:0/2361185809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3140c85f0 0x7fc31415e000 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc319c00640 1 -- 172.21.15.7:0/2361185809 >> 172.21.15.7:0/2361185809 conn(0x7fc314071730 msgr2=0x7fc314071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:50.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc319c00640 1 -- 172.21.15.7:0/2361185809 shutdown_connections 2024-09-13T15:04:50.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc319c00640 1 -- 172.21.15.7:0/2361185809 wait complete. 2024-09-13T15:04:50.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc319c00640 1 Processor -- start 2024-09-13T15:04:50.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc319c00640 1 -- start start 2024-09-13T15:04:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc319c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc31406fb10 0x7fc3141596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc319c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3140c7800 0x7fc31415a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc319c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3140c85f0 0x7fc31415ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc319c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc314159290 con 0x7fc3140c7800 2024-09-13T15:04:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc319c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc314158f40 con 0x7fc31406fb10 2024-09-13T15:04:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc319c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31415a030 con 0x7fc3140c85f0 2024-09-13T15:04:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.245+0000 7fc30a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3140c7800 0x7fc31415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc30a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3140c7800 0x7fc31415a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58004/0 (socket says 172.21.15.7:58004) 2024-09-13T15:04:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc30a000640 1 -- 172.21.15.7:0/1513909876 learned_addr learned my addr 172.21.15.7:0/1513909876 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:50.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc313400640 1 --2- 172.21.15.7:0/1513909876 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3140c85f0 0x7fc31415ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc312a00640 1 --2- 172.21.15.7:0/1513909876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc31406fb10 0x7fc3141596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc30a000640 1 -- 172.21.15.7:0/1513909876 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3140c85f0 msgr2=0x7fc31415ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc30a000640 1 --2- 172.21.15.7:0/1513909876 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3140c85f0 0x7fc31415ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc30a000640 1 -- 172.21.15.7:0/1513909876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc31406fb10 msgr2=0x7fc3141596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc30a000640 1 --2- 172.21.15.7:0/1513909876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc31406fb10 0x7fc3141596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc30a000640 1 -- 172.21.15.7:0/1513909876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2fc009420 con 0x7fc3140c7800 2024-09-13T15:04:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc30a000640 1 --2- 172.21.15.7:0/1513909876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3140c7800 0x7fc31415a630 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc01d340 tx=0x7fc2fc01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc30b400640 1 -- 172.21.15.7:0/1513909876 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc0bb640 con 0x7fc3140c7800 2024-09-13T15:04:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc30b400640 1 -- 172.21.15.7:0/1513909876 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc0bb7c0 con 0x7fc3140c7800 2024-09-13T15:04:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc319c00640 1 -- 172.21.15.7:0/1513909876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3140c9d60 con 0x7fc3140c7800 2024-09-13T15:04:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc30b400640 1 -- 172.21.15.7:0/1513909876 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc0bbb70 con 0x7fc3140c7800 2024-09-13T15:04:50.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc319c00640 1 -- 172.21.15.7:0/1513909876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3141f5e20 con 0x7fc3140c7800 2024-09-13T15:04:50.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc319c00640 1 -- 172.21.15.7:0/1513909876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc314067650 con 0x7fc3140c7800 2024-09-13T15:04:50.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc30b400640 1 -- 172.21.15.7:0/1513909876 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc2fc0b7040 con 0x7fc3140c7800 2024-09-13T15:04:50.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc30b400640 1 --2- 172.21.15.7:0/1513909876 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc2f0066690 0x7fc2f0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:50.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.249+0000 7fc30b400640 1 -- 172.21.15.7:0/1513909876 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc2fc1227f0 con 0x7fc3140c7800 2024-09-13T15:04:50.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.253+0000 7fc312a00640 1 --2- 172.21.15.7:0/1513909876 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc2f0066690 0x7fc2f0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:50.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.253+0000 7fc312a00640 1 --2- 172.21.15.7:0/1513909876 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc2f0066690 0x7fc2f0068b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc304000f70 tx=0x7fc304007b60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:50.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.257+0000 7fc30b400640 1 -- 172.21.15.7:0/1513909876 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc2fc0ef830 con 0x7fc3140c7800 2024-09-13T15:04:50.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.413+0000 7fc319c00640 1 -- 172.21.15.7:0/1513909876 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3140c7c90 con 0x7fc2f0066690 2024-09-13T15:04:50.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.441+0000 7fc30b400640 1 -- 172.21.15.7:0/1513909876 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368649 (secure 0 0 0) 0x7fc3040071f0 con 0x7fc2f0066690 2024-09-13T15:04:50.447 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:50.450 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T15:04:50.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.445+0000 7fc319c00640 1 -- 172.21.15.7:0/1513909876 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc2f0066690 msgr2=0x7fc2f0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:50.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.445+0000 7fc319c00640 1 --2- 172.21.15.7:0/1513909876 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc2f0066690 0x7fc2f0068b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc304000f70 tx=0x7fc304007b60 comp rx=0 tx=0).stop 2024-09-13T15:04:50.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.445+0000 7fc319c00640 1 -- 172.21.15.7:0/1513909876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3140c7800 msgr2=0x7fc31415a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:50.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.445+0000 7fc319c00640 1 --2- 172.21.15.7:0/1513909876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3140c7800 0x7fc31415a630 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc01d340 tx=0x7fc2fc01ba30 comp rx=0 tx=0).stop 2024-09-13T15:04:50.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.445+0000 7fc319c00640 1 -- 172.21.15.7:0/1513909876 shutdown_connections 2024-09-13T15:04:50.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.445+0000 7fc319c00640 1 --2- 172.21.15.7:0/1513909876 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc2f0066690 0x7fc2f0068b50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.445+0000 7fc319c00640 1 --2- 172.21.15.7:0/1513909876 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3140c85f0 0x7fc31415ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.445+0000 7fc319c00640 1 --2- 172.21.15.7:0/1513909876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3140c7800 0x7fc31415a630 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.445+0000 7fc319c00640 1 --2- 172.21.15.7:0/1513909876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc31406fb10 0x7fc3141596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.445+0000 7fc319c00640 1 -- 172.21.15.7:0/1513909876 >> 172.21.15.7:0/1513909876 conn(0x7fc314071730 msgr2=0x7fc3140cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:50.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.445+0000 7fc319c00640 1 -- 172.21.15.7:0/1513909876 shutdown_connections 2024-09-13T15:04:50.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.445+0000 7fc319c00640 1 -- 172.21.15.7:0/1513909876 wait complete. 2024-09-13T15:04:50.468 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2024-09-13T15:04:48.698207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600393,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":368,"num_write_kb":2483,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":300,"ondisk_log_size":300,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232072,"kb_used_data":3656,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":754742648,"statfs":{"total":773094113280,"available":772856471552,"internally_reserved":0,"allocated":3743744,"data_stored":2137074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":233819704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1358,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004624"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.934945+0000","last_change":"2024-09-13T15:01:44.418856+0000","last_active":"2024-09-13T15:04:35.934945+0000","last_peered":"2024-09-13T15:04:35.934945+0000","last_clean":"2024-09-13T15:04:35.934945+0000","last_became_active":"2024-09-13T15:01:44.418641+0000","last_became_peered":"2024-09-13T15:01:44.418641+0000","last_unstale":"2024-09-13T15:04:35.934945+0000","last_undegraded":"2024-09-13T15:04:35.934945+0000","last_fullsized":"2024-09-13T15:04:35.934945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:40.178824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738513+0000","last_change":"2024-09-13T15:01:44.809371+0000","last_active":"2024-09-13T15:02:33.738513+0000","last_peered":"2024-09-13T15:02:33.738513+0000","last_clean":"2024-09-13T15:02:33.738513+0000","last_became_active":"2024-09-13T15:01:44.809091+0000","last_became_peered":"2024-09-13T15:01:44.809091+0000","last_unstale":"2024-09-13T15:02:33.738513+0000","last_undegraded":"2024-09-13T15:02:33.738513+0000","last_fullsized":"2024-09-13T15:02:33.738513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:22.412025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737520+0000","last_change":"2024-09-13T15:01:48.910757+0000","last_active":"2024-09-13T15:02:33.737520+0000","last_peered":"2024-09-13T15:02:33.737520+0000","last_clean":"2024-09-13T15:02:33.737520+0000","last_became_active":"2024-09-13T15:01:48.910262+0000","last_became_peered":"2024-09-13T15:01:48.910262+0000","last_unstale":"2024-09-13T15:02:33.737520+0000","last_undegraded":"2024-09-13T15:02:33.737520+0000","last_fullsized":"2024-09-13T15:02:33.737520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:39.290557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:03:43.915924+0000","last_change":"2024-09-13T15:01:44.404818+0000","last_active":"2024-09-13T15:03:43.915924+0000","last_peered":"2024-09-13T15:03:43.915924+0000","last_clean":"2024-09-13T15:03:43.915924+0000","last_became_active":"2024-09-13T15:01:44.401666+0000","last_became_peered":"2024-09-13T15:01:44.401666+0000","last_unstale":"2024-09-13T15:03:43.915924+0000","last_undegraded":"2024-09-13T15:03:43.915924+0000","last_fullsized":"2024-09-13T15:03:43.915924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:31.818163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742417+0000","last_change":"2024-09-13T15:01:44.850292+0000","last_active":"2024-09-13T15:02:33.742417+0000","last_peered":"2024-09-13T15:02:33.742417+0000","last_clean":"2024-09-13T15:02:33.742417+0000","last_became_active":"2024-09-13T15:01:44.849825+0000","last_became_peered":"2024-09-13T15:01:44.849825+0000","last_unstale":"2024-09-13T15:02:33.742417+0000","last_undegraded":"2024-09-13T15:02:33.742417+0000","last_fullsized":"2024-09-13T15:02:33.742417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:22.582742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.746607+0000","last_change":"2024-09-13T15:01:48.850426+0000","last_active":"2024-09-13T15:02:33.746607+0000","last_peered":"2024-09-13T15:02:33.746607+0000","last_clean":"2024-09-13T15:02:33.746607+0000","last_became_active":"2024-09-13T15:01:48.848750+0000","last_became_peered":"2024-09-13T15:01:48.848750+0000","last_unstale":"2024-09-13T15:02:33.746607+0000","last_undegraded":"2024-09-13T15:02:33.746607+0000","last_fullsized":"2024-09-13T15:02:33.746607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:55.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'12","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.939854+0000","last_change":"2024-09-13T15:01:44.437850+0000","last_active":"2024-09-13T15:04:35.939854+0000","last_peered":"2024-09-13T15:04:35.939854+0000","last_clean":"2024-09-13T15:04:35.939854+0000","last_became_active":"2024-09-13T15:01:44.437168+0000","last_became_peered":"2024-09-13T15:01:44.437168+0000","last_unstale":"2024-09-13T15:04:35.939854+0000","last_undegraded":"2024-09-13T15:04:35.939854+0000","last_fullsized":"2024-09-13T15:04:35.939854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:23.540408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745120+0000","last_change":"2024-09-13T15:01:44.845989+0000","last_active":"2024-09-13T15:02:33.745120+0000","last_peered":"2024-09-13T15:02:33.745120+0000","last_clean":"2024-09-13T15:02:33.745120+0000","last_became_active":"2024-09-13T15:01:44.845395+0000","last_became_peered":"2024-09-13T15:01:44.845395+0000","last_unstale":"2024-09-13T15:02:33.745120+0000","last_undegraded":"2024-09-13T15:02:33.745120+0000","last_fullsized":"2024-09-13T15:02:33.745120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:52.267507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748880+0000","last_change":"2024-09-13T15:01:48.865388+0000","last_active":"2024-09-13T15:02:33.748880+0000","last_peered":"2024-09-13T15:02:33.748880+0000","last_clean":"2024-09-13T15:02:33.748880+0000","last_became_active":"2024-09-13T15:01:48.864314+0000","last_became_peered":"2024-09-13T15:01:48.864314+0000","last_unstale":"2024-09-13T15:02:33.748880+0000","last_undegraded":"2024-09-13T15:02:33.748880+0000","last_fullsized":"2024-09-13T15:02:33.748880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:18.637430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.937176+0000","last_change":"2024-09-13T15:01:44.424080+0000","last_active":"2024-09-13T15:04:35.937176+0000","last_peered":"2024-09-13T15:04:35.937176+0000","last_clean":"2024-09-13T15:04:35.937176+0000","last_became_active":"2024-09-13T15:01:44.423381+0000","last_became_peered":"2024-09-13T15:01:44.423381+0000","last_unstale":"2024-09-13T15:04:35.937176+0000","last_undegraded":"2024-09-13T15:04:35.937176+0000","last_fullsized":"2024-09-13T15:04:35.937176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:38:20.455380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743629+0000","last_change":"2024-09-13T15:01:44.849670+0000","last_active":"2024-09-13T15:02:33.743629+0000","last_peered":"2024-09-13T15:02:33.743629+0000","last_clean":"2024-09-13T15:02:33.743629+0000","last_became_active":"2024-09-13T15:01:44.849038+0000","last_became_peered":"2024-09-13T15:01:44.849038+0000","last_unstale":"2024-09-13T15:02:33.743629+0000","last_undegraded":"2024-09-13T15:02:33.743629+0000","last_fullsized":"2024-09-13T15:02:33.743629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:45.570774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.747610+0000","last_change":"2024-09-13T15:01:48.854953+0000","last_active":"2024-09-13T15:02:33.747610+0000","last_peered":"2024-09-13T15:02:33.747610+0000","last_clean":"2024-09-13T15:02:33.747610+0000","last_became_active":"2024-09-13T15:01:48.853858+0000","last_became_peered":"2024-09-13T15:01:48.853858+0000","last_unstale":"2024-09-13T15:02:33.747610+0000","last_undegraded":"2024-09-13T15:02:33.747610+0000","last_fullsized":"2024-09-13T15:02:33.747610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:07.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742073+0000","last_change":"2024-09-13T15:01:44.824391+0000","last_active":"2024-09-13T15:02:33.742073+0000","last_peered":"2024-09-13T15:02:33.742073+0000","last_clean":"2024-09-13T15:02:33.742073+0000","last_became_active":"2024-09-13T15:01:44.823690+0000","last_became_peered":"2024-09-13T15:01:44.823690+0000","last_unstale":"2024-09-13T15:02:33.742073+0000","last_undegraded":"2024-09-13T15:02:33.742073+0000","last_fullsized":"2024-09-13T15:02:33.742073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.596789+0000","last_change":"2024-09-13T15:01:44.421523+0000","last_active":"2024-09-13T15:04:17.596789+0000","last_peered":"2024-09-13T15:04:17.596789+0000","last_clean":"2024-09-13T15:04:17.596789+0000","last_became_active":"2024-09-13T15:01:44.419965+0000","last_became_peered":"2024-09-13T15:01:44.419965+0000","last_unstale":"2024-09-13T15:04:17.596789+0000","last_undegraded":"2024-09-13T15:04:17.596789+0000","last_fullsized":"2024-09-13T15:04:17.596789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:34.918774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749714+0000","last_change":"2024-09-13T15:01:48.850895+0000","last_active":"2024-09-13T15:02:33.749714+0000","last_peered":"2024-09-13T15:02:33.749714+0000","last_clean":"2024-09-13T15:02:33.749714+0000","last_became_active":"2024-09-13T15:01:48.849856+0000","last_became_peered":"2024-09-13T15:01:48.849856+0000","last_unstale":"2024-09-13T15:02:33.749714+0000","last_undegraded":"2024-09-13T15:02:33.749714+0000","last_fullsized":"2024-09-13T15:02:33.749714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:59.616442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738227+0000","last_change":"2024-09-13T15:01:44.806026+0000","last_active":"2024-09-13T15:02:33.738227+0000","last_peered":"2024-09-13T15:02:33.738227+0000","last_clean":"2024-09-13T15:02:33.738227+0000","last_became_active":"2024-09-13T15:01:44.805767+0000","last_became_peered":"2024-09-13T15:01:44.805767+0000","last_unstale":"2024-09-13T15:02:33.738227+0000","last_undegraded":"2024-09-13T15:02:33.738227+0000","last_fullsized":"2024-09-13T15:02:33.738227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:50.696113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.912198+0000","last_change":"2024-09-13T15:01:44.401897+0000","last_active":"2024-09-13T15:04:29.912198+0000","last_peered":"2024-09-13T15:04:29.912198+0000","last_clean":"2024-09-13T15:04:29.912198+0000","last_became_active":"2024-09-13T15:01:44.401559+0000","last_became_peered":"2024-09-13T15:01:44.401559+0000","last_unstale":"2024-09-13T15:04:29.912198+0000","last_undegraded":"2024-09-13T15:04:29.912198+0000","last_fullsized":"2024-09-13T15:04:29.912198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:58.535567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749109+0000","last_change":"2024-09-13T15:01:48.858808+0000","last_active":"2024-09-13T15:02:33.749109+0000","last_peered":"2024-09-13T15:02:33.749109+0000","last_clean":"2024-09-13T15:02:33.749109+0000","last_became_active":"2024-09-13T15:01:48.857802+0000","last_became_peered":"2024-09-13T15:01:48.857802+0000","last_unstale":"2024-09-13T15:02:33.749109+0000","last_undegraded":"2024-09-13T15:02:33.749109+0000","last_fullsized":"2024-09-13T15:02:33.749109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:41.628058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737738+0000","last_change":"2024-09-13T15:01:44.808674+0000","last_active":"2024-09-13T15:02:33.737738+0000","last_peered":"2024-09-13T15:02:33.737738+0000","last_clean":"2024-09-13T15:02:33.737738+0000","last_became_active":"2024-09-13T15:01:44.808420+0000","last_became_peered":"2024-09-13T15:01:44.808420+0000","last_unstale":"2024-09-13T15:02:33.737738+0000","last_undegraded":"2024-09-13T15:02:33.737738+0000","last_fullsized":"2024-09-13T15:02:33.737738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:33.447973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.933679+0000","last_change":"2024-09-13T15:01:44.406717+0000","last_active":"2024-09-13T15:04:35.933679+0000","last_peered":"2024-09-13T15:04:35.933679+0000","last_clean":"2024-09-13T15:04:35.933679+0000","last_became_active":"2024-09-13T15:01:44.406354+0000","last_became_peered":"2024-09-13T15:01:44.406354+0000","last_unstale":"2024-09-13T15:04:35.933679+0000","last_undegraded":"2024-09-13T15:04:35.933679+0000","last_fullsized":"2024-09-13T15:04:35.933679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:49.413632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741522+0000","last_change":"2024-09-13T15:01:48.909879+0000","last_active":"2024-09-13T15:02:33.741522+0000","last_peered":"2024-09-13T15:02:33.741522+0000","last_clean":"2024-09-13T15:02:33.741522+0000","last_became_active":"2024-09-13T15:01:48.909494+0000","last_became_peered":"2024-09-13T15:01:48.909494+0000","last_unstale":"2024-09-13T15:02:33.741522+0000","last_undegraded":"2024-09-13T15:02:33.741522+0000","last_fullsized":"2024-09-13T15:02:33.741522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:54.415920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748317+0000","last_change":"2024-09-13T15:01:44.825065+0000","last_active":"2024-09-13T15:02:33.748317+0000","last_peered":"2024-09-13T15:02:33.748317+0000","last_clean":"2024-09-13T15:02:33.748317+0000","last_became_active":"2024-09-13T15:01:44.824392+0000","last_became_peered":"2024-09-13T15:01:44.824392+0000","last_unstale":"2024-09-13T15:02:33.748317+0000","last_undegraded":"2024-09-13T15:02:33.748317+0000","last_fullsized":"2024-09-13T15:02:33.748317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:49.717211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.600924+0000","last_change":"2024-09-13T15:01:44.421119+0000","last_active":"2024-09-13T15:04:17.600924+0000","last_peered":"2024-09-13T15:04:17.600924+0000","last_clean":"2024-09-13T15:04:17.600924+0000","last_became_active":"2024-09-13T15:01:44.419082+0000","last_became_peered":"2024-09-13T15:01:44.419082+0000","last_unstale":"2024-09-13T15:04:17.600924+0000","last_undegraded":"2024-09-13T15:04:17.600924+0000","last_fullsized":"2024-09-13T15:04:17.600924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.011350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749456+0000","last_change":"2024-09-13T15:01:48.856387+0000","last_active":"2024-09-13T15:02:33.749456+0000","last_peered":"2024-09-13T15:02:33.749456+0000","last_clean":"2024-09-13T15:02:33.749456+0000","last_became_active":"2024-09-13T15:01:48.855433+0000","last_became_peered":"2024-09-13T15:01:48.855433+0000","last_unstale":"2024-09-13T15:02:33.749456+0000","last_undegraded":"2024-09-13T15:02:33.749456+0000","last_fullsized":"2024-09-13T15:02:33.749456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:58.309929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744608+0000","last_change":"2024-09-13T15:01:44.807909+0000","last_active":"2024-09-13T15:02:33.744608+0000","last_peered":"2024-09-13T15:02:33.744608+0000","last_clean":"2024-09-13T15:02:33.744608+0000","last_became_active":"2024-09-13T15:01:44.807643+0000","last_became_peered":"2024-09-13T15:01:44.807643+0000","last_unstale":"2024-09-13T15:02:33.744608+0000","last_undegraded":"2024-09-13T15:02:33.744608+0000","last_fullsized":"2024-09-13T15:02:33.744608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:30.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.941454+0000","last_change":"2024-09-13T15:01:44.430200+0000","last_active":"2024-09-13T15:04:35.941454+0000","last_peered":"2024-09-13T15:04:35.941454+0000","last_clean":"2024-09-13T15:04:35.941454+0000","last_became_active":"2024-09-13T15:01:44.429510+0000","last_became_peered":"2024-09-13T15:01:44.429510+0000","last_unstale":"2024-09-13T15:04:35.941454+0000","last_undegraded":"2024-09-13T15:04:35.941454+0000","last_fullsized":"2024-09-13T15:04:35.941454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:52.921485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748075+0000","last_change":"2024-09-13T15:01:48.912116+0000","last_active":"2024-09-13T15:02:33.748075+0000","last_peered":"2024-09-13T15:02:33.748075+0000","last_clean":"2024-09-13T15:02:33.748075+0000","last_became_active":"2024-09-13T15:01:48.911578+0000","last_became_peered":"2024-09-13T15:01:48.911578+0000","last_unstale":"2024-09-13T15:02:33.748075+0000","last_undegraded":"2024-09-13T15:02:33.748075+0000","last_fullsized":"2024-09-13T15:02:33.748075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:50.826715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738926+0000","last_change":"2024-09-13T15:01:44.838344+0000","last_active":"2024-09-13T15:02:33.738926+0000","last_peered":"2024-09-13T15:02:33.738926+0000","last_clean":"2024-09-13T15:02:33.738926+0000","last_became_active":"2024-09-13T15:01:44.838128+0000","last_became_peered":"2024-09-13T15:01:44.838128+0000","last_unstale":"2024-09-13T15:02:33.738926+0000","last_undegraded":"2024-09-13T15:02:33.738926+0000","last_fullsized":"2024-09-13T15:02:33.738926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:09:50.373976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.915192+0000","last_change":"2024-09-13T15:01:44.430749+0000","last_active":"2024-09-13T15:04:29.915192+0000","last_peered":"2024-09-13T15:04:29.915192+0000","last_clean":"2024-09-13T15:04:29.915192+0000","last_became_active":"2024-09-13T15:01:44.430548+0000","last_became_peered":"2024-09-13T15:01:44.430548+0000","last_unstale":"2024-09-13T15:04:29.915192+0000","last_undegraded":"2024-09-13T15:04:29.915192+0000","last_fullsized":"2024-09-13T15:04:29.915192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:30.312447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737398+0000","last_change":"2024-09-13T15:01:48.911224+0000","last_active":"2024-09-13T15:02:33.737398+0000","last_peered":"2024-09-13T15:02:33.737398+0000","last_clean":"2024-09-13T15:02:33.737398+0000","last_became_active":"2024-09-13T15:01:48.910150+0000","last_became_peered":"2024-09-13T15:01:48.910150+0000","last_unstale":"2024-09-13T15:02:33.737398+0000","last_undegraded":"2024-09-13T15:02:33.737398+0000","last_fullsized":"2024-09-13T15:02:33.737398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:41.244267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743138+0000","last_change":"2024-09-13T15:01:44.812200+0000","last_active":"2024-09-13T15:02:33.743138+0000","last_peered":"2024-09-13T15:02:33.743138+0000","last_clean":"2024-09-13T15:02:33.743138+0000","last_became_active":"2024-09-13T15:01:44.811915+0000","last_became_peered":"2024-09-13T15:01:44.811915+0000","last_unstale":"2024-09-13T15:02:33.743138+0000","last_undegraded":"2024-09-13T15:02:33.743138+0000","last_fullsized":"2024-09-13T15:02:33.743138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:07.944520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.917182+0000","last_change":"2024-09-13T15:01:44.423119+0000","last_active":"2024-09-13T15:04:29.917182+0000","last_peered":"2024-09-13T15:04:29.917182+0000","last_clean":"2024-09-13T15:04:29.917182+0000","last_became_active":"2024-09-13T15:01:44.422297+0000","last_became_peered":"2024-09-13T15:01:44.422297+0000","last_unstale":"2024-09-13T15:04:29.917182+0000","last_undegraded":"2024-09-13T15:04:29.917182+0000","last_fullsized":"2024-09-13T15:04:29.917182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:09.798196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743841+0000","last_change":"2024-09-13T15:01:48.908569+0000","last_active":"2024-09-13T15:02:33.743841+0000","last_peered":"2024-09-13T15:02:33.743841+0000","last_clean":"2024-09-13T15:02:33.743841+0000","last_became_active":"2024-09-13T15:01:48.908118+0000","last_became_peered":"2024-09-13T15:01:48.908118+0000","last_unstale":"2024-09-13T15:02:33.743841+0000","last_undegraded":"2024-09-13T15:02:33.743841+0000","last_fullsized":"2024-09-13T15:02:33.743841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:06.459855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743852+0000","last_change":"2024-09-13T15:01:44.850837+0000","last_active":"2024-09-13T15:02:33.743852+0000","last_peered":"2024-09-13T15:02:33.743852+0000","last_clean":"2024-09-13T15:02:33.743852+0000","last_became_active":"2024-09-13T15:01:44.850263+0000","last_became_peered":"2024-09-13T15:01:44.850263+0000","last_unstale":"2024-09-13T15:02:33.743852+0000","last_undegraded":"2024-09-13T15:02:33.743852+0000","last_fullsized":"2024-09-13T15:02:33.743852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:16.956369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:03:48.882165+0000","last_change":"2024-09-13T15:01:44.399163+0000","last_active":"2024-09-13T15:03:48.882165+0000","last_peered":"2024-09-13T15:03:48.882165+0000","last_clean":"2024-09-13T15:03:48.882165+0000","last_became_active":"2024-09-13T15:01:44.398881+0000","last_became_peered":"2024-09-13T15:01:44.398881+0000","last_unstale":"2024-09-13T15:03:48.882165+0000","last_undegraded":"2024-09-13T15:03:48.882165+0000","last_fullsized":"2024-09-13T15:03:48.882165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:49.622676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743584+0000","last_change":"2024-09-13T15:01:48.852798+0000","last_active":"2024-09-13T15:02:33.743584+0000","last_peered":"2024-09-13T15:02:33.743584+0000","last_clean":"2024-09-13T15:02:33.743584+0000","last_became_active":"2024-09-13T15:01:48.851948+0000","last_became_peered":"2024-09-13T15:01:48.851948+0000","last_unstale":"2024-09-13T15:02:33.743584+0000","last_undegraded":"2024-09-13T15:02:33.743584+0000","last_fullsized":"2024-09-13T15:02:33.743584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:20.061043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749414+0000","last_change":"2024-09-13T15:01:44.824074+0000","last_active":"2024-09-13T15:02:33.749414+0000","last_peered":"2024-09-13T15:02:33.749414+0000","last_clean":"2024-09-13T15:02:33.749414+0000","last_became_active":"2024-09-13T15:01:44.821475+0000","last_became_peered":"2024-09-13T15:01:44.821475+0000","last_unstale":"2024-09-13T15:02:33.749414+0000","last_undegraded":"2024-09-13T15:02:33.749414+0000","last_fullsized":"2024-09-13T15:02:33.749414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:21.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.935937+0000","last_change":"2024-09-13T15:01:44.433502+0000","last_active":"2024-09-13T15:04:35.935937+0000","last_peered":"2024-09-13T15:04:35.935937+0000","last_clean":"2024-09-13T15:04:35.935937+0000","last_became_active":"2024-09-13T15:01:44.432902+0000","last_became_peered":"2024-09-13T15:01:44.432902+0000","last_unstale":"2024-09-13T15:04:35.935937+0000","last_undegraded":"2024-09-13T15:04:35.935937+0000","last_fullsized":"2024-09-13T15:04:35.935937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:59.189559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743046+0000","last_change":"2024-09-13T15:01:48.846695+0000","last_active":"2024-09-13T15:02:33.743046+0000","last_peered":"2024-09-13T15:02:33.743046+0000","last_clean":"2024-09-13T15:02:33.743046+0000","last_became_active":"2024-09-13T15:01:48.846301+0000","last_became_peered":"2024-09-13T15:01:48.846301+0000","last_unstale":"2024-09-13T15:02:33.743046+0000","last_undegraded":"2024-09-13T15:02:33.743046+0000","last_fullsized":"2024-09-13T15:02:33.743046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:17.532499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741535+0000","last_change":"2024-09-13T15:01:44.814483+0000","last_active":"2024-09-13T15:02:33.741535+0000","last_peered":"2024-09-13T15:02:33.741535+0000","last_clean":"2024-09-13T15:02:33.741535+0000","last_became_active":"2024-09-13T15:01:44.814192+0000","last_became_peered":"2024-09-13T15:01:44.814192+0000","last_unstale":"2024-09-13T15:02:33.741535+0000","last_undegraded":"2024-09-13T15:02:33.741535+0000","last_fullsized":"2024-09-13T15:02:33.741535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:32:30.303635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:23.881464+0000","last_change":"2024-09-13T15:01:44.399314+0000","last_active":"2024-09-13T15:04:23.881464+0000","last_peered":"2024-09-13T15:04:23.881464+0000","last_clean":"2024-09-13T15:04:23.881464+0000","last_became_active":"2024-09-13T15:01:44.398904+0000","last_became_peered":"2024-09-13T15:01:44.398904+0000","last_unstale":"2024-09-13T15:04:23.881464+0000","last_undegraded":"2024-09-13T15:04:23.881464+0000","last_fullsized":"2024-09-13T15:04:23.881464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.645179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741624+0000","last_change":"2024-09-13T15:01:48.859142+0000","last_active":"2024-09-13T15:02:33.741624+0000","last_peered":"2024-09-13T15:02:33.741624+0000","last_clean":"2024-09-13T15:02:33.741624+0000","last_became_active":"2024-09-13T15:01:48.858649+0000","last_became_peered":"2024-09-13T15:01:48.858649+0000","last_unstale":"2024-09-13T15:02:33.741624+0000","last_undegraded":"2024-09-13T15:02:33.741624+0000","last_fullsized":"2024-09-13T15:02:33.741624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:27.314012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743419+0000","last_change":"2024-09-13T15:01:44.826501+0000","last_active":"2024-09-13T15:02:33.743419+0000","last_peered":"2024-09-13T15:02:33.743419+0000","last_clean":"2024-09-13T15:02:33.743419+0000","last_became_active":"2024-09-13T15:01:44.826222+0000","last_became_peered":"2024-09-13T15:01:44.826222+0000","last_unstale":"2024-09-13T15:02:33.743419+0000","last_undegraded":"2024-09-13T15:02:33.743419+0000","last_fullsized":"2024-09-13T15:02:33.743419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:00.543916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:23.881579+0000","last_change":"2024-09-13T15:01:44.421891+0000","last_active":"2024-09-13T15:04:23.881579+0000","last_peered":"2024-09-13T15:04:23.881579+0000","last_clean":"2024-09-13T15:04:23.881579+0000","last_became_active":"2024-09-13T15:01:44.419660+0000","last_became_peered":"2024-09-13T15:01:44.419660+0000","last_unstale":"2024-09-13T15:04:23.881579+0000","last_undegraded":"2024-09-13T15:04:23.881579+0000","last_fullsized":"2024-09-13T15:04:23.881579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:27.554128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.120816+0000","last_change":"2024-09-13T15:02:34.119111+0000","last_active":"2024-09-13T15:02:34.120816+0000","last_peered":"2024-09-13T15:02:34.120816+0000","last_clean":"2024-09-13T15:02:34.120816+0000","last_became_active":"2024-09-13T15:02:34.118461+0000","last_became_peered":"2024-09-13T15:02:34.118461+0000","last_unstale":"2024-09-13T15:02:34.120816+0000","last_undegraded":"2024-09-13T15:02:34.120816+0000","last_fullsized":"2024-09-13T15:02:34.120816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:35.096846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738701+0000","last_change":"2024-09-13T15:01:44.850498+0000","last_active":"2024-09-13T15:02:33.738701+0000","last_peered":"2024-09-13T15:02:33.738701+0000","last_clean":"2024-09-13T15:02:33.738701+0000","last_became_active":"2024-09-13T15:01:44.850234+0000","last_became_peered":"2024-09-13T15:01:44.850234+0000","last_unstale":"2024-09-13T15:02:33.738701+0000","last_undegraded":"2024-09-13T15:02:33.738701+0000","last_fullsized":"2024-09-13T15:02:33.738701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:37.202494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.912171+0000","last_change":"2024-09-13T15:01:44.411997+0000","last_active":"2024-09-13T15:04:29.912171+0000","last_peered":"2024-09-13T15:04:29.912171+0000","last_clean":"2024-09-13T15:04:29.912171+0000","last_became_active":"2024-09-13T15:01:44.410675+0000","last_became_peered":"2024-09-13T15:01:44.410675+0000","last_unstale":"2024-09-13T15:04:29.912171+0000","last_undegraded":"2024-09-13T15:04:29.912171+0000","last_fullsized":"2024-09-13T15:04:29.912171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:50:55.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116345+0000","last_change":"2024-09-13T15:01:40.834440+0000","last_active":"2024-09-13T15:02:34.116345+0000","last_peered":"2024-09-13T15:02:34.116345+0000","last_clean":"2024-09-13T15:02:34.116345+0000","last_became_active":"2024-09-13T15:01:40.832279+0000","last_became_peered":"2024-09-13T15:01:40.832279+0000","last_unstale":"2024-09-13T15:02:34.116345+0000","last_undegraded":"2024-09-13T15:02:34.116345+0000","last_fullsized":"2024-09-13T15:02:34.116345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_clean_scrub_stamp":"2024-09-13T15:01:39.264455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:11.875506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743545+0000","last_change":"2024-09-13T15:01:48.919580+0000","last_active":"2024-09-13T15:02:33.743545+0000","last_peered":"2024-09-13T15:02:33.743545+0000","last_clean":"2024-09-13T15:02:33.743545+0000","last_became_active":"2024-09-13T15:01:48.918678+0000","last_became_peered":"2024-09-13T15:01:48.918678+0000","last_unstale":"2024-09-13T15:02:33.743545+0000","last_undegraded":"2024-09-13T15:02:33.743545+0000","last_fullsized":"2024-09-13T15:02:33.743545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:02.840528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116879+0000","last_change":"2024-09-13T15:01:44.849975+0000","last_active":"2024-09-13T15:02:34.116879+0000","last_peered":"2024-09-13T15:02:34.116879+0000","last_clean":"2024-09-13T15:02:34.116879+0000","last_became_active":"2024-09-13T15:01:44.849457+0000","last_became_peered":"2024-09-13T15:01:44.849457+0000","last_unstale":"2024-09-13T15:02:34.116879+0000","last_undegraded":"2024-09-13T15:02:34.116879+0000","last_fullsized":"2024-09-13T15:02:34.116879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:51.139153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.913440+0000","last_change":"2024-09-13T15:01:44.420906+0000","last_active":"2024-09-13T15:04:29.913440+0000","last_peered":"2024-09-13T15:04:29.913440+0000","last_clean":"2024-09-13T15:04:29.913440+0000","last_became_active":"2024-09-13T15:01:44.420601+0000","last_became_peered":"2024-09-13T15:01:44.420601+0000","last_unstale":"2024-09-13T15:04:29.913440+0000","last_undegraded":"2024-09-13T15:04:29.913440+0000","last_fullsized":"2024-09-13T15:04:29.913440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:33.245745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741847+0000","last_change":"2024-09-13T15:01:48.911047+0000","last_active":"2024-09-13T15:02:33.741847+0000","last_peered":"2024-09-13T15:02:33.741847+0000","last_clean":"2024-09-13T15:02:33.741847+0000","last_became_active":"2024-09-13T15:01:48.910479+0000","last_became_peered":"2024-09-13T15:01:48.910479+0000","last_unstale":"2024-09-13T15:02:33.741847+0000","last_undegraded":"2024-09-13T15:02:33.741847+0000","last_fullsized":"2024-09-13T15:02:33.741847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:06.558889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745346+0000","last_change":"2024-09-13T15:01:44.838098+0000","last_active":"2024-09-13T15:02:33.745346+0000","last_peered":"2024-09-13T15:02:33.745346+0000","last_clean":"2024-09-13T15:02:33.745346+0000","last_became_active":"2024-09-13T15:01:44.837429+0000","last_became_peered":"2024-09-13T15:01:44.837429+0000","last_unstale":"2024-09-13T15:02:33.745346+0000","last_undegraded":"2024-09-13T15:02:33.745346+0000","last_fullsized":"2024-09-13T15:02:33.745346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:37.795841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.913130+0000","last_change":"2024-09-13T15:01:44.406999+0000","last_active":"2024-09-13T15:04:29.913130+0000","last_peered":"2024-09-13T15:04:29.913130+0000","last_clean":"2024-09-13T15:04:29.913130+0000","last_became_active":"2024-09-13T15:01:44.406719+0000","last_became_peered":"2024-09-13T15:01:44.406719+0000","last_unstale":"2024-09-13T15:04:29.913130+0000","last_undegraded":"2024-09-13T15:04:29.913130+0000","last_fullsized":"2024-09-13T15:04:29.913130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:33.397091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743939+0000","last_change":"2024-09-13T15:01:48.857931+0000","last_active":"2024-09-13T15:02:33.743939+0000","last_peered":"2024-09-13T15:02:33.743939+0000","last_clean":"2024-09-13T15:02:33.743939+0000","last_became_active":"2024-09-13T15:01:48.857542+0000","last_became_peered":"2024-09-13T15:01:48.857542+0000","last_unstale":"2024-09-13T15:02:33.743939+0000","last_undegraded":"2024-09-13T15:02:33.743939+0000","last_fullsized":"2024-09-13T15:02:33.743939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:32.805405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118403+0000","last_change":"2024-09-13T15:01:44.835470+0000","last_active":"2024-09-13T15:02:34.118403+0000","last_peered":"2024-09-13T15:02:34.118403+0000","last_clean":"2024-09-13T15:02:34.118403+0000","last_became_active":"2024-09-13T15:01:44.831166+0000","last_became_peered":"2024-09-13T15:01:44.831166+0000","last_unstale":"2024-09-13T15:02:34.118403+0000","last_undegraded":"2024-09-13T15:02:34.118403+0000","last_fullsized":"2024-09-13T15:02:34.118403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:05.887592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.929024+0000","last_change":"2024-09-13T15:01:44.403111+0000","last_active":"2024-09-13T15:04:35.929024+0000","last_peered":"2024-09-13T15:04:35.929024+0000","last_clean":"2024-09-13T15:04:35.929024+0000","last_became_active":"2024-09-13T15:01:44.401799+0000","last_became_peered":"2024-09-13T15:01:44.401799+0000","last_unstale":"2024-09-13T15:04:35.929024+0000","last_undegraded":"2024-09-13T15:04:35.929024+0000","last_fullsized":"2024-09-13T15:04:35.929024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:54.589470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740292+0000","last_change":"2024-09-13T15:01:48.912490+0000","last_active":"2024-09-13T15:02:33.740292+0000","last_peered":"2024-09-13T15:02:33.740292+0000","last_clean":"2024-09-13T15:02:33.740292+0000","last_became_active":"2024-09-13T15:01:48.911474+0000","last_became_peered":"2024-09-13T15:01:48.911474+0000","last_unstale":"2024-09-13T15:02:33.740292+0000","last_undegraded":"2024-09-13T15:02:33.740292+0000","last_fullsized":"2024-09-13T15:02:33.740292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:54.295921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117960+0000","last_change":"2024-09-13T15:01:44.818472+0000","last_active":"2024-09-13T15:02:34.117960+0000","last_peered":"2024-09-13T15:02:34.117960+0000","last_clean":"2024-09-13T15:02:34.117960+0000","last_became_active":"2024-09-13T15:01:44.817718+0000","last_became_peered":"2024-09-13T15:01:44.817718+0000","last_unstale":"2024-09-13T15:02:34.117960+0000","last_undegraded":"2024-09-13T15:02:34.117960+0000","last_fullsized":"2024-09-13T15:02:34.117960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:21.310696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:03:58.897497+0000","last_change":"2024-09-13T15:01:44.410376+0000","last_active":"2024-09-13T15:03:58.897497+0000","last_peered":"2024-09-13T15:03:58.897497+0000","last_clean":"2024-09-13T15:03:58.897497+0000","last_became_active":"2024-09-13T15:01:44.409585+0000","last_became_peered":"2024-09-13T15:01:44.409585+0000","last_unstale":"2024-09-13T15:03:58.897497+0000","last_undegraded":"2024-09-13T15:03:58.897497+0000","last_fullsized":"2024-09-13T15:03:58.897497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:45.845804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.747358+0000","last_change":"2024-09-13T15:01:48.861130+0000","last_active":"2024-09-13T15:02:33.747358+0000","last_peered":"2024-09-13T15:02:33.747358+0000","last_clean":"2024-09-13T15:02:33.747358+0000","last_became_active":"2024-09-13T15:01:48.860317+0000","last_became_peered":"2024-09-13T15:01:48.860317+0000","last_unstale":"2024-09-13T15:02:33.747358+0000","last_undegraded":"2024-09-13T15:02:33.747358+0000","last_fullsized":"2024-09-13T15:02:33.747358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:45.317747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116786+0000","last_change":"2024-09-13T15:01:44.835494+0000","last_active":"2024-09-13T15:02:34.116786+0000","last_peered":"2024-09-13T15:02:34.116786+0000","last_clean":"2024-09-13T15:02:34.116786+0000","last_became_active":"2024-09-13T15:01:44.831150+0000","last_became_peered":"2024-09-13T15:01:44.831150+0000","last_unstale":"2024-09-13T15:02:34.116786+0000","last_undegraded":"2024-09-13T15:02:34.116786+0000","last_fullsized":"2024-09-13T15:02:34.116786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:29.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.912072+0000","last_change":"2024-09-13T15:01:44.390278+0000","last_active":"2024-09-13T15:04:29.912072+0000","last_peered":"2024-09-13T15:04:29.912072+0000","last_clean":"2024-09-13T15:04:29.912072+0000","last_became_active":"2024-09-13T15:01:44.389946+0000","last_became_peered":"2024-09-13T15:01:44.389946+0000","last_unstale":"2024-09-13T15:04:29.912072+0000","last_undegraded":"2024-09-13T15:04:29.912072+0000","last_fullsized":"2024-09-13T15:04:29.912072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:53.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744367+0000","last_change":"2024-09-13T15:01:48.848009+0000","last_active":"2024-09-13T15:02:33.744367+0000","last_peered":"2024-09-13T15:02:33.744367+0000","last_clean":"2024-09-13T15:02:33.744367+0000","last_became_active":"2024-09-13T15:01:48.847605+0000","last_became_peered":"2024-09-13T15:01:48.847605+0000","last_unstale":"2024-09-13T15:02:33.744367+0000","last_undegraded":"2024-09-13T15:02:33.744367+0000","last_fullsized":"2024-09-13T15:02:33.744367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:32.053010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741353+0000","last_change":"2024-09-13T15:01:44.808572+0000","last_active":"2024-09-13T15:02:33.741353+0000","last_peered":"2024-09-13T15:02:33.741353+0000","last_clean":"2024-09-13T15:02:33.741353+0000","last_became_active":"2024-09-13T15:01:44.808140+0000","last_became_peered":"2024-09-13T15:01:44.808140+0000","last_unstale":"2024-09-13T15:02:33.741353+0000","last_undegraded":"2024-09-13T15:02:33.741353+0000","last_fullsized":"2024-09-13T15:02:33.741353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:15.497720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.918281+0000","last_change":"2024-09-13T15:01:44.428794+0000","last_active":"2024-09-13T15:04:29.918281+0000","last_peered":"2024-09-13T15:04:29.918281+0000","last_clean":"2024-09-13T15:04:29.918281+0000","last_became_active":"2024-09-13T15:01:44.428271+0000","last_became_peered":"2024-09-13T15:01:44.428271+0000","last_unstale":"2024-09-13T15:04:29.918281+0000","last_undegraded":"2024-09-13T15:04:29.918281+0000","last_fullsized":"2024-09-13T15:04:29.918281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:53.225826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738469+0000","last_change":"2024-09-13T15:01:48.916354+0000","last_active":"2024-09-13T15:02:33.738469+0000","last_peered":"2024-09-13T15:02:33.738469+0000","last_clean":"2024-09-13T15:02:33.738469+0000","last_became_active":"2024-09-13T15:01:48.916008+0000","last_became_peered":"2024-09-13T15:01:48.916008+0000","last_unstale":"2024-09-13T15:02:33.738469+0000","last_undegraded":"2024-09-13T15:02:33.738469+0000","last_fullsized":"2024-09-13T15:02:33.738469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:58.115410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116589+0000","last_change":"2024-09-13T15:01:44.826700+0000","last_active":"2024-09-13T15:02:34.116589+0000","last_peered":"2024-09-13T15:02:34.116589+0000","last_clean":"2024-09-13T15:02:34.116589+0000","last_became_active":"2024-09-13T15:01:44.825996+0000","last_became_peered":"2024-09-13T15:01:44.825996+0000","last_unstale":"2024-09-13T15:02:34.116589+0000","last_undegraded":"2024-09-13T15:02:34.116589+0000","last_fullsized":"2024-09-13T15:02:34.116589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:11.963837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.912045+0000","last_change":"2024-09-13T15:01:44.409339+0000","last_active":"2024-09-13T15:04:29.912045+0000","last_peered":"2024-09-13T15:04:29.912045+0000","last_clean":"2024-09-13T15:04:29.912045+0000","last_became_active":"2024-09-13T15:01:44.408644+0000","last_became_peered":"2024-09-13T15:01:44.408644+0000","last_unstale":"2024-09-13T15:04:29.912045+0000","last_undegraded":"2024-09-13T15:04:29.912045+0000","last_fullsized":"2024-09-13T15:04:29.912045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:29.297950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737959+0000","last_change":"2024-09-13T15:01:48.916478+0000","last_active":"2024-09-13T15:02:33.737959+0000","last_peered":"2024-09-13T15:02:33.737959+0000","last_clean":"2024-09-13T15:02:33.737959+0000","last_became_active":"2024-09-13T15:01:48.916198+0000","last_became_peered":"2024-09-13T15:01:48.916198+0000","last_unstale":"2024-09-13T15:02:33.737959+0000","last_undegraded":"2024-09-13T15:02:33.737959+0000","last_fullsized":"2024-09-13T15:02:33.737959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:26.311460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743617+0000","last_change":"2024-09-13T15:01:44.831833+0000","last_active":"2024-09-13T15:02:33.743617+0000","last_peered":"2024-09-13T15:02:33.743617+0000","last_clean":"2024-09-13T15:02:33.743617+0000","last_became_active":"2024-09-13T15:01:44.831583+0000","last_became_peered":"2024-09-13T15:01:44.831583+0000","last_unstale":"2024-09-13T15:02:33.743617+0000","last_undegraded":"2024-09-13T15:02:33.743617+0000","last_fullsized":"2024-09-13T15:02:33.743617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.715951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.931315+0000","last_change":"2024-09-13T15:01:44.408752+0000","last_active":"2024-09-13T15:04:35.931315+0000","last_peered":"2024-09-13T15:04:35.931315+0000","last_clean":"2024-09-13T15:04:35.931315+0000","last_became_active":"2024-09-13T15:01:44.408453+0000","last_became_peered":"2024-09-13T15:01:44.408453+0000","last_unstale":"2024-09-13T15:04:35.931315+0000","last_undegraded":"2024-09-13T15:04:35.931315+0000","last_fullsized":"2024-09-13T15:04:35.931315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:31.587404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743419+0000","last_change":"2024-09-13T15:01:48.916681+0000","last_active":"2024-09-13T15:02:33.743419+0000","last_peered":"2024-09-13T15:02:33.743419+0000","last_clean":"2024-09-13T15:02:33.743419+0000","last_became_active":"2024-09-13T15:01:48.916185+0000","last_became_peered":"2024-09-13T15:01:48.916185+0000","last_unstale":"2024-09-13T15:02:33.743419+0000","last_undegraded":"2024-09-13T15:02:33.743419+0000","last_fullsized":"2024-09-13T15:02:33.743419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:33.862835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116757+0000","last_change":"2024-09-13T15:01:44.817007+0000","last_active":"2024-09-13T15:02:34.116757+0000","last_peered":"2024-09-13T15:02:34.116757+0000","last_clean":"2024-09-13T15:02:34.116757+0000","last_became_active":"2024-09-13T15:01:44.815435+0000","last_became_peered":"2024-09-13T15:01:44.815435+0000","last_unstale":"2024-09-13T15:02:34.116757+0000","last_undegraded":"2024-09-13T15:02:34.116757+0000","last_fullsized":"2024-09-13T15:02:34.116757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:25.887993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'14","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.939792+0000","last_change":"2024-09-13T15:01:44.435688+0000","last_active":"2024-09-13T15:04:35.939792+0000","last_peered":"2024-09-13T15:04:35.939792+0000","last_clean":"2024-09-13T15:04:35.939792+0000","last_became_active":"2024-09-13T15:01:44.435222+0000","last_became_peered":"2024-09-13T15:01:44.435222+0000","last_unstale":"2024-09-13T15:04:35.939792+0000","last_undegraded":"2024-09-13T15:04:35.939792+0000","last_fullsized":"2024-09-13T15:04:35.939792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:24.705633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742810+0000","last_change":"2024-09-13T15:01:48.847694+0000","last_active":"2024-09-13T15:02:33.742810+0000","last_peered":"2024-09-13T15:02:33.742810+0000","last_clean":"2024-09-13T15:02:33.742810+0000","last_became_active":"2024-09-13T15:01:48.846835+0000","last_became_peered":"2024-09-13T15:01:48.846835+0000","last_unstale":"2024-09-13T15:02:33.742810+0000","last_undegraded":"2024-09-13T15:02:33.742810+0000","last_fullsized":"2024-09-13T15:02:33.742810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:49.763472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749658+0000","last_change":"2024-09-13T15:01:44.835315+0000","last_active":"2024-09-13T15:02:33.749658+0000","last_peered":"2024-09-13T15:02:33.749658+0000","last_clean":"2024-09-13T15:02:33.749658+0000","last_became_active":"2024-09-13T15:01:44.834643+0000","last_became_peered":"2024-09-13T15:01:44.834643+0000","last_unstale":"2024-09-13T15:02:33.749658+0000","last_undegraded":"2024-09-13T15:02:33.749658+0000","last_fullsized":"2024-09-13T15:02:33.749658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:15.535195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.609255+0000","last_change":"2024-09-13T15:01:44.424966+0000","last_active":"2024-09-13T15:04:17.609255+0000","last_peered":"2024-09-13T15:04:17.609255+0000","last_clean":"2024-09-13T15:04:17.609255+0000","last_became_active":"2024-09-13T15:01:44.424714+0000","last_became_peered":"2024-09-13T15:01:44.424714+0000","last_unstale":"2024-09-13T15:04:17.609255+0000","last_undegraded":"2024-09-13T15:04:17.609255+0000","last_fullsized":"2024-09-13T15:04:17.609255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:46.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.756425+0000","last_change":"2024-09-13T15:02:33.753482+0000","last_active":"2024-09-13T15:02:33.756425+0000","last_peered":"2024-09-13T15:02:33.756425+0000","last_clean":"2024-09-13T15:02:33.756425+0000","last_became_active":"2024-09-13T15:02:33.752505+0000","last_became_peered":"2024-09-13T15:02:33.752505+0000","last_unstale":"2024-09-13T15:02:33.756425+0000","last_undegraded":"2024-09-13T15:02:33.756425+0000","last_fullsized":"2024-09-13T15:02:33.756425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:59.041586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742572+0000","last_change":"2024-09-13T15:01:44.837032+0000","last_active":"2024-09-13T15:02:33.742572+0000","last_peered":"2024-09-13T15:02:33.742572+0000","last_clean":"2024-09-13T15:02:33.742572+0000","last_became_active":"2024-09-13T15:01:44.836750+0000","last_became_peered":"2024-09-13T15:01:44.836750+0000","last_unstale":"2024-09-13T15:02:33.742572+0000","last_undegraded":"2024-09-13T15:02:33.742572+0000","last_fullsized":"2024-09-13T15:02:33.742572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:04.491426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.938284+0000","last_change":"2024-09-13T15:01:44.437854+0000","last_active":"2024-09-13T15:04:35.938284+0000","last_peered":"2024-09-13T15:04:35.938284+0000","last_clean":"2024-09-13T15:04:35.938284+0000","last_became_active":"2024-09-13T15:01:44.437433+0000","last_became_peered":"2024-09-13T15:01:44.437433+0000","last_unstale":"2024-09-13T15:04:35.938284+0000","last_undegraded":"2024-09-13T15:04:35.938284+0000","last_fullsized":"2024-09-13T15:04:35.938284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:47.302388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737553+0000","last_change":"2024-09-13T15:01:48.841829+0000","last_active":"2024-09-13T15:02:33.737553+0000","last_peered":"2024-09-13T15:02:33.737553+0000","last_clean":"2024-09-13T15:02:33.737553+0000","last_became_active":"2024-09-13T15:01:48.841267+0000","last_became_peered":"2024-09-13T15:01:48.841267+0000","last_unstale":"2024-09-13T15:02:33.737553+0000","last_undegraded":"2024-09-13T15:02:33.737553+0000","last_fullsized":"2024-09-13T15:02:33.737553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:25.029615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.746815+0000","last_change":"2024-09-13T15:01:44.844701+0000","last_active":"2024-09-13T15:02:33.746815+0000","last_peered":"2024-09-13T15:02:33.746815+0000","last_clean":"2024-09-13T15:02:33.746815+0000","last_became_active":"2024-09-13T15:01:44.843982+0000","last_became_peered":"2024-09-13T15:01:44.843982+0000","last_unstale":"2024-09-13T15:02:33.746815+0000","last_undegraded":"2024-09-13T15:02:33.746815+0000","last_fullsized":"2024-09-13T15:02:33.746815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.602105+0000","last_change":"2024-09-13T15:01:44.436081+0000","last_active":"2024-09-13T15:04:17.602105+0000","last_peered":"2024-09-13T15:04:17.602105+0000","last_clean":"2024-09-13T15:04:17.602105+0000","last_became_active":"2024-09-13T15:01:44.435367+0000","last_became_peered":"2024-09-13T15:01:44.435367+0000","last_unstale":"2024-09-13T15:04:17.602105+0000","last_undegraded":"2024-09-13T15:04:17.602105+0000","last_fullsized":"2024-09-13T15:04:17.602105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:57:57.065719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737590+0000","last_change":"2024-09-13T15:01:48.910562+0000","last_active":"2024-09-13T15:02:33.737590+0000","last_peered":"2024-09-13T15:02:33.737590+0000","last_clean":"2024-09-13T15:02:33.737590+0000","last_became_active":"2024-09-13T15:01:48.909681+0000","last_became_peered":"2024-09-13T15:01:48.909681+0000","last_unstale":"2024-09-13T15:02:33.737590+0000","last_undegraded":"2024-09-13T15:02:33.737590+0000","last_fullsized":"2024-09-13T15:02:33.737590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:35.989769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.120759+0000","last_change":"2024-09-13T15:02:34.118951+0000","last_active":"2024-09-13T15:02:34.120759+0000","last_peered":"2024-09-13T15:02:34.120759+0000","last_clean":"2024-09-13T15:02:34.120759+0000","last_became_active":"2024-09-13T15:02:34.118477+0000","last_became_peered":"2024-09-13T15:02:34.118477+0000","last_unstale":"2024-09-13T15:02:34.120759+0000","last_undegraded":"2024-09-13T15:02:34.120759+0000","last_fullsized":"2024-09-13T15:02:34.120759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:13.697114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741807+0000","last_change":"2024-09-13T15:01:44.808417+0000","last_active":"2024-09-13T15:02:33.741807+0000","last_peered":"2024-09-13T15:02:33.741807+0000","last_clean":"2024-09-13T15:02:33.741807+0000","last_became_active":"2024-09-13T15:01:44.807641+0000","last_became_peered":"2024-09-13T15:01:44.807641+0000","last_unstale":"2024-09-13T15:02:33.741807+0000","last_undegraded":"2024-09-13T15:02:33.741807+0000","last_fullsized":"2024-09-13T15:02:33.741807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:58.296966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.912543+0000","last_change":"2024-09-13T15:01:44.433582+0000","last_active":"2024-09-13T15:04:29.912543+0000","last_peered":"2024-09-13T15:04:29.912543+0000","last_clean":"2024-09-13T15:04:29.912543+0000","last_became_active":"2024-09-13T15:01:44.433124+0000","last_became_peered":"2024-09-13T15:01:44.433124+0000","last_unstale":"2024-09-13T15:04:29.912543+0000","last_undegraded":"2024-09-13T15:04:29.912543+0000","last_fullsized":"2024-09-13T15:04:29.912543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:04.476996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744178+0000","last_change":"2024-09-13T15:01:48.855090+0000","last_active":"2024-09-13T15:02:33.744178+0000","last_peered":"2024-09-13T15:02:33.744178+0000","last_clean":"2024-09-13T15:02:33.744178+0000","last_became_active":"2024-09-13T15:01:48.852925+0000","last_became_peered":"2024-09-13T15:01:48.852925+0000","last_unstale":"2024-09-13T15:02:33.744178+0000","last_undegraded":"2024-09-13T15:02:33.744178+0000","last_fullsized":"2024-09-13T15:02:33.744178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.176480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748607+0000","last_change":"2024-09-13T15:02:33.746356+0000","last_active":"2024-09-13T15:02:33.748607+0000","last_peered":"2024-09-13T15:02:33.748607+0000","last_clean":"2024-09-13T15:02:33.748607+0000","last_became_active":"2024-09-13T15:02:33.746005+0000","last_became_peered":"2024-09-13T15:02:33.746005+0000","last_unstale":"2024-09-13T15:02:33.748607+0000","last_undegraded":"2024-09-13T15:02:33.748607+0000","last_fullsized":"2024-09-13T15:02:33.748607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:41.159781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:23.881944+0000","last_change":"2024-09-13T15:01:44.436900+0000","last_active":"2024-09-13T15:04:23.881944+0000","last_peered":"2024-09-13T15:04:23.881944+0000","last_clean":"2024-09-13T15:04:23.881944+0000","last_became_active":"2024-09-13T15:01:44.436646+0000","last_became_peered":"2024-09-13T15:01:44.436646+0000","last_unstale":"2024-09-13T15:04:23.881944+0000","last_undegraded":"2024-09-13T15:04:23.881944+0000","last_fullsized":"2024-09-13T15:04:23.881944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:52.505856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.920613+0000","last_change":"2024-09-13T15:01:44.430115+0000","last_active":"2024-09-13T15:04:29.920613+0000","last_peered":"2024-09-13T15:04:29.920613+0000","last_clean":"2024-09-13T15:04:29.920613+0000","last_became_active":"2024-09-13T15:01:44.429339+0000","last_became_peered":"2024-09-13T15:01:44.429339+0000","last_unstale":"2024-09-13T15:04:29.920613+0000","last_undegraded":"2024-09-13T15:04:29.920613+0000","last_fullsized":"2024-09-13T15:04:29.920613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:47.224125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744095+0000","last_change":"2024-09-13T15:01:44.822034+0000","last_active":"2024-09-13T15:02:33.744095+0000","last_peered":"2024-09-13T15:02:33.744095+0000","last_clean":"2024-09-13T15:02:33.744095+0000","last_became_active":"2024-09-13T15:01:44.821734+0000","last_became_peered":"2024-09-13T15:01:44.821734+0000","last_unstale":"2024-09-13T15:02:33.744095+0000","last_undegraded":"2024-09-13T15:02:33.744095+0000","last_fullsized":"2024-09-13T15:02:33.744095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:57:44.629046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741811+0000","last_change":"2024-09-13T15:01:48.858033+0000","last_active":"2024-09-13T15:02:33.741811+0000","last_peered":"2024-09-13T15:02:33.741811+0000","last_clean":"2024-09-13T15:02:33.741811+0000","last_became_active":"2024-09-13T15:01:48.857584+0000","last_became_peered":"2024-09-13T15:01:48.857584+0000","last_unstale":"2024-09-13T15:02:33.741811+0000","last_undegraded":"2024-09-13T15:02:33.741811+0000","last_fullsized":"2024-09-13T15:02:33.741811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:04.797167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'5","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.610821+0000","last_change":"2024-09-13T15:01:44.422582+0000","last_active":"2024-09-13T15:04:17.610821+0000","last_peered":"2024-09-13T15:04:17.610821+0000","last_clean":"2024-09-13T15:04:17.610821+0000","last_became_active":"2024-09-13T15:01:44.422367+0000","last_became_peered":"2024-09-13T15:01:44.422367+0000","last_unstale":"2024-09-13T15:04:17.610821+0000","last_undegraded":"2024-09-13T15:04:17.610821+0000","last_fullsized":"2024-09-13T15:04:17.610821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.902724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748800+0000","last_change":"2024-09-13T15:01:44.820841+0000","last_active":"2024-09-13T15:02:33.748800+0000","last_peered":"2024-09-13T15:02:33.748800+0000","last_clean":"2024-09-13T15:02:33.748800+0000","last_became_active":"2024-09-13T15:01:44.816584+0000","last_became_peered":"2024-09-13T15:01:44.816584+0000","last_unstale":"2024-09-13T15:02:33.748800+0000","last_undegraded":"2024-09-13T15:02:33.748800+0000","last_fullsized":"2024-09-13T15:02:33.748800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:26.763818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738483+0000","last_change":"2024-09-13T15:01:48.840771+0000","last_active":"2024-09-13T15:02:33.738483+0000","last_peered":"2024-09-13T15:02:33.738483+0000","last_clean":"2024-09-13T15:02:33.738483+0000","last_became_active":"2024-09-13T15:01:48.840397+0000","last_became_peered":"2024-09-13T15:01:48.840397+0000","last_unstale":"2024-09-13T15:02:33.738483+0000","last_undegraded":"2024-09-13T15:02:33.738483+0000","last_fullsized":"2024-09-13T15:02:33.738483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:59.700088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741113+0000","last_change":"2024-09-13T15:01:44.809497+0000","last_active":"2024-09-13T15:02:33.741113+0000","last_peered":"2024-09-13T15:02:33.741113+0000","last_clean":"2024-09-13T15:02:33.741113+0000","last_became_active":"2024-09-13T15:01:44.808669+0000","last_became_peered":"2024-09-13T15:01:44.808669+0000","last_unstale":"2024-09-13T15:02:33.741113+0000","last_undegraded":"2024-09-13T15:02:33.741113+0000","last_fullsized":"2024-09-13T15:02:33.741113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:45.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744117+0000","last_change":"2024-09-13T15:01:44.836353+0000","last_active":"2024-09-13T15:02:33.744117+0000","last_peered":"2024-09-13T15:02:33.744117+0000","last_clean":"2024-09-13T15:02:33.744117+0000","last_became_active":"2024-09-13T15:01:44.836102+0000","last_became_peered":"2024-09-13T15:01:44.836102+0000","last_unstale":"2024-09-13T15:02:33.744117+0000","last_undegraded":"2024-09-13T15:02:33.744117+0000","last_fullsized":"2024-09-13T15:02:33.744117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:14.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741973+0000","last_change":"2024-09-13T15:01:44.849091+0000","last_active":"2024-09-13T15:02:33.741973+0000","last_peered":"2024-09-13T15:02:33.741973+0000","last_clean":"2024-09-13T15:02:33.741973+0000","last_became_active":"2024-09-13T15:01:44.846506+0000","last_became_peered":"2024-09-13T15:01:44.846506+0000","last_unstale":"2024-09-13T15:02:33.741973+0000","last_undegraded":"2024-09-13T15:02:33.741973+0000","last_fullsized":"2024-09-13T15:02:33.741973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:38.026998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743939+0000","last_change":"2024-09-13T15:01:44.809873+0000","last_active":"2024-09-13T15:02:33.743939+0000","last_peered":"2024-09-13T15:02:33.743939+0000","last_clean":"2024-09-13T15:02:33.743939+0000","last_became_active":"2024-09-13T15:01:44.809585+0000","last_became_peered":"2024-09-13T15:01:44.809585+0000","last_unstale":"2024-09-13T15:02:33.743939+0000","last_undegraded":"2024-09-13T15:02:33.743939+0000","last_fullsized":"2024-09-13T15:02:33.743939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:20.272320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738378+0000","last_change":"2024-09-13T15:01:44.816761+0000","last_active":"2024-09-13T15:02:33.738378+0000","last_peered":"2024-09-13T15:02:33.738378+0000","last_clean":"2024-09-13T15:02:33.738378+0000","last_became_active":"2024-09-13T15:01:44.816480+0000","last_became_peered":"2024-09-13T15:01:44.816480+0000","last_unstale":"2024-09-13T15:02:33.738378+0000","last_undegraded":"2024-09-13T15:02:33.738378+0000","last_fullsized":"2024-09-13T15:02:33.738378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:46.000440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742115+0000","last_change":"2024-09-13T15:01:44.808373+0000","last_active":"2024-09-13T15:02:33.742115+0000","last_peered":"2024-09-13T15:02:33.742115+0000","last_clean":"2024-09-13T15:02:33.742115+0000","last_became_active":"2024-09-13T15:01:44.807622+0000","last_became_peered":"2024-09-13T15:01:44.807622+0000","last_unstale":"2024-09-13T15:02:33.742115+0000","last_undegraded":"2024-09-13T15:02:33.742115+0000","last_fullsized":"2024-09-13T15:02:33.742115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:38.584426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745064+0000","last_change":"2024-09-13T15:01:44.832521+0000","last_active":"2024-09-13T15:02:33.745064+0000","last_peered":"2024-09-13T15:02:33.745064+0000","last_clean":"2024-09-13T15:02:33.745064+0000","last_became_active":"2024-09-13T15:01:44.831889+0000","last_became_peered":"2024-09-13T15:01:44.831889+0000","last_unstale":"2024-09-13T15:02:33.745064+0000","last_undegraded":"2024-09-13T15:02:33.745064+0000","last_fullsized":"2024-09-13T15:02:33.745064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:07.563684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738576+0000","last_change":"2024-09-13T15:01:44.817583+0000","last_active":"2024-09-13T15:02:33.738576+0000","last_peered":"2024-09-13T15:02:33.738576+0000","last_clean":"2024-09-13T15:02:33.738576+0000","last_became_active":"2024-09-13T15:01:44.817350+0000","last_became_peered":"2024-09-13T15:01:44.817350+0000","last_unstale":"2024-09-13T15:02:33.738576+0000","last_undegraded":"2024-09-13T15:02:33.738576+0000","last_fullsized":"2024-09-13T15:02:33.738576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:10.913776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740529+0000","last_change":"2024-09-13T15:01:44.838372+0000","last_active":"2024-09-13T15:02:33.740529+0000","last_peered":"2024-09-13T15:02:33.740529+0000","last_clean":"2024-09-13T15:02:33.740529+0000","last_became_active":"2024-09-13T15:01:44.837588+0000","last_became_peered":"2024-09-13T15:01:44.837588+0000","last_unstale":"2024-09-13T15:02:33.740529+0000","last_undegraded":"2024-09-13T15:02:33.740529+0000","last_fullsized":"2024-09-13T15:02:33.740529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:05:12.877936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737718+0000","last_change":"2024-09-13T15:01:44.828159+0000","last_active":"2024-09-13T15:02:33.737718+0000","last_peered":"2024-09-13T15:02:33.737718+0000","last_clean":"2024-09-13T15:02:33.737718+0000","last_became_active":"2024-09-13T15:01:44.827910+0000","last_became_peered":"2024-09-13T15:01:44.827910+0000","last_unstale":"2024-09-13T15:02:33.737718+0000","last_undegraded":"2024-09-13T15:02:33.737718+0000","last_fullsized":"2024-09-13T15:02:33.737718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:07:32.776119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.119204+0000","last_change":"2024-09-13T15:02:34.119204+0000","last_active":"2024-09-13T15:02:34.119204+0000","last_peered":"2024-09-13T15:02:34.119204+0000","last_clean":"2024-09-13T15:02:34.119204+0000","last_became_active":"2024-09-13T15:02:34.118621+0000","last_became_peered":"2024-09-13T15:02:34.118621+0000","last_unstale":"2024-09-13T15:02:34.119204+0000","last_undegraded":"2024-09-13T15:02:34.119204+0000","last_fullsized":"2024-09-13T15:02:34.119204+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:33.356064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743857+0000","last_change":"2024-09-13T15:01:44.831717+0000","last_active":"2024-09-13T15:02:33.743857+0000","last_peered":"2024-09-13T15:02:33.743857+0000","last_clean":"2024-09-13T15:02:33.743857+0000","last_became_active":"2024-09-13T15:01:44.831495+0000","last_became_peered":"2024-09-13T15:01:44.831495+0000","last_unstale":"2024-09-13T15:02:33.743857+0000","last_undegraded":"2024-09-13T15:02:33.743857+0000","last_fullsized":"2024-09-13T15:02:33.743857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:48.753543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743869+0000","last_change":"2024-09-13T15:01:44.829698+0000","last_active":"2024-09-13T15:02:33.743869+0000","last_peered":"2024-09-13T15:02:33.743869+0000","last_clean":"2024-09-13T15:02:33.743869+0000","last_became_active":"2024-09-13T15:01:44.828999+0000","last_became_peered":"2024-09-13T15:01:44.828999+0000","last_unstale":"2024-09-13T15:02:33.743869+0000","last_undegraded":"2024-09-13T15:02:33.743869+0000","last_fullsized":"2024-09-13T15:02:33.743869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:30.591718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117647+0000","last_change":"2024-09-13T15:01:44.817554+0000","last_active":"2024-09-13T15:02:34.117647+0000","last_peered":"2024-09-13T15:02:34.117647+0000","last_clean":"2024-09-13T15:02:34.117647+0000","last_became_active":"2024-09-13T15:01:44.816258+0000","last_became_peered":"2024-09-13T15:01:44.816258+0000","last_unstale":"2024-09-13T15:02:34.117647+0000","last_undegraded":"2024-09-13T15:02:34.117647+0000","last_fullsized":"2024-09-13T15:02:34.117647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:07.927802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742322+0000","last_change":"2024-09-13T15:01:44.809979+0000","last_active":"2024-09-13T15:02:33.742322+0000","last_peered":"2024-09-13T15:02:33.742322+0000","last_clean":"2024-09-13T15:02:33.742322+0000","last_became_active":"2024-09-13T15:01:44.809687+0000","last_became_peered":"2024-09-13T15:01:44.809687+0000","last_unstale":"2024-09-13T15:02:33.742322+0000","last_undegraded":"2024-09-13T15:02:33.742322+0000","last_fullsized":"2024-09-13T15:02:33.742322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:45.583840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.119233+0000","last_change":"2024-09-13T15:02:34.119233+0000","last_active":"2024-09-13T15:02:34.119233+0000","last_peered":"2024-09-13T15:02:34.119233+0000","last_clean":"2024-09-13T15:02:34.119233+0000","last_became_active":"2024-09-13T15:02:34.118798+0000","last_became_peered":"2024-09-13T15:02:34.118798+0000","last_unstale":"2024-09-13T15:02:34.119233+0000","last_undegraded":"2024-09-13T15:02:34.119233+0000","last_fullsized":"2024-09-13T15:02:34.119233+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:12.367569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740392+0000","last_change":"2024-09-13T15:01:44.848904+0000","last_active":"2024-09-13T15:02:33.740392+0000","last_peered":"2024-09-13T15:02:33.740392+0000","last_clean":"2024-09-13T15:02:33.740392+0000","last_became_active":"2024-09-13T15:01:44.846074+0000","last_became_peered":"2024-09-13T15:01:44.846074+0000","last_unstale":"2024-09-13T15:02:33.740392+0000","last_undegraded":"2024-09-13T15:02:33.740392+0000","last_fullsized":"2024-09-13T15:02:33.740392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:37.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741904+0000","last_change":"2024-09-13T15:01:44.828243+0000","last_active":"2024-09-13T15:02:33.741904+0000","last_peered":"2024-09-13T15:02:33.741904+0000","last_clean":"2024-09-13T15:02:33.741904+0000","last_became_active":"2024-09-13T15:01:44.828024+0000","last_became_peered":"2024-09-13T15:01:44.828024+0000","last_unstale":"2024-09-13T15:02:33.741904+0000","last_undegraded":"2024-09-13T15:02:33.741904+0000","last_fullsized":"2024-09-13T15:02:33.741904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:28:47.388087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743573+0000","last_change":"2024-09-13T15:01:44.808879+0000","last_active":"2024-09-13T15:02:33.743573+0000","last_peered":"2024-09-13T15:02:33.743573+0000","last_clean":"2024-09-13T15:02:33.743573+0000","last_became_active":"2024-09-13T15:01:44.808609+0000","last_became_peered":"2024-09-13T15:01:44.808609+0000","last_unstale":"2024-09-13T15:02:33.743573+0000","last_undegraded":"2024-09-13T15:02:33.743573+0000","last_fullsized":"2024-09-13T15:02:33.743573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:59.817452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738213+0000","last_change":"2024-09-13T15:01:44.811171+0000","last_active":"2024-09-13T15:02:33.738213+0000","last_peered":"2024-09-13T15:02:33.738213+0000","last_clean":"2024-09-13T15:02:33.738213+0000","last_became_active":"2024-09-13T15:01:44.809918+0000","last_became_peered":"2024-09-13T15:01:44.809918+0000","last_unstale":"2024-09-13T15:02:33.738213+0000","last_undegraded":"2024-09-13T15:02:33.738213+0000","last_fullsized":"2024-09-13T15:02:33.738213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:48.359429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749385+0000","last_change":"2024-09-13T15:01:44.833663+0000","last_active":"2024-09-13T15:02:33.749385+0000","last_peered":"2024-09-13T15:02:33.749385+0000","last_clean":"2024-09-13T15:02:33.749385+0000","last_became_active":"2024-09-13T15:01:44.828737+0000","last_became_peered":"2024-09-13T15:01:44.828737+0000","last_unstale":"2024-09-13T15:02:33.749385+0000","last_undegraded":"2024-09-13T15:02:33.749385+0000","last_fullsized":"2024-09-13T15:02:33.749385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:08.579890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744005+0000","last_change":"2024-09-13T15:01:44.851143+0000","last_active":"2024-09-13T15:02:33.744005+0000","last_peered":"2024-09-13T15:02:33.744005+0000","last_clean":"2024-09-13T15:02:33.744005+0000","last_became_active":"2024-09-13T15:01:44.850410+0000","last_became_peered":"2024-09-13T15:01:44.850410+0000","last_unstale":"2024-09-13T15:02:33.744005+0000","last_undegraded":"2024-09-13T15:02:33.744005+0000","last_fullsized":"2024-09-13T15:02:33.744005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:11.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744851+0000","last_change":"2024-09-13T15:01:44.840082+0000","last_active":"2024-09-13T15:02:33.744851+0000","last_peered":"2024-09-13T15:02:33.744851+0000","last_clean":"2024-09-13T15:02:33.744851+0000","last_became_active":"2024-09-13T15:01:44.839371+0000","last_became_peered":"2024-09-13T15:01:44.839371+0000","last_unstale":"2024-09-13T15:02:33.744851+0000","last_undegraded":"2024-09-13T15:02:33.744851+0000","last_fullsized":"2024-09-13T15:02:33.744851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:13.433036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118361+0000","last_change":"2024-09-13T15:01:44.850416+0000","last_active":"2024-09-13T15:02:34.118361+0000","last_peered":"2024-09-13T15:02:34.118361+0000","last_clean":"2024-09-13T15:02:34.118361+0000","last_became_active":"2024-09-13T15:01:44.849766+0000","last_became_peered":"2024-09-13T15:01:44.849766+0000","last_unstale":"2024-09-13T15:02:34.118361+0000","last_undegraded":"2024-09-13T15:02:34.118361+0000","last_fullsized":"2024-09-13T15:02:34.118361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:11.985610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737522+0000","last_change":"2024-09-13T15:01:44.837060+0000","last_active":"2024-09-13T15:02:33.737522+0000","last_peered":"2024-09-13T15:02:33.737522+0000","last_clean":"2024-09-13T15:02:33.737522+0000","last_became_active":"2024-09-13T15:01:44.836770+0000","last_became_peered":"2024-09-13T15:01:44.836770+0000","last_unstale":"2024-09-13T15:02:33.737522+0000","last_undegraded":"2024-09-13T15:02:33.737522+0000","last_fullsized":"2024-09-13T15:02:33.737522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:45.915852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116554+0000","last_change":"2024-09-13T15:01:44.815867+0000","last_active":"2024-09-13T15:02:34.116554+0000","last_peered":"2024-09-13T15:02:34.116554+0000","last_clean":"2024-09-13T15:02:34.116554+0000","last_became_active":"2024-09-13T15:01:44.815116+0000","last_became_peered":"2024-09-13T15:01:44.815116+0000","last_unstale":"2024-09-13T15:02:34.116554+0000","last_undegraded":"2024-09-13T15:02:34.116554+0000","last_fullsized":"2024-09-13T15:02:34.116554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:02.814724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741454+0000","last_change":"2024-09-13T15:01:44.850022+0000","last_active":"2024-09-13T15:02:33.741454+0000","last_peered":"2024-09-13T15:02:33.741454+0000","last_clean":"2024-09-13T15:02:33.741454+0000","last_became_active":"2024-09-13T15:01:44.849533+0000","last_became_peered":"2024-09-13T15:01:44.849533+0000","last_unstale":"2024-09-13T15:02:33.741454+0000","last_undegraded":"2024-09-13T15:02:33.741454+0000","last_fullsized":"2024-09-13T15:02:33.741454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:09.837692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116378+0000","last_change":"2024-09-13T15:01:44.817139+0000","last_active":"2024-09-13T15:02:34.116378+0000","last_peered":"2024-09-13T15:02:34.116378+0000","last_clean":"2024-09-13T15:02:34.116378+0000","last_became_active":"2024-09-13T15:01:44.816416+0000","last_became_peered":"2024-09-13T15:01:44.816416+0000","last_unstale":"2024-09-13T15:02:34.116378+0000","last_undegraded":"2024-09-13T15:02:34.116378+0000","last_fullsized":"2024-09-13T15:02:34.116378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:38.382210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.869812+0000","last_change":"2024-09-13T15:02:33.747735+0000","last_active":"2024-09-13T15:02:33.869812+0000","last_peered":"2024-09-13T15:02:33.869812+0000","last_clean":"2024-09-13T15:02:33.869812+0000","last_became_active":"2024-09-13T15:02:33.747405+0000","last_became_peered":"2024-09-13T15:02:33.747405+0000","last_unstale":"2024-09-13T15:02:33.869812+0000","last_undegraded":"2024-09-13T15:02:33.869812+0000","last_fullsized":"2024-09-13T15:02:33.869812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:20.616184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742170+0000","last_change":"2024-09-13T15:01:44.808264+0000","last_active":"2024-09-13T15:02:33.742170+0000","last_peered":"2024-09-13T15:02:33.742170+0000","last_clean":"2024-09-13T15:02:33.742170+0000","last_became_active":"2024-09-13T15:01:44.807776+0000","last_became_peered":"2024-09-13T15:01:44.807776+0000","last_unstale":"2024-09-13T15:02:33.742170+0000","last_undegraded":"2024-09-13T15:02:33.742170+0000","last_fullsized":"2024-09-13T15:02:33.742170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:17.637800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742252+0000","last_change":"2024-09-13T15:01:44.804985+0000","last_active":"2024-09-13T15:02:33.742252+0000","last_peered":"2024-09-13T15:02:33.742252+0000","last_clean":"2024-09-13T15:02:33.742252+0000","last_became_active":"2024-09-13T15:01:44.803977+0000","last_became_peered":"2024-09-13T15:01:44.803977+0000","last_unstale":"2024-09-13T15:02:33.742252+0000","last_undegraded":"2024-09-13T15:02:33.742252+0000","last_fullsized":"2024-09-13T15:02:33.742252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:12.999738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118211+0000","last_change":"2024-09-13T15:01:44.824666+0000","last_active":"2024-09-13T15:02:34.118211+0000","last_peered":"2024-09-13T15:02:34.118211+0000","last_clean":"2024-09-13T15:02:34.118211+0000","last_became_active":"2024-09-13T15:01:44.815381+0000","last_became_peered":"2024-09-13T15:01:44.815381+0000","last_unstale":"2024-09-13T15:02:34.118211+0000","last_undegraded":"2024-09-13T15:02:34.118211+0000","last_fullsized":"2024-09-13T15:02:34.118211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:12:17.680247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10025,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":209,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":20050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542184,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":917504,"data_stored":709456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.94599999999999995,"15min":0.94099999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.4079999999999999,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.008},{"interface":"front","average":{"1min":0.878,"5min":0.877,"15min":0.877},"min":{"1min":0.57999999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.753}]},{"osd":1,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.873,"15min":0.877},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.147,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1.028,"15min":1.036},"min":{"1min":0.68300000000000005,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.0009999999999999,"15min":1.0089999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.4570000000000001,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.98699999999999999,"15min":0.995},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.321,"5min":1.452,"15min":1.452},"last":1.0660000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.92200000000000004,"15min":0.93000000000000005},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.1220000000000001,"5min":1.232,"15min":1.232},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.1020000000000001,"15min":1.1140000000000001},"min":{"1min":0.79000000000000004,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.496,"5min":1.7,"15min":1.7},"last":0.878}]},{"osd":4,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.97499999999999998,"15min":0.97799999999999998},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.3700000000000001,"5min":1.643,"15min":1.643},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.93400000000000005,"5min":1.03,"15min":1.046},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.137,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.153,"15min":1.165},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.579,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.095,"5min":1.1040000000000001,"15min":1.1060000000000001},"min":{"1min":0.86799999999999999,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.4359999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.153}]},{"osd":6,"last update":"Fri Sep 13 15:03:39 2024","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.179,"15min":1.1890000000000001},"min":{"1min":0.81299999999999994,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.4970000000000001,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.1399999999999999,"15min":1.157},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.266,"5min":1.641,"15min":1.641},"last":0.86099999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542185,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":121573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.878,"15min":0.90100000000000002},"min":{"1min":0.61499999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.224,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.86799999999999999,"15min":0.85799999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.89200000000000002,"15min":0.89900000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.85199999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.90300000000000002,"15min":0.88900000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.92300000000000004}]},{"osd":3,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91100000000000003,"15min":0.91500000000000004},"min":{"1min":0.63700000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1399999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.94599999999999995,"15min":0.95199999999999996},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.71999999999999997}]},{"osd":4,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.67900000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.97999999999999998,"15min":1.0009999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.115,"5min":1.369,"15min":1.369},"last":1.075}]},{"osd":5,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.95199999999999996,"15min":0.96099999999999997},"min":{"1min":0.69799999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1990000000000001,"5min":1.3,"15min":1.3},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.032,"15min":1.046},"min":{"1min":0.66700000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":1.153}]},{"osd":7,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.016,"15min":1.0289999999999999},"min":{"1min":0.72099999999999997,"5min":0.626,"15min":0.626},"max":{"1min":1.1890000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.089,"15min":1.107},"min":{"1min":0.91200000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.996}]}]},{"osd":5,"up_from":14,"seq":60129542184,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":120872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.86899999999999999,"15min":0.872},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.86899999999999999,"15min":0.86299999999999999},"min":{"1min":0.71599999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.282,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.67400000000000004}]},{"osd":1,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.93700000000000006,"15min":0.94499999999999995},"min":{"1min":0.63700000000000001,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.3839999999999999,"5min":1.401,"15min":1.401},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.89200000000000002,"15min":0.89600000000000002},"min":{"1min":0.65700000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.93500000000000005,"15min":0.94499999999999995},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.95099999999999996,"15min":0.94899999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.80100000000000005}]},{"osd":3,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.94499999999999995,"15min":0.94799999999999995},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.2849999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97199999999999998,"15min":0.97099999999999997},"min":{"1min":0.72699999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.415,"5min":1.415,"15min":1.415},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.85299999999999998,"15min":0.85599999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.2330000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.0600000000000001,"15min":1.079},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.2669999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.0609999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":1.028,"15min":1.044},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.202,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":1.196},{"interface":"front","average":{"1min":1.004,"5min":1.083,"15min":1.0960000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.496,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.036}]},{"osd":7,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.085,"15min":1.087},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.111},{"interface":"front","average":{"1min":1.099,"5min":1.145,"15min":1.153},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.5609999999999999,"5min":1.988,"15min":1.988},"last":1.2170000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542184,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":118318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.90000000000000002,"15min":0.90600000000000003},"min":{"1min":0.60399999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.071,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.83099999999999996,"15min":0.82699999999999996},"min":{"1min":0.63200000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.139,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.004}]},{"osd":1,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.92200000000000004,"15min":0.92600000000000005},"min":{"1min":0.68200000000000005,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.131,"5min":1.224,"15min":1.224},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.876,"5min":0.871,"15min":0.87},"min":{"1min":0.623,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.157,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.97399999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.93700000000000006,"15min":0.94299999999999995},"min":{"1min":0.70299999999999996,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.0780000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.95799999999999996,"15min":0.96199999999999997},"min":{"1min":0.67500000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.1240000000000001,"5min":1.669,"15min":1.669},"last":0.91600000000000004}]},{"osd":3,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.90200000000000002,"15min":0.90600000000000003},"min":{"1min":0.61899999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.099,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.0069999999999999,"15min":1.0189999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.2230000000000001,"5min":1.881,"15min":1.881},"last":0.628}]},{"osd":5,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":1.0169999999999999,"15min":1.05},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.028,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.88,"5min":0.96999999999999997,"15min":0.98499999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.1819999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.88700000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":1.0109999999999999,"15min":1.0269999999999999},"min":{"1min":0.64000000000000001,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.107,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.093},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.083,"15min":1.0960000000000001},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.367,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":0.72899999999999998}]},{"osd":7,"last update":"Fri Sep 13 15:03:43 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.046,"15min":1.054},"min":{"1min":0.751,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.2569999999999999,"5min":1.623,"15min":1.623},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.2090000000000001,"15min":1.2210000000000001},"min":{"1min":0.96099999999999997,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3180000000000001,"5min":1.996,"15min":1.996},"last":1.0700000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":319488,"data_stored":121607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.501,"15min":0.501},"min":{"1min":0.371,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64900000000000002,"5min":0.747,"15min":0.747},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.66300000000000003,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.374,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.71499999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.44400000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.76600000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81200000000000006,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.61399999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97599999999999998,"5min":1.179,"15min":1.179},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85999999999999999,"15min":0.86399999999999999},"min":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.034,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.87}]},{"osd":5,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.873,"15min":0.876},"min":{"1min":0.68500000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0740000000000001,"5min":1.284,"15min":1.284},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.87,"5min":0.93300000000000005,"15min":0.94299999999999995},"min":{"1min":0.70599999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.212,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.753}]},{"osd":6,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.89400000000000002,"15min":0.90700000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0269999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.94099999999999995,"15min":0.95099999999999996},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.1539999999999999,"5min":1.21,"15min":1.21},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.95299999999999996,"15min":0.96899999999999997},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.1499999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.96399999999999997,"15min":0.98799999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0640000000000001,"5min":1.228,"15min":1.228},"last":0.90800000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542184,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":319488,"data_stored":118450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48599999999999999,"15min":0.48799999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.56299999999999994,"15min":0.56799999999999995},"min":{"1min":0.33700000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.76600000000000001,"5min":1.157,"15min":1.157},"last":0.56499999999999995}]},{"osd":1,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56100000000000005,"15min":0.56799999999999995},"min":{"1min":0.41599999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.71199999999999997,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.44700000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.73899999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.625,"15min":0.629},"min":{"1min":0.48599999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.72199999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.96699999999999997,"15min":0.98099999999999998},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.1899999999999999,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.94799999999999995,"15min":0.96299999999999997},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.123,"5min":1.675,"15min":1.675},"last":1.004}]},{"osd":5,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.92300000000000004,"15min":0.93000000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.0920000000000001,"5min":1.296,"15min":1.296},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.877,"15min":0.88700000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.91100000000000003}]},{"osd":6,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.88,"15min":0.88400000000000001},"min":{"1min":0.69599999999999995,"5min":0.628,"15min":0.628},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.93500000000000005,"15min":0.94199999999999995},"min":{"1min":0.748,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.1859999999999999,"5min":1.373,"15min":1.373},"last":1.0700000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.82099999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.98699999999999999,"15min":0.995},"min":{"1min":0.78800000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2010000000000001,"5min":1.353,"15min":1.353},"last":1.1240000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":118520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46500000000000002,"15min":0.47099999999999997},"min":{"1min":0.32500000000000001,"5min":0.318,"15min":0.318},"max":{"1min":0.57699999999999996,"5min":0.871,"15min":0.871},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.69799999999999995,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.38}]},{"osd":2,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.38,"5min":0.37,"15min":0.37},"max":{"1min":0.64600000000000002,"5min":1.071,"15min":1.071},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.61099999999999999,"15min":0.62},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.68700000000000006,"5min":1.107,"15min":1.107},"last":0.46300000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.47399999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.84799999999999998,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.61599999999999999,"15min":0.63},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.68899999999999995,"5min":1.323,"15min":1.323},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.90600000000000003,"15min":0.91800000000000004},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.0169999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.88400000000000001,"15min":0.89300000000000002},"min":{"1min":0.68799999999999994,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1830000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.879,"15min":0.89000000000000001},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0289999999999999,"5min":1.228,"15min":1.228},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.91300000000000003,"15min":0.93100000000000005},"min":{"1min":0.70699999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":0.96899999999999997,"5min":1.365,"15min":1.365},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.90400000000000003,"15min":0.91400000000000003},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":0.999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.94499999999999995,"15min":0.96499999999999997},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":0.98199999999999998,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.59799999999999998}]},{"osd":7,"last update":"Fri Sep 13 15:03:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.94799999999999995,"15min":0.96699999999999997},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":0.95499999999999996,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.93500000000000005,"15min":0.94899999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2170000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.753}]}]},{"osd":0,"up_from":14,"seq":60129542184,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":909312,"data_stored":708278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.66800000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.58699999999999997,"15min":0.60199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68899999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67700000000000005}]},{"osd":2,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.623,"15min":0.64100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.64400000000000002,"5min":1.669,"15min":1.669},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56299999999999994,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69399999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.72499999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.63700000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88900000000000001},"min":{"1min":0.67100000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.0980000000000001,"5min":1.274,"15min":1.274},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.90400000000000003,"15min":0.91200000000000003},"min":{"1min":0.67500000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0580000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.754}]},{"osd":5,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.88300000000000001,"15min":0.88900000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.026,"5min":1.165,"15min":1.165},"last":0.89100000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.95199999999999996,"15min":0.96699999999999997},"min":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.0940000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.91200000000000003,"15min":0.92500000000000004},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":1.044}]},{"osd":7,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":0.93899999999999995},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.93200000000000005,"15min":0.94599999999999995},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.038,"5min":1.141,"15min":1.141},"last":1.0600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:04:50.474 INFO:tasks.mds_thrash.ceph_manager:clean! 2024-09-13T15:04:50.475 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:04:50.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.645+0000 7fa7f8a00640 1 Processor -- start 2024-09-13T15:04:50.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f8a00640 1 -- start start 2024-09-13T15:04:50.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f8a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7f40c7b20 0x7fa7f4159070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:50.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f8a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f406e120 con 0x7fa7f40c7740 2024-09-13T15:04:50.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f8a00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7f40cbd80 con 0x7fa7f41595b0 2024-09-13T15:04:50.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f8a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f40cc060 con 0x7fa7f40c7b20 2024-09-13T15:04:50.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f2800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa7f40c7740 0x7fa7f40cb560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33238/0 (socket says 172.21.15.7:33238) 2024-09-13T15:04:50.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f2800640 1 -- 172.21.15.7:0/179911806 learned_addr learned my addr 172.21.15.7:0/179911806 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:50.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7e9e00640 1 --2- 172.21.15.7:0/179911806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7f40c7b20 0x7fa7f4159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:50.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f1e00640 1 -- 172.21.15.7:0/179911806 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073609037 0 0) 0x7fa7f406e120 con 0x7fa7f40c7740 2024-09-13T15:04:50.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f1e00640 1 -- 172.21.15.7:0/179911806 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d8003530 con 0x7fa7f40c7740 2024-09-13T15:04:50.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f1e00640 1 -- 172.21.15.7:0/179911806 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199818595 0 0) 0x7fa7f40cbd80 con 0x7fa7f41595b0 2024-09-13T15:04:50.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f1e00640 1 -- 172.21.15.7:0/179911806 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f406e120 con 0x7fa7f41595b0 2024-09-13T15:04:50.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f1e00640 1 -- 172.21.15.7:0/179911806 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 363630088 0 0) 0x7fa7d8003530 con 0x7fa7f40c7740 2024-09-13T15:04:50.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f1e00640 1 -- 172.21.15.7:0/179911806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7f40c7b20 msgr2=0x7fa7f4159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:50.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f1e00640 1 --2- 172.21.15.7:0/179911806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7f40c7b20 0x7fa7f4159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f1e00640 1 -- 172.21.15.7:0/179911806 >> v1:172.21.15.77:6789/0 conn(0x7fa7f41595b0 legacy=0x7fa7f4152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:50.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f1e00640 1 -- 172.21.15.7:0/179911806 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f406dad0 con 0x7fa7f40c7740 2024-09-13T15:04:50.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f1e00640 1 -- 172.21.15.7:0/179911806 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7fa7e4001680 con 0x7fa7f40c7740 2024-09-13T15:04:50.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7e9e00640 1 --2- 172.21.15.7:0/179911806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7f40c7b20 0x7fa7f4159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:04:50.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f1e00640 1 -- 172.21.15.7:0/179911806 >> v1:172.21.15.7:6789/0 conn(0x7fa7f40c7740 legacy=0x7fa7f40cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:50.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f1e00640 1 --2- 172.21.15.7:0/179911806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7f40c7b20 0x7fa7d8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:50.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f1e00640 1 --2- 172.21.15.7:0/179911806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d8004080 0x7fa7d80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:50.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f1e00640 1 --2- 172.21.15.7:0/179911806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7d8004d10 0x7fa7d8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:50.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f1e00640 1 -- 172.21.15.7:0/179911806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f40cc060 con 0x7fa7d8004080 2024-09-13T15:04:50.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f1e00640 1 -- 172.21.15.7:0/179911806 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d800ba40 con 0x7fa7d8004d10 2024-09-13T15:04:50.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f1e00640 1 -- 172.21.15.7:0/179911806 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d800bc00 con 0x7fa7f40c7b20 2024-09-13T15:04:50.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7e9e00640 1 --2- 172.21.15.7:0/179911806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d8004080 0x7fa7d80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:50.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f2800640 1 --2- 172.21.15.7:0/179911806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7f40c7b20 0x7fa7d8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:50.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f3200640 1 --2- 172.21.15.7:0/179911806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7d8004d10 0x7fa7d8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:50.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7e9e00640 1 -- 172.21.15.7:0/179911806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7f40c7b20 msgr2=0x7fa7d8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:50.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7e9e00640 1 --2- 172.21.15.7:0/179911806 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7f40c7b20 0x7fa7d8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7e9e00640 1 -- 172.21.15.7:0/179911806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7d8004d10 msgr2=0x7fa7d8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:50.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7e9e00640 1 --2- 172.21.15.7:0/179911806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7d8004d10 0x7fa7d8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7e9e00640 1 -- 172.21.15.7:0/179911806 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7dc009420 con 0x7fa7d8004080 2024-09-13T15:04:50.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.649+0000 7fa7f3200640 1 --2- 172.21.15.7:0/179911806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7d8004d10 0x7fa7d8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:50.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.653+0000 7fa7e9e00640 1 --2- 172.21.15.7:0/179911806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d8004080 0x7fa7d80047d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc009c60 tx=0x7fa7dc01cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb19d32eac8b9a3b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:50.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.653+0000 7fa7f1e00640 1 -- 172.21.15.7:0/179911806 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4007ea0 con 0x7fa7d8004080 2024-09-13T15:04:50.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.653+0000 7fa7f1e00640 1 -- 172.21.15.7:0/179911806 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc0040f0 con 0x7fa7d8004080 2024-09-13T15:04:50.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.653+0000 7fa7f1e00640 1 -- 172.21.15.7:0/179911806 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc0044c0 con 0x7fa7d8004080 2024-09-13T15:04:50.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.653+0000 7fa7f8a00640 1 -- 172.21.15.7:0/179911806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d8004080 msgr2=0x7fa7d80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:50.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.653+0000 7fa7f8a00640 1 --2- 172.21.15.7:0/179911806 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7d8004080 0x7fa7d80047d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc009c60 tx=0x7fa7dc01cbd0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.653+0000 7fa7f3200640 1 -- 172.21.15.7:0/179911806 reap_dead start 2024-09-13T15:04:50.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.653+0000 7fa7f8a00640 1 -- 172.21.15.7:0/179911806 shutdown_connections 2024-09-13T15:04:50.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.653+0000 7fa7f8a00640 1 -- 172.21.15.7:0/179911806 >> 172.21.15.7:0/179911806 conn(0x7fa7f4065d40 msgr2=0x7fa7f4066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:50.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.653+0000 7fa7f8a00640 1 -- 172.21.15.7:0/179911806 shutdown_connections 2024-09-13T15:04:50.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.653+0000 7fa7f8a00640 1 -- 172.21.15.7:0/179911806 wait complete. 2024-09-13T15:04:50.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f8a00640 1 Processor -- start 2024-09-13T15:04:50.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f8a00640 1 -- start start 2024-09-13T15:04:50.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f8a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7d8004080 0x7fa7f4155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:50.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f8a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7f4156840 0x7fa7f4156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:50.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f8a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7f4156170 0x7fa7f41572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:50.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f8a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f406ae60 con 0x7fa7f4156170 2024-09-13T15:04:50.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f8a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f4159150 con 0x7fa7f4156840 2024-09-13T15:04:50.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f8a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f41eecc0 con 0x7fa7d8004080 2024-09-13T15:04:50.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7f4156170 0x7fa7f41572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:50.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7f4156170 0x7fa7f41572a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58024/0 (socket says 172.21.15.7:58024) 2024-09-13T15:04:50.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f3200640 1 -- 172.21.15.7:0/775872325 learned_addr learned my addr 172.21.15.7:0/775872325 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:50.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7e9e00640 1 --2- 172.21.15.7:0/775872325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7f4156840 0x7fa7f4156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:50.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f2800640 1 --2- 172.21.15.7:0/775872325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7d8004080 0x7fa7f4155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:50.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f3200640 1 -- 172.21.15.7:0/775872325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7d8004080 msgr2=0x7fa7f4155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:50.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f3200640 1 --2- 172.21.15.7:0/775872325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7d8004080 0x7fa7f4155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f3200640 1 -- 172.21.15.7:0/775872325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7f4156840 msgr2=0x7fa7f4156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:50.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f3200640 1 --2- 172.21.15.7:0/775872325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7f4156840 0x7fa7f4156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f3200640 1 -- 172.21.15.7:0/775872325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f41eef60 con 0x7fa7f4156170 2024-09-13T15:04:50.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f3200640 1 --2- 172.21.15.7:0/775872325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7f4156170 0x7fa7f41572a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec007e70 tx=0x7fa7ec00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:50.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7eb400640 1 -- 172.21.15.7:0/775872325 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec017070 con 0x7fa7f4156170 2024-09-13T15:04:50.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7eb400640 1 -- 172.21.15.7:0/775872325 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ec00ee70 con 0x7fa7f4156170 2024-09-13T15:04:50.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7eb400640 1 -- 172.21.15.7:0/775872325 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec003b90 con 0x7fa7f4156170 2024-09-13T15:04:50.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f8a00640 1 -- 172.21.15.7:0/775872325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f406a530 con 0x7fa7f4156170 2024-09-13T15:04:50.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f8a00640 1 -- 172.21.15.7:0/775872325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f406aaf0 con 0x7fa7f4156170 2024-09-13T15:04:50.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.657+0000 7fa7f8a00640 1 -- 172.21.15.7:0/775872325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f406b010 con 0x7fa7f4156170 2024-09-13T15:04:50.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.661+0000 7fa7eb400640 1 -- 172.21.15.7:0/775872325 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa7ec003cf0 con 0x7fa7f4156170 2024-09-13T15:04:50.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.661+0000 7fa7eb400640 1 --2- 172.21.15.7:0/775872325 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa7d0066690 0x7fa7d0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:50.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.661+0000 7fa7eb400640 1 -- 172.21.15.7:0/775872325 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa7ec083c20 con 0x7fa7f4156170 2024-09-13T15:04:50.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.661+0000 7fa7f2800640 1 --2- 172.21.15.7:0/775872325 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa7d0066690 0x7fa7d0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:50.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.661+0000 7fa7f2800640 1 --2- 172.21.15.7:0/775872325 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa7d0066690 0x7fa7d0068b50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4001060 tx=0x7fa7e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:50.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.665+0000 7fa7eb400640 1 -- 172.21.15.7:0/775872325 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa7f406b010 con 0x7fa7f4156170 2024-09-13T15:04:50.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.825+0000 7fa7f8a00640 1 -- 172.21.15.7:0/775872325 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7f406e5b0 con 0x7fa7d0066690 2024-09-13T15:04:50.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.853+0000 7fa7eb400640 1 -- 172.21.15.7:0/775872325 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368927 (secure 0 0 0) 0x7fa7e4005550 con 0x7fa7d0066690 2024-09-13T15:04:50.858 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:50.860 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T15:04:50.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.857+0000 7fa7f8a00640 1 -- 172.21.15.7:0/775872325 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa7d0066690 msgr2=0x7fa7d0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.857+0000 7fa7f8a00640 1 --2- 172.21.15.7:0/775872325 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa7d0066690 0x7fa7d0068b50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4001060 tx=0x7fa7e4009040 comp rx=0 tx=0).stop 2024-09-13T15:04:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.857+0000 7fa7f8a00640 1 -- 172.21.15.7:0/775872325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7f4156170 msgr2=0x7fa7f41572a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.857+0000 7fa7f8a00640 1 --2- 172.21.15.7:0/775872325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7f4156170 0x7fa7f41572a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec007e70 tx=0x7fa7ec00ec20 comp rx=0 tx=0).stop 2024-09-13T15:04:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.857+0000 7fa7f8a00640 1 -- 172.21.15.7:0/775872325 shutdown_connections 2024-09-13T15:04:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.857+0000 7fa7f8a00640 1 --2- 172.21.15.7:0/775872325 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa7d0066690 0x7fa7d0068b50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.857+0000 7fa7f8a00640 1 --2- 172.21.15.7:0/775872325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa7f4156170 0x7fa7f41572a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.857+0000 7fa7f8a00640 1 --2- 172.21.15.7:0/775872325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa7f4156840 0x7fa7f4156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.857+0000 7fa7f8a00640 1 --2- 172.21.15.7:0/775872325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa7d8004080 0x7fa7f4155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.857+0000 7fa7f8a00640 1 -- 172.21.15.7:0/775872325 >> 172.21.15.7:0/775872325 conn(0x7fa7f4065d40 msgr2=0x7fa7f4068040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.857+0000 7fa7f8a00640 1 -- 172.21.15.7:0/775872325 shutdown_connections 2024-09-13T15:04:50.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:50.857+0000 7fa7f8a00640 1 -- 172.21.15.7:0/775872325 wait complete. 2024-09-13T15:04:50.878 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2024-09-13T15:04:50.698818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600652,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":370,"num_write_kb":2485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":302,"ondisk_log_size":302,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232072,"kb_used_data":3656,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":754742648,"statfs":{"total":773094113280,"available":772856471552,"internally_reserved":0,"allocated":3743744,"data_stored":2137592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":233819704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1617,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004654"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.934945+0000","last_change":"2024-09-13T15:01:44.418856+0000","last_active":"2024-09-13T15:04:35.934945+0000","last_peered":"2024-09-13T15:04:35.934945+0000","last_clean":"2024-09-13T15:04:35.934945+0000","last_became_active":"2024-09-13T15:01:44.418641+0000","last_became_peered":"2024-09-13T15:01:44.418641+0000","last_unstale":"2024-09-13T15:04:35.934945+0000","last_undegraded":"2024-09-13T15:04:35.934945+0000","last_fullsized":"2024-09-13T15:04:35.934945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:40.178824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738513+0000","last_change":"2024-09-13T15:01:44.809371+0000","last_active":"2024-09-13T15:02:33.738513+0000","last_peered":"2024-09-13T15:02:33.738513+0000","last_clean":"2024-09-13T15:02:33.738513+0000","last_became_active":"2024-09-13T15:01:44.809091+0000","last_became_peered":"2024-09-13T15:01:44.809091+0000","last_unstale":"2024-09-13T15:02:33.738513+0000","last_undegraded":"2024-09-13T15:02:33.738513+0000","last_fullsized":"2024-09-13T15:02:33.738513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:22.412025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737520+0000","last_change":"2024-09-13T15:01:48.910757+0000","last_active":"2024-09-13T15:02:33.737520+0000","last_peered":"2024-09-13T15:02:33.737520+0000","last_clean":"2024-09-13T15:02:33.737520+0000","last_became_active":"2024-09-13T15:01:48.910262+0000","last_became_peered":"2024-09-13T15:01:48.910262+0000","last_unstale":"2024-09-13T15:02:33.737520+0000","last_undegraded":"2024-09-13T15:02:33.737520+0000","last_fullsized":"2024-09-13T15:02:33.737520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:39.290557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:03:43.915924+0000","last_change":"2024-09-13T15:01:44.404818+0000","last_active":"2024-09-13T15:03:43.915924+0000","last_peered":"2024-09-13T15:03:43.915924+0000","last_clean":"2024-09-13T15:03:43.915924+0000","last_became_active":"2024-09-13T15:01:44.401666+0000","last_became_peered":"2024-09-13T15:01:44.401666+0000","last_unstale":"2024-09-13T15:03:43.915924+0000","last_undegraded":"2024-09-13T15:03:43.915924+0000","last_fullsized":"2024-09-13T15:03:43.915924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:31.818163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742417+0000","last_change":"2024-09-13T15:01:44.850292+0000","last_active":"2024-09-13T15:02:33.742417+0000","last_peered":"2024-09-13T15:02:33.742417+0000","last_clean":"2024-09-13T15:02:33.742417+0000","last_became_active":"2024-09-13T15:01:44.849825+0000","last_became_peered":"2024-09-13T15:01:44.849825+0000","last_unstale":"2024-09-13T15:02:33.742417+0000","last_undegraded":"2024-09-13T15:02:33.742417+0000","last_fullsized":"2024-09-13T15:02:33.742417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:22.582742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.746607+0000","last_change":"2024-09-13T15:01:48.850426+0000","last_active":"2024-09-13T15:02:33.746607+0000","last_peered":"2024-09-13T15:02:33.746607+0000","last_clean":"2024-09-13T15:02:33.746607+0000","last_became_active":"2024-09-13T15:01:48.848750+0000","last_became_peered":"2024-09-13T15:01:48.848750+0000","last_unstale":"2024-09-13T15:02:33.746607+0000","last_undegraded":"2024-09-13T15:02:33.746607+0000","last_fullsized":"2024-09-13T15:02:33.746607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:55.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'12","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.939854+0000","last_change":"2024-09-13T15:01:44.437850+0000","last_active":"2024-09-13T15:04:35.939854+0000","last_peered":"2024-09-13T15:04:35.939854+0000","last_clean":"2024-09-13T15:04:35.939854+0000","last_became_active":"2024-09-13T15:01:44.437168+0000","last_became_peered":"2024-09-13T15:01:44.437168+0000","last_unstale":"2024-09-13T15:04:35.939854+0000","last_undegraded":"2024-09-13T15:04:35.939854+0000","last_fullsized":"2024-09-13T15:04:35.939854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:23.540408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745120+0000","last_change":"2024-09-13T15:01:44.845989+0000","last_active":"2024-09-13T15:02:33.745120+0000","last_peered":"2024-09-13T15:02:33.745120+0000","last_clean":"2024-09-13T15:02:33.745120+0000","last_became_active":"2024-09-13T15:01:44.845395+0000","last_became_peered":"2024-09-13T15:01:44.845395+0000","last_unstale":"2024-09-13T15:02:33.745120+0000","last_undegraded":"2024-09-13T15:02:33.745120+0000","last_fullsized":"2024-09-13T15:02:33.745120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:52.267507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748880+0000","last_change":"2024-09-13T15:01:48.865388+0000","last_active":"2024-09-13T15:02:33.748880+0000","last_peered":"2024-09-13T15:02:33.748880+0000","last_clean":"2024-09-13T15:02:33.748880+0000","last_became_active":"2024-09-13T15:01:48.864314+0000","last_became_peered":"2024-09-13T15:01:48.864314+0000","last_unstale":"2024-09-13T15:02:33.748880+0000","last_undegraded":"2024-09-13T15:02:33.748880+0000","last_fullsized":"2024-09-13T15:02:33.748880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:18.637430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'5","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.937176+0000","last_change":"2024-09-13T15:01:44.424080+0000","last_active":"2024-09-13T15:04:35.937176+0000","last_peered":"2024-09-13T15:04:35.937176+0000","last_clean":"2024-09-13T15:04:35.937176+0000","last_became_active":"2024-09-13T15:01:44.423381+0000","last_became_peered":"2024-09-13T15:01:44.423381+0000","last_unstale":"2024-09-13T15:04:35.937176+0000","last_undegraded":"2024-09-13T15:04:35.937176+0000","last_fullsized":"2024-09-13T15:04:35.937176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:38:20.455380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743629+0000","last_change":"2024-09-13T15:01:44.849670+0000","last_active":"2024-09-13T15:02:33.743629+0000","last_peered":"2024-09-13T15:02:33.743629+0000","last_clean":"2024-09-13T15:02:33.743629+0000","last_became_active":"2024-09-13T15:01:44.849038+0000","last_became_peered":"2024-09-13T15:01:44.849038+0000","last_unstale":"2024-09-13T15:02:33.743629+0000","last_undegraded":"2024-09-13T15:02:33.743629+0000","last_fullsized":"2024-09-13T15:02:33.743629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:45.570774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.747610+0000","last_change":"2024-09-13T15:01:48.854953+0000","last_active":"2024-09-13T15:02:33.747610+0000","last_peered":"2024-09-13T15:02:33.747610+0000","last_clean":"2024-09-13T15:02:33.747610+0000","last_became_active":"2024-09-13T15:01:48.853858+0000","last_became_peered":"2024-09-13T15:01:48.853858+0000","last_unstale":"2024-09-13T15:02:33.747610+0000","last_undegraded":"2024-09-13T15:02:33.747610+0000","last_fullsized":"2024-09-13T15:02:33.747610+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:07.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742073+0000","last_change":"2024-09-13T15:01:44.824391+0000","last_active":"2024-09-13T15:02:33.742073+0000","last_peered":"2024-09-13T15:02:33.742073+0000","last_clean":"2024-09-13T15:02:33.742073+0000","last_became_active":"2024-09-13T15:01:44.823690+0000","last_became_peered":"2024-09-13T15:01:44.823690+0000","last_unstale":"2024-09-13T15:02:33.742073+0000","last_undegraded":"2024-09-13T15:02:33.742073+0000","last_fullsized":"2024-09-13T15:02:33.742073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.596789+0000","last_change":"2024-09-13T15:01:44.421523+0000","last_active":"2024-09-13T15:04:17.596789+0000","last_peered":"2024-09-13T15:04:17.596789+0000","last_clean":"2024-09-13T15:04:17.596789+0000","last_became_active":"2024-09-13T15:01:44.419965+0000","last_became_peered":"2024-09-13T15:01:44.419965+0000","last_unstale":"2024-09-13T15:04:17.596789+0000","last_undegraded":"2024-09-13T15:04:17.596789+0000","last_fullsized":"2024-09-13T15:04:17.596789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:34.918774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749714+0000","last_change":"2024-09-13T15:01:48.850895+0000","last_active":"2024-09-13T15:02:33.749714+0000","last_peered":"2024-09-13T15:02:33.749714+0000","last_clean":"2024-09-13T15:02:33.749714+0000","last_became_active":"2024-09-13T15:01:48.849856+0000","last_became_peered":"2024-09-13T15:01:48.849856+0000","last_unstale":"2024-09-13T15:02:33.749714+0000","last_undegraded":"2024-09-13T15:02:33.749714+0000","last_fullsized":"2024-09-13T15:02:33.749714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:59.616442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738227+0000","last_change":"2024-09-13T15:01:44.806026+0000","last_active":"2024-09-13T15:02:33.738227+0000","last_peered":"2024-09-13T15:02:33.738227+0000","last_clean":"2024-09-13T15:02:33.738227+0000","last_became_active":"2024-09-13T15:01:44.805767+0000","last_became_peered":"2024-09-13T15:01:44.805767+0000","last_unstale":"2024-09-13T15:02:33.738227+0000","last_undegraded":"2024-09-13T15:02:33.738227+0000","last_fullsized":"2024-09-13T15:02:33.738227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:50.696113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.912198+0000","last_change":"2024-09-13T15:01:44.401897+0000","last_active":"2024-09-13T15:04:29.912198+0000","last_peered":"2024-09-13T15:04:29.912198+0000","last_clean":"2024-09-13T15:04:29.912198+0000","last_became_active":"2024-09-13T15:01:44.401559+0000","last_became_peered":"2024-09-13T15:01:44.401559+0000","last_unstale":"2024-09-13T15:04:29.912198+0000","last_undegraded":"2024-09-13T15:04:29.912198+0000","last_fullsized":"2024-09-13T15:04:29.912198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:58.535567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749109+0000","last_change":"2024-09-13T15:01:48.858808+0000","last_active":"2024-09-13T15:02:33.749109+0000","last_peered":"2024-09-13T15:02:33.749109+0000","last_clean":"2024-09-13T15:02:33.749109+0000","last_became_active":"2024-09-13T15:01:48.857802+0000","last_became_peered":"2024-09-13T15:01:48.857802+0000","last_unstale":"2024-09-13T15:02:33.749109+0000","last_undegraded":"2024-09-13T15:02:33.749109+0000","last_fullsized":"2024-09-13T15:02:33.749109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:41.628058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737738+0000","last_change":"2024-09-13T15:01:44.808674+0000","last_active":"2024-09-13T15:02:33.737738+0000","last_peered":"2024-09-13T15:02:33.737738+0000","last_clean":"2024-09-13T15:02:33.737738+0000","last_became_active":"2024-09-13T15:01:44.808420+0000","last_became_peered":"2024-09-13T15:01:44.808420+0000","last_unstale":"2024-09-13T15:02:33.737738+0000","last_undegraded":"2024-09-13T15:02:33.737738+0000","last_fullsized":"2024-09-13T15:02:33.737738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:33.447973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.933679+0000","last_change":"2024-09-13T15:01:44.406717+0000","last_active":"2024-09-13T15:04:35.933679+0000","last_peered":"2024-09-13T15:04:35.933679+0000","last_clean":"2024-09-13T15:04:35.933679+0000","last_became_active":"2024-09-13T15:01:44.406354+0000","last_became_peered":"2024-09-13T15:01:44.406354+0000","last_unstale":"2024-09-13T15:04:35.933679+0000","last_undegraded":"2024-09-13T15:04:35.933679+0000","last_fullsized":"2024-09-13T15:04:35.933679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:49.413632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741522+0000","last_change":"2024-09-13T15:01:48.909879+0000","last_active":"2024-09-13T15:02:33.741522+0000","last_peered":"2024-09-13T15:02:33.741522+0000","last_clean":"2024-09-13T15:02:33.741522+0000","last_became_active":"2024-09-13T15:01:48.909494+0000","last_became_peered":"2024-09-13T15:01:48.909494+0000","last_unstale":"2024-09-13T15:02:33.741522+0000","last_undegraded":"2024-09-13T15:02:33.741522+0000","last_fullsized":"2024-09-13T15:02:33.741522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:54.415920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748317+0000","last_change":"2024-09-13T15:01:44.825065+0000","last_active":"2024-09-13T15:02:33.748317+0000","last_peered":"2024-09-13T15:02:33.748317+0000","last_clean":"2024-09-13T15:02:33.748317+0000","last_became_active":"2024-09-13T15:01:44.824392+0000","last_became_peered":"2024-09-13T15:01:44.824392+0000","last_unstale":"2024-09-13T15:02:33.748317+0000","last_undegraded":"2024-09-13T15:02:33.748317+0000","last_fullsized":"2024-09-13T15:02:33.748317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:49.717211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.600924+0000","last_change":"2024-09-13T15:01:44.421119+0000","last_active":"2024-09-13T15:04:17.600924+0000","last_peered":"2024-09-13T15:04:17.600924+0000","last_clean":"2024-09-13T15:04:17.600924+0000","last_became_active":"2024-09-13T15:01:44.419082+0000","last_became_peered":"2024-09-13T15:01:44.419082+0000","last_unstale":"2024-09-13T15:04:17.600924+0000","last_undegraded":"2024-09-13T15:04:17.600924+0000","last_fullsized":"2024-09-13T15:04:17.600924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.011350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749456+0000","last_change":"2024-09-13T15:01:48.856387+0000","last_active":"2024-09-13T15:02:33.749456+0000","last_peered":"2024-09-13T15:02:33.749456+0000","last_clean":"2024-09-13T15:02:33.749456+0000","last_became_active":"2024-09-13T15:01:48.855433+0000","last_became_peered":"2024-09-13T15:01:48.855433+0000","last_unstale":"2024-09-13T15:02:33.749456+0000","last_undegraded":"2024-09-13T15:02:33.749456+0000","last_fullsized":"2024-09-13T15:02:33.749456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:58.309929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744608+0000","last_change":"2024-09-13T15:01:44.807909+0000","last_active":"2024-09-13T15:02:33.744608+0000","last_peered":"2024-09-13T15:02:33.744608+0000","last_clean":"2024-09-13T15:02:33.744608+0000","last_became_active":"2024-09-13T15:01:44.807643+0000","last_became_peered":"2024-09-13T15:01:44.807643+0000","last_unstale":"2024-09-13T15:02:33.744608+0000","last_undegraded":"2024-09-13T15:02:33.744608+0000","last_fullsized":"2024-09-13T15:02:33.744608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:30.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.941454+0000","last_change":"2024-09-13T15:01:44.430200+0000","last_active":"2024-09-13T15:04:35.941454+0000","last_peered":"2024-09-13T15:04:35.941454+0000","last_clean":"2024-09-13T15:04:35.941454+0000","last_became_active":"2024-09-13T15:01:44.429510+0000","last_became_peered":"2024-09-13T15:01:44.429510+0000","last_unstale":"2024-09-13T15:04:35.941454+0000","last_undegraded":"2024-09-13T15:04:35.941454+0000","last_fullsized":"2024-09-13T15:04:35.941454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:52.921485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748075+0000","last_change":"2024-09-13T15:01:48.912116+0000","last_active":"2024-09-13T15:02:33.748075+0000","last_peered":"2024-09-13T15:02:33.748075+0000","last_clean":"2024-09-13T15:02:33.748075+0000","last_became_active":"2024-09-13T15:01:48.911578+0000","last_became_peered":"2024-09-13T15:01:48.911578+0000","last_unstale":"2024-09-13T15:02:33.748075+0000","last_undegraded":"2024-09-13T15:02:33.748075+0000","last_fullsized":"2024-09-13T15:02:33.748075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:50.826715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738926+0000","last_change":"2024-09-13T15:01:44.838344+0000","last_active":"2024-09-13T15:02:33.738926+0000","last_peered":"2024-09-13T15:02:33.738926+0000","last_clean":"2024-09-13T15:02:33.738926+0000","last_became_active":"2024-09-13T15:01:44.838128+0000","last_became_peered":"2024-09-13T15:01:44.838128+0000","last_unstale":"2024-09-13T15:02:33.738926+0000","last_undegraded":"2024-09-13T15:02:33.738926+0000","last_fullsized":"2024-09-13T15:02:33.738926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:09:50.373976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.915192+0000","last_change":"2024-09-13T15:01:44.430749+0000","last_active":"2024-09-13T15:04:29.915192+0000","last_peered":"2024-09-13T15:04:29.915192+0000","last_clean":"2024-09-13T15:04:29.915192+0000","last_became_active":"2024-09-13T15:01:44.430548+0000","last_became_peered":"2024-09-13T15:01:44.430548+0000","last_unstale":"2024-09-13T15:04:29.915192+0000","last_undegraded":"2024-09-13T15:04:29.915192+0000","last_fullsized":"2024-09-13T15:04:29.915192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:30.312447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737398+0000","last_change":"2024-09-13T15:01:48.911224+0000","last_active":"2024-09-13T15:02:33.737398+0000","last_peered":"2024-09-13T15:02:33.737398+0000","last_clean":"2024-09-13T15:02:33.737398+0000","last_became_active":"2024-09-13T15:01:48.910150+0000","last_became_peered":"2024-09-13T15:01:48.910150+0000","last_unstale":"2024-09-13T15:02:33.737398+0000","last_undegraded":"2024-09-13T15:02:33.737398+0000","last_fullsized":"2024-09-13T15:02:33.737398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:41.244267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743138+0000","last_change":"2024-09-13T15:01:44.812200+0000","last_active":"2024-09-13T15:02:33.743138+0000","last_peered":"2024-09-13T15:02:33.743138+0000","last_clean":"2024-09-13T15:02:33.743138+0000","last_became_active":"2024-09-13T15:01:44.811915+0000","last_became_peered":"2024-09-13T15:01:44.811915+0000","last_unstale":"2024-09-13T15:02:33.743138+0000","last_undegraded":"2024-09-13T15:02:33.743138+0000","last_fullsized":"2024-09-13T15:02:33.743138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:07.944520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.917182+0000","last_change":"2024-09-13T15:01:44.423119+0000","last_active":"2024-09-13T15:04:29.917182+0000","last_peered":"2024-09-13T15:04:29.917182+0000","last_clean":"2024-09-13T15:04:29.917182+0000","last_became_active":"2024-09-13T15:01:44.422297+0000","last_became_peered":"2024-09-13T15:01:44.422297+0000","last_unstale":"2024-09-13T15:04:29.917182+0000","last_undegraded":"2024-09-13T15:04:29.917182+0000","last_fullsized":"2024-09-13T15:04:29.917182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:09.798196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743841+0000","last_change":"2024-09-13T15:01:48.908569+0000","last_active":"2024-09-13T15:02:33.743841+0000","last_peered":"2024-09-13T15:02:33.743841+0000","last_clean":"2024-09-13T15:02:33.743841+0000","last_became_active":"2024-09-13T15:01:48.908118+0000","last_became_peered":"2024-09-13T15:01:48.908118+0000","last_unstale":"2024-09-13T15:02:33.743841+0000","last_undegraded":"2024-09-13T15:02:33.743841+0000","last_fullsized":"2024-09-13T15:02:33.743841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:06.459855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743852+0000","last_change":"2024-09-13T15:01:44.850837+0000","last_active":"2024-09-13T15:02:33.743852+0000","last_peered":"2024-09-13T15:02:33.743852+0000","last_clean":"2024-09-13T15:02:33.743852+0000","last_became_active":"2024-09-13T15:01:44.850263+0000","last_became_peered":"2024-09-13T15:01:44.850263+0000","last_unstale":"2024-09-13T15:02:33.743852+0000","last_undegraded":"2024-09-13T15:02:33.743852+0000","last_fullsized":"2024-09-13T15:02:33.743852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:16.956369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"27'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:03:48.882165+0000","last_change":"2024-09-13T15:01:44.399163+0000","last_active":"2024-09-13T15:03:48.882165+0000","last_peered":"2024-09-13T15:03:48.882165+0000","last_clean":"2024-09-13T15:03:48.882165+0000","last_became_active":"2024-09-13T15:01:44.398881+0000","last_became_peered":"2024-09-13T15:01:44.398881+0000","last_unstale":"2024-09-13T15:03:48.882165+0000","last_undegraded":"2024-09-13T15:03:48.882165+0000","last_fullsized":"2024-09-13T15:03:48.882165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:49.622676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743584+0000","last_change":"2024-09-13T15:01:48.852798+0000","last_active":"2024-09-13T15:02:33.743584+0000","last_peered":"2024-09-13T15:02:33.743584+0000","last_clean":"2024-09-13T15:02:33.743584+0000","last_became_active":"2024-09-13T15:01:48.851948+0000","last_became_peered":"2024-09-13T15:01:48.851948+0000","last_unstale":"2024-09-13T15:02:33.743584+0000","last_undegraded":"2024-09-13T15:02:33.743584+0000","last_fullsized":"2024-09-13T15:02:33.743584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:20.061043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749414+0000","last_change":"2024-09-13T15:01:44.824074+0000","last_active":"2024-09-13T15:02:33.749414+0000","last_peered":"2024-09-13T15:02:33.749414+0000","last_clean":"2024-09-13T15:02:33.749414+0000","last_became_active":"2024-09-13T15:01:44.821475+0000","last_became_peered":"2024-09-13T15:01:44.821475+0000","last_unstale":"2024-09-13T15:02:33.749414+0000","last_undegraded":"2024-09-13T15:02:33.749414+0000","last_fullsized":"2024-09-13T15:02:33.749414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:21.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.935937+0000","last_change":"2024-09-13T15:01:44.433502+0000","last_active":"2024-09-13T15:04:35.935937+0000","last_peered":"2024-09-13T15:04:35.935937+0000","last_clean":"2024-09-13T15:04:35.935937+0000","last_became_active":"2024-09-13T15:01:44.432902+0000","last_became_peered":"2024-09-13T15:01:44.432902+0000","last_unstale":"2024-09-13T15:04:35.935937+0000","last_undegraded":"2024-09-13T15:04:35.935937+0000","last_fullsized":"2024-09-13T15:04:35.935937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:59.189559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743046+0000","last_change":"2024-09-13T15:01:48.846695+0000","last_active":"2024-09-13T15:02:33.743046+0000","last_peered":"2024-09-13T15:02:33.743046+0000","last_clean":"2024-09-13T15:02:33.743046+0000","last_became_active":"2024-09-13T15:01:48.846301+0000","last_became_peered":"2024-09-13T15:01:48.846301+0000","last_unstale":"2024-09-13T15:02:33.743046+0000","last_undegraded":"2024-09-13T15:02:33.743046+0000","last_fullsized":"2024-09-13T15:02:33.743046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:17.532499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741535+0000","last_change":"2024-09-13T15:01:44.814483+0000","last_active":"2024-09-13T15:02:33.741535+0000","last_peered":"2024-09-13T15:02:33.741535+0000","last_clean":"2024-09-13T15:02:33.741535+0000","last_became_active":"2024-09-13T15:01:44.814192+0000","last_became_peered":"2024-09-13T15:01:44.814192+0000","last_unstale":"2024-09-13T15:02:33.741535+0000","last_undegraded":"2024-09-13T15:02:33.741535+0000","last_fullsized":"2024-09-13T15:02:33.741535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:32:30.303635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:23.881464+0000","last_change":"2024-09-13T15:01:44.399314+0000","last_active":"2024-09-13T15:04:23.881464+0000","last_peered":"2024-09-13T15:04:23.881464+0000","last_clean":"2024-09-13T15:04:23.881464+0000","last_became_active":"2024-09-13T15:01:44.398904+0000","last_became_peered":"2024-09-13T15:01:44.398904+0000","last_unstale":"2024-09-13T15:04:23.881464+0000","last_undegraded":"2024-09-13T15:04:23.881464+0000","last_fullsized":"2024-09-13T15:04:23.881464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.645179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741624+0000","last_change":"2024-09-13T15:01:48.859142+0000","last_active":"2024-09-13T15:02:33.741624+0000","last_peered":"2024-09-13T15:02:33.741624+0000","last_clean":"2024-09-13T15:02:33.741624+0000","last_became_active":"2024-09-13T15:01:48.858649+0000","last_became_peered":"2024-09-13T15:01:48.858649+0000","last_unstale":"2024-09-13T15:02:33.741624+0000","last_undegraded":"2024-09-13T15:02:33.741624+0000","last_fullsized":"2024-09-13T15:02:33.741624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:27.314012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743419+0000","last_change":"2024-09-13T15:01:44.826501+0000","last_active":"2024-09-13T15:02:33.743419+0000","last_peered":"2024-09-13T15:02:33.743419+0000","last_clean":"2024-09-13T15:02:33.743419+0000","last_became_active":"2024-09-13T15:01:44.826222+0000","last_became_peered":"2024-09-13T15:01:44.826222+0000","last_unstale":"2024-09-13T15:02:33.743419+0000","last_undegraded":"2024-09-13T15:02:33.743419+0000","last_fullsized":"2024-09-13T15:02:33.743419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:00.543916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:23.881579+0000","last_change":"2024-09-13T15:01:44.421891+0000","last_active":"2024-09-13T15:04:23.881579+0000","last_peered":"2024-09-13T15:04:23.881579+0000","last_clean":"2024-09-13T15:04:23.881579+0000","last_became_active":"2024-09-13T15:01:44.419660+0000","last_became_peered":"2024-09-13T15:01:44.419660+0000","last_unstale":"2024-09-13T15:04:23.881579+0000","last_undegraded":"2024-09-13T15:04:23.881579+0000","last_fullsized":"2024-09-13T15:04:23.881579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:27.554128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.120816+0000","last_change":"2024-09-13T15:02:34.119111+0000","last_active":"2024-09-13T15:02:34.120816+0000","last_peered":"2024-09-13T15:02:34.120816+0000","last_clean":"2024-09-13T15:02:34.120816+0000","last_became_active":"2024-09-13T15:02:34.118461+0000","last_became_peered":"2024-09-13T15:02:34.118461+0000","last_unstale":"2024-09-13T15:02:34.120816+0000","last_undegraded":"2024-09-13T15:02:34.120816+0000","last_fullsized":"2024-09-13T15:02:34.120816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:35.096846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738701+0000","last_change":"2024-09-13T15:01:44.850498+0000","last_active":"2024-09-13T15:02:33.738701+0000","last_peered":"2024-09-13T15:02:33.738701+0000","last_clean":"2024-09-13T15:02:33.738701+0000","last_became_active":"2024-09-13T15:01:44.850234+0000","last_became_peered":"2024-09-13T15:01:44.850234+0000","last_unstale":"2024-09-13T15:02:33.738701+0000","last_undegraded":"2024-09-13T15:02:33.738701+0000","last_fullsized":"2024-09-13T15:02:33.738701+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:37.202494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.912171+0000","last_change":"2024-09-13T15:01:44.411997+0000","last_active":"2024-09-13T15:04:29.912171+0000","last_peered":"2024-09-13T15:04:29.912171+0000","last_clean":"2024-09-13T15:04:29.912171+0000","last_became_active":"2024-09-13T15:01:44.410675+0000","last_became_peered":"2024-09-13T15:01:44.410675+0000","last_unstale":"2024-09-13T15:04:29.912171+0000","last_undegraded":"2024-09-13T15:04:29.912171+0000","last_fullsized":"2024-09-13T15:04:29.912171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:50:55.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116345+0000","last_change":"2024-09-13T15:01:40.834440+0000","last_active":"2024-09-13T15:02:34.116345+0000","last_peered":"2024-09-13T15:02:34.116345+0000","last_clean":"2024-09-13T15:02:34.116345+0000","last_became_active":"2024-09-13T15:01:40.832279+0000","last_became_peered":"2024-09-13T15:01:40.832279+0000","last_unstale":"2024-09-13T15:02:34.116345+0000","last_undegraded":"2024-09-13T15:02:34.116345+0000","last_fullsized":"2024-09-13T15:02:34.116345+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_clean_scrub_stamp":"2024-09-13T15:01:39.264455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:11.875506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743545+0000","last_change":"2024-09-13T15:01:48.919580+0000","last_active":"2024-09-13T15:02:33.743545+0000","last_peered":"2024-09-13T15:02:33.743545+0000","last_clean":"2024-09-13T15:02:33.743545+0000","last_became_active":"2024-09-13T15:01:48.918678+0000","last_became_peered":"2024-09-13T15:01:48.918678+0000","last_unstale":"2024-09-13T15:02:33.743545+0000","last_undegraded":"2024-09-13T15:02:33.743545+0000","last_fullsized":"2024-09-13T15:02:33.743545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:02.840528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116879+0000","last_change":"2024-09-13T15:01:44.849975+0000","last_active":"2024-09-13T15:02:34.116879+0000","last_peered":"2024-09-13T15:02:34.116879+0000","last_clean":"2024-09-13T15:02:34.116879+0000","last_became_active":"2024-09-13T15:01:44.849457+0000","last_became_peered":"2024-09-13T15:01:44.849457+0000","last_unstale":"2024-09-13T15:02:34.116879+0000","last_undegraded":"2024-09-13T15:02:34.116879+0000","last_fullsized":"2024-09-13T15:02:34.116879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:51.139153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"27'6","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.918513+0000","last_change":"2024-09-13T15:01:44.420906+0000","last_active":"2024-09-13T15:04:29.918513+0000","last_peered":"2024-09-13T15:04:29.918513+0000","last_clean":"2024-09-13T15:04:29.918513+0000","last_became_active":"2024-09-13T15:01:44.420601+0000","last_became_peered":"2024-09-13T15:01:44.420601+0000","last_unstale":"2024-09-13T15:04:29.918513+0000","last_undegraded":"2024-09-13T15:04:29.918513+0000","last_fullsized":"2024-09-13T15:04:29.918513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:33.245745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1381,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741847+0000","last_change":"2024-09-13T15:01:48.911047+0000","last_active":"2024-09-13T15:02:33.741847+0000","last_peered":"2024-09-13T15:02:33.741847+0000","last_clean":"2024-09-13T15:02:33.741847+0000","last_became_active":"2024-09-13T15:01:48.910479+0000","last_became_peered":"2024-09-13T15:01:48.910479+0000","last_unstale":"2024-09-13T15:02:33.741847+0000","last_undegraded":"2024-09-13T15:02:33.741847+0000","last_fullsized":"2024-09-13T15:02:33.741847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:06.558889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745346+0000","last_change":"2024-09-13T15:01:44.838098+0000","last_active":"2024-09-13T15:02:33.745346+0000","last_peered":"2024-09-13T15:02:33.745346+0000","last_clean":"2024-09-13T15:02:33.745346+0000","last_became_active":"2024-09-13T15:01:44.837429+0000","last_became_peered":"2024-09-13T15:01:44.837429+0000","last_unstale":"2024-09-13T15:02:33.745346+0000","last_undegraded":"2024-09-13T15:02:33.745346+0000","last_fullsized":"2024-09-13T15:02:33.745346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:37.795841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.913130+0000","last_change":"2024-09-13T15:01:44.406999+0000","last_active":"2024-09-13T15:04:29.913130+0000","last_peered":"2024-09-13T15:04:29.913130+0000","last_clean":"2024-09-13T15:04:29.913130+0000","last_became_active":"2024-09-13T15:01:44.406719+0000","last_became_peered":"2024-09-13T15:01:44.406719+0000","last_unstale":"2024-09-13T15:04:29.913130+0000","last_undegraded":"2024-09-13T15:04:29.913130+0000","last_fullsized":"2024-09-13T15:04:29.913130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:33.397091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743939+0000","last_change":"2024-09-13T15:01:48.857931+0000","last_active":"2024-09-13T15:02:33.743939+0000","last_peered":"2024-09-13T15:02:33.743939+0000","last_clean":"2024-09-13T15:02:33.743939+0000","last_became_active":"2024-09-13T15:01:48.857542+0000","last_became_peered":"2024-09-13T15:01:48.857542+0000","last_unstale":"2024-09-13T15:02:33.743939+0000","last_undegraded":"2024-09-13T15:02:33.743939+0000","last_fullsized":"2024-09-13T15:02:33.743939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:32.805405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118403+0000","last_change":"2024-09-13T15:01:44.835470+0000","last_active":"2024-09-13T15:02:34.118403+0000","last_peered":"2024-09-13T15:02:34.118403+0000","last_clean":"2024-09-13T15:02:34.118403+0000","last_became_active":"2024-09-13T15:01:44.831166+0000","last_became_peered":"2024-09-13T15:01:44.831166+0000","last_unstale":"2024-09-13T15:02:34.118403+0000","last_undegraded":"2024-09-13T15:02:34.118403+0000","last_fullsized":"2024-09-13T15:02:34.118403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:05.887592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.929024+0000","last_change":"2024-09-13T15:01:44.403111+0000","last_active":"2024-09-13T15:04:35.929024+0000","last_peered":"2024-09-13T15:04:35.929024+0000","last_clean":"2024-09-13T15:04:35.929024+0000","last_became_active":"2024-09-13T15:01:44.401799+0000","last_became_peered":"2024-09-13T15:01:44.401799+0000","last_unstale":"2024-09-13T15:04:35.929024+0000","last_undegraded":"2024-09-13T15:04:35.929024+0000","last_fullsized":"2024-09-13T15:04:35.929024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:54.589470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740292+0000","last_change":"2024-09-13T15:01:48.912490+0000","last_active":"2024-09-13T15:02:33.740292+0000","last_peered":"2024-09-13T15:02:33.740292+0000","last_clean":"2024-09-13T15:02:33.740292+0000","last_became_active":"2024-09-13T15:01:48.911474+0000","last_became_peered":"2024-09-13T15:01:48.911474+0000","last_unstale":"2024-09-13T15:02:33.740292+0000","last_undegraded":"2024-09-13T15:02:33.740292+0000","last_fullsized":"2024-09-13T15:02:33.740292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:54.295921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117960+0000","last_change":"2024-09-13T15:01:44.818472+0000","last_active":"2024-09-13T15:02:34.117960+0000","last_peered":"2024-09-13T15:02:34.117960+0000","last_clean":"2024-09-13T15:02:34.117960+0000","last_became_active":"2024-09-13T15:01:44.817718+0000","last_became_peered":"2024-09-13T15:01:44.817718+0000","last_unstale":"2024-09-13T15:02:34.117960+0000","last_undegraded":"2024-09-13T15:02:34.117960+0000","last_fullsized":"2024-09-13T15:02:34.117960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:21.310696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:03:58.897497+0000","last_change":"2024-09-13T15:01:44.410376+0000","last_active":"2024-09-13T15:03:58.897497+0000","last_peered":"2024-09-13T15:03:58.897497+0000","last_clean":"2024-09-13T15:03:58.897497+0000","last_became_active":"2024-09-13T15:01:44.409585+0000","last_became_peered":"2024-09-13T15:01:44.409585+0000","last_unstale":"2024-09-13T15:03:58.897497+0000","last_undegraded":"2024-09-13T15:03:58.897497+0000","last_fullsized":"2024-09-13T15:03:58.897497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:45.845804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.747358+0000","last_change":"2024-09-13T15:01:48.861130+0000","last_active":"2024-09-13T15:02:33.747358+0000","last_peered":"2024-09-13T15:02:33.747358+0000","last_clean":"2024-09-13T15:02:33.747358+0000","last_became_active":"2024-09-13T15:01:48.860317+0000","last_became_peered":"2024-09-13T15:01:48.860317+0000","last_unstale":"2024-09-13T15:02:33.747358+0000","last_undegraded":"2024-09-13T15:02:33.747358+0000","last_fullsized":"2024-09-13T15:02:33.747358+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:45.317747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116786+0000","last_change":"2024-09-13T15:01:44.835494+0000","last_active":"2024-09-13T15:02:34.116786+0000","last_peered":"2024-09-13T15:02:34.116786+0000","last_clean":"2024-09-13T15:02:34.116786+0000","last_became_active":"2024-09-13T15:01:44.831150+0000","last_became_peered":"2024-09-13T15:01:44.831150+0000","last_unstale":"2024-09-13T15:02:34.116786+0000","last_undegraded":"2024-09-13T15:02:34.116786+0000","last_fullsized":"2024-09-13T15:02:34.116786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:29.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"27'17","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.912072+0000","last_change":"2024-09-13T15:01:44.390278+0000","last_active":"2024-09-13T15:04:29.912072+0000","last_peered":"2024-09-13T15:04:29.912072+0000","last_clean":"2024-09-13T15:04:29.912072+0000","last_became_active":"2024-09-13T15:01:44.389946+0000","last_became_peered":"2024-09-13T15:01:44.389946+0000","last_unstale":"2024-09-13T15:04:29.912072+0000","last_undegraded":"2024-09-13T15:04:29.912072+0000","last_fullsized":"2024-09-13T15:04:29.912072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:53.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744367+0000","last_change":"2024-09-13T15:01:48.848009+0000","last_active":"2024-09-13T15:02:33.744367+0000","last_peered":"2024-09-13T15:02:33.744367+0000","last_clean":"2024-09-13T15:02:33.744367+0000","last_became_active":"2024-09-13T15:01:48.847605+0000","last_became_peered":"2024-09-13T15:01:48.847605+0000","last_unstale":"2024-09-13T15:02:33.744367+0000","last_undegraded":"2024-09-13T15:02:33.744367+0000","last_fullsized":"2024-09-13T15:02:33.744367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:32.053010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741353+0000","last_change":"2024-09-13T15:01:44.808572+0000","last_active":"2024-09-13T15:02:33.741353+0000","last_peered":"2024-09-13T15:02:33.741353+0000","last_clean":"2024-09-13T15:02:33.741353+0000","last_became_active":"2024-09-13T15:01:44.808140+0000","last_became_peered":"2024-09-13T15:01:44.808140+0000","last_unstale":"2024-09-13T15:02:33.741353+0000","last_undegraded":"2024-09-13T15:02:33.741353+0000","last_fullsized":"2024-09-13T15:02:33.741353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:15.497720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.918281+0000","last_change":"2024-09-13T15:01:44.428794+0000","last_active":"2024-09-13T15:04:29.918281+0000","last_peered":"2024-09-13T15:04:29.918281+0000","last_clean":"2024-09-13T15:04:29.918281+0000","last_became_active":"2024-09-13T15:01:44.428271+0000","last_became_peered":"2024-09-13T15:01:44.428271+0000","last_unstale":"2024-09-13T15:04:29.918281+0000","last_undegraded":"2024-09-13T15:04:29.918281+0000","last_fullsized":"2024-09-13T15:04:29.918281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:53.225826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738469+0000","last_change":"2024-09-13T15:01:48.916354+0000","last_active":"2024-09-13T15:02:33.738469+0000","last_peered":"2024-09-13T15:02:33.738469+0000","last_clean":"2024-09-13T15:02:33.738469+0000","last_became_active":"2024-09-13T15:01:48.916008+0000","last_became_peered":"2024-09-13T15:01:48.916008+0000","last_unstale":"2024-09-13T15:02:33.738469+0000","last_undegraded":"2024-09-13T15:02:33.738469+0000","last_fullsized":"2024-09-13T15:02:33.738469+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:58.115410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116589+0000","last_change":"2024-09-13T15:01:44.826700+0000","last_active":"2024-09-13T15:02:34.116589+0000","last_peered":"2024-09-13T15:02:34.116589+0000","last_clean":"2024-09-13T15:02:34.116589+0000","last_became_active":"2024-09-13T15:01:44.825996+0000","last_became_peered":"2024-09-13T15:01:44.825996+0000","last_unstale":"2024-09-13T15:02:34.116589+0000","last_undegraded":"2024-09-13T15:02:34.116589+0000","last_fullsized":"2024-09-13T15:02:34.116589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:11.963837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.912045+0000","last_change":"2024-09-13T15:01:44.409339+0000","last_active":"2024-09-13T15:04:29.912045+0000","last_peered":"2024-09-13T15:04:29.912045+0000","last_clean":"2024-09-13T15:04:29.912045+0000","last_became_active":"2024-09-13T15:01:44.408644+0000","last_became_peered":"2024-09-13T15:01:44.408644+0000","last_unstale":"2024-09-13T15:04:29.912045+0000","last_undegraded":"2024-09-13T15:04:29.912045+0000","last_fullsized":"2024-09-13T15:04:29.912045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:29.297950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737959+0000","last_change":"2024-09-13T15:01:48.916478+0000","last_active":"2024-09-13T15:02:33.737959+0000","last_peered":"2024-09-13T15:02:33.737959+0000","last_clean":"2024-09-13T15:02:33.737959+0000","last_became_active":"2024-09-13T15:01:48.916198+0000","last_became_peered":"2024-09-13T15:01:48.916198+0000","last_unstale":"2024-09-13T15:02:33.737959+0000","last_undegraded":"2024-09-13T15:02:33.737959+0000","last_fullsized":"2024-09-13T15:02:33.737959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:26.311460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743617+0000","last_change":"2024-09-13T15:01:44.831833+0000","last_active":"2024-09-13T15:02:33.743617+0000","last_peered":"2024-09-13T15:02:33.743617+0000","last_clean":"2024-09-13T15:02:33.743617+0000","last_became_active":"2024-09-13T15:01:44.831583+0000","last_became_peered":"2024-09-13T15:01:44.831583+0000","last_unstale":"2024-09-13T15:02:33.743617+0000","last_undegraded":"2024-09-13T15:02:33.743617+0000","last_fullsized":"2024-09-13T15:02:33.743617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.715951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'9","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.931315+0000","last_change":"2024-09-13T15:01:44.408752+0000","last_active":"2024-09-13T15:04:35.931315+0000","last_peered":"2024-09-13T15:04:35.931315+0000","last_clean":"2024-09-13T15:04:35.931315+0000","last_became_active":"2024-09-13T15:01:44.408453+0000","last_became_peered":"2024-09-13T15:01:44.408453+0000","last_unstale":"2024-09-13T15:04:35.931315+0000","last_undegraded":"2024-09-13T15:04:35.931315+0000","last_fullsized":"2024-09-13T15:04:35.931315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:31.587404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743419+0000","last_change":"2024-09-13T15:01:48.916681+0000","last_active":"2024-09-13T15:02:33.743419+0000","last_peered":"2024-09-13T15:02:33.743419+0000","last_clean":"2024-09-13T15:02:33.743419+0000","last_became_active":"2024-09-13T15:01:48.916185+0000","last_became_peered":"2024-09-13T15:01:48.916185+0000","last_unstale":"2024-09-13T15:02:33.743419+0000","last_undegraded":"2024-09-13T15:02:33.743419+0000","last_fullsized":"2024-09-13T15:02:33.743419+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:33.862835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116757+0000","last_change":"2024-09-13T15:01:44.817007+0000","last_active":"2024-09-13T15:02:34.116757+0000","last_peered":"2024-09-13T15:02:34.116757+0000","last_clean":"2024-09-13T15:02:34.116757+0000","last_became_active":"2024-09-13T15:01:44.815435+0000","last_became_peered":"2024-09-13T15:01:44.815435+0000","last_unstale":"2024-09-13T15:02:34.116757+0000","last_undegraded":"2024-09-13T15:02:34.116757+0000","last_fullsized":"2024-09-13T15:02:34.116757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:25.887993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'14","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.939792+0000","last_change":"2024-09-13T15:01:44.435688+0000","last_active":"2024-09-13T15:04:35.939792+0000","last_peered":"2024-09-13T15:04:35.939792+0000","last_clean":"2024-09-13T15:04:35.939792+0000","last_became_active":"2024-09-13T15:01:44.435222+0000","last_became_peered":"2024-09-13T15:01:44.435222+0000","last_unstale":"2024-09-13T15:04:35.939792+0000","last_undegraded":"2024-09-13T15:04:35.939792+0000","last_fullsized":"2024-09-13T15:04:35.939792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:24.705633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742810+0000","last_change":"2024-09-13T15:01:48.847694+0000","last_active":"2024-09-13T15:02:33.742810+0000","last_peered":"2024-09-13T15:02:33.742810+0000","last_clean":"2024-09-13T15:02:33.742810+0000","last_became_active":"2024-09-13T15:01:48.846835+0000","last_became_peered":"2024-09-13T15:01:48.846835+0000","last_unstale":"2024-09-13T15:02:33.742810+0000","last_undegraded":"2024-09-13T15:02:33.742810+0000","last_fullsized":"2024-09-13T15:02:33.742810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:49.763472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749658+0000","last_change":"2024-09-13T15:01:44.835315+0000","last_active":"2024-09-13T15:02:33.749658+0000","last_peered":"2024-09-13T15:02:33.749658+0000","last_clean":"2024-09-13T15:02:33.749658+0000","last_became_active":"2024-09-13T15:01:44.834643+0000","last_became_peered":"2024-09-13T15:01:44.834643+0000","last_unstale":"2024-09-13T15:02:33.749658+0000","last_undegraded":"2024-09-13T15:02:33.749658+0000","last_fullsized":"2024-09-13T15:02:33.749658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:15.535195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.609255+0000","last_change":"2024-09-13T15:01:44.424966+0000","last_active":"2024-09-13T15:04:17.609255+0000","last_peered":"2024-09-13T15:04:17.609255+0000","last_clean":"2024-09-13T15:04:17.609255+0000","last_became_active":"2024-09-13T15:01:44.424714+0000","last_became_peered":"2024-09-13T15:01:44.424714+0000","last_unstale":"2024-09-13T15:04:17.609255+0000","last_undegraded":"2024-09-13T15:04:17.609255+0000","last_fullsized":"2024-09-13T15:04:17.609255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:46.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.756425+0000","last_change":"2024-09-13T15:02:33.753482+0000","last_active":"2024-09-13T15:02:33.756425+0000","last_peered":"2024-09-13T15:02:33.756425+0000","last_clean":"2024-09-13T15:02:33.756425+0000","last_became_active":"2024-09-13T15:02:33.752505+0000","last_became_peered":"2024-09-13T15:02:33.752505+0000","last_unstale":"2024-09-13T15:02:33.756425+0000","last_undegraded":"2024-09-13T15:02:33.756425+0000","last_fullsized":"2024-09-13T15:02:33.756425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:59.041586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742572+0000","last_change":"2024-09-13T15:01:44.837032+0000","last_active":"2024-09-13T15:02:33.742572+0000","last_peered":"2024-09-13T15:02:33.742572+0000","last_clean":"2024-09-13T15:02:33.742572+0000","last_became_active":"2024-09-13T15:01:44.836750+0000","last_became_peered":"2024-09-13T15:01:44.836750+0000","last_unstale":"2024-09-13T15:02:33.742572+0000","last_undegraded":"2024-09-13T15:02:33.742572+0000","last_fullsized":"2024-09-13T15:02:33.742572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:04.491426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"27'4","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:35.938284+0000","last_change":"2024-09-13T15:01:44.437854+0000","last_active":"2024-09-13T15:04:35.938284+0000","last_peered":"2024-09-13T15:04:35.938284+0000","last_clean":"2024-09-13T15:04:35.938284+0000","last_became_active":"2024-09-13T15:01:44.437433+0000","last_became_peered":"2024-09-13T15:01:44.437433+0000","last_unstale":"2024-09-13T15:04:35.938284+0000","last_undegraded":"2024-09-13T15:04:35.938284+0000","last_fullsized":"2024-09-13T15:04:35.938284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:47.302388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737553+0000","last_change":"2024-09-13T15:01:48.841829+0000","last_active":"2024-09-13T15:02:33.737553+0000","last_peered":"2024-09-13T15:02:33.737553+0000","last_clean":"2024-09-13T15:02:33.737553+0000","last_became_active":"2024-09-13T15:01:48.841267+0000","last_became_peered":"2024-09-13T15:01:48.841267+0000","last_unstale":"2024-09-13T15:02:33.737553+0000","last_undegraded":"2024-09-13T15:02:33.737553+0000","last_fullsized":"2024-09-13T15:02:33.737553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:25.029615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.746815+0000","last_change":"2024-09-13T15:01:44.844701+0000","last_active":"2024-09-13T15:02:33.746815+0000","last_peered":"2024-09-13T15:02:33.746815+0000","last_clean":"2024-09-13T15:02:33.746815+0000","last_became_active":"2024-09-13T15:01:44.843982+0000","last_became_peered":"2024-09-13T15:01:44.843982+0000","last_unstale":"2024-09-13T15:02:33.746815+0000","last_undegraded":"2024-09-13T15:02:33.746815+0000","last_fullsized":"2024-09-13T15:02:33.746815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.914773+0000","last_change":"2024-09-13T15:01:44.436081+0000","last_active":"2024-09-13T15:04:29.914773+0000","last_peered":"2024-09-13T15:04:29.914773+0000","last_clean":"2024-09-13T15:04:29.914773+0000","last_became_active":"2024-09-13T15:01:44.435367+0000","last_became_peered":"2024-09-13T15:01:44.435367+0000","last_unstale":"2024-09-13T15:04:29.914773+0000","last_undegraded":"2024-09-13T15:04:29.914773+0000","last_fullsized":"2024-09-13T15:04:29.914773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:57:57.065719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737590+0000","last_change":"2024-09-13T15:01:48.910562+0000","last_active":"2024-09-13T15:02:33.737590+0000","last_peered":"2024-09-13T15:02:33.737590+0000","last_clean":"2024-09-13T15:02:33.737590+0000","last_became_active":"2024-09-13T15:01:48.909681+0000","last_became_peered":"2024-09-13T15:01:48.909681+0000","last_unstale":"2024-09-13T15:02:33.737590+0000","last_undegraded":"2024-09-13T15:02:33.737590+0000","last_fullsized":"2024-09-13T15:02:33.737590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:35.989769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.120759+0000","last_change":"2024-09-13T15:02:34.118951+0000","last_active":"2024-09-13T15:02:34.120759+0000","last_peered":"2024-09-13T15:02:34.120759+0000","last_clean":"2024-09-13T15:02:34.120759+0000","last_became_active":"2024-09-13T15:02:34.118477+0000","last_became_peered":"2024-09-13T15:02:34.118477+0000","last_unstale":"2024-09-13T15:02:34.120759+0000","last_undegraded":"2024-09-13T15:02:34.120759+0000","last_fullsized":"2024-09-13T15:02:34.120759+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:13.697114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741807+0000","last_change":"2024-09-13T15:01:44.808417+0000","last_active":"2024-09-13T15:02:33.741807+0000","last_peered":"2024-09-13T15:02:33.741807+0000","last_clean":"2024-09-13T15:02:33.741807+0000","last_became_active":"2024-09-13T15:01:44.807641+0000","last_became_peered":"2024-09-13T15:01:44.807641+0000","last_unstale":"2024-09-13T15:02:33.741807+0000","last_undegraded":"2024-09-13T15:02:33.741807+0000","last_fullsized":"2024-09-13T15:02:33.741807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:58.296966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"27'3","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.912543+0000","last_change":"2024-09-13T15:01:44.433582+0000","last_active":"2024-09-13T15:04:29.912543+0000","last_peered":"2024-09-13T15:04:29.912543+0000","last_clean":"2024-09-13T15:04:29.912543+0000","last_became_active":"2024-09-13T15:01:44.433124+0000","last_became_peered":"2024-09-13T15:01:44.433124+0000","last_unstale":"2024-09-13T15:04:29.912543+0000","last_undegraded":"2024-09-13T15:04:29.912543+0000","last_fullsized":"2024-09-13T15:04:29.912543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:04.476996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744178+0000","last_change":"2024-09-13T15:01:48.855090+0000","last_active":"2024-09-13T15:02:33.744178+0000","last_peered":"2024-09-13T15:02:33.744178+0000","last_clean":"2024-09-13T15:02:33.744178+0000","last_became_active":"2024-09-13T15:01:48.852925+0000","last_became_peered":"2024-09-13T15:01:48.852925+0000","last_unstale":"2024-09-13T15:02:33.744178+0000","last_undegraded":"2024-09-13T15:02:33.744178+0000","last_fullsized":"2024-09-13T15:02:33.744178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.176480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748607+0000","last_change":"2024-09-13T15:02:33.746356+0000","last_active":"2024-09-13T15:02:33.748607+0000","last_peered":"2024-09-13T15:02:33.748607+0000","last_clean":"2024-09-13T15:02:33.748607+0000","last_became_active":"2024-09-13T15:02:33.746005+0000","last_became_peered":"2024-09-13T15:02:33.746005+0000","last_unstale":"2024-09-13T15:02:33.748607+0000","last_undegraded":"2024-09-13T15:02:33.748607+0000","last_fullsized":"2024-09-13T15:02:33.748607+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:41.159781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:23.881944+0000","last_change":"2024-09-13T15:01:44.436900+0000","last_active":"2024-09-13T15:04:23.881944+0000","last_peered":"2024-09-13T15:04:23.881944+0000","last_clean":"2024-09-13T15:04:23.881944+0000","last_became_active":"2024-09-13T15:01:44.436646+0000","last_became_peered":"2024-09-13T15:01:44.436646+0000","last_unstale":"2024-09-13T15:04:23.881944+0000","last_undegraded":"2024-09-13T15:04:23.881944+0000","last_fullsized":"2024-09-13T15:04:23.881944+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:52.505856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"27'7","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:29.920613+0000","last_change":"2024-09-13T15:01:44.430115+0000","last_active":"2024-09-13T15:04:29.920613+0000","last_peered":"2024-09-13T15:04:29.920613+0000","last_clean":"2024-09-13T15:04:29.920613+0000","last_became_active":"2024-09-13T15:01:44.429339+0000","last_became_peered":"2024-09-13T15:01:44.429339+0000","last_unstale":"2024-09-13T15:04:29.920613+0000","last_undegraded":"2024-09-13T15:04:29.920613+0000","last_fullsized":"2024-09-13T15:04:29.920613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:47.224125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744095+0000","last_change":"2024-09-13T15:01:44.822034+0000","last_active":"2024-09-13T15:02:33.744095+0000","last_peered":"2024-09-13T15:02:33.744095+0000","last_clean":"2024-09-13T15:02:33.744095+0000","last_became_active":"2024-09-13T15:01:44.821734+0000","last_became_peered":"2024-09-13T15:01:44.821734+0000","last_unstale":"2024-09-13T15:02:33.744095+0000","last_undegraded":"2024-09-13T15:02:33.744095+0000","last_fullsized":"2024-09-13T15:02:33.744095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:57:44.629046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741811+0000","last_change":"2024-09-13T15:01:48.858033+0000","last_active":"2024-09-13T15:02:33.741811+0000","last_peered":"2024-09-13T15:02:33.741811+0000","last_clean":"2024-09-13T15:02:33.741811+0000","last_became_active":"2024-09-13T15:01:48.857584+0000","last_became_peered":"2024-09-13T15:01:48.857584+0000","last_unstale":"2024-09-13T15:02:33.741811+0000","last_undegraded":"2024-09-13T15:02:33.741811+0000","last_fullsized":"2024-09-13T15:02:33.741811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:04.797167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"27'5","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:04:17.610821+0000","last_change":"2024-09-13T15:01:44.422582+0000","last_active":"2024-09-13T15:04:17.610821+0000","last_peered":"2024-09-13T15:04:17.610821+0000","last_clean":"2024-09-13T15:04:17.610821+0000","last_became_active":"2024-09-13T15:01:44.422367+0000","last_became_peered":"2024-09-13T15:01:44.422367+0000","last_unstale":"2024-09-13T15:04:17.610821+0000","last_undegraded":"2024-09-13T15:04:17.610821+0000","last_fullsized":"2024-09-13T15:04:17.610821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.902724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.748800+0000","last_change":"2024-09-13T15:01:44.820841+0000","last_active":"2024-09-13T15:02:33.748800+0000","last_peered":"2024-09-13T15:02:33.748800+0000","last_clean":"2024-09-13T15:02:33.748800+0000","last_became_active":"2024-09-13T15:01:44.816584+0000","last_became_peered":"2024-09-13T15:01:44.816584+0000","last_unstale":"2024-09-13T15:02:33.748800+0000","last_undegraded":"2024-09-13T15:02:33.748800+0000","last_fullsized":"2024-09-13T15:02:33.748800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:26.763818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738483+0000","last_change":"2024-09-13T15:01:48.840771+0000","last_active":"2024-09-13T15:02:33.738483+0000","last_peered":"2024-09-13T15:02:33.738483+0000","last_clean":"2024-09-13T15:02:33.738483+0000","last_became_active":"2024-09-13T15:01:48.840397+0000","last_became_peered":"2024-09-13T15:01:48.840397+0000","last_unstale":"2024-09-13T15:02:33.738483+0000","last_undegraded":"2024-09-13T15:02:33.738483+0000","last_fullsized":"2024-09-13T15:02:33.738483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:59.700088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741113+0000","last_change":"2024-09-13T15:01:44.809497+0000","last_active":"2024-09-13T15:02:33.741113+0000","last_peered":"2024-09-13T15:02:33.741113+0000","last_clean":"2024-09-13T15:02:33.741113+0000","last_became_active":"2024-09-13T15:01:44.808669+0000","last_became_peered":"2024-09-13T15:01:44.808669+0000","last_unstale":"2024-09-13T15:02:33.741113+0000","last_undegraded":"2024-09-13T15:02:33.741113+0000","last_fullsized":"2024-09-13T15:02:33.741113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:45.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744117+0000","last_change":"2024-09-13T15:01:44.836353+0000","last_active":"2024-09-13T15:02:33.744117+0000","last_peered":"2024-09-13T15:02:33.744117+0000","last_clean":"2024-09-13T15:02:33.744117+0000","last_became_active":"2024-09-13T15:01:44.836102+0000","last_became_peered":"2024-09-13T15:01:44.836102+0000","last_unstale":"2024-09-13T15:02:33.744117+0000","last_undegraded":"2024-09-13T15:02:33.744117+0000","last_fullsized":"2024-09-13T15:02:33.744117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:14.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741973+0000","last_change":"2024-09-13T15:01:44.849091+0000","last_active":"2024-09-13T15:02:33.741973+0000","last_peered":"2024-09-13T15:02:33.741973+0000","last_clean":"2024-09-13T15:02:33.741973+0000","last_became_active":"2024-09-13T15:01:44.846506+0000","last_became_peered":"2024-09-13T15:01:44.846506+0000","last_unstale":"2024-09-13T15:02:33.741973+0000","last_undegraded":"2024-09-13T15:02:33.741973+0000","last_fullsized":"2024-09-13T15:02:33.741973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:38.026998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743939+0000","last_change":"2024-09-13T15:01:44.809873+0000","last_active":"2024-09-13T15:02:33.743939+0000","last_peered":"2024-09-13T15:02:33.743939+0000","last_clean":"2024-09-13T15:02:33.743939+0000","last_became_active":"2024-09-13T15:01:44.809585+0000","last_became_peered":"2024-09-13T15:01:44.809585+0000","last_unstale":"2024-09-13T15:02:33.743939+0000","last_undegraded":"2024-09-13T15:02:33.743939+0000","last_fullsized":"2024-09-13T15:02:33.743939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:20.272320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738378+0000","last_change":"2024-09-13T15:01:44.816761+0000","last_active":"2024-09-13T15:02:33.738378+0000","last_peered":"2024-09-13T15:02:33.738378+0000","last_clean":"2024-09-13T15:02:33.738378+0000","last_became_active":"2024-09-13T15:01:44.816480+0000","last_became_peered":"2024-09-13T15:01:44.816480+0000","last_unstale":"2024-09-13T15:02:33.738378+0000","last_undegraded":"2024-09-13T15:02:33.738378+0000","last_fullsized":"2024-09-13T15:02:33.738378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:46.000440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742115+0000","last_change":"2024-09-13T15:01:44.808373+0000","last_active":"2024-09-13T15:02:33.742115+0000","last_peered":"2024-09-13T15:02:33.742115+0000","last_clean":"2024-09-13T15:02:33.742115+0000","last_became_active":"2024-09-13T15:01:44.807622+0000","last_became_peered":"2024-09-13T15:01:44.807622+0000","last_unstale":"2024-09-13T15:02:33.742115+0000","last_undegraded":"2024-09-13T15:02:33.742115+0000","last_fullsized":"2024-09-13T15:02:33.742115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:38.584426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.745064+0000","last_change":"2024-09-13T15:01:44.832521+0000","last_active":"2024-09-13T15:02:33.745064+0000","last_peered":"2024-09-13T15:02:33.745064+0000","last_clean":"2024-09-13T15:02:33.745064+0000","last_became_active":"2024-09-13T15:01:44.831889+0000","last_became_peered":"2024-09-13T15:01:44.831889+0000","last_unstale":"2024-09-13T15:02:33.745064+0000","last_undegraded":"2024-09-13T15:02:33.745064+0000","last_fullsized":"2024-09-13T15:02:33.745064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:07.563684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738576+0000","last_change":"2024-09-13T15:01:44.817583+0000","last_active":"2024-09-13T15:02:33.738576+0000","last_peered":"2024-09-13T15:02:33.738576+0000","last_clean":"2024-09-13T15:02:33.738576+0000","last_became_active":"2024-09-13T15:01:44.817350+0000","last_became_peered":"2024-09-13T15:01:44.817350+0000","last_unstale":"2024-09-13T15:02:33.738576+0000","last_undegraded":"2024-09-13T15:02:33.738576+0000","last_fullsized":"2024-09-13T15:02:33.738576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:10.913776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740529+0000","last_change":"2024-09-13T15:01:44.838372+0000","last_active":"2024-09-13T15:02:33.740529+0000","last_peered":"2024-09-13T15:02:33.740529+0000","last_clean":"2024-09-13T15:02:33.740529+0000","last_became_active":"2024-09-13T15:01:44.837588+0000","last_became_peered":"2024-09-13T15:01:44.837588+0000","last_unstale":"2024-09-13T15:02:33.740529+0000","last_undegraded":"2024-09-13T15:02:33.740529+0000","last_fullsized":"2024-09-13T15:02:33.740529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:05:12.877936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737718+0000","last_change":"2024-09-13T15:01:44.828159+0000","last_active":"2024-09-13T15:02:33.737718+0000","last_peered":"2024-09-13T15:02:33.737718+0000","last_clean":"2024-09-13T15:02:33.737718+0000","last_became_active":"2024-09-13T15:01:44.827910+0000","last_became_peered":"2024-09-13T15:01:44.827910+0000","last_unstale":"2024-09-13T15:02:33.737718+0000","last_undegraded":"2024-09-13T15:02:33.737718+0000","last_fullsized":"2024-09-13T15:02:33.737718+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:07:32.776119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.121188+0000","last_change":"2024-09-13T15:02:34.119204+0000","last_active":"2024-09-13T15:02:34.121188+0000","last_peered":"2024-09-13T15:02:34.121188+0000","last_clean":"2024-09-13T15:02:34.121188+0000","last_became_active":"2024-09-13T15:02:34.118621+0000","last_became_peered":"2024-09-13T15:02:34.118621+0000","last_unstale":"2024-09-13T15:02:34.121188+0000","last_undegraded":"2024-09-13T15:02:34.121188+0000","last_fullsized":"2024-09-13T15:02:34.121188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:33.356064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743857+0000","last_change":"2024-09-13T15:01:44.831717+0000","last_active":"2024-09-13T15:02:33.743857+0000","last_peered":"2024-09-13T15:02:33.743857+0000","last_clean":"2024-09-13T15:02:33.743857+0000","last_became_active":"2024-09-13T15:01:44.831495+0000","last_became_peered":"2024-09-13T15:01:44.831495+0000","last_unstale":"2024-09-13T15:02:33.743857+0000","last_undegraded":"2024-09-13T15:02:33.743857+0000","last_fullsized":"2024-09-13T15:02:33.743857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:48.753543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743869+0000","last_change":"2024-09-13T15:01:44.829698+0000","last_active":"2024-09-13T15:02:33.743869+0000","last_peered":"2024-09-13T15:02:33.743869+0000","last_clean":"2024-09-13T15:02:33.743869+0000","last_became_active":"2024-09-13T15:01:44.828999+0000","last_became_peered":"2024-09-13T15:01:44.828999+0000","last_unstale":"2024-09-13T15:02:33.743869+0000","last_undegraded":"2024-09-13T15:02:33.743869+0000","last_fullsized":"2024-09-13T15:02:33.743869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:30.591718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.117647+0000","last_change":"2024-09-13T15:01:44.817554+0000","last_active":"2024-09-13T15:02:34.117647+0000","last_peered":"2024-09-13T15:02:34.117647+0000","last_clean":"2024-09-13T15:02:34.117647+0000","last_became_active":"2024-09-13T15:01:44.816258+0000","last_became_peered":"2024-09-13T15:01:44.816258+0000","last_unstale":"2024-09-13T15:02:34.117647+0000","last_undegraded":"2024-09-13T15:02:34.117647+0000","last_fullsized":"2024-09-13T15:02:34.117647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:07.927802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742322+0000","last_change":"2024-09-13T15:01:44.809979+0000","last_active":"2024-09-13T15:02:33.742322+0000","last_peered":"2024-09-13T15:02:33.742322+0000","last_clean":"2024-09-13T15:02:33.742322+0000","last_became_active":"2024-09-13T15:01:44.809687+0000","last_became_peered":"2024-09-13T15:01:44.809687+0000","last_unstale":"2024-09-13T15:02:33.742322+0000","last_undegraded":"2024-09-13T15:02:33.742322+0000","last_fullsized":"2024-09-13T15:02:33.742322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:45.583840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.119233+0000","last_change":"2024-09-13T15:02:34.119233+0000","last_active":"2024-09-13T15:02:34.119233+0000","last_peered":"2024-09-13T15:02:34.119233+0000","last_clean":"2024-09-13T15:02:34.119233+0000","last_became_active":"2024-09-13T15:02:34.118798+0000","last_became_peered":"2024-09-13T15:02:34.118798+0000","last_unstale":"2024-09-13T15:02:34.119233+0000","last_undegraded":"2024-09-13T15:02:34.119233+0000","last_fullsized":"2024-09-13T15:02:34.119233+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:12.367569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.740392+0000","last_change":"2024-09-13T15:01:44.848904+0000","last_active":"2024-09-13T15:02:33.740392+0000","last_peered":"2024-09-13T15:02:33.740392+0000","last_clean":"2024-09-13T15:02:33.740392+0000","last_became_active":"2024-09-13T15:01:44.846074+0000","last_became_peered":"2024-09-13T15:01:44.846074+0000","last_unstale":"2024-09-13T15:02:33.740392+0000","last_undegraded":"2024-09-13T15:02:33.740392+0000","last_fullsized":"2024-09-13T15:02:33.740392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:37.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741904+0000","last_change":"2024-09-13T15:01:44.828243+0000","last_active":"2024-09-13T15:02:33.741904+0000","last_peered":"2024-09-13T15:02:33.741904+0000","last_clean":"2024-09-13T15:02:33.741904+0000","last_became_active":"2024-09-13T15:01:44.828024+0000","last_became_peered":"2024-09-13T15:01:44.828024+0000","last_unstale":"2024-09-13T15:02:33.741904+0000","last_undegraded":"2024-09-13T15:02:33.741904+0000","last_fullsized":"2024-09-13T15:02:33.741904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:28:47.388087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.743573+0000","last_change":"2024-09-13T15:01:44.808879+0000","last_active":"2024-09-13T15:02:33.743573+0000","last_peered":"2024-09-13T15:02:33.743573+0000","last_clean":"2024-09-13T15:02:33.743573+0000","last_became_active":"2024-09-13T15:01:44.808609+0000","last_became_peered":"2024-09-13T15:01:44.808609+0000","last_unstale":"2024-09-13T15:02:33.743573+0000","last_undegraded":"2024-09-13T15:02:33.743573+0000","last_fullsized":"2024-09-13T15:02:33.743573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:59.817452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.738213+0000","last_change":"2024-09-13T15:01:44.811171+0000","last_active":"2024-09-13T15:02:33.738213+0000","last_peered":"2024-09-13T15:02:33.738213+0000","last_clean":"2024-09-13T15:02:33.738213+0000","last_became_active":"2024-09-13T15:01:44.809918+0000","last_became_peered":"2024-09-13T15:01:44.809918+0000","last_unstale":"2024-09-13T15:02:33.738213+0000","last_undegraded":"2024-09-13T15:02:33.738213+0000","last_fullsized":"2024-09-13T15:02:33.738213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:48.359429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.749385+0000","last_change":"2024-09-13T15:01:44.833663+0000","last_active":"2024-09-13T15:02:33.749385+0000","last_peered":"2024-09-13T15:02:33.749385+0000","last_clean":"2024-09-13T15:02:33.749385+0000","last_became_active":"2024-09-13T15:01:44.828737+0000","last_became_peered":"2024-09-13T15:01:44.828737+0000","last_unstale":"2024-09-13T15:02:33.749385+0000","last_undegraded":"2024-09-13T15:02:33.749385+0000","last_fullsized":"2024-09-13T15:02:33.749385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:08.579890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744005+0000","last_change":"2024-09-13T15:01:44.851143+0000","last_active":"2024-09-13T15:02:33.744005+0000","last_peered":"2024-09-13T15:02:33.744005+0000","last_clean":"2024-09-13T15:02:33.744005+0000","last_became_active":"2024-09-13T15:01:44.850410+0000","last_became_peered":"2024-09-13T15:01:44.850410+0000","last_unstale":"2024-09-13T15:02:33.744005+0000","last_undegraded":"2024-09-13T15:02:33.744005+0000","last_fullsized":"2024-09-13T15:02:33.744005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:11.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.744851+0000","last_change":"2024-09-13T15:01:44.840082+0000","last_active":"2024-09-13T15:02:33.744851+0000","last_peered":"2024-09-13T15:02:33.744851+0000","last_clean":"2024-09-13T15:02:33.744851+0000","last_became_active":"2024-09-13T15:01:44.839371+0000","last_became_peered":"2024-09-13T15:01:44.839371+0000","last_unstale":"2024-09-13T15:02:33.744851+0000","last_undegraded":"2024-09-13T15:02:33.744851+0000","last_fullsized":"2024-09-13T15:02:33.744851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:13.433036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118361+0000","last_change":"2024-09-13T15:01:44.850416+0000","last_active":"2024-09-13T15:02:34.118361+0000","last_peered":"2024-09-13T15:02:34.118361+0000","last_clean":"2024-09-13T15:02:34.118361+0000","last_became_active":"2024-09-13T15:01:44.849766+0000","last_became_peered":"2024-09-13T15:01:44.849766+0000","last_unstale":"2024-09-13T15:02:34.118361+0000","last_undegraded":"2024-09-13T15:02:34.118361+0000","last_fullsized":"2024-09-13T15:02:34.118361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:11.985610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.737522+0000","last_change":"2024-09-13T15:01:44.837060+0000","last_active":"2024-09-13T15:02:33.737522+0000","last_peered":"2024-09-13T15:02:33.737522+0000","last_clean":"2024-09-13T15:02:33.737522+0000","last_became_active":"2024-09-13T15:01:44.836770+0000","last_became_peered":"2024-09-13T15:01:44.836770+0000","last_unstale":"2024-09-13T15:02:33.737522+0000","last_undegraded":"2024-09-13T15:02:33.737522+0000","last_fullsized":"2024-09-13T15:02:33.737522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:45.915852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116554+0000","last_change":"2024-09-13T15:01:44.815867+0000","last_active":"2024-09-13T15:02:34.116554+0000","last_peered":"2024-09-13T15:02:34.116554+0000","last_clean":"2024-09-13T15:02:34.116554+0000","last_became_active":"2024-09-13T15:01:44.815116+0000","last_became_peered":"2024-09-13T15:01:44.815116+0000","last_unstale":"2024-09-13T15:02:34.116554+0000","last_undegraded":"2024-09-13T15:02:34.116554+0000","last_fullsized":"2024-09-13T15:02:34.116554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:02.814724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.741454+0000","last_change":"2024-09-13T15:01:44.850022+0000","last_active":"2024-09-13T15:02:33.741454+0000","last_peered":"2024-09-13T15:02:33.741454+0000","last_clean":"2024-09-13T15:02:33.741454+0000","last_became_active":"2024-09-13T15:01:44.849533+0000","last_became_peered":"2024-09-13T15:01:44.849533+0000","last_unstale":"2024-09-13T15:02:33.741454+0000","last_undegraded":"2024-09-13T15:02:33.741454+0000","last_fullsized":"2024-09-13T15:02:33.741454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:09.837692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.116378+0000","last_change":"2024-09-13T15:01:44.817139+0000","last_active":"2024-09-13T15:02:34.116378+0000","last_peered":"2024-09-13T15:02:34.116378+0000","last_clean":"2024-09-13T15:02:34.116378+0000","last_became_active":"2024-09-13T15:01:44.816416+0000","last_became_peered":"2024-09-13T15:01:44.816416+0000","last_unstale":"2024-09-13T15:02:34.116378+0000","last_undegraded":"2024-09-13T15:02:34.116378+0000","last_fullsized":"2024-09-13T15:02:34.116378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:38.382210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.869812+0000","last_change":"2024-09-13T15:02:33.747735+0000","last_active":"2024-09-13T15:02:33.869812+0000","last_peered":"2024-09-13T15:02:33.869812+0000","last_clean":"2024-09-13T15:02:33.869812+0000","last_became_active":"2024-09-13T15:02:33.747405+0000","last_became_peered":"2024-09-13T15:02:33.747405+0000","last_unstale":"2024-09-13T15:02:33.869812+0000","last_undegraded":"2024-09-13T15:02:33.869812+0000","last_fullsized":"2024-09-13T15:02:33.869812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:20.616184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742170+0000","last_change":"2024-09-13T15:01:44.808264+0000","last_active":"2024-09-13T15:02:33.742170+0000","last_peered":"2024-09-13T15:02:33.742170+0000","last_clean":"2024-09-13T15:02:33.742170+0000","last_became_active":"2024-09-13T15:01:44.807776+0000","last_became_peered":"2024-09-13T15:01:44.807776+0000","last_unstale":"2024-09-13T15:02:33.742170+0000","last_undegraded":"2024-09-13T15:02:33.742170+0000","last_fullsized":"2024-09-13T15:02:33.742170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:17.637800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:33.742252+0000","last_change":"2024-09-13T15:01:44.804985+0000","last_active":"2024-09-13T15:02:33.742252+0000","last_peered":"2024-09-13T15:02:33.742252+0000","last_clean":"2024-09-13T15:02:33.742252+0000","last_became_active":"2024-09-13T15:01:44.803977+0000","last_became_peered":"2024-09-13T15:01:44.803977+0000","last_unstale":"2024-09-13T15:02:33.742252+0000","last_undegraded":"2024-09-13T15:02:33.742252+0000","last_fullsized":"2024-09-13T15:02:33.742252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:12.999738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-13T15:02:34.118211+0000","last_change":"2024-09-13T15:01:44.824666+0000","last_active":"2024-09-13T15:02:34.118211+0000","last_peered":"2024-09-13T15:02:34.118211+0000","last_clean":"2024-09-13T15:02:34.118211+0000","last_became_active":"2024-09-13T15:01:44.815381+0000","last_became_peered":"2024-09-13T15:01:44.815381+0000","last_unstale":"2024-09-13T15:02:34.118211+0000","last_undegraded":"2024-09-13T15:02:34.118211+0000","last_fullsized":"2024-09-13T15:02:34.118211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:12:17.680247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":10284,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":211,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":20568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":185,"ondisk_log_size":185,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":917504,"data_stored":709456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.91400000000000003,"15min":0.93000000000000005},"min":{"1min":0.53600000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.1220000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.747},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.86799999999999999,"15min":0.874},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.232,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.97299999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.84399999999999997,"15min":0.86699999999999999},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0189999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.98099999999999998,"15min":1.02},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.1619999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.68400000000000005}]},{"osd":2,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.96599999999999997,"15min":0.997},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.1439999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.95199999999999996,"15min":0.98399999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1850000000000001,"5min":1.452,"15min":1.452},"last":0.85699999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.89200000000000002,"15min":0.92000000000000004},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.052,"5min":1.232,"15min":1.232},"last":0.626},{"interface":"front","average":{"1min":0.93999999999999995,"5min":1.0660000000000001,"15min":1.1020000000000001},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.2210000000000001,"5min":1.7,"15min":1.7},"last":0.91100000000000003}]},{"osd":4,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.95399999999999996,"15min":0.97099999999999997},"min":{"1min":0.67800000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.0980000000000001,"5min":1.643,"15min":1.643},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.91500000000000004,"5min":1.002,"15min":1.036},"min":{"1min":0.68300000000000005,"5min":0.624,"15min":0.624},"max":{"1min":1.1000000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.1240000000000001,"15min":1.1559999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.212,"5min":1.8899999999999999,"15min":1.8899999999999999},"last":1.036},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.081,"15min":1.0980000000000001},"min":{"1min":0.77300000000000002,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.1819999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.0569999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.1439999999999999,"15min":1.1779999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2969999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.107,"15min":1.1459999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.173,"5min":1.641,"15min":1.641},"last":0.88900000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542186,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":121573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.878,"15min":0.90100000000000002},"min":{"1min":0.61499999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.224,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.59999999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.86799999999999999,"15min":0.85799999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.498},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.89200000000000002,"15min":0.89900000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.90300000000000002,"15min":0.88900000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.76200000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.91100000000000003,"15min":0.91500000000000004},"min":{"1min":0.63700000000000001,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1399999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.94599999999999995,"15min":0.95199999999999996},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.81000000000000005}]},{"osd":4,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.67900000000000005,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.97999999999999998,"15min":1.0009999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.115,"5min":1.369,"15min":1.369},"last":0.88100000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.95199999999999996,"15min":0.96099999999999997},"min":{"1min":0.69799999999999995,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1990000000000001,"5min":1.3,"15min":1.3},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.032,"15min":1.046},"min":{"1min":0.66700000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":1.0229999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:04:43 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.016,"15min":1.0289999999999999},"min":{"1min":0.72099999999999997,"5min":0.626,"15min":0.626},"max":{"1min":1.1890000000000001,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.996},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.089,"15min":1.107},"min":{"1min":0.91200000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.427,"5min":1.427,"15min":1.427},"last":0.96099999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27344,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344496,"statfs":{"total":96636764160,"available":96608763904,"internally_reserved":0,"allocated":335872,"data_stored":121131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:04:47 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.85499999999999998,"15min":0.86699999999999999},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.097,"5min":1.383,"15min":1.383},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.86199999999999999,"15min":0.86099999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.651,"5min":1.651,"15min":1.651},"last":0.63300000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:04:47 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.93000000000000005,"15min":0.94199999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.878,"15min":0.89200000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.024,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Sep 13 15:04:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91700000000000004,"15min":0.93899999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.93700000000000006,"15min":0.94499999999999995},"min":{"1min":0.64400000000000002,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.137,"5min":1.357,"15min":1.357},"last":0.73099999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:04:47 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.94099999999999995,"15min":0.94699999999999995},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.175,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.96299999999999997,"15min":0.96799999999999997},"min":{"1min":0.65200000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2450000000000001,"5min":1.415,"15min":1.415},"last":0.92000000000000004}]},{"osd":4,"last update":"Fri Sep 13 15:04:47 2024","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.85899999999999999,"15min":0.85799999999999998},"min":{"1min":0.59299999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.349,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.04,"15min":1.0720000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.508,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.96099999999999997}]},{"osd":6,"last update":"Fri Sep 13 15:04:47 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.016,"15min":1.04},"min":{"1min":0.68400000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.88},{"interface":"front","average":{"1min":1.004,"5min":1.0629999999999999,"15min":1.089},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2929999999999999,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":0.98899999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:04:47 2024","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0860000000000001,"15min":1.0880000000000001},"min":{"1min":0.81499999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":1.01},{"interface":"front","average":{"1min":1.073,"5min":1.1279999999999999,"15min":1.147},"min":{"1min":0.76700000000000002,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.3759999999999999,"5min":1.988,"15min":1.988},"last":1.0469999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542185,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":118318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.88300000000000001,"15min":0.90100000000000002},"min":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.163,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.88},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.81799999999999995,"15min":0.82199999999999995},"min":{"1min":0.55200000000000005,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.02,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.85499999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.89100000000000001,"15min":0.91500000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0860000000000001,"5min":1.224,"15min":1.224},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.86599999999999999,"15min":0.86799999999999999},"min":{"1min":0.55300000000000005,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.72299999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.91600000000000004,"15min":0.93600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1020000000000001,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.94699999999999995,"15min":0.95899999999999996},"min":{"1min":0.59399999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3160000000000001,"5min":1.669,"15min":1.669},"last":1.048}]},{"osd":3,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.89200000000000002,"15min":0.90200000000000002},"min":{"1min":0.65900000000000003,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.093,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.97699999999999998,"15min":1.0089999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.111,"5min":1.881,"15min":1.881},"last":0.91200000000000003}]},{"osd":5,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.98799999999999999,"15min":1.04},"min":{"1min":0.62,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.494,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.95999999999999996,"15min":0.98199999999999998},"min":{"1min":0.66700000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.1319999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.94999999999999996}]},{"osd":6,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0189999999999999,"15min":1.0289999999999999},"min":{"1min":0.77500000000000002,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.534,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.141},{"interface":"front","average":{"1min":0.92100000000000004,"5min":1.046,"15min":1.0840000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.177,"5min":2.1110000000000002,"15min":2.1110000000000002},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.04,"15min":1.052},"min":{"1min":0.73299999999999998,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3600000000000001,"5min":1.623,"15min":1.623},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.107,"5min":1.1850000000000001,"15min":1.2130000000000001},"min":{"1min":0.81299999999999994,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.3919999999999999,"5min":1.996,"15min":1.996},"last":1.1060000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542184,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":319488,"data_stored":121607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.501,"15min":0.501},"min":{"1min":0.371,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.64900000000000002,"5min":0.747,"15min":0.747},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.44900000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.66300000000000003,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.42299999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.495,"15min":0.49399999999999999},"min":{"1min":0.374,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.44600000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.71499999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.504}]},{"osd":2,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.625,"15min":0.63500000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.76600000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.46100000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81200000000000006,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.44400000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.83399999999999996,"15min":0.84499999999999997},"min":{"1min":0.61399999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.97599999999999998,"5min":1.179,"15min":1.179},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.85999999999999999,"15min":0.86399999999999999},"min":{"1min":0.64600000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.034,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.873,"15min":0.876},"min":{"1min":0.68500000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0740000000000001,"5min":1.284,"15min":1.284},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.87,"5min":0.93300000000000005,"15min":0.94299999999999995},"min":{"1min":0.70599999999999996,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.212,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.81899999999999995}]},{"osd":6,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.89400000000000002,"15min":0.90700000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0269999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.94099999999999995,"15min":0.95099999999999996},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.1539999999999999,"5min":1.21,"15min":1.21},"last":0.80900000000000005}]},{"osd":7,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.95299999999999996,"15min":0.96899999999999997},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.1499999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.96399999999999997,"15min":0.98799999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.0640000000000001,"5min":1.228,"15min":1.228},"last":0.83199999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":312,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":319488,"data_stored":118709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.47399999999999998,"15min":0.48399999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.60999999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.54200000000000004,"15min":0.56100000000000005},"min":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.627,"5min":1.157,"15min":1.157},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.54500000000000004,"15min":0.56299999999999994},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.64000000000000001,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.57599999999999996,"15min":0.58299999999999996},"min":{"1min":0.39900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52600000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.52500000000000002},"min":{"1min":0.40600000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.60399999999999998,"15min":0.622},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72199999999999998,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.93500000000000005,"15min":0.96999999999999997},"min":{"1min":0.70599999999999996,"5min":0.63,"15min":0.63},"max":{"1min":1.0900000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.90600000000000003,"15min":0.94899999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.004,"5min":1.675,"15min":1.675},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.89700000000000002,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":0.95899999999999996,"5min":1.296,"15min":1.296},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.86699999999999999,"15min":0.88300000000000001},"min":{"1min":0.70499999999999996,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":0.94499999999999995,"5min":1.246,"15min":1.246},"last":0.76500000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.85799999999999998,"15min":0.876},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":0.99399999999999999,"5min":1.268,"15min":1.268},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.91500000000000004,"15min":0.93500000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1850000000000001,"5min":1.373,"15min":1.373},"last":0.751}]},{"osd":7,"last update":"Fri Sep 13 15:04:44 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.96899999999999997,"15min":0.97799999999999998},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.2869999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.96199999999999997,"15min":0.98599999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1240000000000001,"5min":1.353,"15min":1.353},"last":0.69099999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":308,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":315392,"data_stored":118520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45400000000000001,"15min":0.46800000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.55500000000000005,"5min":0.871,"15min":0.871},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.52900000000000003,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.65800000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.498}]},{"osd":2,"last update":"Fri Sep 13 15:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.54500000000000004,"15min":0.57099999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.59399999999999997,"5min":1.071,"15min":1.071},"last":0.433},{"interface":"front","average":{"1min":0.504,"5min":0.58699999999999997,"15min":0.61199999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69099999999999995,"5min":1.107,"15min":1.107},"last":0.45600000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.61299999999999999,"15min":0.63300000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70499999999999996,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60499999999999998,"15min":0.627},"min":{"1min":0.44800000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.77300000000000002,"5min":1.323,"15min":1.323},"last":0.54300000000000004}]},{"osd":4,"last update":"Fri Sep 13 15:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.86499999999999999,"15min":0.90400000000000003},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.97099999999999997,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.85799999999999998,"15min":0.88400000000000001},"min":{"1min":0.64800000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":0.98299999999999998,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Fri Sep 13 15:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.85099999999999998,"15min":0.88100000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.97299999999999998,"5min":1.228,"15min":1.228},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.878,"15min":0.92000000000000004},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.90900000000000003,"5min":1.365,"15min":1.365},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri Sep 13 15:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.876,"15min":0.90400000000000003},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.016,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.90000000000000002,"15min":0.94999999999999996},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.94399999999999995,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:04:46 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.90600000000000003,"15min":0.95299999999999996},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":0.89600000000000002,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.91200000000000003,"15min":0.94099999999999995},"min":{"1min":0.68899999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0349999999999999,"5min":1.7090000000000001,"15min":1.7090000000000001},"last":0.754}]}]},{"osd":0,"up_from":14,"seq":60129542185,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":909312,"data_stored":708278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.66800000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.433},{"interface":"front","average":{"1min":0.495,"5min":0.58699999999999997,"15min":0.60199999999999998},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68899999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.623,"15min":0.64100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.64400000000000002,"5min":1.669,"15min":1.669},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.58299999999999996,"15min":0.58599999999999997},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":0.73499999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.497}]},{"osd":3,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.56299999999999994,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69399999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64700000000000002,"15min":0.66000000000000003},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.72499999999999998,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.628}]},{"osd":4,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.88,"15min":0.88900000000000001},"min":{"1min":0.67100000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.0980000000000001,"5min":1.274,"15min":1.274},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.90400000000000003,"15min":0.91200000000000003},"min":{"1min":0.67500000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0580000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.96599999999999997}]},{"osd":5,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.88300000000000001,"15min":0.88900000000000001},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.026,"5min":1.165,"15min":1.165},"last":1.002}]},{"osd":6,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.95199999999999996,"15min":0.96699999999999997},"min":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.0940000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.91200000000000003,"15min":0.92500000000000004},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Fri Sep 13 15:03:47 2024","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.92800000000000005,"15min":0.93899999999999995},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.93200000000000005,"15min":0.94599999999999995},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.038,"5min":1.141,"15min":1.141},"last":1.046}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:04:50.884 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:04:51.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.057+0000 7f2cffc00640 1 Processor -- start 2024-09-13T15:04:51.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.057+0000 7f2cffc00640 1 -- start start 2024-09-13T15:04:51.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.061+0000 7f2cffc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2cf8071a70 0x7f2cf81576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.061+0000 7f2cffc00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2cf80b0bf0 0x7f2cf8150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.061+0000 7f2cffc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf80c5530 con 0x7f2cf806ddb0 2024-09-13T15:04:51.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.061+0000 7f2cffc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf81583b0 con 0x7f2cf8071a70 2024-09-13T15:04:51.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.061+0000 7f2cffc00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf8156f40 con 0x7f2cf80b0bf0 2024-09-13T15:04:51.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.061+0000 7f2cfd200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2cf8071a70 0x7f2cf81576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.061+0000 7f2cfdc00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2cf806ddb0 0x7f2cf815a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33242/0 (socket says 172.21.15.7:33242) 2024-09-13T15:04:51.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.061+0000 7f2cfdc00640 1 -- 172.21.15.7:0/3421562438 learned_addr learned my addr 172.21.15.7:0/3421562438 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:51.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.061+0000 7f2cf7e00640 1 --2- 172.21.15.7:0/3421562438 >> v2:172.21.15.77:3300/0 conn(0x7f2cf80b0bf0 0x7f2cf8150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.061+0000 7f2cfd200640 1 -- 172.21.15.7:0/3421562438 >> v2:172.21.15.77:3300/0 conn(0x7f2cf80b0bf0 msgr2=0x7f2cf8150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:51.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.061+0000 7f2cfd200640 1 --2- 172.21.15.7:0/3421562438 >> v2:172.21.15.77:3300/0 conn(0x7f2cf80b0bf0 0x7f2cf8150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.061+0000 7f2cfd200640 1 -- 172.21.15.7:0/3421562438 >> v1:172.21.15.7:6789/0 conn(0x7f2cf806ddb0 legacy=0x7f2cf815a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.061+0000 7f2cfd200640 1 -- 172.21.15.7:0/3421562438 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf80b10c0 con 0x7f2cf8071a70 2024-09-13T15:04:51.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.061+0000 7f2cf7400640 1 -- 172.21.15.7:0/3421562438 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910185656 0 0) 0x7f2cf80c5530 con 0x7f2cf806ddb0 2024-09-13T15:04:51.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cfd200640 1 --2- 172.21.15.7:0/3421562438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cf8071a70 0x7f2cf81576e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8072760 tx=0x7f2cec01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6279326e7bd8ccb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:51.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cf7400640 1 -- 172.21.15.7:0/3421562438 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0ab650 con 0x7f2cf8071a70 2024-09-13T15:04:51.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cf7400640 1 -- 172.21.15.7:0/3421562438 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec0ab7b0 con 0x7f2cf8071a70 2024-09-13T15:04:51.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cf7400640 1 -- 172.21.15.7:0/3421562438 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0abb40 con 0x7f2cf8071a70 2024-09-13T15:04:51.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cffc00640 1 -- 172.21.15.7:0/3421562438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cf8071a70 msgr2=0x7f2cf81576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cffc00640 1 --2- 172.21.15.7:0/3421562438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cf8071a70 0x7f2cf81576e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8072760 tx=0x7f2cec01c450 comp rx=0 tx=0).stop 2024-09-13T15:04:51.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cffc00640 1 -- 172.21.15.7:0/3421562438 shutdown_connections 2024-09-13T15:04:51.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cffc00640 1 --2- 172.21.15.7:0/3421562438 >> v2:172.21.15.77:3300/0 conn(0x7f2cf80b0bf0 0x7f2cf8150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cffc00640 1 --2- 172.21.15.7:0/3421562438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cf8071a70 0x7f2cf81576e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cffc00640 1 -- 172.21.15.7:0/3421562438 >> 172.21.15.7:0/3421562438 conn(0x7f2cf8065d40 msgr2=0x7f2cf8066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:51.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cffc00640 1 -- 172.21.15.7:0/3421562438 shutdown_connections 2024-09-13T15:04:51.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cffc00640 1 -- 172.21.15.7:0/3421562438 wait complete. 2024-09-13T15:04:51.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cffc00640 1 Processor -- start 2024-09-13T15:04:51.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cffc00640 1 -- start start 2024-09-13T15:04:51.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cffc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cf806ddb0 0x7f2cf8161db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cffc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cf8071a70 0x7f2cf814fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cffc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cf80b0bf0 0x7f2cf8160c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cffc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf815f7e0 con 0x7f2cf80b0bf0 2024-09-13T15:04:51.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cffc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf8160800 con 0x7f2cf806ddb0 2024-09-13T15:04:51.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cffc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf81f2240 con 0x7f2cf8071a70 2024-09-13T15:04:51.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cfdc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cf80b0bf0 0x7f2cf8160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cfdc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cf80b0bf0 0x7f2cf8160c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58050/0 (socket says 172.21.15.7:58050) 2024-09-13T15:04:51.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.065+0000 7f2cfdc00640 1 -- 172.21.15.7:0/2332545519 learned_addr learned my addr 172.21.15.7:0/2332545519 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:51.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.069+0000 7f2cfd200640 1 --2- 172.21.15.7:0/2332545519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cf806ddb0 0x7f2cf8161db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.069+0000 7f2cf7e00640 1 --2- 172.21.15.7:0/2332545519 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cf8071a70 0x7f2cf814fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.069+0000 7f2cfdc00640 1 -- 172.21.15.7:0/2332545519 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cf8071a70 msgr2=0x7f2cf814fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.069+0000 7f2cfdc00640 1 --2- 172.21.15.7:0/2332545519 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cf8071a70 0x7f2cf814fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.069+0000 7f2cfdc00640 1 -- 172.21.15.7:0/2332545519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cf806ddb0 msgr2=0x7f2cf8161db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.069+0000 7f2cfdc00640 1 --2- 172.21.15.7:0/2332545519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cf806ddb0 0x7f2cf8161db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.069+0000 7f2cfdc00640 1 -- 172.21.15.7:0/2332545519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec009420 con 0x7f2cf80b0bf0 2024-09-13T15:04:51.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.069+0000 7f2cfdc00640 1 --2- 172.21.15.7:0/2332545519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cf80b0bf0 0x7f2cf8160c90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000c780 tx=0x7f2cf000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:51.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.069+0000 7f2cf4c00640 1 -- 172.21.15.7:0/2332545519 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf000ce90 con 0x7f2cf80b0bf0 2024-09-13T15:04:51.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.069+0000 7f2cf4c00640 1 -- 172.21.15.7:0/2332545519 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf000a640 con 0x7f2cf80b0bf0 2024-09-13T15:04:51.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.069+0000 7f2cffc00640 1 -- 172.21.15.7:0/2332545519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf81f2500 con 0x7f2cf80b0bf0 2024-09-13T15:04:51.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.069+0000 7f2cf4c00640 1 -- 172.21.15.7:0/2332545519 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf000a9b0 con 0x7f2cf80b0bf0 2024-09-13T15:04:51.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.069+0000 7f2cffc00640 1 -- 172.21.15.7:0/2332545519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf815fd10 con 0x7f2cf80b0bf0 2024-09-13T15:04:51.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.069+0000 7f2cffc00640 1 -- 172.21.15.7:0/2332545519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf8067650 con 0x7f2cf80b0bf0 2024-09-13T15:04:51.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.069+0000 7f2cf4c00640 1 -- 172.21.15.7:0/2332545519 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2cf000ab10 con 0x7f2cf80b0bf0 2024-09-13T15:04:51.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.073+0000 7f2cf4c00640 1 --2- 172.21.15.7:0/2332545519 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2cd8066690 0x7f2cd8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.073+0000 7f2cf4c00640 1 -- 172.21.15.7:0/2332545519 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2cf0083d70 con 0x7f2cf80b0bf0 2024-09-13T15:04:51.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.073+0000 7f2cfd200640 1 --2- 172.21.15.7:0/2332545519 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2cd8066690 0x7f2cd8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.073+0000 7f2cfd200640 1 --2- 172.21.15.7:0/2332545519 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2cd8066690 0x7f2cd8068b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0af000 tx=0x7f2cec0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:51.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.077+0000 7f2cf4c00640 1 -- 172.21.15.7:0/2332545519 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2cf0050db0 con 0x7f2cf80b0bf0 2024-09-13T15:04:51.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.237+0000 7f2cffc00640 1 -- 172.21.15.7:0/2332545519 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cf81576e0 con 0x7f2cf80b0bf0 2024-09-13T15:04:51.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.241+0000 7f2cf4c00640 1 -- 172.21.15.7:0/2332545519 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18616 (secure 0 0 0) 0x7f2cf0018070 con 0x7f2cf80b0bf0 2024-09-13T15:04:51.242 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:51.242 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:02:33.732864+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:04:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.241+0000 7f2cffc00640 1 -- 172.21.15.7:0/2332545519 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2cd8066690 msgr2=0x7f2cd8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.241+0000 7f2cffc00640 1 --2- 172.21.15.7:0/2332545519 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2cd8066690 0x7f2cd8068b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0af000 tx=0x7f2cec0a7000 comp rx=0 tx=0).stop 2024-09-13T15:04:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.241+0000 7f2cffc00640 1 -- 172.21.15.7:0/2332545519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cf80b0bf0 msgr2=0x7f2cf8160c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.241+0000 7f2cffc00640 1 --2- 172.21.15.7:0/2332545519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cf80b0bf0 0x7f2cf8160c90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000c780 tx=0x7f2cf000cc40 comp rx=0 tx=0).stop 2024-09-13T15:04:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.241+0000 7f2cffc00640 1 -- 172.21.15.7:0/2332545519 shutdown_connections 2024-09-13T15:04:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.241+0000 7f2cffc00640 1 --2- 172.21.15.7:0/2332545519 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2cd8066690 0x7f2cd8068b50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.241+0000 7f2cffc00640 1 --2- 172.21.15.7:0/2332545519 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2cf80b0bf0 0x7f2cf8160c90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.241+0000 7f2cffc00640 1 --2- 172.21.15.7:0/2332545519 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2cf8071a70 0x7f2cf814fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.241+0000 7f2cffc00640 1 --2- 172.21.15.7:0/2332545519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cf806ddb0 0x7f2cf8161db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.241+0000 7f2cffc00640 1 -- 172.21.15.7:0/2332545519 >> 172.21.15.7:0/2332545519 conn(0x7f2cf8065d40 msgr2=0x7f2cf8150aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:51.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.241+0000 7f2cffc00640 1 -- 172.21.15.7:0/2332545519 shutdown_connections 2024-09-13T15:04:51.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.241+0000 7f2cffc00640 1 -- 172.21.15.7:0/2332545519 wait complete. 2024-09-13T15:04:51.263 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:01:38.710958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:01:43.178724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:01:43.774877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:01:46.843203+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:04:51.264 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:04:51.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.405+0000 7f618b200640 1 Processor -- start 2024-09-13T15:04:51.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.405+0000 7f618b200640 1 -- start start 2024-09-13T15:04:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.405+0000 7f618b200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f618414fdd0 0x7f6184156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.405+0000 7f618b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840c16f0 0x7f61840c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.405+0000 7f618b200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61840c6880 con 0x7f61841501b0 2024-09-13T15:04:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.405+0000 7f618b200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61840721e0 con 0x7f618414fdd0 2024-09-13T15:04:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.405+0000 7f618b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618406f860 con 0x7f61840c16f0 2024-09-13T15:04:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.405+0000 7f6183e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f618414fdd0 0x7f6184156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.409+0000 7f6183e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f618414fdd0 0x7f6184156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58056/0 (socket says 172.21.15.7:58056) 2024-09-13T15:04:51.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.409+0000 7f6183e00640 1 -- 172.21.15.7:0/44890702 learned_addr learned my addr 172.21.15.7:0/44890702 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.409+0000 7f6189200640 1 --2- 172.21.15.7:0/44890702 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840c16f0 0x7f61840c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.409+0000 7f6183e00640 1 -- 172.21.15.7:0/44890702 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840c16f0 msgr2=0x7f61840c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.409+0000 7f6183e00640 1 --2- 172.21.15.7:0/44890702 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840c16f0 0x7f61840c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.409+0000 7f6183e00640 1 -- 172.21.15.7:0/44890702 >> v1:172.21.15.77:6789/0 conn(0x7f61841501b0 legacy=0x7f61840c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.409+0000 7f6183e00640 1 -- 172.21.15.7:0/44890702 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61840c6ad0 con 0x7f618414fdd0 2024-09-13T15:04:51.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.409+0000 7f6189200640 1 --2- 172.21.15.7:0/44890702 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840c16f0 0x7f61840c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:51.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.409+0000 7f6183e00640 1 --2- 172.21.15.7:0/44890702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f618414fdd0 0x7f6184156780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6174009870 tx=0x7f617401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f044c92aa6d6ae60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:51.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.409+0000 7f6183400640 1 -- 172.21.15.7:0/44890702 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61740a9620 con 0x7f618414fdd0 2024-09-13T15:04:51.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.409+0000 7f6183400640 1 -- 172.21.15.7:0/44890702 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61740a9780 con 0x7f618414fdd0 2024-09-13T15:04:51.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.409+0000 7f6183400640 1 -- 172.21.15.7:0/44890702 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61740a9b10 con 0x7f618414fdd0 2024-09-13T15:04:51.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f618b200640 1 -- 172.21.15.7:0/44890702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f618414fdd0 msgr2=0x7f6184156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f618b200640 1 --2- 172.21.15.7:0/44890702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f618414fdd0 0x7f6184156780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6174009870 tx=0x7f617401c560 comp rx=0 tx=0).stop 2024-09-13T15:04:51.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f618b200640 1 -- 172.21.15.7:0/44890702 shutdown_connections 2024-09-13T15:04:51.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f618b200640 1 --2- 172.21.15.7:0/44890702 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840c16f0 0x7f61840c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f618b200640 1 --2- 172.21.15.7:0/44890702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f618414fdd0 0x7f6184156780 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f618b200640 1 -- 172.21.15.7:0/44890702 >> 172.21.15.7:0/44890702 conn(0x7f6184065d40 msgr2=0x7f6184066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:51.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f618b200640 1 -- 172.21.15.7:0/44890702 shutdown_connections 2024-09-13T15:04:51.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f618b200640 1 -- 172.21.15.7:0/44890702 wait complete. 2024-09-13T15:04:51.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f618b200640 1 Processor -- start 2024-09-13T15:04:51.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f618b200640 1 -- start start 2024-09-13T15:04:51.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f618b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840c16f0 0x7f61841553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f618b200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f618414fdd0 0x7f618414c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f618b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61841501b0 0x7f618414e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f618b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61841f1be0 con 0x7f61841501b0 2024-09-13T15:04:51.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f618b200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6184154430 con 0x7f618414fdd0 2024-09-13T15:04:51.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f618b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61841558e0 con 0x7f61840c16f0 2024-09-13T15:04:51.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f6189200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61841501b0 0x7f618414e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f6189200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61841501b0 0x7f618414e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58072/0 (socket says 172.21.15.7:58072) 2024-09-13T15:04:51.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f6189200640 1 -- 172.21.15.7:0/3945057566 learned_addr learned my addr 172.21.15.7:0/3945057566 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:51.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f617b400640 1 --2- 172.21.15.7:0/3945057566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f618414fdd0 0x7f618414c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f6183e00640 1 --2- 172.21.15.7:0/3945057566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840c16f0 0x7f61841553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f6189200640 1 -- 172.21.15.7:0/3945057566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840c16f0 msgr2=0x7f61841553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f6189200640 1 --2- 172.21.15.7:0/3945057566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840c16f0 0x7f61841553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f6189200640 1 -- 172.21.15.7:0/3945057566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f618414fdd0 msgr2=0x7f618414c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f6189200640 1 --2- 172.21.15.7:0/3945057566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f618414fdd0 0x7f618414c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.413+0000 7f6189200640 1 -- 172.21.15.7:0/3945057566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61740094d0 con 0x7f61841501b0 2024-09-13T15:04:51.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.417+0000 7f6189200640 1 --2- 172.21.15.7:0/3945057566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61841501b0 0x7f618414e200 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f617c007f20 tx=0x7f617c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:51.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.417+0000 7f6180c00640 1 -- 172.21.15.7:0/3945057566 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c00dee0 con 0x7f61841501b0 2024-09-13T15:04:51.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.417+0000 7f6180c00640 1 -- 172.21.15.7:0/3945057566 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617c00f040 con 0x7f61841501b0 2024-09-13T15:04:51.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.417+0000 7f618b200640 1 -- 172.21.15.7:0/3945057566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61841f1900 con 0x7f61841501b0 2024-09-13T15:04:51.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.417+0000 7f6180c00640 1 -- 172.21.15.7:0/3945057566 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617c003de0 con 0x7f61841501b0 2024-09-13T15:04:51.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.417+0000 7f618b200640 1 -- 172.21.15.7:0/3945057566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6184153d70 con 0x7f61841501b0 2024-09-13T15:04:51.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.417+0000 7f618b200640 1 -- 172.21.15.7:0/3945057566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6184154570 con 0x7f61841501b0 2024-09-13T15:04:51.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.417+0000 7f6180c00640 1 -- 172.21.15.7:0/3945057566 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f617c004030 con 0x7f61841501b0 2024-09-13T15:04:51.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.417+0000 7f6180c00640 1 --2- 172.21.15.7:0/3945057566 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f61600666c0 0x7f6160068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.417+0000 7f6180c00640 1 -- 172.21.15.7:0/3945057566 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f617c084720 con 0x7f61841501b0 2024-09-13T15:04:51.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.417+0000 7f6183e00640 1 --2- 172.21.15.7:0/3945057566 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f61600666c0 0x7f6160068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.421+0000 7f6183e00640 1 --2- 172.21.15.7:0/3945057566 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f61600666c0 0x7f6160068b80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f61740ae000 tx=0x7f61740b3040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:51.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.421+0000 7f6180c00640 1 -- 172.21.15.7:0/3945057566 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6184154570 con 0x7f61841501b0 2024-09-13T15:04:51.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.581+0000 7f618b200640 1 -- 172.21.15.7:0/3945057566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6184154570 con 0x7f61841501b0 2024-09-13T15:04:51.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.581+0000 7f6180c00640 1 -- 172.21.15.7:0/3945057566 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6184154570 con 0x7f61841501b0 2024-09-13T15:04:51.585 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T15:04:51.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.585+0000 7f618b200640 1 -- 172.21.15.7:0/3945057566 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f61600666c0 msgr2=0x7f6160068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.585+0000 7f618b200640 1 --2- 172.21.15.7:0/3945057566 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f61600666c0 0x7f6160068b80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f61740ae000 tx=0x7f61740b3040 comp rx=0 tx=0).stop 2024-09-13T15:04:51.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.585+0000 7f618b200640 1 -- 172.21.15.7:0/3945057566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61841501b0 msgr2=0x7f618414e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.585+0000 7f618b200640 1 --2- 172.21.15.7:0/3945057566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61841501b0 0x7f618414e200 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f617c007f20 tx=0x7f617c00d560 comp rx=0 tx=0).stop 2024-09-13T15:04:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.585+0000 7f618b200640 1 -- 172.21.15.7:0/3945057566 shutdown_connections 2024-09-13T15:04:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.585+0000 7f618b200640 1 --2- 172.21.15.7:0/3945057566 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f61600666c0 0x7f6160068b80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.585+0000 7f618b200640 1 --2- 172.21.15.7:0/3945057566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f61841501b0 0x7f618414e200 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.585+0000 7f618b200640 1 --2- 172.21.15.7:0/3945057566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f618414fdd0 0x7f618414c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.585+0000 7f618b200640 1 --2- 172.21.15.7:0/3945057566 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f61840c16f0 0x7f61841553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.585+0000 7f618b200640 1 -- 172.21.15.7:0/3945057566 >> 172.21.15.7:0/3945057566 conn(0x7f6184065d40 msgr2=0x7f61840c24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.585+0000 7f618b200640 1 -- 172.21.15.7:0/3945057566 shutdown_connections 2024-09-13T15:04:51.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.585+0000 7f618b200640 1 -- 172.21.15.7:0/3945057566 wait complete. 2024-09-13T15:04:51.607 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:04:51.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff06ce00640 1 Processor -- start 2024-09-13T15:04:51.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff06ce00640 1 -- start start 2024-09-13T15:04:51.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff06ce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0680c66c0 0x7ff0680c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff06ce00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff0680ca1e0 0x7ff0680ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff06ce00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff068159360 con 0x7ff0680c9010 2024-09-13T15:04:51.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff06ce00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff068159150 con 0x7ff0680ca1e0 2024-09-13T15:04:51.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff06ce00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff068159600 con 0x7ff0680c66c0 2024-09-13T15:04:51.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff065400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff0680c9010 0x7ff06806f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33252/0 (socket says 172.21.15.7:33252) 2024-09-13T15:04:51.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff065400640 1 -- 172.21.15.7:0/2100337526 learned_addr learned my addr 172.21.15.7:0/2100337526 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:51.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff065e00640 1 --2- 172.21.15.7:0/2100337526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0680c66c0 0x7ff0680c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff066800640 1 --2- 172.21.15.7:0/2100337526 >> v2:172.21.15.77:3300/0 conn(0x7ff0680ca1e0 0x7ff0680ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff064a00640 1 -- 172.21.15.7:0/2100337526 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1595462115 0 0) 0x7ff068159360 con 0x7ff0680c9010 2024-09-13T15:04:51.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff064a00640 1 -- 172.21.15.7:0/2100337526 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff04c003530 con 0x7ff0680c9010 2024-09-13T15:04:51.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff064a00640 1 -- 172.21.15.7:0/2100337526 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1467720826 0 0) 0x7ff04c003530 con 0x7ff0680c9010 2024-09-13T15:04:51.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff064a00640 1 -- 172.21.15.7:0/2100337526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0680c66c0 msgr2=0x7ff0680c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:51.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff064a00640 1 --2- 172.21.15.7:0/2100337526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0680c66c0 0x7ff0680c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff064a00640 1 -- 172.21.15.7:0/2100337526 >> v2:172.21.15.77:3300/0 conn(0x7ff0680ca1e0 msgr2=0x7ff0680ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:51.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff064a00640 1 --2- 172.21.15.7:0/2100337526 >> v2:172.21.15.77:3300/0 conn(0x7ff0680ca1e0 0x7ff0680ccdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff064a00640 1 -- 172.21.15.7:0/2100337526 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0681598e0 con 0x7ff0680c9010 2024-09-13T15:04:51.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff064a00640 1 -- 172.21.15.7:0/2100337526 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7ff054001680 con 0x7ff0680c9010 2024-09-13T15:04:51.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff064a00640 1 -- 172.21.15.7:0/2100337526 >> v1:172.21.15.7:6789/0 conn(0x7ff0680c9010 legacy=0x7ff06806f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff064a00640 1 --2- 172.21.15.7:0/2100337526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0680c66c0 0x7ff04c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff064a00640 1 --2- 172.21.15.7:0/2100337526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff04c003f00 0x7ff04c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff064a00640 1 --2- 172.21.15.7:0/2100337526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff04c004d10 0x7ff04c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff064a00640 1 -- 172.21.15.7:0/2100337526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff068159150 con 0x7ff04c003f00 2024-09-13T15:04:51.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff064a00640 1 -- 172.21.15.7:0/2100337526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff068159600 con 0x7ff04c004d10 2024-09-13T15:04:51.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff064a00640 1 -- 172.21.15.7:0/2100337526 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04c00b9c0 con 0x7ff0680c66c0 2024-09-13T15:04:51.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff065400640 1 --2- 172.21.15.7:0/2100337526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff04c003f00 0x7ff04c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff066800640 1 --2- 172.21.15.7:0/2100337526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff04c004d10 0x7ff04c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff065e00640 1 --2- 172.21.15.7:0/2100337526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0680c66c0 0x7ff04c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff065400640 1 -- 172.21.15.7:0/2100337526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0680c66c0 msgr2=0x7ff04c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:51.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff065400640 1 --2- 172.21.15.7:0/2100337526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0680c66c0 0x7ff04c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff065400640 1 -- 172.21.15.7:0/2100337526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff04c004d10 msgr2=0x7ff04c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:51.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff065400640 1 --2- 172.21.15.7:0/2100337526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff04c004d10 0x7ff04c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.749+0000 7ff065400640 1 -- 172.21.15.7:0/2100337526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c003530 con 0x7ff04c003f00 2024-09-13T15:04:51.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.753+0000 7ff065400640 1 --2- 172.21.15.7:0/2100337526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff04c003f00 0x7ff04c0047d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff05400c290 tx=0x7ff05401cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0ad470f1d88e36 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.753+0000 7ff064a00640 1 -- 172.21.15.7:0/2100337526 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0540a5970 con 0x7ff04c003f00 2024-09-13T15:04:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.753+0000 7ff064a00640 1 -- 172.21.15.7:0/2100337526 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0540a5ad0 con 0x7ff04c003f00 2024-09-13T15:04:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.753+0000 7ff064a00640 1 -- 172.21.15.7:0/2100337526 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0540a5e80 con 0x7ff04c003f00 2024-09-13T15:04:51.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.753+0000 7ff06ce00640 1 -- 172.21.15.7:0/2100337526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff04c003f00 msgr2=0x7ff04c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.753+0000 7ff06ce00640 1 --2- 172.21.15.7:0/2100337526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff04c003f00 0x7ff04c0047d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff05400c290 tx=0x7ff05401cd00 comp rx=0 tx=0).stop 2024-09-13T15:04:51.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.753+0000 7ff066800640 1 -- 172.21.15.7:0/2100337526 reap_dead start 2024-09-13T15:04:51.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.753+0000 7ff06ce00640 1 -- 172.21.15.7:0/2100337526 shutdown_connections 2024-09-13T15:04:51.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.753+0000 7ff06ce00640 1 -- 172.21.15.7:0/2100337526 >> 172.21.15.7:0/2100337526 conn(0x7ff06806cf60 msgr2=0x7ff0680717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:51.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.753+0000 7ff06ce00640 1 -- 172.21.15.7:0/2100337526 shutdown_connections 2024-09-13T15:04:51.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.753+0000 7ff06ce00640 1 -- 172.21.15.7:0/2100337526 wait complete. 2024-09-13T15:04:51.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff06ce00640 1 Processor -- start 2024-09-13T15:04:51.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff06ce00640 1 -- start start 2024-09-13T15:04:51.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff06ce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff04c003f00 0x7ff0681f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff06ce00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0680c2b80 0x7ff0680c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff06ce00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0681f21b0 0x7ff0680c1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff06ce00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0680c3ad0 con 0x7ff0681f21b0 2024-09-13T15:04:51.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff06ce00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0680c3010 con 0x7ff0680c2b80 2024-09-13T15:04:51.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff06ce00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0681f2920 con 0x7ff04c003f00 2024-09-13T15:04:51.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff066800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0681f21b0 0x7ff0680c1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff066800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0681f21b0 0x7ff0680c1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58100/0 (socket says 172.21.15.7:58100) 2024-09-13T15:04:51.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff066800640 1 -- 172.21.15.7:0/1482664442 learned_addr learned my addr 172.21.15.7:0/1482664442 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:51.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff065400640 1 --2- 172.21.15.7:0/1482664442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0680c2b80 0x7ff0680c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff065e00640 1 --2- 172.21.15.7:0/1482664442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff04c003f00 0x7ff0681f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff066800640 1 -- 172.21.15.7:0/1482664442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff04c003f00 msgr2=0x7ff0681f1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff066800640 1 --2- 172.21.15.7:0/1482664442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff04c003f00 0x7ff0681f1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff066800640 1 -- 172.21.15.7:0/1482664442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0680c2b80 msgr2=0x7ff0680c1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff066800640 1 --2- 172.21.15.7:0/1482664442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0680c2b80 0x7ff0680c1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff066800640 1 -- 172.21.15.7:0/1482664442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0680c15b0 con 0x7ff0681f21b0 2024-09-13T15:04:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff066800640 1 --2- 172.21.15.7:0/1482664442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0681f21b0 0x7ff0680c1f80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff0680ca5c0 tx=0x7ff06000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:51.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff05e000640 1 -- 172.21.15.7:0/1482664442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06000e040 con 0x7ff0681f21b0 2024-09-13T15:04:51.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff05e000640 1 -- 172.21.15.7:0/1482664442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06000f040 con 0x7ff0681f21b0 2024-09-13T15:04:51.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff05e000640 1 -- 172.21.15.7:0/1482664442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff060015430 con 0x7ff0681f21b0 2024-09-13T15:04:51.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff06ce00640 1 -- 172.21.15.7:0/1482664442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0680c37f0 con 0x7ff0681f21b0 2024-09-13T15:04:51.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.757+0000 7ff06ce00640 1 -- 172.21.15.7:0/1482664442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06814dea0 con 0x7ff0681f21b0 2024-09-13T15:04:51.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.761+0000 7ff06ce00640 1 -- 172.21.15.7:0/1482664442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0680c1740 con 0x7ff0681f21b0 2024-09-13T15:04:51.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.761+0000 7ff05e000640 1 -- 172.21.15.7:0/1482664442 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff060015590 con 0x7ff0681f21b0 2024-09-13T15:04:51.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.761+0000 7ff05e000640 1 --2- 172.21.15.7:0/1482664442 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff0480666c0 0x7ff048068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:51.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.761+0000 7ff05e000640 1 -- 172.21.15.7:0/1482664442 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff060084c70 con 0x7ff0681f21b0 2024-09-13T15:04:51.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.761+0000 7ff065e00640 1 --2- 172.21.15.7:0/1482664442 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff0480666c0 0x7ff048068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:51.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.761+0000 7ff065e00640 1 --2- 172.21.15.7:0/1482664442 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff0480666c0 0x7ff048068b80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff0580099e0 tx=0x7ff058008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:51.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.765+0000 7ff05e000640 1 -- 172.21.15.7:0/1482664442 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff060051c10 con 0x7ff0681f21b0 2024-09-13T15:04:51.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.925+0000 7ff06ce00640 1 -- 172.21.15.7:0/1482664442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff0680c9ca0 con 0x7ff0681f21b0 2024-09-13T15:04:51.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.929+0000 7ff05e000640 1 -- 172.21.15.7:0/1482664442 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff060055230 con 0x7ff0681f21b0 2024-09-13T15:04:51.929 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T15:04:51.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.929+0000 7ff06ce00640 1 -- 172.21.15.7:0/1482664442 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff0480666c0 msgr2=0x7ff048068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.929+0000 7ff06ce00640 1 --2- 172.21.15.7:0/1482664442 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff0480666c0 0x7ff048068b80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff0580099e0 tx=0x7ff058008040 comp rx=0 tx=0).stop 2024-09-13T15:04:51.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.929+0000 7ff06ce00640 1 -- 172.21.15.7:0/1482664442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0681f21b0 msgr2=0x7ff0680c1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:51.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.929+0000 7ff06ce00640 1 --2- 172.21.15.7:0/1482664442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0681f21b0 0x7ff0680c1f80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff0680ca5c0 tx=0x7ff06000f580 comp rx=0 tx=0).stop 2024-09-13T15:04:51.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.929+0000 7ff06ce00640 1 -- 172.21.15.7:0/1482664442 shutdown_connections 2024-09-13T15:04:51.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.929+0000 7ff06ce00640 1 --2- 172.21.15.7:0/1482664442 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff0480666c0 0x7ff048068b80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.929+0000 7ff06ce00640 1 --2- 172.21.15.7:0/1482664442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0681f21b0 0x7ff0680c1f80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.929+0000 7ff06ce00640 1 --2- 172.21.15.7:0/1482664442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0680c2b80 0x7ff0680c1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.929+0000 7ff06ce00640 1 --2- 172.21.15.7:0/1482664442 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff04c003f00 0x7ff0681f1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:51.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.929+0000 7ff06ce00640 1 -- 172.21.15.7:0/1482664442 >> 172.21.15.7:0/1482664442 conn(0x7ff06806cf60 msgr2=0x7ff0680cc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:51.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.929+0000 7ff06ce00640 1 -- 172.21.15.7:0/1482664442 shutdown_connections 2024-09-13T15:04:51.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:51.929+0000 7ff06ce00640 1 -- 172.21.15.7:0/1482664442 wait complete. 2024-09-13T15:04:51.950 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:04:52.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.093+0000 7ffbac000640 1 Processor -- start 2024-09-13T15:04:52.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.093+0000 7ffbac000640 1 -- start start 2024-09-13T15:04:52.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.093+0000 7ffbac000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffba40c5ce0 0x7ffba4156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:52.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.093+0000 7ffbac000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba40c6880 con 0x7ffba414fdd0 2024-09-13T15:04:52.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.093+0000 7ffbac000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffba40721e0 con 0x7ffba41501b0 2024-09-13T15:04:52.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.093+0000 7ffbac000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba406f860 con 0x7ffba40c5ce0 2024-09-13T15:04:52.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.093+0000 7ffba9600640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ffba414fdd0 0x7ffba40c7420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33262/0 (socket says 172.21.15.7:33262) 2024-09-13T15:04:52.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.093+0000 7ffba9600640 1 -- 172.21.15.7:0/3112202173 learned_addr learned my addr 172.21.15.7:0/3112202173 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:52.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.093+0000 7ffbaa000640 1 --2- 172.21.15.7:0/3112202173 >> v2:172.21.15.7:3300/0 conn(0x7ffba40c5ce0 0x7ffba4156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:52.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.093+0000 7ffba3e00640 1 -- 172.21.15.7:0/3112202173 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090623209 0 0) 0x7ffba40c6880 con 0x7ffba414fdd0 2024-09-13T15:04:52.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.093+0000 7ffba3e00640 1 -- 172.21.15.7:0/3112202173 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb8c003530 con 0x7ffba414fdd0 2024-09-13T15:04:52.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.093+0000 7ffbaa000640 1 -- 172.21.15.7:0/3112202173 >> v1:172.21.15.77:6789/0 conn(0x7ffba41501b0 legacy=0x7ffba40c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:52.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.093+0000 7ffbaa000640 1 -- 172.21.15.7:0/3112202173 >> v1:172.21.15.7:6789/0 conn(0x7ffba414fdd0 legacy=0x7ffba40c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:52.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.093+0000 7ffbaa000640 1 -- 172.21.15.7:0/3112202173 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba40c6ad0 con 0x7ffba40c5ce0 2024-09-13T15:04:52.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.097+0000 7ffbaa000640 1 --2- 172.21.15.7:0/3112202173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba40c5ce0 0x7ffba4156780 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c009d90 tx=0x7ffb9c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5a96a3ad48fa56 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:52.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.097+0000 7ffba3e00640 1 -- 172.21.15.7:0/3112202173 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c0a5a30 con 0x7ffba40c5ce0 2024-09-13T15:04:52.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.097+0000 7ffba3e00640 1 -- 172.21.15.7:0/3112202173 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb9c0a5b90 con 0x7ffba40c5ce0 2024-09-13T15:04:52.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.097+0000 7ffba3e00640 1 -- 172.21.15.7:0/3112202173 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c0ad440 con 0x7ffba40c5ce0 2024-09-13T15:04:52.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.097+0000 7ffbac000640 1 -- 172.21.15.7:0/3112202173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba40c5ce0 msgr2=0x7ffba4156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.097+0000 7ffbac000640 1 --2- 172.21.15.7:0/3112202173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba40c5ce0 0x7ffba4156780 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c009d90 tx=0x7ffb9c01c970 comp rx=0 tx=0).stop 2024-09-13T15:04:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.097+0000 7ffbac000640 1 -- 172.21.15.7:0/3112202173 shutdown_connections 2024-09-13T15:04:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.097+0000 7ffbac000640 1 --2- 172.21.15.7:0/3112202173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba40c5ce0 0x7ffba4156780 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.097+0000 7ffbac000640 1 -- 172.21.15.7:0/3112202173 >> 172.21.15.7:0/3112202173 conn(0x7ffba4065d40 msgr2=0x7ffba4066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.097+0000 7ffbac000640 1 -- 172.21.15.7:0/3112202173 shutdown_connections 2024-09-13T15:04:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.097+0000 7ffbac000640 1 -- 172.21.15.7:0/3112202173 wait complete. 2024-09-13T15:04:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.097+0000 7ffbac000640 1 Processor -- start 2024-09-13T15:04:52.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.097+0000 7ffbac000640 1 -- start start 2024-09-13T15:04:52.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffbac000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffba40c5ce0 0x7ffba414d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:52.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffbac000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba414fdd0 0x7ffba4151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:52.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffbac000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffba41501b0 0x7ffba4152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:52.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffbac000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba4152a60 con 0x7ffba414fdd0 2024-09-13T15:04:52.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffbac000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba4160550 con 0x7ffba40c5ce0 2024-09-13T15:04:52.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffbac000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba4160dd0 con 0x7ffba41501b0 2024-09-13T15:04:52.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffba8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba414fdd0 0x7ffba4151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:52.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffba8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba414fdd0 0x7ffba4151ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58118/0 (socket says 172.21.15.7:58118) 2024-09-13T15:04:52.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffba8c00640 1 -- 172.21.15.7:0/187417403 learned_addr learned my addr 172.21.15.7:0/187417403 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:52.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffba9600640 1 --2- 172.21.15.7:0/187417403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffba40c5ce0 0x7ffba414d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:52.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffbaa000640 1 --2- 172.21.15.7:0/187417403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffba41501b0 0x7ffba4152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:52.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffba8c00640 1 -- 172.21.15.7:0/187417403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffba41501b0 msgr2=0x7ffba4152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:52.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffba8c00640 1 --2- 172.21.15.7:0/187417403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffba41501b0 0x7ffba4152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffba8c00640 1 -- 172.21.15.7:0/187417403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffba40c5ce0 msgr2=0x7ffba414d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:52.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffba8c00640 1 --2- 172.21.15.7:0/187417403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffba40c5ce0 0x7ffba414d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffba8c00640 1 -- 172.21.15.7:0/187417403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9c009a70 con 0x7ffba414fdd0 2024-09-13T15:04:52.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffba8c00640 1 --2- 172.21.15.7:0/187417403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba414fdd0 0x7ffba4151ae0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000c3c0 tx=0x7ffb9000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:52.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffba1600640 1 -- 172.21.15.7:0/187417403 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb900052d0 con 0x7ffba414fdd0 2024-09-13T15:04:52.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffba1600640 1 -- 172.21.15.7:0/187417403 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb90005430 con 0x7ffba414fdd0 2024-09-13T15:04:52.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffbac000640 1 -- 172.21.15.7:0/187417403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba41f5a80 con 0x7ffba414fdd0 2024-09-13T15:04:52.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffba1600640 1 -- 172.21.15.7:0/187417403 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb90003840 con 0x7ffba414fdd0 2024-09-13T15:04:52.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffbac000640 1 -- 172.21.15.7:0/187417403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba4160af0 con 0x7ffba414fdd0 2024-09-13T15:04:52.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffbac000640 1 -- 172.21.15.7:0/187417403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba4156780 con 0x7ffba414fdd0 2024-09-13T15:04:52.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.101+0000 7ffba1600640 1 -- 172.21.15.7:0/187417403 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb900039a0 con 0x7ffba414fdd0 2024-09-13T15:04:52.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.105+0000 7ffba1600640 1 --2- 172.21.15.7:0/187417403 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffb84066690 0x7ffb84068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:52.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.105+0000 7ffba1600640 1 -- 172.21.15.7:0/187417403 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffb90083bc0 con 0x7ffba414fdd0 2024-09-13T15:04:52.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.105+0000 7ffba9600640 1 --2- 172.21.15.7:0/187417403 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffb84066690 0x7ffb84068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:52.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.105+0000 7ffba9600640 1 --2- 172.21.15.7:0/187417403 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffb84066690 0x7ffb84068b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffb980011f0 tx=0x7ffb98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:52.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.109+0000 7ffba1600640 1 -- 172.21.15.7:0/187417403 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffb90050a40 con 0x7ffba414fdd0 2024-09-13T15:04:52.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.273+0000 7ffbac000640 1 -- 172.21.15.7:0/187417403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffba40c26f0 con 0x7ffba414fdd0 2024-09-13T15:04:52.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.273+0000 7ffba1600640 1 -- 172.21.15.7:0/187417403 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffb90017020 con 0x7ffba414fdd0 2024-09-13T15:04:52.275 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-13T15:04:52.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.273+0000 7ffbac000640 1 -- 172.21.15.7:0/187417403 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffb84066690 msgr2=0x7ffb84068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:52.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.273+0000 7ffbac000640 1 --2- 172.21.15.7:0/187417403 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffb84066690 0x7ffb84068b50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffb980011f0 tx=0x7ffb98009040 comp rx=0 tx=0).stop 2024-09-13T15:04:52.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.273+0000 7ffbac000640 1 -- 172.21.15.7:0/187417403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba414fdd0 msgr2=0x7ffba4151ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:52.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.273+0000 7ffbac000640 1 --2- 172.21.15.7:0/187417403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba414fdd0 0x7ffba4151ae0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffb9000c3c0 tx=0x7ffb9000c880 comp rx=0 tx=0).stop 2024-09-13T15:04:52.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.273+0000 7ffbac000640 1 -- 172.21.15.7:0/187417403 shutdown_connections 2024-09-13T15:04:52.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.273+0000 7ffbac000640 1 --2- 172.21.15.7:0/187417403 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffb84066690 0x7ffb84068b50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.273+0000 7ffbac000640 1 --2- 172.21.15.7:0/187417403 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffba41501b0 0x7ffba4152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.273+0000 7ffbac000640 1 --2- 172.21.15.7:0/187417403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffba414fdd0 0x7ffba4151ae0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.273+0000 7ffbac000640 1 --2- 172.21.15.7:0/187417403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffba40c5ce0 0x7ffba414d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.273+0000 7ffbac000640 1 -- 172.21.15.7:0/187417403 >> 172.21.15.7:0/187417403 conn(0x7ffba4065d40 msgr2=0x7ffba4155ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:52.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.273+0000 7ffbac000640 1 -- 172.21.15.7:0/187417403 shutdown_connections 2024-09-13T15:04:52.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.273+0000 7ffbac000640 1 -- 172.21.15.7:0/187417403 wait complete. 2024-09-13T15:04:52.297 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:04:52.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.437+0000 7f215ae00640 1 Processor -- start 2024-09-13T15:04:52.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.437+0000 7f215ae00640 1 -- start start 2024-09-13T15:04:52.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.441+0000 7f215ae00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f21540c1880 0x7f21540c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:52.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.441+0000 7f215ae00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21540c5c30 0x7f2154071810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:52.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.441+0000 7f215ae00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2154157100 con 0x7f2154150d90 2024-09-13T15:04:52.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.441+0000 7f215ae00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2154066b00 con 0x7f21540c5c30 2024-09-13T15:04:52.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.441+0000 7f215ae00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215415a3a0 con 0x7f21540c1880 2024-09-13T15:04:52.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.441+0000 7f2158e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21540c5c30 0x7f2154071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:52.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.441+0000 7f2158e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f21540c5c30 0x7f2154071810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58132/0 (socket says 172.21.15.7:58132) 2024-09-13T15:04:52.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.441+0000 7f2158e00640 1 -- 172.21.15.7:0/3510571673 learned_addr learned my addr 172.21.15.7:0/3510571673 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:52.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.441+0000 7f214b400640 1 --2- 172.21.15.7:0/3510571673 >> v2:172.21.15.77:3300/0 conn(0x7f21540c1880 0x7f21540c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:52.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.441+0000 7f2158e00640 1 -- 172.21.15.7:0/3510571673 >> v2:172.21.15.77:3300/0 conn(0x7f21540c1880 msgr2=0x7f21540c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:52.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.441+0000 7f2158e00640 1 --2- 172.21.15.7:0/3510571673 >> v2:172.21.15.77:3300/0 conn(0x7f21540c1880 0x7f21540c56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.441+0000 7f2158e00640 1 -- 172.21.15.7:0/3510571673 >> v1:172.21.15.77:6789/0 conn(0x7f2154150d90 legacy=0x7f2154157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:52.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.441+0000 7f2158e00640 1 -- 172.21.15.7:0/3510571673 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2154156db0 con 0x7f21540c5c30 2024-09-13T15:04:52.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f2158e00640 1 --2- 172.21.15.7:0/3510571673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21540c5c30 0x7f2154071810 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f215406d210 tx=0x7f214c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98f63f1a39ad78c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:52.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f2153400640 1 -- 172.21.15.7:0/3510571673 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c0af400 con 0x7f21540c5c30 2024-09-13T15:04:52.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f2153400640 1 -- 172.21.15.7:0/3510571673 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c0ab050 con 0x7f21540c5c30 2024-09-13T15:04:52.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f2153400640 1 -- 172.21.15.7:0/3510571673 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c0af780 con 0x7f21540c5c30 2024-09-13T15:04:52.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f215ae00640 1 -- 172.21.15.7:0/3510571673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21540c5c30 msgr2=0x7f2154071810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:52.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f215ae00640 1 --2- 172.21.15.7:0/3510571673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21540c5c30 0x7f2154071810 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f215406d210 tx=0x7f214c01f1e0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f215ae00640 1 -- 172.21.15.7:0/3510571673 shutdown_connections 2024-09-13T15:04:52.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f215ae00640 1 --2- 172.21.15.7:0/3510571673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21540c5c30 0x7f2154071810 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f215ae00640 1 --2- 172.21.15.7:0/3510571673 >> v2:172.21.15.77:3300/0 conn(0x7f21540c1880 0x7f21540c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f215ae00640 1 -- 172.21.15.7:0/3510571673 >> 172.21.15.7:0/3510571673 conn(0x7f2154065d40 msgr2=0x7f2154066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:52.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f215ae00640 1 -- 172.21.15.7:0/3510571673 shutdown_connections 2024-09-13T15:04:52.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f215ae00640 1 -- 172.21.15.7:0/3510571673 wait complete. 2024-09-13T15:04:52.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f215ae00640 1 Processor -- start 2024-09-13T15:04:52.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f215ae00640 1 -- start start 2024-09-13T15:04:52.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f215ae00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21540c1880 0x7f215406f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:52.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f215ae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21540c5c30 0x7f21540c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:52.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f215ae00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2154150d90 0x7f21540ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:52.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.445+0000 7f215ae00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2154071c50 con 0x7f21540c5c30 2024-09-13T15:04:52.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f215ae00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2154071990 con 0x7f2154150d90 2024-09-13T15:04:52.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f215ae00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2154072160 con 0x7f21540c1880 2024-09-13T15:04:52.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f214b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21540c5c30 0x7f21540c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:52.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f214b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21540c5c30 0x7f21540c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58140/0 (socket says 172.21.15.7:58140) 2024-09-13T15:04:52.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f214b400640 1 -- 172.21.15.7:0/4243935950 learned_addr learned my addr 172.21.15.7:0/4243935950 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:52.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f2153e00640 1 --2- 172.21.15.7:0/4243935950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21540c1880 0x7f215406f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:52.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f2158e00640 1 --2- 172.21.15.7:0/4243935950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2154150d90 0x7f21540ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:52.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f214b400640 1 -- 172.21.15.7:0/4243935950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21540c1880 msgr2=0x7f215406f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:52.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f214b400640 1 --2- 172.21.15.7:0/4243935950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21540c1880 0x7f215406f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f214b400640 1 -- 172.21.15.7:0/4243935950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2154150d90 msgr2=0x7f21540ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:52.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f214b400640 1 --2- 172.21.15.7:0/4243935950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2154150d90 0x7f21540ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f214b400640 1 -- 172.21.15.7:0/4243935950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c009b30 con 0x7f21540c5c30 2024-09-13T15:04:52.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f214b400640 1 --2- 172.21.15.7:0/4243935950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21540c5c30 0x7f21540c9d80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f213c00e930 tx=0x7f213c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:52.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f2150c00640 1 -- 172.21.15.7:0/4243935950 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c009690 con 0x7f21540c5c30 2024-09-13T15:04:52.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f2150c00640 1 -- 172.21.15.7:0/4243935950 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c00ca00 con 0x7f21540c5c30 2024-09-13T15:04:52.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f215ae00640 1 -- 172.21.15.7:0/4243935950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2154154ea0 con 0x7f21540c5c30 2024-09-13T15:04:52.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f2150c00640 1 -- 172.21.15.7:0/4243935950 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c00cd70 con 0x7f21540c5c30 2024-09-13T15:04:52.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f215ae00640 1 -- 172.21.15.7:0/4243935950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2154158590 con 0x7f21540c5c30 2024-09-13T15:04:52.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f215ae00640 1 -- 172.21.15.7:0/4243935950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2154151170 con 0x7f21540c5c30 2024-09-13T15:04:52.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.449+0000 7f2150c00640 1 -- 172.21.15.7:0/4243935950 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f213c013470 con 0x7f21540c5c30 2024-09-13T15:04:52.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.453+0000 7f2150c00640 1 --2- 172.21.15.7:0/4243935950 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2130066690 0x7f2130068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:52.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.453+0000 7f2150c00640 1 -- 172.21.15.7:0/4243935950 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f213c084780 con 0x7f21540c5c30 2024-09-13T15:04:52.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.453+0000 7f2153e00640 1 --2- 172.21.15.7:0/4243935950 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2130066690 0x7f2130068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:52.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.453+0000 7f2153e00640 1 --2- 172.21.15.7:0/4243935950 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2130066690 0x7f2130068b50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2144007fd0 tx=0x7f2144009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:52.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.457+0000 7f2150c00640 1 -- 172.21.15.7:0/4243935950 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f213c051890 con 0x7f21540c5c30 2024-09-13T15:04:52.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.617+0000 7f215ae00640 1 -- 172.21.15.7:0/4243935950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f21540c54d0 con 0x7f21540c5c30 2024-09-13T15:04:52.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.621+0000 7f2150c00640 1 -- 172.21.15.7:0/4243935950 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f213c054eb0 con 0x7f21540c5c30 2024-09-13T15:04:52.621 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T15:04:52.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.621+0000 7f215ae00640 1 -- 172.21.15.7:0/4243935950 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2130066690 msgr2=0x7f2130068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:52.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.621+0000 7f215ae00640 1 --2- 172.21.15.7:0/4243935950 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2130066690 0x7f2130068b50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2144007fd0 tx=0x7f2144009040 comp rx=0 tx=0).stop 2024-09-13T15:04:52.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.621+0000 7f215ae00640 1 -- 172.21.15.7:0/4243935950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21540c5c30 msgr2=0x7f21540c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:52.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.621+0000 7f215ae00640 1 --2- 172.21.15.7:0/4243935950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21540c5c30 0x7f21540c9d80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f213c00e930 tx=0x7f213c00edf0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.621+0000 7f215ae00640 1 -- 172.21.15.7:0/4243935950 shutdown_connections 2024-09-13T15:04:52.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.621+0000 7f215ae00640 1 --2- 172.21.15.7:0/4243935950 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2130066690 0x7f2130068b50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.621+0000 7f215ae00640 1 --2- 172.21.15.7:0/4243935950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2154150d90 0x7f21540ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.621+0000 7f215ae00640 1 --2- 172.21.15.7:0/4243935950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21540c5c30 0x7f21540c9d80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.621+0000 7f215ae00640 1 --2- 172.21.15.7:0/4243935950 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f21540c1880 0x7f215406f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.621+0000 7f215ae00640 1 -- 172.21.15.7:0/4243935950 >> 172.21.15.7:0/4243935950 conn(0x7f2154065d40 msgr2=0x7f21540c1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:52.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.621+0000 7f215ae00640 1 -- 172.21.15.7:0/4243935950 shutdown_connections 2024-09-13T15:04:52.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.621+0000 7f215ae00640 1 -- 172.21.15.7:0/4243935950 wait complete. 2024-09-13T15:04:52.643 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:04:52.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.781+0000 7f7168600640 1 Processor -- start 2024-09-13T15:04:52.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.781+0000 7f7168600640 1 -- start start 2024-09-13T15:04:52.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.785+0000 7f7168600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7160153500 0x7f716006c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:52.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.785+0000 7f7168600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f71600bffe0 0x7f71600cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:52.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.785+0000 7f7168600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71600c59c0 con 0x7f71600c66f0 2024-09-13T15:04:52.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.785+0000 7f7168600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7160159d30 con 0x7f71600bffe0 2024-09-13T15:04:52.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.785+0000 7f7168600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71600c6b00 con 0x7f7160153500 2024-09-13T15:04:52.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.785+0000 7f7165200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f71600bffe0 0x7f71600cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:52.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.785+0000 7f7166600640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f71600c66f0 0x7f716015c780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33274/0 (socket says 172.21.15.7:33274) 2024-09-13T15:04:52.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.785+0000 7f7166600640 1 -- 172.21.15.7:0/4201568254 learned_addr learned my addr 172.21.15.7:0/4201568254 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:52.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.785+0000 7f7165c00640 1 --2- 172.21.15.7:0/4201568254 >> v2:172.21.15.77:3300/0 conn(0x7f7160153500 0x7f716006c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:52.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.785+0000 7f7165200640 1 -- 172.21.15.7:0/4201568254 >> v2:172.21.15.77:3300/0 conn(0x7f7160153500 msgr2=0x7f716006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:52.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.785+0000 7f7165200640 1 --2- 172.21.15.7:0/4201568254 >> v2:172.21.15.77:3300/0 conn(0x7f7160153500 0x7f716006c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.785+0000 7f7165200640 1 -- 172.21.15.7:0/4201568254 >> v1:172.21.15.7:6789/0 conn(0x7f71600c66f0 legacy=0x7f716015c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:52.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.785+0000 7f7165200640 1 -- 172.21.15.7:0/4201568254 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7160159fa0 con 0x7f71600bffe0 2024-09-13T15:04:52.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.785+0000 7f7165200640 1 --2- 172.21.15.7:0/4201568254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71600bffe0 0x7f71600cbae0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f716006f140 tx=0x7f714c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c4aea4f83ac05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:52.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f715fe00640 1 -- 172.21.15.7:0/4201568254 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c0ab600 con 0x7f71600bffe0 2024-09-13T15:04:52.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f715fe00640 1 -- 172.21.15.7:0/4201568254 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c0a7050 con 0x7f71600bffe0 2024-09-13T15:04:52.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f715fe00640 1 -- 172.21.15.7:0/4201568254 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c0ab980 con 0x7f71600bffe0 2024-09-13T15:04:52.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7168600640 1 -- 172.21.15.7:0/4201568254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71600bffe0 msgr2=0x7f71600cbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:52.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7168600640 1 --2- 172.21.15.7:0/4201568254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71600bffe0 0x7f71600cbae0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f716006f140 tx=0x7f714c01c480 comp rx=0 tx=0).stop 2024-09-13T15:04:52.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7168600640 1 -- 172.21.15.7:0/4201568254 shutdown_connections 2024-09-13T15:04:52.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7168600640 1 --2- 172.21.15.7:0/4201568254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71600bffe0 0x7f71600cbae0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7168600640 1 --2- 172.21.15.7:0/4201568254 >> v2:172.21.15.77:3300/0 conn(0x7f7160153500 0x7f716006c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7168600640 1 -- 172.21.15.7:0/4201568254 >> 172.21.15.7:0/4201568254 conn(0x7f71600cafc0 msgr2=0x7f71600cb3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:52.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7168600640 1 -- 172.21.15.7:0/4201568254 shutdown_connections 2024-09-13T15:04:52.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7168600640 1 -- 172.21.15.7:0/4201568254 wait complete. 2024-09-13T15:04:52.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7168600640 1 Processor -- start 2024-09-13T15:04:52.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7168600640 1 -- start start 2024-09-13T15:04:52.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7168600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71600bffe0 0x7f71600c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:52.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7168600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71600c66f0 0x7f7160158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:52.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7168600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7160153500 0x7f716014ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:52.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7168600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71600c5240 con 0x7f71600bffe0 2024-09-13T15:04:52.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7168600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71601f5b80 con 0x7f7160153500 2024-09-13T15:04:52.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7168600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71601f5e60 con 0x7f71600c66f0 2024-09-13T15:04:52.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7165c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71600bffe0 0x7f71600c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:52.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7165c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71600bffe0 0x7f71600c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58158/0 (socket says 172.21.15.7:58158) 2024-09-13T15:04:52.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7165c00640 1 -- 172.21.15.7:0/2669860391 learned_addr learned my addr 172.21.15.7:0/2669860391 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:52.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7166600640 1 --2- 172.21.15.7:0/2669860391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7160153500 0x7f716014ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:52.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.789+0000 7f7165200640 1 --2- 172.21.15.7:0/2669860391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71600c66f0 0x7f7160158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:52.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.793+0000 7f7165c00640 1 -- 172.21.15.7:0/2669860391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71600c66f0 msgr2=0x7f7160158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:52.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.793+0000 7f7165c00640 1 --2- 172.21.15.7:0/2669860391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71600c66f0 0x7f7160158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.793+0000 7f7165c00640 1 -- 172.21.15.7:0/2669860391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7160153500 msgr2=0x7f716014ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:52.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.793+0000 7f7165c00640 1 --2- 172.21.15.7:0/2669860391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7160153500 0x7f716014ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:52.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.793+0000 7f7165c00640 1 -- 172.21.15.7:0/2669860391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c009420 con 0x7f71600bffe0 2024-09-13T15:04:52.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.793+0000 7f7165200640 1 --2- 172.21.15.7:0/2669860391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71600c66f0 0x7f7160158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:52.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.793+0000 7f7166600640 1 --2- 172.21.15.7:0/2669860391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7160153500 0x7f716014ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:52.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.793+0000 7f7165c00640 1 --2- 172.21.15.7:0/2669860391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71600bffe0 0x7f71600c3bd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f715400d5f0 tx=0x7f715400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.793+0000 7f715d600640 1 -- 172.21.15.7:0/2669860391 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71540125f0 con 0x7f71600bffe0 2024-09-13T15:04:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.793+0000 7f715d600640 1 -- 172.21.15.7:0/2669860391 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7154012750 con 0x7f71600bffe0 2024-09-13T15:04:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.793+0000 7f715d600640 1 -- 172.21.15.7:0/2669860391 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7154012ae0 con 0x7f71600bffe0 2024-09-13T15:04:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.793+0000 7f7168600640 1 -- 172.21.15.7:0/2669860391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71600c4910 con 0x7f71600bffe0 2024-09-13T15:04:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.793+0000 7f7168600640 1 -- 172.21.15.7:0/2669860391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71600c4ed0 con 0x7f71600bffe0 2024-09-13T15:04:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.793+0000 7f7168600640 1 -- 172.21.15.7:0/2669860391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71600c4110 con 0x7f71600bffe0 2024-09-13T15:04:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.793+0000 7f715d600640 1 -- 172.21.15.7:0/2669860391 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7154012c40 con 0x7f71600bffe0 2024-09-13T15:04:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.797+0000 7f715d600640 1 --2- 172.21.15.7:0/2669860391 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f71400666c0 0x7f7140068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.797+0000 7f715d600640 1 -- 172.21.15.7:0/2669860391 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7154084ac0 con 0x7f71600bffe0 2024-09-13T15:04:52.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.797+0000 7f7165200640 1 --2- 172.21.15.7:0/2669860391 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f71400666c0 0x7f7140068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:52.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.797+0000 7f7165200640 1 --2- 172.21.15.7:0/2669860391 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f71400666c0 0x7f7140068b80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f714c0ad000 tx=0x7f714c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:52.801+0000 7f715d600640 1 -- 172.21.15.7:0/2669860391 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f71540519e0 con 0x7f71600bffe0 2024-09-13T15:04:53.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.001+0000 7f7168600640 1 -- 172.21.15.7:0/2669860391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71601599e0 con 0x7f71600bffe0 2024-09-13T15:04:53.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.001+0000 7f715d600640 1 -- 172.21.15.7:0/2669860391 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6299 (secure 0 0 0) 0x7f7154084e60 con 0x7f71600bffe0 2024-09-13T15:04:53.003 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:53.003 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:04:36.936420+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"e","rank":4,"incarnation":17,"state":"up:active","state_seq":46,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:04:53.003 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 18 2024-09-13T15:04:53.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.001+0000 7f7168600640 1 -- 172.21.15.7:0/2669860391 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f71400666c0 msgr2=0x7f7140068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:53.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.001+0000 7f7168600640 1 --2- 172.21.15.7:0/2669860391 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f71400666c0 0x7f7140068b80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f714c0ad000 tx=0x7f714c008040 comp rx=0 tx=0).stop 2024-09-13T15:04:53.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.001+0000 7f7168600640 1 -- 172.21.15.7:0/2669860391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71600bffe0 msgr2=0x7f71600c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:53.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.001+0000 7f7168600640 1 --2- 172.21.15.7:0/2669860391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71600bffe0 0x7f71600c3bd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f715400d5f0 tx=0x7f715400dab0 comp rx=0 tx=0).stop 2024-09-13T15:04:53.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.001+0000 7f7168600640 1 -- 172.21.15.7:0/2669860391 shutdown_connections 2024-09-13T15:04:53.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.001+0000 7f7168600640 1 --2- 172.21.15.7:0/2669860391 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f71400666c0 0x7f7140068b80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:53.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.001+0000 7f7168600640 1 --2- 172.21.15.7:0/2669860391 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7160153500 0x7f716014ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:53.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.001+0000 7f7168600640 1 --2- 172.21.15.7:0/2669860391 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71600c66f0 0x7f7160158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:53.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.001+0000 7f7168600640 1 --2- 172.21.15.7:0/2669860391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71600bffe0 0x7f71600c3bd0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:53.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.001+0000 7f7168600640 1 -- 172.21.15.7:0/2669860391 >> 172.21.15.7:0/2669860391 conn(0x7f71600cafc0 msgr2=0x7f7160071220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:53.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.001+0000 7f7168600640 1 -- 172.21.15.7:0/2669860391 shutdown_connections 2024-09-13T15:04:53.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.001+0000 7f7168600640 1 -- 172.21.15.7:0/2669860391 wait complete. 2024-09-13T15:04:53.023 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:04:53.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.161+0000 7f3c62600640 1 Processor -- start 2024-09-13T15:04:53.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.161+0000 7f3c62600640 1 -- start start 2024-09-13T15:04:53.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.161+0000 7f3c62600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c5c0c5e90 0x7f3c5c15cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:53.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.165+0000 7f3c62600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c5c15d180 0x7f3c5c0c6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:53.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.165+0000 7f3c62600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c5c0c8380 con 0x7f3c5c0c5ab0 2024-09-13T15:04:53.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.165+0000 7f3c62600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c5c06cce0 con 0x7f3c5c0c5e90 2024-09-13T15:04:53.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.165+0000 7f3c62600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c15d630 con 0x7f3c5c15d180 2024-09-13T15:04:53.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.165+0000 7f3c53e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3c5c0c5e90 0x7f3c5c15cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:53.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.165+0000 7f3c5b400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f3c5c0c5ab0 0x7f3c5c153020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33282/0 (socket says 172.21.15.7:33282) 2024-09-13T15:04:53.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.165+0000 7f3c5b400640 1 -- 172.21.15.7:0/4109886974 learned_addr learned my addr 172.21.15.7:0/4109886974 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:53.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.165+0000 7f3c5be00640 1 --2- 172.21.15.7:0/4109886974 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c5c15d180 0x7f3c5c0c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:53.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.165+0000 7f3c53e00640 1 -- 172.21.15.7:0/4109886974 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c5c15d180 msgr2=0x7f3c5c0c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:53.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.165+0000 7f3c53e00640 1 --2- 172.21.15.7:0/4109886974 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c5c15d180 0x7f3c5c0c6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:53.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.165+0000 7f3c53e00640 1 -- 172.21.15.7:0/4109886974 >> v1:172.21.15.7:6789/0 conn(0x7f3c5c0c5ab0 legacy=0x7f3c5c153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:53.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.165+0000 7f3c53e00640 1 -- 172.21.15.7:0/4109886974 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c06cf30 con 0x7f3c5c0c5e90 2024-09-13T15:04:53.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.165+0000 7f3c5aa00640 1 -- 172.21.15.7:0/4109886974 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420809451 0 0) 0x7f3c4c001120 con 0x7f3c5c0c5ab0 2024-09-13T15:04:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.165+0000 7f3c53e00640 1 --2- 172.21.15.7:0/4109886974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c5c0c5e90 0x7f3c5c15cc40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3c440097c0 tx=0x7f3c4401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66aa66835fb85c6b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.165+0000 7f3c5aa00640 1 -- 172.21.15.7:0/4109886974 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c440ab670 con 0x7f3c5c0c5e90 2024-09-13T15:04:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.165+0000 7f3c5aa00640 1 -- 172.21.15.7:0/4109886974 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c440ab7d0 con 0x7f3c5c0c5e90 2024-09-13T15:04:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.165+0000 7f3c5aa00640 1 -- 172.21.15.7:0/4109886974 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c440abb60 con 0x7f3c5c0c5e90 2024-09-13T15:04:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c62600640 1 -- 172.21.15.7:0/4109886974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c5c0c5e90 msgr2=0x7f3c5c15cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c62600640 1 --2- 172.21.15.7:0/4109886974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c5c0c5e90 0x7f3c5c15cc40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3c440097c0 tx=0x7f3c4401c470 comp rx=0 tx=0).stop 2024-09-13T15:04:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c62600640 1 -- 172.21.15.7:0/4109886974 shutdown_connections 2024-09-13T15:04:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c62600640 1 --2- 172.21.15.7:0/4109886974 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c5c15d180 0x7f3c5c0c6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c62600640 1 --2- 172.21.15.7:0/4109886974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c5c0c5e90 0x7f3c5c15cc40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c62600640 1 -- 172.21.15.7:0/4109886974 >> 172.21.15.7:0/4109886974 conn(0x7f3c5c065d40 msgr2=0x7f3c5c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:53.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c62600640 1 -- 172.21.15.7:0/4109886974 shutdown_connections 2024-09-13T15:04:53.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c62600640 1 -- 172.21.15.7:0/4109886974 wait complete. 2024-09-13T15:04:53.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c62600640 1 Processor -- start 2024-09-13T15:04:53.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c62600640 1 -- start start 2024-09-13T15:04:53.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c62600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c5c0c5ab0 0x7f3c5c0c3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:53.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c62600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c5c0c5e90 0x7f3c5c1f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:53.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c62600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c5c15d180 0x7f3c5c144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c62600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0c37c0 con 0x7f3c5c0c5ab0 2024-09-13T15:04:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c62600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0ae790 con 0x7f3c5c15d180 2024-09-13T15:04:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c62600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5c0c2da0 con 0x7f3c5c0c5e90 2024-09-13T15:04:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c5b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c5c0c5ab0 0x7f3c5c0c3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c5b400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c5c0c5ab0 0x7f3c5c0c3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58178/0 (socket says 172.21.15.7:58178) 2024-09-13T15:04:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c5b400640 1 -- 172.21.15.7:0/3952143684 learned_addr learned my addr 172.21.15.7:0/3952143684 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c53e00640 1 --2- 172.21.15.7:0/3952143684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c5c0c5e90 0x7f3c5c1f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c5be00640 1 --2- 172.21.15.7:0/3952143684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c5c15d180 0x7f3c5c144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c5b400640 1 -- 172.21.15.7:0/3952143684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c5c0c5e90 msgr2=0x7f3c5c1f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c5b400640 1 --2- 172.21.15.7:0/3952143684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c5c0c5e90 0x7f3c5c1f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c5b400640 1 -- 172.21.15.7:0/3952143684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c5c15d180 msgr2=0x7f3c5c144530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:53.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c5b400640 1 --2- 172.21.15.7:0/3952143684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c5c15d180 0x7f3c5c144530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c5b400640 1 -- 172.21.15.7:0/3952143684 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c44009420 con 0x7f3c5c0c5ab0 2024-09-13T15:04:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.169+0000 7f3c5be00640 1 --2- 172.21.15.7:0/3952143684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c5c15d180 0x7f3c5c144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:04:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.173+0000 7f3c5b400640 1 --2- 172.21.15.7:0/3952143684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c5c0c5ab0 0x7f3c5c0c3280 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00c480 tx=0x7f3c4c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.173+0000 7f3c53400640 1 -- 172.21.15.7:0/3952143684 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c0074e0 con 0x7f3c5c0c5ab0 2024-09-13T15:04:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.173+0000 7f3c53400640 1 -- 172.21.15.7:0/3952143684 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4c007660 con 0x7f3c5c0c5ab0 2024-09-13T15:04:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.173+0000 7f3c53400640 1 -- 172.21.15.7:0/3952143684 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c004a30 con 0x7f3c5c0c5ab0 2024-09-13T15:04:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.173+0000 7f3c62600640 1 -- 172.21.15.7:0/3952143684 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c5c147020 con 0x7f3c5c0c5ab0 2024-09-13T15:04:53.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.173+0000 7f3c62600640 1 -- 172.21.15.7:0/3952143684 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c5c1f5e90 con 0x7f3c5c0c5ab0 2024-09-13T15:04:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.173+0000 7f3c62600640 1 -- 172.21.15.7:0/3952143684 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c5c067650 con 0x7f3c5c0c5ab0 2024-09-13T15:04:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.173+0000 7f3c53400640 1 -- 172.21.15.7:0/3952143684 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3c4c004b90 con 0x7f3c5c0c5ab0 2024-09-13T15:04:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.173+0000 7f3c53400640 1 --2- 172.21.15.7:0/3952143684 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3c38066690 0x7f3c38068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:53.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.173+0000 7f3c53400640 1 -- 172.21.15.7:0/3952143684 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3c4c083580 con 0x7f3c5c0c5ab0 2024-09-13T15:04:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.173+0000 7f3c53e00640 1 --2- 172.21.15.7:0/3952143684 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3c38066690 0x7f3c38068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:53.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.177+0000 7f3c53e00640 1 --2- 172.21.15.7:0/3952143684 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3c38066690 0x7f3c38068b50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c440af000 tx=0x7f3c440a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:53.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.177+0000 7f3c53400640 1 -- 172.21.15.7:0/3952143684 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3c4c053fb0 con 0x7f3c5c0c5ab0 2024-09-13T15:04:53.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.341+0000 7f3c62600640 1 -- 172.21.15.7:0/3952143684 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c5c0c8380 con 0x7f3c5c0c5ab0 2024-09-13T15:04:53.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.341+0000 7f3c53400640 1 -- 172.21.15.7:0/3952143684 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18616 (secure 0 0 0) 0x7f3c5c0c8380 con 0x7f3c5c0c5ab0 2024-09-13T15:04:53.343 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:53.343 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:02:33.732864+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:04:53.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.341+0000 7f3c62600640 1 -- 172.21.15.7:0/3952143684 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3c38066690 msgr2=0x7f3c38068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:53.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.341+0000 7f3c62600640 1 --2- 172.21.15.7:0/3952143684 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3c38066690 0x7f3c38068b50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c440af000 tx=0x7f3c440a7000 comp rx=0 tx=0).stop 2024-09-13T15:04:53.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.341+0000 7f3c62600640 1 -- 172.21.15.7:0/3952143684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c5c0c5ab0 msgr2=0x7f3c5c0c3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:53.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.341+0000 7f3c62600640 1 --2- 172.21.15.7:0/3952143684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c5c0c5ab0 0x7f3c5c0c3280 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c00c480 tx=0x7f3c4c00c940 comp rx=0 tx=0).stop 2024-09-13T15:04:53.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.341+0000 7f3c62600640 1 -- 172.21.15.7:0/3952143684 shutdown_connections 2024-09-13T15:04:53.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.341+0000 7f3c62600640 1 --2- 172.21.15.7:0/3952143684 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3c38066690 0x7f3c38068b50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:53.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.341+0000 7f3c62600640 1 --2- 172.21.15.7:0/3952143684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c5c15d180 0x7f3c5c144530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:53.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.341+0000 7f3c62600640 1 --2- 172.21.15.7:0/3952143684 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3c5c0c5e90 0x7f3c5c1f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:53.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.341+0000 7f3c62600640 1 --2- 172.21.15.7:0/3952143684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c5c0c5ab0 0x7f3c5c0c3280 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:53.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.341+0000 7f3c62600640 1 -- 172.21.15.7:0/3952143684 >> 172.21.15.7:0/3952143684 conn(0x7f3c5c065d40 msgr2=0x7f3c5c152df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:53.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.345+0000 7f3c62600640 1 -- 172.21.15.7:0/3952143684 shutdown_connections 2024-09-13T15:04:53.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:53.345+0000 7f3c62600640 1 -- 172.21.15.7:0/3952143684 wait complete. 2024-09-13T15:04:53.365 DEBUG:tasks.mds_thrash:Yielding 2024-09-13T15:04:53.365 INFO:teuthology.run_tasks:Running task workunit... 2024-09-13T15:04:53.379 INFO:tasks.workunit:Pulling workunits from ref 50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:04:53.379 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T15:04:53.379 INFO:tasks.workunit:timeout=3h 2024-09-13T15:04:53.379 INFO:tasks.workunit:cleanup=True 2024-09-13T15:04:53.380 DEBUG:teuthology.orchestra.run.smithi007:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T15:04:53.380 INFO:tasks.mds_thrash.fs.[cephfs]:starting mds_do_thrash for fs cephfs 2024-09-13T15:04:53.380 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 1 secs before thrashing 2024-09-13T15:04:53.389 INFO:teuthology.orchestra.run.smithi007.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T15:04:53.389 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-13T15:04:53.389 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 2ch/44d Inode: 1 Links: 2 2024-09-13T15:04:53.390 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T15:04:53.390 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T15:04:53.390 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-13 15:01:49.795688213 +0000 2024-09-13T15:04:53.390 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-13 15:03:59.316575341 +0000 2024-09-13T15:04:53.390 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-13 15:01:49.795688213 +0000 2024-09-13T15:04:53.390 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T15:04:53.390 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T15:04:53.572 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 50bbe7f395997dcd871813949c49addbbf630361 2024-09-13T15:04:53.583 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T15:04:54.382 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:04:54.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.525+0000 7f574c600640 1 Processor -- start 2024-09-13T15:04:54.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.525+0000 7f574c600640 1 -- start start 2024-09-13T15:04:54.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.525+0000 7f574c600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f57440c5ab0 0x7f5744153020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:54.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.525+0000 7f574c600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f574415d350 0x7f5744153560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:54.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.525+0000 7f574c600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57440c8380 con 0x7f57440c5e90 2024-09-13T15:04:54.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.525+0000 7f574c600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574406cce0 con 0x7f574415d350 2024-09-13T15:04:54.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.525+0000 7f574c600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574406cf30 con 0x7f57440c5ab0 2024-09-13T15:04:54.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.525+0000 7f5749200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f57440c5e90 0x7f574415cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33290/0 (socket says 172.21.15.7:33290) 2024-09-13T15:04:54.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.525+0000 7f574a600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f574415d350 0x7f5744153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:54.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.525+0000 7f5749200640 1 -- 172.21.15.7:0/2686556597 learned_addr learned my addr 172.21.15.7:0/2686556597 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:54.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.525+0000 7f5749c00640 1 --2- 172.21.15.7:0/2686556597 >> v2:172.21.15.77:3300/0 conn(0x7f57440c5ab0 0x7f5744153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:54.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.525+0000 7f5743e00640 1 -- 172.21.15.7:0/2686556597 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493588931 0 0) 0x7f5730001120 con 0x7f57440c5e90 2024-09-13T15:04:54.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.525+0000 7f5743e00640 1 -- 172.21.15.7:0/2686556597 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f572c003530 con 0x7f57440c5e90 2024-09-13T15:04:54.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.525+0000 7f574a600640 1 -- 172.21.15.7:0/2686556597 >> v2:172.21.15.77:3300/0 conn(0x7f57440c5ab0 msgr2=0x7f5744153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:54.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.525+0000 7f574a600640 1 --2- 172.21.15.7:0/2686556597 >> v2:172.21.15.77:3300/0 conn(0x7f57440c5ab0 0x7f5744153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:54.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.525+0000 7f574a600640 1 -- 172.21.15.7:0/2686556597 >> v1:172.21.15.7:6789/0 conn(0x7f57440c5e90 legacy=0x7f574415cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:54.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.525+0000 7f574a600640 1 -- 172.21.15.7:0/2686556597 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574406d210 con 0x7f574415d350 2024-09-13T15:04:54.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.529+0000 7f574a600640 1 --2- 172.21.15.7:0/2686556597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f574415d350 0x7f5744153560 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f574406de80 tx=0x7f573c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7398a5ec8731389 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:54.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.529+0000 7f5743e00640 1 -- 172.21.15.7:0/2686556597 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c0a59c0 con 0x7f574415d350 2024-09-13T15:04:54.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.529+0000 7f5743e00640 1 -- 172.21.15.7:0/2686556597 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c0a5b20 con 0x7f574415d350 2024-09-13T15:04:54.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.529+0000 7f5743e00640 1 -- 172.21.15.7:0/2686556597 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c0ad440 con 0x7f574415d350 2024-09-13T15:04:54.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.529+0000 7f574c600640 1 -- 172.21.15.7:0/2686556597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f574415d350 msgr2=0x7f5744153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:54.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.529+0000 7f574c600640 1 --2- 172.21.15.7:0/2686556597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f574415d350 0x7f5744153560 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f574406de80 tx=0x7f573c01c900 comp rx=0 tx=0).stop 2024-09-13T15:04:54.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.529+0000 7f574c600640 1 -- 172.21.15.7:0/2686556597 shutdown_connections 2024-09-13T15:04:54.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.529+0000 7f574c600640 1 --2- 172.21.15.7:0/2686556597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f574415d350 0x7f5744153560 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:54.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.529+0000 7f574c600640 1 --2- 172.21.15.7:0/2686556597 >> v2:172.21.15.77:3300/0 conn(0x7f57440c5ab0 0x7f5744153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:54.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.529+0000 7f574c600640 1 -- 172.21.15.7:0/2686556597 >> 172.21.15.7:0/2686556597 conn(0x7f5744065d40 msgr2=0x7f5744066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:54.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.529+0000 7f574c600640 1 -- 172.21.15.7:0/2686556597 shutdown_connections 2024-09-13T15:04:54.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.529+0000 7f574c600640 1 -- 172.21.15.7:0/2686556597 wait complete. 2024-09-13T15:04:54.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.529+0000 7f574c600640 1 Processor -- start 2024-09-13T15:04:54.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574c600640 1 -- start start 2024-09-13T15:04:54.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574c600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57440c5ab0 0x7f57440c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:54.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574c600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57440c5e90 0x7f574414b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:54.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574c600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f574415d350 0x7f574414b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:54.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574c600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574414b200 con 0x7f574415d350 2024-09-13T15:04:54.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574c600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57440c2ec0 con 0x7f57440c5ab0 2024-09-13T15:04:54.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574c600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574414acd0 con 0x7f57440c5e90 2024-09-13T15:04:54.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574a600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f574415d350 0x7f574414b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:54.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574a600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f574415d350 0x7f574414b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58198/0 (socket says 172.21.15.7:58198) 2024-09-13T15:04:54.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574a600640 1 -- 172.21.15.7:0/3778966697 learned_addr learned my addr 172.21.15.7:0/3778966697 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:54.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f5749200640 1 --2- 172.21.15.7:0/3778966697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57440c5e90 0x7f574414b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:54.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f5749c00640 1 --2- 172.21.15.7:0/3778966697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57440c5ab0 0x7f57440c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:54.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574a600640 1 -- 172.21.15.7:0/3778966697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57440c5e90 msgr2=0x7f574414b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:54.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574a600640 1 --2- 172.21.15.7:0/3778966697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57440c5e90 0x7f574414b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:54.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574a600640 1 -- 172.21.15.7:0/3778966697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57440c5ab0 msgr2=0x7f57440c48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:54.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574a600640 1 --2- 172.21.15.7:0/3778966697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57440c5ab0 0x7f57440c48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:54.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574a600640 1 -- 172.21.15.7:0/3778966697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c009a70 con 0x7f574415d350 2024-09-13T15:04:54.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f5749c00640 1 --2- 172.21.15.7:0/3778966697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57440c5ab0 0x7f57440c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:54.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574a600640 1 --2- 172.21.15.7:0/3778966697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f574415d350 0x7f574414b9d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f573c019510 tx=0x7f573c0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:54.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f5741600640 1 -- 172.21.15.7:0/3778966697 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c0adcc0 con 0x7f574415d350 2024-09-13T15:04:54.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f5741600640 1 -- 172.21.15.7:0/3778966697 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c0ade20 con 0x7f574415d350 2024-09-13T15:04:54.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f5741600640 1 -- 172.21.15.7:0/3778966697 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c0b9690 con 0x7f574415d350 2024-09-13T15:04:54.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574c600640 1 -- 172.21.15.7:0/3778966697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57440c31a0 con 0x7f574415d350 2024-09-13T15:04:54.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574c600640 1 -- 172.21.15.7:0/3778966697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574414af20 con 0x7f574415d350 2024-09-13T15:04:54.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.533+0000 7f574c600640 1 -- 172.21.15.7:0/3778966697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5744067650 con 0x7f574415d350 2024-09-13T15:04:54.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.537+0000 7f5741600640 1 -- 172.21.15.7:0/3778966697 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f573c0b97f0 con 0x7f574415d350 2024-09-13T15:04:54.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.537+0000 7f5741600640 1 --2- 172.21.15.7:0/3778966697 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5724066690 0x7f5724068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:54.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.537+0000 7f5741600640 1 -- 172.21.15.7:0/3778966697 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f573c11fb50 con 0x7f574415d350 2024-09-13T15:04:54.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.537+0000 7f5749c00640 1 --2- 172.21.15.7:0/3778966697 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5724066690 0x7f5724068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:54.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.537+0000 7f5749c00640 1 --2- 172.21.15.7:0/3778966697 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5724066690 0x7f5724068b50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5738009b10 tx=0x7f5738008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:54.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.541+0000 7f5741600640 1 -- 172.21.15.7:0/3778966697 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f573c0ecb90 con 0x7f574415d350 2024-09-13T15:04:54.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.733+0000 7f574c600640 1 -- 172.21.15.7:0/3778966697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57440c3000 con 0x7f574415d350 2024-09-13T15:04:54.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.733+0000 7f5741600640 1 -- 172.21.15.7:0/3778966697 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6299 (secure 0 0 0) 0x7f57440c3000 con 0x7f574415d350 2024-09-13T15:04:54.737 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:54.737 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:04:36.936420+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"e","rank":4,"incarnation":17,"state":"up:active","state_seq":46,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:04:54.738 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 18 2024-09-13T15:04:54.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.737+0000 7f574c600640 1 -- 172.21.15.7:0/3778966697 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5724066690 msgr2=0x7f5724068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:54.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.737+0000 7f574c600640 1 --2- 172.21.15.7:0/3778966697 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5724066690 0x7f5724068b50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5738009b10 tx=0x7f5738008040 comp rx=0 tx=0).stop 2024-09-13T15:04:54.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.737+0000 7f574c600640 1 -- 172.21.15.7:0/3778966697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f574415d350 msgr2=0x7f574414b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:54.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.737+0000 7f574c600640 1 --2- 172.21.15.7:0/3778966697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f574415d350 0x7f574414b9d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f573c019510 tx=0x7f573c0196a0 comp rx=0 tx=0).stop 2024-09-13T15:04:54.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.737+0000 7f574c600640 1 -- 172.21.15.7:0/3778966697 shutdown_connections 2024-09-13T15:04:54.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.737+0000 7f574c600640 1 --2- 172.21.15.7:0/3778966697 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5724066690 0x7f5724068b50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:54.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.737+0000 7f574c600640 1 --2- 172.21.15.7:0/3778966697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f574415d350 0x7f574414b9d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:54.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.737+0000 7f574c600640 1 --2- 172.21.15.7:0/3778966697 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f57440c5e90 0x7f574414b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:54.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.737+0000 7f574c600640 1 --2- 172.21.15.7:0/3778966697 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57440c5ab0 0x7f57440c48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:54.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.737+0000 7f574c600640 1 -- 172.21.15.7:0/3778966697 >> 172.21.15.7:0/3778966697 conn(0x7f5744065d40 msgr2=0x7f574414d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:54.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.737+0000 7f574c600640 1 -- 172.21.15.7:0/3778966697 shutdown_connections 2024-09-13T15:04:54.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.737+0000 7f574c600640 1 -- 172.21.15.7:0/3778966697 wait complete. 2024-09-13T15:04:54.759 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.e (rank=4) 2024-09-13T15:04:54.760 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-09-13T15:04:54.760 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:04:54.774 INFO:tasks.ceph.mds.e:Stopped 2024-09-13T15:04:54.774 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:04:54.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.953+0000 7fe7b7e00640 1 Processor -- start 2024-09-13T15:04:54.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.953+0000 7fe7b7e00640 1 -- start start 2024-09-13T15:04:54.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.957+0000 7fe7b7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe7b80c7f60 0x7fe7b80c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:54.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.957+0000 7fe7b7e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe7b8069fa0 0x7fe7b806a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:54.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.957+0000 7fe7b7e00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b80c7ad0 con 0x7fe7b8152ff0 2024-09-13T15:04:54.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.957+0000 7fe7b7e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b806efa0 con 0x7fe7b80c7f60 2024-09-13T15:04:54.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.957+0000 7fe7b7e00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7b80c88d0 con 0x7fe7b8069fa0 2024-09-13T15:04:54.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.957+0000 7fe7afe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe7b80c7f60 0x7fe7b80c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:54.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.957+0000 7fe7afe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe7b80c7f60 0x7fe7b80c8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58200/0 (socket says 172.21.15.7:58200) 2024-09-13T15:04:54.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.957+0000 7fe7afe00640 1 -- 172.21.15.7:0/2825135946 learned_addr learned my addr 172.21.15.7:0/2825135946 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:54.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.957+0000 7fe7b7400640 1 --2- 172.21.15.7:0/2825135946 >> v2:172.21.15.77:3300/0 conn(0x7fe7b8069fa0 0x7fe7b806a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:54.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.957+0000 7fe7afe00640 1 -- 172.21.15.7:0/2825135946 >> v2:172.21.15.77:3300/0 conn(0x7fe7b8069fa0 msgr2=0x7fe7b806a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:54.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.957+0000 7fe7afe00640 1 --2- 172.21.15.7:0/2825135946 >> v2:172.21.15.77:3300/0 conn(0x7fe7b8069fa0 0x7fe7b806a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:54.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.957+0000 7fe7afe00640 1 -- 172.21.15.7:0/2825135946 >> v1:172.21.15.77:6789/0 conn(0x7fe7b8152ff0 legacy=0x7fe7b80cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:54.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.957+0000 7fe7afe00640 1 -- 172.21.15.7:0/2825135946 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b815c5a0 con 0x7fe7b80c7f60 2024-09-13T15:04:54.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7afe00640 1 --2- 172.21.15.7:0/2825135946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7b80c7f60 0x7fe7b80c8390 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe7b80cd960 tx=0x7fe7a001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d5acf2094591fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:54.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b6000640 1 -- 172.21.15.7:0/2825135946 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a00aa650 con 0x7fe7b80c7f60 2024-09-13T15:04:54.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b6000640 1 -- 172.21.15.7:0/2825135946 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a00aa7b0 con 0x7fe7b80c7f60 2024-09-13T15:04:54.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b6000640 1 -- 172.21.15.7:0/2825135946 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a00aab40 con 0x7fe7b80c7f60 2024-09-13T15:04:54.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b7e00640 1 -- 172.21.15.7:0/2825135946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7b80c7f60 msgr2=0x7fe7b80c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:54.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b7e00640 1 --2- 172.21.15.7:0/2825135946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7b80c7f60 0x7fe7b80c8390 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe7b80cd960 tx=0x7fe7a001c4f0 comp rx=0 tx=0).stop 2024-09-13T15:04:54.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b7e00640 1 -- 172.21.15.7:0/2825135946 shutdown_connections 2024-09-13T15:04:54.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b7e00640 1 --2- 172.21.15.7:0/2825135946 >> v2:172.21.15.77:3300/0 conn(0x7fe7b8069fa0 0x7fe7b806a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:54.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b7e00640 1 --2- 172.21.15.7:0/2825135946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7b80c7f60 0x7fe7b80c8390 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:54.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b7e00640 1 -- 172.21.15.7:0/2825135946 >> 172.21.15.7:0/2825135946 conn(0x7fe7b806da90 msgr2=0x7fe7b8065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:54.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b7e00640 1 -- 172.21.15.7:0/2825135946 shutdown_connections 2024-09-13T15:04:54.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b7e00640 1 -- 172.21.15.7:0/2825135946 wait complete. 2024-09-13T15:04:54.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b7e00640 1 Processor -- start 2024-09-13T15:04:54.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b7e00640 1 -- start start 2024-09-13T15:04:54.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7b8069fa0 0x7fe7b81f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:54.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b80c7f60 0x7fe7b80c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:54.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7b8152ff0 0x7fe7b80c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:54.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b7e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b81f5b10 con 0x7fe7b8069fa0 2024-09-13T15:04:54.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b7e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b81f5df0 con 0x7fe7b80c7f60 2024-09-13T15:04:54.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.961+0000 7fe7b7e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b8147730 con 0x7fe7b8152ff0 2024-09-13T15:04:54.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7b6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7b8069fa0 0x7fe7b81f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:54.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7b6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7b8069fa0 0x7fe7b81f5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58214/0 (socket says 172.21.15.7:58214) 2024-09-13T15:04:54.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7b6a00640 1 -- 172.21.15.7:0/1454399226 learned_addr learned my addr 172.21.15.7:0/1454399226 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:54.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7afe00640 1 --2- 172.21.15.7:0/1454399226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b80c7f60 0x7fe7b80c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:54.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7b7400640 1 --2- 172.21.15.7:0/1454399226 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7b8152ff0 0x7fe7b80c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:54.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7b6a00640 1 -- 172.21.15.7:0/1454399226 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7b8152ff0 msgr2=0x7fe7b80c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:54.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7b6a00640 1 --2- 172.21.15.7:0/1454399226 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7b8152ff0 0x7fe7b80c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:54.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7b6a00640 1 -- 172.21.15.7:0/1454399226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b80c7f60 msgr2=0x7fe7b80c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:54.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7b6a00640 1 --2- 172.21.15.7:0/1454399226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b80c7f60 0x7fe7b80c4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:54.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7b6a00640 1 -- 172.21.15.7:0/1454399226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a00094d0 con 0x7fe7b8069fa0 2024-09-13T15:04:54.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7afe00640 1 --2- 172.21.15.7:0/1454399226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b80c7f60 0x7fe7b80c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:04:54.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7b6a00640 1 --2- 172.21.15.7:0/1454399226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7b8069fa0 0x7fe7b81f5240 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800c3c0 tx=0x7fe7a800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:54.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7aea00640 1 -- 172.21.15.7:0/1454399226 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a80052d0 con 0x7fe7b8069fa0 2024-09-13T15:04:54.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7aea00640 1 -- 172.21.15.7:0/1454399226 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a8005430 con 0x7fe7b8069fa0 2024-09-13T15:04:54.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7b7e00640 1 -- 172.21.15.7:0/1454399226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b8147a10 con 0x7fe7b8069fa0 2024-09-13T15:04:54.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7aea00640 1 -- 172.21.15.7:0/1454399226 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a8003840 con 0x7fe7b8069fa0 2024-09-13T15:04:54.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7b7e00640 1 -- 172.21.15.7:0/1454399226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b80cb060 con 0x7fe7b8069fa0 2024-09-13T15:04:54.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7b7e00640 1 -- 172.21.15.7:0/1454399226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b8152870 con 0x7fe7b8069fa0 2024-09-13T15:04:54.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.965+0000 7fe7aea00640 1 -- 172.21.15.7:0/1454399226 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe7a80039a0 con 0x7fe7b8069fa0 2024-09-13T15:04:54.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.969+0000 7fe7aea00640 1 --2- 172.21.15.7:0/1454399226 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe794066690 0x7fe794068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:54.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.969+0000 7fe7aea00640 1 -- 172.21.15.7:0/1454399226 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe7a8083bc0 con 0x7fe7b8069fa0 2024-09-13T15:04:54.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.969+0000 7fe7afe00640 1 --2- 172.21.15.7:0/1454399226 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe794066690 0x7fe794068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:54.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.969+0000 7fe7afe00640 1 --2- 172.21.15.7:0/1454399226 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe794066690 0x7fe794068b50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00ae000 tx=0x7fe7a00a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:54.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:54.973+0000 7fe7aea00640 1 -- 172.21.15.7:0/1454399226 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe7a8050a40 con 0x7fe7b8069fa0 2024-09-13T15:04:55.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:55.165+0000 7fe7b7e00640 1 -- 172.21.15.7:0/1454399226 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7b81533d0 con 0x7fe7b8069fa0 2024-09-13T15:04:55.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:55.165+0000 7fe7aea00640 1 -- 172.21.15.7:0/1454399226 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6299 (secure 0 0 0) 0x7fe7a8017020 con 0x7fe7b8069fa0 2024-09-13T15:04:55.169 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:55.169 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:04:36.936420+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"e","rank":4,"incarnation":17,"state":"up:active","state_seq":46,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:04:55.169 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 18 2024-09-13T15:04:55.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:55.169+0000 7fe7b7e00640 1 -- 172.21.15.7:0/1454399226 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe794066690 msgr2=0x7fe794068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:55.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:55.169+0000 7fe7b7e00640 1 --2- 172.21.15.7:0/1454399226 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe794066690 0x7fe794068b50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe7a00ae000 tx=0x7fe7a00a7000 comp rx=0 tx=0).stop 2024-09-13T15:04:55.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:55.169+0000 7fe7b7e00640 1 -- 172.21.15.7:0/1454399226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7b8069fa0 msgr2=0x7fe7b81f5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:55.169+0000 7fe7b7e00640 1 --2- 172.21.15.7:0/1454399226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7b8069fa0 0x7fe7b81f5240 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe7a800c3c0 tx=0x7fe7a800c880 comp rx=0 tx=0).stop 2024-09-13T15:04:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:55.169+0000 7fe7b7e00640 1 -- 172.21.15.7:0/1454399226 shutdown_connections 2024-09-13T15:04:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:55.169+0000 7fe7b7e00640 1 --2- 172.21.15.7:0/1454399226 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe794066690 0x7fe794068b50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:55.169+0000 7fe7b7e00640 1 --2- 172.21.15.7:0/1454399226 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe7b8152ff0 0x7fe7b80c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:55.169+0000 7fe7b7e00640 1 --2- 172.21.15.7:0/1454399226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7b80c7f60 0x7fe7b80c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:55.169+0000 7fe7b7e00640 1 --2- 172.21.15.7:0/1454399226 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7b8069fa0 0x7fe7b81f5240 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:55.169+0000 7fe7b7e00640 1 -- 172.21.15.7:0/1454399226 >> 172.21.15.7:0/1454399226 conn(0x7fe7b806da90 msgr2=0x7fe7b80cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:55.169+0000 7fe7b7e00640 1 -- 172.21.15.7:0/1454399226 shutdown_connections 2024-09-13T15:04:55.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:55.169+0000 7fe7b7e00640 1 -- 172.21.15.7:0/1454399226 wait complete. 2024-09-13T15:04:55.190 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-13T15:04:57.190 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:04:57.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.341+0000 7ff534400640 1 Processor -- start 2024-09-13T15:04:57.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.341+0000 7ff534400640 1 -- start start 2024-09-13T15:04:57.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.341+0000 7ff534400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff52c0c5ab0 0x7ff52c153020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:57.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.341+0000 7ff534400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff52c0c5e90 0x7ff52c153560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:57.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.341+0000 7ff534400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52c0c8380 con 0x7ff52c15cc40 2024-09-13T15:04:57.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.341+0000 7ff534400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52c06cce0 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.341+0000 7ff534400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c06cf30 con 0x7ff52c0c5e90 2024-09-13T15:04:57.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.341+0000 7ff531a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff52c0c5ab0 0x7ff52c153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:57.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.341+0000 7ff532400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff52c15cc40 0x7ff52c15d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:33296/0 (socket says 172.21.15.7:33296) 2024-09-13T15:04:57.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.341+0000 7ff532400640 1 -- 172.21.15.7:0/2249658267 learned_addr learned my addr 172.21.15.7:0/2249658267 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:04:57.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.341+0000 7ff531000640 1 --2- 172.21.15.7:0/2249658267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff52c0c5e90 0x7ff52c153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:57.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.341+0000 7ff531a00640 1 -- 172.21.15.7:0/2249658267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff52c0c5e90 msgr2=0x7ff52c153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:57.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.341+0000 7ff531a00640 1 --2- 172.21.15.7:0/2249658267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff52c0c5e90 0x7ff52c153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:57.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.341+0000 7ff531a00640 1 -- 172.21.15.7:0/2249658267 >> v1:172.21.15.7:6789/0 conn(0x7ff52c15cc40 legacy=0x7ff52c15d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:57.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.341+0000 7ff531a00640 1 -- 172.21.15.7:0/2249658267 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c06d210 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.341+0000 7ff52be00640 1 -- 172.21.15.7:0/2249658267 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1237277844 0 0) 0x7ff5240014a0 con 0x7ff52c15cc40 2024-09-13T15:04:57.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.345+0000 7ff531a00640 1 --2- 172.21.15.7:0/2249658267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff52c0c5ab0 0x7ff52c153020 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff5200097c0 tx=0x7ff52001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89fd6e3192a787e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:57.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.345+0000 7ff52be00640 1 -- 172.21.15.7:0/2249658267 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5200ab670 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.345+0000 7ff52be00640 1 -- 172.21.15.7:0/2249658267 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5200ab7d0 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.345+0000 7ff52be00640 1 -- 172.21.15.7:0/2249658267 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5200abb60 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.345+0000 7ff534400640 1 -- 172.21.15.7:0/2249658267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff52c0c5ab0 msgr2=0x7ff52c153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:57.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.345+0000 7ff534400640 1 --2- 172.21.15.7:0/2249658267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff52c0c5ab0 0x7ff52c153020 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff5200097c0 tx=0x7ff52001c470 comp rx=0 tx=0).stop 2024-09-13T15:04:57.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.345+0000 7ff534400640 1 -- 172.21.15.7:0/2249658267 shutdown_connections 2024-09-13T15:04:57.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.345+0000 7ff534400640 1 --2- 172.21.15.7:0/2249658267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff52c0c5e90 0x7ff52c153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:57.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.345+0000 7ff534400640 1 --2- 172.21.15.7:0/2249658267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff52c0c5ab0 0x7ff52c153020 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:57.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.345+0000 7ff534400640 1 -- 172.21.15.7:0/2249658267 >> 172.21.15.7:0/2249658267 conn(0x7ff52c065d40 msgr2=0x7ff52c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:57.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.345+0000 7ff534400640 1 -- 172.21.15.7:0/2249658267 shutdown_connections 2024-09-13T15:04:57.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.345+0000 7ff534400640 1 -- 172.21.15.7:0/2249658267 wait complete. 2024-09-13T15:04:57.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff534400640 1 Processor -- start 2024-09-13T15:04:57.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff534400640 1 -- start start 2024-09-13T15:04:57.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff534400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff52c0c5ab0 0x7ff52c0c4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:57.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff534400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff52c0c5e90 0x7ff52c14cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:57.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff534400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff52c15cc40 0x7ff52c1f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:57.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff534400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c144ed0 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff534400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c15c0c0 con 0x7ff52c15cc40 2024-09-13T15:04:57.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff534400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c1f5790 con 0x7ff52c0c5e90 2024-09-13T15:04:57.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff531a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff52c0c5ab0 0x7ff52c0c4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:57.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff531a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff52c0c5ab0 0x7ff52c0c4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58230/0 (socket says 172.21.15.7:58230) 2024-09-13T15:04:57.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff531a00640 1 -- 172.21.15.7:0/4220887059 learned_addr learned my addr 172.21.15.7:0/4220887059 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:57.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff531000640 1 --2- 172.21.15.7:0/4220887059 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff52c0c5e90 0x7ff52c14cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:57.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff532400640 1 --2- 172.21.15.7:0/4220887059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff52c15cc40 0x7ff52c1f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:57.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff531a00640 1 -- 172.21.15.7:0/4220887059 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff52c0c5e90 msgr2=0x7ff52c14cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:57.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff531a00640 1 --2- 172.21.15.7:0/4220887059 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff52c0c5e90 0x7ff52c14cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:57.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff531a00640 1 -- 172.21.15.7:0/4220887059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff52c15cc40 msgr2=0x7ff52c1f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:57.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff531a00640 1 --2- 172.21.15.7:0/4220887059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff52c15cc40 0x7ff52c1f4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:57.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff531a00640 1 -- 172.21.15.7:0/4220887059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff520009420 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff532400640 1 --2- 172.21.15.7:0/4220887059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff52c15cc40 0x7ff52c1f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:04:57.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff531a00640 1 --2- 172.21.15.7:0/4220887059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff52c0c5ab0 0x7ff52c0c4c20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff5200ad040 tx=0x7ff52001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:57.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff529600640 1 -- 172.21.15.7:0/4220887059 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5200bf610 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff529600640 1 -- 172.21.15.7:0/4220887059 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5200bf7b0 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff529600640 1 -- 172.21.15.7:0/4220887059 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5200bfb60 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff534400640 1 -- 172.21.15.7:0/4220887059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52c0c2990 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.349+0000 7ff534400640 1 -- 172.21.15.7:0/4220887059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52c15c310 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.353+0000 7ff534400640 1 -- 172.21.15.7:0/4220887059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52c067650 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.353+0000 7ff529600640 1 -- 172.21.15.7:0/4220887059 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff5200b5400 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.353+0000 7ff529600640 1 --2- 172.21.15.7:0/4220887059 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff50c066690 0x7ff50c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:57.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.353+0000 7ff529600640 1 -- 172.21.15.7:0/4220887059 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff52011f250 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.353+0000 7ff531000640 1 --2- 172.21.15.7:0/4220887059 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff50c066690 0x7ff50c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:57.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.357+0000 7ff531000640 1 --2- 172.21.15.7:0/4220887059 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff50c066690 0x7ff50c068b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0c33e0 tx=0x7ff518008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:57.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.357+0000 7ff529600640 1 -- 172.21.15.7:0/4220887059 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff5200ec280 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.549+0000 7ff534400640 1 -- 172.21.15.7:0/4220887059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff52c15d0d0 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.553+0000 7ff529600640 1 -- 172.21.15.7:0/4220887059 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6299 (secure 0 0 0) 0x7ff5200ef8a0 con 0x7ff52c0c5ab0 2024-09-13T15:04:57.554 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:57.554 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:04:36.936420+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"e","rank":4,"incarnation":17,"state":"up:active","state_seq":46,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:04:57.554 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 18 2024-09-13T15:04:57.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.553+0000 7ff534400640 1 -- 172.21.15.7:0/4220887059 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff50c066690 msgr2=0x7ff50c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:57.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.553+0000 7ff534400640 1 --2- 172.21.15.7:0/4220887059 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff50c066690 0x7ff50c068b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0c33e0 tx=0x7ff518008040 comp rx=0 tx=0).stop 2024-09-13T15:04:57.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.553+0000 7ff534400640 1 -- 172.21.15.7:0/4220887059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff52c0c5ab0 msgr2=0x7ff52c0c4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:57.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.553+0000 7ff534400640 1 --2- 172.21.15.7:0/4220887059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff52c0c5ab0 0x7ff52c0c4c20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff5200ad040 tx=0x7ff52001acb0 comp rx=0 tx=0).stop 2024-09-13T15:04:57.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.553+0000 7ff534400640 1 -- 172.21.15.7:0/4220887059 shutdown_connections 2024-09-13T15:04:57.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.553+0000 7ff534400640 1 --2- 172.21.15.7:0/4220887059 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff50c066690 0x7ff50c068b50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:57.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.553+0000 7ff534400640 1 --2- 172.21.15.7:0/4220887059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff52c15cc40 0x7ff52c1f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:57.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.553+0000 7ff534400640 1 --2- 172.21.15.7:0/4220887059 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff52c0c5e90 0x7ff52c14cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:57.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.553+0000 7ff534400640 1 --2- 172.21.15.7:0/4220887059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff52c0c5ab0 0x7ff52c0c4c20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:57.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.553+0000 7ff534400640 1 -- 172.21.15.7:0/4220887059 >> 172.21.15.7:0/4220887059 conn(0x7ff52c065d40 msgr2=0x7ff52c152460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:57.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.553+0000 7ff534400640 1 -- 172.21.15.7:0/4220887059 shutdown_connections 2024-09-13T15:04:57.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:57.553+0000 7ff534400640 1 -- 172.21.15.7:0/4220887059 wait complete. 2024-09-13T15:04:57.575 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-13T15:04:59.576 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:04:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.725+0000 7f29e6600640 1 Processor -- start 2024-09-13T15:04:59.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.725+0000 7f29e6600640 1 -- start start 2024-09-13T15:04:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.725+0000 7f29e6600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f29e00c00f0 0x7f29e00c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.725+0000 7f29e6600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f29e00c04d0 0x7f29e006f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.725+0000 7f29e6600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e00b0cb0 0x7f29e014f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.725+0000 7f29e6600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e0071000 con 0x7f29e00c00f0 2024-09-13T15:04:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.725+0000 7f29e6600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e0155ec0 con 0x7f29e00c04d0 2024-09-13T15:04:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.725+0000 7f29e6600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e006ff60 con 0x7f29e00b0cb0 2024-09-13T15:04:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.729+0000 7f29df400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f29e00c00f0 0x7f29e00c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.729+0000 7f29d6a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f29e00c04d0 0x7f29e006f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.729+0000 7f29dfe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e00b0cb0 0x7f29e014f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.729+0000 7f29df400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f29e00c00f0 0x7f29e00c5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53416/0 (socket says 172.21.15.7:53416) 2024-09-13T15:04:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.729+0000 7f29df400640 1 -- 172.21.15.7:0/3785286828 learned_addr learned my addr 172.21.15.7:0/3785286828 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.729+0000 7f29df400640 1 -- 172.21.15.7:0/3785286828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e00b0cb0 msgr2=0x7f29e014f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.729+0000 7f29df400640 1 --2- 172.21.15.7:0/3785286828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e00b0cb0 0x7f29e014f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.729+0000 7f29df400640 1 -- 172.21.15.7:0/3785286828 >> v2:172.21.15.77:3300/0 conn(0x7f29e00c04d0 msgr2=0x7f29e006f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:04:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.729+0000 7f29df400640 1 --2- 172.21.15.7:0/3785286828 >> v2:172.21.15.77:3300/0 conn(0x7f29e00c04d0 0x7f29e006f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.729+0000 7f29df400640 1 -- 172.21.15.7:0/3785286828 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e0156160 con 0x7f29e00c00f0 2024-09-13T15:04:59.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.729+0000 7f29df400640 1 --2- 172.21.15.7:0/3785286828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e00c00f0 0x7f29e00c5530 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f29e00c51f0 tx=0x7f29d001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77de2da9d798f457 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:59.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.729+0000 7f29dea00640 1 -- 172.21.15.7:0/3785286828 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d00a89d0 con 0x7f29e00c00f0 2024-09-13T15:04:59.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.729+0000 7f29dea00640 1 -- 172.21.15.7:0/3785286828 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d00a8b30 con 0x7f29e00c00f0 2024-09-13T15:04:59.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.729+0000 7f29dea00640 1 -- 172.21.15.7:0/3785286828 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d00b0440 con 0x7f29e00c00f0 2024-09-13T15:04:59.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29e6600640 1 -- 172.21.15.7:0/3785286828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e00c00f0 msgr2=0x7f29e00c5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:59.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29e6600640 1 --2- 172.21.15.7:0/3785286828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e00c00f0 0x7f29e00c5530 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f29e00c51f0 tx=0x7f29d001ed10 comp rx=0 tx=0).stop 2024-09-13T15:04:59.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29e6600640 1 -- 172.21.15.7:0/3785286828 shutdown_connections 2024-09-13T15:04:59.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29e6600640 1 --2- 172.21.15.7:0/3785286828 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e00b0cb0 0x7f29e014f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:59.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29e6600640 1 --2- 172.21.15.7:0/3785286828 >> v2:172.21.15.77:3300/0 conn(0x7f29e00c04d0 0x7f29e006f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:59.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29e6600640 1 --2- 172.21.15.7:0/3785286828 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e00c00f0 0x7f29e00c5530 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:59.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29e6600640 1 -- 172.21.15.7:0/3785286828 >> 172.21.15.7:0/3785286828 conn(0x7f29e0065d40 msgr2=0x7f29e0066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:59.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29e6600640 1 -- 172.21.15.7:0/3785286828 shutdown_connections 2024-09-13T15:04:59.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29e6600640 1 -- 172.21.15.7:0/3785286828 wait complete. 2024-09-13T15:04:59.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29e6600640 1 Processor -- start 2024-09-13T15:04:59.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29e6600640 1 -- start start 2024-09-13T15:04:59.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29e6600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e00b0cb0 0x7f29e00c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:59.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29e6600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e00c00f0 0x7f29e01efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:59.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29e6600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e00c04d0 0x7f29e00c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:59.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29e6600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00c1f30 con 0x7f29e00c00f0 2024-09-13T15:04:59.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29e6600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00c9340 con 0x7f29e00c04d0 2024-09-13T15:04:59.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29e6600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e00cb540 con 0x7f29e00b0cb0 2024-09-13T15:04:59.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29d6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e00c00f0 0x7f29e01efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:59.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29d6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e00c00f0 0x7f29e01efd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53422/0 (socket says 172.21.15.7:53422) 2024-09-13T15:04:59.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29d6a00640 1 -- 172.21.15.7:0/2538046863 learned_addr learned my addr 172.21.15.7:0/2538046863 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:04:59.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29df400640 1 --2- 172.21.15.7:0/2538046863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e00b0cb0 0x7f29e00c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:59.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29dfe00640 1 --2- 172.21.15.7:0/2538046863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e00c04d0 0x7f29e00c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:59.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.733+0000 7f29d6a00640 1 -- 172.21.15.7:0/2538046863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e00b0cb0 msgr2=0x7f29e00c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:59.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.737+0000 7f29d6a00640 1 --2- 172.21.15.7:0/2538046863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e00b0cb0 0x7f29e00c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:59.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.737+0000 7f29d6a00640 1 -- 172.21.15.7:0/2538046863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e00c04d0 msgr2=0x7f29e00c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:59.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.737+0000 7f29d6a00640 1 --2- 172.21.15.7:0/2538046863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e00c04d0 0x7f29e00c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:59.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.737+0000 7f29d6a00640 1 -- 172.21.15.7:0/2538046863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d00094d0 con 0x7f29e00c00f0 2024-09-13T15:04:59.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.737+0000 7f29d6a00640 1 --2- 172.21.15.7:0/2538046863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e00c00f0 0x7f29e01efd50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f29c800e870 tx=0x7f29c800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:59.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.737+0000 7f29d7e00640 1 -- 172.21.15.7:0/2538046863 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8009510 con 0x7f29e00c00f0 2024-09-13T15:04:59.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.737+0000 7f29d7e00640 1 -- 172.21.15.7:0/2538046863 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c800eec0 con 0x7f29e00c00f0 2024-09-13T15:04:59.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.737+0000 7f29e6600640 1 -- 172.21.15.7:0/2538046863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e01f0620 con 0x7f29e00c00f0 2024-09-13T15:04:59.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.737+0000 7f29d7e00640 1 -- 172.21.15.7:0/2538046863 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c800cb60 con 0x7f29e00c00f0 2024-09-13T15:04:59.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.737+0000 7f29e6600640 1 -- 172.21.15.7:0/2538046863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e00c2180 con 0x7f29e00c00f0 2024-09-13T15:04:59.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.737+0000 7f29e6600640 1 -- 172.21.15.7:0/2538046863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e0067650 con 0x7f29e00c00f0 2024-09-13T15:04:59.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.737+0000 7f29d7e00640 1 -- 172.21.15.7:0/2538046863 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f29c800ccc0 con 0x7f29e00c00f0 2024-09-13T15:04:59.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.737+0000 7f29d7e00640 1 --2- 172.21.15.7:0/2538046863 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f29bc066690 0x7f29bc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:04:59.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.737+0000 7f29d7e00640 1 -- 172.21.15.7:0/2538046863 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f29c80845b0 con 0x7f29e00c00f0 2024-09-13T15:04:59.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.737+0000 7f29df400640 1 --2- 172.21.15.7:0/2538046863 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f29bc066690 0x7f29bc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:04:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.741+0000 7f29df400640 1 --2- 172.21.15.7:0/2538046863 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f29bc066690 0x7f29bc068b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f29d00b2000 tx=0x7f29d0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:04:59.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.745+0000 7f29d7e00640 1 -- 172.21.15.7:0/2538046863 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f29c8051600 con 0x7f29e00c00f0 2024-09-13T15:04:59.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.941+0000 7f29e6600640 1 -- 172.21.15.7:0/2538046863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29e0070240 con 0x7f29e00c00f0 2024-09-13T15:04:59.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.941+0000 7f29d7e00640 1 -- 172.21.15.7:0/2538046863 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6299 (secure 0 0 0) 0x7f29c8054c20 con 0x7f29e00c00f0 2024-09-13T15:04:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:04:59.942 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:04:36.936420+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"e","rank":4,"incarnation":17,"state":"up:active","state_seq":46,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:04:59.943 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 18 2024-09-13T15:04:59.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.941+0000 7f29e6600640 1 -- 172.21.15.7:0/2538046863 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f29bc066690 msgr2=0x7f29bc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:59.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.941+0000 7f29e6600640 1 --2- 172.21.15.7:0/2538046863 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f29bc066690 0x7f29bc068b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f29d00b2000 tx=0x7f29d0009040 comp rx=0 tx=0).stop 2024-09-13T15:04:59.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.941+0000 7f29e6600640 1 -- 172.21.15.7:0/2538046863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e00c00f0 msgr2=0x7f29e01efd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:04:59.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.941+0000 7f29e6600640 1 --2- 172.21.15.7:0/2538046863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e00c00f0 0x7f29e01efd50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f29c800e870 tx=0x7f29c800ec70 comp rx=0 tx=0).stop 2024-09-13T15:04:59.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.941+0000 7f29e6600640 1 -- 172.21.15.7:0/2538046863 shutdown_connections 2024-09-13T15:04:59.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.941+0000 7f29e6600640 1 --2- 172.21.15.7:0/2538046863 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f29bc066690 0x7f29bc068b50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:59.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.941+0000 7f29e6600640 1 --2- 172.21.15.7:0/2538046863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f29e00c04d0 0x7f29e00c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:59.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.941+0000 7f29e6600640 1 --2- 172.21.15.7:0/2538046863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f29e00c00f0 0x7f29e01efd50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:59.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.941+0000 7f29e6600640 1 --2- 172.21.15.7:0/2538046863 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f29e00b0cb0 0x7f29e00c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:04:59.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.941+0000 7f29e6600640 1 -- 172.21.15.7:0/2538046863 >> 172.21.15.7:0/2538046863 conn(0x7f29e0065d40 msgr2=0x7f29e00c7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:04:59.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.941+0000 7f29e6600640 1 -- 172.21.15.7:0/2538046863 shutdown_connections 2024-09-13T15:04:59.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:04:59.941+0000 7f29e6600640 1 -- 172.21.15.7:0/2538046863 wait complete. 2024-09-13T15:04:59.964 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-13T15:05:01.965 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:05:02.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.117+0000 7f5ed9800640 1 Processor -- start 2024-09-13T15:05:02.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.117+0000 7f5ed9800640 1 -- start start 2024-09-13T15:05:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.117+0000 7f5ed9800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ed40c2b20 0x7f5ed4065df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.117+0000 7f5ed9800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5ed40c65e0 0x7f5ed4066330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.117+0000 7f5ed9800640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed4159110 con 0x7f5ed4153560 2024-09-13T15:05:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.117+0000 7f5ed9800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed4153940 con 0x7f5ed40c65e0 2024-09-13T15:05:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.117+0000 7f5ed9800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed40c8480 con 0x7f5ed40c2b20 2024-09-13T15:05:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.117+0000 7f5ed3400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5ed40c65e0 0x7f5ed4066330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.117+0000 7f5ed3400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5ed40c65e0 0x7f5ed4066330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53430/0 (socket says 172.21.15.7:53430) 2024-09-13T15:05:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.117+0000 7f5ed3400640 1 -- 172.21.15.7:0/2245395245 learned_addr learned my addr 172.21.15.7:0/2245395245 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.117+0000 7f5eca000640 1 --2- 172.21.15.7:0/2245395245 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ed40c2b20 0x7f5ed4065df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:02.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.117+0000 7f5ed3400640 1 -- 172.21.15.7:0/2245395245 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ed40c2b20 msgr2=0x7f5ed4065df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:05:02.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.117+0000 7f5ed3400640 1 --2- 172.21.15.7:0/2245395245 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ed40c2b20 0x7f5ed4065df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:02.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.117+0000 7f5ed3400640 1 -- 172.21.15.7:0/2245395245 >> v1:172.21.15.77:6789/0 conn(0x7f5ed4153560 legacy=0x7f5ed40c7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:02.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.117+0000 7f5ed3400640 1 -- 172.21.15.7:0/2245395245 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed40c81a0 con 0x7f5ed40c65e0 2024-09-13T15:05:02.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.117+0000 7f5eca000640 1 --2- 172.21.15.7:0/2245395245 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ed40c2b20 0x7f5ed4065df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:05:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.121+0000 7f5ed3400640 1 --2- 172.21.15.7:0/2245395245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed40c65e0 0x7f5ed4066330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009870 tx=0x7f5ecc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5bb0b2ebece16c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.121+0000 7f5ed2000640 1 -- 172.21.15.7:0/2245395245 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc0ad660 con 0x7f5ed40c65e0 2024-09-13T15:05:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.121+0000 7f5ed2000640 1 -- 172.21.15.7:0/2245395245 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc0ad7c0 con 0x7f5ed40c65e0 2024-09-13T15:05:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.121+0000 7f5ed2000640 1 -- 172.21.15.7:0/2245395245 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc0adb50 con 0x7f5ed40c65e0 2024-09-13T15:05:02.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.121+0000 7f5ed9800640 1 -- 172.21.15.7:0/2245395245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed40c65e0 msgr2=0x7f5ed4066330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:02.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.121+0000 7f5ed9800640 1 --2- 172.21.15.7:0/2245395245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed40c65e0 0x7f5ed4066330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f5ecc009870 tx=0x7f5ecc01c560 comp rx=0 tx=0).stop 2024-09-13T15:05:02.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.121+0000 7f5ed9800640 1 -- 172.21.15.7:0/2245395245 shutdown_connections 2024-09-13T15:05:02.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.121+0000 7f5ed9800640 1 --2- 172.21.15.7:0/2245395245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed40c65e0 0x7f5ed4066330 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:02.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.121+0000 7f5ed9800640 1 --2- 172.21.15.7:0/2245395245 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ed40c2b20 0x7f5ed4065df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:02.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.121+0000 7f5ed9800640 1 -- 172.21.15.7:0/2245395245 >> 172.21.15.7:0/2245395245 conn(0x7f5ed4069f30 msgr2=0x7f5ed406a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:02.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.121+0000 7f5ed9800640 1 -- 172.21.15.7:0/2245395245 shutdown_connections 2024-09-13T15:05:02.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.121+0000 7f5ed9800640 1 -- 172.21.15.7:0/2245395245 wait complete. 2024-09-13T15:05:02.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed9800640 1 Processor -- start 2024-09-13T15:05:02.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed9800640 1 -- start start 2024-09-13T15:05:02.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed9800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed40c2b20 0x7f5ed414f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed9800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ed40c65e0 0x7f5ed41eb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed9800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ed4153560 0x7f5ed41494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed9800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed414bae0 con 0x7f5ed40c2b20 2024-09-13T15:05:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed9800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed41eb4f0 con 0x7f5ed4153560 2024-09-13T15:05:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed9800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed41eaf00 con 0x7f5ed40c65e0 2024-09-13T15:05:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed40c2b20 0x7f5ed414f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed40c2b20 0x7f5ed414f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53440/0 (socket says 172.21.15.7:53440) 2024-09-13T15:05:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed2a00640 1 -- 172.21.15.7:0/3027357526 learned_addr learned my addr 172.21.15.7:0/3027357526 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed3400640 1 --2- 172.21.15.7:0/3027357526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ed4153560 0x7f5ed41494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5eca000640 1 --2- 172.21.15.7:0/3027357526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ed40c65e0 0x7f5ed41eb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed2a00640 1 -- 172.21.15.7:0/3027357526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ed40c65e0 msgr2=0x7f5ed41eb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed2a00640 1 --2- 172.21.15.7:0/3027357526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ed40c65e0 0x7f5ed41eb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed2a00640 1 -- 172.21.15.7:0/3027357526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ed4153560 msgr2=0x7f5ed41494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed2a00640 1 --2- 172.21.15.7:0/3027357526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ed4153560 0x7f5ed41494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed2a00640 1 -- 172.21.15.7:0/3027357526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ecc0094d0 con 0x7f5ed40c2b20 2024-09-13T15:05:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed2a00640 1 --2- 172.21.15.7:0/3027357526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed40c2b20 0x7f5ed414f0b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400c7a0 tx=0x7f5ec400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ecb400640 1 -- 172.21.15.7:0/3027357526 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4003b80 con 0x7f5ed40c2b20 2024-09-13T15:05:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ecb400640 1 -- 172.21.15.7:0/3027357526 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec4003ce0 con 0x7f5ed40c2b20 2024-09-13T15:05:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ecb400640 1 -- 172.21.15.7:0/3027357526 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec400aa90 con 0x7f5ed40c2b20 2024-09-13T15:05:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed9800640 1 -- 172.21.15.7:0/3027357526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed414c2e0 con 0x7f5ed40c2b20 2024-09-13T15:05:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed9800640 1 -- 172.21.15.7:0/3027357526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed414b190 con 0x7f5ed40c2b20 2024-09-13T15:05:02.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.125+0000 7f5ed9800640 1 -- 172.21.15.7:0/3027357526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed40c7160 con 0x7f5ed40c2b20 2024-09-13T15:05:02.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.129+0000 7f5ecb400640 1 -- 172.21.15.7:0/3027357526 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5ec400abf0 con 0x7f5ed40c2b20 2024-09-13T15:05:02.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.129+0000 7f5ecb400640 1 --2- 172.21.15.7:0/3027357526 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5eb00666c0 0x7f5eb0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:02.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.129+0000 7f5ecb400640 1 -- 172.21.15.7:0/3027357526 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5ec4084370 con 0x7f5ed40c2b20 2024-09-13T15:05:02.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.129+0000 7f5eca000640 1 --2- 172.21.15.7:0/3027357526 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5eb00666c0 0x7f5eb0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:02.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.129+0000 7f5eca000640 1 --2- 172.21.15.7:0/3027357526 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5eb00666c0 0x7f5eb0068b80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4157190 tx=0x7f5ebc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:02.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.133+0000 7f5ecb400640 1 -- 172.21.15.7:0/3027357526 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5ec4051280 con 0x7f5ed40c2b20 2024-09-13T15:05:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.325+0000 7f5ed9800640 1 -- 172.21.15.7:0/3027357526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ed4163830 con 0x7f5ed40c2b20 2024-09-13T15:05:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.325+0000 7f5ecb400640 1 -- 172.21.15.7:0/3027357526 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6299 (secure 0 0 0) 0x7f5ed4163830 con 0x7f5ed40c2b20 2024-09-13T15:05:02.330 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:05:02.330 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:04:36.936420+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"e","rank":4,"incarnation":17,"state":"up:active","state_seq":46,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:05:02.331 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 18 2024-09-13T15:05:02.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.329+0000 7f5ed9800640 1 -- 172.21.15.7:0/3027357526 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5eb00666c0 msgr2=0x7f5eb0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:02.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.329+0000 7f5ed9800640 1 --2- 172.21.15.7:0/3027357526 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5eb00666c0 0x7f5eb0068b80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4157190 tx=0x7f5ebc008040 comp rx=0 tx=0).stop 2024-09-13T15:05:02.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.329+0000 7f5ed9800640 1 -- 172.21.15.7:0/3027357526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed40c2b20 msgr2=0x7f5ed414f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:02.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.329+0000 7f5ed9800640 1 --2- 172.21.15.7:0/3027357526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed40c2b20 0x7f5ed414f0b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5ec400c7a0 tx=0x7f5ec400cc60 comp rx=0 tx=0).stop 2024-09-13T15:05:02.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.329+0000 7f5ed9800640 1 -- 172.21.15.7:0/3027357526 shutdown_connections 2024-09-13T15:05:02.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.329+0000 7f5ed9800640 1 --2- 172.21.15.7:0/3027357526 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5eb00666c0 0x7f5eb0068b80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:02.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.329+0000 7f5ed9800640 1 --2- 172.21.15.7:0/3027357526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ed4153560 0x7f5ed41494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:02.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.329+0000 7f5ed9800640 1 --2- 172.21.15.7:0/3027357526 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ed40c65e0 0x7f5ed41eb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:02.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.329+0000 7f5ed9800640 1 --2- 172.21.15.7:0/3027357526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ed40c2b20 0x7f5ed414f0b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:02.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.329+0000 7f5ed9800640 1 -- 172.21.15.7:0/3027357526 >> 172.21.15.7:0/3027357526 conn(0x7f5ed4069f30 msgr2=0x7f5ed40c14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:02.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.329+0000 7f5ed9800640 1 -- 172.21.15.7:0/3027357526 shutdown_connections 2024-09-13T15:05:02.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:02.329+0000 7f5ed9800640 1 -- 172.21.15.7:0/3027357526 wait complete. 2024-09-13T15:05:02.351 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-13T15:05:04.352 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:05:04.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.505+0000 7f8598600640 1 Processor -- start 2024-09-13T15:05:04.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.505+0000 7f8598600640 1 -- start start 2024-09-13T15:05:04.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.505+0000 7f8598600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85900c9c40 0x7f85900662d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:04.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.505+0000 7f8598600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f85900ca020 0x7f85900c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:04.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.505+0000 7f8598600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8590159400 con 0x7f85900c6ff0 2024-09-13T15:05:04.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.505+0000 7f8598600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85901596e0 con 0x7f85900ca020 2024-09-13T15:05:04.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.505+0000 7f8598600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85901599c0 con 0x7f85900c9c40 2024-09-13T15:05:04.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.505+0000 7f8595200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f85900ca020 0x7f85900c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:04.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.505+0000 7f8595200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f85900ca020 0x7f85900c8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53454/0 (socket says 172.21.15.7:53454) 2024-09-13T15:05:04.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.505+0000 7f8595200640 1 -- 172.21.15.7:0/419988239 learned_addr learned my addr 172.21.15.7:0/419988239 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:04.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.505+0000 7f8595c00640 1 --2- 172.21.15.7:0/419988239 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85900c9c40 0x7f85900662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:04.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.505+0000 7f8595200640 1 -- 172.21.15.7:0/419988239 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85900c9c40 msgr2=0x7f85900662d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:05:04.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.505+0000 7f8595200640 1 --2- 172.21.15.7:0/419988239 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85900c9c40 0x7f85900662d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:04.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.505+0000 7f8595200640 1 -- 172.21.15.7:0/419988239 >> v1:172.21.15.77:6789/0 conn(0x7f85900c6ff0 legacy=0x7f8590152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:04.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.505+0000 7f8595200640 1 -- 172.21.15.7:0/419988239 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8590159ca0 con 0x7f85900ca020 2024-09-13T15:05:04.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.509+0000 7f8595200640 1 --2- 172.21.15.7:0/419988239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85900ca020 0x7f85900c8730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f857c009870 tx=0x7f857c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288cc09e3f413490 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:04.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.509+0000 7f858fe00640 1 -- 172.21.15.7:0/419988239 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c0a8a50 con 0x7f85900ca020 2024-09-13T15:05:04.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.509+0000 7f858fe00640 1 -- 172.21.15.7:0/419988239 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857c0a8bb0 con 0x7f85900ca020 2024-09-13T15:05:04.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.509+0000 7f858fe00640 1 -- 172.21.15.7:0/419988239 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c0b0440 con 0x7f85900ca020 2024-09-13T15:05:04.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.509+0000 7f8598600640 1 -- 172.21.15.7:0/419988239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85900ca020 msgr2=0x7f85900c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:04.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.509+0000 7f8598600640 1 --2- 172.21.15.7:0/419988239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85900ca020 0x7f85900c8730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f857c009870 tx=0x7f857c01ed50 comp rx=0 tx=0).stop 2024-09-13T15:05:04.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.509+0000 7f8598600640 1 -- 172.21.15.7:0/419988239 shutdown_connections 2024-09-13T15:05:04.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.509+0000 7f8598600640 1 --2- 172.21.15.7:0/419988239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85900ca020 0x7f85900c8730 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:04.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.509+0000 7f8598600640 1 --2- 172.21.15.7:0/419988239 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85900c9c40 0x7f85900662d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:04.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.509+0000 7f8598600640 1 -- 172.21.15.7:0/419988239 >> 172.21.15.7:0/419988239 conn(0x7f859006e1f0 msgr2=0x7f859006e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:04.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.509+0000 7f8598600640 1 -- 172.21.15.7:0/419988239 shutdown_connections 2024-09-13T15:05:04.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.509+0000 7f8598600640 1 -- 172.21.15.7:0/419988239 wait complete. 2024-09-13T15:05:04.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8598600640 1 Processor -- start 2024-09-13T15:05:04.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8598600640 1 -- start start 2024-09-13T15:05:04.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8598600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85900c6ff0 0x7f85901f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:04.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8598600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85900c9c40 0x7f859014bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:04.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8598600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85900ca020 0x7f859014c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:04.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8598600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859014d7e0 con 0x7f85900ca020 2024-09-13T15:05:04.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8598600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85901f2dd0 con 0x7f85900c6ff0 2024-09-13T15:05:04.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8598600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85901f2b10 con 0x7f85900c9c40 2024-09-13T15:05:04.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8596600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85900ca020 0x7f859014c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:04.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8596600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85900ca020 0x7f859014c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53458/0 (socket says 172.21.15.7:53458) 2024-09-13T15:05:04.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8596600640 1 -- 172.21.15.7:0/3805550181 learned_addr learned my addr 172.21.15.7:0/3805550181 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:04.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8595200640 1 --2- 172.21.15.7:0/3805550181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85900c9c40 0x7f859014bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:04.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8595c00640 1 --2- 172.21.15.7:0/3805550181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85900c6ff0 0x7f85901f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:04.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8596600640 1 -- 172.21.15.7:0/3805550181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85900c9c40 msgr2=0x7f859014bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:04.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8596600640 1 --2- 172.21.15.7:0/3805550181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85900c9c40 0x7f859014bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:04.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8596600640 1 -- 172.21.15.7:0/3805550181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85900c6ff0 msgr2=0x7f85901f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:04.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8596600640 1 --2- 172.21.15.7:0/3805550181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85900c6ff0 0x7f85901f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:04.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8596600640 1 -- 172.21.15.7:0/3805550181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c0094d0 con 0x7f85900ca020 2024-09-13T15:05:04.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8595c00640 1 --2- 172.21.15.7:0/3805550181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85900c6ff0 0x7f85901f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:05:04.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8596600640 1 --2- 172.21.15.7:0/3805550181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85900ca020 0x7f859014c460 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f858800c730 tx=0x7f858800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:04.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f858d600640 1 -- 172.21.15.7:0/3805550181 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588003b80 con 0x7f85900ca020 2024-09-13T15:05:04.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f858d600640 1 -- 172.21.15.7:0/3805550181 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8588003ce0 con 0x7f85900ca020 2024-09-13T15:05:04.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8598600640 1 -- 172.21.15.7:0/3805550181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859014b120 con 0x7f85900ca020 2024-09-13T15:05:04.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f858d600640 1 -- 172.21.15.7:0/3805550181 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858800aa30 con 0x7f85900ca020 2024-09-13T15:05:04.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.513+0000 7f8598600640 1 -- 172.21.15.7:0/3805550181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859014ba00 con 0x7f85900ca020 2024-09-13T15:05:04.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.517+0000 7f8598600640 1 -- 172.21.15.7:0/3805550181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8590067650 con 0x7f85900ca020 2024-09-13T15:05:04.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.517+0000 7f858d600640 1 -- 172.21.15.7:0/3805550181 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f858800ab90 con 0x7f85900ca020 2024-09-13T15:05:04.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.517+0000 7f858d600640 1 --2- 172.21.15.7:0/3805550181 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8570066690 0x7f8570068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:04.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.517+0000 7f858d600640 1 -- 172.21.15.7:0/3805550181 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8588084250 con 0x7f85900ca020 2024-09-13T15:05:04.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.517+0000 7f8595c00640 1 --2- 172.21.15.7:0/3805550181 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8570066690 0x7f8570068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:04.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.517+0000 7f8595c00640 1 --2- 172.21.15.7:0/3805550181 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8570066690 0x7f8570068b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8584009bb0 tx=0x7f8584008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:04.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.521+0000 7f858d600640 1 -- 172.21.15.7:0/3805550181 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f85880511f0 con 0x7f85900ca020 2024-09-13T15:05:04.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.725+0000 7f8598600640 1 -- 172.21.15.7:0/3805550181 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f859014b640 con 0x7f85900ca020 2024-09-13T15:05:04.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.725+0000 7f858d600640 1 -- 172.21.15.7:0/3805550181 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6299 (secure 0 0 0) 0x7f859014b640 con 0x7f85900ca020 2024-09-13T15:05:04.729 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:05:04.729 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:04:36.936420+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"e","rank":4,"incarnation":17,"state":"up:active","state_seq":46,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:05:04.729 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 18 2024-09-13T15:05:04.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.729+0000 7f8598600640 1 -- 172.21.15.7:0/3805550181 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8570066690 msgr2=0x7f8570068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:04.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.729+0000 7f8598600640 1 --2- 172.21.15.7:0/3805550181 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8570066690 0x7f8570068b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8584009bb0 tx=0x7f8584008040 comp rx=0 tx=0).stop 2024-09-13T15:05:04.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.729+0000 7f8598600640 1 -- 172.21.15.7:0/3805550181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85900ca020 msgr2=0x7f859014c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:04.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.729+0000 7f8598600640 1 --2- 172.21.15.7:0/3805550181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85900ca020 0x7f859014c460 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f858800c730 tx=0x7f858800cbf0 comp rx=0 tx=0).stop 2024-09-13T15:05:04.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.729+0000 7f8598600640 1 -- 172.21.15.7:0/3805550181 shutdown_connections 2024-09-13T15:05:04.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.729+0000 7f8598600640 1 --2- 172.21.15.7:0/3805550181 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8570066690 0x7f8570068b50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:04.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.729+0000 7f8598600640 1 --2- 172.21.15.7:0/3805550181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85900ca020 0x7f859014c460 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:04.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.729+0000 7f8598600640 1 --2- 172.21.15.7:0/3805550181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f85900c9c40 0x7f859014bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:04.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.729+0000 7f8598600640 1 --2- 172.21.15.7:0/3805550181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f85900c6ff0 0x7f85901f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:04.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.729+0000 7f8598600640 1 -- 172.21.15.7:0/3805550181 >> 172.21.15.7:0/3805550181 conn(0x7f859006e1f0 msgr2=0x7f85900c8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:04.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.729+0000 7f8598600640 1 -- 172.21.15.7:0/3805550181 shutdown_connections 2024-09-13T15:05:04.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:04.729+0000 7f8598600640 1 -- 172.21.15.7:0/3805550181 wait complete. 2024-09-13T15:05:04.750 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-13T15:05:06.751 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:05:06.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.901+0000 7f5f10200640 1 Processor -- start 2024-09-13T15:05:06.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.901+0000 7f5f10200640 1 -- start start 2024-09-13T15:05:06.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.901+0000 7f5f10200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f080c00f0 0x7f5f080c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:06.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.901+0000 7f5f10200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5f080c04d0 0x7f5f0806f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.901+0000 7f5f10200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f08155ec0 con 0x7f5f080b0cb0 2024-09-13T15:05:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.901+0000 7f5f10200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f08071000 con 0x7f5f080c04d0 2024-09-13T15:05:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.901+0000 7f5f10200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0806ff60 con 0x7f5f080c00f0 2024-09-13T15:05:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.901+0000 7f5f0ce00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5f080c04d0 0x7f5f0806f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.901+0000 7f5f0ce00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5f080c04d0 0x7f5f0806f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53468/0 (socket says 172.21.15.7:53468) 2024-09-13T15:05:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.901+0000 7f5f0ce00640 1 -- 172.21.15.7:0/3744171316 learned_addr learned my addr 172.21.15.7:0/3744171316 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:06.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.901+0000 7f5f0d800640 1 --2- 172.21.15.7:0/3744171316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f080c00f0 0x7f5f080c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:06.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.901+0000 7f5f0ce00640 1 -- 172.21.15.7:0/3744171316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f080c00f0 msgr2=0x7f5f080c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:05:06.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.901+0000 7f5f0ce00640 1 --2- 172.21.15.7:0/3744171316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f080c00f0 0x7f5f080c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:06.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.901+0000 7f5f0ce00640 1 -- 172.21.15.7:0/3744171316 >> v1:172.21.15.77:6789/0 conn(0x7f5f080b0cb0 legacy=0x7f5f0814f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:06.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.901+0000 7f5f0ce00640 1 -- 172.21.15.7:0/3744171316 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f08156160 con 0x7f5f080c04d0 2024-09-13T15:05:06.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.905+0000 7f5f0ce00640 1 --2- 172.21.15.7:0/3744171316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f080c04d0 0x7f5f0806f600 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009870 tx=0x7f5ef401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539292f729943cb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.905+0000 7f5f07e00640 1 -- 172.21.15.7:0/3744171316 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef40a8a50 con 0x7f5f080c04d0 2024-09-13T15:05:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.905+0000 7f5f07e00640 1 -- 172.21.15.7:0/3744171316 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef40a8bb0 con 0x7f5f080c04d0 2024-09-13T15:05:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.905+0000 7f5f07e00640 1 -- 172.21.15.7:0/3744171316 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef40b0440 con 0x7f5f080c04d0 2024-09-13T15:05:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.905+0000 7f5f10200640 1 -- 172.21.15.7:0/3744171316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f080c04d0 msgr2=0x7f5f0806f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.905+0000 7f5f10200640 1 --2- 172.21.15.7:0/3744171316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f080c04d0 0x7f5f0806f600 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009870 tx=0x7f5ef401ed50 comp rx=0 tx=0).stop 2024-09-13T15:05:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.905+0000 7f5f10200640 1 -- 172.21.15.7:0/3744171316 shutdown_connections 2024-09-13T15:05:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.905+0000 7f5f10200640 1 --2- 172.21.15.7:0/3744171316 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f080c04d0 0x7f5f0806f600 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.905+0000 7f5f10200640 1 --2- 172.21.15.7:0/3744171316 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f080c00f0 0x7f5f080c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.905+0000 7f5f10200640 1 -- 172.21.15.7:0/3744171316 >> 172.21.15.7:0/3744171316 conn(0x7f5f08065d40 msgr2=0x7f5f08066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.905+0000 7f5f10200640 1 -- 172.21.15.7:0/3744171316 shutdown_connections 2024-09-13T15:05:06.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.905+0000 7f5f10200640 1 -- 172.21.15.7:0/3744171316 wait complete. 2024-09-13T15:05:06.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f10200640 1 Processor -- start 2024-09-13T15:05:06.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f10200640 1 -- start start 2024-09-13T15:05:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f10200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f080b0cb0 0x7f5f080ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f10200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f080c00f0 0x7f5f08147d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f10200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f080c04d0 0x7f5f081482d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f10200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f080addb0 con 0x7f5f080c04d0 2024-09-13T15:05:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f10200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f081eef30 con 0x7f5f080b0cb0 2024-09-13T15:05:06.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f10200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f081ef1d0 con 0x7f5f080c00f0 2024-09-13T15:05:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f0e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f080c04d0 0x7f5f081482d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f0e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f080c04d0 0x7f5f081482d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53472/0 (socket says 172.21.15.7:53472) 2024-09-13T15:05:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f0e200640 1 -- 172.21.15.7:0/2722843971 learned_addr learned my addr 172.21.15.7:0/2722843971 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f0d800640 1 --2- 172.21.15.7:0/2722843971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f080b0cb0 0x7f5f080ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f0ce00640 1 --2- 172.21.15.7:0/2722843971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f080c00f0 0x7f5f08147d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f0e200640 1 -- 172.21.15.7:0/2722843971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f080c00f0 msgr2=0x7f5f08147d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f0e200640 1 --2- 172.21.15.7:0/2722843971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f080c00f0 0x7f5f08147d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f0e200640 1 -- 172.21.15.7:0/2722843971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f080b0cb0 msgr2=0x7f5f080ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f0e200640 1 --2- 172.21.15.7:0/2722843971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f080b0cb0 0x7f5f080ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f0e200640 1 -- 172.21.15.7:0/2722843971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef40094d0 con 0x7f5f080c04d0 2024-09-13T15:05:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f0d800640 1 --2- 172.21.15.7:0/2722843971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f080b0cb0 0x7f5f080ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:05:06.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f0e200640 1 --2- 172.21.15.7:0/2722843971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f080c04d0 0x7f5f081482d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000c7a0 tx=0x7f5f0000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:06.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f05600640 1 -- 172.21.15.7:0/2722843971 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f00003b80 con 0x7f5f080c04d0 2024-09-13T15:05:06.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f05600640 1 -- 172.21.15.7:0/2722843971 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f00003ce0 con 0x7f5f080c04d0 2024-09-13T15:05:06.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f05600640 1 -- 172.21.15.7:0/2722843971 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0000aa30 con 0x7f5f080c04d0 2024-09-13T15:05:06.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f10200640 1 -- 172.21.15.7:0/2722843971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f081ef4b0 con 0x7f5f080c04d0 2024-09-13T15:05:06.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.909+0000 7f5f10200640 1 -- 172.21.15.7:0/2722843971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f080ada40 con 0x7f5f080c04d0 2024-09-13T15:05:06.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.913+0000 7f5f10200640 1 -- 172.21.15.7:0/2722843971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f08067650 con 0x7f5f080c04d0 2024-09-13T15:05:06.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.913+0000 7f5f05600640 1 -- 172.21.15.7:0/2722843971 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5f0000ab90 con 0x7f5f080c04d0 2024-09-13T15:05:06.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.913+0000 7f5f05600640 1 --2- 172.21.15.7:0/2722843971 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5ee8066690 0x7f5ee8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:06.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.913+0000 7f5f05600640 1 -- 172.21.15.7:0/2722843971 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5f000844a0 con 0x7f5f080c04d0 2024-09-13T15:05:06.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.913+0000 7f5f0d800640 1 --2- 172.21.15.7:0/2722843971 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5ee8066690 0x7f5ee8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:06.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.913+0000 7f5f0d800640 1 --2- 172.21.15.7:0/2722843971 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5ee8066690 0x7f5ee8068b50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009bb0 tx=0x7f5efc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:06.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:06.917+0000 7f5f05600640 1 -- 172.21.15.7:0/2722843971 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5f00051320 con 0x7f5f080c04d0 2024-09-13T15:05:07.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:07.113+0000 7f5f10200640 1 -- 172.21.15.7:0/2722843971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f080ad8a0 con 0x7f5f080c04d0 2024-09-13T15:05:07.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:07.113+0000 7f5f05600640 1 -- 172.21.15.7:0/2722843971 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+6299 (secure 0 0 0) 0x7f5f080ad8a0 con 0x7f5f080c04d0 2024-09-13T15:05:07.115 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:05:07.115 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:04:36.936420+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4232":{"gid":4232,"name":"e","rank":4,"incarnation":17,"state":"up:active","state_seq":46,"addr":"172.21.15.7:6833/2907495549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2907495549},{"type":"v1","addr":"172.21.15.7:6833","nonce":2907495549}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:05:07.115 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 18 2024-09-13T15:05:07.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:07.113+0000 7f5f10200640 1 -- 172.21.15.7:0/2722843971 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5ee8066690 msgr2=0x7f5ee8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:07.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:07.113+0000 7f5f10200640 1 --2- 172.21.15.7:0/2722843971 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5ee8066690 0x7f5ee8068b50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009bb0 tx=0x7f5efc008040 comp rx=0 tx=0).stop 2024-09-13T15:05:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:07.113+0000 7f5f10200640 1 -- 172.21.15.7:0/2722843971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f080c04d0 msgr2=0x7f5f081482d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:07.113+0000 7f5f10200640 1 --2- 172.21.15.7:0/2722843971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f080c04d0 0x7f5f081482d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000c7a0 tx=0x7f5f0000cc60 comp rx=0 tx=0).stop 2024-09-13T15:05:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:07.113+0000 7f5f10200640 1 -- 172.21.15.7:0/2722843971 shutdown_connections 2024-09-13T15:05:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:07.113+0000 7f5f10200640 1 --2- 172.21.15.7:0/2722843971 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5ee8066690 0x7f5ee8068b50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:07.113+0000 7f5f10200640 1 --2- 172.21.15.7:0/2722843971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f080c04d0 0x7f5f081482d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:07.113+0000 7f5f10200640 1 --2- 172.21.15.7:0/2722843971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5f080c00f0 0x7f5f08147d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:07.113+0000 7f5f10200640 1 --2- 172.21.15.7:0/2722843971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f080b0cb0 0x7f5f080ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:07.113+0000 7f5f10200640 1 -- 172.21.15.7:0/2722843971 >> 172.21.15.7:0/2722843971 conn(0x7f5f08065d40 msgr2=0x7f5f0814d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:07.113+0000 7f5f10200640 1 -- 172.21.15.7:0/2722843971 shutdown_connections 2024-09-13T15:05:07.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:07.113+0000 7f5f10200640 1 -- 172.21.15.7:0/2722843971 wait complete. 2024-09-13T15:05:07.136 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.e is laggy/crashed, in failed state, or mds.e is removed from mdsmap 2024-09-13T15:05:09.137 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:05:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.289+0000 7f6b60c00640 1 Processor -- start 2024-09-13T15:05:09.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.289+0000 7f6b60c00640 1 -- start start 2024-09-13T15:05:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.289+0000 7f6b60c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b5c152f50 0x7f6b5c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.289+0000 7f6b60c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6b5c06ff40 0x7f6b5c0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.289+0000 7f6b60c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b5c159210 con 0x7f6b5c153330 2024-09-13T15:05:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.289+0000 7f6b60c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b5c1594f0 con 0x7f6b5c06ff40 2024-09-13T15:05:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.289+0000 7f6b60c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c1597d0 con 0x7f6b5c152f50 2024-09-13T15:05:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.289+0000 7f6b5a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6b5c06ff40 0x7f6b5c0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.289+0000 7f6b5a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6b5c06ff40 0x7f6b5c0cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52620/0 (socket says 172.21.15.7:52620) 2024-09-13T15:05:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.289+0000 7f6b5a800640 1 -- 172.21.15.7:0/1224894498 learned_addr learned my addr 172.21.15.7:0/1224894498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:09.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.289+0000 7f6b59e00640 1 --2- 172.21.15.7:0/1224894498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b5c152f50 0x7f6b5c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:09.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.289+0000 7f6b5a800640 1 -- 172.21.15.7:0/1224894498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b5c152f50 msgr2=0x7f6b5c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:05:09.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.289+0000 7f6b5a800640 1 --2- 172.21.15.7:0/1224894498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b5c152f50 0x7f6b5c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.289+0000 7f6b5a800640 1 -- 172.21.15.7:0/1224894498 >> v1:172.21.15.77:6789/0 conn(0x7f6b5c153330 legacy=0x7f6b5c06f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:09.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.289+0000 7f6b5a800640 1 -- 172.21.15.7:0/1224894498 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c159ab0 con 0x7f6b5c06ff40 2024-09-13T15:05:09.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.293+0000 7f6b5a800640 1 --2- 172.21.15.7:0/1224894498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c06ff40 0x7f6b5c0cd000 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009e50 tx=0x7f6b5401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1395b739c609fa82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.293+0000 7f6b59400640 1 -- 172.21.15.7:0/1224894498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b540a58f0 con 0x7f6b5c06ff40 2024-09-13T15:05:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.293+0000 7f6b59400640 1 -- 172.21.15.7:0/1224894498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b540a5a50 con 0x7f6b5c06ff40 2024-09-13T15:05:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.293+0000 7f6b59400640 1 -- 172.21.15.7:0/1224894498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b540a5de0 con 0x7f6b5c06ff40 2024-09-13T15:05:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.293+0000 7f6b60c00640 1 -- 172.21.15.7:0/1224894498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c06ff40 msgr2=0x7f6b5c0cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.293+0000 7f6b60c00640 1 --2- 172.21.15.7:0/1224894498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c06ff40 0x7f6b5c0cd000 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6b54009e50 tx=0x7f6b5401ca00 comp rx=0 tx=0).stop 2024-09-13T15:05:09.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.293+0000 7f6b60c00640 1 -- 172.21.15.7:0/1224894498 shutdown_connections 2024-09-13T15:05:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.293+0000 7f6b60c00640 1 --2- 172.21.15.7:0/1224894498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c06ff40 0x7f6b5c0cd000 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.293+0000 7f6b60c00640 1 --2- 172.21.15.7:0/1224894498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b5c152f50 0x7f6b5c0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.293+0000 7f6b60c00640 1 -- 172.21.15.7:0/1224894498 >> 172.21.15.7:0/1224894498 conn(0x7f6b5c0739a0 msgr2=0x7f6b5c071830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.293+0000 7f6b60c00640 1 -- 172.21.15.7:0/1224894498 shutdown_connections 2024-09-13T15:05:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.293+0000 7f6b60c00640 1 -- 172.21.15.7:0/1224894498 wait complete. 2024-09-13T15:05:09.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.293+0000 7f6b60c00640 1 Processor -- start 2024-09-13T15:05:09.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.293+0000 7f6b60c00640 1 -- start start 2024-09-13T15:05:09.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b60c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b5c06ff40 0x7f6b5c155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:09.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b60c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c152f50 0x7f6b5c1f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:09.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b60c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b5c153330 0x7f6b5c15b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:09.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b60c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c1f20e0 con 0x7f6b5c152f50 2024-09-13T15:05:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b60c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c1569a0 con 0x7f6b5c153330 2024-09-13T15:05:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b60c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c1f2630 con 0x7f6b5c06ff40 2024-09-13T15:05:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b53e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c152f50 0x7f6b5c1f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b53e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c152f50 0x7f6b5c1f2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52632/0 (socket says 172.21.15.7:52632) 2024-09-13T15:05:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b53e00640 1 -- 172.21.15.7:0/654988610 learned_addr learned my addr 172.21.15.7:0/654988610 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b59e00640 1 --2- 172.21.15.7:0/654988610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b5c06ff40 0x7f6b5c155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b5a800640 1 --2- 172.21.15.7:0/654988610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b5c153330 0x7f6b5c15b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b53e00640 1 -- 172.21.15.7:0/654988610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b5c06ff40 msgr2=0x7f6b5c155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b53e00640 1 --2- 172.21.15.7:0/654988610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b5c06ff40 0x7f6b5c155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b53e00640 1 -- 172.21.15.7:0/654988610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b5c153330 msgr2=0x7f6b5c15b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b53e00640 1 --2- 172.21.15.7:0/654988610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b5c153330 0x7f6b5c15b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b53e00640 1 -- 172.21.15.7:0/654988610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b54009b30 con 0x7f6b5c152f50 2024-09-13T15:05:09.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b53e00640 1 --2- 172.21.15.7:0/654988610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c152f50 0x7f6b5c1f2ac0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400c3c0 tx=0x7f6b4400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:09.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b52000640 1 -- 172.21.15.7:0/654988610 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b440052d0 con 0x7f6b5c152f50 2024-09-13T15:05:09.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b52000640 1 -- 172.21.15.7:0/654988610 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b44005430 con 0x7f6b5c152f50 2024-09-13T15:05:09.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b52000640 1 -- 172.21.15.7:0/654988610 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b44003840 con 0x7f6b5c152f50 2024-09-13T15:05:09.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b60c00640 1 -- 172.21.15.7:0/654988610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5c1550e0 con 0x7f6b5c152f50 2024-09-13T15:05:09.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b60c00640 1 -- 172.21.15.7:0/654988610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5c1f22c0 con 0x7f6b5c152f50 2024-09-13T15:05:09.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b60c00640 1 -- 172.21.15.7:0/654988610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b5c150330 con 0x7f6b5c152f50 2024-09-13T15:05:09.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.297+0000 7f6b52000640 1 -- 172.21.15.7:0/654988610 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6b440039a0 con 0x7f6b5c152f50 2024-09-13T15:05:09.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.301+0000 7f6b52000640 1 --2- 172.21.15.7:0/654988610 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6b38066690 0x7f6b38068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:09.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.301+0000 7f6b52000640 1 -- 172.21.15.7:0/654988610 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f6b44083b60 con 0x7f6b5c152f50 2024-09-13T15:05:09.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.301+0000 7f6b59e00640 1 --2- 172.21.15.7:0/654988610 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6b38066690 0x7f6b38068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:09.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.301+0000 7f6b59e00640 1 --2- 172.21.15.7:0/654988610 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6b38066690 0x7f6b38068b50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00b9d0 tx=0x7f6b4c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:09.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.305+0000 7f6b52000640 1 -- 172.21.15.7:0/654988610 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6b44050a30 con 0x7f6b5c152f50 2024-09-13T15:05:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.509+0000 7f6b60c00640 1 -- 172.21.15.7:0/654988610 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b5c1f2770 con 0x7f6b5c152f50 2024-09-13T15:05:09.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.509+0000 7f6b52000640 1 -- 172.21.15.7:0/654988610 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5547 (secure 0 0 0) 0x7f6b44054050 con 0x7f6b5c152f50 2024-09-13T15:05:09.512 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:05:09.512 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:05:07.590241+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4220":{"gid":4220,"name":"b","rank":4,"incarnation":19,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:05:09.512 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 19 2024-09-13T15:05:09.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.513+0000 7f6b60c00640 1 -- 172.21.15.7:0/654988610 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6b38066690 msgr2=0x7f6b38068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:09.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.513+0000 7f6b60c00640 1 --2- 172.21.15.7:0/654988610 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6b38066690 0x7f6b38068b50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00b9d0 tx=0x7f6b4c008040 comp rx=0 tx=0).stop 2024-09-13T15:05:09.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.513+0000 7f6b60c00640 1 -- 172.21.15.7:0/654988610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c152f50 msgr2=0x7f6b5c1f2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:09.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.513+0000 7f6b60c00640 1 --2- 172.21.15.7:0/654988610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c152f50 0x7f6b5c1f2ac0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400c3c0 tx=0x7f6b4400c880 comp rx=0 tx=0).stop 2024-09-13T15:05:09.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.513+0000 7f6b60c00640 1 -- 172.21.15.7:0/654988610 shutdown_connections 2024-09-13T15:05:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.513+0000 7f6b60c00640 1 --2- 172.21.15.7:0/654988610 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6b38066690 0x7f6b38068b50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.513+0000 7f6b60c00640 1 --2- 172.21.15.7:0/654988610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6b5c153330 0x7f6b5c15b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.513+0000 7f6b60c00640 1 --2- 172.21.15.7:0/654988610 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b5c152f50 0x7f6b5c1f2ac0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.513+0000 7f6b60c00640 1 --2- 172.21.15.7:0/654988610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6b5c06ff40 0x7f6b5c155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.513+0000 7f6b60c00640 1 -- 172.21.15.7:0/654988610 >> 172.21.15.7:0/654988610 conn(0x7f6b5c0739a0 msgr2=0x7f6b5c0c95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.513+0000 7f6b60c00640 1 -- 172.21.15.7:0/654988610 shutdown_connections 2024-09-13T15:05:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.513+0000 7f6b60c00640 1 -- 172.21.15.7:0/654988610 wait complete. 2024-09-13T15:05:09.534 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e down, removed from mdsmap 2024-09-13T15:05:09.534 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-09-13T15:05:09.534 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:05:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.672+0000 7ffa70a00640 1 Processor -- start 2024-09-13T15:05:09.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.672+0000 7ffa70a00640 1 -- start start 2024-09-13T15:05:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.672+0000 7ffa70a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa6c1513c0 0x7ffa6c156e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.672+0000 7ffa70a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa6c0c8780 0x7ffa6c157370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.672+0000 7ffa70a00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c0c20e0 con 0x7ffa6c150fe0 2024-09-13T15:05:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.672+0000 7ffa70a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c15af50 con 0x7ffa6c0c8780 2024-09-13T15:05:09.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.672+0000 7ffa70a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c15b230 con 0x7ffa6c1513c0 2024-09-13T15:05:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.672+0000 7ffa6a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa6c0c8780 0x7ffa6c157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.672+0000 7ffa61400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa6c1513c0 0x7ffa6c156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.672+0000 7ffa69e00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ffa6c150fe0 0x7ffa6c0c6b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:59032/0 (socket says 172.21.15.7:59032) 2024-09-13T15:05:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.672+0000 7ffa69e00640 1 -- 172.21.15.7:0/641617438 learned_addr learned my addr 172.21.15.7:0/641617438 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:05:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.672+0000 7ffa6a800640 1 -- 172.21.15.7:0/641617438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa6c1513c0 msgr2=0x7ffa6c156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:05:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.672+0000 7ffa6a800640 1 --2- 172.21.15.7:0/641617438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa6c1513c0 0x7ffa6c156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.672+0000 7ffa6a800640 1 -- 172.21.15.7:0/641617438 >> v1:172.21.15.77:6789/0 conn(0x7ffa6c150fe0 legacy=0x7ffa6c0c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:09.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.672+0000 7ffa6a800640 1 -- 172.21.15.7:0/641617438 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c0c3b70 con 0x7ffa6c0c8780 2024-09-13T15:05:09.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.676+0000 7ffa6a800640 1 --2- 172.21.15.7:0/641617438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c0c8780 0x7ffa6c157370 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ffa640097c0 tx=0x7ffa6401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626cc01399bb2d57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.676+0000 7ffa69400640 1 -- 172.21.15.7:0/641617438 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa640ab600 con 0x7ffa6c0c8780 2024-09-13T15:05:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.676+0000 7ffa69400640 1 -- 172.21.15.7:0/641617438 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa640a7050 con 0x7ffa6c0c8780 2024-09-13T15:05:09.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.676+0000 7ffa69400640 1 -- 172.21.15.7:0/641617438 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa640ab980 con 0x7ffa6c0c8780 2024-09-13T15:05:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.676+0000 7ffa70a00640 1 -- 172.21.15.7:0/641617438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c0c8780 msgr2=0x7ffa6c157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.676+0000 7ffa70a00640 1 --2- 172.21.15.7:0/641617438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c0c8780 0x7ffa6c157370 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ffa640097c0 tx=0x7ffa6401c410 comp rx=0 tx=0).stop 2024-09-13T15:05:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.676+0000 7ffa70a00640 1 -- 172.21.15.7:0/641617438 shutdown_connections 2024-09-13T15:05:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.676+0000 7ffa70a00640 1 --2- 172.21.15.7:0/641617438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c0c8780 0x7ffa6c157370 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.676+0000 7ffa70a00640 1 --2- 172.21.15.7:0/641617438 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa6c1513c0 0x7ffa6c156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.676+0000 7ffa70a00640 1 -- 172.21.15.7:0/641617438 >> 172.21.15.7:0/641617438 conn(0x7ffa6c071730 msgr2=0x7ffa6c071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.676+0000 7ffa70a00640 1 -- 172.21.15.7:0/641617438 shutdown_connections 2024-09-13T15:05:09.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.676+0000 7ffa70a00640 1 -- 172.21.15.7:0/641617438 wait complete. 2024-09-13T15:05:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa70a00640 1 Processor -- start 2024-09-13T15:05:09.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa70a00640 1 -- start start 2024-09-13T15:05:09.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa70a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c0c8780 0x7ffa6c158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa70a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa6c150fe0 0x7ffa6c160ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa70a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c1513c0 0x7ffa6c1f5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa70a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c15bac0 con 0x7ffa6c1513c0 2024-09-13T15:05:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa70a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c1f52c0 con 0x7ffa6c0c8780 2024-09-13T15:05:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa70a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0c53c0 con 0x7ffa6c150fe0 2024-09-13T15:05:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa6a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c1513c0 0x7ffa6c1f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa6a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c1513c0 0x7ffa6c1f5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52638/0 (socket says 172.21.15.7:52638) 2024-09-13T15:05:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa6a800640 1 -- 172.21.15.7:0/3124011283 learned_addr learned my addr 172.21.15.7:0/3124011283 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa61400640 1 --2- 172.21.15.7:0/3124011283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa6c150fe0 0x7ffa6c160ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa69e00640 1 --2- 172.21.15.7:0/3124011283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c0c8780 0x7ffa6c158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:09.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa6a800640 1 -- 172.21.15.7:0/3124011283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa6c150fe0 msgr2=0x7ffa6c160ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa6a800640 1 --2- 172.21.15.7:0/3124011283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa6c150fe0 0x7ffa6c160ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa6a800640 1 -- 172.21.15.7:0/3124011283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c0c8780 msgr2=0x7ffa6c158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa6a800640 1 --2- 172.21.15.7:0/3124011283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c0c8780 0x7ffa6c158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa6a800640 1 -- 172.21.15.7:0/3124011283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64009420 con 0x7ffa6c1513c0 2024-09-13T15:05:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa69e00640 1 --2- 172.21.15.7:0/3124011283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c0c8780 0x7ffa6c158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:05:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa6a800640 1 --2- 172.21.15.7:0/3124011283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c1513c0 0x7ffa6c1f5710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ffa6401a040 tx=0x7ffa640191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa62a00640 1 -- 172.21.15.7:0/3124011283 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa640b4430 con 0x7ffa6c1513c0 2024-09-13T15:05:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa62a00640 1 -- 172.21.15.7:0/3124011283 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa640b4590 con 0x7ffa6c1513c0 2024-09-13T15:05:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa62a00640 1 -- 172.21.15.7:0/3124011283 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa640b4920 con 0x7ffa6c1513c0 2024-09-13T15:05:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa70a00640 1 -- 172.21.15.7:0/3124011283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c0c56a0 con 0x7ffa6c1513c0 2024-09-13T15:05:09.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.680+0000 7ffa70a00640 1 -- 172.21.15.7:0/3124011283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c15c4b0 con 0x7ffa6c1513c0 2024-09-13T15:05:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.684+0000 7ffa70a00640 1 -- 172.21.15.7:0/3124011283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c067650 con 0x7ffa6c1513c0 2024-09-13T15:05:09.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.684+0000 7ffa62a00640 1 -- 172.21.15.7:0/3124011283 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffa640b2040 con 0x7ffa6c1513c0 2024-09-13T15:05:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.684+0000 7ffa62a00640 1 --2- 172.21.15.7:0/3124011283 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa48066690 0x7ffa48068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.684+0000 7ffa62a00640 1 -- 172.21.15.7:0/3124011283 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7ffa6411e4a0 con 0x7ffa6c1513c0 2024-09-13T15:05:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.684+0000 7ffa69e00640 1 --2- 172.21.15.7:0/3124011283 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa48066690 0x7ffa48068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:09.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.684+0000 7ffa69e00640 1 --2- 172.21.15.7:0/3124011283 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa48066690 0x7ffa48068b50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c005c10 tx=0x7ffa5c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:09.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.688+0000 7ffa62a00640 1 -- 172.21.15.7:0/3124011283 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffa640eb3f0 con 0x7ffa6c1513c0 2024-09-13T15:05:09.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.884+0000 7ffa70a00640 1 -- 172.21.15.7:0/3124011283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa6c1f5430 con 0x7ffa6c1513c0 2024-09-13T15:05:09.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.884+0000 7ffa62a00640 1 -- 172.21.15.7:0/3124011283 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5547 (secure 0 0 0) 0x7ffa6c1f5430 con 0x7ffa6c1513c0 2024-09-13T15:05:09.889 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:05:09.889 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:05:07.590241+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4220":{"gid":4220,"name":"b","rank":4,"incarnation":19,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:05:09.889 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 19 2024-09-13T15:05:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.888+0000 7ffa70a00640 1 -- 172.21.15.7:0/3124011283 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa48066690 msgr2=0x7ffa48068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.888+0000 7ffa70a00640 1 --2- 172.21.15.7:0/3124011283 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa48066690 0x7ffa48068b50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c005c10 tx=0x7ffa5c009040 comp rx=0 tx=0).stop 2024-09-13T15:05:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.888+0000 7ffa70a00640 1 -- 172.21.15.7:0/3124011283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c1513c0 msgr2=0x7ffa6c1f5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.888+0000 7ffa70a00640 1 --2- 172.21.15.7:0/3124011283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c1513c0 0x7ffa6c1f5710 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ffa6401a040 tx=0x7ffa640191b0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.888+0000 7ffa70a00640 1 -- 172.21.15.7:0/3124011283 shutdown_connections 2024-09-13T15:05:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.888+0000 7ffa70a00640 1 --2- 172.21.15.7:0/3124011283 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa48066690 0x7ffa48068b50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.888+0000 7ffa70a00640 1 --2- 172.21.15.7:0/3124011283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa6c1513c0 0x7ffa6c1f5710 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.888+0000 7ffa70a00640 1 --2- 172.21.15.7:0/3124011283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa6c150fe0 0x7ffa6c160ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.888+0000 7ffa70a00640 1 --2- 172.21.15.7:0/3124011283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c0c8780 0x7ffa6c158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:09.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.888+0000 7ffa70a00640 1 -- 172.21.15.7:0/3124011283 >> 172.21.15.7:0/3124011283 conn(0x7ffa6c071730 msgr2=0x7ffa6c14ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:09.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.888+0000 7ffa70a00640 1 -- 172.21.15.7:0/3124011283 shutdown_connections 2024-09-13T15:05:09.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:09.888+0000 7ffa70a00640 1 -- 172.21.15.7:0/3124011283 wait complete. 2024-09-13T15:05:09.911 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 19, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-13T15:01:44.789559+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 19, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3, 4 ], "info": { "gid_4220": { "addr": "172.21.15.77:6838/3330080895", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6836", "nonce": 3330080895, "type": "v2" }, { "addr": "172.21.15.77:6838", "nonce": 3330080895, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4220, "incarnation": 19, "join_fscid": -1, "name": "b", "rank": 4, "state": "up:replay", "state_seq": 1 }, "gid_4238": { "addr": "172.21.15.7:6837/3369648543", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6835", "nonce": 3369648543, "type": "v2" }, { "addr": "172.21.15.7:6837", "nonce": 3369648543, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4238, "incarnation": 15, "join_fscid": -1, "name": "a", "rank": 3, "state": "up:active", "state_seq": 44 }, "gid_4252": { "addr": "172.21.15.77:6835/2367107997", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6834", "nonce": 2367107997, "type": "v2" }, { "addr": "172.21.15.77:6835", "nonce": 2367107997, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4252, "incarnation": 13, "join_fscid": -1, "name": "d", "rank": 2, "state": "up:active", "state_seq": 43 }, "gid_4267": { "addr": "172.21.15.77:6839/2233000674", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6837", "nonce": 2233000674, "type": "v2" }, { "addr": "172.21.15.77:6839", "nonce": 2233000674, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4267, "incarnation": 9, "join_fscid": -1, "name": "f", "rank": 1, "state": "up:active", "state_seq": 41 }, "gid_4276": { "addr": "172.21.15.7:6836/2396967179", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6834", "nonce": 2396967179, "type": "v2" }, { "addr": "172.21.15.7:6836", "nonce": 2396967179, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4276, "incarnation": 4, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 5, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-13T15:05:07.590241+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4276, "mds_1": 4267, "mds_2": 4252, "mds_3": 4238, "mds_4": 4220 } } } ], "standbys": [] } 2024-09-13T15:05:11.912 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:05:12.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.052+0000 7ff3e2a00640 1 Processor -- start 2024-09-13T15:05:12.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.052+0000 7ff3e2a00640 1 -- start start 2024-09-13T15:05:12.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.052+0000 7ff3e2a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3dc0c5140 0x7ff3dc15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:12.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.052+0000 7ff3e2a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3dc0707d0 con 0x7ff3dc0c4d60 2024-09-13T15:05:12.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.052+0000 7ff3e2a00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3dc157dc0 con 0x7ff3dc15afe0 2024-09-13T15:05:12.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.052+0000 7ff3e2a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc073ab0 con 0x7ff3dc0c5140 2024-09-13T15:05:12.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.056+0000 7ff3dbe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff3dc0c4d60 0x7ff3dc0733a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45426/0 (socket says 172.21.15.7:45426) 2024-09-13T15:05:12.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.056+0000 7ff3dbe00640 1 -- 172.21.15.7:0/769728130 learned_addr learned my addr 172.21.15.7:0/769728130 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:05:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.056+0000 7ff3db400640 1 --2- 172.21.15.7:0/769728130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3dc0c5140 0x7ff3dc15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.056+0000 7ff3daa00640 1 -- 172.21.15.7:0/769728130 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33921637 0 0) 0x7ff3dc0707d0 con 0x7ff3dc0c4d60 2024-09-13T15:05:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.056+0000 7ff3daa00640 1 -- 172.21.15.7:0/769728130 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3c0003530 con 0x7ff3dc0c4d60 2024-09-13T15:05:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.056+0000 7ff3db400640 1 -- 172.21.15.7:0/769728130 >> v1:172.21.15.77:6789/0 conn(0x7ff3dc15afe0 legacy=0x7ff3dc14d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.056+0000 7ff3daa00640 1 -- 172.21.15.7:0/769728130 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593317947 0 0) 0x7ff3dc157dc0 con 0x7ff3dc15afe0 2024-09-13T15:05:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.056+0000 7ff3db400640 1 -- 172.21.15.7:0/769728130 >> v1:172.21.15.7:6789/0 conn(0x7ff3dc0c4d60 legacy=0x7ff3dc0733a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:12.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.056+0000 7ff3db400640 1 -- 172.21.15.7:0/769728130 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc157280 con 0x7ff3dc0c5140 2024-09-13T15:05:12.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.056+0000 7ff3db400640 1 --2- 172.21.15.7:0/769728130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3dc0c5140 0x7ff3dc15aaa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80097f0 tx=0x7ff3c801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7080ff6407fbba8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:12.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3daa00640 1 -- 172.21.15.7:0/769728130 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c80ab600 con 0x7ff3dc0c5140 2024-09-13T15:05:12.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3daa00640 1 -- 172.21.15.7:0/769728130 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c80a7050 con 0x7ff3dc0c5140 2024-09-13T15:05:12.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3daa00640 1 -- 172.21.15.7:0/769728130 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c80ab980 con 0x7ff3dc0c5140 2024-09-13T15:05:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3e2a00640 1 -- 172.21.15.7:0/769728130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3dc0c5140 msgr2=0x7ff3dc15aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3e2a00640 1 --2- 172.21.15.7:0/769728130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3dc0c5140 0x7ff3dc15aaa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80097f0 tx=0x7ff3c801c4e0 comp rx=0 tx=0).stop 2024-09-13T15:05:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3e2a00640 1 -- 172.21.15.7:0/769728130 shutdown_connections 2024-09-13T15:05:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3e2a00640 1 --2- 172.21.15.7:0/769728130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3dc0c5140 0x7ff3dc15aaa0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3e2a00640 1 -- 172.21.15.7:0/769728130 >> 172.21.15.7:0/769728130 conn(0x7ff3dc0cb3f0 msgr2=0x7ff3dc0cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:12.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3e2a00640 1 -- 172.21.15.7:0/769728130 shutdown_connections 2024-09-13T15:05:12.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3e2a00640 1 -- 172.21.15.7:0/769728130 wait complete. 2024-09-13T15:05:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3e2a00640 1 Processor -- start 2024-09-13T15:05:12.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3e2a00640 1 -- start start 2024-09-13T15:05:12.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3e2a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3dc0c4d60 0x7ff3dc13c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:12.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3e2a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3dc0c5140 0x7ff3dc13eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:12.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3e2a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3dc15afe0 0x7ff3dc1582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:12.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3e2a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc154a10 con 0x7ff3dc0c5140 2024-09-13T15:05:12.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3e2a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc1f3d50 con 0x7ff3dc0c4d60 2024-09-13T15:05:12.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3e2a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc159d50 con 0x7ff3dc15afe0 2024-09-13T15:05:12.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.060+0000 7ff3db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3dc0c5140 0x7ff3dc13eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:12.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.064+0000 7ff3db400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3dc0c5140 0x7ff3dc13eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52642/0 (socket says 172.21.15.7:52642) 2024-09-13T15:05:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.064+0000 7ff3db400640 1 -- 172.21.15.7:0/343639868 learned_addr learned my addr 172.21.15.7:0/343639868 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.064+0000 7ff3dbe00640 1 --2- 172.21.15.7:0/343639868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3dc0c4d60 0x7ff3dc13c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.064+0000 7ff3e0a00640 1 --2- 172.21.15.7:0/343639868 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3dc15afe0 0x7ff3dc1582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.064+0000 7ff3db400640 1 -- 172.21.15.7:0/343639868 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3dc15afe0 msgr2=0x7ff3dc1582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.064+0000 7ff3db400640 1 --2- 172.21.15.7:0/343639868 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3dc15afe0 0x7ff3dc1582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.064+0000 7ff3db400640 1 -- 172.21.15.7:0/343639868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3dc0c4d60 msgr2=0x7ff3dc13c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.064+0000 7ff3db400640 1 --2- 172.21.15.7:0/343639868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3dc0c4d60 0x7ff3dc13c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.064+0000 7ff3db400640 1 -- 172.21.15.7:0/343639868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c8009420 con 0x7ff3dc0c5140 2024-09-13T15:05:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.064+0000 7ff3db400640 1 --2- 172.21.15.7:0/343639868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3dc0c5140 0x7ff3dc13eca0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80ae040 tx=0x7ff3c8019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.064+0000 7ff3d3e00640 1 -- 172.21.15.7:0/343639868 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8004030 con 0x7ff3dc0c5140 2024-09-13T15:05:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.064+0000 7ff3d3e00640 1 -- 172.21.15.7:0/343639868 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c8004190 con 0x7ff3dc0c5140 2024-09-13T15:05:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.064+0000 7ff3d3e00640 1 -- 172.21.15.7:0/343639868 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8004500 con 0x7ff3dc0c5140 2024-09-13T15:05:12.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.064+0000 7ff3e2a00640 1 -- 172.21.15.7:0/343639868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3dc154f60 con 0x7ff3dc0c5140 2024-09-13T15:05:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.064+0000 7ff3e2a00640 1 -- 172.21.15.7:0/343639868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3dc154bf0 con 0x7ff3dc0c5140 2024-09-13T15:05:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.064+0000 7ff3e2a00640 1 -- 172.21.15.7:0/343639868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3dc158000 con 0x7ff3dc0c5140 2024-09-13T15:05:12.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.064+0000 7ff3d3e00640 1 -- 172.21.15.7:0/343639868 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff3c80b2040 con 0x7ff3dc0c5140 2024-09-13T15:05:12.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.068+0000 7ff3d3e00640 1 --2- 172.21.15.7:0/343639868 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff3bc0666c0 0x7ff3bc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:12.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.068+0000 7ff3d3e00640 1 -- 172.21.15.7:0/343639868 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7ff3c811d700 con 0x7ff3dc0c5140 2024-09-13T15:05:12.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.068+0000 7ff3dbe00640 1 --2- 172.21.15.7:0/343639868 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff3bc0666c0 0x7ff3bc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:12.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.068+0000 7ff3dbe00640 1 --2- 172.21.15.7:0/343639868 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff3bc0666c0 0x7ff3bc068b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc007fd0 tx=0x7ff3cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:12.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.072+0000 7ff3d3e00640 1 -- 172.21.15.7:0/343639868 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3dc158000 con 0x7ff3dc0c5140 2024-09-13T15:05:12.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.288+0000 7ff3e2a00640 1 -- 172.21.15.7:0/343639868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3dc158000 con 0x7ff3dc0c5140 2024-09-13T15:05:12.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.288+0000 7ff3d3e00640 1 -- 172.21.15.7:0/343639868 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5547 (secure 0 0 0) 0x7ff3dc158000 con 0x7ff3dc0c5140 2024-09-13T15:05:12.290 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:05:12.290 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:05:07.590241+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4220":{"gid":4220,"name":"b","rank":4,"incarnation":19,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:05:12.291 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 19 2024-09-13T15:05:12.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.288+0000 7ff3e2a00640 1 -- 172.21.15.7:0/343639868 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff3bc0666c0 msgr2=0x7ff3bc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:12.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.288+0000 7ff3e2a00640 1 --2- 172.21.15.7:0/343639868 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff3bc0666c0 0x7ff3bc068b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc007fd0 tx=0x7ff3cc009040 comp rx=0 tx=0).stop 2024-09-13T15:05:12.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.288+0000 7ff3e2a00640 1 -- 172.21.15.7:0/343639868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3dc0c5140 msgr2=0x7ff3dc13eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:12.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.288+0000 7ff3e2a00640 1 --2- 172.21.15.7:0/343639868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3dc0c5140 0x7ff3dc13eca0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80ae040 tx=0x7ff3c8019280 comp rx=0 tx=0).stop 2024-09-13T15:05:12.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.288+0000 7ff3e2a00640 1 -- 172.21.15.7:0/343639868 shutdown_connections 2024-09-13T15:05:12.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.288+0000 7ff3e2a00640 1 --2- 172.21.15.7:0/343639868 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff3bc0666c0 0x7ff3bc068b80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:12.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.288+0000 7ff3e2a00640 1 --2- 172.21.15.7:0/343639868 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff3dc15afe0 0x7ff3dc1582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:12.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.288+0000 7ff3e2a00640 1 --2- 172.21.15.7:0/343639868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3dc0c5140 0x7ff3dc13eca0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:12.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.288+0000 7ff3e2a00640 1 --2- 172.21.15.7:0/343639868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3dc0c4d60 0x7ff3dc13c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:12.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.288+0000 7ff3e2a00640 1 -- 172.21.15.7:0/343639868 >> 172.21.15.7:0/343639868 conn(0x7ff3dc0cb3f0 msgr2=0x7ff3dc0733a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:12.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.288+0000 7ff3e2a00640 1 -- 172.21.15.7:0/343639868 shutdown_connections 2024-09-13T15:05:12.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:12.288+0000 7ff3e2a00640 1 -- 172.21.15.7:0/343639868 wait complete. 2024-09-13T15:05:12.312 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:05:13.496 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:05:13.499 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:05:14.313 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:05:14.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.460+0000 7f3dcaa00640 1 Processor -- start 2024-09-13T15:05:14.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.460+0000 7f3dcaa00640 1 -- start start 2024-09-13T15:05:14.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.460+0000 7f3dcaa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3dc4150e30 0x7f3dc40b1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:14.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.460+0000 7f3dcaa00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3dc40c5b30 0x7f3dc4069f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:14.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.460+0000 7f3dcaa00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc40c5fd0 con 0x7f3dc4072350 2024-09-13T15:05:14.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.460+0000 7f3dcaa00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc4156c10 con 0x7f3dc4150e30 2024-09-13T15:05:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.460+0000 7f3dcaa00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc4073660 con 0x7f3dc40c5b30 2024-09-13T15:05:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.460+0000 7f3dc9600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3dc4150e30 0x7f3dc40b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.460+0000 7f3dc9600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3dc4150e30 0x7f3dc40b1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52654/0 (socket says 172.21.15.7:52654) 2024-09-13T15:05:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.460+0000 7f3dc9600640 1 -- 172.21.15.7:0/3061663299 learned_addr learned my addr 172.21.15.7:0/3061663299 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.460+0000 7f3dc8c00640 1 --2- 172.21.15.7:0/3061663299 >> v2:172.21.15.77:3300/0 conn(0x7f3dc40c5b30 0x7f3dc4069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.460+0000 7f3dc9600640 1 -- 172.21.15.7:0/3061663299 >> v2:172.21.15.77:3300/0 conn(0x7f3dc40c5b30 msgr2=0x7f3dc4069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:05:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.460+0000 7f3dc9600640 1 --2- 172.21.15.7:0/3061663299 >> v2:172.21.15.77:3300/0 conn(0x7f3dc40c5b30 0x7f3dc4069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.460+0000 7f3dc9600640 1 -- 172.21.15.7:0/3061663299 >> v1:172.21.15.77:6789/0 conn(0x7f3dc4072350 legacy=0x7f3dc4157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:05:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.460+0000 7f3dc9600640 1 -- 172.21.15.7:0/3061663299 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc4073940 con 0x7f3dc4150e30 2024-09-13T15:05:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.460+0000 7f3dc8c00640 1 --2- 172.21.15.7:0/3061663299 >> v2:172.21.15.77:3300/0 conn(0x7f3dc40c5b30 0x7f3dc4069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:05:14.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.464+0000 7f3dc9600640 1 --2- 172.21.15.7:0/3061663299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dc4150e30 0x7f3dc40b1170 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40b16b0 tx=0x7f3db801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d0549b718766f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.464+0000 7f3dc3e00640 1 -- 172.21.15.7:0/3061663299 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db80ac630 con 0x7f3dc4150e30 2024-09-13T15:05:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.464+0000 7f3dc3e00640 1 -- 172.21.15.7:0/3061663299 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db80ac790 con 0x7f3dc4150e30 2024-09-13T15:05:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.464+0000 7f3dc3e00640 1 -- 172.21.15.7:0/3061663299 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db80acb20 con 0x7f3dc4150e30 2024-09-13T15:05:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.464+0000 7f3dcaa00640 1 -- 172.21.15.7:0/3061663299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dc4150e30 msgr2=0x7f3dc40b1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.464+0000 7f3dcaa00640 1 --2- 172.21.15.7:0/3061663299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dc4150e30 0x7f3dc40b1170 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3dc40b16b0 tx=0x7f3db801c4e0 comp rx=0 tx=0).stop 2024-09-13T15:05:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.464+0000 7f3dcaa00640 1 -- 172.21.15.7:0/3061663299 shutdown_connections 2024-09-13T15:05:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.464+0000 7f3dcaa00640 1 --2- 172.21.15.7:0/3061663299 >> v2:172.21.15.77:3300/0 conn(0x7f3dc40c5b30 0x7f3dc4069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.464+0000 7f3dcaa00640 1 --2- 172.21.15.7:0/3061663299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dc4150e30 0x7f3dc40b1170 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.464+0000 7f3dcaa00640 1 -- 172.21.15.7:0/3061663299 >> 172.21.15.7:0/3061663299 conn(0x7f3dc40cb300 msgr2=0x7f3dc40cb710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.464+0000 7f3dcaa00640 1 -- 172.21.15.7:0/3061663299 shutdown_connections 2024-09-13T15:05:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.464+0000 7f3dcaa00640 1 -- 172.21.15.7:0/3061663299 wait complete. 2024-09-13T15:05:14.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dcaa00640 1 Processor -- start 2024-09-13T15:05:14.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dcaa00640 1 -- start start 2024-09-13T15:05:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dcaa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3dc4072350 0x7f3dc414f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dcaa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dc40c5b30 0x7f3dc40c0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dcaa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dc4150e30 0x7f3dc40c0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dcaa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40c9530 con 0x7f3dc40c5b30 2024-09-13T15:05:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dcaa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40c1f70 con 0x7f3dc4150e30 2024-09-13T15:05:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dcaa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40c9b50 con 0x7f3dc4072350 2024-09-13T15:05:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dc8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dc40c5b30 0x7f3dc40c0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dc8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dc40c5b30 0x7f3dc40c0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52662/0 (socket says 172.21.15.7:52662) 2024-09-13T15:05:14.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dc8c00640 1 -- 172.21.15.7:0/3159339433 learned_addr learned my addr 172.21.15.7:0/3159339433 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:14.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dc9600640 1 --2- 172.21.15.7:0/3159339433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3dc4072350 0x7f3dc414f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:14.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dca000640 1 --2- 172.21.15.7:0/3159339433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dc4150e30 0x7f3dc40c0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:14.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dc8c00640 1 -- 172.21.15.7:0/3159339433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3dc4072350 msgr2=0x7f3dc414f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:14.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dc8c00640 1 --2- 172.21.15.7:0/3159339433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3dc4072350 0x7f3dc414f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:14.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dc8c00640 1 -- 172.21.15.7:0/3159339433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dc4150e30 msgr2=0x7f3dc40c0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:14.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dc8c00640 1 --2- 172.21.15.7:0/3159339433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dc4150e30 0x7f3dc40c0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:14.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dc8c00640 1 -- 172.21.15.7:0/3159339433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db80094d0 con 0x7f3dc40c5b30 2024-09-13T15:05:14.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dc8c00640 1 --2- 172.21.15.7:0/3159339433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dc40c5b30 0x7f3dc40c0250 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3db000e810 tx=0x7f3db000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:14.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dc1600640 1 -- 172.21.15.7:0/3159339433 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db000c8d0 con 0x7f3dc40c5b30 2024-09-13T15:05:14.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dc1600640 1 -- 172.21.15.7:0/3159339433 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db000ca30 con 0x7f3dc40c5b30 2024-09-13T15:05:14.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dc1600640 1 -- 172.21.15.7:0/3159339433 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db000cde0 con 0x7f3dc40c5b30 2024-09-13T15:05:14.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dcaa00640 1 -- 172.21.15.7:0/3159339433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc4140ac0 con 0x7f3dc40c5b30 2024-09-13T15:05:14.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.468+0000 7f3dcaa00640 1 -- 172.21.15.7:0/3159339433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc40cab60 con 0x7f3dc40c5b30 2024-09-13T15:05:14.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.472+0000 7f3dcaa00640 1 -- 172.21.15.7:0/3159339433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc4069f30 con 0x7f3dc40c5b30 2024-09-13T15:05:14.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.472+0000 7f3dc1600640 1 -- 172.21.15.7:0/3159339433 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3db0013410 con 0x7f3dc40c5b30 2024-09-13T15:05:14.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.472+0000 7f3dc1600640 1 --2- 172.21.15.7:0/3159339433 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3da40666c0 0x7f3da4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:14.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.472+0000 7f3dc1600640 1 -- 172.21.15.7:0/3159339433 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f3db0084380 con 0x7f3dc40c5b30 2024-09-13T15:05:14.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.472+0000 7f3dc9600640 1 --2- 172.21.15.7:0/3159339433 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3da40666c0 0x7f3da4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:14.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.476+0000 7f3dc9600640 1 --2- 172.21.15.7:0/3159339433 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3da40666c0 0x7f3da4068b80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3db80ae000 tx=0x7f3db8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:14.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.476+0000 7f3dc1600640 1 -- 172.21.15.7:0/3159339433 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3db00512d0 con 0x7f3dc40c5b30 2024-09-13T15:05:14.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.692+0000 7f3dcaa00640 1 -- 172.21.15.7:0/3159339433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3dc40c7f10 con 0x7f3dc40c5b30 2024-09-13T15:05:14.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.692+0000 7f3dc1600640 1 -- 172.21.15.7:0/3159339433 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5549 (secure 0 0 0) 0x7f3db00548f0 con 0x7f3dc40c5b30 2024-09-13T15:05:14.694 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:05:14.694 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:05:12.864509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4220":{"gid":4220,"name":"b","rank":4,"incarnation":19,"state":"up:resolve","state_seq":55,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:05:14.694 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 20 2024-09-13T15:05:14.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.692+0000 7f3dcaa00640 1 -- 172.21.15.7:0/3159339433 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3da40666c0 msgr2=0x7f3da4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:14.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.692+0000 7f3dcaa00640 1 --2- 172.21.15.7:0/3159339433 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3da40666c0 0x7f3da4068b80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3db80ae000 tx=0x7f3db8008040 comp rx=0 tx=0).stop 2024-09-13T15:05:14.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.692+0000 7f3dcaa00640 1 -- 172.21.15.7:0/3159339433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dc40c5b30 msgr2=0x7f3dc40c0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:14.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.692+0000 7f3dcaa00640 1 --2- 172.21.15.7:0/3159339433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dc40c5b30 0x7f3dc40c0250 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3db000e810 tx=0x7f3db000ecd0 comp rx=0 tx=0).stop 2024-09-13T15:05:14.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.692+0000 7f3dcaa00640 1 -- 172.21.15.7:0/3159339433 shutdown_connections 2024-09-13T15:05:14.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.692+0000 7f3dcaa00640 1 --2- 172.21.15.7:0/3159339433 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3da40666c0 0x7f3da4068b80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:14.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.692+0000 7f3dcaa00640 1 --2- 172.21.15.7:0/3159339433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3dc4150e30 0x7f3dc40c0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:14.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.692+0000 7f3dcaa00640 1 --2- 172.21.15.7:0/3159339433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3dc40c5b30 0x7f3dc40c0250 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:14.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.692+0000 7f3dcaa00640 1 --2- 172.21.15.7:0/3159339433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3dc4072350 0x7f3dc414f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:14.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.692+0000 7f3dcaa00640 1 -- 172.21.15.7:0/3159339433 >> 172.21.15.7:0/3159339433 conn(0x7f3dc40cb300 msgr2=0x7f3dc4154870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:14.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.692+0000 7f3dcaa00640 1 -- 172.21.15.7:0/3159339433 shutdown_connections 2024-09-13T15:05:14.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:14.692+0000 7f3dcaa00640 1 -- 172.21.15.7:0/3159339433 wait complete. 2024-09-13T15:05:14.716 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:05:16.717 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:05:16.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.860+0000 7f0a90c00640 1 Processor -- start 2024-09-13T15:05:16.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.860+0000 7f0a90c00640 1 -- start start 2024-09-13T15:05:16.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.860+0000 7f0a90c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a8c14f650 0x7f0a8c155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:16.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.860+0000 7f0a90c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0a8c158a70 0x7f0a8c15fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:16.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.860+0000 7f0a90c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c155a40 con 0x7f0a8c14fa30 2024-09-13T15:05:16.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.860+0000 7f0a90c00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c0cba30 con 0x7f0a8c158a70 2024-09-13T15:05:16.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.860+0000 7f0a90c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0c2110 con 0x7f0a8c14f650 2024-09-13T15:05:16.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.860+0000 7f0a83e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f0a8c14fa30 0x7f0a8c0c5d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45440/0 (socket says 172.21.15.7:45440) 2024-09-13T15:05:16.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.860+0000 7f0a83e00640 1 -- 172.21.15.7:0/2818022049 learned_addr learned my addr 172.21.15.7:0/2818022049 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:05:16.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.860+0000 7f0a8b400640 1 --2- 172.21.15.7:0/2818022049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a8c14f650 0x7f0a8c155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:16.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.860+0000 7f0a8be00640 1 --2- 172.21.15.7:0/2818022049 >> v2:172.21.15.77:3300/0 conn(0x7f0a8c158a70 0x7f0a8c15fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:16.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.860+0000 7f0a8aa00640 1 -- 172.21.15.7:0/2818022049 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556488129 0 0) 0x7f0a8c155a40 con 0x7f0a8c14fa30 2024-09-13T15:05:16.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.860+0000 7f0a8aa00640 1 -- 172.21.15.7:0/2818022049 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a70003450 con 0x7f0a8c14fa30 2024-09-13T15:05:16.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.860+0000 7f0a8b400640 1 -- 172.21.15.7:0/2818022049 >> v2:172.21.15.77:3300/0 conn(0x7f0a8c158a70 msgr2=0x7f0a8c15fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:05:16.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.860+0000 7f0a8b400640 1 --2- 172.21.15.7:0/2818022049 >> v2:172.21.15.77:3300/0 conn(0x7f0a8c158a70 0x7f0a8c15fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:16.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.860+0000 7f0a8b400640 1 -- 172.21.15.7:0/2818022049 >> v1:172.21.15.7:6789/0 conn(0x7f0a8c14fa30 legacy=0x7f0a8c0c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:16.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.860+0000 7f0a8b400640 1 -- 172.21.15.7:0/2818022049 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c156410 con 0x7f0a8c14f650 2024-09-13T15:05:16.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.864+0000 7f0a8b400640 1 --2- 172.21.15.7:0/2818022049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a8c14f650 0x7f0a8c155ed0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0097c0 tx=0x7f0a7c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18074295292c1a04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:16.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.864+0000 7f0a8aa00640 1 -- 172.21.15.7:0/2818022049 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c0ac410 con 0x7f0a8c14f650 2024-09-13T15:05:16.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.864+0000 7f0a8aa00640 1 -- 172.21.15.7:0/2818022049 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c0ac570 con 0x7f0a8c14f650 2024-09-13T15:05:16.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.864+0000 7f0a8aa00640 1 -- 172.21.15.7:0/2818022049 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c0ac900 con 0x7f0a8c14f650 2024-09-13T15:05:16.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.864+0000 7f0a90c00640 1 -- 172.21.15.7:0/2818022049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a8c14f650 msgr2=0x7f0a8c155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:16.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.864+0000 7f0a90c00640 1 --2- 172.21.15.7:0/2818022049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a8c14f650 0x7f0a8c155ed0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0097c0 tx=0x7f0a7c01c4a0 comp rx=0 tx=0).stop 2024-09-13T15:05:16.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.864+0000 7f0a90c00640 1 -- 172.21.15.7:0/2818022049 shutdown_connections 2024-09-13T15:05:16.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.864+0000 7f0a90c00640 1 --2- 172.21.15.7:0/2818022049 >> v2:172.21.15.77:3300/0 conn(0x7f0a8c158a70 0x7f0a8c15fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:16.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.864+0000 7f0a90c00640 1 --2- 172.21.15.7:0/2818022049 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a8c14f650 0x7f0a8c155ed0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:16.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.864+0000 7f0a90c00640 1 -- 172.21.15.7:0/2818022049 >> 172.21.15.7:0/2818022049 conn(0x7f0a8c066340 msgr2=0x7f0a8c06bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:16.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.864+0000 7f0a90c00640 1 -- 172.21.15.7:0/2818022049 shutdown_connections 2024-09-13T15:05:16.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.864+0000 7f0a90c00640 1 -- 172.21.15.7:0/2818022049 wait complete. 2024-09-13T15:05:16.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.868+0000 7f0a90c00640 1 Processor -- start 2024-09-13T15:05:16.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.868+0000 7f0a90c00640 1 -- start start 2024-09-13T15:05:16.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a90c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a8c14f650 0x7f0a8c1f2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:16.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a90c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a8c14fa30 0x7f0a8c0c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:16.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a90c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a8c158a70 0x7f0a8c148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a90c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0c54c0 con 0x7f0a8c158a70 2024-09-13T15:05:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a90c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0c2800 con 0x7f0a8c14f650 2024-09-13T15:05:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a90c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c0c2ae0 con 0x7f0a8c14fa30 2024-09-13T15:05:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a8b400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a8c14f650 0x7f0a8c1f2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a8be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a8c158a70 0x7f0a8c148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a8b400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a8c14f650 0x7f0a8c1f2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:35874/0 (socket says 172.21.15.7:35874) 2024-09-13T15:05:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a8b400640 1 -- 172.21.15.7:0/4290920273 learned_addr learned my addr 172.21.15.7:0/4290920273 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:16.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a83e00640 1 --2- 172.21.15.7:0/4290920273 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a8c14fa30 0x7f0a8c0c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:16.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a8be00640 1 -- 172.21.15.7:0/4290920273 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a8c14fa30 msgr2=0x7f0a8c0c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:16.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a8be00640 1 --2- 172.21.15.7:0/4290920273 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a8c14fa30 0x7f0a8c0c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:16.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a8be00640 1 -- 172.21.15.7:0/4290920273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a8c14f650 msgr2=0x7f0a8c1f2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:16.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a8be00640 1 --2- 172.21.15.7:0/4290920273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a8c14f650 0x7f0a8c1f2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:16.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a8be00640 1 -- 172.21.15.7:0/4290920273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c009420 con 0x7f0a8c158a70 2024-09-13T15:05:16.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a8be00640 1 --2- 172.21.15.7:0/4290920273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a8c158a70 0x7f0a8c148d80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400eba0 tx=0x7f0a8400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:16.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a83400640 1 -- 172.21.15.7:0/4290920273 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8400cd20 con 0x7f0a8c158a70 2024-09-13T15:05:16.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a83400640 1 -- 172.21.15.7:0/4290920273 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8400f040 con 0x7f0a8c158a70 2024-09-13T15:05:16.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a83400640 1 -- 172.21.15.7:0/4290920273 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a840146c0 con 0x7f0a8c158a70 2024-09-13T15:05:16.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a90c00640 1 -- 172.21.15.7:0/4290920273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8c0c2dc0 con 0x7f0a8c158a70 2024-09-13T15:05:16.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a90c00640 1 -- 172.21.15.7:0/4290920273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8c0c4a60 con 0x7f0a8c158a70 2024-09-13T15:05:16.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.872+0000 7f0a90c00640 1 -- 172.21.15.7:0/4290920273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a8c06aaf0 con 0x7f0a8c158a70 2024-09-13T15:05:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.876+0000 7f0a83400640 1 -- 172.21.15.7:0/4290920273 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0a84014820 con 0x7f0a8c158a70 2024-09-13T15:05:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.876+0000 7f0a83400640 1 --2- 172.21.15.7:0/4290920273 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0a68066690 0x7f0a68068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.876+0000 7f0a83400640 1 -- 172.21.15.7:0/4290920273 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f0a84085160 con 0x7f0a8c158a70 2024-09-13T15:05:16.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.876+0000 7f0a8b400640 1 --2- 172.21.15.7:0/4290920273 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0a68066690 0x7f0a68068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:16.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.876+0000 7f0a8b400640 1 --2- 172.21.15.7:0/4290920273 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0a68066690 0x7f0a68068b50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c01c4e0 tx=0x7f0a7c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:16.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:16.880+0000 7f0a83400640 1 -- 172.21.15.7:0/4290920273 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0a84052160 con 0x7f0a8c158a70 2024-09-13T15:05:17.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:17.096+0000 7f0a90c00640 1 -- 172.21.15.7:0/4290920273 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a8c070e60 con 0x7f0a8c158a70 2024-09-13T15:05:17.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:17.096+0000 7f0a83400640 1 -- 172.21.15.7:0/4290920273 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5549 (secure 0 0 0) 0x7f0a84055780 con 0x7f0a8c158a70 2024-09-13T15:05:17.100 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:05:17.100 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:05:12.864509+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4220":{"gid":4220,"name":"b","rank":4,"incarnation":19,"state":"up:resolve","state_seq":55,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:05:17.100 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 20 2024-09-13T15:05:17.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:17.100+0000 7f0a90c00640 1 -- 172.21.15.7:0/4290920273 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0a68066690 msgr2=0x7f0a68068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:17.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:17.100+0000 7f0a90c00640 1 --2- 172.21.15.7:0/4290920273 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0a68066690 0x7f0a68068b50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c01c4e0 tx=0x7f0a7c008040 comp rx=0 tx=0).stop 2024-09-13T15:05:17.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:17.100+0000 7f0a90c00640 1 -- 172.21.15.7:0/4290920273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a8c158a70 msgr2=0x7f0a8c148d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:17.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:17.100+0000 7f0a90c00640 1 --2- 172.21.15.7:0/4290920273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a8c158a70 0x7f0a8c148d80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400eba0 tx=0x7f0a8400c490 comp rx=0 tx=0).stop 2024-09-13T15:05:17.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:17.100+0000 7f0a90c00640 1 -- 172.21.15.7:0/4290920273 shutdown_connections 2024-09-13T15:05:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:17.100+0000 7f0a90c00640 1 --2- 172.21.15.7:0/4290920273 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0a68066690 0x7f0a68068b50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:17.100+0000 7f0a90c00640 1 --2- 172.21.15.7:0/4290920273 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0a8c158a70 0x7f0a8c148d80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:17.100+0000 7f0a90c00640 1 --2- 172.21.15.7:0/4290920273 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0a8c14fa30 0x7f0a8c0c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:17.100+0000 7f0a90c00640 1 --2- 172.21.15.7:0/4290920273 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0a8c14f650 0x7f0a8c1f2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:17.100+0000 7f0a90c00640 1 -- 172.21.15.7:0/4290920273 >> 172.21.15.7:0/4290920273 conn(0x7f0a8c066340 msgr2=0x7f0a8c06dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:17.100+0000 7f0a90c00640 1 -- 172.21.15.7:0/4290920273 shutdown_connections 2024-09-13T15:05:17.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:17.100+0000 7f0a90c00640 1 -- 172.21.15.7:0/4290920273 wait complete. 2024-09-13T15:05:17.123 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:05:19.124 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:05:19.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.280+0000 7f634c000640 1 Processor -- start 2024-09-13T15:05:19.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.280+0000 7f634c000640 1 -- start start 2024-09-13T15:05:19.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.280+0000 7f634c000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f63440b0bf0 0x7f6344150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:19.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.280+0000 7f634c000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f634406ddb0 0x7f6344151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:19.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.280+0000 7f634c000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63440c5530 con 0x7f6344071a70 2024-09-13T15:05:19.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.280+0000 7f634c000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6344151750 con 0x7f63440b0bf0 2024-09-13T15:05:19.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.280+0000 7f634c000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63441583b0 con 0x7f634406ddb0 2024-09-13T15:05:19.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.280+0000 7f6348c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f63440b0bf0 0x7f6344150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:19.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.280+0000 7f6348c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f63440b0bf0 0x7f6344150cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39938/0 (socket says 172.21.15.7:39938) 2024-09-13T15:05:19.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.280+0000 7f6348c00640 1 -- 172.21.15.7:0/363318345 learned_addr learned my addr 172.21.15.7:0/363318345 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:19.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.280+0000 7f634a000640 1 --2- 172.21.15.7:0/363318345 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f634406ddb0 0x7f6344151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.284+0000 7f6348c00640 1 -- 172.21.15.7:0/363318345 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f634406ddb0 msgr2=0x7f6344151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:05:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.284+0000 7f6348c00640 1 --2- 172.21.15.7:0/363318345 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f634406ddb0 0x7f6344151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.284+0000 7f6348c00640 1 -- 172.21.15.7:0/363318345 >> v1:172.21.15.77:6789/0 conn(0x7f6344071a70 legacy=0x7f63441576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.284+0000 7f6348c00640 1 -- 172.21.15.7:0/363318345 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6344156f40 con 0x7f63440b0bf0 2024-09-13T15:05:19.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.284+0000 7f6348c00640 1 --2- 172.21.15.7:0/363318345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63440b0bf0 0x7f6344150cd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6330009870 tx=0x7f633001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d56a674523c281c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:19.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.284+0000 7f6343e00640 1 -- 172.21.15.7:0/363318345 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63300a95f0 con 0x7f63440b0bf0 2024-09-13T15:05:19.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.284+0000 7f6343e00640 1 -- 172.21.15.7:0/363318345 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63300a9750 con 0x7f63440b0bf0 2024-09-13T15:05:19.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.284+0000 7f6343e00640 1 -- 172.21.15.7:0/363318345 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63300a9ae0 con 0x7f63440b0bf0 2024-09-13T15:05:19.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.284+0000 7f634c000640 1 -- 172.21.15.7:0/363318345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63440b0bf0 msgr2=0x7f6344150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:19.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.284+0000 7f634c000640 1 --2- 172.21.15.7:0/363318345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63440b0bf0 0x7f6344150cd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6330009870 tx=0x7f633001c530 comp rx=0 tx=0).stop 2024-09-13T15:05:19.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f634c000640 1 -- 172.21.15.7:0/363318345 shutdown_connections 2024-09-13T15:05:19.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f634c000640 1 --2- 172.21.15.7:0/363318345 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f634406ddb0 0x7f6344151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:19.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f634c000640 1 --2- 172.21.15.7:0/363318345 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63440b0bf0 0x7f6344150cd0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:19.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f634c000640 1 -- 172.21.15.7:0/363318345 >> 172.21.15.7:0/363318345 conn(0x7f6344065d40 msgr2=0x7f6344066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:19.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f634c000640 1 -- 172.21.15.7:0/363318345 shutdown_connections 2024-09-13T15:05:19.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f634c000640 1 -- 172.21.15.7:0/363318345 wait complete. 2024-09-13T15:05:19.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f634c000640 1 Processor -- start 2024-09-13T15:05:19.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f634c000640 1 -- start start 2024-09-13T15:05:19.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f634c000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f634406ddb0 0x7f634413b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:19.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f634c000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6344071a70 0x7f6344142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:19.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f634c000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63440b0bf0 0x7f634413ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:19.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f634c000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634413bf70 con 0x7f634406ddb0 2024-09-13T15:05:19.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f634c000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634413f210 con 0x7f6344071a70 2024-09-13T15:05:19.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f634c000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634413de60 con 0x7f63440b0bf0 2024-09-13T15:05:19.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f6349600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f634406ddb0 0x7f634413b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:19.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f6349600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f634406ddb0 0x7f634413b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39950/0 (socket says 172.21.15.7:39950) 2024-09-13T15:05:19.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f6349600640 1 -- 172.21.15.7:0/1860311996 learned_addr learned my addr 172.21.15.7:0/1860311996 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:19.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f6348c00640 1 --2- 172.21.15.7:0/1860311996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6344071a70 0x7f6344142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:19.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.288+0000 7f634a000640 1 --2- 172.21.15.7:0/1860311996 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63440b0bf0 0x7f634413ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:19.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.292+0000 7f6349600640 1 -- 172.21.15.7:0/1860311996 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63440b0bf0 msgr2=0x7f634413ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.292+0000 7f6349600640 1 --2- 172.21.15.7:0/1860311996 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63440b0bf0 0x7f634413ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.292+0000 7f6349600640 1 -- 172.21.15.7:0/1860311996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6344071a70 msgr2=0x7f6344142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.292+0000 7f6349600640 1 --2- 172.21.15.7:0/1860311996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6344071a70 0x7f6344142b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.292+0000 7f6349600640 1 -- 172.21.15.7:0/1860311996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63300094d0 con 0x7f634406ddb0 2024-09-13T15:05:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.292+0000 7f6349600640 1 --2- 172.21.15.7:0/1860311996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f634406ddb0 0x7f634413b820 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f633800c3f0 tx=0x7f633800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.292+0000 7f6341600640 1 -- 172.21.15.7:0/1860311996 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63380052d0 con 0x7f634406ddb0 2024-09-13T15:05:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.292+0000 7f6341600640 1 -- 172.21.15.7:0/1860311996 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6338005430 con 0x7f634406ddb0 2024-09-13T15:05:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.292+0000 7f6341600640 1 -- 172.21.15.7:0/1860311996 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6338003840 con 0x7f634406ddb0 2024-09-13T15:05:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.292+0000 7f634c000640 1 -- 172.21.15.7:0/1860311996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634413ece0 con 0x7f634406ddb0 2024-09-13T15:05:19.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.292+0000 7f634c000640 1 -- 172.21.15.7:0/1860311996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6344144b70 con 0x7f634406ddb0 2024-09-13T15:05:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.292+0000 7f634c000640 1 -- 172.21.15.7:0/1860311996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6344067650 con 0x7f634406ddb0 2024-09-13T15:05:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.292+0000 7f6341600640 1 -- 172.21.15.7:0/1860311996 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f63380039a0 con 0x7f634406ddb0 2024-09-13T15:05:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.292+0000 7f6341600640 1 --2- 172.21.15.7:0/1860311996 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f63240666c0 0x7f6324068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.292+0000 7f6341600640 1 -- 172.21.15.7:0/1860311996 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f63380839e0 con 0x7f634406ddb0 2024-09-13T15:05:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.296+0000 7f6348c00640 1 --2- 172.21.15.7:0/1860311996 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f63240666c0 0x7f6324068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:19.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.296+0000 7f6348c00640 1 --2- 172.21.15.7:0/1860311996 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f63240666c0 0x7f6324068b80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f63300ae000 tx=0x7f63300b3040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:19.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.300+0000 7f6341600640 1 -- 172.21.15.7:0/1860311996 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6338050a80 con 0x7f634406ddb0 2024-09-13T15:05:19.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.516+0000 7f634c000640 1 -- 172.21.15.7:0/1860311996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6344071630 con 0x7f634406ddb0 2024-09-13T15:05:19.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.516+0000 7f6341600640 1 -- 172.21.15.7:0/1860311996 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5551 (secure 0 0 0) 0x7f63380540a0 con 0x7f634406ddb0 2024-09-13T15:05:19.520 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:05:19.520 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:05:17.885962+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4220":{"gid":4220,"name":"b","rank":4,"incarnation":19,"state":"up:reconnect","state_seq":57,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:05:19.520 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 21 2024-09-13T15:05:19.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.520+0000 7f634c000640 1 -- 172.21.15.7:0/1860311996 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f63240666c0 msgr2=0x7f6324068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:19.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.520+0000 7f634c000640 1 --2- 172.21.15.7:0/1860311996 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f63240666c0 0x7f6324068b80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f63300ae000 tx=0x7f63300b3040 comp rx=0 tx=0).stop 2024-09-13T15:05:19.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.520+0000 7f634c000640 1 -- 172.21.15.7:0/1860311996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f634406ddb0 msgr2=0x7f634413b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:19.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.520+0000 7f634c000640 1 --2- 172.21.15.7:0/1860311996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f634406ddb0 0x7f634413b820 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f633800c3f0 tx=0x7f633800c8b0 comp rx=0 tx=0).stop 2024-09-13T15:05:19.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.520+0000 7f634c000640 1 -- 172.21.15.7:0/1860311996 shutdown_connections 2024-09-13T15:05:19.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.520+0000 7f634c000640 1 --2- 172.21.15.7:0/1860311996 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f63240666c0 0x7f6324068b80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:19.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.520+0000 7f634c000640 1 --2- 172.21.15.7:0/1860311996 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f63440b0bf0 0x7f634413ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:19.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.520+0000 7f634c000640 1 --2- 172.21.15.7:0/1860311996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6344071a70 0x7f6344142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:19.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.520+0000 7f634c000640 1 --2- 172.21.15.7:0/1860311996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f634406ddb0 0x7f634413b820 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:19.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.520+0000 7f634c000640 1 -- 172.21.15.7:0/1860311996 >> 172.21.15.7:0/1860311996 conn(0x7f6344065d40 msgr2=0x7f63440bfe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:19.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.520+0000 7f634c000640 1 -- 172.21.15.7:0/1860311996 shutdown_connections 2024-09-13T15:05:19.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:19.520+0000 7f634c000640 1 -- 172.21.15.7:0/1860311996 wait complete. 2024-09-13T15:05:19.543 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:05:21.545 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:05:21.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.692+0000 7fb7ab200640 1 Processor -- start 2024-09-13T15:05:21.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.692+0000 7fb7ab200640 1 -- start start 2024-09-13T15:05:21.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.692+0000 7fb7ab200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb7ac155e80 0x7fb7ac06f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:21.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.692+0000 7fb7ab200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7ac14fa90 0x7fb7ac14ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:21.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.692+0000 7fb7ab200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ac0c6100 con 0x7fb7ac156260 2024-09-13T15:05:21.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.692+0000 7fb7ab200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ac06fc60 con 0x7fb7ac155e80 2024-09-13T15:05:21.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.692+0000 7fb7ab200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac06fa40 con 0x7fb7ac14fa90 2024-09-13T15:05:21.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.692+0000 7fb7a9400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb7ac156260 0x7fb7ac0c15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47026/0 (socket says 172.21.15.7:47026) 2024-09-13T15:05:21.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.692+0000 7fb7a9400640 1 -- 172.21.15.7:0/1666840203 learned_addr learned my addr 172.21.15.7:0/1666840203 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:05:21.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.692+0000 7fb7a9e00640 1 --2- 172.21.15.7:0/1666840203 >> v2:172.21.15.7:3300/0 conn(0x7fb7ac155e80 0x7fb7ac06f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:21.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.692+0000 7fb7aa800640 1 --2- 172.21.15.7:0/1666840203 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7ac14fa90 0x7fb7ac14ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:21.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.692+0000 7fb7a8a00640 1 -- 172.21.15.7:0/1666840203 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475037475 0 0) 0x7fb7ac0c6100 con 0x7fb7ac156260 2024-09-13T15:05:21.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.692+0000 7fb7a9e00640 1 -- 172.21.15.7:0/1666840203 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7ac14fa90 msgr2=0x7fb7ac14ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:05:21.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.692+0000 7fb7a9e00640 1 --2- 172.21.15.7:0/1666840203 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7ac14fa90 0x7fb7ac14ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:21.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.692+0000 7fb7a9e00640 1 -- 172.21.15.7:0/1666840203 >> v1:172.21.15.7:6789/0 conn(0x7fb7ac156260 legacy=0x7fb7ac0c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:21.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.692+0000 7fb7a9e00640 1 -- 172.21.15.7:0/1666840203 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ac0c5530 con 0x7fb7ac155e80 2024-09-13T15:05:21.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.696+0000 7fb7a9e00640 1 --2- 172.21.15.7:0/1666840203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7ac155e80 0x7fb7ac06f500 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0097f0 tx=0x7fb79c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d58a1d0f66e71d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:21.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.696+0000 7fb7a8a00640 1 -- 172.21.15.7:0/1666840203 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c0a8990 con 0x7fb7ac155e80 2024-09-13T15:05:21.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.696+0000 7fb7a8a00640 1 -- 172.21.15.7:0/1666840203 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79c0a8af0 con 0x7fb7ac155e80 2024-09-13T15:05:21.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.696+0000 7fb7a8a00640 1 -- 172.21.15.7:0/1666840203 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79c0a8e80 con 0x7fb7ac155e80 2024-09-13T15:05:21.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7ab200640 1 -- 172.21.15.7:0/1666840203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7ac155e80 msgr2=0x7fb7ac06f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:21.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7ab200640 1 --2- 172.21.15.7:0/1666840203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7ac155e80 0x7fb7ac06f500 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0097f0 tx=0x7fb79c01ec90 comp rx=0 tx=0).stop 2024-09-13T15:05:21.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7ab200640 1 -- 172.21.15.7:0/1666840203 shutdown_connections 2024-09-13T15:05:21.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7ab200640 1 --2- 172.21.15.7:0/1666840203 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7ac14fa90 0x7fb7ac14ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:21.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7ab200640 1 --2- 172.21.15.7:0/1666840203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7ac155e80 0x7fb7ac06f500 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:21.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7ab200640 1 -- 172.21.15.7:0/1666840203 >> 172.21.15.7:0/1666840203 conn(0x7fb7ac065d40 msgr2=0x7fb7ac066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:21.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7ab200640 1 -- 172.21.15.7:0/1666840203 shutdown_connections 2024-09-13T15:05:21.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7ab200640 1 -- 172.21.15.7:0/1666840203 wait complete. 2024-09-13T15:05:21.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7ab200640 1 Processor -- start 2024-09-13T15:05:21.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7ab200640 1 -- start start 2024-09-13T15:05:21.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7ab200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7ac14fa90 0x7fb7ac1ecac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:21.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7ab200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7ac155e80 0x7fb7ac14e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:21.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7ab200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7ac156260 0x7fb7ac14aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:21.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7ab200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac14be90 con 0x7fb7ac155e80 2024-09-13T15:05:21.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7ab200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac14c990 con 0x7fb7ac156260 2024-09-13T15:05:21.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7ab200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac1f0f90 con 0x7fb7ac14fa90 2024-09-13T15:05:21.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7a9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7ac155e80 0x7fb7ac14e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:21.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7a9400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7ac155e80 0x7fb7ac14e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39962/0 (socket says 172.21.15.7:39962) 2024-09-13T15:05:21.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7a9400640 1 -- 172.21.15.7:0/791634692 learned_addr learned my addr 172.21.15.7:0/791634692 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:21.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7a9e00640 1 --2- 172.21.15.7:0/791634692 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7ac14fa90 0x7fb7ac1ecac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:21.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7aa800640 1 --2- 172.21.15.7:0/791634692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7ac156260 0x7fb7ac14aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:21.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7a9400640 1 -- 172.21.15.7:0/791634692 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7ac14fa90 msgr2=0x7fb7ac1ecac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:21.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7a9400640 1 --2- 172.21.15.7:0/791634692 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7ac14fa90 0x7fb7ac1ecac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:21.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7a9400640 1 -- 172.21.15.7:0/791634692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7ac156260 msgr2=0x7fb7ac14aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:21.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7a9400640 1 --2- 172.21.15.7:0/791634692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7ac156260 0x7fb7ac14aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:21.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7a9400640 1 -- 172.21.15.7:0/791634692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79c009420 con 0x7fb7ac155e80 2024-09-13T15:05:21.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7a9e00640 1 --2- 172.21.15.7:0/791634692 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7ac14fa90 0x7fb7ac1ecac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:05:21.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.700+0000 7fb7a9400640 1 --2- 172.21.15.7:0/791634692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7ac155e80 0x7fb7ac14e900 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb79800c4b0 tx=0x7fb79800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:21.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.704+0000 7fb7a2000640 1 -- 172.21.15.7:0/791634692 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7980074e0 con 0x7fb7ac155e80 2024-09-13T15:05:21.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.704+0000 7fb7a2000640 1 -- 172.21.15.7:0/791634692 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb798007660 con 0x7fb7ac155e80 2024-09-13T15:05:21.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.704+0000 7fb7a2000640 1 -- 172.21.15.7:0/791634692 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb798004a30 con 0x7fb7ac155e80 2024-09-13T15:05:21.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.704+0000 7fb7ab200640 1 -- 172.21.15.7:0/791634692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7ac14a570 con 0x7fb7ac155e80 2024-09-13T15:05:21.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.704+0000 7fb7ab200640 1 -- 172.21.15.7:0/791634692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ac1f09d0 con 0x7fb7ac155e80 2024-09-13T15:05:21.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.704+0000 7fb7ab200640 1 -- 172.21.15.7:0/791634692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ac14a700 con 0x7fb7ac155e80 2024-09-13T15:05:21.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.704+0000 7fb7a2000640 1 -- 172.21.15.7:0/791634692 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb798004b90 con 0x7fb7ac155e80 2024-09-13T15:05:21.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.704+0000 7fb7a2000640 1 --2- 172.21.15.7:0/791634692 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb78c0666c0 0x7fb78c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:21.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.704+0000 7fb7a2000640 1 -- 172.21.15.7:0/791634692 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fb798083750 con 0x7fb7ac155e80 2024-09-13T15:05:21.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.704+0000 7fb7a9e00640 1 --2- 172.21.15.7:0/791634692 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb78c0666c0 0x7fb78c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:21.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.708+0000 7fb7a9e00640 1 --2- 172.21.15.7:0/791634692 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb78c0666c0 0x7fb78c068b80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0b2000 tx=0x7fb79c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:21.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.708+0000 7fb7a2000640 1 -- 172.21.15.7:0/791634692 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb798050610 con 0x7fb7ac155e80 2024-09-13T15:05:21.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.920+0000 7fb7ab200640 1 -- 172.21.15.7:0/791634692 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7ac0c6070 con 0x7fb7ac155e80 2024-09-13T15:05:21.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.924+0000 7fb7a2000640 1 -- 172.21.15.7:0/791634692 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+5551 (secure 0 0 0) 0x7fb798053c30 con 0x7fb7ac155e80 2024-09-13T15:05:21.925 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:05:21.925 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:05:17.885962+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4220":{"gid":4220,"name":"b","rank":4,"incarnation":19,"state":"up:reconnect","state_seq":57,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:05:21.926 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 21 2024-09-13T15:05:21.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.924+0000 7fb7ab200640 1 -- 172.21.15.7:0/791634692 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb78c0666c0 msgr2=0x7fb78c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:21.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.924+0000 7fb7ab200640 1 --2- 172.21.15.7:0/791634692 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb78c0666c0 0x7fb78c068b80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0b2000 tx=0x7fb79c008040 comp rx=0 tx=0).stop 2024-09-13T15:05:21.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.924+0000 7fb7ab200640 1 -- 172.21.15.7:0/791634692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7ac155e80 msgr2=0x7fb7ac14e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:21.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.924+0000 7fb7ab200640 1 --2- 172.21.15.7:0/791634692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7ac155e80 0x7fb7ac14e900 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb79800c4b0 tx=0x7fb79800c970 comp rx=0 tx=0).stop 2024-09-13T15:05:21.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.924+0000 7fb7ab200640 1 -- 172.21.15.7:0/791634692 shutdown_connections 2024-09-13T15:05:21.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.924+0000 7fb7ab200640 1 --2- 172.21.15.7:0/791634692 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb78c0666c0 0x7fb78c068b80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:21.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.924+0000 7fb7ab200640 1 --2- 172.21.15.7:0/791634692 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb7ac156260 0x7fb7ac14aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:21.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.924+0000 7fb7ab200640 1 --2- 172.21.15.7:0/791634692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7ac155e80 0x7fb7ac14e900 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:21.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.924+0000 7fb7ab200640 1 --2- 172.21.15.7:0/791634692 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7ac14fa90 0x7fb7ac1ecac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:21.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.924+0000 7fb7ab200640 1 -- 172.21.15.7:0/791634692 >> 172.21.15.7:0/791634692 conn(0x7fb7ac065d40 msgr2=0x7fb7ac0718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:21.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.924+0000 7fb7ab200640 1 -- 172.21.15.7:0/791634692 shutdown_connections 2024-09-13T15:05:21.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:21.924+0000 7fb7ab200640 1 -- 172.21.15.7:0/791634692 wait complete. 2024-09-13T15:05:21.951 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 21, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-13T15:01:44.789559+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 21, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3, 4 ], "info": { "gid_4220": { "addr": "172.21.15.77:6838/3330080895", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6836", "nonce": 3330080895, "type": "v2" }, { "addr": "172.21.15.77:6838", "nonce": 3330080895, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4220, "incarnation": 19, "join_fscid": -1, "name": "b", "rank": 4, "state": "up:reconnect", "state_seq": 57 }, "gid_4238": { "addr": "172.21.15.7:6837/3369648543", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6835", "nonce": 3369648543, "type": "v2" }, { "addr": "172.21.15.7:6837", "nonce": 3369648543, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4238, "incarnation": 15, "join_fscid": -1, "name": "a", "rank": 3, "state": "up:active", "state_seq": 44 }, "gid_4252": { "addr": "172.21.15.77:6835/2367107997", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6834", "nonce": 2367107997, "type": "v2" }, { "addr": "172.21.15.77:6835", "nonce": 2367107997, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4252, "incarnation": 13, "join_fscid": -1, "name": "d", "rank": 2, "state": "up:active", "state_seq": 43 }, "gid_4267": { "addr": "172.21.15.77:6839/2233000674", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6837", "nonce": 2233000674, "type": "v2" }, { "addr": "172.21.15.77:6839", "nonce": 2233000674, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4267, "incarnation": 9, "join_fscid": -1, "name": "f", "rank": 1, "state": "up:active", "state_seq": 41 }, "gid_4276": { "addr": "172.21.15.7:6836/2396967179", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6834", "nonce": 2396967179, "type": "v2" }, { "addr": "172.21.15.7:6836", "nonce": 2396967179, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4276, "incarnation": 4, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 5, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-13T15:05:17.885962+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4276, "mds_1": 4267, "mds_2": 4252, "mds_3": 4238, "mds_4": 4220 } } } ], "standbys": [] } 2024-09-13T15:05:23.952 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:05:24.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.124+0000 7f6a0b200640 1 Processor -- start 2024-09-13T15:05:24.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.124+0000 7f6a0b200640 1 -- start start 2024-09-13T15:05:24.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.124+0000 7f6a0b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a0c0c9780 0x7f6a0c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.124+0000 7f6a0b200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6a0c0c9b60 0x7f6a0c159070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.124+0000 7f6a0b200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a0c15d520 con 0x7f6a0c06df00 2024-09-13T15:05:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.124+0000 7f6a0b200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a0c06e470 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.124+0000 7f6a0b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c15c760 con 0x7f6a0c0c9780 2024-09-13T15:05:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.128+0000 7f6a09e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a0c0c9780 0x7f6a0c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.128+0000 7f6a09e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a0c0c9780 0x7f6a0c06d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:43076/0 (socket says 172.21.15.7:43076) 2024-09-13T15:05:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.128+0000 7f6a09400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6a0c0c9b60 0x7f6a0c159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.128+0000 7f6a09e00640 1 -- 172.21.15.7:0/3000392013 learned_addr learned my addr 172.21.15.7:0/3000392013 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.128+0000 7f6a0a800640 1 --1- 172.21.15.7:0/3000392013 >> v1:172.21.15.77:6789/0 conn(0x7f6a0c06df00 0x7f6a0c152f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:58672/0 (socket says 172.21.15.7:58672) 2024-09-13T15:05:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.128+0000 7f6a09400640 1 -- 172.21.15.7:0/3000392013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a0c0c9780 msgr2=0x7f6a0c06d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:05:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.128+0000 7f6a09400640 1 --2- 172.21.15.7:0/3000392013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a0c0c9780 0x7f6a0c06d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.128+0000 7f6a09400640 1 -- 172.21.15.7:0/3000392013 >> v1:172.21.15.77:6789/0 conn(0x7f6a0c06df00 legacy=0x7f6a0c152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.128+0000 7f6a09400640 1 -- 172.21.15.7:0/3000392013 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c15ca40 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.128+0000 7f6a09e00640 1 --2- 172.21.15.7:0/3000392013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a0c0c9780 0x7f6a0c06d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:05:24.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.132+0000 7f6a09400640 1 --2- 172.21.15.7:0/3000392013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a0c0c9b60 0x7f6a0c159070 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f69f80097c0 tx=0x7f69f801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90aee85a5377d99d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:24.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.132+0000 7f6a08a00640 1 -- 172.21.15.7:0/3000392013 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f80a8990 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.132+0000 7f6a08a00640 1 -- 172.21.15.7:0/3000392013 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f80a8af0 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.132+0000 7f6a08a00640 1 -- 172.21.15.7:0/3000392013 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f80a8e80 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.132+0000 7f6a0b200640 1 -- 172.21.15.7:0/3000392013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a0c0c9b60 msgr2=0x7f6a0c159070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:24.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.132+0000 7f6a0b200640 1 --2- 172.21.15.7:0/3000392013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a0c0c9b60 0x7f6a0c159070 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f69f80097c0 tx=0x7f69f801ec90 comp rx=0 tx=0).stop 2024-09-13T15:05:24.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.132+0000 7f6a0b200640 1 -- 172.21.15.7:0/3000392013 shutdown_connections 2024-09-13T15:05:24.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.132+0000 7f6a0b200640 1 --2- 172.21.15.7:0/3000392013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a0c0c9b60 0x7f6a0c159070 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:24.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.132+0000 7f6a0b200640 1 --2- 172.21.15.7:0/3000392013 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a0c0c9780 0x7f6a0c06d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:24.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.132+0000 7f6a0b200640 1 -- 172.21.15.7:0/3000392013 >> 172.21.15.7:0/3000392013 conn(0x7f6a0c065d40 msgr2=0x7f6a0c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:24.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.132+0000 7f6a0b200640 1 -- 172.21.15.7:0/3000392013 shutdown_connections 2024-09-13T15:05:24.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.132+0000 7f6a0b200640 1 -- 172.21.15.7:0/3000392013 wait complete. 2024-09-13T15:05:24.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0b200640 1 Processor -- start 2024-09-13T15:05:24.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0b200640 1 -- start start 2024-09-13T15:05:24.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0b200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a0c06df00 0x7f6a0c1e5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:24.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a0c0c9780 0x7f6a0c1ef470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:24.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a0c0c9b60 0x7f6a0c14c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:24.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c1eea30 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0b200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0718d0 con 0x7f6a0c06df00 2024-09-13T15:05:24.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c0c1eb0 con 0x7f6a0c0c9780 2024-09-13T15:05:24.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a0c0c9b60 0x7f6a0c14c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:24.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a09e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a0c06df00 0x7f6a0c1e5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:24.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a09400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a0c0c9780 0x7f6a0c1ef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:24.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a0c0c9b60 0x7f6a0c14c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39976/0 (socket says 172.21.15.7:39976) 2024-09-13T15:05:24.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0a800640 1 -- 172.21.15.7:0/2969134054 learned_addr learned my addr 172.21.15.7:0/2969134054 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:24.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a09e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a0c06df00 0x7f6a0c1e5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:52658/0 (socket says 172.21.15.7:52658) 2024-09-13T15:05:24.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0a800640 1 -- 172.21.15.7:0/2969134054 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a0c0c9780 msgr2=0x7f6a0c1ef470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:24.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0a800640 1 --2- 172.21.15.7:0/2969134054 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a0c0c9780 0x7f6a0c1ef470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:24.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0a800640 1 -- 172.21.15.7:0/2969134054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a0c06df00 msgr2=0x7f6a0c1e5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:24.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0a800640 1 --2- 172.21.15.7:0/2969134054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a0c06df00 0x7f6a0c1e5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:24.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0a800640 1 -- 172.21.15.7:0/2969134054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc0094d0 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0a800640 1 --2- 172.21.15.7:0/2969134054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a0c0c9b60 0x7f6a0c14c4b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400c730 tx=0x7f6a0400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:24.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a02000640 1 -- 172.21.15.7:0/2969134054 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400ce40 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a02000640 1 -- 172.21.15.7:0/2969134054 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0400a640 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a02000640 1 -- 172.21.15.7:0/2969134054 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400a9b0 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0b200640 1 -- 172.21.15.7:0/2969134054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f8009420 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.136+0000 7f6a0b200640 1 -- 172.21.15.7:0/2969134054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0c0c23e0 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.140+0000 7f6a0b200640 1 -- 172.21.15.7:0/2969134054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a0c0cc300 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.140+0000 7f6a02000640 1 -- 172.21.15.7:0/2969134054 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6a0400ab10 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.140+0000 7f6a02000640 1 --2- 172.21.15.7:0/2969134054 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f69ec0666c0 0x7f69ec068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:24.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.140+0000 7f6a02000640 1 -- 172.21.15.7:0/2969134054 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f6a04083cb0 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.140+0000 7f6a09e00640 1 --2- 172.21.15.7:0/2969134054 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f69ec0666c0 0x7f69ec068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:24.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.144+0000 7f6a09e00640 1 --2- 172.21.15.7:0/2969134054 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f69ec0666c0 0x7f69ec068b80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f69fc006cb0 tx=0x7f69fc009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:24.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.148+0000 7f6a02000640 1 -- 172.21.15.7:0/2969134054 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6a04050cb0 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.492+0000 7f6a0b200640 1 -- 172.21.15.7:0/2969134054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a0c1eeb80 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.496+0000 7f6a02000640 1 -- 172.21.15.7:0/2969134054 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5548 (secure 0 0 0) 0x7f6a04017020 con 0x7f6a0c0c9b60 2024-09-13T15:05:24.498 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:05:24.498 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:05:22.905332+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4220":{"gid":4220,"name":"b","rank":4,"incarnation":19,"state":"up:rejoin","state_seq":59,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:05:24.498 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 22 2024-09-13T15:05:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.496+0000 7f6a0b200640 1 -- 172.21.15.7:0/2969134054 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f69ec0666c0 msgr2=0x7f69ec068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.496+0000 7f6a0b200640 1 --2- 172.21.15.7:0/2969134054 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f69ec0666c0 0x7f69ec068b80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f69fc006cb0 tx=0x7f69fc009240 comp rx=0 tx=0).stop 2024-09-13T15:05:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.496+0000 7f6a0b200640 1 -- 172.21.15.7:0/2969134054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a0c0c9b60 msgr2=0x7f6a0c14c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.496+0000 7f6a0b200640 1 --2- 172.21.15.7:0/2969134054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a0c0c9b60 0x7f6a0c14c4b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400c730 tx=0x7f6a0400cbf0 comp rx=0 tx=0).stop 2024-09-13T15:05:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.496+0000 7f6a0b200640 1 -- 172.21.15.7:0/2969134054 shutdown_connections 2024-09-13T15:05:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.496+0000 7f6a0b200640 1 --2- 172.21.15.7:0/2969134054 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f69ec0666c0 0x7f69ec068b80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.496+0000 7f6a0b200640 1 --2- 172.21.15.7:0/2969134054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6a0c0c9b60 0x7f6a0c14c4b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.496+0000 7f6a0b200640 1 --2- 172.21.15.7:0/2969134054 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6a0c0c9780 0x7f6a0c1ef470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.496+0000 7f6a0b200640 1 --2- 172.21.15.7:0/2969134054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a0c06df00 0x7f6a0c1e5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:24.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.496+0000 7f6a0b200640 1 -- 172.21.15.7:0/2969134054 >> 172.21.15.7:0/2969134054 conn(0x7f6a0c065d40 msgr2=0x7f6a0c150130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:24.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.496+0000 7f6a0b200640 1 -- 172.21.15.7:0/2969134054 shutdown_connections 2024-09-13T15:05:24.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:24.496+0000 7f6a0b200640 1 -- 172.21.15.7:0/2969134054 wait complete. 2024-09-13T15:05:24.527 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:05:26.527 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:05:26.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.728+0000 7fe25f200640 1 Processor -- start 2024-09-13T15:05:26.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.728+0000 7fe25f200640 1 -- start start 2024-09-13T15:05:26.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.728+0000 7fe25f200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe2600c9f30 0x7fe26006db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:26.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.728+0000 7fe25f200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe260159590 0x7fe260159a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:26.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.728+0000 7fe25f200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26015c7f0 con 0x7fe260153170 2024-09-13T15:05:26.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.728+0000 7fe25f200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe260159170 con 0x7fe2600c9f30 2024-09-13T15:05:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.728+0000 7fe25f200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe260159f60 con 0x7fe260159590 2024-09-13T15:05:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.728+0000 7fe25d400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe2600c9f30 0x7fe26006db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.728+0000 7fe25de00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe260153170 0x7fe2600c74e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:58680/0 (socket says 172.21.15.7:58680) 2024-09-13T15:05:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.728+0000 7fe25de00640 1 -- 172.21.15.7:0/3796397138 learned_addr learned my addr 172.21.15.7:0/3796397138 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:05:26.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.728+0000 7fe25e800640 1 --2- 172.21.15.7:0/3796397138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe260159590 0x7fe260159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:26.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.732+0000 7fe25ca00640 1 -- 172.21.15.7:0/3796397138 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3167344541 0 0) 0x7fe26015c7f0 con 0x7fe260153170 2024-09-13T15:05:26.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.732+0000 7fe25d400640 1 -- 172.21.15.7:0/3796397138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe260159590 msgr2=0x7fe260159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:05:26.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.732+0000 7fe25d400640 1 --2- 172.21.15.7:0/3796397138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe260159590 0x7fe260159a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:26.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.732+0000 7fe25d400640 1 -- 172.21.15.7:0/3796397138 >> v1:172.21.15.77:6789/0 conn(0x7fe260153170 legacy=0x7fe2600c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:26.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.732+0000 7fe25d400640 1 -- 172.21.15.7:0/3796397138 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26015cad0 con 0x7fe2600c9f30 2024-09-13T15:05:26.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.736+0000 7fe25d400640 1 --2- 172.21.15.7:0/3796397138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2600c9f30 0x7fe26006db20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0097c0 tx=0x7fe24c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e20ad252e0e06f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:26.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.736+0000 7fe25ca00640 1 -- 172.21.15.7:0/3796397138 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c0a8990 con 0x7fe2600c9f30 2024-09-13T15:05:26.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.736+0000 7fe25ca00640 1 -- 172.21.15.7:0/3796397138 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24c0a8af0 con 0x7fe2600c9f30 2024-09-13T15:05:26.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.736+0000 7fe25ca00640 1 -- 172.21.15.7:0/3796397138 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c0a8e80 con 0x7fe2600c9f30 2024-09-13T15:05:26.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.736+0000 7fe25f200640 1 -- 172.21.15.7:0/3796397138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2600c9f30 msgr2=0x7fe26006db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:26.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.736+0000 7fe25f200640 1 --2- 172.21.15.7:0/3796397138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2600c9f30 0x7fe26006db20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0097c0 tx=0x7fe24c01ec90 comp rx=0 tx=0).stop 2024-09-13T15:05:26.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.736+0000 7fe25f200640 1 -- 172.21.15.7:0/3796397138 shutdown_connections 2024-09-13T15:05:26.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.736+0000 7fe25f200640 1 --2- 172.21.15.7:0/3796397138 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe260159590 0x7fe260159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:26.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.736+0000 7fe25f200640 1 --2- 172.21.15.7:0/3796397138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2600c9f30 0x7fe26006db20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:26.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.736+0000 7fe25f200640 1 -- 172.21.15.7:0/3796397138 >> 172.21.15.7:0/3796397138 conn(0x7fe260065d40 msgr2=0x7fe260066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:26.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.736+0000 7fe25f200640 1 -- 172.21.15.7:0/3796397138 shutdown_connections 2024-09-13T15:05:26.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.736+0000 7fe25f200640 1 -- 172.21.15.7:0/3796397138 wait complete. 2024-09-13T15:05:26.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25f200640 1 Processor -- start 2024-09-13T15:05:26.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25f200640 1 -- start start 2024-09-13T15:05:26.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe260153170 0x7fe2601e3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:26.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25f200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe260159590 0x7fe260154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:26.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25f200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe260155210 0x7fe2601489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:26.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe260153bb0 con 0x7fe260153170 2024-09-13T15:05:26.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25f200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26014d780 con 0x7fe260159590 2024-09-13T15:05:26.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25f200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe260154840 con 0x7fe260155210 2024-09-13T15:05:26.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe260153170 0x7fe2601e3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:26.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe260153170 0x7fe2601e3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39982/0 (socket says 172.21.15.7:39982) 2024-09-13T15:05:26.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25de00640 1 -- 172.21.15.7:0/702513799 learned_addr learned my addr 172.21.15.7:0/702513799 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:26.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25e800640 1 --2- 172.21.15.7:0/702513799 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe260155210 0x7fe2601489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:26.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25d400640 1 --2- 172.21.15.7:0/702513799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe260159590 0x7fe260154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:26.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25de00640 1 -- 172.21.15.7:0/702513799 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe260155210 msgr2=0x7fe2601489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:26.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25de00640 1 --2- 172.21.15.7:0/702513799 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe260155210 0x7fe2601489d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:26.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25de00640 1 -- 172.21.15.7:0/702513799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe260159590 msgr2=0x7fe260154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:26.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25de00640 1 --2- 172.21.15.7:0/702513799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe260159590 0x7fe260154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:26.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25de00640 1 -- 172.21.15.7:0/702513799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c009420 con 0x7fe260153170 2024-09-13T15:05:26.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25de00640 1 --2- 172.21.15.7:0/702513799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe260153170 0x7fe2601e3540 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe25000c520 tx=0x7fe25000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:26.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe256000640 1 -- 172.21.15.7:0/702513799 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2500074e0 con 0x7fe260153170 2024-09-13T15:05:26.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe256000640 1 -- 172.21.15.7:0/702513799 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe250007640 con 0x7fe260153170 2024-09-13T15:05:26.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe256000640 1 -- 172.21.15.7:0/702513799 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2500049f0 con 0x7fe260153170 2024-09-13T15:05:26.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25f200640 1 -- 172.21.15.7:0/702513799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2601556c0 con 0x7fe260153170 2024-09-13T15:05:26.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.740+0000 7fe25f200640 1 -- 172.21.15.7:0/702513799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26014d4c0 con 0x7fe260153170 2024-09-13T15:05:26.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.744+0000 7fe25f200640 1 -- 172.21.15.7:0/702513799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26006e2f0 con 0x7fe260153170 2024-09-13T15:05:26.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.744+0000 7fe256000640 1 -- 172.21.15.7:0/702513799 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe250004b50 con 0x7fe260153170 2024-09-13T15:05:26.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.744+0000 7fe256000640 1 --2- 172.21.15.7:0/702513799 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe240066710 0x7fe240068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:26.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.744+0000 7fe256000640 1 -- 172.21.15.7:0/702513799 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fe250083a10 con 0x7fe260153170 2024-09-13T15:05:26.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.744+0000 7fe25d400640 1 --2- 172.21.15.7:0/702513799 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe240066710 0x7fe240068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:26.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.748+0000 7fe25d400640 1 --2- 172.21.15.7:0/702513799 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe240066710 0x7fe240068bd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0b2000 tx=0x7fe24c0aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:26.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.748+0000 7fe256000640 1 -- 172.21.15.7:0/702513799 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe250050a00 con 0x7fe260153170 2024-09-13T15:05:26.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.952+0000 7fe25f200640 1 -- 172.21.15.7:0/702513799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe26015c4a0 con 0x7fe260153170 2024-09-13T15:05:26.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.952+0000 7fe256000640 1 -- 172.21.15.7:0/702513799 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+5548 (secure 0 0 0) 0x7fe250018020 con 0x7fe260153170 2024-09-13T15:05:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:05:26.956 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:05:22.905332+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4220":{"gid":4220,"name":"b","rank":4,"incarnation":19,"state":"up:rejoin","state_seq":59,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:05:26.956 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 22 2024-09-13T15:05:26.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.956+0000 7fe25f200640 1 -- 172.21.15.7:0/702513799 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe240066710 msgr2=0x7fe240068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:26.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.956+0000 7fe25f200640 1 --2- 172.21.15.7:0/702513799 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe240066710 0x7fe240068bd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0b2000 tx=0x7fe24c0aa070 comp rx=0 tx=0).stop 2024-09-13T15:05:26.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.956+0000 7fe25f200640 1 -- 172.21.15.7:0/702513799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe260153170 msgr2=0x7fe2601e3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:26.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.956+0000 7fe25f200640 1 --2- 172.21.15.7:0/702513799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe260153170 0x7fe2601e3540 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe25000c520 tx=0x7fe25000c9e0 comp rx=0 tx=0).stop 2024-09-13T15:05:26.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.956+0000 7fe25f200640 1 -- 172.21.15.7:0/702513799 shutdown_connections 2024-09-13T15:05:26.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.956+0000 7fe25f200640 1 --2- 172.21.15.7:0/702513799 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe240066710 0x7fe240068bd0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:26.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.956+0000 7fe25f200640 1 --2- 172.21.15.7:0/702513799 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe260155210 0x7fe2601489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:26.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.956+0000 7fe25f200640 1 --2- 172.21.15.7:0/702513799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe260159590 0x7fe260154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:26.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.956+0000 7fe25f200640 1 --2- 172.21.15.7:0/702513799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe260153170 0x7fe2601e3540 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:26.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.956+0000 7fe25f200640 1 -- 172.21.15.7:0/702513799 >> 172.21.15.7:0/702513799 conn(0x7fe260065d40 msgr2=0x7fe260157f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:26.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.956+0000 7fe25f200640 1 -- 172.21.15.7:0/702513799 shutdown_connections 2024-09-13T15:05:26.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:26.956+0000 7fe25f200640 1 -- 172.21.15.7:0/702513799 wait complete. 2024-09-13T15:05:26.978 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:05:28.979 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:05:29.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.124+0000 7fbcf4c00640 1 Processor -- start 2024-09-13T15:05:29.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.124+0000 7fbcf4c00640 1 -- start start 2024-09-13T15:05:29.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.124+0000 7fbcf4c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbcf0155e80 0x7fbcf006f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:29.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.124+0000 7fbcf4c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbcf0156260 0x7fbcf00c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:29.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.124+0000 7fbcf4c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf00c6100 con 0x7fbcf014fa90 2024-09-13T15:05:29.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.124+0000 7fbcf4c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf006fc60 con 0x7fbcf0155e80 2024-09-13T15:05:29.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.124+0000 7fbcf4c00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf006fa40 con 0x7fbcf0156260 2024-09-13T15:05:29.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.124+0000 7fbcef400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbcf0155e80 0x7fbcf006f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:29.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.124+0000 7fbcef400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbcf0155e80 0x7fbcf006f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49340/0 (socket says 172.21.15.7:49340) 2024-09-13T15:05:29.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.124+0000 7fbcef400640 1 -- 172.21.15.7:0/443537612 learned_addr learned my addr 172.21.15.7:0/443537612 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:29.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.124+0000 7fbce7e00640 1 --2- 172.21.15.7:0/443537612 >> v2:172.21.15.77:3300/0 conn(0x7fbcf0156260 0x7fbcf00c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:29.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.124+0000 7fbcef400640 1 -- 172.21.15.7:0/443537612 >> v2:172.21.15.77:3300/0 conn(0x7fbcf0156260 msgr2=0x7fbcf00c15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:05:29.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.124+0000 7fbcef400640 1 --2- 172.21.15.7:0/443537612 >> v2:172.21.15.77:3300/0 conn(0x7fbcf0156260 0x7fbcf00c15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:29.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.124+0000 7fbcef400640 1 -- 172.21.15.7:0/443537612 >> v1:172.21.15.77:6789/0 conn(0x7fbcf014fa90 legacy=0x7fbcf0070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:29.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.124+0000 7fbcef400640 1 -- 172.21.15.7:0/443537612 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf00c5530 con 0x7fbcf0155e80 2024-09-13T15:05:29.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.128+0000 7fbcef400640 1 --2- 172.21.15.7:0/443537612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf0155e80 0x7fbcf006f500 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00c13b0 tx=0x7fbce001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63e87feedae38f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:29.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.128+0000 7fbceea00640 1 -- 172.21.15.7:0/443537612 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce00a8a10 con 0x7fbcf0155e80 2024-09-13T15:05:29.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.128+0000 7fbceea00640 1 -- 172.21.15.7:0/443537612 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce00a8b70 con 0x7fbcf0155e80 2024-09-13T15:05:29.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.128+0000 7fbceea00640 1 -- 172.21.15.7:0/443537612 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce00b0440 con 0x7fbcf0155e80 2024-09-13T15:05:29.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.128+0000 7fbcf4c00640 1 -- 172.21.15.7:0/443537612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf0155e80 msgr2=0x7fbcf006f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:29.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.128+0000 7fbcf4c00640 1 --2- 172.21.15.7:0/443537612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf0155e80 0x7fbcf006f500 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00c13b0 tx=0x7fbce001ed10 comp rx=0 tx=0).stop 2024-09-13T15:05:29.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.128+0000 7fbcf4c00640 1 -- 172.21.15.7:0/443537612 shutdown_connections 2024-09-13T15:05:29.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.128+0000 7fbcf4c00640 1 --2- 172.21.15.7:0/443537612 >> v2:172.21.15.77:3300/0 conn(0x7fbcf0156260 0x7fbcf00c15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:29.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.128+0000 7fbcf4c00640 1 --2- 172.21.15.7:0/443537612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf0155e80 0x7fbcf006f500 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:29.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.128+0000 7fbcf4c00640 1 -- 172.21.15.7:0/443537612 >> 172.21.15.7:0/443537612 conn(0x7fbcf0065d40 msgr2=0x7fbcf0066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:29.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.132+0000 7fbcf4c00640 1 -- 172.21.15.7:0/443537612 shutdown_connections 2024-09-13T15:05:29.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.132+0000 7fbcf4c00640 1 -- 172.21.15.7:0/443537612 wait complete. 2024-09-13T15:05:29.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.132+0000 7fbcf4c00640 1 Processor -- start 2024-09-13T15:05:29.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.132+0000 7fbcf4c00640 1 -- start start 2024-09-13T15:05:29.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcf4c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf014fa90 0x7fbcf013e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:29.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcf4c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf0155e80 0x7fbcf0145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:29.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcf4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf0156260 0x7fbcf00c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:29.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcf4c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf0144040 con 0x7fbcf0156260 2024-09-13T15:05:29.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcf4c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf0144570 con 0x7fbcf0155e80 2024-09-13T15:05:29.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcf4c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf0144290 con 0x7fbcf014fa90 2024-09-13T15:05:29.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcefe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf0156260 0x7fbcf00c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:29.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcef400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf014fa90 0x7fbcf013e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:29.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcefe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf0156260 0x7fbcf00c41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49344/0 (socket says 172.21.15.7:49344) 2024-09-13T15:05:29.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcefe00640 1 -- 172.21.15.7:0/854712343 learned_addr learned my addr 172.21.15.7:0/854712343 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:29.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbce7e00640 1 --2- 172.21.15.7:0/854712343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf0155e80 0x7fbcf0145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:29.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcefe00640 1 -- 172.21.15.7:0/854712343 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf014fa90 msgr2=0x7fbcf013e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:29.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcefe00640 1 --2- 172.21.15.7:0/854712343 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf014fa90 0x7fbcf013e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:29.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcefe00640 1 -- 172.21.15.7:0/854712343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf0155e80 msgr2=0x7fbcf0145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:29.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcefe00640 1 --2- 172.21.15.7:0/854712343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf0155e80 0x7fbcf0145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:29.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcefe00640 1 -- 172.21.15.7:0/854712343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce00094d0 con 0x7fbcf0156260 2024-09-13T15:05:29.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcefe00640 1 --2- 172.21.15.7:0/854712343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf0156260 0x7fbcf00c41f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbce800c7a0 tx=0x7fbce800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:29.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbce7400640 1 -- 172.21.15.7:0/854712343 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8003b80 con 0x7fbcf0156260 2024-09-13T15:05:29.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbce7400640 1 -- 172.21.15.7:0/854712343 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce8003ce0 con 0x7fbcf0156260 2024-09-13T15:05:29.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcf4c00640 1 -- 172.21.15.7:0/854712343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf0144960 con 0x7fbcf0156260 2024-09-13T15:05:29.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbce7400640 1 -- 172.21.15.7:0/854712343 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce800aa90 con 0x7fbcf0156260 2024-09-13T15:05:29.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcf4c00640 1 -- 172.21.15.7:0/854712343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf013e620 con 0x7fbcf0156260 2024-09-13T15:05:29.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.136+0000 7fbcf4c00640 1 -- 172.21.15.7:0/854712343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf0146c50 con 0x7fbcf0156260 2024-09-13T15:05:29.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.140+0000 7fbce7400640 1 -- 172.21.15.7:0/854712343 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbce800abf0 con 0x7fbcf0156260 2024-09-13T15:05:29.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.140+0000 7fbce7400640 1 --2- 172.21.15.7:0/854712343 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbccc066690 0x7fbccc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:29.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.140+0000 7fbce7400640 1 -- 172.21.15.7:0/854712343 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fbce80842f0 con 0x7fbcf0156260 2024-09-13T15:05:29.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.140+0000 7fbcef400640 1 --2- 172.21.15.7:0/854712343 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbccc066690 0x7fbccc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:29.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.140+0000 7fbcef400640 1 --2- 172.21.15.7:0/854712343 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbccc066690 0x7fbccc068b50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbce00b2000 tx=0x7fbce0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:29.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.144+0000 7fbce7400640 1 -- 172.21.15.7:0/854712343 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbce80512f0 con 0x7fbcf0156260 2024-09-13T15:05:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.444+0000 7fbcf4c00640 1 -- 172.21.15.7:0/854712343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbcf0156970 con 0x7fbcf0156260 2024-09-13T15:05:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.444+0000 7fbce7400640 1 -- 172.21.15.7:0/854712343 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+5548 (secure 0 0 0) 0x7fbce8054910 con 0x7fbcf0156260 2024-09-13T15:05:29.448 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:05:29.448 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:05:28.769591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4220":{"gid":4220,"name":"b","rank":4,"incarnation":19,"state":"up:active","state_seq":61,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:05:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 23 2024-09-13T15:05:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.448+0000 7fbcf4c00640 1 -- 172.21.15.7:0/854712343 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbccc066690 msgr2=0x7fbccc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.448+0000 7fbcf4c00640 1 --2- 172.21.15.7:0/854712343 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbccc066690 0x7fbccc068b50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbce00b2000 tx=0x7fbce0009040 comp rx=0 tx=0).stop 2024-09-13T15:05:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.448+0000 7fbcf4c00640 1 -- 172.21.15.7:0/854712343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf0156260 msgr2=0x7fbcf00c41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.448+0000 7fbcf4c00640 1 --2- 172.21.15.7:0/854712343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf0156260 0x7fbcf00c41f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbce800c7a0 tx=0x7fbce800cc60 comp rx=0 tx=0).stop 2024-09-13T15:05:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.448+0000 7fbcf4c00640 1 -- 172.21.15.7:0/854712343 shutdown_connections 2024-09-13T15:05:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.448+0000 7fbcf4c00640 1 --2- 172.21.15.7:0/854712343 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbccc066690 0x7fbccc068b50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.448+0000 7fbcf4c00640 1 --2- 172.21.15.7:0/854712343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbcf0156260 0x7fbcf00c41f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.448+0000 7fbcf4c00640 1 --2- 172.21.15.7:0/854712343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbcf0155e80 0x7fbcf0145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.448+0000 7fbcf4c00640 1 --2- 172.21.15.7:0/854712343 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbcf014fa90 0x7fbcf013e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.448+0000 7fbcf4c00640 1 -- 172.21.15.7:0/854712343 >> 172.21.15.7:0/854712343 conn(0x7fbcf0065d40 msgr2=0x7fbcf00c65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.448+0000 7fbcf4c00640 1 -- 172.21.15.7:0/854712343 shutdown_connections 2024-09-13T15:05:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:29.448+0000 7fbcf4c00640 1 -- 172.21.15.7:0/854712343 wait complete. 2024-09-13T15:05:29.480 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b has gained rank=4, replacing gid=4232 2024-09-13T15:05:29.480 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 3 secs before reviving mds.e 2024-09-13T15:05:29.741 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-09-13T15:05:29.736+0000 7ff9aa000640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-13T15:05:32.481 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.e 2024-09-13T15:05:32.482 INFO:tasks.ceph.mds.e:Restarting daemon 2024-09-13T15:05:32.482 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-09-13T15:05:32.486 INFO:tasks.ceph.mds.e:Started 2024-09-13T15:05:32.486 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:05:32.629 INFO:tasks.ceph.mds.e.smithi007.stdout:starting mds.e at 2024-09-13T15:05:32.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.716+0000 7f3ecd400640 1 Processor -- start 2024-09-13T15:05:32.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.716+0000 7f3ecd400640 1 -- start start 2024-09-13T15:05:32.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.716+0000 7f3ecd400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3ec80c9f30 0x7f3ec806db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:32.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.720+0000 7f3ecd400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3ec8159590 0x7f3ec8159a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:32.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.720+0000 7f3ecd400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec815c7f0 con 0x7f3ec8153170 2024-09-13T15:05:32.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.720+0000 7f3ecd400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec8159170 con 0x7f3ec8159590 2024-09-13T15:05:32.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.720+0000 7f3ecd400640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec8159f40 con 0x7f3ec80c9f30 2024-09-13T15:05:32.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.720+0000 7f3ec7400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3ec80c9f30 0x7f3ec806db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.720+0000 7f3ecca00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3ec8159590 0x7f3ec8159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.720+0000 7f3ec7400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3ec80c9f30 0x7f3ec806db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:43010/0 (socket says 172.21.15.7:43010) 2024-09-13T15:05:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.720+0000 7f3ec7400640 1 -- 172.21.15.7:0/2136806438 learned_addr learned my addr 172.21.15.7:0/2136806438 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.720+0000 7f3ecca00640 1 -- 172.21.15.7:0/2136806438 >> v2:172.21.15.77:3300/0 conn(0x7f3ec80c9f30 msgr2=0x7f3ec806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:05:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.720+0000 7f3ecca00640 1 --2- 172.21.15.7:0/2136806438 >> v2:172.21.15.77:3300/0 conn(0x7f3ec80c9f30 0x7f3ec806db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.720+0000 7f3ecca00640 1 -- 172.21.15.7:0/2136806438 >> v1:172.21.15.77:6789/0 conn(0x7f3ec8153170 legacy=0x7f3ec80c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.720+0000 7f3ecca00640 1 -- 172.21.15.7:0/2136806438 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec815cad0 con 0x7f3ec8159590 2024-09-13T15:05:32.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.720+0000 7f3ec6a00640 1 -- 172.21.15.7:0/2136806438 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114010420 0 0) 0x7f3ec815c7f0 con 0x7f3ec8153170 2024-09-13T15:05:32.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.724+0000 7f3ecca00640 1 --2- 172.21.15.7:0/2136806438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ec8159590 0x7f3ec8159a00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3ec806d370 tx=0x7f3ec001f140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c83babd46a4692f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:32.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.724+0000 7f3ec6a00640 1 -- 172.21.15.7:0/2136806438 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec00af600 con 0x7f3ec8159590 2024-09-13T15:05:32.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.724+0000 7f3ec6a00640 1 -- 172.21.15.7:0/2136806438 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec00ab050 con 0x7f3ec8159590 2024-09-13T15:05:32.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.724+0000 7f3ec6a00640 1 -- 172.21.15.7:0/2136806438 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec00af980 con 0x7f3ec8159590 2024-09-13T15:05:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.724+0000 7f3ecd400640 1 -- 172.21.15.7:0/2136806438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ec8159590 msgr2=0x7f3ec8159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.724+0000 7f3ecd400640 1 --2- 172.21.15.7:0/2136806438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ec8159590 0x7f3ec8159a00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3ec806d370 tx=0x7f3ec001f140 comp rx=0 tx=0).stop 2024-09-13T15:05:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.724+0000 7f3ecd400640 1 -- 172.21.15.7:0/2136806438 shutdown_connections 2024-09-13T15:05:32.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.724+0000 7f3ecd400640 1 --2- 172.21.15.7:0/2136806438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ec8159590 0x7f3ec8159a00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:32.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.724+0000 7f3ecd400640 1 --2- 172.21.15.7:0/2136806438 >> v2:172.21.15.77:3300/0 conn(0x7f3ec80c9f30 0x7f3ec806db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:32.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.724+0000 7f3ecd400640 1 -- 172.21.15.7:0/2136806438 >> 172.21.15.7:0/2136806438 conn(0x7f3ec8065d40 msgr2=0x7f3ec8066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:32.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.724+0000 7f3ecd400640 1 -- 172.21.15.7:0/2136806438 shutdown_connections 2024-09-13T15:05:32.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.724+0000 7f3ecd400640 1 -- 172.21.15.7:0/2136806438 wait complete. 2024-09-13T15:05:32.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.728+0000 7f3ecd400640 1 Processor -- start 2024-09-13T15:05:32.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.728+0000 7f3ecd400640 1 -- start start 2024-09-13T15:05:32.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.728+0000 7f3ecd400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ec80c9f30 0x7f3ec80c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:32.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.728+0000 7f3ecd400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ec8153170 0x7f3ec80c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:32.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.728+0000 7f3ecd400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ec8159590 0x7f3ec80c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:32.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.728+0000 7f3ecd400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80c6090 con 0x7f3ec8153170 2024-09-13T15:05:32.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.728+0000 7f3ecd400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec8158d20 con 0x7f3ec80c9f30 2024-09-13T15:05:32.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.728+0000 7f3ecd400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec80c3ff0 con 0x7f3ec8159590 2024-09-13T15:05:32.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.732+0000 7f3ecca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ec8159590 0x7f3ec80c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:32.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.732+0000 7f3ec7400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ec8153170 0x7f3ec80c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:32.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.732+0000 7f3ecca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ec8159590 0x7f3ec80c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:60538/0 (socket says 172.21.15.7:60538) 2024-09-13T15:05:32.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.732+0000 7f3ec7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ec80c9f30 0x7f3ec80c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:32.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.732+0000 7f3ecca00640 1 -- 172.21.15.7:0/3740385550 learned_addr learned my addr 172.21.15.7:0/3740385550 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:05:32.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.732+0000 7f3ecca00640 1 -- 172.21.15.7:0/3740385550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ec80c9f30 msgr2=0x7f3ec80c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:32.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.732+0000 7f3ecca00640 1 --2- 172.21.15.7:0/3740385550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ec80c9f30 0x7f3ec80c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:32.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.732+0000 7f3ecca00640 1 -- 172.21.15.7:0/3740385550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ec8153170 msgr2=0x7f3ec80c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:32.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.732+0000 7f3ecca00640 1 --2- 172.21.15.7:0/3740385550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ec8153170 0x7f3ec80c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:32.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.732+0000 7f3ecca00640 1 -- 172.21.15.7:0/3740385550 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec0009a70 con 0x7f3ec8159590 2024-09-13T15:05:32.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.732+0000 7f3ecca00640 1 --2- 172.21.15.7:0/3740385550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ec8159590 0x7f3ec80c5b50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ec00b2040 tx=0x7f3ec001bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:32.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.732+0000 7f3ebfe00640 1 -- 172.21.15.7:0/3740385550 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec00b9610 con 0x7f3ec8159590 2024-09-13T15:05:32.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.732+0000 7f3ebfe00640 1 -- 172.21.15.7:0/3740385550 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec00b9770 con 0x7f3ec8159590 2024-09-13T15:05:32.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.732+0000 7f3ebfe00640 1 -- 172.21.15.7:0/3740385550 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec00b9b20 con 0x7f3ec8159590 2024-09-13T15:05:32.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.732+0000 7f3ecd400640 1 -- 172.21.15.7:0/3740385550 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec80c42d0 con 0x7f3ec8159590 2024-09-13T15:05:32.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.732+0000 7f3ecd400640 1 -- 172.21.15.7:0/3740385550 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec81f25a0 con 0x7f3ec8159590 2024-09-13T15:05:32.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.732+0000 7f3ecd400640 1 -- 172.21.15.7:0/3740385550 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec80c2470 con 0x7f3ec8159590 2024-09-13T15:05:32.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.736+0000 7f3ebfe00640 1 -- 172.21.15.7:0/3740385550 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3ec00b6050 con 0x7f3ec8159590 2024-09-13T15:05:32.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.736+0000 7f3ebfe00640 1 --2- 172.21.15.7:0/3740385550 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3ea8066690 0x7f3ea8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:05:32.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.740+0000 7f3ebfe00640 1 -- 172.21.15.7:0/3740385550 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f3ec0123080 con 0x7f3ec8159590 2024-09-13T15:05:32.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.740+0000 7f3ec7e00640 1 --2- 172.21.15.7:0/3740385550 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3ea8066690 0x7f3ea8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:05:32.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.740+0000 7f3ec7e00640 1 --2- 172.21.15.7:0/3740385550 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3ea8066690 0x7f3ea8068b50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8000f70 tx=0x7f3eb8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:05:32.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:32.748+0000 7f3ebfe00640 1 -- 172.21.15.7:0/3740385550 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3ec00f0220 con 0x7f3ec8159590 2024-09-13T15:05:33.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:33.148+0000 7f3ecd400640 1 -- 172.21.15.7:0/3740385550 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ec80c2470 con 0x7f3ec8159590 2024-09-13T15:05:33.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:33.152+0000 7f3ebfe00640 1 -- 172.21.15.7:0/3740385550 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+6301 (secure 0 0 0) 0x7f3ec80c2470 con 0x7f3ec8159590 2024-09-13T15:05:33.154 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:05:33.154 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:05:28.769591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4220":{"gid":4220,"name":"b","rank":4,"incarnation":19,"state":"up:active","state_seq":61,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:05:33.154 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-13T15:05:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:33.152+0000 7f3ecd400640 1 -- 172.21.15.7:0/3740385550 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3ea8066690 msgr2=0x7f3ea8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:33.152+0000 7f3ecd400640 1 --2- 172.21.15.7:0/3740385550 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3ea8066690 0x7f3ea8068b50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8000f70 tx=0x7f3eb8009040 comp rx=0 tx=0).stop 2024-09-13T15:05:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:33.152+0000 7f3ecd400640 1 -- 172.21.15.7:0/3740385550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ec8159590 msgr2=0x7f3ec80c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:05:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:33.152+0000 7f3ecd400640 1 --2- 172.21.15.7:0/3740385550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ec8159590 0x7f3ec80c5b50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3ec00b2040 tx=0x7f3ec001bee0 comp rx=0 tx=0).stop 2024-09-13T15:05:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:33.152+0000 7f3ecd400640 1 -- 172.21.15.7:0/3740385550 shutdown_connections 2024-09-13T15:05:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:33.152+0000 7f3ecd400640 1 --2- 172.21.15.7:0/3740385550 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3ea8066690 0x7f3ea8068b50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:33.152+0000 7f3ecd400640 1 --2- 172.21.15.7:0/3740385550 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3ec8159590 0x7f3ec80c5b50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:33.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:33.152+0000 7f3ecd400640 1 --2- 172.21.15.7:0/3740385550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ec8153170 0x7f3ec80c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:33.152+0000 7f3ecd400640 1 --2- 172.21.15.7:0/3740385550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ec80c9f30 0x7f3ec80c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:05:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:33.152+0000 7f3ecd400640 1 -- 172.21.15.7:0/3740385550 >> 172.21.15.7:0/3740385550 conn(0x7f3ec8065d40 msgr2=0x7f3ec806ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:05:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:33.156+0000 7f3ecd400640 1 -- 172.21.15.7:0/3740385550 shutdown_connections 2024-09-13T15:05:33.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:05:33.156+0000 7f3ecd400640 1 -- 172.21.15.7:0/3740385550 wait complete. 2024-09-13T15:05:33.185 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e reported in up:standby state 2024-09-13T15:05:33.185 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 85 secs before thrashing 2024-09-13T15:05:43.544 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:05:43.549 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:05:57.982 INFO:tasks.workunit.client.0.smithi007.stderr:Updating files: 63% (8098/12697) Updating files: 64% (8127/12697) Updating files: 65% (8254/12697) Updating files: 66% (8381/12697) Updating files: 67% (8507/12697) Updating files: 68% (8634/12697) Updating files: 69% (8761/12697) Updating files: 70% (8888/12697) Updating files: 71% (9015/12697) Updating files: 72% (9142/12697) Updating files: 73% (9269/12697) Updating files: 74% (9396/12697) Updating files: 75% (9523/12697) Updating files: 76% (9650/12697) Updating files: 77% (9777/12697) Updating files: 78% (9904/12697) Updating files: 79% (10031/12697) Updating files: 80% (10158/12697) Updating files: 81% (10285/12697) Updating files: 82% (10412/12697) Updating files: 83% (10539/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-13T15:05:58.818 INFO:tasks.workunit.client.0.smithi007.stderr:Note: switching to '50bbe7f395997dcd871813949c49addbbf630361'. 2024-09-13T15:05:58.818 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-13T15:05:58.818 INFO:tasks.workunit.client.0.smithi007.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T15:05:58.818 INFO:tasks.workunit.client.0.smithi007.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T15:05:58.819 INFO:tasks.workunit.client.0.smithi007.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T15:05:58.819 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-13T15:05:58.819 INFO:tasks.workunit.client.0.smithi007.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T15:05:58.819 INFO:tasks.workunit.client.0.smithi007.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T15:05:58.819 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-13T15:05:58.819 INFO:tasks.workunit.client.0.smithi007.stderr: git switch -c 2024-09-13T15:05:58.819 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-13T15:05:58.819 INFO:tasks.workunit.client.0.smithi007.stderr:Or undo this operation with: 2024-09-13T15:05:58.819 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-13T15:05:58.819 INFO:tasks.workunit.client.0.smithi007.stderr: git switch - 2024-09-13T15:05:58.819 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-13T15:05:58.819 INFO:tasks.workunit.client.0.smithi007.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T15:05:58.819 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-13T15:05:58.820 INFO:tasks.workunit.client.0.smithi007.stderr:HEAD is now at 50bbe7f3959 Merge PR #58789 into wip-rishabh-testing-20240910.095512-reef 2024-09-13T15:05:58.835 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T15:05:58.844 INFO:tasks.workunit.client.0.smithi007.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T15:05:58.847 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T15:05:58.847 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T15:05:59.589 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T15:05:59.688 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T15:05:59.748 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T15:05:59.750 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T15:05:59.750 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T15:05:59.805 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T15:05:59.810 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:05:59.810 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T15:05:59.865 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-09-13T15:05:59.867 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-13T15:05:59.867 DEBUG:teuthology.orchestra.run.smithi007:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=50bbe7f395997dcd871813949c49addbbf630361 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-13T15:05:59.941 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into 'ffsb'... 2024-09-13T15:06:01.914 INFO:tasks.workunit.client.0.smithi007.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-13T15:06:02.925 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether build environment is sane... yes 2024-09-13T15:06:02.942 INFO:tasks.workunit.client.0.smithi007.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-13T15:06:02.943 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gawk... gawk 2024-09-13T15:06:02.966 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether make sets $(MAKE)... yes 2024-09-13T15:06:03.033 INFO:tasks.workunit.client.0.smithi007.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-13T15:06:03.033 INFO:tasks.workunit.client.0.smithi007.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-13T15:06:03.048 INFO:tasks.workunit.client.0.smithi007.stdout:checking for style of include used by make... GNU 2024-09-13T15:06:03.053 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gcc... gcc 2024-09-13T15:06:03.137 INFO:tasks.workunit.client.0.smithi007.stdout:checking for C compiler default output file name... a.out 2024-09-13T15:06:03.141 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether the C compiler works... yes 2024-09-13T15:06:03.144 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether we are cross compiling... no 2024-09-13T15:06:03.195 INFO:tasks.workunit.client.0.smithi007.stdout:checking for suffix of executables... 2024-09-13T15:06:03.240 INFO:tasks.workunit.client.0.smithi007.stdout:checking for suffix of object files... o 2024-09-13T15:06:03.280 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether we are using the GNU C compiler... yes 2024-09-13T15:06:03.320 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether gcc accepts -g... yes 2024-09-13T15:06:03.400 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-13T15:06:03.511 INFO:tasks.workunit.client.0.smithi007.stdout:checking dependency style of gcc... gcc3 2024-09-13T15:06:03.583 INFO:tasks.workunit.client.0.smithi007.stdout:checking how to run the C preprocessor... gcc -E 2024-09-13T15:06:03.643 INFO:tasks.workunit.client.0.smithi007.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-13T15:06:03.646 INFO:tasks.workunit.client.0.smithi007.stdout:checking for egrep... /usr/bin/grep -E 2024-09-13T15:06:03.661 INFO:tasks.workunit.client.0.smithi007.stdout:checking for AIX... no 2024-09-13T15:06:03.678 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gcc... (cached) gcc 2024-09-13T15:06:03.695 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-13T15:06:03.696 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-13T15:06:03.696 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-13T15:06:03.696 INFO:tasks.workunit.client.0.smithi007.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-13T15:06:03.780 INFO:tasks.workunit.client.0.smithi007.stdout:checking for main in -lm... yes 2024-09-13T15:06:03.849 INFO:tasks.workunit.client.0.smithi007.stdout:checking for main in -lpthread... yes 2024-09-13T15:06:04.088 INFO:tasks.workunit.client.0.smithi007.stdout:checking for ANSI C header files... yes 2024-09-13T15:06:04.149 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-13T15:06:04.213 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/types.h... yes 2024-09-13T15:06:04.283 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/stat.h... yes 2024-09-13T15:06:04.352 INFO:tasks.workunit.client.0.smithi007.stdout:checking for stdlib.h... yes 2024-09-13T15:06:04.422 INFO:tasks.workunit.client.0.smithi007.stdout:checking for string.h... yes 2024-09-13T15:06:04.493 INFO:tasks.workunit.client.0.smithi007.stdout:checking for memory.h... yes 2024-09-13T15:06:04.564 INFO:tasks.workunit.client.0.smithi007.stdout:checking for strings.h... yes 2024-09-13T15:06:04.843 INFO:tasks.workunit.client.0.smithi007.stdout:checking for inttypes.h... yes 2024-09-13T15:06:04.918 INFO:tasks.workunit.client.0.smithi007.stdout:checking for stdint.h... yes 2024-09-13T15:06:05.005 INFO:tasks.workunit.client.0.smithi007.stdout:checking for unistd.h... yes 2024-09-13T15:06:05.984 INFO:tasks.workunit.client.0.smithi007.stdout:checking pthread.h usability... yes 2024-09-13T15:06:06.021 INFO:tasks.workunit.client.0.smithi007.stdout:checking pthread.h presence... yes 2024-09-13T15:06:06.021 INFO:tasks.workunit.client.0.smithi007.stdout:checking for pthread.h... yes 2024-09-13T15:06:06.133 INFO:tasks.workunit.client.0.smithi007.stdout:checking fcntl.h usability... yes 2024-09-13T15:06:06.347 INFO:tasks.workunit.client.0.smithi007.stdout:checking fcntl.h presence... yes 2024-09-13T15:06:06.348 INFO:tasks.workunit.client.0.smithi007.stdout:checking for fcntl.h... yes 2024-09-13T15:06:07.135 INFO:tasks.workunit.client.0.smithi007.stdout:checking limits.h usability... yes 2024-09-13T15:06:07.164 INFO:tasks.workunit.client.0.smithi007.stdout:checking limits.h presence... yes 2024-09-13T15:06:07.166 INFO:tasks.workunit.client.0.smithi007.stdout:checking for limits.h... yes 2024-09-13T15:06:07.189 INFO:tasks.workunit.client.0.smithi007.stdout:checking for stdint.h... (cached) yes 2024-09-13T15:06:07.503 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/time.h usability... yes 2024-09-13T15:06:07.533 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/time.h presence... yes 2024-09-13T15:06:07.534 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/time.h... yes 2024-09-13T15:06:07.558 INFO:tasks.workunit.client.0.smithi007.stdout:checking for unistd.h... (cached) yes 2024-09-13T15:06:07.625 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/vfs.h usability... yes 2024-09-13T15:06:07.653 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/vfs.h presence... yes 2024-09-13T15:06:07.654 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/vfs.h... yes 2024-09-13T15:06:07.737 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/limits.h usability... no 2024-09-13T15:06:07.765 INFO:tasks.workunit.client.0.smithi007.stdout:checking sys/limits.h presence... no 2024-09-13T15:06:07.766 INFO:tasks.workunit.client.0.smithi007.stdout:checking for sys/limits.h... no 2024-09-13T15:06:07.810 INFO:tasks.workunit.client.0.smithi007.stdout:checking for an ANSI C-conforming const... yes 2024-09-13T15:06:07.855 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-13T15:06:07.857 INFO:tasks.workunit.client.0.smithi007.stdout:checking for function prototypes... yes 2024-09-13T15:06:08.611 INFO:tasks.workunit.client.0.smithi007.stdout:checking whether setvbuf arguments are reversed... no 2024-09-13T15:06:08.713 INFO:tasks.workunit.client.0.smithi007.stdout:checking for system... yes 2024-09-13T15:06:08.805 INFO:tasks.workunit.client.0.smithi007.stdout:checking for gettimeofday... yes 2024-09-13T15:06:08.900 INFO:tasks.workunit.client.0.smithi007.stdout:checking for mkdir... yes 2024-09-13T15:06:08.994 INFO:tasks.workunit.client.0.smithi007.stdout:checking for strerror... yes 2024-09-13T15:06:09.086 INFO:tasks.workunit.client.0.smithi007.stdout:checking for open64... yes 2024-09-13T15:06:09.176 INFO:tasks.workunit.client.0.smithi007.stdout:checking for stat64... yes 2024-09-13T15:06:09.268 INFO:tasks.workunit.client.0.smithi007.stdout:checking for fseeko64... yes 2024-09-13T15:06:09.358 INFO:tasks.workunit.client.0.smithi007.stdout:checking for lrand48_r... yes 2024-09-13T15:06:09.450 INFO:tasks.workunit.client.0.smithi007.stdout:checking for srand48_r... yes 2024-09-13T15:06:09.499 INFO:tasks.workunit.client.0.smithi007.stdout:configure: creating ./config.status 2024-09-13T15:06:09.688 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: creating Makefile 2024-09-13T15:06:09.716 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: creating config.h 2024-09-13T15:06:09.744 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: executing depfiles commands 2024-09-13T15:06:09.822 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: executing default commands 2024-09-13T15:06:10.132 INFO:tasks.workunit.client.0.smithi007.stdout: cd . && /bin/bash /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-13T15:06:10.134 INFO:tasks.workunit.client.0.smithi007.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-13T15:06:10.136 INFO:tasks.workunit.client.0.smithi007.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-13T15:06:10.136 INFO:tasks.workunit.client.0.smithi007.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-13T15:06:10.136 INFO:tasks.workunit.client.0.smithi007.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-13T15:06:10.136 INFO:tasks.workunit.client.0.smithi007.stderr: Grab them from any GNU archive site. 2024-09-13T15:06:10.708 INFO:tasks.workunit.client.0.smithi007.stdout: cd . && /bin/bash ./config.status Makefile depfiles 2024-09-13T15:06:11.206 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: creating Makefile 2024-09-13T15:06:11.235 INFO:tasks.workunit.client.0.smithi007.stdout:config.status: executing depfiles commands 2024-09-13T15:06:11.288 INFO:tasks.workunit.client.0.smithi007.stdout:make all-am 2024-09-13T15:06:11.293 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-13T15:06:11.293 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-13T15:06:11.489 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-13T15:06:11.494 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-13T15:06:11.595 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-13T15:06:11.826 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-13T15:06:11.934 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-13T15:06:11.939 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-13T15:06:12.060 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-13T15:06:12.067 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-13T15:06:12.221 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-13T15:06:12.226 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-13T15:06:12.290 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-13T15:06:12.295 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-13T15:06:12.346 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-13T15:06:12.351 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-13T15:06:12.410 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-13T15:06:12.415 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-13T15:06:12.640 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-13T15:06:12.645 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-13T15:06:12.785 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-13T15:06:12.790 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-13T15:06:12.982 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-13T15:06:12.987 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-13T15:06:13.071 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-13T15:06:13.077 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-13T15:06:13.113 INFO:tasks.workunit.client.0.smithi007.stderr:ffsb_op.c: In function 'print_op_results': 2024-09-13T15:06:13.113 INFO:tasks.workunit.client.0.smithi007.stderr:ffsb_op.c:83:37: warning: embedded '\0' in format [-Wformat-contains-nul] 2024-09-13T15:06:13.114 INFO:tasks.workunit.client.0.smithi007.stderr: 83 | sprintf(buf, "%s/sec\0", buf); 2024-09-13T15:06:13.114 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~ 2024-09-13T15:06:13.114 INFO:tasks.workunit.client.0.smithi007.stderr:ffsb_op.c:86:33: warning: embedded '\0' in format [-Wformat-contains-nul] 2024-09-13T15:06:13.114 INFO:tasks.workunit.client.0.smithi007.stderr: 86 | sprintf(buf, "NA\0"); 2024-09-13T15:06:13.114 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~ 2024-09-13T15:06:13.129 INFO:tasks.workunit.client.0.smithi007.stderr:ffsb_op.c: In function 'print_results': 2024-09-13T15:06:13.129 INFO:tasks.workunit.client.0.smithi007.stderr:ffsb_op.c:83:33: warning: '/sec' directive writing 4 bytes into a region of size between 1 and 256 [-Wformat-overflow=] 2024-09-13T15:06:13.130 INFO:tasks.workunit.client.0.smithi007.stderr: 83 | sprintf(buf, "%s/sec\0", buf); 2024-09-13T15:06:13.130 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~ 2024-09-13T15:06:13.130 INFO:tasks.workunit.client.0.smithi007.stderr:In file included from /usr/include/stdio.h:894, 2024-09-13T15:06:13.130 INFO:tasks.workunit.client.0.smithi007.stderr: from ffsb_op.c:20: 2024-09-13T15:06:13.130 INFO:tasks.workunit.client.0.smithi007.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:38:10: note: '__builtin___sprintf_chk' output between 5 and 260 bytes into a destination of size 256 2024-09-13T15:06:13.130 INFO:tasks.workunit.client.0.smithi007.stderr: 38 | return __builtin___sprintf_chk (__s, __USE_FORTIFY_LEVEL - 1, 2024-09-13T15:06:13.130 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-13T15:06:13.130 INFO:tasks.workunit.client.0.smithi007.stderr: 39 | __glibc_objsize (__s), __fmt, 2024-09-13T15:06:13.130 INFO:tasks.workunit.client.0.smithi007.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-13T15:06:13.130 INFO:tasks.workunit.client.0.smithi007.stderr: 40 | __va_arg_pack ()); 2024-09-13T15:06:13.130 INFO:tasks.workunit.client.0.smithi007.stderr: | ~~~~~~~~~~~~~~~~~ 2024-09-13T15:06:13.167 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-13T15:06:13.173 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-13T15:06:13.302 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-13T15:06:13.307 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-13T15:06:13.349 INFO:tasks.workunit.client.0.smithi007.stderr:In file included from parser.h:22, 2024-09-13T15:06:13.349 INFO:tasks.workunit.client.0.smithi007.stderr: from parser.c:25: 2024-09-13T15:06:13.349 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c: In function 'init_filesys': 2024-09-13T15:06:13.349 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-13T15:06:13.349 INFO:tasks.workunit.client.0.smithi007.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-13T15:06:13.349 INFO:tasks.workunit.client.0.smithi007.stderr: | ^ 2024-09-13T15:06:13.349 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-09-13T15:06:13.349 INFO:tasks.workunit.client.0.smithi007.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-13T15:06:13.349 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~ 2024-09-13T15:06:13.349 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-09-13T15:06:13.350 INFO:tasks.workunit.client.0.smithi007.stderr: 36 | container_of(ptr, type, member) 2024-09-13T15:06:13.350 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~ 2024-09-13T15:06:13.350 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-09-13T15:06:13.350 INFO:tasks.workunit.client.0.smithi007.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-13T15:06:13.350 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~ 2024-09-13T15:06:13.350 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:934:17: note: in expansion of macro 'list_for_each_entry' 2024-09-13T15:06:13.350 INFO:tasks.workunit.client.0.smithi007.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-13T15:06:13.350 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-13T15:06:13.351 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-13T15:06:13.351 INFO:tasks.workunit.client.0.smithi007.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-13T15:06:13.352 INFO:tasks.workunit.client.0.smithi007.stderr: | ^ 2024-09-13T15:06:13.352 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-09-13T15:06:13.352 INFO:tasks.workunit.client.0.smithi007.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-13T15:06:13.352 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~ 2024-09-13T15:06:13.352 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-09-13T15:06:13.352 INFO:tasks.workunit.client.0.smithi007.stderr: 36 | container_of(ptr, type, member) 2024-09-13T15:06:13.352 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~ 2024-09-13T15:06:13.352 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-09-13T15:06:13.352 INFO:tasks.workunit.client.0.smithi007.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-13T15:06:13.352 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~ 2024-09-13T15:06:13.353 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:934:17: note: in expansion of macro 'list_for_each_entry' 2024-09-13T15:06:13.353 INFO:tasks.workunit.client.0.smithi007.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-13T15:06:13.353 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-13T15:06:13.353 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-13T15:06:13.353 INFO:tasks.workunit.client.0.smithi007.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-13T15:06:13.353 INFO:tasks.workunit.client.0.smithi007.stderr: | ^ 2024-09-13T15:06:13.353 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-09-13T15:06:13.353 INFO:tasks.workunit.client.0.smithi007.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-13T15:06:13.353 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~ 2024-09-13T15:06:13.353 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-09-13T15:06:13.353 INFO:tasks.workunit.client.0.smithi007.stderr: 36 | container_of(ptr, type, member) 2024-09-13T15:06:13.354 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~ 2024-09-13T15:06:13.354 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-09-13T15:06:13.354 INFO:tasks.workunit.client.0.smithi007.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-13T15:06:13.354 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~ 2024-09-13T15:06:13.354 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:941:17: note: in expansion of macro 'list_for_each_entry' 2024-09-13T15:06:13.354 INFO:tasks.workunit.client.0.smithi007.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-13T15:06:13.354 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-13T15:06:13.354 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-13T15:06:13.354 INFO:tasks.workunit.client.0.smithi007.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-13T15:06:13.354 INFO:tasks.workunit.client.0.smithi007.stderr: | ^ 2024-09-13T15:06:13.354 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-09-13T15:06:13.354 INFO:tasks.workunit.client.0.smithi007.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-13T15:06:13.354 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~ 2024-09-13T15:06:13.355 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-09-13T15:06:13.355 INFO:tasks.workunit.client.0.smithi007.stderr: 36 | container_of(ptr, type, member) 2024-09-13T15:06:13.355 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~ 2024-09-13T15:06:13.355 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-09-13T15:06:13.355 INFO:tasks.workunit.client.0.smithi007.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-13T15:06:13.355 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~ 2024-09-13T15:06:13.355 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:941:17: note: in expansion of macro 'list_for_each_entry' 2024-09-13T15:06:13.355 INFO:tasks.workunit.client.0.smithi007.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-13T15:06:13.355 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-13T15:06:13.356 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c: In function 'init_tg_stats': 2024-09-13T15:06:13.356 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-13T15:06:13.356 INFO:tasks.workunit.client.0.smithi007.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-13T15:06:13.356 INFO:tasks.workunit.client.0.smithi007.stderr: | ^ 2024-09-13T15:06:13.356 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-09-13T15:06:13.356 INFO:tasks.workunit.client.0.smithi007.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-13T15:06:13.356 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~ 2024-09-13T15:06:13.356 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-09-13T15:06:13.356 INFO:tasks.workunit.client.0.smithi007.stderr: 36 | container_of(ptr, type, member) 2024-09-13T15:06:13.356 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~ 2024-09-13T15:06:13.356 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-09-13T15:06:13.356 INFO:tasks.workunit.client.0.smithi007.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-13T15:06:13.356 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~ 2024-09-13T15:06:13.356 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:971:41: note: in expansion of macro 'list_for_each_entry' 2024-09-13T15:06:13.357 INFO:tasks.workunit.client.0.smithi007.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-13T15:06:13.357 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-13T15:06:13.357 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-13T15:06:13.357 INFO:tasks.workunit.client.0.smithi007.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-13T15:06:13.357 INFO:tasks.workunit.client.0.smithi007.stderr: | ^ 2024-09-13T15:06:13.357 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-09-13T15:06:13.357 INFO:tasks.workunit.client.0.smithi007.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-13T15:06:13.357 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~ 2024-09-13T15:06:13.357 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-09-13T15:06:13.357 INFO:tasks.workunit.client.0.smithi007.stderr: 36 | container_of(ptr, type, member) 2024-09-13T15:06:13.357 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~ 2024-09-13T15:06:13.357 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-09-13T15:06:13.357 INFO:tasks.workunit.client.0.smithi007.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-13T15:06:13.358 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~ 2024-09-13T15:06:13.358 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:971:41: note: in expansion of macro 'list_for_each_entry' 2024-09-13T15:06:13.358 INFO:tasks.workunit.client.0.smithi007.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-13T15:06:13.358 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-13T15:06:13.358 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-13T15:06:13.358 INFO:tasks.workunit.client.0.smithi007.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-13T15:06:13.358 INFO:tasks.workunit.client.0.smithi007.stderr: | ^ 2024-09-13T15:06:13.358 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-09-13T15:06:13.358 INFO:tasks.workunit.client.0.smithi007.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-13T15:06:13.358 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~ 2024-09-13T15:06:13.358 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-09-13T15:06:13.358 INFO:tasks.workunit.client.0.smithi007.stderr: 36 | container_of(ptr, type, member) 2024-09-13T15:06:13.358 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~ 2024-09-13T15:06:13.358 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:39:20: note: in expansion of macro 'list_entry' 2024-09-13T15:06:13.359 INFO:tasks.workunit.client.0.smithi007.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-13T15:06:13.359 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~ 2024-09-13T15:06:13.359 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:980:41: note: in expansion of macro 'list_for_each_entry' 2024-09-13T15:06:13.359 INFO:tasks.workunit.client.0.smithi007.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-13T15:06:13.359 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-13T15:06:13.359 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-13T15:06:13.359 INFO:tasks.workunit.client.0.smithi007.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-13T15:06:13.359 INFO:tasks.workunit.client.0.smithi007.stderr: | ^ 2024-09-13T15:06:13.359 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:33:35: note: in expansion of macro 'offsetof' 2024-09-13T15:06:13.359 INFO:tasks.workunit.client.0.smithi007.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-13T15:06:13.359 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~ 2024-09-13T15:06:13.359 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:36:9: note: in expansion of macro 'container_of' 2024-09-13T15:06:13.359 INFO:tasks.workunit.client.0.smithi007.stderr: 36 | container_of(ptr, type, member) 2024-09-13T15:06:13.360 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~ 2024-09-13T15:06:13.360 INFO:tasks.workunit.client.0.smithi007.stderr:list.h:41:20: note: in expansion of macro 'list_entry' 2024-09-13T15:06:13.360 INFO:tasks.workunit.client.0.smithi007.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-13T15:06:13.360 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~ 2024-09-13T15:06:13.360 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:980:41: note: in expansion of macro 'list_for_each_entry' 2024-09-13T15:06:13.360 INFO:tasks.workunit.client.0.smithi007.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-13T15:06:13.360 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-13T15:06:13.412 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c: In function 'get_optstr': 2024-09-13T15:06:13.412 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:206:23: warning: 'strnlen' specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-13T15:06:13.412 INFO:tasks.workunit.client.0.smithi007.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-13T15:06:13.412 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-13T15:06:13.412 INFO:tasks.workunit.client.0.smithi007.stderr:parser.c:200:14: note: source object declared here 2024-09-13T15:06:13.413 INFO:tasks.workunit.client.0.smithi007.stderr: 200 | char temp[BUFSIZE]; 2024-09-13T15:06:13.413 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~ 2024-09-13T15:06:13.428 INFO:tasks.workunit.client.0.smithi007.stderr:In file included from /usr/include/string.h:535, 2024-09-13T15:06:13.429 INFO:tasks.workunit.client.0.smithi007.stderr: from parser.c:19: 2024-09-13T15:06:13.429 INFO:tasks.workunit.client.0.smithi007.stderr:In function 'memcpy', 2024-09-13T15:06:13.429 INFO:tasks.workunit.client.0.smithi007.stderr: inlined from 'size64_convert' at parser.c:119:2: 2024-09-13T15:06:13.429 INFO:tasks.workunit.client.0.smithi007.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:29:10: warning: '__builtin_memcpy' reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-13T15:06:13.429 INFO:tasks.workunit.client.0.smithi007.stderr: 29 | return __builtin___memcpy_chk (__dest, __src, __len, 2024-09-13T15:06:13.429 INFO:tasks.workunit.client.0.smithi007.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-13T15:06:13.429 INFO:tasks.workunit.client.0.smithi007.stderr: 30 | __glibc_objsize0 (__dest)); 2024-09-13T15:06:13.429 INFO:tasks.workunit.client.0.smithi007.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-13T15:06:13.614 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:06:13.618 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:06:13.732 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-13T15:06:13.737 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-13T15:06:13.809 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-13T15:06:13.814 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-13T15:06:13.922 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-13T15:06:13.928 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-13T15:06:13.965 INFO:tasks.workunit.client.0.smithi007.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-13T15:06:14.444 INFO:tasks.workunit.client.0.smithi007.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-13T15:06:14.499 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-13T15:06:14.504 INFO:tasks.workunit.client.0.smithi007.stdout:FFSB version 6.0-RC2~fork started 2024-09-13T15:06:14.504 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:06:14.510 INFO:tasks.workunit.client.0.smithi007.stdout:benchmark time = 300 2024-09-13T15:06:14.510 INFO:tasks.workunit.client.0.smithi007.stdout:ThreadGroup 0 2024-09-13T15:06:14.510 INFO:tasks.workunit.client.0.smithi007.stdout:================ 2024-09-13T15:06:14.510 INFO:tasks.workunit.client.0.smithi007.stdout: num_threads = 32 2024-09-13T15:06:14.510 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:06:14.511 INFO:tasks.workunit.client.0.smithi007.stdout: read_random = off 2024-09-13T15:06:14.511 INFO:tasks.workunit.client.0.smithi007.stdout: read_size = 0 (0B) 2024-09-13T15:06:14.511 INFO:tasks.workunit.client.0.smithi007.stdout: read_blocksize = 0 (0B) 2024-09-13T15:06:14.511 INFO:tasks.workunit.client.0.smithi007.stdout: read_skip = off 2024-09-13T15:06:14.511 INFO:tasks.workunit.client.0.smithi007.stdout: read_skipsize = 0 (0B) 2024-09-13T15:06:14.511 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:06:14.511 INFO:tasks.workunit.client.0.smithi007.stdout: write_random = on 2024-09-13T15:06:14.511 INFO:tasks.workunit.client.0.smithi007.stdout: write_size = 5242880 (5MB) 2024-09-13T15:06:14.511 INFO:tasks.workunit.client.0.smithi007.stdout: fsync_file = 0 2024-09-13T15:06:14.511 INFO:tasks.workunit.client.0.smithi007.stdout: write_blocksize = 4096 (4KB) 2024-09-13T15:06:14.511 INFO:tasks.workunit.client.0.smithi007.stdout: wait time = 0 2024-09-13T15:06:14.511 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:06:14.511 INFO:tasks.workunit.client.0.smithi007.stdout: op weights 2024-09-13T15:06:14.511 INFO:tasks.workunit.client.0.smithi007.stdout: read = 0 (0.00%) 2024-09-13T15:06:14.511 INFO:tasks.workunit.client.0.smithi007.stdout: readall = 0 (0.00%) 2024-09-13T15:06:14.511 INFO:tasks.workunit.client.0.smithi007.stdout: write = 1 (100.00%) 2024-09-13T15:06:14.512 INFO:tasks.workunit.client.0.smithi007.stdout: create = 0 (0.00%) 2024-09-13T15:06:14.512 INFO:tasks.workunit.client.0.smithi007.stdout: append = 0 (0.00%) 2024-09-13T15:06:14.512 INFO:tasks.workunit.client.0.smithi007.stdout: delete = 0 (0.00%) 2024-09-13T15:06:14.512 INFO:tasks.workunit.client.0.smithi007.stdout: metaop = 0 (0.00%) 2024-09-13T15:06:14.512 INFO:tasks.workunit.client.0.smithi007.stdout: createdir = 0 (0.00%) 2024-09-13T15:06:14.512 INFO:tasks.workunit.client.0.smithi007.stdout: stat = 0 (0.00%) 2024-09-13T15:06:14.512 INFO:tasks.workunit.client.0.smithi007.stdout: writeall = 0 (0.00%) 2024-09-13T15:06:14.512 INFO:tasks.workunit.client.0.smithi007.stdout: writeall_fsync = 0 (0.00%) 2024-09-13T15:06:14.512 INFO:tasks.workunit.client.0.smithi007.stdout: open_close = 0 (0.00%) 2024-09-13T15:06:14.512 INFO:tasks.workunit.client.0.smithi007.stdout: write_fsync = 0 (0.00%) 2024-09-13T15:06:14.512 INFO:tasks.workunit.client.0.smithi007.stdout: create_fsync = 0 (0.00%) 2024-09-13T15:06:14.512 INFO:tasks.workunit.client.0.smithi007.stdout: append_fsync = 0 (0.00%) 2024-09-13T15:06:14.512 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:06:14.512 INFO:tasks.workunit.client.0.smithi007.stdout:FileSystem . 2024-09-13T15:06:14.513 INFO:tasks.workunit.client.0.smithi007.stdout:========== 2024-09-13T15:06:14.513 INFO:tasks.workunit.client.0.smithi007.stdout: num_dirs = 0 2024-09-13T15:06:14.513 INFO:tasks.workunit.client.0.smithi007.stdout: starting files = 128 2024-09-13T15:06:14.513 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:06:14.513 INFO:tasks.workunit.client.0.smithi007.stdout: min file size = 104857600 (100MB) 2024-09-13T15:06:14.513 INFO:tasks.workunit.client.0.smithi007.stdout: max file size = 104857600 (100MB) 2024-09-13T15:06:14.513 INFO:tasks.workunit.client.0.smithi007.stdout: directio = off 2024-09-13T15:06:14.513 INFO:tasks.workunit.client.0.smithi007.stdout: alignedio = on 2024-09-13T15:06:14.513 INFO:tasks.workunit.client.0.smithi007.stdout: bufferedio = off 2024-09-13T15:06:14.513 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:06:14.513 INFO:tasks.workunit.client.0.smithi007.stdout: aging is off 2024-09-13T15:06:14.514 INFO:tasks.workunit.client.0.smithi007.stdout: current utilization = 0.03% 2024-09-13T15:06:14.514 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:06:14.514 INFO:tasks.workunit.client.0.smithi007.stdout:checking existing fs: . 2024-09-13T15:06:14.514 INFO:tasks.workunit.client.0.smithi007.stdout:recreating new fileset 2024-09-13T15:06:14.514 INFO:tasks.workunit.client.0.smithi007.stderr:opendir: No such file or directory 2024-09-13T15:06:43.758 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:06:43.764 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:06:58.187 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:06:58.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.439+0000 7f757a600640 1 Processor -- start 2024-09-13T15:06:58.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.439+0000 7f757a600640 1 -- start start 2024-09-13T15:06:58.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.439+0000 7f757a600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7574070600 0x7f75740c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:06:58.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.443+0000 7f757a600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75740c7a30 con 0x7f7574066750 2024-09-13T15:06:58.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.443+0000 7f757a600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75740c6b80 con 0x7f75740709e0 2024-09-13T15:06:58.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.443+0000 7f757a600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75740c6e20 con 0x7f7574070600 2024-09-13T15:06:58.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.443+0000 7f7573e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7574066750 0x7f757415c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55044/0 (socket says 172.21.15.7:55044) 2024-09-13T15:06:58.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.443+0000 7f7573e00640 1 -- 172.21.15.7:0/487617920 learned_addr learned my addr 172.21.15.7:0/487617920 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:06:58.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.443+0000 7f7579200640 1 --2- 172.21.15.7:0/487617920 >> v2:172.21.15.7:3300/0 conn(0x7f7574070600 0x7f75740c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:06:58.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.443+0000 7f7579200640 1 -- 172.21.15.7:0/487617920 >> v1:172.21.15.77:6789/0 conn(0x7f75740709e0 legacy=0x7f7574152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:06:58.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.443+0000 7f7579200640 1 -- 172.21.15.7:0/487617920 >> v1:172.21.15.7:6789/0 conn(0x7f7574066750 legacy=0x7f757415c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:06:58.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.443+0000 7f7573400640 1 -- 172.21.15.7:0/487617920 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258238935 0 0) 0x7f75740c7a30 con 0x7f7574066750 2024-09-13T15:06:58.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.443+0000 7f7579200640 1 -- 172.21.15.7:0/487617920 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75740c7100 con 0x7f7574070600 2024-09-13T15:06:58.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.447+0000 7f7579200640 1 --2- 172.21.15.7:0/487617920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7574070600 0x7f75740c7d30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f75680097c0 tx=0x7f756801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bdadd8eecda606 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:06:58.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.447+0000 7f7573400640 1 -- 172.21.15.7:0/487617920 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75680a8950 con 0x7f7574070600 2024-09-13T15:06:58.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.447+0000 7f7573400640 1 -- 172.21.15.7:0/487617920 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75680a8ab0 con 0x7f7574070600 2024-09-13T15:06:58.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.447+0000 7f7573400640 1 -- 172.21.15.7:0/487617920 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75680a8e40 con 0x7f7574070600 2024-09-13T15:06:58.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.447+0000 7f757a600640 1 -- 172.21.15.7:0/487617920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7574070600 msgr2=0x7f75740c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:06:58.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.447+0000 7f757a600640 1 --2- 172.21.15.7:0/487617920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7574070600 0x7f75740c7d30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f75680097c0 tx=0x7f756801ec50 comp rx=0 tx=0).stop 2024-09-13T15:06:58.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.447+0000 7f757a600640 1 -- 172.21.15.7:0/487617920 shutdown_connections 2024-09-13T15:06:58.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.447+0000 7f757a600640 1 --2- 172.21.15.7:0/487617920 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7574070600 0x7f75740c7d30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:06:58.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.447+0000 7f757a600640 1 -- 172.21.15.7:0/487617920 >> 172.21.15.7:0/487617920 conn(0x7f75740c8390 msgr2=0x7f75740c8770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:06:58.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.447+0000 7f757a600640 1 -- 172.21.15.7:0/487617920 shutdown_connections 2024-09-13T15:06:58.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.447+0000 7f757a600640 1 -- 172.21.15.7:0/487617920 wait complete. 2024-09-13T15:06:58.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f757a600640 1 Processor -- start 2024-09-13T15:06:58.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f757a600640 1 -- start start 2024-09-13T15:06:58.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f757a600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7574066750 0x7f757414e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:06:58.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f757a600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7574070600 0x7f75740c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:06:58.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f757a600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75740709e0 0x7f75740c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:06:58.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f757a600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75740bcf50 con 0x7f75740709e0 2024-09-13T15:06:58.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f757a600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75741e47b0 con 0x7f7574066750 2024-09-13T15:06:58.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f757a600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75741e30a0 con 0x7f7574070600 2024-09-13T15:06:58.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f7579c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75740709e0 0x7f75740c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:06:58.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f7579c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75740709e0 0x7f75740c5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39486/0 (socket says 172.21.15.7:39486) 2024-09-13T15:06:58.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f7579c00640 1 -- 172.21.15.7:0/2133779951 learned_addr learned my addr 172.21.15.7:0/2133779951 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:06:58.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f7579200640 1 --2- 172.21.15.7:0/2133779951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7574066750 0x7f757414e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:06:58.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f7573e00640 1 --2- 172.21.15.7:0/2133779951 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7574070600 0x7f75740c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:06:58.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f7579c00640 1 -- 172.21.15.7:0/2133779951 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7574070600 msgr2=0x7f75740c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:06:58.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f7579c00640 1 --2- 172.21.15.7:0/2133779951 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7574070600 0x7f75740c50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:06:58.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f7579c00640 1 -- 172.21.15.7:0/2133779951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7574066750 msgr2=0x7f757414e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:06:58.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f7579c00640 1 --2- 172.21.15.7:0/2133779951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7574066750 0x7f757414e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:06:58.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f7579c00640 1 -- 172.21.15.7:0/2133779951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7568009420 con 0x7f75740709e0 2024-09-13T15:06:58.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f7579c00640 1 --2- 172.21.15.7:0/2133779951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75740709e0 0x7f75740c5600 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f756c00b9e0 tx=0x7f756c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:06:58.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f7570c00640 1 -- 172.21.15.7:0/2133779951 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c00cb20 con 0x7f75740709e0 2024-09-13T15:06:58.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f757a600640 1 -- 172.21.15.7:0/2133779951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75741e3380 con 0x7f75740709e0 2024-09-13T15:06:58.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f7570c00640 1 -- 172.21.15.7:0/2133779951 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c00cc80 con 0x7f75740709e0 2024-09-13T15:06:58.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f7570c00640 1 -- 172.21.15.7:0/2133779951 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c014640 con 0x7f75740709e0 2024-09-13T15:06:58.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.451+0000 7f757a600640 1 -- 172.21.15.7:0/2133779951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75741e3940 con 0x7f75740709e0 2024-09-13T15:06:58.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.455+0000 7f757a600640 1 -- 172.21.15.7:0/2133779951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75741e49d0 con 0x7f75740709e0 2024-09-13T15:06:58.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.455+0000 7f7570c00640 1 -- 172.21.15.7:0/2133779951 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f756c0147a0 con 0x7f75740709e0 2024-09-13T15:06:58.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.455+0000 7f7570c00640 1 --2- 172.21.15.7:0/2133779951 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7558066690 0x7f7558068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:06:58.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.455+0000 7f7570c00640 1 -- 172.21.15.7:0/2133779951 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f756c084500 con 0x7f75740709e0 2024-09-13T15:06:58.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.455+0000 7f7579200640 1 --2- 172.21.15.7:0/2133779951 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7558066690 0x7f7558068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:06:58.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.459+0000 7f7579200640 1 --2- 172.21.15.7:0/2133779951 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7558066690 0x7f7558068b50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f75680b2000 tx=0x7f7568008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:06:58.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.463+0000 7f7570c00640 1 -- 172.21.15.7:0/2133779951 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f75741e49d0 con 0x7f75740709e0 2024-09-13T15:06:58.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.779+0000 7f757a600640 1 -- 172.21.15.7:0/2133779951 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75741e49d0 con 0x7f75740709e0 2024-09-13T15:06:58.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.779+0000 7f7570c00640 1 -- 172.21.15.7:0/2133779951 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+6301 (secure 0 0 0) 0x7f75741e49d0 con 0x7f75740709e0 2024-09-13T15:06:58.783 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:06:58.783 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:05:28.769591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4220":{"gid":4220,"name":"b","rank":4,"incarnation":19,"state":"up:active","state_seq":61,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:06:58.783 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-13T15:06:58.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.783+0000 7f757a600640 1 -- 172.21.15.7:0/2133779951 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7558066690 msgr2=0x7f7558068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:06:58.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.783+0000 7f757a600640 1 --2- 172.21.15.7:0/2133779951 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7558066690 0x7f7558068b50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f75680b2000 tx=0x7f7568008040 comp rx=0 tx=0).stop 2024-09-13T15:06:58.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.783+0000 7f757a600640 1 -- 172.21.15.7:0/2133779951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75740709e0 msgr2=0x7f75740c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:06:58.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.783+0000 7f757a600640 1 --2- 172.21.15.7:0/2133779951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75740709e0 0x7f75740c5600 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f756c00b9e0 tx=0x7f756c00bea0 comp rx=0 tx=0).stop 2024-09-13T15:06:58.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.783+0000 7f757a600640 1 -- 172.21.15.7:0/2133779951 shutdown_connections 2024-09-13T15:06:58.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.783+0000 7f757a600640 1 --2- 172.21.15.7:0/2133779951 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7558066690 0x7f7558068b50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:06:58.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.783+0000 7f757a600640 1 --2- 172.21.15.7:0/2133779951 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f75740709e0 0x7f75740c5600 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:06:58.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.783+0000 7f757a600640 1 --2- 172.21.15.7:0/2133779951 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7574070600 0x7f75740c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:06:58.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.783+0000 7f757a600640 1 --2- 172.21.15.7:0/2133779951 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7574066750 0x7f757414e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:06:58.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.783+0000 7f757a600640 1 -- 172.21.15.7:0/2133779951 >> 172.21.15.7:0/2133779951 conn(0x7f75740c8390 msgr2=0x7f7574150760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:06:58.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.783+0000 7f757a600640 1 -- 172.21.15.7:0/2133779951 shutdown_connections 2024-09-13T15:06:58.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:58.783+0000 7f757a600640 1 -- 172.21.15.7:0/2133779951 wait complete. 2024-09-13T15:06:58.818 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.b (rank=4) 2024-09-13T15:06:58.818 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T15:06:58.818 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:06:58.835 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T15:06:58.836 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:06:59.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.059+0000 7fc3fc200640 1 Processor -- start 2024-09-13T15:06:59.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.059+0000 7fc3fc200640 1 -- start start 2024-09-13T15:06:59.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.059+0000 7fc3fc200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3f4150f40 0x7fc3f41579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:06:59.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.059+0000 7fc3fc200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3f415f900 0x7fc3f4161cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:06:59.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.059+0000 7fc3fc200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f40c5d30 con 0x7fc3f4158480 2024-09-13T15:06:59.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.059+0000 7fc3fc200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f4156f90 con 0x7fc3f4150f40 2024-09-13T15:06:59.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.059+0000 7fc3fc200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f4157510 con 0x7fc3f415f900 2024-09-13T15:06:59.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.059+0000 7fc3f9800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3f4150f40 0x7fc3f41579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:06:59.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.059+0000 7fc3f9800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc3f4150f40 0x7fc3f41579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39494/0 (socket says 172.21.15.7:39494) 2024-09-13T15:06:59.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.059+0000 7fc3f9800640 1 -- 172.21.15.7:0/2512947573 learned_addr learned my addr 172.21.15.7:0/2512947573 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:06:59.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.059+0000 7fc3fa200640 1 --2- 172.21.15.7:0/2512947573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3f415f900 0x7fc3f4161cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:06:59.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.063+0000 7fc3f9800640 1 -- 172.21.15.7:0/2512947573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3f415f900 msgr2=0x7fc3f4161cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:06:59.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.063+0000 7fc3f9800640 1 --2- 172.21.15.7:0/2512947573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3f415f900 0x7fc3f4161cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:06:59.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.063+0000 7fc3f9800640 1 -- 172.21.15.7:0/2512947573 >> v1:172.21.15.7:6789/0 conn(0x7fc3f4158480 legacy=0x7fc3f4066180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:06:59.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.063+0000 7fc3f9800640 1 -- 172.21.15.7:0/2512947573 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f40c5490 con 0x7fc3f4150f40 2024-09-13T15:06:59.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.063+0000 7fc3f9800640 1 --2- 172.21.15.7:0/2512947573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3f4150f40 0x7fc3f41579a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009e50 tx=0x7fc3e801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f372e88e2c85cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:06:59.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.063+0000 7fc3f3e00640 1 -- 172.21.15.7:0/2512947573 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80a56e0 con 0x7fc3f4150f40 2024-09-13T15:06:59.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.063+0000 7fc3f3e00640 1 -- 172.21.15.7:0/2512947573 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e80a5840 con 0x7fc3f4150f40 2024-09-13T15:06:59.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.067+0000 7fc3f3e00640 1 -- 172.21.15.7:0/2512947573 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80a5bd0 con 0x7fc3f4150f40 2024-09-13T15:06:59.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.067+0000 7fc3fc200640 1 -- 172.21.15.7:0/2512947573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3f4150f40 msgr2=0x7fc3f41579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:06:59.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.067+0000 7fc3fc200640 1 --2- 172.21.15.7:0/2512947573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3f4150f40 0x7fc3f41579a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8009e50 tx=0x7fc3e801c8c0 comp rx=0 tx=0).stop 2024-09-13T15:06:59.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.067+0000 7fc3fc200640 1 -- 172.21.15.7:0/2512947573 shutdown_connections 2024-09-13T15:06:59.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.067+0000 7fc3fc200640 1 --2- 172.21.15.7:0/2512947573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3f415f900 0x7fc3f4161cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:06:59.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.067+0000 7fc3fc200640 1 --2- 172.21.15.7:0/2512947573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3f4150f40 0x7fc3f41579a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:06:59.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.067+0000 7fc3fc200640 1 -- 172.21.15.7:0/2512947573 >> 172.21.15.7:0/2512947573 conn(0x7fc3f406e110 msgr2=0x7fc3f406e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:06:59.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.067+0000 7fc3fc200640 1 -- 172.21.15.7:0/2512947573 shutdown_connections 2024-09-13T15:06:59.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.067+0000 7fc3fc200640 1 -- 172.21.15.7:0/2512947573 wait complete. 2024-09-13T15:06:59.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.067+0000 7fc3fc200640 1 Processor -- start 2024-09-13T15:06:59.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.067+0000 7fc3fc200640 1 -- start start 2024-09-13T15:06:59.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.067+0000 7fc3fc200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3f4150f40 0x7fc3f4154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:06:59.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.067+0000 7fc3fc200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3f4158480 0x7fc3f406e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:06:59.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.067+0000 7fc3fc200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3f415f900 0x7fc3f4144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:06:59.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.067+0000 7fc3fc200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f4155720 con 0x7fc3f4150f40 2024-09-13T15:06:59.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.067+0000 7fc3fc200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f4142e20 con 0x7fc3f415f900 2024-09-13T15:06:59.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.067+0000 7fc3fc200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40ca260 con 0x7fc3f4158480 2024-09-13T15:06:59.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.071+0000 7fc3f9800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3f4150f40 0x7fc3f4154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:06:59.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.071+0000 7fc3f9800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3f4150f40 0x7fc3f4154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39496/0 (socket says 172.21.15.7:39496) 2024-09-13T15:06:59.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.071+0000 7fc3f9800640 1 -- 172.21.15.7:0/572636238 learned_addr learned my addr 172.21.15.7:0/572636238 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:06:59.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.071+0000 7fc3f8e00640 1 --2- 172.21.15.7:0/572636238 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3f4158480 0x7fc3f406e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:06:59.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.071+0000 7fc3fa200640 1 --2- 172.21.15.7:0/572636238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3f415f900 0x7fc3f4144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:06:59.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.071+0000 7fc3f9800640 1 -- 172.21.15.7:0/572636238 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3f4158480 msgr2=0x7fc3f406e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:06:59.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.071+0000 7fc3f9800640 1 --2- 172.21.15.7:0/572636238 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3f4158480 0x7fc3f406e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:06:59.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.071+0000 7fc3f9800640 1 -- 172.21.15.7:0/572636238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3f415f900 msgr2=0x7fc3f4144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:06:59.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.071+0000 7fc3f9800640 1 --2- 172.21.15.7:0/572636238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3f415f900 0x7fc3f4144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:06:59.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.071+0000 7fc3f9800640 1 -- 172.21.15.7:0/572636238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e8009b30 con 0x7fc3f4150f40 2024-09-13T15:06:59.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.071+0000 7fc3f9800640 1 --2- 172.21.15.7:0/572636238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3f4150f40 0x7fc3f4154bd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc3e801af70 tx=0x7fc3e8019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:06:59.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.071+0000 7fc3f1600640 1 -- 172.21.15.7:0/572636238 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80a56e0 con 0x7fc3f4150f40 2024-09-13T15:06:59.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.071+0000 7fc3fc200640 1 -- 172.21.15.7:0/572636238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f41444b0 con 0x7fc3f4150f40 2024-09-13T15:06:59.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.071+0000 7fc3f1600640 1 -- 172.21.15.7:0/572636238 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e8007c30 con 0x7fc3f4150f40 2024-09-13T15:06:59.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.071+0000 7fc3fc200640 1 -- 172.21.15.7:0/572636238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f4156610 con 0x7fc3f4150f40 2024-09-13T15:06:59.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.071+0000 7fc3f1600640 1 -- 172.21.15.7:0/572636238 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80a56e0 con 0x7fc3f4150f40 2024-09-13T15:06:59.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.075+0000 7fc3fc200640 1 -- 172.21.15.7:0/572636238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f4067a60 con 0x7fc3f4150f40 2024-09-13T15:06:59.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.079+0000 7fc3f1600640 1 -- 172.21.15.7:0/572636238 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc3e80c2480 con 0x7fc3f4150f40 2024-09-13T15:06:59.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.079+0000 7fc3f1600640 1 --2- 172.21.15.7:0/572636238 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc3d4066720 0x7fc3d4068be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:06:59.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.079+0000 7fc3f1600640 1 -- 172.21.15.7:0/572636238 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fc3e811f370 con 0x7fc3f4150f40 2024-09-13T15:06:59.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.083+0000 7fc3f8e00640 1 --2- 172.21.15.7:0/572636238 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc3d4066720 0x7fc3d4068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:06:59.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.087+0000 7fc3f8e00640 1 --2- 172.21.15.7:0/572636238 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc3d4066720 0x7fc3d4068be0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4154b30 tx=0x7fc3e000c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:06:59.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.087+0000 7fc3f1600640 1 -- 172.21.15.7:0/572636238 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc3e80ec2f0 con 0x7fc3f4150f40 2024-09-13T15:06:59.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.503+0000 7fc3fc200640 1 -- 172.21.15.7:0/572636238 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3f4065f60 con 0x7fc3f4150f40 2024-09-13T15:06:59.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.503+0000 7fc3f1600640 1 -- 172.21.15.7:0/572636238 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+6301 (secure 0 0 0) 0x7fc3e8009510 con 0x7fc3f4150f40 2024-09-13T15:06:59.507 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:06:59.508 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:05:28.769591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4220":{"gid":4220,"name":"b","rank":4,"incarnation":19,"state":"up:active","state_seq":61,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:06:59.508 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-13T15:06:59.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.507+0000 7fc3fc200640 1 -- 172.21.15.7:0/572636238 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc3d4066720 msgr2=0x7fc3d4068be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:06:59.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.507+0000 7fc3fc200640 1 --2- 172.21.15.7:0/572636238 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc3d4066720 0x7fc3d4068be0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc3f4154b30 tx=0x7fc3e000c040 comp rx=0 tx=0).stop 2024-09-13T15:06:59.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.507+0000 7fc3fc200640 1 -- 172.21.15.7:0/572636238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3f4150f40 msgr2=0x7fc3f4154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:06:59.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.507+0000 7fc3fc200640 1 --2- 172.21.15.7:0/572636238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3f4150f40 0x7fc3f4154bd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fc3e801af70 tx=0x7fc3e8019660 comp rx=0 tx=0).stop 2024-09-13T15:06:59.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.507+0000 7fc3fc200640 1 -- 172.21.15.7:0/572636238 shutdown_connections 2024-09-13T15:06:59.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.507+0000 7fc3fc200640 1 --2- 172.21.15.7:0/572636238 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc3d4066720 0x7fc3d4068be0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:06:59.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.507+0000 7fc3fc200640 1 --2- 172.21.15.7:0/572636238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3f415f900 0x7fc3f4144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:06:59.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.507+0000 7fc3fc200640 1 --2- 172.21.15.7:0/572636238 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc3f4158480 0x7fc3f406e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:06:59.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.507+0000 7fc3fc200640 1 --2- 172.21.15.7:0/572636238 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc3f4150f40 0x7fc3f4154bd0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:06:59.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.507+0000 7fc3fc200640 1 -- 172.21.15.7:0/572636238 >> 172.21.15.7:0/572636238 conn(0x7fc3f406e110 msgr2=0x7fc3f41495b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:06:59.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.507+0000 7fc3fc200640 1 -- 172.21.15.7:0/572636238 shutdown_connections 2024-09-13T15:06:59.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:06:59.507+0000 7fc3fc200640 1 -- 172.21.15.7:0/572636238 wait complete. 2024-09-13T15:06:59.545 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-09-13T15:07:01.545 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:01.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.715+0000 7fdc5ac00640 1 Processor -- start 2024-09-13T15:07:01.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.715+0000 7fdc5ac00640 1 -- start start 2024-09-13T15:07:01.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.715+0000 7fdc5ac00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdc5406f5f0 0x7fdc540c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:01.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.715+0000 7fdc5ac00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdc5406f9d0 0x7fdc54154130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:01.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.715+0000 7fdc5ac00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc540c7fb0 con 0x7fdc540c9060 2024-09-13T15:07:01.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.715+0000 7fdc5ac00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc54156fc0 con 0x7fdc5406f9d0 2024-09-13T15:07:01.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.715+0000 7fdc5ac00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc540c8250 con 0x7fdc5406f5f0 2024-09-13T15:07:01.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.715+0000 7fdc53e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdc5406f5f0 0x7fdc540c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:01.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.715+0000 7fdc53e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdc5406f5f0 0x7fdc540c9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:34136/0 (socket says 172.21.15.7:34136) 2024-09-13T15:07:01.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.715+0000 7fdc53e00640 1 -- 172.21.15.7:0/185128957 learned_addr learned my addr 172.21.15.7:0/185128957 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:01.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.715+0000 7fdc53400640 1 --2- 172.21.15.7:0/185128957 >> v2:172.21.15.7:3300/0 conn(0x7fdc5406f9d0 0x7fdc54154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:01.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.715+0000 7fdc53e00640 1 -- 172.21.15.7:0/185128957 >> v2:172.21.15.7:3300/0 conn(0x7fdc5406f9d0 msgr2=0x7fdc54154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:01.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.715+0000 7fdc53e00640 1 --2- 172.21.15.7:0/185128957 >> v2:172.21.15.7:3300/0 conn(0x7fdc5406f9d0 0x7fdc54154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:01.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.715+0000 7fdc53e00640 1 -- 172.21.15.7:0/185128957 >> v1:172.21.15.7:6789/0 conn(0x7fdc540c9060 legacy=0x7fdc541574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:01.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.715+0000 7fdc53e00640 1 -- 172.21.15.7:0/185128957 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc540c8530 con 0x7fdc5406f5f0 2024-09-13T15:07:01.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.715+0000 7fdc53400640 1 --2- 172.21.15.7:0/185128957 >> v2:172.21.15.7:3300/0 conn(0x7fdc5406f9d0 0x7fdc54154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:07:01.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.719+0000 7fdc53e00640 1 --2- 172.21.15.7:0/185128957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5406f5f0 0x7fdc540c9ca0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdc540cdb50 tx=0x7fdc4001c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9448756bf13c171 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:01.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.723+0000 7fdc52a00640 1 -- 172.21.15.7:0/185128957 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc400ac620 con 0x7fdc5406f5f0 2024-09-13T15:07:01.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.723+0000 7fdc52a00640 1 -- 172.21.15.7:0/185128957 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc400ac780 con 0x7fdc5406f5f0 2024-09-13T15:07:01.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.723+0000 7fdc52a00640 1 -- 172.21.15.7:0/185128957 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc400acb10 con 0x7fdc5406f5f0 2024-09-13T15:07:01.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.723+0000 7fdc5ac00640 1 -- 172.21.15.7:0/185128957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5406f5f0 msgr2=0x7fdc540c9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:01.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.723+0000 7fdc5ac00640 1 --2- 172.21.15.7:0/185128957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5406f5f0 0x7fdc540c9ca0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdc540cdb50 tx=0x7fdc4001c4b0 comp rx=0 tx=0).stop 2024-09-13T15:07:01.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.723+0000 7fdc5ac00640 1 -- 172.21.15.7:0/185128957 shutdown_connections 2024-09-13T15:07:01.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.723+0000 7fdc5ac00640 1 --2- 172.21.15.7:0/185128957 >> v2:172.21.15.7:3300/0 conn(0x7fdc5406f9d0 0x7fdc54154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:01.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.723+0000 7fdc5ac00640 1 --2- 172.21.15.7:0/185128957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5406f5f0 0x7fdc540c9ca0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:01.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.723+0000 7fdc5ac00640 1 -- 172.21.15.7:0/185128957 >> 172.21.15.7:0/185128957 conn(0x7fdc5406cf60 msgr2=0x7fdc540717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:01.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.723+0000 7fdc5ac00640 1 -- 172.21.15.7:0/185128957 shutdown_connections 2024-09-13T15:07:01.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.723+0000 7fdc5ac00640 1 -- 172.21.15.7:0/185128957 wait complete. 2024-09-13T15:07:01.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.727+0000 7fdc5ac00640 1 Processor -- start 2024-09-13T15:07:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.727+0000 7fdc5ac00640 1 -- start start 2024-09-13T15:07:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.727+0000 7fdc5ac00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5406f5f0 0x7fdc5414a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.727+0000 7fdc5ac00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5406f9d0 0x7fdc541501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.727+0000 7fdc5ac00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc540c9060 0x7fdc54155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.727+0000 7fdc5ac00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc540cbd40 con 0x7fdc540c9060 2024-09-13T15:07:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.727+0000 7fdc5ac00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc540cb060 con 0x7fdc5406f9d0 2024-09-13T15:07:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.727+0000 7fdc5ac00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc540cd280 con 0x7fdc5406f5f0 2024-09-13T15:07:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.731+0000 7fdc53e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5406f5f0 0x7fdc5414a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.731+0000 7fdc53e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5406f5f0 0x7fdc5414a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:53218/0 (socket says 172.21.15.7:53218) 2024-09-13T15:07:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.731+0000 7fdc53e00640 1 -- 172.21.15.7:0/2839080942 learned_addr learned my addr 172.21.15.7:0/2839080942 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.731+0000 7fdc53400640 1 --2- 172.21.15.7:0/2839080942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5406f9d0 0x7fdc541501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.731+0000 7fdc53e00640 1 -- 172.21.15.7:0/2839080942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5406f9d0 msgr2=0x7fdc541501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.731+0000 7fdc53e00640 1 --2- 172.21.15.7:0/2839080942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5406f9d0 0x7fdc541501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.731+0000 7fdc53e00640 1 -- 172.21.15.7:0/2839080942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc540c9060 msgr2=0x7fdc54155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.731+0000 7fdc53e00640 1 --2- 172.21.15.7:0/2839080942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc540c9060 0x7fdc54155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.731+0000 7fdc53e00640 1 -- 172.21.15.7:0/2839080942 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc400094d0 con 0x7fdc5406f5f0 2024-09-13T15:07:01.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.731+0000 7fdc53e00640 1 --2- 172.21.15.7:0/2839080942 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5406f5f0 0x7fdc5414a510 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdc400af040 tx=0x7fdc4001acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.731+0000 7fdc4be00640 1 -- 172.21.15.7:0/2839080942 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc400c8630 con 0x7fdc5406f5f0 2024-09-13T15:07:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.731+0000 7fdc4be00640 1 -- 172.21.15.7:0/2839080942 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc400c87b0 con 0x7fdc5406f5f0 2024-09-13T15:07:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.731+0000 7fdc4be00640 1 -- 172.21.15.7:0/2839080942 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc400c8b60 con 0x7fdc5406f5f0 2024-09-13T15:07:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.731+0000 7fdc5ac00640 1 -- 172.21.15.7:0/2839080942 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc5414aa50 con 0x7fdc5406f5f0 2024-09-13T15:07:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.731+0000 7fdc5ac00640 1 -- 172.21.15.7:0/2839080942 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc540ccfa0 con 0x7fdc5406f5f0 2024-09-13T15:07:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.731+0000 7fdc5ac00640 1 -- 172.21.15.7:0/2839080942 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc540cb1d0 con 0x7fdc5406f5f0 2024-09-13T15:07:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.735+0000 7fdc4be00640 1 -- 172.21.15.7:0/2839080942 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdc400aa070 con 0x7fdc5406f5f0 2024-09-13T15:07:01.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.735+0000 7fdc4be00640 1 --2- 172.21.15.7:0/2839080942 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdc340666c0 0x7fdc34068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:01.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.735+0000 7fdc4be00640 1 -- 172.21.15.7:0/2839080942 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fdc40130460 con 0x7fdc5406f5f0 2024-09-13T15:07:01.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.735+0000 7fdc53400640 1 --2- 172.21.15.7:0/2839080942 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdc340666c0 0x7fdc34068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:01.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.739+0000 7fdc53400640 1 --2- 172.21.15.7:0/2839080942 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdc340666c0 0x7fdc34068b80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdc5414ae20 tx=0x7fdc44008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:01.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:01.747+0000 7fdc4be00640 1 -- 172.21.15.7:0/2839080942 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdc400fd3a0 con 0x7fdc5406f5f0 2024-09-13T15:07:02.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:02.291+0000 7fdc5ac00640 1 -- 172.21.15.7:0/2839080942 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc540cb1d0 con 0x7fdc5406f5f0 2024-09-13T15:07:02.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:02.295+0000 7fdc4be00640 1 -- 172.21.15.7:0/2839080942 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+6301 (secure 0 0 0) 0x7fdc400b1030 con 0x7fdc5406f5f0 2024-09-13T15:07:02.298 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:07:02.298 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:05:28.769591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4220":{"gid":4220,"name":"b","rank":4,"incarnation":19,"state":"up:active","state_seq":61,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:07:02.298 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-13T15:07:02.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:02.299+0000 7fdc5ac00640 1 -- 172.21.15.7:0/2839080942 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdc340666c0 msgr2=0x7fdc34068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:02.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:02.299+0000 7fdc5ac00640 1 --2- 172.21.15.7:0/2839080942 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdc340666c0 0x7fdc34068b80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdc5414ae20 tx=0x7fdc44008040 comp rx=0 tx=0).stop 2024-09-13T15:07:02.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:02.299+0000 7fdc5ac00640 1 -- 172.21.15.7:0/2839080942 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5406f5f0 msgr2=0x7fdc5414a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:02.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:02.299+0000 7fdc5ac00640 1 --2- 172.21.15.7:0/2839080942 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5406f5f0 0x7fdc5414a510 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdc400af040 tx=0x7fdc4001acf0 comp rx=0 tx=0).stop 2024-09-13T15:07:02.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:02.299+0000 7fdc5ac00640 1 -- 172.21.15.7:0/2839080942 shutdown_connections 2024-09-13T15:07:02.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:02.299+0000 7fdc5ac00640 1 --2- 172.21.15.7:0/2839080942 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdc340666c0 0x7fdc34068b80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:02.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:02.299+0000 7fdc5ac00640 1 --2- 172.21.15.7:0/2839080942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc540c9060 0x7fdc54155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:02.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:02.299+0000 7fdc5ac00640 1 --2- 172.21.15.7:0/2839080942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdc5406f9d0 0x7fdc541501e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:02.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:02.299+0000 7fdc5ac00640 1 --2- 172.21.15.7:0/2839080942 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdc5406f5f0 0x7fdc5414a510 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:02.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:02.299+0000 7fdc5ac00640 1 -- 172.21.15.7:0/2839080942 >> 172.21.15.7:0/2839080942 conn(0x7fdc5406cf60 msgr2=0x7fdc540bc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:02.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:02.299+0000 7fdc5ac00640 1 -- 172.21.15.7:0/2839080942 shutdown_connections 2024-09-13T15:07:02.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:02.299+0000 7fdc5ac00640 1 -- 172.21.15.7:0/2839080942 wait complete. 2024-09-13T15:07:02.329 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-09-13T15:07:04.330 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:04.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.551+0000 7f6c97200640 1 Processor -- start 2024-09-13T15:07:04.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.551+0000 7f6c97200640 1 -- start start 2024-09-13T15:07:04.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.551+0000 7f6c97200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6c98150f30 0x7f6c980b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:04.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.551+0000 7f6c97200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6c980b2f90 0x7f6c980c7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:04.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.551+0000 7f6c97200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c980cabe0 con 0x7f6c980cb580 2024-09-13T15:07:04.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.551+0000 7f6c97200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c98156cf0 con 0x7f6c980b2f90 2024-09-13T15:07:04.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.551+0000 7f6c97200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c980cba70 con 0x7f6c98150f30 2024-09-13T15:07:04.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.551+0000 7f6c96800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6c980b2f90 0x7f6c980c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:04.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.551+0000 7f6c96800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f6c980b2f90 0x7f6c980c7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39540/0 (socket says 172.21.15.7:39540) 2024-09-13T15:07:04.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.551+0000 7f6c96800640 1 -- 172.21.15.7:0/3717313236 learned_addr learned my addr 172.21.15.7:0/3717313236 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:04.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.551+0000 7f6c95400640 1 --1- 172.21.15.7:0/3717313236 >> v1:172.21.15.7:6789/0 conn(0x7f6c980cb580 0x7f6c980c9570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:55068/0 (socket says 172.21.15.7:55068) 2024-09-13T15:07:04.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.551+0000 7f6c95e00640 1 --2- 172.21.15.7:0/3717313236 >> v2:172.21.15.77:3300/0 conn(0x7f6c98150f30 0x7f6c980b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:04.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.551+0000 7f6c96800640 1 -- 172.21.15.7:0/3717313236 >> v2:172.21.15.77:3300/0 conn(0x7f6c98150f30 msgr2=0x7f6c980b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:04.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.551+0000 7f6c96800640 1 --2- 172.21.15.7:0/3717313236 >> v2:172.21.15.77:3300/0 conn(0x7f6c98150f30 0x7f6c980b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:04.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.551+0000 7f6c96800640 1 -- 172.21.15.7:0/3717313236 >> v1:172.21.15.7:6789/0 conn(0x7f6c980cb580 legacy=0x7f6c980c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:04.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.551+0000 7f6c96800640 1 -- 172.21.15.7:0/3717313236 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c980cbd50 con 0x7f6c980b2f90 2024-09-13T15:07:04.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.555+0000 7f6c96800640 1 --2- 172.21.15.7:0/3717313236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c980b2f90 0x7f6c980c7720 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6c980c9540 tx=0x7f6c9001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b2c9608abb4577 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:04.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.555+0000 7f6c94a00640 1 -- 172.21.15.7:0/3717313236 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900af400 con 0x7f6c980b2f90 2024-09-13T15:07:04.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.555+0000 7f6c94a00640 1 -- 172.21.15.7:0/3717313236 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c900ab050 con 0x7f6c980b2f90 2024-09-13T15:07:04.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.555+0000 7f6c94a00640 1 -- 172.21.15.7:0/3717313236 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c900af780 con 0x7f6c980b2f90 2024-09-13T15:07:04.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.555+0000 7f6c97200640 1 -- 172.21.15.7:0/3717313236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c980b2f90 msgr2=0x7f6c980c7720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:04.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.555+0000 7f6c97200640 1 --2- 172.21.15.7:0/3717313236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c980b2f90 0x7f6c980c7720 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6c980c9540 tx=0x7f6c9001f1e0 comp rx=0 tx=0).stop 2024-09-13T15:07:04.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.555+0000 7f6c97200640 1 -- 172.21.15.7:0/3717313236 shutdown_connections 2024-09-13T15:07:04.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.555+0000 7f6c97200640 1 --2- 172.21.15.7:0/3717313236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c980b2f90 0x7f6c980c7720 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:04.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.555+0000 7f6c97200640 1 --2- 172.21.15.7:0/3717313236 >> v2:172.21.15.77:3300/0 conn(0x7f6c98150f30 0x7f6c980b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:04.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.555+0000 7f6c97200640 1 -- 172.21.15.7:0/3717313236 >> 172.21.15.7:0/3717313236 conn(0x7f6c98065d40 msgr2=0x7f6c98066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:04.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.559+0000 7f6c97200640 1 -- 172.21.15.7:0/3717313236 shutdown_connections 2024-09-13T15:07:04.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.559+0000 7f6c97200640 1 -- 172.21.15.7:0/3717313236 wait complete. 2024-09-13T15:07:04.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.559+0000 7f6c97200640 1 Processor -- start 2024-09-13T15:07:04.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.559+0000 7f6c97200640 1 -- start start 2024-09-13T15:07:04.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c97200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c980b2f90 0x7f6c980c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:04.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c97200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c980cb580 0x7f6c9814f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:04.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c97200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c98150f30 0x7f6c980c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:04.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c97200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980c5df0 con 0x7f6c980cb580 2024-09-13T15:07:04.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c97200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c981534a0 con 0x7f6c980b2f90 2024-09-13T15:07:04.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c97200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c980c4580 con 0x7f6c98150f30 2024-09-13T15:07:04.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c95400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c980cb580 0x7f6c9814f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:04.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c95400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c980cb580 0x7f6c9814f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39546/0 (socket says 172.21.15.7:39546) 2024-09-13T15:07:04.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c95400640 1 -- 172.21.15.7:0/2835489573 learned_addr learned my addr 172.21.15.7:0/2835489573 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:04.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c95e00640 1 --2- 172.21.15.7:0/2835489573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c980b2f90 0x7f6c980c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:04.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c96800640 1 --2- 172.21.15.7:0/2835489573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c98150f30 0x7f6c980c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:04.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c95400640 1 -- 172.21.15.7:0/2835489573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c98150f30 msgr2=0x7f6c980c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:04.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c95400640 1 --2- 172.21.15.7:0/2835489573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c98150f30 0x7f6c980c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:04.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c95400640 1 -- 172.21.15.7:0/2835489573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c980b2f90 msgr2=0x7f6c980c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:04.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c95400640 1 --2- 172.21.15.7:0/2835489573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c980b2f90 0x7f6c980c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:04.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c95400640 1 -- 172.21.15.7:0/2835489573 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c90009b30 con 0x7f6c980cb580 2024-09-13T15:07:04.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c96800640 1 --2- 172.21.15.7:0/2835489573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c98150f30 0x7f6c980c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:07:04.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c95400640 1 --2- 172.21.15.7:0/2835489573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c980cb580 0x7f6c9814f1f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400c490 tx=0x7f6c8400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:04.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c8e000640 1 -- 172.21.15.7:0/2835489573 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c84007480 con 0x7f6c980cb580 2024-09-13T15:07:04.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c8e000640 1 -- 172.21.15.7:0/2835489573 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c840075e0 con 0x7f6c980cb580 2024-09-13T15:07:04.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c8e000640 1 -- 172.21.15.7:0/2835489573 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c84004a10 con 0x7f6c980cb580 2024-09-13T15:07:04.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c97200640 1 -- 172.21.15.7:0/2835489573 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c981ed290 con 0x7f6c980cb580 2024-09-13T15:07:04.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c97200640 1 -- 172.21.15.7:0/2835489573 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c98151640 con 0x7f6c980cb580 2024-09-13T15:07:04.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.563+0000 7f6c97200640 1 -- 172.21.15.7:0/2835489573 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c98151310 con 0x7f6c980cb580 2024-09-13T15:07:04.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.567+0000 7f6c8e000640 1 -- 172.21.15.7:0/2835489573 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6c84004b70 con 0x7f6c980cb580 2024-09-13T15:07:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.567+0000 7f6c8e000640 1 --2- 172.21.15.7:0/2835489573 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6c780666c0 0x7f6c78068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:04.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.567+0000 7f6c8e000640 1 -- 172.21.15.7:0/2835489573 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f6c840835d0 con 0x7f6c980cb580 2024-09-13T15:07:04.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.567+0000 7f6c95e00640 1 --2- 172.21.15.7:0/2835489573 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6c780666c0 0x7f6c78068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:04.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.567+0000 7f6c95e00640 1 --2- 172.21.15.7:0/2835489573 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6c780666c0 0x7f6c78068b80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009ac0 tx=0x7f6c88009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:04.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.571+0000 7f6c8e000640 1 -- 172.21.15.7:0/2835489573 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6c84050540 con 0x7f6c980cb580 2024-09-13T15:07:04.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.815+0000 7f6c97200640 1 -- 172.21.15.7:0/2835489573 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c9814da90 con 0x7f6c980cb580 2024-09-13T15:07:04.830 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:07:04.831 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:05:28.769591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4220":{"gid":4220,"name":"b","rank":4,"incarnation":19,"state":"up:active","state_seq":61,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:07:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.827+0000 7f6c8e000640 1 -- 172.21.15.7:0/2835489573 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+6301 (secure 0 0 0) 0x7f6c84053b60 con 0x7f6c980cb580 2024-09-13T15:07:04.831 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-13T15:07:04.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.831+0000 7f6c97200640 1 -- 172.21.15.7:0/2835489573 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6c780666c0 msgr2=0x7f6c78068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:04.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.831+0000 7f6c97200640 1 --2- 172.21.15.7:0/2835489573 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6c780666c0 0x7f6c78068b80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009ac0 tx=0x7f6c88009190 comp rx=0 tx=0).stop 2024-09-13T15:07:04.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.831+0000 7f6c97200640 1 -- 172.21.15.7:0/2835489573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c980cb580 msgr2=0x7f6c9814f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:04.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.831+0000 7f6c97200640 1 --2- 172.21.15.7:0/2835489573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c980cb580 0x7f6c9814f1f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400c490 tx=0x7f6c8400c950 comp rx=0 tx=0).stop 2024-09-13T15:07:04.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.831+0000 7f6c97200640 1 -- 172.21.15.7:0/2835489573 shutdown_connections 2024-09-13T15:07:04.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.831+0000 7f6c97200640 1 --2- 172.21.15.7:0/2835489573 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6c780666c0 0x7f6c78068b80 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6c88009ac0 tx=0x7f6c88009190 comp rx=0 tx=0).stop 2024-09-13T15:07:04.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.831+0000 7f6c97200640 1 --2- 172.21.15.7:0/2835489573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f6c98150f30 0x7f6c980c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:04.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.831+0000 7f6c97200640 1 --2- 172.21.15.7:0/2835489573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6c980cb580 0x7f6c9814f1f0 secure :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400c490 tx=0x7f6c8400c950 comp rx=0 tx=0).stop 2024-09-13T15:07:04.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.831+0000 7f6c97200640 1 --2- 172.21.15.7:0/2835489573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c980b2f90 0x7f6c980c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:04.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.831+0000 7f6c97200640 1 -- 172.21.15.7:0/2835489573 >> 172.21.15.7:0/2835489573 conn(0x7f6c98065d40 msgr2=0x7f6c9814dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:04.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.835+0000 7f6c97200640 1 -- 172.21.15.7:0/2835489573 shutdown_connections 2024-09-13T15:07:04.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:04.843+0000 7f6c97200640 1 -- 172.21.15.7:0/2835489573 wait complete. 2024-09-13T15:07:04.928 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-09-13T15:07:06.929 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:07.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.167+0000 7f4a56a00640 1 Processor -- start 2024-09-13T15:07:07.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.167+0000 7f4a56a00640 1 -- start start 2024-09-13T15:07:07.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.167+0000 7f4a56a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a50071a70 0x7f4a501576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:07.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.167+0000 7f4a56a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a500c5530 con 0x7f4a5006ddb0 2024-09-13T15:07:07.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.167+0000 7f4a56a00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a501583b0 con 0x7f4a500b0bf0 2024-09-13T15:07:07.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.167+0000 7f4a56a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a50156f40 con 0x7f4a50071a70 2024-09-13T15:07:07.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.167+0000 7f4a4fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a50071a70 0x7f4a501576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:07.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.167+0000 7f4a4fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a50071a70 0x7f4a501576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:53234/0 (socket says 172.21.15.7:53234) 2024-09-13T15:07:07.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.167+0000 7f4a4fe00640 1 -- 172.21.15.7:0/524195426 learned_addr learned my addr 172.21.15.7:0/524195426 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:07.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.167+0000 7f4a4fe00640 1 -- 172.21.15.7:0/524195426 >> v1:172.21.15.77:6789/0 conn(0x7f4a500b0bf0 legacy=0x7f4a50150cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:07:07.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.167+0000 7f4a4fe00640 1 -- 172.21.15.7:0/524195426 >> v1:172.21.15.7:6789/0 conn(0x7f4a5006ddb0 legacy=0x7f4a50161800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:07:07.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.167+0000 7f4a4fe00640 1 -- 172.21.15.7:0/524195426 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a500b10c0 con 0x7f4a50071a70 2024-09-13T15:07:07.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.175+0000 7f4a4fe00640 1 --2- 172.21.15.7:0/524195426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a50071a70 0x7f4a501576e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a400098a0 tx=0x7f4a4001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84b0a1153d7ea2b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:07.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.183+0000 7f4a4ea00640 1 -- 172.21.15.7:0/524195426 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a400aa5f0 con 0x7f4a50071a70 2024-09-13T15:07:07.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.183+0000 7f4a4ea00640 1 -- 172.21.15.7:0/524195426 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a400aa750 con 0x7f4a50071a70 2024-09-13T15:07:07.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.183+0000 7f4a4ea00640 1 -- 172.21.15.7:0/524195426 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a400aaae0 con 0x7f4a50071a70 2024-09-13T15:07:07.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.183+0000 7f4a56a00640 1 -- 172.21.15.7:0/524195426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a50071a70 msgr2=0x7f4a501576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:07.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.183+0000 7f4a56a00640 1 --2- 172.21.15.7:0/524195426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a50071a70 0x7f4a501576e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4a400098a0 tx=0x7f4a4001c4d0 comp rx=0 tx=0).stop 2024-09-13T15:07:07.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.183+0000 7f4a56a00640 1 -- 172.21.15.7:0/524195426 shutdown_connections 2024-09-13T15:07:07.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.183+0000 7f4a56a00640 1 --2- 172.21.15.7:0/524195426 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a50071a70 0x7f4a501576e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:07.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.183+0000 7f4a56a00640 1 -- 172.21.15.7:0/524195426 >> 172.21.15.7:0/524195426 conn(0x7f4a50065d40 msgr2=0x7f4a50066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:07.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.183+0000 7f4a56a00640 1 -- 172.21.15.7:0/524195426 shutdown_connections 2024-09-13T15:07:07.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.183+0000 7f4a56a00640 1 -- 172.21.15.7:0/524195426 wait complete. 2024-09-13T15:07:07.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.187+0000 7f4a56a00640 1 Processor -- start 2024-09-13T15:07:07.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.187+0000 7f4a56a00640 1 -- start start 2024-09-13T15:07:07.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.191+0000 7f4a56a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a5006ddb0 0x7f4a50071090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:07.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.191+0000 7f4a56a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a50071a70 0x7f4a501562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:07.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.191+0000 7f4a56a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a500b0bf0 0x7f4a500aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:07.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.191+0000 7f4a4fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a5006ddb0 0x7f4a50071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:07.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.191+0000 7f4a4fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a5006ddb0 0x7f4a50071090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:53248/0 (socket says 172.21.15.7:53248) 2024-09-13T15:07:07.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.191+0000 7f4a4f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a50071a70 0x7f4a501562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:07.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.191+0000 7f4a4f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a50071a70 0x7f4a501562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39562/0 (socket says 172.21.15.7:39562) 2024-09-13T15:07:07.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.191+0000 7f4a4fe00640 1 -- 172.21.15.7:0/96266859 learned_addr learned my addr 172.21.15.7:0/96266859 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:07.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.191+0000 7f4a54a00640 1 --2- 172.21.15.7:0/96266859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a500b0bf0 0x7f4a500aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:07.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.191+0000 7f4a56a00640 1 -- 172.21.15.7:0/96266859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a500c80a0 con 0x7f4a50071a70 2024-09-13T15:07:07.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.191+0000 7f4a56a00640 1 -- 172.21.15.7:0/96266859 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a500706d0 con 0x7f4a500b0bf0 2024-09-13T15:07:07.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.191+0000 7f4a56a00640 1 -- 172.21.15.7:0/96266859 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a500b02d0 con 0x7f4a5006ddb0 2024-09-13T15:07:07.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.195+0000 7f4a4f400640 1 -- 172.21.15.7:0/96266859 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a5006ddb0 msgr2=0x7f4a50071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:07.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.195+0000 7f4a4f400640 1 --2- 172.21.15.7:0/96266859 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a5006ddb0 0x7f4a50071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:07.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.195+0000 7f4a4f400640 1 -- 172.21.15.7:0/96266859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a500b0bf0 msgr2=0x7f4a500aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:07.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.195+0000 7f4a4f400640 1 --2- 172.21.15.7:0/96266859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a500b0bf0 0x7f4a500aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:07.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.195+0000 7f4a4f400640 1 -- 172.21.15.7:0/96266859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a400094d0 con 0x7f4a50071a70 2024-09-13T15:07:07.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.195+0000 7f4a54a00640 1 --2- 172.21.15.7:0/96266859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a500b0bf0 0x7f4a500aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:07.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.195+0000 7f4a4f400640 1 --2- 172.21.15.7:0/96266859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a50071a70 0x7f4a501562d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00b460 tx=0x7f4a3c00b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:07.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.199+0000 7f4a47e00640 1 -- 172.21.15.7:0/96266859 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c011830 con 0x7f4a50071a70 2024-09-13T15:07:07.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.199+0000 7f4a56a00640 1 -- 172.21.15.7:0/96266859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a500c7e40 con 0x7f4a50071a70 2024-09-13T15:07:07.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.199+0000 7f4a56a00640 1 -- 172.21.15.7:0/96266859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a500c9b70 con 0x7f4a50071a70 2024-09-13T15:07:07.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.199+0000 7f4a47e00640 1 -- 172.21.15.7:0/96266859 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3c011990 con 0x7f4a50071a70 2024-09-13T15:07:07.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.203+0000 7f4a47e00640 1 -- 172.21.15.7:0/96266859 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3c011830 con 0x7f4a50071a70 2024-09-13T15:07:07.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.203+0000 7f4a45600640 1 -- 172.21.15.7:0/96266859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a50067650 con 0x7f4a50071a70 2024-09-13T15:07:07.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.207+0000 7f4a47e00640 1 -- 172.21.15.7:0/96266859 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4a3c011b00 con 0x7f4a50071a70 2024-09-13T15:07:07.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.207+0000 7f4a47e00640 1 --2- 172.21.15.7:0/96266859 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4a30066750 0x7f4a30068c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:07.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.215+0000 7f4a47e00640 1 -- 172.21.15.7:0/96266859 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f4a3c083f10 con 0x7f4a50071a70 2024-09-13T15:07:07.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.219+0000 7f4a4fe00640 1 --2- 172.21.15.7:0/96266859 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4a30066750 0x7f4a30068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.227+0000 7f4a4fe00640 1 --2- 172.21.15.7:0/96266859 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4a30066750 0x7f4a30068c10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4a4001c510 tx=0x7f4a400b5040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:07.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.243+0000 7f4a47e00640 1 -- 172.21.15.7:0/96266859 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4a3c050e90 con 0x7f4a50071a70 2024-09-13T15:07:07.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.683+0000 7f4a45600640 1 -- 172.21.15.7:0/96266859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a5006d7e0 con 0x7f4a50071a70 2024-09-13T15:07:07.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.687+0000 7f4a47e00640 1 -- 172.21.15.7:0/96266859 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+6301 (secure 0 0 0) 0x7f4a3c0544b0 con 0x7f4a50071a70 2024-09-13T15:07:07.692 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:07:07.693 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:05:28.769591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4220":{"gid":4220,"name":"b","rank":4,"incarnation":19,"state":"up:active","state_seq":61,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:07:07.693 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-13T15:07:07.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.691+0000 7f4a45600640 1 -- 172.21.15.7:0/96266859 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4a30066750 msgr2=0x7f4a30068c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:07.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.691+0000 7f4a45600640 1 --2- 172.21.15.7:0/96266859 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4a30066750 0x7f4a30068c10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4a4001c510 tx=0x7f4a400b5040 comp rx=0 tx=0).stop 2024-09-13T15:07:07.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.691+0000 7f4a45600640 1 -- 172.21.15.7:0/96266859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a50071a70 msgr2=0x7f4a501562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:07.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.691+0000 7f4a45600640 1 --2- 172.21.15.7:0/96266859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a50071a70 0x7f4a501562d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c00b460 tx=0x7f4a3c00b920 comp rx=0 tx=0).stop 2024-09-13T15:07:07.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.691+0000 7f4a45600640 1 -- 172.21.15.7:0/96266859 shutdown_connections 2024-09-13T15:07:07.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.691+0000 7f4a45600640 1 --2- 172.21.15.7:0/96266859 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4a30066750 0x7f4a30068c10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:07.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.691+0000 7f4a45600640 1 --2- 172.21.15.7:0/96266859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4a500b0bf0 0x7f4a500aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:07.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.691+0000 7f4a45600640 1 --2- 172.21.15.7:0/96266859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a50071a70 0x7f4a501562d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:07.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.691+0000 7f4a45600640 1 --2- 172.21.15.7:0/96266859 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4a5006ddb0 0x7f4a50071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:07.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.691+0000 7f4a45600640 1 -- 172.21.15.7:0/96266859 >> 172.21.15.7:0/96266859 conn(0x7f4a50065d40 msgr2=0x7f4a50143120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:07.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.691+0000 7f4a45600640 1 -- 172.21.15.7:0/96266859 shutdown_connections 2024-09-13T15:07:07.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:07.691+0000 7f4a45600640 1 -- 172.21.15.7:0/96266859 wait complete. 2024-09-13T15:07:07.724 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-09-13T15:07:09.725 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.027+0000 7f49c6a00640 1 Processor -- start 2024-09-13T15:07:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.027+0000 7f49c6a00640 1 -- start start 2024-09-13T15:07:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.027+0000 7f49c6a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f49b804ac40 0x7f49b80da510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.027+0000 7f49c6a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f49b804b020 0x7f49b8033ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.031+0000 7f49c6a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b8005e50 con 0x7f49b804bda0 2024-09-13T15:07:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.031+0000 7f49c6a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b8006110 con 0x7f49b804b020 2024-09-13T15:07:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.031+0000 7f49c6a00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b80063f0 con 0x7f49b804ac40 2024-09-13T15:07:10.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.031+0000 7f49c6000640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f49b804bda0 0x7f49b80d42f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40120/0 (socket says 172.21.15.7:40120) 2024-09-13T15:07:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.031+0000 7f49c6000640 1 -- 172.21.15.7:0/3956724549 learned_addr learned my addr 172.21.15.7:0/3956724549 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:07:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.035+0000 7f49c5600640 1 --2- 172.21.15.7:0/3956724549 >> v2:172.21.15.77:3300/0 conn(0x7f49b804ac40 0x7f49b80da510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.035+0000 7f49bfe00640 1 -- 172.21.15.7:0/3956724549 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050135291 0 0) 0x7f49b8005e50 con 0x7f49b804bda0 2024-09-13T15:07:10.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.035+0000 7f49bfe00640 1 -- 172.21.15.7:0/3956724549 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49a8003530 con 0x7f49b804bda0 2024-09-13T15:07:10.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.035+0000 7f49c5600640 1 -- 172.21.15.7:0/3956724549 >> v2:172.21.15.7:3300/0 conn(0x7f49b804b020 msgr2=0x7f49b8033ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:10.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.035+0000 7f49bfe00640 1 -- 172.21.15.7:0/3956724549 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3383286383 0 0) 0x7f49a8003530 con 0x7f49b804bda0 2024-09-13T15:07:10.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.035+0000 7f49c4c00640 1 --2- 172.21.15.7:0/3956724549 >> v2:172.21.15.7:3300/0 conn(0x7f49b804b020 0x7f49b8033ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:10.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.035+0000 7f49c5600640 1 --2- 172.21.15.7:0/3956724549 >> v2:172.21.15.7:3300/0 conn(0x7f49b804b020 0x7f49b8033ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:10.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.035+0000 7f49c5600640 1 -- 172.21.15.7:0/3956724549 >> v1:172.21.15.7:6789/0 conn(0x7f49b804bda0 legacy=0x7f49b80d42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.039+0000 7f49c5600640 1 -- 172.21.15.7:0/3956724549 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b80066d0 con 0x7f49b804ac40 2024-09-13T15:07:10.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.039+0000 7f49c4c00640 1 --2- 172.21.15.7:0/3956724549 >> v2:172.21.15.7:3300/0 conn(0x7f49b804b020 0x7f49b8033ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:07:10.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.059+0000 7f49c5600640 1 --2- 172.21.15.7:0/3956724549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49b804ac40 0x7f49b80da510 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f49b8007500 tx=0x7f49b401ffe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb35e180cffb5193 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:10.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.059+0000 7f49bfe00640 1 -- 172.21.15.7:0/3956724549 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c0074490 con 0x7f49b804ac40 2024-09-13T15:07:10.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.059+0000 7f49bfe00640 1 -- 172.21.15.7:0/3956724549 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b40a9af0 con 0x7f49b804ac40 2024-09-13T15:07:10.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.059+0000 7f49bfe00640 1 -- 172.21.15.7:0/3956724549 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40a9e80 con 0x7f49b804ac40 2024-09-13T15:07:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.059+0000 7f49c6a00640 1 -- 172.21.15.7:0/3956724549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49b804ac40 msgr2=0x7f49b80da510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.059+0000 7f49c6a00640 1 --2- 172.21.15.7:0/3956724549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49b804ac40 0x7f49b80da510 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f49b8007500 tx=0x7f49b401ffe0 comp rx=0 tx=0).stop 2024-09-13T15:07:10.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.063+0000 7f49c6a00640 1 -- 172.21.15.7:0/3956724549 shutdown_connections 2024-09-13T15:07:10.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.063+0000 7f49c6a00640 1 --2- 172.21.15.7:0/3956724549 >> v2:172.21.15.7:3300/0 conn(0x7f49b804b020 0x7f49b8033ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:10.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.063+0000 7f49c6a00640 1 --2- 172.21.15.7:0/3956724549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49b804ac40 0x7f49b80da510 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:10.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.063+0000 7f49c6a00640 1 -- 172.21.15.7:0/3956724549 >> 172.21.15.7:0/3956724549 conn(0x7f49b804fc30 msgr2=0x7f49b8050010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:10.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.063+0000 7f49c6a00640 1 -- 172.21.15.7:0/3956724549 shutdown_connections 2024-09-13T15:07:10.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.063+0000 7f49c6a00640 1 -- 172.21.15.7:0/3956724549 wait complete. 2024-09-13T15:07:10.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.067+0000 7f49c6a00640 1 Processor -- start 2024-09-13T15:07:10.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.071+0000 7f49c6a00640 1 -- start start 2024-09-13T15:07:10.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.071+0000 7f49c6a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49b804ac40 0x7f49b80d9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:10.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.071+0000 7f49c6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49b804b020 0x7f49b81783d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:10.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.071+0000 7f49c5600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49b804ac40 0x7f49b80d9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:10.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.071+0000 7f49c5600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49b804ac40 0x7f49b80d9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:55084/0 (socket says 172.21.15.7:55084) 2024-09-13T15:07:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.071+0000 7f49c6a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49b804bda0 0x7f49b8178910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.071+0000 7f49c6a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b8177fc0 con 0x7f49b804b020 2024-09-13T15:07:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.071+0000 7f49c6a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b817c4a0 con 0x7f49b804bda0 2024-09-13T15:07:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.071+0000 7f49c6a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b8032c10 con 0x7f49b804ac40 2024-09-13T15:07:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.071+0000 7f49c5600640 1 -- 172.21.15.7:0/2518852071 learned_addr learned my addr 172.21.15.7:0/2518852071 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.071+0000 7f49c6000640 1 --2- 172.21.15.7:0/2518852071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49b804bda0 0x7f49b8178910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.071+0000 7f49c5600640 1 -- 172.21.15.7:0/2518852071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49b804bda0 msgr2=0x7f49b8178910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.071+0000 7f49c5600640 1 --2- 172.21.15.7:0/2518852071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49b804bda0 0x7f49b8178910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.071+0000 7f49c5600640 1 -- 172.21.15.7:0/2518852071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49b804b020 msgr2=0x7f49b81783d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.071+0000 7f49c5600640 1 --2- 172.21.15.7:0/2518852071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49b804b020 0x7f49b81783d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.071+0000 7f49c5600640 1 -- 172.21.15.7:0/2518852071 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b400a5c0 con 0x7f49b804ac40 2024-09-13T15:07:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.075+0000 7f49c6000640 1 --2- 172.21.15.7:0/2518852071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49b804bda0 0x7f49b8178910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:07:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.075+0000 7f49c5600640 1 --2- 172.21.15.7:0/2518852071 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49b804ac40 0x7f49b80d9630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f49b401e690 tx=0x7f49b401cd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.075+0000 7f49bd600640 1 -- 172.21.15.7:0/2518852071 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40ba610 con 0x7f49b804ac40 2024-09-13T15:07:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.075+0000 7f49bd600640 1 -- 172.21.15.7:0/2518852071 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b40ba770 con 0x7f49b804ac40 2024-09-13T15:07:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.075+0000 7f49bd600640 1 -- 172.21.15.7:0/2518852071 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40bab00 con 0x7f49b804ac40 2024-09-13T15:07:10.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.075+0000 7f49c6a00640 1 -- 172.21.15.7:0/2518852071 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b817b640 con 0x7f49b804ac40 2024-09-13T15:07:10.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.075+0000 7f49c6a00640 1 -- 172.21.15.7:0/2518852071 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b817bc00 con 0x7f49b804ac40 2024-09-13T15:07:10.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.075+0000 7f49c6a00640 1 -- 172.21.15.7:0/2518852071 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b8005a30 con 0x7f49b804ac40 2024-09-13T15:07:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.075+0000 7f49bd600640 1 -- 172.21.15.7:0/2518852071 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f49b40b8040 con 0x7f49b804ac40 2024-09-13T15:07:10.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.079+0000 7f49bd600640 1 --2- 172.21.15.7:0/2518852071 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f49a0066690 0x7f49a0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:10.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.079+0000 7f49bd600640 1 -- 172.21.15.7:0/2518852071 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f49b41222c0 con 0x7f49b804ac40 2024-09-13T15:07:10.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.079+0000 7f49c4c00640 1 --2- 172.21.15.7:0/2518852071 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f49a0066690 0x7f49a0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:10.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.079+0000 7f49c4c00640 1 --2- 172.21.15.7:0/2518852071 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f49a0066690 0x7f49a0068b50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f49b8045d90 tx=0x7f49ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:10.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.087+0000 7f49bd600640 1 -- 172.21.15.7:0/2518852071 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f49b40ef0f0 con 0x7f49b804ac40 2024-09-13T15:07:10.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.359+0000 7f49c6a00640 1 -- 172.21.15.7:0/2518852071 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49b8178130 con 0x7f49b804ac40 2024-09-13T15:07:10.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.363+0000 7f49bd600640 1 -- 172.21.15.7:0/2518852071 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+6301 (secure 0 0 0) 0x7f49b40b6090 con 0x7f49b804ac40 2024-09-13T15:07:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:07:10.366 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:05:28.769591+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":4220},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4220":{"gid":4220,"name":"b","rank":4,"incarnation":19,"state":"up:active","state_seq":61,"addr":"172.21.15.77:6838/3330080895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":3330080895},{"type":"v1","addr":"172.21.15.77:6838","nonce":3330080895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:07:10.366 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-13T15:07:10.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.363+0000 7f49c6a00640 1 -- 172.21.15.7:0/2518852071 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f49a0066690 msgr2=0x7f49a0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:10.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.363+0000 7f49c6a00640 1 --2- 172.21.15.7:0/2518852071 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f49a0066690 0x7f49a0068b50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f49b8045d90 tx=0x7f49ac008040 comp rx=0 tx=0).stop 2024-09-13T15:07:10.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.363+0000 7f49c6a00640 1 -- 172.21.15.7:0/2518852071 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49b804ac40 msgr2=0x7f49b80d9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:10.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.363+0000 7f49c6a00640 1 --2- 172.21.15.7:0/2518852071 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49b804ac40 0x7f49b80d9630 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f49b401e690 tx=0x7f49b401cd80 comp rx=0 tx=0).stop 2024-09-13T15:07:10.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.363+0000 7f49c6a00640 1 -- 172.21.15.7:0/2518852071 shutdown_connections 2024-09-13T15:07:10.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.363+0000 7f49c6a00640 1 --2- 172.21.15.7:0/2518852071 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f49a0066690 0x7f49a0068b50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:10.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.363+0000 7f49c6a00640 1 --2- 172.21.15.7:0/2518852071 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49b804bda0 0x7f49b8178910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:10.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.363+0000 7f49c6a00640 1 --2- 172.21.15.7:0/2518852071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49b804b020 0x7f49b81783d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:10.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.363+0000 7f49c6a00640 1 --2- 172.21.15.7:0/2518852071 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49b804ac40 0x7f49b80d9630 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:10.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.363+0000 7f49c6a00640 1 -- 172.21.15.7:0/2518852071 >> 172.21.15.7:0/2518852071 conn(0x7f49b804fc30 msgr2=0x7f49b804ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:10.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.367+0000 7f49c6a00640 1 -- 172.21.15.7:0/2518852071 shutdown_connections 2024-09-13T15:07:10.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:10.367+0000 7f49c6a00640 1 -- 172.21.15.7:0/2518852071 wait complete. 2024-09-13T15:07:10.402 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-09-13T15:07:12.403 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:12.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.687+0000 7fac27600640 1 Processor -- start 2024-09-13T15:07:12.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.687+0000 7fac27600640 1 -- start start 2024-09-13T15:07:12.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.691+0000 7fac27600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fac201427c0 0x7fac20142bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:12.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.691+0000 7fac27600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac200c9010 con 0x7fac200c5b20 2024-09-13T15:07:12.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.691+0000 7fac27600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac20143130 con 0x7fac200705e0 2024-09-13T15:07:12.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.691+0000 7fac27600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2015dc40 con 0x7fac201427c0 2024-09-13T15:07:12.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.691+0000 7fac25600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fac201427c0 0x7fac20142bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:12.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.691+0000 7fac25600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fac201427c0 0x7fac20142bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:40948/0 (socket says 172.21.15.7:40948) 2024-09-13T15:07:12.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.691+0000 7fac25600640 1 -- 172.21.15.7:0/3654841826 learned_addr learned my addr 172.21.15.7:0/3654841826 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:12.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.691+0000 7fac25600640 1 -- 172.21.15.7:0/3654841826 >> v1:172.21.15.77:6789/0 conn(0x7fac200705e0 legacy=0x7fac200c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:12.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.691+0000 7fac25600640 1 -- 172.21.15.7:0/3654841826 >> v1:172.21.15.7:6789/0 conn(0x7fac200c5b20 legacy=0x7fac2015d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:12.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.691+0000 7fac25600640 1 -- 172.21.15.7:0/3654841826 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac201433a0 con 0x7fac201427c0 2024-09-13T15:07:12.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.695+0000 7fac25600640 1 --2- 172.21.15.7:0/3654841826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac201427c0 0x7fac20142bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fac18009e50 tx=0x7fac1801c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9cb79cdb4281942 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:12.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.699+0000 7fac1f400640 1 -- 172.21.15.7:0/3654841826 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180a5870 con 0x7fac201427c0 2024-09-13T15:07:12.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.699+0000 7fac1f400640 1 -- 172.21.15.7:0/3654841826 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac180a59d0 con 0x7fac201427c0 2024-09-13T15:07:12.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.699+0000 7fac1f400640 1 -- 172.21.15.7:0/3654841826 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180a5d60 con 0x7fac201427c0 2024-09-13T15:07:12.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.699+0000 7fac27600640 1 -- 172.21.15.7:0/3654841826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac201427c0 msgr2=0x7fac20142bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:12.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.699+0000 7fac27600640 1 --2- 172.21.15.7:0/3654841826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac201427c0 0x7fac20142bf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fac18009e50 tx=0x7fac1801c9b0 comp rx=0 tx=0).stop 2024-09-13T15:07:12.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.699+0000 7fac27600640 1 -- 172.21.15.7:0/3654841826 shutdown_connections 2024-09-13T15:07:12.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.699+0000 7fac27600640 1 --2- 172.21.15.7:0/3654841826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac201427c0 0x7fac20142bf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:12.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.699+0000 7fac27600640 1 -- 172.21.15.7:0/3654841826 >> 172.21.15.7:0/3654841826 conn(0x7fac2006e110 msgr2=0x7fac2006e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:12.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.703+0000 7fac27600640 1 -- 172.21.15.7:0/3654841826 shutdown_connections 2024-09-13T15:07:12.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.703+0000 7fac27600640 1 -- 172.21.15.7:0/3654841826 wait complete. 2024-09-13T15:07:12.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.711+0000 7fac27600640 1 Processor -- start 2024-09-13T15:07:12.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.711+0000 7fac27600640 1 -- start start 2024-09-13T15:07:12.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.715+0000 7fac27600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac200705e0 0x7fac20145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:12.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.715+0000 7fac27600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac200c5b20 0x7fac2013daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:12.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.715+0000 7fac27600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac201427c0 0x7fac20158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:12.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.719+0000 7fac27600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2015ad80 con 0x7fac200c5b20 2024-09-13T15:07:12.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.719+0000 7fac24c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac200705e0 0x7fac20145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:12.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.719+0000 7fac27600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac20144550 con 0x7fac200705e0 2024-09-13T15:07:12.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.719+0000 7fac27600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2015c1c0 con 0x7fac201427c0 2024-09-13T15:07:12.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.719+0000 7fac1fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac200c5b20 0x7fac2013daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:12.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.719+0000 7fac24c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac200705e0 0x7fac20145790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:40962/0 (socket says 172.21.15.7:40962) 2024-09-13T15:07:12.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.719+0000 7fac24c00640 1 -- 172.21.15.7:0/3042830608 learned_addr learned my addr 172.21.15.7:0/3042830608 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:12.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.719+0000 7fac25600640 1 --2- 172.21.15.7:0/3042830608 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac201427c0 0x7fac20158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:12.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.719+0000 7fac24c00640 1 -- 172.21.15.7:0/3042830608 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac201427c0 msgr2=0x7fac20158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:12.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.719+0000 7fac24c00640 1 --2- 172.21.15.7:0/3042830608 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac201427c0 0x7fac20158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:12.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.719+0000 7fac24c00640 1 -- 172.21.15.7:0/3042830608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac200c5b20 msgr2=0x7fac2013daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:12.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.719+0000 7fac24c00640 1 --2- 172.21.15.7:0/3042830608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac200c5b20 0x7fac2013daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:12.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.719+0000 7fac24c00640 1 -- 172.21.15.7:0/3042830608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac18009b30 con 0x7fac200705e0 2024-09-13T15:07:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.719+0000 7fac24c00640 1 --2- 172.21.15.7:0/3042830608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac200705e0 0x7fac20145790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00c480 tx=0x7fac0c00c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.719+0000 7fac1cc00640 1 -- 172.21.15.7:0/3042830608 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c012830 con 0x7fac200705e0 2024-09-13T15:07:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.723+0000 7fac1cc00640 1 -- 172.21.15.7:0/3042830608 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c0129b0 con 0x7fac200705e0 2024-09-13T15:07:12.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.723+0000 7fac1cc00640 1 -- 172.21.15.7:0/3042830608 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c012d60 con 0x7fac200705e0 2024-09-13T15:07:12.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.723+0000 7fac27600640 1 -- 172.21.15.7:0/3042830608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac20145cd0 con 0x7fac200705e0 2024-09-13T15:07:12.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.723+0000 7fac27600640 1 -- 172.21.15.7:0/3042830608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac20143c20 con 0x7fac200705e0 2024-09-13T15:07:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.723+0000 7fac27600640 1 -- 172.21.15.7:0/3042830608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac200c9480 con 0x7fac200705e0 2024-09-13T15:07:12.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.727+0000 7fac1cc00640 1 -- 172.21.15.7:0/3042830608 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fac0c01c460 con 0x7fac200705e0 2024-09-13T15:07:12.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.727+0000 7fac1cc00640 1 --2- 172.21.15.7:0/3042830608 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fac00066690 0x7fac00068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:12.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.727+0000 7fac1cc00640 1 -- 172.21.15.7:0/3042830608 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7fac0c0844a0 con 0x7fac200705e0 2024-09-13T15:07:12.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.727+0000 7fac1fe00640 1 --2- 172.21.15.7:0/3042830608 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fac00066690 0x7fac00068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:12.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.727+0000 7fac1fe00640 1 --2- 172.21.15.7:0/3042830608 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fac00066690 0x7fac00068b50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fac20156ab0 tx=0x7fac14009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:12.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:12.739+0000 7fac1cc00640 1 -- 172.21.15.7:0/3042830608 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fac200c9480 con 0x7fac200705e0 2024-09-13T15:07:13.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.159+0000 7fac27600640 1 -- 172.21.15.7:0/3042830608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac200c9480 con 0x7fac200705e0 2024-09-13T15:07:13.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.159+0000 7fac1cc00640 1 -- 172.21.15.7:0/3042830608 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+5544 (secure 0 0 0) 0x7fac200c9480 con 0x7fac200705e0 2024-09-13T15:07:13.163 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:07:13.163 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:12.613915+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:07:13.163 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-13T15:07:13.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.163+0000 7fac27600640 1 -- 172.21.15.7:0/3042830608 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fac00066690 msgr2=0x7fac00068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:13.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.163+0000 7fac27600640 1 --2- 172.21.15.7:0/3042830608 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fac00066690 0x7fac00068b50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fac20156ab0 tx=0x7fac14009040 comp rx=0 tx=0).stop 2024-09-13T15:07:13.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.163+0000 7fac27600640 1 -- 172.21.15.7:0/3042830608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac200705e0 msgr2=0x7fac20145790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:13.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.163+0000 7fac27600640 1 --2- 172.21.15.7:0/3042830608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac200705e0 0x7fac20145790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00c480 tx=0x7fac0c00c940 comp rx=0 tx=0).stop 2024-09-13T15:07:13.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.163+0000 7fac27600640 1 -- 172.21.15.7:0/3042830608 shutdown_connections 2024-09-13T15:07:13.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.163+0000 7fac27600640 1 --2- 172.21.15.7:0/3042830608 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fac00066690 0x7fac00068b50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.163+0000 7fac27600640 1 --2- 172.21.15.7:0/3042830608 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fac201427c0 0x7fac20158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.163+0000 7fac27600640 1 --2- 172.21.15.7:0/3042830608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fac200c5b20 0x7fac2013daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.163+0000 7fac27600640 1 --2- 172.21.15.7:0/3042830608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac200705e0 0x7fac20145790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.163+0000 7fac27600640 1 -- 172.21.15.7:0/3042830608 >> 172.21.15.7:0/3042830608 conn(0x7fac2006e110 msgr2=0x7fac200c3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:13.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.163+0000 7fac27600640 1 -- 172.21.15.7:0/3042830608 shutdown_connections 2024-09-13T15:07:13.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.163+0000 7fac27600640 1 -- 172.21.15.7:0/3042830608 wait complete. 2024-09-13T15:07:13.186 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b down, removed from mdsmap 2024-09-13T15:07:13.186 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-09-13T15:07:13.187 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:13.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.343+0000 7fe66fe00640 1 Processor -- start 2024-09-13T15:07:13.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.343+0000 7fe66fe00640 1 -- start start 2024-09-13T15:07:13.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.343+0000 7fe66fe00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe6700c9b60 0x7fe67006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:13.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.347+0000 7fe66fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe6700ca8e0 0x7fe6700cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:13.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.347+0000 7fe66fe00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6700c8150 con 0x7fe6700c9780 2024-09-13T15:07:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.347+0000 7fe66fe00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6700c7580 con 0x7fe6700ca8e0 2024-09-13T15:07:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.347+0000 7fe66fe00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6700c7820 con 0x7fe6700c9b60 2024-09-13T15:07:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.347+0000 7fe66e000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe6700c9b60 0x7fe67006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.347+0000 7fe66e000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe6700c9b60 0x7fe67006ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:40964/0 (socket says 172.21.15.7:40964) 2024-09-13T15:07:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.347+0000 7fe66e000640 1 -- 172.21.15.7:0/2943546867 learned_addr learned my addr 172.21.15.7:0/2943546867 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:13.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.347+0000 7fe66e000640 1 -- 172.21.15.7:0/2943546867 >> v2:172.21.15.7:3300/0 conn(0x7fe6700ca8e0 msgr2=0x7fe6700cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:13.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.347+0000 7fe66e000640 1 --2- 172.21.15.7:0/2943546867 >> v2:172.21.15.7:3300/0 conn(0x7fe6700ca8e0 0x7fe6700cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.347+0000 7fe66e000640 1 -- 172.21.15.7:0/2943546867 >> v1:172.21.15.7:6789/0 conn(0x7fe6700c9780 legacy=0x7fe670157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:13.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.347+0000 7fe66e000640 1 -- 172.21.15.7:0/2943546867 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6700c7b00 con 0x7fe6700c9b60 2024-09-13T15:07:13.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.351+0000 7fe66e000640 1 --2- 172.21.15.7:0/2943546867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6700c9b60 0x7fe67006ddb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe67015b0a0 tx=0x7fe65c01c320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=199fd68632fb3251 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.351+0000 7fe66d600640 1 -- 172.21.15.7:0/2943546867 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c0ab600 con 0x7fe6700c9b60 2024-09-13T15:07:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.351+0000 7fe66d600640 1 -- 172.21.15.7:0/2943546867 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c0a7050 con 0x7fe6700c9b60 2024-09-13T15:07:13.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.351+0000 7fe66d600640 1 -- 172.21.15.7:0/2943546867 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c0ab600 con 0x7fe6700c9b60 2024-09-13T15:07:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.355+0000 7fe66fe00640 1 -- 172.21.15.7:0/2943546867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6700c9b60 msgr2=0x7fe67006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:13.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.355+0000 7fe66fe00640 1 --2- 172.21.15.7:0/2943546867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6700c9b60 0x7fe67006ddb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe67015b0a0 tx=0x7fe65c01c320 comp rx=0 tx=0).stop 2024-09-13T15:07:13.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.367+0000 7fe66fe00640 1 -- 172.21.15.7:0/2943546867 shutdown_connections 2024-09-13T15:07:13.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.367+0000 7fe66fe00640 1 --2- 172.21.15.7:0/2943546867 >> v2:172.21.15.7:3300/0 conn(0x7fe6700ca8e0 0x7fe6700cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.367+0000 7fe66fe00640 1 --2- 172.21.15.7:0/2943546867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6700c9b60 0x7fe67006ddb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.367+0000 7fe66fe00640 1 -- 172.21.15.7:0/2943546867 >> 172.21.15.7:0/2943546867 conn(0x7fe670065d40 msgr2=0x7fe670066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:13.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.367+0000 7fe66fe00640 1 -- 172.21.15.7:0/2943546867 shutdown_connections 2024-09-13T15:07:13.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.367+0000 7fe66fe00640 1 -- 172.21.15.7:0/2943546867 wait complete. 2024-09-13T15:07:13.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.367+0000 7fe66fe00640 1 Processor -- start 2024-09-13T15:07:13.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.367+0000 7fe66fe00640 1 -- start start 2024-09-13T15:07:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.371+0000 7fe66fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6700c9780 0x7fe67006b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.371+0000 7fe66fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6700c9b60 0x7fe670143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:13.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.371+0000 7fe66fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6700ca8e0 0x7fe6701440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.371+0000 7fe66ea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6700c9780 0x7fe67006b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.371+0000 7fe66ea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6700c9780 0x7fe67006b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:55104/0 (socket says 172.21.15.7:55104) 2024-09-13T15:07:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.371+0000 7fe66f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6700ca8e0 0x7fe6701440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:13.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.371+0000 7fe66fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6701506d0 con 0x7fe6700c9b60 2024-09-13T15:07:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.371+0000 7fe66f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6700ca8e0 0x7fe6701440f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:40968/0 (socket says 172.21.15.7:40968) 2024-09-13T15:07:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.371+0000 7fe66fe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67014efe0 con 0x7fe6700ca8e0 2024-09-13T15:07:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.371+0000 7fe66fe00640 1 -- 172.21.15.7:0/845608091 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67014be80 con 0x7fe6700c9780 2024-09-13T15:07:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.371+0000 7fe66f400640 1 -- 172.21.15.7:0/845608091 learned_addr learned my addr 172.21.15.7:0/845608091 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:13.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.375+0000 7fe66e000640 1 --2- 172.21.15.7:0/845608091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6700c9b60 0x7fe670143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.375+0000 7fe66f400640 1 -- 172.21.15.7:0/845608091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6700c9780 msgr2=0x7fe67006b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.375+0000 7fe66f400640 1 --2- 172.21.15.7:0/845608091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6700c9780 0x7fe67006b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.375+0000 7fe66f400640 1 -- 172.21.15.7:0/845608091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6700c9b60 msgr2=0x7fe670143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:13.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.375+0000 7fe66f400640 1 --2- 172.21.15.7:0/845608091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6700c9b60 0x7fe670143bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.375+0000 7fe66f400640 1 -- 172.21.15.7:0/845608091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c0094d0 con 0x7fe6700ca8e0 2024-09-13T15:07:13.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.375+0000 7fe66e000640 1 --2- 172.21.15.7:0/845608091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6700c9b60 0x7fe670143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:13.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.375+0000 7fe66ea00640 1 --2- 172.21.15.7:0/845608091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6700c9780 0x7fe67006b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:13.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.375+0000 7fe66f400640 1 --2- 172.21.15.7:0/845608091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6700ca8e0 0x7fe6701440f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe66800b9a0 tx=0x7fe66800be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:13.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.375+0000 7fe666a00640 1 -- 172.21.15.7:0/845608091 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800cba0 con 0x7fe6700ca8e0 2024-09-13T15:07:13.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.379+0000 7fe666a00640 1 -- 172.21.15.7:0/845608091 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66800cd20 con 0x7fe6700ca8e0 2024-09-13T15:07:13.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.379+0000 7fe666a00640 1 -- 172.21.15.7:0/845608091 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668014680 con 0x7fe6700ca8e0 2024-09-13T15:07:13.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.379+0000 7fe66fe00640 1 -- 172.21.15.7:0/845608091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67014e840 con 0x7fe6700ca8e0 2024-09-13T15:07:13.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.379+0000 7fe66fe00640 1 -- 172.21.15.7:0/845608091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67014e280 con 0x7fe6700ca8e0 2024-09-13T15:07:13.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.383+0000 7fe666a00640 1 -- 172.21.15.7:0/845608091 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe66801d3b0 con 0x7fe6700ca8e0 2024-09-13T15:07:13.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.383+0000 7fe66fe00640 1 -- 172.21.15.7:0/845608091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe67014f150 con 0x7fe6700ca8e0 2024-09-13T15:07:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.383+0000 7fe666a00640 1 --2- 172.21.15.7:0/845608091 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe650066790 0x7fe650068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:13.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.383+0000 7fe666a00640 1 -- 172.21.15.7:0/845608091 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7fe668084450 con 0x7fe6700ca8e0 2024-09-13T15:07:13.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.383+0000 7fe66ea00640 1 --2- 172.21.15.7:0/845608091 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe650066790 0x7fe650068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:13.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.387+0000 7fe66ea00640 1 --2- 172.21.15.7:0/845608091 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe650066790 0x7fe650068c50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe6600124e0 tx=0x7fe66000c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:13.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.395+0000 7fe666a00640 1 -- 172.21.15.7:0/845608091 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe668051470 con 0x7fe6700ca8e0 2024-09-13T15:07:13.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.875+0000 7fe66fe00640 1 -- 172.21.15.7:0/845608091 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe670067680 con 0x7fe6700ca8e0 2024-09-13T15:07:13.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.875+0000 7fe666a00640 1 -- 172.21.15.7:0/845608091 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+5544 (secure 0 0 0) 0x7fe668019070 con 0x7fe6700ca8e0 2024-09-13T15:07:13.880 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:07:13.880 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:12.613915+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:07:13.881 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-13T15:07:13.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.883+0000 7fe66fe00640 1 -- 172.21.15.7:0/845608091 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe650066790 msgr2=0x7fe650068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:13.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.883+0000 7fe66fe00640 1 --2- 172.21.15.7:0/845608091 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe650066790 0x7fe650068c50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe6600124e0 tx=0x7fe66000c040 comp rx=0 tx=0).stop 2024-09-13T15:07:13.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.883+0000 7fe66fe00640 1 -- 172.21.15.7:0/845608091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6700ca8e0 msgr2=0x7fe6701440f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:13.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.883+0000 7fe66fe00640 1 --2- 172.21.15.7:0/845608091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6700ca8e0 0x7fe6701440f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe66800b9a0 tx=0x7fe66800be60 comp rx=0 tx=0).stop 2024-09-13T15:07:13.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.883+0000 7fe66fe00640 1 -- 172.21.15.7:0/845608091 shutdown_connections 2024-09-13T15:07:13.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.883+0000 7fe66fe00640 1 --2- 172.21.15.7:0/845608091 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe650066790 0x7fe650068c50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.883+0000 7fe66fe00640 1 --2- 172.21.15.7:0/845608091 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe6700ca8e0 0x7fe6701440f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.883+0000 7fe66fe00640 1 --2- 172.21.15.7:0/845608091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6700c9b60 0x7fe670143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.883+0000 7fe66fe00640 1 --2- 172.21.15.7:0/845608091 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe6700c9780 0x7fe67006b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:13.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.883+0000 7fe66fe00640 1 -- 172.21.15.7:0/845608091 >> 172.21.15.7:0/845608091 conn(0x7fe670065d40 msgr2=0x7fe6700caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:13.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.883+0000 7fe66fe00640 1 -- 172.21.15.7:0/845608091 shutdown_connections 2024-09-13T15:07:13.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:13.883+0000 7fe66fe00640 1 -- 172.21.15.7:0/845608091 wait complete. 2024-09-13T15:07:13.907 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:07:13.925 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:07:13.939 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 25, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-13T15:01:44.789559+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 25, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3, 4 ], "info": { "gid_4238": { "addr": "172.21.15.7:6837/3369648543", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6835", "nonce": 3369648543, "type": "v2" }, { "addr": "172.21.15.7:6837", "nonce": 3369648543, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4238, "incarnation": 15, "join_fscid": -1, "name": "a", "rank": 3, "state": "up:active", "state_seq": 44 }, "gid_4252": { "addr": "172.21.15.77:6835/2367107997", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6834", "nonce": 2367107997, "type": "v2" }, { "addr": "172.21.15.77:6835", "nonce": 2367107997, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4252, "incarnation": 13, "join_fscid": -1, "name": "d", "rank": 2, "state": "up:active", "state_seq": 43 }, "gid_4267": { "addr": "172.21.15.77:6839/2233000674", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6837", "nonce": 2233000674, "type": "v2" }, { "addr": "172.21.15.77:6839", "nonce": 2233000674, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4267, "incarnation": 9, "join_fscid": -1, "name": "f", "rank": 1, "state": "up:active", "state_seq": 41 }, "gid_4276": { "addr": "172.21.15.7:6836/2396967179", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6834", "nonce": 2396967179, "type": "v2" }, { "addr": "172.21.15.7:6836", "nonce": 2396967179, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4276, "incarnation": 4, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_5230": { "addr": "172.21.15.7:6833/2896136827", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6832", "nonce": 2896136827, "type": "v2" }, { "addr": "172.21.15.7:6833", "nonce": 2896136827, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5230, "incarnation": 25, "join_fscid": -1, "name": "e", "rank": 4, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 5, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-13T15:07:12.613915+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4276, "mds_1": 4267, "mds_2": 4252, "mds_3": 4238, "mds_4": 5230 } } } ], "standbys": [] } 2024-09-13T15:07:15.352 INFO:tasks.workunit.client.0.smithi007.stdout:fs setup took 60 secs 2024-09-13T15:07:15.939 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:16.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.119+0000 7f3aa6600640 1 Processor -- start 2024-09-13T15:07:16.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.119+0000 7f3aa6600640 1 -- start start 2024-09-13T15:07:16.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.119+0000 7f3aa6600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3aa015d0b0 0x7f3aa006aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.119+0000 7f3aa6600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3aa00c6440 0x7f3aa00c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.119+0000 7f3aa6600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aa00c9260 con 0x7f3aa006a1e0 2024-09-13T15:07:16.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.119+0000 7f3aa6600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa006af50 con 0x7f3aa015d0b0 2024-09-13T15:07:16.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.119+0000 7f3aa6600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa00c8670 con 0x7f3aa00c6440 2024-09-13T15:07:16.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.119+0000 7f3a9f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3aa015d0b0 0x7f3aa006aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.119+0000 7f3a9f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f3aa015d0b0 0x7f3aa006aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38314/0 (socket says 172.21.15.7:38314) 2024-09-13T15:07:16.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.119+0000 7f3a9f400640 1 -- 172.21.15.7:0/949161474 learned_addr learned my addr 172.21.15.7:0/949161474 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:16.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.119+0000 7f3a9fe00640 1 --2- 172.21.15.7:0/949161474 >> v2:172.21.15.77:3300/0 conn(0x7f3aa00c6440 0x7f3aa00c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.119+0000 7f3a9f400640 1 -- 172.21.15.7:0/949161474 >> v2:172.21.15.77:3300/0 conn(0x7f3aa00c6440 msgr2=0x7f3aa00c6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:16.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.119+0000 7f3a9f400640 1 --2- 172.21.15.7:0/949161474 >> v2:172.21.15.77:3300/0 conn(0x7f3aa00c6440 0x7f3aa00c6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.119+0000 7f3a9f400640 1 -- 172.21.15.7:0/949161474 >> v1:172.21.15.7:6789/0 conn(0x7f3aa006a1e0 legacy=0x7f3aa00c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:16.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.119+0000 7f3a9f400640 1 -- 172.21.15.7:0/949161474 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa00707b0 con 0x7f3aa015d0b0 2024-09-13T15:07:16.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.127+0000 7f3a9f400640 1 --2- 172.21.15.7:0/949161474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3aa015d0b0 0x7f3aa006aa10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00c7f80 tx=0x7f3a8801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d597eaa87b1a59b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:16.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.127+0000 7f3a9ea00640 1 -- 172.21.15.7:0/949161474 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a880a89d0 con 0x7f3aa015d0b0 2024-09-13T15:07:16.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.127+0000 7f3a9ea00640 1 -- 172.21.15.7:0/949161474 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a880a8b30 con 0x7f3aa015d0b0 2024-09-13T15:07:16.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.127+0000 7f3a9ea00640 1 -- 172.21.15.7:0/949161474 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a880b0440 con 0x7f3aa015d0b0 2024-09-13T15:07:16.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.131+0000 7f3aa6600640 1 -- 172.21.15.7:0/949161474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3aa015d0b0 msgr2=0x7f3aa006aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.131+0000 7f3aa6600640 1 --2- 172.21.15.7:0/949161474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3aa015d0b0 0x7f3aa006aa10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3aa00c7f80 tx=0x7f3a8801ecd0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.131+0000 7f3aa6600640 1 -- 172.21.15.7:0/949161474 shutdown_connections 2024-09-13T15:07:16.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.131+0000 7f3aa6600640 1 --2- 172.21.15.7:0/949161474 >> v2:172.21.15.77:3300/0 conn(0x7f3aa00c6440 0x7f3aa00c6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.131+0000 7f3aa6600640 1 --2- 172.21.15.7:0/949161474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3aa015d0b0 0x7f3aa006aa10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.131+0000 7f3aa6600640 1 -- 172.21.15.7:0/949161474 >> 172.21.15.7:0/949161474 conn(0x7f3aa006e2a0 msgr2=0x7f3aa006e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:16.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.131+0000 7f3aa6600640 1 -- 172.21.15.7:0/949161474 shutdown_connections 2024-09-13T15:07:16.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.131+0000 7f3aa6600640 1 -- 172.21.15.7:0/949161474 wait complete. 2024-09-13T15:07:16.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.135+0000 7f3aa6600640 1 Processor -- start 2024-09-13T15:07:16.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.135+0000 7f3aa6600640 1 -- start start 2024-09-13T15:07:16.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.135+0000 7f3aa6600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3aa006a1e0 0x7f3aa01491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.135+0000 7f3aa6600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3aa00c6440 0x7f3aa0151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.135+0000 7f3aa6600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3aa015d0b0 0x7f3aa0149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.135+0000 7f3aa6600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa01f2e00 con 0x7f3aa015d0b0 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.135+0000 7f3aa6600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa01576c0 con 0x7f3aa006a1e0 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.135+0000 7f3aa6600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa014bb30 con 0x7f3aa00c6440 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.135+0000 7f3a9fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3aa015d0b0 0x7f3aa0149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.135+0000 7f3a9fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3aa015d0b0 0x7f3aa0149b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38328/0 (socket says 172.21.15.7:38328) 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.135+0000 7f3a9fe00640 1 -- 172.21.15.7:0/3433517208 learned_addr learned my addr 172.21.15.7:0/3433517208 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.135+0000 7f3a9f400640 1 --2- 172.21.15.7:0/3433517208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3aa006a1e0 0x7f3aa01491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.139+0000 7f3a96a00640 1 --2- 172.21.15.7:0/3433517208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3aa00c6440 0x7f3aa0151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.139+0000 7f3a9f400640 1 -- 172.21.15.7:0/3433517208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3aa00c6440 msgr2=0x7f3aa0151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.139+0000 7f3a9f400640 1 --2- 172.21.15.7:0/3433517208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3aa00c6440 0x7f3aa0151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.139+0000 7f3a9f400640 1 -- 172.21.15.7:0/3433517208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3aa015d0b0 msgr2=0x7f3aa0149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.139+0000 7f3a9f400640 1 --2- 172.21.15.7:0/3433517208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3aa015d0b0 0x7f3aa0149b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.139+0000 7f3a9f400640 1 -- 172.21.15.7:0/3433517208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a880094d0 con 0x7f3aa006a1e0 2024-09-13T15:07:16.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.139+0000 7f3a96a00640 1 --2- 172.21.15.7:0/3433517208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3aa00c6440 0x7f3aa0151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:07:16.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.139+0000 7f3a9f400640 1 --2- 172.21.15.7:0/3433517208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3aa006a1e0 0x7f3aa01491c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3aa006bbe0 tx=0x7f3a8801ba70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:16.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.143+0000 7f3a97e00640 1 -- 172.21.15.7:0/3433517208 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a880cb610 con 0x7f3aa006a1e0 2024-09-13T15:07:16.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.143+0000 7f3a97e00640 1 -- 172.21.15.7:0/3433517208 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a880cb790 con 0x7f3aa006a1e0 2024-09-13T15:07:16.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.143+0000 7f3a97e00640 1 -- 172.21.15.7:0/3433517208 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a880cbb40 con 0x7f3aa006a1e0 2024-09-13T15:07:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.143+0000 7f3aa6600640 1 -- 172.21.15.7:0/3433517208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa014b240 con 0x7f3aa006a1e0 2024-09-13T15:07:16.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.143+0000 7f3aa6600640 1 -- 172.21.15.7:0/3433517208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa01f2b20 con 0x7f3aa006a1e0 2024-09-13T15:07:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.147+0000 7f3a97e00640 1 -- 172.21.15.7:0/3433517208 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3a880cbca0 con 0x7f3aa006a1e0 2024-09-13T15:07:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.147+0000 7f3a97e00640 1 --2- 172.21.15.7:0/3433517208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3a7c0666e0 0x7f3a7c068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.147+0000 7f3a97e00640 1 -- 172.21.15.7:0/3433517208 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f3a881339e0 con 0x7f3aa006a1e0 2024-09-13T15:07:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.147+0000 7f3a96a00640 1 --2- 172.21.15.7:0/3433517208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3a7c0666e0 0x7f3a7c068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:16.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.147+0000 7f3aa6600640 1 -- 172.21.15.7:0/3433517208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa00ccc30 con 0x7f3aa006a1e0 2024-09-13T15:07:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.151+0000 7f3a96a00640 1 --2- 172.21.15.7:0/3433517208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3a7c0666e0 0x7f3a7c068ba0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3aa015b760 tx=0x7f3a90009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:16.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.163+0000 7f3a97e00640 1 -- 172.21.15.7:0/3433517208 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3a880b5030 con 0x7f3aa006a1e0 2024-09-13T15:07:16.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.611+0000 7f3aa6600640 1 -- 172.21.15.7:0/3433517208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3aa00ccc30 con 0x7f3aa006a1e0 2024-09-13T15:07:16.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.615+0000 7f3a97e00640 1 -- 172.21.15.7:0/3433517208 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+5544 (secure 0 0 0) 0x7f3a880b5020 con 0x7f3aa006a1e0 2024-09-13T15:07:16.617 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:07:16.618 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:12.613915+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:07:16.618 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-13T15:07:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.615+0000 7f3aa6600640 1 -- 172.21.15.7:0/3433517208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3a7c0666e0 msgr2=0x7f3a7c068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.615+0000 7f3aa6600640 1 --2- 172.21.15.7:0/3433517208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3a7c0666e0 0x7f3a7c068ba0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3aa015b760 tx=0x7f3a90009040 comp rx=0 tx=0).stop 2024-09-13T15:07:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.615+0000 7f3aa6600640 1 -- 172.21.15.7:0/3433517208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3aa006a1e0 msgr2=0x7f3aa01491c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.615+0000 7f3aa6600640 1 --2- 172.21.15.7:0/3433517208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3aa006a1e0 0x7f3aa01491c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3aa006bbe0 tx=0x7f3a8801ba70 comp rx=0 tx=0).stop 2024-09-13T15:07:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.615+0000 7f3aa6600640 1 -- 172.21.15.7:0/3433517208 shutdown_connections 2024-09-13T15:07:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.615+0000 7f3aa6600640 1 --2- 172.21.15.7:0/3433517208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3a7c0666e0 0x7f3a7c068ba0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.615+0000 7f3aa6600640 1 --2- 172.21.15.7:0/3433517208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3aa015d0b0 0x7f3aa0149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.615+0000 7f3aa6600640 1 --2- 172.21.15.7:0/3433517208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3aa00c6440 0x7f3aa0151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.615+0000 7f3aa6600640 1 --2- 172.21.15.7:0/3433517208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3aa006a1e0 0x7f3aa01491c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:16.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.615+0000 7f3aa6600640 1 -- 172.21.15.7:0/3433517208 >> 172.21.15.7:0/3433517208 conn(0x7f3aa006e2a0 msgr2=0x7f3aa0152530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:16.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.615+0000 7f3aa6600640 1 -- 172.21.15.7:0/3433517208 shutdown_connections 2024-09-13T15:07:16.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:16.615+0000 7f3aa6600640 1 -- 172.21.15.7:0/3433517208 wait complete. 2024-09-13T15:07:16.647 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:07:18.649 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.831+0000 7f4b6d600640 1 Processor -- start 2024-09-13T15:07:18.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.831+0000 7f4b6d600640 1 -- start start 2024-09-13T15:07:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.831+0000 7f4b6d600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4b68066860 0x7f4b680c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.831+0000 7f4b6d600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4b68158bb0 0x7f4b68159020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.831+0000 7f4b6d600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b68158720 con 0x7f4b680c08a0 2024-09-13T15:07:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.831+0000 7f4b6d600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b68155130 con 0x7f4b68066860 2024-09-13T15:07:18.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.831+0000 7f4b6d600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b68159560 con 0x7f4b68158bb0 2024-09-13T15:07:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.831+0000 7f4b66000640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4b680c08a0 0x7f4b680c77f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:57432/0 (socket says 172.21.15.7:57432) 2024-09-13T15:07:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.831+0000 7f4b66000640 1 -- 172.21.15.7:0/1646528597 learned_addr learned my addr 172.21.15.7:0/1646528597 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:07:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.831+0000 7f4b67400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4b68158bb0 0x7f4b68159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:18.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.835+0000 7f4b66a00640 1 --2- 172.21.15.7:0/1646528597 >> v2:172.21.15.7:3300/0 conn(0x7f4b68066860 0x7f4b680c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:18.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.835+0000 7f4b65600640 1 -- 172.21.15.7:0/1646528597 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181125214 0 0) 0x7f4b68158720 con 0x7f4b680c08a0 2024-09-13T15:07:18.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.835+0000 7f4b65600640 1 -- 172.21.15.7:0/1646528597 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b4c003530 con 0x7f4b680c08a0 2024-09-13T15:07:18.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.835+0000 7f4b67400640 1 -- 172.21.15.7:0/1646528597 >> v2:172.21.15.7:3300/0 conn(0x7f4b68066860 msgr2=0x7f4b680c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:18.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.835+0000 7f4b67400640 1 --2- 172.21.15.7:0/1646528597 >> v2:172.21.15.7:3300/0 conn(0x7f4b68066860 0x7f4b680c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:18.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.835+0000 7f4b67400640 1 -- 172.21.15.7:0/1646528597 >> v1:172.21.15.77:6789/0 conn(0x7f4b680c08a0 legacy=0x7f4b680c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:18.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.835+0000 7f4b67400640 1 -- 172.21.15.7:0/1646528597 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b68155320 con 0x7f4b68158bb0 2024-09-13T15:07:18.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.835+0000 7f4b67400640 1 --2- 172.21.15.7:0/1646528597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4b68158bb0 0x7f4b68159020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4b500097c0 tx=0x7f4b5001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=719e66fb667e33fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:18.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.839+0000 7f4b65600640 1 -- 172.21.15.7:0/1646528597 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b500a6040 con 0x7f4b68158bb0 2024-09-13T15:07:18.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.839+0000 7f4b65600640 1 -- 172.21.15.7:0/1646528597 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b500aa600 con 0x7f4b68158bb0 2024-09-13T15:07:18.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.839+0000 7f4b65600640 1 -- 172.21.15.7:0/1646528597 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b500aa990 con 0x7f4b68158bb0 2024-09-13T15:07:18.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.839+0000 7f4b6d600640 1 -- 172.21.15.7:0/1646528597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4b68158bb0 msgr2=0x7f4b68159020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:18.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.839+0000 7f4b6d600640 1 --2- 172.21.15.7:0/1646528597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4b68158bb0 0x7f4b68159020 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4b500097c0 tx=0x7f4b5001c4c0 comp rx=0 tx=0).stop 2024-09-13T15:07:18.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.839+0000 7f4b6d600640 1 -- 172.21.15.7:0/1646528597 shutdown_connections 2024-09-13T15:07:18.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.839+0000 7f4b6d600640 1 --2- 172.21.15.7:0/1646528597 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4b68158bb0 0x7f4b68159020 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:18.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.839+0000 7f4b6d600640 1 --2- 172.21.15.7:0/1646528597 >> v2:172.21.15.7:3300/0 conn(0x7f4b68066860 0x7f4b680c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:18.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.839+0000 7f4b6d600640 1 -- 172.21.15.7:0/1646528597 >> 172.21.15.7:0/1646528597 conn(0x7f4b68065d40 msgr2=0x7f4b68066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:18.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.839+0000 7f4b6d600640 1 -- 172.21.15.7:0/1646528597 shutdown_connections 2024-09-13T15:07:18.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.839+0000 7f4b6d600640 1 -- 172.21.15.7:0/1646528597 wait complete. 2024-09-13T15:07:18.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b6d600640 1 Processor -- start 2024-09-13T15:07:18.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b6d600640 1 -- start start 2024-09-13T15:07:18.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b6d600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b68066860 0x7f4b68149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:18.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b6d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b680c08a0 0x7f4b681575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:18.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b6d600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4b68158bb0 0x7f4b680c39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:18.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b6d600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b680c4570 con 0x7f4b680c08a0 2024-09-13T15:07:18.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b6d600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b680c3170 con 0x7f4b68066860 2024-09-13T15:07:18.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b6d600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b681582b0 con 0x7f4b68158bb0 2024-09-13T15:07:18.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b66a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b68066860 0x7f4b68149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:18.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b66a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b68066860 0x7f4b68149c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:42180/0 (socket says 172.21.15.7:42180) 2024-09-13T15:07:18.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b66a00640 1 -- 172.21.15.7:0/3185722840 learned_addr learned my addr 172.21.15.7:0/3185722840 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:18.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b67400640 1 --2- 172.21.15.7:0/3185722840 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4b68158bb0 0x7f4b680c39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:18.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b66000640 1 --2- 172.21.15.7:0/3185722840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b680c08a0 0x7f4b681575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b66a00640 1 -- 172.21.15.7:0/3185722840 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4b68158bb0 msgr2=0x7f4b680c39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b66a00640 1 --2- 172.21.15.7:0/3185722840 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4b68158bb0 0x7f4b680c39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b66a00640 1 -- 172.21.15.7:0/3185722840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b680c08a0 msgr2=0x7f4b681575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b66a00640 1 --2- 172.21.15.7:0/3185722840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b680c08a0 0x7f4b681575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b66a00640 1 -- 172.21.15.7:0/3185722840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b50009420 con 0x7f4b68066860 2024-09-13T15:07:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b66000640 1 --2- 172.21.15.7:0/3185722840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b680c08a0 0x7f4b681575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b66a00640 1 --2- 172.21.15.7:0/3185722840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b68066860 0x7f4b68149c80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800e870 tx=0x7f4b5800ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:18.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b5ea00640 1 -- 172.21.15.7:0/3185722840 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58009510 con 0x7f4b68066860 2024-09-13T15:07:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b5ea00640 1 -- 172.21.15.7:0/3185722840 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5800eec0 con 0x7f4b68066860 2024-09-13T15:07:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b5ea00640 1 -- 172.21.15.7:0/3185722840 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5800cb40 con 0x7f4b68066860 2024-09-13T15:07:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.843+0000 7f4b6d600640 1 -- 172.21.15.7:0/3185722840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b68158550 con 0x7f4b68066860 2024-09-13T15:07:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.847+0000 7f4b6d600640 1 -- 172.21.15.7:0/3185722840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6814bd20 con 0x7f4b68066860 2024-09-13T15:07:18.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.847+0000 7f4b6d600640 1 -- 172.21.15.7:0/3185722840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b68148ee0 con 0x7f4b68066860 2024-09-13T15:07:18.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.847+0000 7f4b5ea00640 1 -- 172.21.15.7:0/3185722840 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4b5800cca0 con 0x7f4b68066860 2024-09-13T15:07:18.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.851+0000 7f4b5ea00640 1 --2- 172.21.15.7:0/3185722840 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4b440666c0 0x7f4b44068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:18.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.851+0000 7f4b5ea00640 1 -- 172.21.15.7:0/3185722840 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f4b58084dc0 con 0x7f4b68066860 2024-09-13T15:07:18.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.851+0000 7f4b66000640 1 --2- 172.21.15.7:0/3185722840 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4b440666c0 0x7f4b44068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:18.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.851+0000 7f4b66000640 1 --2- 172.21.15.7:0/3185722840 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4b440666c0 0x7f4b44068b80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4b680c6c60 tx=0x7f4b60001aa0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:18.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:18.863+0000 7f4b5ea00640 1 -- 172.21.15.7:0/3185722840 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4b58051d60 con 0x7f4b68066860 2024-09-13T15:07:19.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:19.211+0000 7f4b6d600640 1 -- 172.21.15.7:0/3185722840 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b68067650 con 0x7f4b68066860 2024-09-13T15:07:19.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:19.211+0000 7f4b5ea00640 1 -- 172.21.15.7:0/3185722840 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+5546 (secure 0 0 0) 0x7f4b58017090 con 0x7f4b68066860 2024-09-13T15:07:19.220 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:07:19.220 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:17.746381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:resolve","state_seq":28,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:07:19.220 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 26 2024-09-13T15:07:19.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:19.219+0000 7f4b6d600640 1 -- 172.21.15.7:0/3185722840 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4b440666c0 msgr2=0x7f4b44068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:19.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:19.219+0000 7f4b6d600640 1 --2- 172.21.15.7:0/3185722840 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4b440666c0 0x7f4b44068b80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4b680c6c60 tx=0x7f4b60001aa0 comp rx=0 tx=0).stop 2024-09-13T15:07:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:19.219+0000 7f4b6d600640 1 -- 172.21.15.7:0/3185722840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b68066860 msgr2=0x7f4b68149c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:19.219+0000 7f4b6d600640 1 --2- 172.21.15.7:0/3185722840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b68066860 0x7f4b68149c80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800e870 tx=0x7f4b5800ec70 comp rx=0 tx=0).stop 2024-09-13T15:07:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:19.219+0000 7f4b6d600640 1 -- 172.21.15.7:0/3185722840 shutdown_connections 2024-09-13T15:07:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:19.219+0000 7f4b6d600640 1 --2- 172.21.15.7:0/3185722840 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4b440666c0 0x7f4b44068b80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:19.219+0000 7f4b6d600640 1 --2- 172.21.15.7:0/3185722840 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4b68158bb0 0x7f4b680c39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:19.219+0000 7f4b6d600640 1 --2- 172.21.15.7:0/3185722840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4b680c08a0 0x7f4b681575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:19.219+0000 7f4b6d600640 1 --2- 172.21.15.7:0/3185722840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b68066860 0x7f4b68149c80 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4b5800e870 tx=0x7f4b5800ec70 comp rx=0 tx=0).stop 2024-09-13T15:07:19.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:19.219+0000 7f4b6d600640 1 -- 172.21.15.7:0/3185722840 >> 172.21.15.7:0/3185722840 conn(0x7f4b68065d40 msgr2=0x7f4b680c5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:19.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:19.219+0000 7f4b6d600640 1 -- 172.21.15.7:0/3185722840 shutdown_connections 2024-09-13T15:07:19.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:19.219+0000 7f4b6d600640 1 -- 172.21.15.7:0/3185722840 wait complete. 2024-09-13T15:07:19.290 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:07:21.292 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:21.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.507+0000 7f1034c00640 1 Processor -- start 2024-09-13T15:07:21.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.511+0000 7f1034c00640 1 -- start start 2024-09-13T15:07:21.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.511+0000 7f1034c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f1028045560 0x7f102804b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:21.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.511+0000 7f1034c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1028046500 con 0x7f1028044b10 2024-09-13T15:07:21.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.511+0000 7f1034c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1028006140 con 0x7f102804ad70 2024-09-13T15:07:21.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.511+0000 7f1034c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1028045380 con 0x7f1028045560 2024-09-13T15:07:21.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.515+0000 7f102f400640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f102804ad70 0x7f10280daee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:57436/0 (socket says 172.21.15.7:57436) 2024-09-13T15:07:21.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.515+0000 7f102f400640 1 -- 172.21.15.7:0/840595160 learned_addr learned my addr 172.21.15.7:0/840595160 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:07:21.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.523+0000 7f102ea00640 1 --2- 172.21.15.7:0/840595160 >> v2:172.21.15.7:3300/0 conn(0x7f1028045560 0x7f102804b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:21.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.523+0000 7f102e000640 1 -- 172.21.15.7:0/840595160 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3916559584 0 0) 0x7f1028006140 con 0x7f102804ad70 2024-09-13T15:07:21.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.523+0000 7f102e000640 1 -- 172.21.15.7:0/840595160 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1018003530 con 0x7f102804ad70 2024-09-13T15:07:21.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.523+0000 7f102ea00640 1 -- 172.21.15.7:0/840595160 >> v1:172.21.15.77:6789/0 conn(0x7f102804ad70 legacy=0x7f10280daee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:21.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.523+0000 7f102ea00640 1 -- 172.21.15.7:0/840595160 >> v1:172.21.15.7:6789/0 conn(0x7f1028044b10 legacy=0x7f1028005a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:21.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.523+0000 7f102ea00640 1 -- 172.21.15.7:0/840595160 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10280450a0 con 0x7f1028045560 2024-09-13T15:07:21.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.531+0000 7f102ea00640 1 --2- 172.21.15.7:0/840595160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1028045560 0x7f102804b150 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f10240097c0 tx=0x7f1024020f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c8381ec2980032d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:21.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.535+0000 7f102e000640 1 -- 172.21.15.7:0/840595160 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10240aad90 con 0x7f1028045560 2024-09-13T15:07:21.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.535+0000 7f102e000640 1 -- 172.21.15.7:0/840595160 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10240b2440 con 0x7f1028045560 2024-09-13T15:07:21.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.535+0000 7f102e000640 1 -- 172.21.15.7:0/840595160 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10240aad90 con 0x7f1028045560 2024-09-13T15:07:21.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.539+0000 7f1034c00640 1 -- 172.21.15.7:0/840595160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1028045560 msgr2=0x7f102804b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:21.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.539+0000 7f1034c00640 1 --2- 172.21.15.7:0/840595160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1028045560 0x7f102804b150 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f10240097c0 tx=0x7f1024020f80 comp rx=0 tx=0).stop 2024-09-13T15:07:21.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.543+0000 7f1034c00640 1 -- 172.21.15.7:0/840595160 shutdown_connections 2024-09-13T15:07:21.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.543+0000 7f1034c00640 1 --2- 172.21.15.7:0/840595160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1028045560 0x7f102804b150 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:21.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.543+0000 7f1034c00640 1 -- 172.21.15.7:0/840595160 >> 172.21.15.7:0/840595160 conn(0x7f102804fc30 msgr2=0x7f1028050010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:21.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.543+0000 7f1034c00640 1 -- 172.21.15.7:0/840595160 shutdown_connections 2024-09-13T15:07:21.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.543+0000 7f1034c00640 1 -- 172.21.15.7:0/840595160 wait complete. 2024-09-13T15:07:21.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.547+0000 7f1034c00640 1 Processor -- start 2024-09-13T15:07:21.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.547+0000 7f1034c00640 1 -- start start 2024-09-13T15:07:21.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.551+0000 7f1034c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1028044b10 0x7f10280d8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:21.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.551+0000 7f1034c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1028045560 0x7f102804dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:21.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.551+0000 7f102f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1028044b10 0x7f10280d8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:21.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.551+0000 7f102f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1028044b10 0x7f10280d8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:42184/0 (socket says 172.21.15.7:42184) 2024-09-13T15:07:21.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.551+0000 7f102ea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1028045560 0x7f102804dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:21.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.551+0000 7f102ea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1028045560 0x7f102804dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:46892/0 (socket says 172.21.15.7:46892) 2024-09-13T15:07:21.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.551+0000 7f102f400640 1 -- 172.21.15.7:0/2949151484 learned_addr learned my addr 172.21.15.7:0/2949151484 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:21.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.551+0000 7f1034c00640 1 --2- 172.21.15.7:0/2949151484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f102804ad70 0x7f10281733e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:21.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.551+0000 7f1034c00640 1 -- 172.21.15.7:0/2949151484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10280d9100 con 0x7f102804ad70 2024-09-13T15:07:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.551+0000 7f1034c00640 1 -- 172.21.15.7:0/2949151484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10280da3e0 con 0x7f1028044b10 2024-09-13T15:07:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.551+0000 7f1034c00640 1 -- 172.21.15.7:0/2949151484 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10280d9860 con 0x7f1028045560 2024-09-13T15:07:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.555+0000 7f102ea00640 1 -- 172.21.15.7:0/2949151484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1028044b10 msgr2=0x7f10280d8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:21.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.555+0000 7f102ea00640 1 --2- 172.21.15.7:0/2949151484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1028044b10 0x7f10280d8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.555+0000 7f102ea00640 1 -- 172.21.15.7:0/2949151484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f102804ad70 msgr2=0x7f10281733e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:07:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.555+0000 7f102fe00640 1 --2- 172.21.15.7:0/2949151484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f102804ad70 0x7f10281733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.555+0000 7f102ea00640 1 --2- 172.21.15.7:0/2949151484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f102804ad70 0x7f10281733e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.555+0000 7f102ea00640 1 -- 172.21.15.7:0/2949151484 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1024009420 con 0x7f1028045560 2024-09-13T15:07:21.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.555+0000 7f102fe00640 1 --2- 172.21.15.7:0/2949151484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f102804ad70 0x7f10281733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:07:21.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.555+0000 7f102ea00640 1 --2- 172.21.15.7:0/2949151484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1028045560 0x7f102804dc70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10240b1000 tx=0x7f102401dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:21.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.555+0000 7f1023400640 1 -- 172.21.15.7:0/2949151484 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10240c1070 con 0x7f1028045560 2024-09-13T15:07:21.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.555+0000 7f1023400640 1 -- 172.21.15.7:0/2949151484 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1024003830 con 0x7f1028045560 2024-09-13T15:07:21.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.555+0000 7f1034c00640 1 -- 172.21.15.7:0/2949151484 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10280d9b40 con 0x7f1028045560 2024-09-13T15:07:21.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.555+0000 7f1023400640 1 -- 172.21.15.7:0/2949151484 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1024003be0 con 0x7f1028045560 2024-09-13T15:07:21.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.559+0000 7f1034c00640 1 -- 172.21.15.7:0/2949151484 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10280da100 con 0x7f1028045560 2024-09-13T15:07:21.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.563+0000 7f1023400640 1 -- 172.21.15.7:0/2949151484 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f10240b9040 con 0x7f1028045560 2024-09-13T15:07:21.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.563+0000 7f1034c00640 1 -- 172.21.15.7:0/2949151484 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1028006f90 con 0x7f1028045560 2024-09-13T15:07:21.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.563+0000 7f1023400640 1 --2- 172.21.15.7:0/2949151484 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1010066760 0x7f1010068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:21.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.563+0000 7f1023400640 1 -- 172.21.15.7:0/2949151484 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f1024123d10 con 0x7f1028045560 2024-09-13T15:07:21.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.567+0000 7f102f400640 1 --2- 172.21.15.7:0/2949151484 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1010066760 0x7f1010068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.583+0000 7f1023400640 1 -- 172.21.15.7:0/2949151484 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f10240f0c80 con 0x7f1028045560 2024-09-13T15:07:21.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.583+0000 7f102f400640 1 --2- 172.21.15.7:0/2949151484 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1010066760 0x7f1010068c20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f101c000f70 tx=0x7f101c001160 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:21.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.991+0000 7f1034c00640 1 -- 172.21.15.7:0/2949151484 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1028006f90 con 0x7f1028045560 2024-09-13T15:07:21.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.995+0000 7f1023400640 1 -- 172.21.15.7:0/2949151484 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+5546 (secure 0 0 0) 0x7f10240b7030 con 0x7f1028045560 2024-09-13T15:07:21.998 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:07:21.998 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:17.746381+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:resolve","state_seq":28,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:07:21.999 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 26 2024-09-13T15:07:22.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.999+0000 7f1034c00640 1 -- 172.21.15.7:0/2949151484 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1010066760 msgr2=0x7f1010068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:22.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.999+0000 7f1034c00640 1 --2- 172.21.15.7:0/2949151484 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1010066760 0x7f1010068c20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f101c000f70 tx=0x7f101c001160 comp rx=0 tx=0).stop 2024-09-13T15:07:22.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.999+0000 7f1034c00640 1 -- 172.21.15.7:0/2949151484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1028045560 msgr2=0x7f102804dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:22.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.999+0000 7f1034c00640 1 --2- 172.21.15.7:0/2949151484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1028045560 0x7f102804dc70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f10240b1000 tx=0x7f102401dd40 comp rx=0 tx=0).stop 2024-09-13T15:07:22.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.999+0000 7f1034c00640 1 -- 172.21.15.7:0/2949151484 shutdown_connections 2024-09-13T15:07:22.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.999+0000 7f1034c00640 1 --2- 172.21.15.7:0/2949151484 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f1010066760 0x7f1010068c20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:22.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.999+0000 7f1034c00640 1 --2- 172.21.15.7:0/2949151484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f102804ad70 0x7f10281733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:22.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.999+0000 7f1034c00640 1 --2- 172.21.15.7:0/2949151484 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f1028045560 0x7f102804dc70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:22.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.999+0000 7f1034c00640 1 --2- 172.21.15.7:0/2949151484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1028044b10 0x7f10280d8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:22.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.999+0000 7f1034c00640 1 -- 172.21.15.7:0/2949151484 >> 172.21.15.7:0/2949151484 conn(0x7f102804fc30 msgr2=0x7f10280d3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:22.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.999+0000 7f1034c00640 1 -- 172.21.15.7:0/2949151484 shutdown_connections 2024-09-13T15:07:22.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:21.999+0000 7f1034c00640 1 -- 172.21.15.7:0/2949151484 wait complete. 2024-09-13T15:07:22.024 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:07:24.025 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:24.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.323+0000 7f2b47600640 1 Processor -- start 2024-09-13T15:07:24.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.323+0000 7f2b47600640 1 -- start start 2024-09-13T15:07:24.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.327+0000 7f2b47600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2b400c77f0 0x7f2b400c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:24.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.327+0000 7f2b47600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b400c7bd0 0x7f2b40158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:24.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.327+0000 7f2b47600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2b40066860 0x7f2b401590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:24.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.327+0000 7f2b47600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b40155130 con 0x7f2b400c77f0 2024-09-13T15:07:24.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.327+0000 7f2b47600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b40158720 con 0x7f2b40066860 2024-09-13T15:07:24.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.327+0000 7f2b47600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b40155320 con 0x7f2b400c7bd0 2024-09-13T15:07:24.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.327+0000 7f2b3fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b400c7bd0 0x7f2b40158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:24.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.327+0000 7f2b45600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2b40066860 0x7f2b401590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:24.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.327+0000 7f2b45600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2b40066860 0x7f2b401590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:42188/0 (socket says 172.21.15.7:42188) 2024-09-13T15:07:24.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.327+0000 7f2b45600640 1 -- 172.21.15.7:0/795253647 learned_addr learned my addr 172.21.15.7:0/795253647 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:24.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.331+0000 7f2b45600640 1 -- 172.21.15.7:0/795253647 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b400c7bd0 msgr2=0x7f2b40158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:24.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.331+0000 7f2b45600640 1 --2- 172.21.15.7:0/795253647 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b400c7bd0 0x7f2b40158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:24.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.331+0000 7f2b45600640 1 -- 172.21.15.7:0/795253647 >> v2:172.21.15.7:3300/0 conn(0x7f2b400c77f0 msgr2=0x7f2b400c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:24.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.331+0000 7f2b45600640 1 --2- 172.21.15.7:0/795253647 >> v2:172.21.15.7:3300/0 conn(0x7f2b400c77f0 0x7f2b400c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:24.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.331+0000 7f2b45600640 1 -- 172.21.15.7:0/795253647 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b401555e0 con 0x7f2b40066860 2024-09-13T15:07:24.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.335+0000 7f2b45600640 1 --2- 172.21.15.7:0/795253647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b40066860 0x7f2b401590f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2b4006c940 tx=0x7f2b3801ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f695ff7a091b1656 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:24.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.335+0000 7f2b3f400640 1 -- 172.21.15.7:0/795253647 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b380a5790 con 0x7f2b40066860 2024-09-13T15:07:24.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.335+0000 7f2b3f400640 1 -- 172.21.15.7:0/795253647 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b380a58f0 con 0x7f2b40066860 2024-09-13T15:07:24.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.335+0000 7f2b3f400640 1 -- 172.21.15.7:0/795253647 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b380a5c80 con 0x7f2b40066860 2024-09-13T15:07:24.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.335+0000 7f2b47600640 1 -- 172.21.15.7:0/795253647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b40066860 msgr2=0x7f2b401590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:24.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.335+0000 7f2b47600640 1 --2- 172.21.15.7:0/795253647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b40066860 0x7f2b401590f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2b4006c940 tx=0x7f2b3801ca30 comp rx=0 tx=0).stop 2024-09-13T15:07:24.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.335+0000 7f2b47600640 1 -- 172.21.15.7:0/795253647 shutdown_connections 2024-09-13T15:07:24.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.335+0000 7f2b47600640 1 --2- 172.21.15.7:0/795253647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b40066860 0x7f2b401590f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:24.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.335+0000 7f2b47600640 1 --2- 172.21.15.7:0/795253647 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b400c7bd0 0x7f2b40158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:24.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.335+0000 7f2b47600640 1 --2- 172.21.15.7:0/795253647 >> v2:172.21.15.7:3300/0 conn(0x7f2b400c77f0 0x7f2b400c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:24.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.335+0000 7f2b47600640 1 -- 172.21.15.7:0/795253647 >> 172.21.15.7:0/795253647 conn(0x7f2b40065d40 msgr2=0x7f2b40066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:24.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.335+0000 7f2b47600640 1 -- 172.21.15.7:0/795253647 shutdown_connections 2024-09-13T15:07:24.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.339+0000 7f2b47600640 1 -- 172.21.15.7:0/795253647 wait complete. 2024-09-13T15:07:24.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.339+0000 7f2b47600640 1 Processor -- start 2024-09-13T15:07:24.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.339+0000 7f2b47600640 1 -- start start 2024-09-13T15:07:24.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.343+0000 7f2b47600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b40066860 0x7f2b400c65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.343+0000 7f2b47600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b400c77f0 0x7f2b40143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.343+0000 7f2b47600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b400c7bd0 0x7f2b40143660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.343+0000 7f2b44c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b40066860 0x7f2b400c65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.343+0000 7f2b3fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b400c77f0 0x7f2b40143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:24.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.343+0000 7f2b44c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b40066860 0x7f2b400c65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:46906/0 (socket says 172.21.15.7:46906) 2024-09-13T15:07:24.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.343+0000 7f2b47600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b401f5c80 con 0x7f2b400c7bd0 2024-09-13T15:07:24.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.343+0000 7f2b47600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b40143ba0 con 0x7f2b400c77f0 2024-09-13T15:07:24.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.343+0000 7f2b47600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b40142c90 con 0x7f2b40066860 2024-09-13T15:07:24.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.343+0000 7f2b44c00640 1 -- 172.21.15.7:0/837912919 learned_addr learned my addr 172.21.15.7:0/837912919 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:24.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.343+0000 7f2b3fe00640 1 -- 172.21.15.7:0/837912919 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b40066860 msgr2=0x7f2b400c65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:24.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.343+0000 7f2b3fe00640 1 --2- 172.21.15.7:0/837912919 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b40066860 0x7f2b400c65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:24.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.343+0000 7f2b3fe00640 1 -- 172.21.15.7:0/837912919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b400c7bd0 msgr2=0x7f2b40143660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:24.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.343+0000 7f2b3fe00640 1 --2- 172.21.15.7:0/837912919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b400c7bd0 0x7f2b40143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:24.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.347+0000 7f2b3fe00640 1 -- 172.21.15.7:0/837912919 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b38009b30 con 0x7f2b400c77f0 2024-09-13T15:07:24.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.347+0000 7f2b3fe00640 1 --2- 172.21.15.7:0/837912919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b400c77f0 0x7f2b40143120 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c00e840 tx=0x7f2b2c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:24.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.347+0000 7f2b3cc00640 1 -- 172.21.15.7:0/837912919 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c00c730 con 0x7f2b400c77f0 2024-09-13T15:07:24.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.347+0000 7f2b3cc00640 1 -- 172.21.15.7:0/837912919 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2c00c890 con 0x7f2b400c77f0 2024-09-13T15:07:24.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.347+0000 7f2b3cc00640 1 -- 172.21.15.7:0/837912919 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c00cc20 con 0x7f2b400c77f0 2024-09-13T15:07:24.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.347+0000 7f2b47600640 1 -- 172.21.15.7:0/837912919 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b401f6170 con 0x7f2b400c77f0 2024-09-13T15:07:24.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.351+0000 7f2b47600640 1 -- 172.21.15.7:0/837912919 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b40156990 con 0x7f2b400c77f0 2024-09-13T15:07:24.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.351+0000 7f2b47600640 1 -- 172.21.15.7:0/837912919 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b40067650 con 0x7f2b400c77f0 2024-09-13T15:07:24.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.355+0000 7f2b3cc00640 1 -- 172.21.15.7:0/837912919 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2b2c0059a0 con 0x7f2b400c77f0 2024-09-13T15:07:24.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.359+0000 7f2b3cc00640 1 --2- 172.21.15.7:0/837912919 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b20066710 0x7f2b20068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:24.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.359+0000 7f2b3cc00640 1 -- 172.21.15.7:0/837912919 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f2b2c084840 con 0x7f2b400c77f0 2024-09-13T15:07:24.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.359+0000 7f2b44c00640 1 --2- 172.21.15.7:0/837912919 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b20066710 0x7f2b20068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:24.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.363+0000 7f2b44c00640 1 --2- 172.21.15.7:0/837912919 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b20066710 0x7f2b20068bd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009a50 tx=0x7f2b30009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:24.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.371+0000 7f2b3cc00640 1 -- 172.21.15.7:0/837912919 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2b2c051960 con 0x7f2b400c77f0 2024-09-13T15:07:24.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.783+0000 7f2b47600640 1 -- 172.21.15.7:0/837912919 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b400c5880 con 0x7f2b400c77f0 2024-09-13T15:07:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.783+0000 7f2b3cc00640 1 -- 172.21.15.7:0/837912919 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+5548 (secure 0 0 0) 0x7f2b2c017090 con 0x7f2b400c77f0 2024-09-13T15:07:24.788 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:07:24.788 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:22.786679+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:reconnect","state_seq":30,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:07:24.789 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-09-13T15:07:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.803+0000 7f2b47600640 1 -- 172.21.15.7:0/837912919 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b20066710 msgr2=0x7f2b20068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.803+0000 7f2b47600640 1 --2- 172.21.15.7:0/837912919 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b20066710 0x7f2b20068bd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009a50 tx=0x7f2b30009210 comp rx=0 tx=0).stop 2024-09-13T15:07:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.803+0000 7f2b47600640 1 -- 172.21.15.7:0/837912919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b400c77f0 msgr2=0x7f2b40143120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.803+0000 7f2b47600640 1 --2- 172.21.15.7:0/837912919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b400c77f0 0x7f2b40143120 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c00e840 tx=0x7f2b2c00ed00 comp rx=0 tx=0).stop 2024-09-13T15:07:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.803+0000 7f2b47600640 1 -- 172.21.15.7:0/837912919 shutdown_connections 2024-09-13T15:07:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.803+0000 7f2b47600640 1 --2- 172.21.15.7:0/837912919 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b20066710 0x7f2b20068bd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.803+0000 7f2b47600640 1 --2- 172.21.15.7:0/837912919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b400c7bd0 0x7f2b40143660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.803+0000 7f2b47600640 1 --2- 172.21.15.7:0/837912919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b400c77f0 0x7f2b40143120 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.803+0000 7f2b47600640 1 --2- 172.21.15.7:0/837912919 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b40066860 0x7f2b400c65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.803+0000 7f2b47600640 1 -- 172.21.15.7:0/837912919 >> 172.21.15.7:0/837912919 conn(0x7f2b40065d40 msgr2=0x7f2b401451c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:24.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.807+0000 7f2b47600640 1 -- 172.21.15.7:0/837912919 shutdown_connections 2024-09-13T15:07:24.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:24.807+0000 7f2b47600640 1 -- 172.21.15.7:0/837912919 wait complete. 2024-09-13T15:07:24.853 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:07:26.854 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:27.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.119+0000 7f8d14e00640 1 Processor -- start 2024-09-13T15:07:27.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.119+0000 7f8d14e00640 1 -- start start 2024-09-13T15:07:27.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.119+0000 7f8d14e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d100c5b60 0x7f8d1006fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:27.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.119+0000 7f8d14e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8d100c5f40 0x7f8d100c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:27.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.123+0000 7f8d14e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8d1006cd70 0x7f8d100c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:27.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.123+0000 7f8d14e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d10070410 con 0x7f8d100c5f40 2024-09-13T15:07:27.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.123+0000 7f8d14e00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d100706d0 con 0x7f8d1006cd70 2024-09-13T15:07:27.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.123+0000 7f8d14e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d100709b0 con 0x7f8d100c5b60 2024-09-13T15:07:27.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.123+0000 7f8d0f400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d100c5b60 0x7f8d1006fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:27.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.123+0000 7f8d0ea00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8d100c5f40 0x7f8d100c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:27.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.123+0000 7f8d0ea00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8d100c5f40 0x7f8d100c6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42026/0 (socket says 172.21.15.7:42026) 2024-09-13T15:07:27.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.123+0000 7f8d0fe00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8d1006cd70 0x7f8d100c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:27.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.123+0000 7f8d0f400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d100c5b60 0x7f8d1006fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:46914/0 (socket says 172.21.15.7:46914) 2024-09-13T15:07:27.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.315+0000 7f8d0ea00640 1 -- 172.21.15.7:0/1353055115 learned_addr learned my addr 172.21.15.7:0/1353055115 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:27.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.315+0000 7f8d0fe00640 1 -- 172.21.15.7:0/1353055115 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d100c5b60 msgr2=0x7f8d1006fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:27.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.315+0000 7f8d0fe00640 1 --2- 172.21.15.7:0/1353055115 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d100c5b60 0x7f8d1006fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:27.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.315+0000 7f8d0fe00640 1 -- 172.21.15.7:0/1353055115 >> v2:172.21.15.7:3300/0 conn(0x7f8d100c5f40 msgr2=0x7f8d100c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:27.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.315+0000 7f8d0fe00640 1 --2- 172.21.15.7:0/1353055115 >> v2:172.21.15.7:3300/0 conn(0x7f8d100c5f40 0x7f8d100c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:27.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.315+0000 7f8d0fe00640 1 -- 172.21.15.7:0/1353055115 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d10070c90 con 0x7f8d1006cd70 2024-09-13T15:07:27.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.315+0000 7f8d0ea00640 1 --2- 172.21.15.7:0/1353055115 >> v2:172.21.15.7:3300/0 conn(0x7f8d100c5f40 0x7f8d100c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:27.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.323+0000 7f8d0fe00640 1 --2- 172.21.15.7:0/1353055115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d1006cd70 0x7f8d100c70e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8d100c6340 tx=0x7f8cf801f5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f47a81d55bf6b6b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:27.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.323+0000 7f8d0e000640 1 -- 172.21.15.7:0/1353055115 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80b0660 con 0x7f8d1006cd70 2024-09-13T15:07:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.323+0000 7f8d0e000640 1 -- 172.21.15.7:0/1353055115 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf80b07c0 con 0x7f8d1006cd70 2024-09-13T15:07:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.323+0000 7f8d0e000640 1 -- 172.21.15.7:0/1353055115 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf80b0b90 con 0x7f8d1006cd70 2024-09-13T15:07:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.327+0000 7f8d14e00640 1 -- 172.21.15.7:0/1353055115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d1006cd70 msgr2=0x7f8d100c70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.327+0000 7f8d14e00640 1 --2- 172.21.15.7:0/1353055115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d1006cd70 0x7f8d100c70e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8d100c6340 tx=0x7f8cf801f5b0 comp rx=0 tx=0).stop 2024-09-13T15:07:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.327+0000 7f8d14e00640 1 -- 172.21.15.7:0/1353055115 shutdown_connections 2024-09-13T15:07:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.327+0000 7f8d14e00640 1 --2- 172.21.15.7:0/1353055115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d1006cd70 0x7f8d100c70e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.327+0000 7f8d14e00640 1 --2- 172.21.15.7:0/1353055115 >> v2:172.21.15.7:3300/0 conn(0x7f8d100c5f40 0x7f8d100c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.327+0000 7f8d14e00640 1 --2- 172.21.15.7:0/1353055115 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d100c5b60 0x7f8d1006fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.327+0000 7f8d14e00640 1 -- 172.21.15.7:0/1353055115 >> 172.21.15.7:0/1353055115 conn(0x7f8d10065d40 msgr2=0x7f8d10066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.327+0000 7f8d14e00640 1 -- 172.21.15.7:0/1353055115 shutdown_connections 2024-09-13T15:07:27.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.327+0000 7f8d14e00640 1 -- 172.21.15.7:0/1353055115 wait complete. 2024-09-13T15:07:27.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d14e00640 1 Processor -- start 2024-09-13T15:07:27.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d14e00640 1 -- start start 2024-09-13T15:07:27.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d14e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d1006cd70 0x7f8d100c1f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:27.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d14e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d100c5b60 0x7f8d101ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:27.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d14e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d100c5f40 0x7f8d101692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:27.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d14e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1015dc50 con 0x7f8d100c5b60 2024-09-13T15:07:27.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d14e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1015c500 con 0x7f8d100c5f40 2024-09-13T15:07:27.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d14e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1015d6b0 con 0x7f8d1006cd70 2024-09-13T15:07:27.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d0ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d100c5b60 0x7f8d101ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:27.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d0f400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d1006cd70 0x7f8d100c1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:27.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d0f400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d1006cd70 0x7f8d100c1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:46922/0 (socket says 172.21.15.7:46922) 2024-09-13T15:07:27.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d0ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d100c5b60 0x7f8d101ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42034/0 (socket says 172.21.15.7:42034) 2024-09-13T15:07:27.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d0f400640 1 -- 172.21.15.7:0/2875880311 learned_addr learned my addr 172.21.15.7:0/2875880311 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:27.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d0fe00640 1 --2- 172.21.15.7:0/2875880311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d100c5f40 0x7f8d101692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:27.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d0ea00640 1 -- 172.21.15.7:0/2875880311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d1006cd70 msgr2=0x7f8d100c1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:27.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d0ea00640 1 --2- 172.21.15.7:0/2875880311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d1006cd70 0x7f8d100c1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:27.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d0ea00640 1 -- 172.21.15.7:0/2875880311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d100c5f40 msgr2=0x7f8d101692d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:27.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d0ea00640 1 --2- 172.21.15.7:0/2875880311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d100c5f40 0x7f8d101692d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:27.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d0ea00640 1 -- 172.21.15.7:0/2875880311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0000b770 con 0x7f8d100c5b60 2024-09-13T15:07:27.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d0f400640 1 --2- 172.21.15.7:0/2875880311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d1006cd70 0x7f8d100c1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:27.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d0ea00640 1 --2- 172.21.15.7:0/2875880311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d100c5b60 0x7f8d101ff670 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000eb10 tx=0x7f8d0000bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:27.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d07400640 1 -- 172.21.15.7:0/2875880311 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00004030 con 0x7f8d100c5b60 2024-09-13T15:07:27.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d07400640 1 -- 172.21.15.7:0/2875880311 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d00004190 con 0x7f8d100c5b60 2024-09-13T15:07:27.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d14e00640 1 -- 172.21.15.7:0/2875880311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf800c4b0 con 0x7f8d100c5b60 2024-09-13T15:07:27.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d07400640 1 -- 172.21.15.7:0/2875880311 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00004500 con 0x7f8d100c5b60 2024-09-13T15:07:27.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.331+0000 7f8d14e00640 1 -- 172.21.15.7:0/2875880311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d10200220 con 0x7f8d100c5b60 2024-09-13T15:07:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.339+0000 7f8d07400640 1 -- 172.21.15.7:0/2875880311 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8d00003620 con 0x7f8d100c5b60 2024-09-13T15:07:27.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.339+0000 7f8d14e00640 1 -- 172.21.15.7:0/2875880311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1015c2d0 con 0x7f8d100c5b60 2024-09-13T15:07:27.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.343+0000 7f8d07400640 1 --2- 172.21.15.7:0/2875880311 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8cec066690 0x7f8cec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:27.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.343+0000 7f8d07400640 1 -- 172.21.15.7:0/2875880311 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f8d00054c00 con 0x7f8d100c5b60 2024-09-13T15:07:27.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.347+0000 7f8d0f400640 1 --2- 172.21.15.7:0/2875880311 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8cec066690 0x7f8cec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:27.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.347+0000 7f8d0f400640 1 --2- 172.21.15.7:0/2875880311 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8cec066690 0x7f8cec068b50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8d08009a40 tx=0x7f8d0800d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:27.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.355+0000 7f8d07400640 1 -- 172.21.15.7:0/2875880311 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8d1015c2d0 con 0x7f8d100c5b60 2024-09-13T15:07:27.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.831+0000 7f8d14e00640 1 -- 172.21.15.7:0/2875880311 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d1015c2d0 con 0x7f8d100c5b60 2024-09-13T15:07:27.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.835+0000 7f8d07400640 1 -- 172.21.15.7:0/2875880311 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+5548 (secure 0 0 0) 0x7f8d1015c2d0 con 0x7f8d100c5b60 2024-09-13T15:07:27.837 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:07:27.837 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:22.786679+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:reconnect","state_seq":30,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:07:27.837 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 27 2024-09-13T15:07:27.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.835+0000 7f8d14e00640 1 -- 172.21.15.7:0/2875880311 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8cec066690 msgr2=0x7f8cec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:27.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.835+0000 7f8d14e00640 1 --2- 172.21.15.7:0/2875880311 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8cec066690 0x7f8cec068b50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8d08009a40 tx=0x7f8d0800d040 comp rx=0 tx=0).stop 2024-09-13T15:07:27.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.835+0000 7f8d14e00640 1 -- 172.21.15.7:0/2875880311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d100c5b60 msgr2=0x7f8d101ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:27.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.835+0000 7f8d14e00640 1 --2- 172.21.15.7:0/2875880311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d100c5b60 0x7f8d101ff670 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000eb10 tx=0x7f8d0000bf70 comp rx=0 tx=0).stop 2024-09-13T15:07:27.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.835+0000 7f8d14e00640 1 -- 172.21.15.7:0/2875880311 shutdown_connections 2024-09-13T15:07:27.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.835+0000 7f8d14e00640 1 --2- 172.21.15.7:0/2875880311 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8cec066690 0x7f8cec068b50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:27.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.835+0000 7f8d14e00640 1 --2- 172.21.15.7:0/2875880311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d100c5f40 0x7f8d101692d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:27.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.835+0000 7f8d14e00640 1 --2- 172.21.15.7:0/2875880311 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8d100c5b60 0x7f8d101ff670 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:27.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.835+0000 7f8d14e00640 1 --2- 172.21.15.7:0/2875880311 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8d1006cd70 0x7f8d100c1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:27.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.835+0000 7f8d14e00640 1 -- 172.21.15.7:0/2875880311 >> 172.21.15.7:0/2875880311 conn(0x7f8d10065d40 msgr2=0x7f8d10164a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:27.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.835+0000 7f8d14e00640 1 -- 172.21.15.7:0/2875880311 shutdown_connections 2024-09-13T15:07:27.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:27.835+0000 7f8d14e00640 1 -- 172.21.15.7:0/2875880311 wait complete. 2024-09-13T15:07:27.877 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 27, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-13T15:01:44.789559+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 27, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3, 4 ], "info": { "gid_4238": { "addr": "172.21.15.7:6837/3369648543", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6835", "nonce": 3369648543, "type": "v2" }, { "addr": "172.21.15.7:6837", "nonce": 3369648543, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4238, "incarnation": 15, "join_fscid": -1, "name": "a", "rank": 3, "state": "up:active", "state_seq": 44 }, "gid_4252": { "addr": "172.21.15.77:6835/2367107997", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6834", "nonce": 2367107997, "type": "v2" }, { "addr": "172.21.15.77:6835", "nonce": 2367107997, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4252, "incarnation": 13, "join_fscid": -1, "name": "d", "rank": 2, "state": "up:active", "state_seq": 43 }, "gid_4267": { "addr": "172.21.15.77:6839/2233000674", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6837", "nonce": 2233000674, "type": "v2" }, { "addr": "172.21.15.77:6839", "nonce": 2233000674, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4267, "incarnation": 9, "join_fscid": -1, "name": "f", "rank": 1, "state": "up:active", "state_seq": 41 }, "gid_4276": { "addr": "172.21.15.7:6836/2396967179", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6834", "nonce": 2396967179, "type": "v2" }, { "addr": "172.21.15.7:6836", "nonce": 2396967179, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4276, "incarnation": 4, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_5230": { "addr": "172.21.15.7:6833/2896136827", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6832", "nonce": 2896136827, "type": "v2" }, { "addr": "172.21.15.7:6833", "nonce": 2896136827, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5230, "incarnation": 25, "join_fscid": -1, "name": "e", "rank": 4, "state": "up:reconnect", "state_seq": 30 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 5, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-13T15:07:22.786679+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4276, "mds_1": 4267, "mds_2": 4252, "mds_3": 4238, "mds_4": 5230 } } } ], "standbys": [] } 2024-09-13T15:07:29.877 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf59200640 1 Processor -- start 2024-09-13T15:07:30.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf59200640 1 -- start start 2024-09-13T15:07:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf59200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf54071a70 0x7fdf541576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf59200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdf540b0bf0 0x7fdf54150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf59200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdf5406ddb0 0x7fdf54151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf59200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf54151750 con 0x7fdf5406ddb0 2024-09-13T15:07:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf59200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf540c5530 con 0x7fdf540b0bf0 2024-09-13T15:07:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf59200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf541583b0 con 0x7fdf54071a70 2024-09-13T15:07:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf49400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdf540b0bf0 0x7fdf54150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf51e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf54071a70 0x7fdf541576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf52800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdf5406ddb0 0x7fdf54151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf51e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf54071a70 0x7fdf541576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:40684/0 (socket says 172.21.15.7:40684) 2024-09-13T15:07:30.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf49400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdf540b0bf0 0x7fdf54150cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:51756/0 (socket says 172.21.15.7:51756) 2024-09-13T15:07:30.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf51e00640 1 -- 172.21.15.7:0/1367219671 learned_addr learned my addr 172.21.15.7:0/1367219671 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:30.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf52800640 1 -- 172.21.15.7:0/1367219671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf54071a70 msgr2=0x7fdf541576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:30.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf52800640 1 --2- 172.21.15.7:0/1367219671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf54071a70 0x7fdf541576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:30.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf52800640 1 -- 172.21.15.7:0/1367219671 >> v2:172.21.15.77:3300/0 conn(0x7fdf540b0bf0 msgr2=0x7fdf54150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf52800640 1 --2- 172.21.15.7:0/1367219671 >> v2:172.21.15.77:3300/0 conn(0x7fdf540b0bf0 0x7fdf54150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf52800640 1 -- 172.21.15.7:0/1367219671 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf54156f40 con 0x7fdf5406ddb0 2024-09-13T15:07:30.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.031+0000 7fdf49400640 1 --2- 172.21.15.7:0/1367219671 >> v2:172.21.15.77:3300/0 conn(0x7fdf540b0bf0 0x7fdf54150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.035+0000 7fdf52800640 1 --2- 172.21.15.7:0/1367219671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf5406ddb0 0x7fdf54151210 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdf54066c60 tx=0x7fdf4c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e583df845382e5b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.035+0000 7fdf51400640 1 -- 172.21.15.7:0/1367219671 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c0a5980 con 0x7fdf5406ddb0 2024-09-13T15:07:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.035+0000 7fdf51400640 1 -- 172.21.15.7:0/1367219671 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4c0a5ae0 con 0x7fdf5406ddb0 2024-09-13T15:07:30.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.035+0000 7fdf51400640 1 -- 172.21.15.7:0/1367219671 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c0a5e70 con 0x7fdf5406ddb0 2024-09-13T15:07:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.035+0000 7fdf59200640 1 -- 172.21.15.7:0/1367219671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf5406ddb0 msgr2=0x7fdf54151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.035+0000 7fdf59200640 1 --2- 172.21.15.7:0/1367219671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf5406ddb0 0x7fdf54151210 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdf54066c60 tx=0x7fdf4c01c900 comp rx=0 tx=0).stop 2024-09-13T15:07:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.035+0000 7fdf59200640 1 -- 172.21.15.7:0/1367219671 shutdown_connections 2024-09-13T15:07:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.035+0000 7fdf59200640 1 --2- 172.21.15.7:0/1367219671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf5406ddb0 0x7fdf54151210 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.035+0000 7fdf59200640 1 --2- 172.21.15.7:0/1367219671 >> v2:172.21.15.77:3300/0 conn(0x7fdf540b0bf0 0x7fdf54150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.035+0000 7fdf59200640 1 --2- 172.21.15.7:0/1367219671 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf54071a70 0x7fdf541576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:30.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.035+0000 7fdf59200640 1 -- 172.21.15.7:0/1367219671 >> 172.21.15.7:0/1367219671 conn(0x7fdf54065d40 msgr2=0x7fdf54066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:30.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.035+0000 7fdf59200640 1 -- 172.21.15.7:0/1367219671 shutdown_connections 2024-09-13T15:07:30.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.035+0000 7fdf59200640 1 -- 172.21.15.7:0/1367219671 wait complete. 2024-09-13T15:07:30.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf59200640 1 Processor -- start 2024-09-13T15:07:30.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf59200640 1 -- start start 2024-09-13T15:07:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf59200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf5406ddb0 0x7fdf541f5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf59200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf54071a70 0x7fdf54145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf59200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf540b0bf0 0x7fdf541458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf59200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf541f5960 con 0x7fdf540b0bf0 2024-09-13T15:07:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf59200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf540c7bf0 con 0x7fdf54071a70 2024-09-13T15:07:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf59200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf541f5c00 con 0x7fdf5406ddb0 2024-09-13T15:07:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf52800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf540b0bf0 0x7fdf541458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf49400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf54071a70 0x7fdf54145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:30.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf51e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf5406ddb0 0x7fdf541f5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:30.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf49400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf54071a70 0x7fdf54145380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:51764/0 (socket says 172.21.15.7:51764) 2024-09-13T15:07:30.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf49400640 1 -- 172.21.15.7:0/3711077392 learned_addr learned my addr 172.21.15.7:0/3711077392 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf52800640 1 -- 172.21.15.7:0/3711077392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf5406ddb0 msgr2=0x7fdf541f5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf52800640 1 --2- 172.21.15.7:0/3711077392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf5406ddb0 0x7fdf541f5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf52800640 1 -- 172.21.15.7:0/3711077392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf54071a70 msgr2=0x7fdf54145380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf52800640 1 --2- 172.21.15.7:0/3711077392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf54071a70 0x7fdf54145380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf52800640 1 -- 172.21.15.7:0/3711077392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c009420 con 0x7fdf540b0bf0 2024-09-13T15:07:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf49400640 1 --2- 172.21.15.7:0/3711077392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf54071a70 0x7fdf54145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf52800640 1 --2- 172.21.15.7:0/3711077392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf540b0bf0 0x7fdf541458c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0ac000 tx=0x7fdf4c0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf4aa00640 1 -- 172.21.15.7:0/3711077392 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c0b9860 con 0x7fdf540b0bf0 2024-09-13T15:07:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf4aa00640 1 -- 172.21.15.7:0/3711077392 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4c0b99e0 con 0x7fdf540b0bf0 2024-09-13T15:07:30.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf4aa00640 1 -- 172.21.15.7:0/3711077392 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c0b9d90 con 0x7fdf540b0bf0 2024-09-13T15:07:30.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf59200640 1 -- 172.21.15.7:0/3711077392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4c009a70 con 0x7fdf540b0bf0 2024-09-13T15:07:30.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.039+0000 7fdf59200640 1 -- 172.21.15.7:0/3711077392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf540c8170 con 0x7fdf540b0bf0 2024-09-13T15:07:30.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.043+0000 7fdf59200640 1 -- 172.21.15.7:0/3711077392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf54067650 con 0x7fdf540b0bf0 2024-09-13T15:07:30.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.043+0000 7fdf4aa00640 1 -- 172.21.15.7:0/3711077392 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdf4c0ad440 con 0x7fdf540b0bf0 2024-09-13T15:07:30.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.043+0000 7fdf4aa00640 1 --2- 172.21.15.7:0/3711077392 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdf300666c0 0x7fdf30068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:30.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.043+0000 7fdf4aa00640 1 -- 172.21.15.7:0/3711077392 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7fdf4c11f770 con 0x7fdf540b0bf0 2024-09-13T15:07:30.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.043+0000 7fdf51e00640 1 --2- 172.21.15.7:0/3711077392 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdf300666c0 0x7fdf30068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:30.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.043+0000 7fdf51e00640 1 --2- 172.21.15.7:0/3711077392 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdf300666c0 0x7fdf30068b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdf44006cd0 tx=0x7fdf44009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:30.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.047+0000 7fdf4aa00640 1 -- 172.21.15.7:0/3711077392 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdf4c0ec8d0 con 0x7fdf540b0bf0 2024-09-13T15:07:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.247+0000 7fdf59200640 1 -- 172.21.15.7:0/3711077392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf541576e0 con 0x7fdf540b0bf0 2024-09-13T15:07:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.247+0000 7fdf4aa00640 1 -- 172.21.15.7:0/3711077392 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5545 (secure 0 0 0) 0x7fdf4c0efef0 con 0x7fdf540b0bf0 2024-09-13T15:07:30.251 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:07:30.251 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:27.870033+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:rejoin","state_seq":32,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:07:30.251 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2024-09-13T15:07:30.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.251+0000 7fdf59200640 1 -- 172.21.15.7:0/3711077392 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdf300666c0 msgr2=0x7fdf30068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:30.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.251+0000 7fdf59200640 1 --2- 172.21.15.7:0/3711077392 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdf300666c0 0x7fdf30068b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdf44006cd0 tx=0x7fdf44009240 comp rx=0 tx=0).stop 2024-09-13T15:07:30.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.251+0000 7fdf59200640 1 -- 172.21.15.7:0/3711077392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf540b0bf0 msgr2=0x7fdf541458c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:30.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.251+0000 7fdf59200640 1 --2- 172.21.15.7:0/3711077392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf540b0bf0 0x7fdf541458c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c0ac000 tx=0x7fdf4c0196a0 comp rx=0 tx=0).stop 2024-09-13T15:07:30.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.251+0000 7fdf59200640 1 -- 172.21.15.7:0/3711077392 shutdown_connections 2024-09-13T15:07:30.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.251+0000 7fdf59200640 1 --2- 172.21.15.7:0/3711077392 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdf300666c0 0x7fdf30068b80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:30.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.251+0000 7fdf59200640 1 --2- 172.21.15.7:0/3711077392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf540b0bf0 0x7fdf541458c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:30.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.251+0000 7fdf59200640 1 --2- 172.21.15.7:0/3711077392 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdf54071a70 0x7fdf54145380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:30.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.251+0000 7fdf59200640 1 --2- 172.21.15.7:0/3711077392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdf5406ddb0 0x7fdf541f5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.251+0000 7fdf59200640 1 -- 172.21.15.7:0/3711077392 >> 172.21.15.7:0/3711077392 conn(0x7fdf54065d40 msgr2=0x7fdf540c9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.251+0000 7fdf59200640 1 -- 172.21.15.7:0/3711077392 shutdown_connections 2024-09-13T15:07:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:30.251+0000 7fdf59200640 1 -- 172.21.15.7:0/3711077392 wait complete. 2024-09-13T15:07:30.273 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:07:32.274 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:32.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.423+0000 7f68df000640 1 Processor -- start 2024-09-13T15:07:32.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.423+0000 7f68df000640 1 -- start start 2024-09-13T15:07:32.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.423+0000 7f68df000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68d8151280 0x7f68d815ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.423+0000 7f68df000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f68d80c7550 0x7f68d80ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.427+0000 7f68df000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f68d806f8b0 0x7f68d80cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.427+0000 7f68df000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d8151660 con 0x7f68d806f8b0 2024-09-13T15:07:32.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.427+0000 7f68df000640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d815a3b0 con 0x7f68d80c7550 2024-09-13T15:07:32.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.427+0000 7f68df000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d80c7a90 con 0x7f68d8151280 2024-09-13T15:07:32.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.427+0000 7f68dd000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f68d806f8b0 0x7f68d80cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.427+0000 7f68dd000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f68d806f8b0 0x7f68d80cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48244/0 (socket says 172.21.15.7:48244) 2024-09-13T15:07:32.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.427+0000 7f68dd000640 1 -- 172.21.15.7:0/2268966053 learned_addr learned my addr 172.21.15.7:0/2268966053 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:32.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.427+0000 7f68cfe00640 1 --2- 172.21.15.7:0/2268966053 >> v2:172.21.15.77:3300/0 conn(0x7f68d80c7550 0x7f68d80ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.427+0000 7f68d7e00640 1 --2- 172.21.15.7:0/2268966053 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68d8151280 0x7f68d815ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.427+0000 7f68dd000640 1 -- 172.21.15.7:0/2268966053 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68d8151280 msgr2=0x7f68d815ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:32.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.427+0000 7f68dd000640 1 --2- 172.21.15.7:0/2268966053 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68d8151280 0x7f68d815ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.427+0000 7f68dd000640 1 -- 172.21.15.7:0/2268966053 >> v2:172.21.15.77:3300/0 conn(0x7f68d80c7550 msgr2=0x7f68d80ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:32.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.427+0000 7f68dd000640 1 --2- 172.21.15.7:0/2268966053 >> v2:172.21.15.77:3300/0 conn(0x7f68d80c7550 0x7f68d80ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.427+0000 7f68dd000640 1 -- 172.21.15.7:0/2268966053 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d80b2b10 con 0x7f68d806f8b0 2024-09-13T15:07:32.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.427+0000 7f68dd000640 1 --2- 172.21.15.7:0/2268966053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68d806f8b0 0x7f68d80cd020 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f68d80ccab0 tx=0x7f68d001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fad91d239cba2f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:32.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68d7400640 1 -- 172.21.15.7:0/2268966053 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d00a56d0 con 0x7f68d806f8b0 2024-09-13T15:07:32.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68d7400640 1 -- 172.21.15.7:0/2268966053 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d00a5830 con 0x7f68d806f8b0 2024-09-13T15:07:32.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68d7400640 1 -- 172.21.15.7:0/2268966053 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d00a5bc0 con 0x7f68d806f8b0 2024-09-13T15:07:32.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68df000640 1 -- 172.21.15.7:0/2268966053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68d806f8b0 msgr2=0x7f68d80cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68df000640 1 --2- 172.21.15.7:0/2268966053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68d806f8b0 0x7f68d80cd020 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f68d80ccab0 tx=0x7f68d001c960 comp rx=0 tx=0).stop 2024-09-13T15:07:32.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68df000640 1 -- 172.21.15.7:0/2268966053 shutdown_connections 2024-09-13T15:07:32.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68df000640 1 --2- 172.21.15.7:0/2268966053 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68d806f8b0 0x7f68d80cd020 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68df000640 1 --2- 172.21.15.7:0/2268966053 >> v2:172.21.15.77:3300/0 conn(0x7f68d80c7550 0x7f68d80ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68df000640 1 --2- 172.21.15.7:0/2268966053 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68d8151280 0x7f68d815ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68df000640 1 -- 172.21.15.7:0/2268966053 >> 172.21.15.7:0/2268966053 conn(0x7f68d80717a0 msgr2=0x7f68d8071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:32.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68df000640 1 -- 172.21.15.7:0/2268966053 shutdown_connections 2024-09-13T15:07:32.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68df000640 1 -- 172.21.15.7:0/2268966053 wait complete. 2024-09-13T15:07:32.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68df000640 1 Processor -- start 2024-09-13T15:07:32.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68df000640 1 -- start start 2024-09-13T15:07:32.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68df000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68d806f8b0 0x7f68d8140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68df000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68d80c7550 0x7f68d806aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68df000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68d8151280 0x7f68d806af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68df000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d80c3f60 con 0x7f68d806f8b0 2024-09-13T15:07:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68df000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d8158a30 con 0x7f68d80c7550 2024-09-13T15:07:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68df000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d8069fd0 con 0x7f68d8151280 2024-09-13T15:07:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.431+0000 7f68d7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68d806f8b0 0x7f68d8140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.435+0000 7f68d7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68d806f8b0 0x7f68d8140d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48252/0 (socket says 172.21.15.7:48252) 2024-09-13T15:07:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.435+0000 7f68d7e00640 1 -- 172.21.15.7:0/413558122 learned_addr learned my addr 172.21.15.7:0/413558122 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.435+0000 7f68cfe00640 1 --2- 172.21.15.7:0/413558122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68d80c7550 0x7f68d806aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.435+0000 7f68dd000640 1 --2- 172.21.15.7:0/413558122 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68d8151280 0x7f68d806af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.435+0000 7f68d7e00640 1 -- 172.21.15.7:0/413558122 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68d8151280 msgr2=0x7f68d806af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.435+0000 7f68d7e00640 1 --2- 172.21.15.7:0/413558122 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68d8151280 0x7f68d806af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.435+0000 7f68d7e00640 1 -- 172.21.15.7:0/413558122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68d80c7550 msgr2=0x7f68d806aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.435+0000 7f68d7e00640 1 --2- 172.21.15.7:0/413558122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68d80c7550 0x7f68d806aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.435+0000 7f68d7e00640 1 -- 172.21.15.7:0/413558122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d0009b30 con 0x7f68d806f8b0 2024-09-13T15:07:32.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.435+0000 7f68d7e00640 1 --2- 172.21.15.7:0/413558122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68d806f8b0 0x7f68d8140d30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f68c800d620 tx=0x7f68c800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:32.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.435+0000 7f68d4c00640 1 -- 172.21.15.7:0/413558122 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c800b620 con 0x7f68d806f8b0 2024-09-13T15:07:32.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.435+0000 7f68d4c00640 1 -- 172.21.15.7:0/413558122 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c800b780 con 0x7f68d806f8b0 2024-09-13T15:07:32.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.435+0000 7f68d4c00640 1 -- 172.21.15.7:0/413558122 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c800bb10 con 0x7f68d806f8b0 2024-09-13T15:07:32.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.435+0000 7f68df000640 1 -- 172.21.15.7:0/413558122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d8158ca0 con 0x7f68d806f8b0 2024-09-13T15:07:32.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.435+0000 7f68df000640 1 -- 172.21.15.7:0/413558122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d806a520 con 0x7f68d806f8b0 2024-09-13T15:07:32.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.435+0000 7f68df000640 1 -- 172.21.15.7:0/413558122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d806a6b0 con 0x7f68d806f8b0 2024-09-13T15:07:32.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.439+0000 7f68d4c00640 1 -- 172.21.15.7:0/413558122 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f68c800bc70 con 0x7f68d806f8b0 2024-09-13T15:07:32.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.439+0000 7f68d4c00640 1 --2- 172.21.15.7:0/413558122 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f68b40666c0 0x7f68b4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:32.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.439+0000 7f68d4c00640 1 -- 172.21.15.7:0/413558122 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f68c8084b40 con 0x7f68d806f8b0 2024-09-13T15:07:32.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.439+0000 7f68cfe00640 1 --2- 172.21.15.7:0/413558122 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f68b40666c0 0x7f68b4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:32.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.439+0000 7f68cfe00640 1 --2- 172.21.15.7:0/413558122 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f68b40666c0 0x7f68b4068b80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f68d80cc1a0 tx=0x7f68c0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:32.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.443+0000 7f68d4c00640 1 -- 172.21.15.7:0/413558122 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f68c80519b0 con 0x7f68d806f8b0 2024-09-13T15:07:32.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.639+0000 7f68df000640 1 -- 172.21.15.7:0/413558122 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f68d80c9df0 con 0x7f68d806f8b0 2024-09-13T15:07:32.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.639+0000 7f68d4c00640 1 -- 172.21.15.7:0/413558122 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+5545 (secure 0 0 0) 0x7f68c8054fd0 con 0x7f68d806f8b0 2024-09-13T15:07:32.644 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:07:32.644 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:27.870033+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:rejoin","state_seq":32,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:07:32.644 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 28 2024-09-13T15:07:32.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.643+0000 7f68df000640 1 -- 172.21.15.7:0/413558122 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f68b40666c0 msgr2=0x7f68b4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.643+0000 7f68df000640 1 --2- 172.21.15.7:0/413558122 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f68b40666c0 0x7f68b4068b80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f68d80cc1a0 tx=0x7f68c0008040 comp rx=0 tx=0).stop 2024-09-13T15:07:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.643+0000 7f68df000640 1 -- 172.21.15.7:0/413558122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68d806f8b0 msgr2=0x7f68d8140d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.643+0000 7f68df000640 1 --2- 172.21.15.7:0/413558122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68d806f8b0 0x7f68d8140d30 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f68c800d620 tx=0x7f68c800dae0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.643+0000 7f68df000640 1 -- 172.21.15.7:0/413558122 shutdown_connections 2024-09-13T15:07:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.643+0000 7f68df000640 1 --2- 172.21.15.7:0/413558122 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f68b40666c0 0x7f68b4068b80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.643+0000 7f68df000640 1 --2- 172.21.15.7:0/413558122 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f68d8151280 0x7f68d806af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.643+0000 7f68df000640 1 --2- 172.21.15.7:0/413558122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68d80c7550 0x7f68d806aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.643+0000 7f68df000640 1 --2- 172.21.15.7:0/413558122 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68d806f8b0 0x7f68d8140d30 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.643+0000 7f68df000640 1 -- 172.21.15.7:0/413558122 >> 172.21.15.7:0/413558122 conn(0x7f68d80717a0 msgr2=0x7f68d8071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.643+0000 7f68df000640 1 -- 172.21.15.7:0/413558122 shutdown_connections 2024-09-13T15:07:32.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:32.643+0000 7f68df000640 1 -- 172.21.15.7:0/413558122 wait complete. 2024-09-13T15:07:32.668 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:07:34.669 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:34.762 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-09-13T15:07:34.759+0000 7ff9aa000640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-13T15:07:34.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.807+0000 7f8e95a00640 1 Processor -- start 2024-09-13T15:07:34.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.807+0000 7f8e95a00640 1 -- start start 2024-09-13T15:07:34.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.807+0000 7f8e95a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8e901531d0 0x7f8e900c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:34.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.807+0000 7f8e95a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e9006f780 0x7f8e900ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:34.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.807+0000 7f8e95a00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e9015d3b0 con 0x7f8e9006fb80 2024-09-13T15:07:34.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.807+0000 7f8e95a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e90070050 con 0x7f8e901531d0 2024-09-13T15:07:34.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.807+0000 7f8e95a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9015c7a0 con 0x7f8e9006f780 2024-09-13T15:07:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.811+0000 7f8e8ea00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8e901531d0 0x7f8e900c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.811+0000 7f8e8ea00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8e901531d0 0x7f8e900c28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48268/0 (socket says 172.21.15.7:48268) 2024-09-13T15:07:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.811+0000 7f8e8ea00640 1 -- 172.21.15.7:0/3444456514 learned_addr learned my addr 172.21.15.7:0/3444456514 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.811+0000 7f8e86000640 1 --2- 172.21.15.7:0/3444456514 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e9006f780 0x7f8e900ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.811+0000 7f8e8ea00640 1 -- 172.21.15.7:0/3444456514 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e9006f780 msgr2=0x7f8e900ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.811+0000 7f8e8ea00640 1 --2- 172.21.15.7:0/3444456514 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e9006f780 0x7f8e900ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.811+0000 7f8e8ea00640 1 -- 172.21.15.7:0/3444456514 >> v1:172.21.15.77:6789/0 conn(0x7f8e9006fb80 legacy=0x7f8e90159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.811+0000 7f8e8ea00640 1 -- 172.21.15.7:0/3444456514 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9015ca80 con 0x7f8e901531d0 2024-09-13T15:07:34.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.811+0000 7f8e8ea00640 1 --2- 172.21.15.7:0/3444456514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e901531d0 0x7f8e900c28c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009870 tx=0x7f8e8001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4669da7685651894 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:34.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.811+0000 7f8e8e000640 1 -- 172.21.15.7:0/3444456514 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e800a8a50 con 0x7f8e901531d0 2024-09-13T15:07:34.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.811+0000 7f8e8e000640 1 -- 172.21.15.7:0/3444456514 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e800a8bb0 con 0x7f8e901531d0 2024-09-13T15:07:34.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.811+0000 7f8e8e000640 1 -- 172.21.15.7:0/3444456514 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e800b0440 con 0x7f8e901531d0 2024-09-13T15:07:34.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e95a00640 1 -- 172.21.15.7:0/3444456514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e901531d0 msgr2=0x7f8e900c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e95a00640 1 --2- 172.21.15.7:0/3444456514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e901531d0 0x7f8e900c28c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009870 tx=0x7f8e8001ed50 comp rx=0 tx=0).stop 2024-09-13T15:07:34.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e95a00640 1 -- 172.21.15.7:0/3444456514 shutdown_connections 2024-09-13T15:07:34.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e95a00640 1 --2- 172.21.15.7:0/3444456514 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e9006f780 0x7f8e900ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e95a00640 1 --2- 172.21.15.7:0/3444456514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e901531d0 0x7f8e900c28c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e95a00640 1 -- 172.21.15.7:0/3444456514 >> 172.21.15.7:0/3444456514 conn(0x7f8e900739a0 msgr2=0x7f8e90071830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:34.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e95a00640 1 -- 172.21.15.7:0/3444456514 shutdown_connections 2024-09-13T15:07:34.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e95a00640 1 -- 172.21.15.7:0/3444456514 wait complete. 2024-09-13T15:07:34.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e95a00640 1 Processor -- start 2024-09-13T15:07:34.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e95a00640 1 -- start start 2024-09-13T15:07:34.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e95a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e9006f780 0x7f8e900c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:34.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e95a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e9006fb80 0x7f8e900c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:34.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e95a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e901531d0 0x7f8e900c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:34.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e95a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e901504e0 con 0x7f8e9006f780 2024-09-13T15:07:34.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e95a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e900c64b0 con 0x7f8e9006fb80 2024-09-13T15:07:34.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e95a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9014ceb0 con 0x7f8e901531d0 2024-09-13T15:07:34.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e8ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e9006f780 0x7f8e900c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:34.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e8ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e9006f780 0x7f8e900c5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48278/0 (socket says 172.21.15.7:48278) 2024-09-13T15:07:34.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e8ea00640 1 -- 172.21.15.7:0/4204914337 learned_addr learned my addr 172.21.15.7:0/4204914337 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:34.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e8f400640 1 --2- 172.21.15.7:0/4204914337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e901531d0 0x7f8e900c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:34.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e86000640 1 --2- 172.21.15.7:0/4204914337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e9006fb80 0x7f8e900c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:34.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e8ea00640 1 -- 172.21.15.7:0/4204914337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e901531d0 msgr2=0x7f8e900c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e8ea00640 1 --2- 172.21.15.7:0/4204914337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e901531d0 0x7f8e900c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e8ea00640 1 -- 172.21.15.7:0/4204914337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e9006fb80 msgr2=0x7f8e900c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:34.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e8ea00640 1 --2- 172.21.15.7:0/4204914337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e9006fb80 0x7f8e900c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:34.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e8ea00640 1 -- 172.21.15.7:0/4204914337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e800094d0 con 0x7f8e9006f780 2024-09-13T15:07:34.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e8f400640 1 --2- 172.21.15.7:0/4204914337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e901531d0 0x7f8e900c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:34.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.815+0000 7f8e86000640 1 --2- 172.21.15.7:0/4204914337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e9006fb80 0x7f8e900c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:07:34.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.819+0000 7f8e8ea00640 1 --2- 172.21.15.7:0/4204914337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e9006f780 0x7f8e900c5f70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8e8001c980 tx=0x7f8e8001baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:34.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.819+0000 7f8e87400640 1 -- 172.21.15.7:0/4204914337 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e800b0d90 con 0x7f8e9006f780 2024-09-13T15:07:34.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.819+0000 7f8e87400640 1 -- 172.21.15.7:0/4204914337 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e800b9440 con 0x7f8e9006f780 2024-09-13T15:07:34.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.819+0000 7f8e95a00640 1 -- 172.21.15.7:0/4204914337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e901eede0 con 0x7f8e9006f780 2024-09-13T15:07:34.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.819+0000 7f8e87400640 1 -- 172.21.15.7:0/4204914337 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e800b97f0 con 0x7f8e9006f780 2024-09-13T15:07:34.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.819+0000 7f8e95a00640 1 -- 172.21.15.7:0/4204914337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e900c6840 con 0x7f8e9006f780 2024-09-13T15:07:34.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.819+0000 7f8e95a00640 1 -- 172.21.15.7:0/4204914337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e900c28c0 con 0x7f8e9006f780 2024-09-13T15:07:34.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.819+0000 7f8e87400640 1 -- 172.21.15.7:0/4204914337 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8e800b7070 con 0x7f8e9006f780 2024-09-13T15:07:34.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.819+0000 7f8e87400640 1 --2- 172.21.15.7:0/4204914337 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8e6c0666c0 0x7f8e6c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:34.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.819+0000 7f8e87400640 1 -- 172.21.15.7:0/4204914337 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f8e80122290 con 0x7f8e9006f780 2024-09-13T15:07:34.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.819+0000 7f8e86000640 1 --2- 172.21.15.7:0/4204914337 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8e6c0666c0 0x7f8e6c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:34.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.823+0000 7f8e86000640 1 --2- 172.21.15.7:0/4204914337 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8e6c0666c0 0x7f8e6c068b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8e900c5e40 tx=0x7f8e78008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:34.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:34.823+0000 7f8e87400640 1 -- 172.21.15.7:0/4204914337 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8e800ef060 con 0x7f8e9006f780 2024-09-13T15:07:35.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.023+0000 7f8e95a00640 1 -- 172.21.15.7:0/4204914337 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e900c9760 con 0x7f8e9006f780 2024-09-13T15:07:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.023+0000 7f8e87400640 1 -- 172.21.15.7:0/4204914337 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+5545 (secure 0 0 0) 0x7f8e800b5020 con 0x7f8e9006f780 2024-09-13T15:07:35.026 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:07:35.026 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:32.906325+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:07:35.026 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 29 2024-09-13T15:07:35.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.023+0000 7f8e95a00640 1 -- 172.21.15.7:0/4204914337 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8e6c0666c0 msgr2=0x7f8e6c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:35.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.023+0000 7f8e95a00640 1 --2- 172.21.15.7:0/4204914337 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8e6c0666c0 0x7f8e6c068b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8e900c5e40 tx=0x7f8e78008040 comp rx=0 tx=0).stop 2024-09-13T15:07:35.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.023+0000 7f8e95a00640 1 -- 172.21.15.7:0/4204914337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e9006f780 msgr2=0x7f8e900c5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:35.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.023+0000 7f8e95a00640 1 --2- 172.21.15.7:0/4204914337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e9006f780 0x7f8e900c5f70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8e8001c980 tx=0x7f8e8001baf0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.023+0000 7f8e95a00640 1 -- 172.21.15.7:0/4204914337 shutdown_connections 2024-09-13T15:07:35.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.023+0000 7f8e95a00640 1 --2- 172.21.15.7:0/4204914337 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8e6c0666c0 0x7f8e6c068b80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.023+0000 7f8e95a00640 1 --2- 172.21.15.7:0/4204914337 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8e901531d0 0x7f8e900c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.023+0000 7f8e95a00640 1 --2- 172.21.15.7:0/4204914337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e9006fb80 0x7f8e900c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.023+0000 7f8e95a00640 1 --2- 172.21.15.7:0/4204914337 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8e9006f780 0x7f8e900c5f70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.023+0000 7f8e95a00640 1 -- 172.21.15.7:0/4204914337 >> 172.21.15.7:0/4204914337 conn(0x7f8e900739a0 msgr2=0x7f8e900b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:35.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.023+0000 7f8e95a00640 1 -- 172.21.15.7:0/4204914337 shutdown_connections 2024-09-13T15:07:35.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.023+0000 7f8e95a00640 1 -- 172.21.15.7:0/4204914337 wait complete. 2024-09-13T15:07:35.047 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e has gained rank=4, replacing gid=4220 2024-09-13T15:07:35.048 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 0 secs before reviving mds.b 2024-09-13T15:07:35.048 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.b 2024-09-13T15:07:35.048 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T15:07:35.048 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T15:07:35.051 INFO:tasks.ceph.mds.b:Started 2024-09-13T15:07:35.052 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:35.144 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-13T15:07:35.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c8400640 1 Processor -- start 2024-09-13T15:07:35.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c8400640 1 -- start start 2024-09-13T15:07:35.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c8400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f95c0152fe0 0x7f95c00ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:35.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c8400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c00ccff0 0x7f95c006f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:35.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c8400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c00701a0 con 0x7f95c006fd70 2024-09-13T15:07:35.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c8400640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c0159230 con 0x7f95c0152fe0 2024-09-13T15:07:35.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c8400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c0159510 con 0x7f95c00ccff0 2024-09-13T15:07:35.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c5000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c00ccff0 0x7f95c006f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:35.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c5a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f95c0152fe0 0x7f95c00ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:35.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c5a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f95c0152fe0 0x7f95c00ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:51802/0 (socket says 172.21.15.7:51802) 2024-09-13T15:07:35.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c5a00640 1 -- 172.21.15.7:0/261472463 learned_addr learned my addr 172.21.15.7:0/261472463 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:35.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c5000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c00ccff0 0x7f95c006f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:40734/0 (socket says 172.21.15.7:40734) 2024-09-13T15:07:35.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c6400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f95c006fd70 0x7f95c015ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58262/0 (socket says 172.21.15.7:58262) 2024-09-13T15:07:35.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c5000640 1 -- 172.21.15.7:0/261472463 >> v2:172.21.15.77:3300/0 conn(0x7f95c0152fe0 msgr2=0x7f95c00ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:35.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c5000640 1 --2- 172.21.15.7:0/261472463 >> v2:172.21.15.77:3300/0 conn(0x7f95c0152fe0 0x7f95c00ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c5000640 1 -- 172.21.15.7:0/261472463 >> v1:172.21.15.7:6789/0 conn(0x7f95c006fd70 legacy=0x7f95c015ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:35.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c5000640 1 -- 172.21.15.7:0/261472463 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c01597f0 con 0x7f95c00ccff0 2024-09-13T15:07:35.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95c5a00640 1 --2- 172.21.15.7:0/261472463 >> v2:172.21.15.77:3300/0 conn(0x7f95c0152fe0 0x7f95c00ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:35.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.191+0000 7f95bfe00640 1 -- 172.21.15.7:0/261472463 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347505795 0 0) 0x7f95b80014a0 con 0x7f95c006fd70 2024-09-13T15:07:35.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.195+0000 7f95c5000640 1 --2- 172.21.15.7:0/261472463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c00ccff0 0x7f95c006f830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0097c0 tx=0x7f95ac01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7eccd18776ab38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:35.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.195+0000 7f95bfe00640 1 -- 172.21.15.7:0/261472463 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac0a8990 con 0x7f95c00ccff0 2024-09-13T15:07:35.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.195+0000 7f95bfe00640 1 -- 172.21.15.7:0/261472463 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac0a8af0 con 0x7f95c00ccff0 2024-09-13T15:07:35.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.195+0000 7f95bfe00640 1 -- 172.21.15.7:0/261472463 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac0a8e80 con 0x7f95c00ccff0 2024-09-13T15:07:35.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.195+0000 7f95c8400640 1 -- 172.21.15.7:0/261472463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c00ccff0 msgr2=0x7f95c006f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:35.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.195+0000 7f95c8400640 1 --2- 172.21.15.7:0/261472463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c00ccff0 0x7f95c006f830 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0097c0 tx=0x7f95ac01ec90 comp rx=0 tx=0).stop 2024-09-13T15:07:35.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.195+0000 7f95c8400640 1 -- 172.21.15.7:0/261472463 shutdown_connections 2024-09-13T15:07:35.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.195+0000 7f95c8400640 1 --2- 172.21.15.7:0/261472463 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c00ccff0 0x7f95c006f830 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.195+0000 7f95c8400640 1 --2- 172.21.15.7:0/261472463 >> v2:172.21.15.77:3300/0 conn(0x7f95c0152fe0 0x7f95c00ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.195+0000 7f95c8400640 1 -- 172.21.15.7:0/261472463 >> 172.21.15.7:0/261472463 conn(0x7f95c00739a0 msgr2=0x7f95c0071830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:35.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.195+0000 7f95c8400640 1 -- 172.21.15.7:0/261472463 shutdown_connections 2024-09-13T15:07:35.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.195+0000 7f95c8400640 1 -- 172.21.15.7:0/261472463 wait complete. 2024-09-13T15:07:35.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c8400640 1 Processor -- start 2024-09-13T15:07:35.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c8400640 1 -- start start 2024-09-13T15:07:35.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c8400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c006fd70 0x7f95c01f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:35.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c8400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95c00ccff0 0x7f95c014ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:35.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c8400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c0152fe0 0x7f95c015b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:35.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c8400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c014fd60 con 0x7f95c0152fe0 2024-09-13T15:07:35.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c8400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c014ffd0 con 0x7f95c00ccff0 2024-09-13T15:07:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c8400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c01f1c00 con 0x7f95c006fd70 2024-09-13T15:07:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c5000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95c00ccff0 0x7f95c014ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c5a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c006fd70 0x7f95c01f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c6400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c0152fe0 0x7f95c015b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c5000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95c00ccff0 0x7f95c014ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:51816/0 (socket says 172.21.15.7:51816) 2024-09-13T15:07:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c5000640 1 -- 172.21.15.7:0/1824923025 learned_addr learned my addr 172.21.15.7:0/1824923025 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c6400640 1 -- 172.21.15.7:0/1824923025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c006fd70 msgr2=0x7f95c01f26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c6400640 1 --2- 172.21.15.7:0/1824923025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c006fd70 0x7f95c01f26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c6400640 1 -- 172.21.15.7:0/1824923025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95c00ccff0 msgr2=0x7f95c014ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c6400640 1 --2- 172.21.15.7:0/1824923025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95c00ccff0 0x7f95c014ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c6400640 1 -- 172.21.15.7:0/1824923025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b40094d0 con 0x7f95c0152fe0 2024-09-13T15:07:35.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c5000640 1 --2- 172.21.15.7:0/1824923025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95c00ccff0 0x7f95c014ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:07:35.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c6400640 1 --2- 172.21.15.7:0/1824923025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c0152fe0 0x7f95c015b500 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f95b800c780 tx=0x7f95b800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95bd600640 1 -- 172.21.15.7:0/1824923025 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b800ce30 con 0x7f95c0152fe0 2024-09-13T15:07:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95bd600640 1 -- 172.21.15.7:0/1824923025 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b800a640 con 0x7f95c0152fe0 2024-09-13T15:07:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95bd600640 1 -- 172.21.15.7:0/1824923025 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b800a9f0 con 0x7f95c0152fe0 2024-09-13T15:07:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c8400640 1 -- 172.21.15.7:0/1824923025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ac009420 con 0x7f95c0152fe0 2024-09-13T15:07:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.199+0000 7f95c8400640 1 -- 172.21.15.7:0/1824923025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c01f21c0 con 0x7f95c0152fe0 2024-09-13T15:07:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.203+0000 7f95c8400640 1 -- 172.21.15.7:0/1824923025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c00c28c0 con 0x7f95c0152fe0 2024-09-13T15:07:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.203+0000 7f95bd600640 1 -- 172.21.15.7:0/1824923025 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f95b800ab50 con 0x7f95c0152fe0 2024-09-13T15:07:35.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.203+0000 7f95bd600640 1 --2- 172.21.15.7:0/1824923025 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f95a0066690 0x7f95a0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:35.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.203+0000 7f95bd600640 1 -- 172.21.15.7:0/1824923025 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f95b8083a50 con 0x7f95c0152fe0 2024-09-13T15:07:35.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.203+0000 7f95c5a00640 1 --2- 172.21.15.7:0/1824923025 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f95a0066690 0x7f95a0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:35.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.203+0000 7f95c5a00640 1 --2- 172.21.15.7:0/1824923025 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f95a0066690 0x7f95a0068b50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f95b4006cb0 tx=0x7f95b4009240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:35.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.207+0000 7f95bd600640 1 -- 172.21.15.7:0/1824923025 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f95b8050ae0 con 0x7f95c0152fe0 2024-09-13T15:07:35.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.403+0000 7f95c8400640 1 -- 172.21.15.7:0/1824923025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95c00701a0 con 0x7f95c0152fe0 2024-09-13T15:07:35.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.403+0000 7f95bd600640 1 -- 172.21.15.7:0/1824923025 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+5545 (secure 0 0 0) 0x7f95c00701a0 con 0x7f95c0152fe0 2024-09-13T15:07:35.406 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:07:35.406 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:32.906325+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:07:35.406 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 29 2024-09-13T15:07:35.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.403+0000 7f95c8400640 1 -- 172.21.15.7:0/1824923025 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f95a0066690 msgr2=0x7f95a0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:35.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.403+0000 7f95c8400640 1 --2- 172.21.15.7:0/1824923025 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f95a0066690 0x7f95a0068b50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f95b4006cb0 tx=0x7f95b4009240 comp rx=0 tx=0).stop 2024-09-13T15:07:35.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.403+0000 7f95c8400640 1 -- 172.21.15.7:0/1824923025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c0152fe0 msgr2=0x7f95c015b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:35.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.403+0000 7f95c8400640 1 --2- 172.21.15.7:0/1824923025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c0152fe0 0x7f95c015b500 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f95b800c780 tx=0x7f95b800cc40 comp rx=0 tx=0).stop 2024-09-13T15:07:35.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.403+0000 7f95c8400640 1 -- 172.21.15.7:0/1824923025 shutdown_connections 2024-09-13T15:07:35.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.403+0000 7f95c8400640 1 --2- 172.21.15.7:0/1824923025 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f95a0066690 0x7f95a0068b50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.403+0000 7f95c8400640 1 --2- 172.21.15.7:0/1824923025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95c0152fe0 0x7f95c015b500 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.403+0000 7f95c8400640 1 --2- 172.21.15.7:0/1824923025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95c00ccff0 0x7f95c014ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.403+0000 7f95c8400640 1 --2- 172.21.15.7:0/1824923025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f95c006fd70 0x7f95c01f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:35.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.403+0000 7f95c8400640 1 -- 172.21.15.7:0/1824923025 >> 172.21.15.7:0/1824923025 conn(0x7f95c00739a0 msgr2=0x7f95c00c95e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:35.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.403+0000 7f95c8400640 1 -- 172.21.15.7:0/1824923025 shutdown_connections 2024-09-13T15:07:35.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:35.403+0000 7f95c8400640 1 -- 172.21.15.7:0/1824923025 wait complete. 2024-09-13T15:07:35.427 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2024-09-13T15:07:37.428 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:07:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.567+0000 7f4f0f400640 1 Processor -- start 2024-09-13T15:07:37.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.567+0000 7f4f0f400640 1 -- start start 2024-09-13T15:07:37.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.567+0000 7f4f0f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4f08150fc0 0x7f4f080c7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.567+0000 7f4f0f400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4f080b2c80 0x7f4f0815aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.567+0000 7f4f0f400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f080c2050 con 0x7f4f080c7a90 2024-09-13T15:07:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.567+0000 7f4f0f400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f08156e20 con 0x7f4f08150fc0 2024-09-13T15:07:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.567+0000 7f4f0f400640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f080c2330 con 0x7f4f080b2c80 2024-09-13T15:07:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.567+0000 7f4f0ca00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4f08150fc0 0x7f4f080c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.567+0000 7f4f0ca00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4f08150fc0 0x7f4f080c7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48292/0 (socket says 172.21.15.7:48292) 2024-09-13T15:07:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.567+0000 7f4f0ca00640 1 -- 172.21.15.7:0/3615992442 learned_addr learned my addr 172.21.15.7:0/3615992442 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.567+0000 7f4f07e00640 1 --2- 172.21.15.7:0/3615992442 >> v2:172.21.15.77:3300/0 conn(0x7f4f080b2c80 0x7f4f0815aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.567+0000 7f4f0ca00640 1 -- 172.21.15.7:0/3615992442 >> v2:172.21.15.77:3300/0 conn(0x7f4f080b2c80 msgr2=0x7f4f0815aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:07:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.567+0000 7f4f0ca00640 1 --2- 172.21.15.7:0/3615992442 >> v2:172.21.15.77:3300/0 conn(0x7f4f080b2c80 0x7f4f0815aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.567+0000 7f4f0ca00640 1 -- 172.21.15.7:0/3615992442 >> v1:172.21.15.77:6789/0 conn(0x7f4f080c7a90 legacy=0x7f4f080ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:37.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.567+0000 7f4f0ca00640 1 -- 172.21.15.7:0/3615992442 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f080c2610 con 0x7f4f08150fc0 2024-09-13T15:07:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.571+0000 7f4f0ca00640 1 --2- 172.21.15.7:0/3615992442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f08150fc0 0x7f4f080c7550 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4f080ca6d0 tx=0x7f4efc01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1429eb074794599 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.571+0000 7f4f07400640 1 -- 172.21.15.7:0/3615992442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc0a8a10 con 0x7f4f08150fc0 2024-09-13T15:07:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.571+0000 7f4f07400640 1 -- 172.21.15.7:0/3615992442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc0a8b70 con 0x7f4f08150fc0 2024-09-13T15:07:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.571+0000 7f4f07400640 1 -- 172.21.15.7:0/3615992442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc0b0440 con 0x7f4f08150fc0 2024-09-13T15:07:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.571+0000 7f4f0f400640 1 -- 172.21.15.7:0/3615992442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f08150fc0 msgr2=0x7f4f080c7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.571+0000 7f4f0f400640 1 --2- 172.21.15.7:0/3615992442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f08150fc0 0x7f4f080c7550 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4f080ca6d0 tx=0x7f4efc01ed10 comp rx=0 tx=0).stop 2024-09-13T15:07:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.571+0000 7f4f0f400640 1 -- 172.21.15.7:0/3615992442 shutdown_connections 2024-09-13T15:07:37.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.571+0000 7f4f0f400640 1 --2- 172.21.15.7:0/3615992442 >> v2:172.21.15.77:3300/0 conn(0x7f4f080b2c80 0x7f4f0815aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.571+0000 7f4f0f400640 1 --2- 172.21.15.7:0/3615992442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f08150fc0 0x7f4f080c7550 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.571+0000 7f4f0f400640 1 -- 172.21.15.7:0/3615992442 >> 172.21.15.7:0/3615992442 conn(0x7f4f080739a0 msgr2=0x7f4f08071830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:37.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.571+0000 7f4f0f400640 1 -- 172.21.15.7:0/3615992442 shutdown_connections 2024-09-13T15:07:37.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.571+0000 7f4f0f400640 1 -- 172.21.15.7:0/3615992442 wait complete. 2024-09-13T15:07:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f0f400640 1 Processor -- start 2024-09-13T15:07:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f0f400640 1 -- start start 2024-09-13T15:07:37.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f0f400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f080b2c80 0x7f4f08159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f0f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f080c7a90 0x7f4f0814faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f0f400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f08150fc0 0x7f4f081587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f0f400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f08156700 con 0x7f4f080c7a90 2024-09-13T15:07:37.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f0f400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f081560d0 con 0x7f4f080b2c80 2024-09-13T15:07:37.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f0f400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f08156b90 con 0x7f4f08150fc0 2024-09-13T15:07:37.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f07e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f080c7a90 0x7f4f0814faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f0ca00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f080b2c80 0x7f4f08159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f07e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f080c7a90 0x7f4f0814faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48306/0 (socket says 172.21.15.7:48306) 2024-09-13T15:07:37.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f07e00640 1 -- 172.21.15.7:0/1842831248 learned_addr learned my addr 172.21.15.7:0/1842831248 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:07:37.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f0d400640 1 --2- 172.21.15.7:0/1842831248 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f08150fc0 0x7f4f081587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f07e00640 1 -- 172.21.15.7:0/1842831248 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f08150fc0 msgr2=0x7f4f081587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f07e00640 1 --2- 172.21.15.7:0/1842831248 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f08150fc0 0x7f4f081587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f07e00640 1 -- 172.21.15.7:0/1842831248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f080b2c80 msgr2=0x7f4f08159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f07e00640 1 --2- 172.21.15.7:0/1842831248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f080b2c80 0x7f4f08159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f07e00640 1 -- 172.21.15.7:0/1842831248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc0094d0 con 0x7f4f080c7a90 2024-09-13T15:07:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f07e00640 1 --2- 172.21.15.7:0/1842831248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f080c7a90 0x7f4f0814faa0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400d800 tx=0x7f4ef400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f04c00640 1 -- 172.21.15.7:0/1842831248 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef400b6c0 con 0x7f4f080c7a90 2024-09-13T15:07:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f04c00640 1 -- 172.21.15.7:0/1842831248 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef400b820 con 0x7f4f080c7a90 2024-09-13T15:07:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f04c00640 1 -- 172.21.15.7:0/1842831248 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef400bb90 con 0x7f4f080c7a90 2024-09-13T15:07:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f0f400640 1 -- 172.21.15.7:0/1842831248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f08159ed0 con 0x7f4f080c7a90 2024-09-13T15:07:37.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.575+0000 7f4f0f400640 1 -- 172.21.15.7:0/1842831248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f08156390 con 0x7f4f080c7a90 2024-09-13T15:07:37.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.579+0000 7f4f0f400640 1 -- 172.21.15.7:0/1842831248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f08156550 con 0x7f4f080c7a90 2024-09-13T15:07:37.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.579+0000 7f4f04c00640 1 -- 172.21.15.7:0/1842831248 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4ef400bcf0 con 0x7f4f080c7a90 2024-09-13T15:07:37.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.579+0000 7f4f04c00640 1 --2- 172.21.15.7:0/1842831248 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4ee80666c0 0x7f4ee8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:07:37.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.579+0000 7f4f04c00640 1 -- 172.21.15.7:0/1842831248 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f4ef4084a00 con 0x7f4f080c7a90 2024-09-13T15:07:37.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.579+0000 7f4f0ca00640 1 --2- 172.21.15.7:0/1842831248 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4ee80666c0 0x7f4ee8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:07:37.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.579+0000 7f4f0ca00640 1 --2- 172.21.15.7:0/1842831248 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4ee80666c0 0x7f4ee8068b80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0b2000 tx=0x7f4efc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:07:37.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.583+0000 7f4f04c00640 1 -- 172.21.15.7:0/1842831248 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4ef4051990 con 0x7f4f080c7a90 2024-09-13T15:07:37.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.779+0000 7f4f0f400640 1 -- 172.21.15.7:0/1842831248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f080c7550 con 0x7f4f080c7a90 2024-09-13T15:07:37.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.779+0000 7f4f04c00640 1 -- 172.21.15.7:0/1842831248 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+6298 (secure 0 0 0) 0x7f4ef4054fb0 con 0x7f4f080c7a90 2024-09-13T15:07:37.782 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:07:37.783 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:32.906325+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:07:37.783 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2024-09-13T15:07:37.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.779+0000 7f4f0f400640 1 -- 172.21.15.7:0/1842831248 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4ee80666c0 msgr2=0x7f4ee8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:37.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.779+0000 7f4f0f400640 1 --2- 172.21.15.7:0/1842831248 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4ee80666c0 0x7f4ee8068b80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4efc0b2000 tx=0x7f4efc009040 comp rx=0 tx=0).stop 2024-09-13T15:07:37.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.779+0000 7f4f0f400640 1 -- 172.21.15.7:0/1842831248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f080c7a90 msgr2=0x7f4f0814faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:07:37.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.779+0000 7f4f0f400640 1 --2- 172.21.15.7:0/1842831248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f080c7a90 0x7f4f0814faa0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4ef400d800 tx=0x7f4ef400dcc0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.779+0000 7f4f0f400640 1 -- 172.21.15.7:0/1842831248 shutdown_connections 2024-09-13T15:07:37.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.779+0000 7f4f0f400640 1 --2- 172.21.15.7:0/1842831248 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4ee80666c0 0x7f4ee8068b80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.779+0000 7f4f0f400640 1 --2- 172.21.15.7:0/1842831248 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4f08150fc0 0x7f4f081587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.779+0000 7f4f0f400640 1 --2- 172.21.15.7:0/1842831248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4f080c7a90 0x7f4f0814faa0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.779+0000 7f4f0f400640 1 --2- 172.21.15.7:0/1842831248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4f080b2c80 0x7f4f08159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:07:37.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.779+0000 7f4f0f400640 1 -- 172.21.15.7:0/1842831248 >> 172.21.15.7:0/1842831248 conn(0x7f4f080739a0 msgr2=0x7f4f080cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:07:37.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.779+0000 7f4f0f400640 1 -- 172.21.15.7:0/1842831248 shutdown_connections 2024-09-13T15:07:37.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:07:37.779+0000 7f4f0f400640 1 -- 172.21.15.7:0/1842831248 wait complete. 2024-09-13T15:07:37.804 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b reported in up:standby state 2024-09-13T15:07:37.804 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 112 secs before thrashing 2024-09-13T15:07:44.165 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:07:44.168 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:07:44.254 INFO:tasks.workunit.client.0.smithi007.stdout:Syncing()...28 sec 2024-09-13T15:07:44.255 INFO:tasks.workunit.client.0.smithi007.stdout:Starting Actual Benchmark At: Fri Sep 13 15:07:44 2024 2024-09-13T15:07:44.255 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:08:14.214 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:08:14.219 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:08:45.991 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:08:45.995 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:09:17.340 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:09:17.346 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:09:29.805 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:33.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.966+0000 7f7ef4c00640 1 Processor -- start 2024-09-13T15:09:33.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.974+0000 7f7ef4c00640 1 -- start start 2024-09-13T15:09:33.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.974+0000 7f7ef4c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7ef00c6890 0x7f7ef006cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:33.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.974+0000 7f7ef4c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7ef00c5e90 0x7f7ef00c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:33.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.974+0000 7f7ef4c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef0161ab0 con 0x7f7ef00c5ab0 2024-09-13T15:09:33.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.974+0000 7f7ef4c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef0160f80 con 0x7f7ef00c5e90 2024-09-13T15:09:33.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.974+0000 7f7ef4c00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef006dbc0 con 0x7f7ef00c6890 2024-09-13T15:09:33.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.978+0000 7f7eede00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7ef00c5ab0 0x7f7ef01613a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:32850/0 (socket says 172.21.15.7:32850) 2024-09-13T15:09:33.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.978+0000 7f7eed400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7ef00c6890 0x7f7ef006cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:33.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.978+0000 7f7eede00640 1 -- 172.21.15.7:0/210444992 learned_addr learned my addr 172.21.15.7:0/210444992 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:09:33.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.978+0000 7f7eee800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f7ef00c5e90 0x7f7ef00c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:33.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.978+0000 7f7eeca00640 1 -- 172.21.15.7:0/210444992 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1113246252 0 0) 0x7f7edc001120 con 0x7f7ef00c5ab0 2024-09-13T15:09:33.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.978+0000 7f7eeca00640 1 -- 172.21.15.7:0/210444992 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ed4003530 con 0x7f7ef00c5ab0 2024-09-13T15:09:33.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.978+0000 7f7eeca00640 1 -- 172.21.15.7:0/210444992 <== mon.1 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3657891775 0 0) 0x7f7ed4003530 con 0x7f7ef00c5ab0 2024-09-13T15:09:33.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.978+0000 7f7eed400640 1 -- 172.21.15.7:0/210444992 >> v2:172.21.15.7:3300/0 conn(0x7f7ef00c5e90 msgr2=0x7f7ef00c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:33.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.978+0000 7f7eed400640 1 --2- 172.21.15.7:0/210444992 >> v2:172.21.15.7:3300/0 conn(0x7f7ef00c5e90 0x7f7ef00c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:33.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.978+0000 7f7eed400640 1 -- 172.21.15.7:0/210444992 >> v1:172.21.15.77:6789/0 conn(0x7f7ef00c5ab0 legacy=0x7f7ef01613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:33.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.978+0000 7f7eed400640 1 -- 172.21.15.7:0/210444992 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef006d320 con 0x7f7ef00c6890 2024-09-13T15:09:33.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.978+0000 7f7eee800640 1 --2- 172.21.15.7:0/210444992 >> v2:172.21.15.7:3300/0 conn(0x7f7ef00c5e90 0x7f7ef00c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:33.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.982+0000 7f7eed400640 1 --2- 172.21.15.7:0/210444992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef00c6890 0x7f7ef006cce0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009d90 tx=0x7f7ee801f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e91a2901448f1e87 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.982+0000 7f7eeca00640 1 -- 172.21.15.7:0/210444992 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc001810 con 0x7f7ef00c6890 2024-09-13T15:09:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.982+0000 7f7eeca00640 1 -- 172.21.15.7:0/210444992 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee80a8c10 con 0x7f7ef00c6890 2024-09-13T15:09:33.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.982+0000 7f7eeca00640 1 -- 172.21.15.7:0/210444992 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80b0440 con 0x7f7ef00c6890 2024-09-13T15:09:33.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.986+0000 7f7ef4c00640 1 -- 172.21.15.7:0/210444992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef00c6890 msgr2=0x7f7ef006cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:33.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.986+0000 7f7ef4c00640 1 --2- 172.21.15.7:0/210444992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef00c6890 0x7f7ef006cce0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009d90 tx=0x7f7ee801f040 comp rx=0 tx=0).stop 2024-09-13T15:09:33.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.994+0000 7f7ef4c00640 1 -- 172.21.15.7:0/210444992 shutdown_connections 2024-09-13T15:09:33.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.994+0000 7f7ef4c00640 1 --2- 172.21.15.7:0/210444992 >> v2:172.21.15.7:3300/0 conn(0x7f7ef00c5e90 0x7f7ef00c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:33.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.994+0000 7f7ef4c00640 1 --2- 172.21.15.7:0/210444992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef00c6890 0x7f7ef006cce0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:33.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.994+0000 7f7ef4c00640 1 -- 172.21.15.7:0/210444992 >> 172.21.15.7:0/210444992 conn(0x7f7ef0065d40 msgr2=0x7f7ef0066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:33.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.994+0000 7f7ef4c00640 1 -- 172.21.15.7:0/210444992 shutdown_connections 2024-09-13T15:09:34.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.994+0000 7f7ef4c00640 1 -- 172.21.15.7:0/210444992 wait complete. 2024-09-13T15:09:34.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.998+0000 7f7ef4c00640 1 Processor -- start 2024-09-13T15:09:34.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.998+0000 7f7ef4c00640 1 -- start start 2024-09-13T15:09:34.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:33.998+0000 7f7ef4c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ef00c5ab0 0x7f7ef00c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:34.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.002+0000 7f7eede00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ef00c5ab0 0x7f7ef00c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:34.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.002+0000 7f7eede00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ef00c5ab0 0x7f7ef00c8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37206/0 (socket says 172.21.15.7:37206) 2024-09-13T15:09:34.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.002+0000 7f7eede00640 1 -- 172.21.15.7:0/3115696543 learned_addr learned my addr 172.21.15.7:0/3115696543 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:09:34.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.002+0000 7f7ef4c00640 1 --2- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef00c5e90 0x7f7ef015fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:34.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.002+0000 7f7ef4c00640 1 --2- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ef00c6890 0x7f7ef01396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:34.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.002+0000 7f7eed400640 1 --2- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef00c5e90 0x7f7ef015fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:34.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.006+0000 7f7eee800640 1 --2- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ef00c6890 0x7f7ef01396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:34.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.006+0000 7f7ef4c00640 1 -- 172.21.15.7:0/3115696543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef013a400 con 0x7f7ef00c5ab0 2024-09-13T15:09:34.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.006+0000 7f7ef4c00640 1 -- 172.21.15.7:0/3115696543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef0139240 con 0x7f7ef00c5e90 2024-09-13T15:09:34.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.006+0000 7f7ef4c00640 1 -- 172.21.15.7:0/3115696543 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef00c9210 con 0x7f7ef00c6890 2024-09-13T15:09:34.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.010+0000 7f7eed400640 1 -- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ef00c6890 msgr2=0x7f7ef01396d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:34.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.010+0000 7f7eed400640 1 --2- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ef00c6890 0x7f7ef01396d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:34.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.010+0000 7f7eed400640 1 -- 172.21.15.7:0/3115696543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ef00c5ab0 msgr2=0x7f7ef00c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:34.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.010+0000 7f7eed400640 1 --2- 172.21.15.7:0/3115696543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ef00c5ab0 0x7f7ef00c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:34.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.010+0000 7f7eed400640 1 -- 172.21.15.7:0/3115696543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee0009420 con 0x7f7ef00c5e90 2024-09-13T15:09:34.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.010+0000 7f7eee800640 1 --2- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ef00c6890 0x7f7ef01396d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:34.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.010+0000 7f7eed400640 1 --2- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef00c5e90 0x7f7ef015fd80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00bffb0 tx=0x7f7ee801bde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:34.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.014+0000 7f7ee6000640 1 -- 172.21.15.7:0/3115696543 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8009450 con 0x7f7ef00c5e90 2024-09-13T15:09:34.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.014+0000 7f7ee6000640 1 -- 172.21.15.7:0/3115696543 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee80ba410 con 0x7f7ef00c5e90 2024-09-13T15:09:34.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.014+0000 7f7ef4c00640 1 -- 172.21.15.7:0/3115696543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee8009a70 con 0x7f7ef00c5e90 2024-09-13T15:09:34.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.014+0000 7f7ef4c00640 1 -- 172.21.15.7:0/3115696543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef013a910 con 0x7f7ef00c5e90 2024-09-13T15:09:34.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.014+0000 7f7ee6000640 1 -- 172.21.15.7:0/3115696543 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80ba7a0 con 0x7f7ef00c5e90 2024-09-13T15:09:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.014+0000 7f7ef4c00640 1 -- 172.21.15.7:0/3115696543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef0067650 con 0x7f7ef00c5e90 2024-09-13T15:09:34.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.018+0000 7f7ee6000640 1 -- 172.21.15.7:0/3115696543 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7ee80b7050 con 0x7f7ef00c5e90 2024-09-13T15:09:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.022+0000 7f7ee6000640 1 --2- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7ed00666e0 0x7f7ed0068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.022+0000 7f7ee6000640 1 -- 172.21.15.7:0/3115696543 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f7ee81224b0 con 0x7f7ef00c5e90 2024-09-13T15:09:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.022+0000 7f7eede00640 1 --2- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7ed00666e0 0x7f7ed0068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.022+0000 7f7eede00640 1 --2- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7ed00666e0 0x7f7ed0068ba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7edc000fc0 tx=0x7f7edc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.026+0000 7f7ee6000640 1 -- 172.21.15.7:0/3115696543 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7ee80ef420 con 0x7f7ef00c5e90 2024-09-13T15:09:34.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.414+0000 7f7ef4c00640 1 -- 172.21.15.7:0/3115696543 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ef0139010 con 0x7f7ef00c5e90 2024-09-13T15:09:34.421 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:09:34.421 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:32.906325+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:09:34.421 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2024-09-13T15:09:34.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.418+0000 7f7ee6000640 1 -- 172.21.15.7:0/3115696543 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+6298 (secure 0 0 0) 0x7f7ef0139010 con 0x7f7ef00c5e90 2024-09-13T15:09:34.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.422+0000 7f7ef4c00640 1 -- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7ed00666e0 msgr2=0x7f7ed0068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:34.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.422+0000 7f7ef4c00640 1 --2- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7ed00666e0 0x7f7ed0068ba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7edc000fc0 tx=0x7f7edc009040 comp rx=0 tx=0).stop 2024-09-13T15:09:34.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.422+0000 7f7ef4c00640 1 -- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef00c5e90 msgr2=0x7f7ef015fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:34.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.422+0000 7f7ef4c00640 1 --2- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef00c5e90 0x7f7ef015fd80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00bffb0 tx=0x7f7ee801bde0 comp rx=0 tx=0).stop 2024-09-13T15:09:34.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.422+0000 7f7ef4c00640 1 -- 172.21.15.7:0/3115696543 shutdown_connections 2024-09-13T15:09:34.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.422+0000 7f7ef4c00640 1 --2- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7ed00666e0 0x7f7ed0068ba0 secure :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7edc000fc0 tx=0x7f7edc009040 comp rx=0 tx=0).stop 2024-09-13T15:09:34.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.422+0000 7f7ef4c00640 1 --2- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7ef00c6890 0x7f7ef01396d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:34.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.422+0000 7f7ef4c00640 1 --2- 172.21.15.7:0/3115696543 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7ef00c5e90 0x7f7ef015fd80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:34.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.422+0000 7f7ef4c00640 1 --2- 172.21.15.7:0/3115696543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7ef00c5ab0 0x7f7ef00c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:34.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.422+0000 7f7ef4c00640 1 -- 172.21.15.7:0/3115696543 >> 172.21.15.7:0/3115696543 conn(0x7f7ef0065d40 msgr2=0x7f7ef01564a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:34.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.426+0000 7f7ef4c00640 1 -- 172.21.15.7:0/3115696543 shutdown_connections 2024-09-13T15:09:34.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:34.426+0000 7f7ef4c00640 1 -- 172.21.15.7:0/3115696543 wait complete. 2024-09-13T15:09:35.020 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.a (rank=3) 2024-09-13T15:09:35.020 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T15:09:35.020 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:09:35.033 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T15:09:35.033 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:35.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.326+0000 7fc434c00640 1 Processor -- start 2024-09-13T15:09:35.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.326+0000 7fc434c00640 1 -- start start 2024-09-13T15:09:35.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.330+0000 7fc434c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc4300c79f0 0x7fc4300c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:35.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.330+0000 7fc434c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc43006dc00 con 0x7fc4300c1980 2024-09-13T15:09:35.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.330+0000 7fc434c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4300c6ae0 con 0x7fc430066860 2024-09-13T15:09:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.330+0000 7fc434c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4301593d0 con 0x7fc4300c79f0 2024-09-13T15:09:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.330+0000 7fc42fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc4300c79f0 0x7fc4300c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:35.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.330+0000 7fc42fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc4300c79f0 0x7fc4300c5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37218/0 (socket says 172.21.15.7:37218) 2024-09-13T15:09:35.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.330+0000 7fc42fe00640 1 -- 172.21.15.7:0/2476331922 learned_addr learned my addr 172.21.15.7:0/2476331922 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:09:35.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.330+0000 7fc42fe00640 1 -- 172.21.15.7:0/2476331922 >> v1:172.21.15.77:6789/0 conn(0x7fc430066860 legacy=0x7fc4300c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:35.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.330+0000 7fc42fe00640 1 -- 172.21.15.7:0/2476331922 >> v1:172.21.15.7:6789/0 conn(0x7fc4300c1980 legacy=0x7fc43014f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:35.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.330+0000 7fc42fe00640 1 -- 172.21.15.7:0/2476331922 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4300c6dc0 con 0x7fc4300c79f0 2024-09-13T15:09:35.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.334+0000 7fc42fe00640 1 --2- 172.21.15.7:0/2476331922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4300c79f0 0x7fc4300c5d70 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc428009e50 tx=0x7fc42801f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baae0a9c85bff36a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:35.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.338+0000 7fc42e000640 1 -- 172.21.15.7:0/2476331922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4280af400 con 0x7fc4300c79f0 2024-09-13T15:09:35.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.338+0000 7fc42e000640 1 -- 172.21.15.7:0/2476331922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4280ab050 con 0x7fc4300c79f0 2024-09-13T15:09:35.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.338+0000 7fc42e000640 1 -- 172.21.15.7:0/2476331922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4280af400 con 0x7fc4300c79f0 2024-09-13T15:09:35.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.338+0000 7fc434c00640 1 -- 172.21.15.7:0/2476331922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4300c79f0 msgr2=0x7fc4300c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:35.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.338+0000 7fc434c00640 1 --2- 172.21.15.7:0/2476331922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4300c79f0 0x7fc4300c5d70 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc428009e50 tx=0x7fc42801f1a0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.342+0000 7fc434c00640 1 -- 172.21.15.7:0/2476331922 shutdown_connections 2024-09-13T15:09:35.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.342+0000 7fc434c00640 1 --2- 172.21.15.7:0/2476331922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc4300c79f0 0x7fc4300c5d70 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.342+0000 7fc434c00640 1 -- 172.21.15.7:0/2476331922 >> 172.21.15.7:0/2476331922 conn(0x7fc430065d40 msgr2=0x7fc430066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:35.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.342+0000 7fc434c00640 1 -- 172.21.15.7:0/2476331922 shutdown_connections 2024-09-13T15:09:35.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.346+0000 7fc434c00640 1 -- 172.21.15.7:0/2476331922 wait complete. 2024-09-13T15:09:35.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.346+0000 7fc434c00640 1 Processor -- start 2024-09-13T15:09:35.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.350+0000 7fc434c00640 1 -- start start 2024-09-13T15:09:35.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.358+0000 7fc434c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc430066860 0x7fc4300ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:35.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.358+0000 7fc434c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4300c1980 0x7fc4300cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:35.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.358+0000 7fc434c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4300c79f0 0x7fc4301fc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:35.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.358+0000 7fc434c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4301fcec0 con 0x7fc430066860 2024-09-13T15:09:35.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.358+0000 7fc434c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4300c9630 con 0x7fc4300c79f0 2024-09-13T15:09:35.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.358+0000 7fc434c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43014eb10 con 0x7fc4300c1980 2024-09-13T15:09:35.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.362+0000 7fc42fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4300c79f0 0x7fc4301fc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:35.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.362+0000 7fc42fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4300c79f0 0x7fc4301fc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56412/0 (socket says 172.21.15.7:56412) 2024-09-13T15:09:35.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.362+0000 7fc42fe00640 1 -- 172.21.15.7:0/3259536430 learned_addr learned my addr 172.21.15.7:0/3259536430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:09:35.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.362+0000 7fc42ea00640 1 --2- 172.21.15.7:0/3259536430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4300c1980 0x7fc4300cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:35.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.362+0000 7fc42f400640 1 --2- 172.21.15.7:0/3259536430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc430066860 0x7fc4300ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:35.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.362+0000 7fc42fe00640 1 -- 172.21.15.7:0/3259536430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4300c1980 msgr2=0x7fc4300cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:35.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.362+0000 7fc42fe00640 1 --2- 172.21.15.7:0/3259536430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4300c1980 0x7fc4300cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.362+0000 7fc42fe00640 1 -- 172.21.15.7:0/3259536430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc430066860 msgr2=0x7fc4300ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:35.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.362+0000 7fc42fe00640 1 --2- 172.21.15.7:0/3259536430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc430066860 0x7fc4300ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:35.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.362+0000 7fc42fe00640 1 -- 172.21.15.7:0/3259536430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc428009b30 con 0x7fc4300c79f0 2024-09-13T15:09:35.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.366+0000 7fc42f400640 1 --2- 172.21.15.7:0/3259536430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc430066860 0x7fc4300ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:35.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.366+0000 7fc42ea00640 1 --2- 172.21.15.7:0/3259536430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4300c1980 0x7fc4300cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:09:35.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.366+0000 7fc42fe00640 1 --2- 172.21.15.7:0/3259536430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4300c79f0 0x7fc4301fc980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc4280b2040 tx=0x7fc42801bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:35.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.366+0000 7fc427400640 1 -- 172.21.15.7:0/3259536430 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc428004250 con 0x7fc4300c79f0 2024-09-13T15:09:35.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.366+0000 7fc427400640 1 -- 172.21.15.7:0/3259536430 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4280043b0 con 0x7fc4300c79f0 2024-09-13T15:09:35.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.366+0000 7fc427400640 1 -- 172.21.15.7:0/3259536430 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc428004720 con 0x7fc4300c79f0 2024-09-13T15:09:35.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.378+0000 7fc434c00640 1 -- 172.21.15.7:0/3259536430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4301ff720 con 0x7fc4300c79f0 2024-09-13T15:09:35.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.378+0000 7fc434c00640 1 -- 172.21.15.7:0/3259536430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4300c9bd0 con 0x7fc4300c79f0 2024-09-13T15:09:35.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.382+0000 7fc434c00640 1 -- 172.21.15.7:0/3259536430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4300cad80 con 0x7fc4300c79f0 2024-09-13T15:09:35.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.386+0000 7fc427400640 1 -- 172.21.15.7:0/3259536430 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc4280b6070 con 0x7fc4300c79f0 2024-09-13T15:09:35.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.390+0000 7fc427400640 1 --2- 172.21.15.7:0/3259536430 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc410066710 0x7fc410068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.390+0000 7fc42f400640 1 --2- 172.21.15.7:0/3259536430 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc410066710 0x7fc410068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:35.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.398+0000 7fc42f400640 1 --2- 172.21.15.7:0/3259536430 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc410066710 0x7fc410068bd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc4200016e0 tx=0x7fc420009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:35.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.398+0000 7fc427400640 1 -- 172.21.15.7:0/3259536430 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7fc4280f4500 con 0x7fc4300c79f0 2024-09-13T15:09:35.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:35.402+0000 7fc427400640 1 -- 172.21.15.7:0/3259536430 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc4280f08d0 con 0x7fc4300c79f0 2024-09-13T15:09:36.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:36.002+0000 7fc434c00640 1 -- 172.21.15.7:0/3259536430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4300cad80 con 0x7fc4300c79f0 2024-09-13T15:09:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:36.006+0000 7fc427400640 1 -- 172.21.15.7:0/3259536430 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+6298 (secure 0 0 0) 0x7fc4280b4090 con 0x7fc4300c79f0 2024-09-13T15:09:36.008 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:09:36.008 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:32.906325+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:09:36.008 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2024-09-13T15:09:36.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:36.010+0000 7fc434c00640 1 -- 172.21.15.7:0/3259536430 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc410066710 msgr2=0x7fc410068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:36.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:36.010+0000 7fc434c00640 1 --2- 172.21.15.7:0/3259536430 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc410066710 0x7fc410068bd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc4200016e0 tx=0x7fc420009040 comp rx=0 tx=0).stop 2024-09-13T15:09:36.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:36.010+0000 7fc434c00640 1 -- 172.21.15.7:0/3259536430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4300c79f0 msgr2=0x7fc4301fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:36.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:36.010+0000 7fc434c00640 1 --2- 172.21.15.7:0/3259536430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4300c79f0 0x7fc4301fc980 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc4280b2040 tx=0x7fc42801bf40 comp rx=0 tx=0).stop 2024-09-13T15:09:36.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:36.010+0000 7fc434c00640 1 -- 172.21.15.7:0/3259536430 shutdown_connections 2024-09-13T15:09:36.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:36.010+0000 7fc434c00640 1 --2- 172.21.15.7:0/3259536430 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc410066710 0x7fc410068bd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:36.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:36.010+0000 7fc434c00640 1 --2- 172.21.15.7:0/3259536430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4300c79f0 0x7fc4301fc980 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:36.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:36.010+0000 7fc434c00640 1 --2- 172.21.15.7:0/3259536430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc4300c1980 0x7fc4300cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:36.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:36.010+0000 7fc434c00640 1 --2- 172.21.15.7:0/3259536430 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc430066860 0x7fc4300ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:36.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:36.010+0000 7fc434c00640 1 -- 172.21.15.7:0/3259536430 >> 172.21.15.7:0/3259536430 conn(0x7fc430065d40 msgr2=0x7fc4300c0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:36.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:36.010+0000 7fc434c00640 1 -- 172.21.15.7:0/3259536430 shutdown_connections 2024-09-13T15:09:36.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:36.010+0000 7fc434c00640 1 -- 172.21.15.7:0/3259536430 wait complete. 2024-09-13T15:09:36.096 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-09-13T15:09:38.098 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.418+0000 7f65a4e00640 1 Processor -- start 2024-09-13T15:09:38.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.418+0000 7f65a4e00640 1 -- start start 2024-09-13T15:09:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.422+0000 7f65a4e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a00cbe00 0x7f65a00c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.422+0000 7f65a4e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65a0159c40 0x7f65a00c7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.422+0000 7f659fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65a0159c40 0x7f65a00c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:38.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.422+0000 7f659fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f65a0159c40 0x7f65a00c7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36858/0 (socket says 172.21.15.7:36858) 2024-09-13T15:09:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.422+0000 7f659fe00640 1 -- 172.21.15.7:0/73631881 learned_addr learned my addr 172.21.15.7:0/73631881 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:09:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.422+0000 7f65a4e00640 1 -- 172.21.15.7:0/73631881 --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a006ad30 con 0x7f65a00cba20 2024-09-13T15:09:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.422+0000 7f65a4e00640 1 -- 172.21.15.7:0/73631881 --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a006b010 con 0x7f65a0159c40 2024-09-13T15:09:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.422+0000 7f65a4e00640 1 -- 172.21.15.7:0/73631881 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a006b2f0 con 0x7f65a00cbe00 2024-09-13T15:09:38.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.422+0000 7f659ea00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a00cbe00 0x7f65a00c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:38.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.422+0000 7f659fe00640 1 -- 172.21.15.7:0/73631881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a00cbe00 msgr2=0x7f65a00c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:38.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.422+0000 7f659fe00640 1 --2- 172.21.15.7:0/73631881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a00cbe00 0x7f65a00c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.422+0000 7f659fe00640 1 -- 172.21.15.7:0/73631881 >> v1:172.21.15.7:6789/0 conn(0x7f65a00cba20 legacy=0x7f65a00c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:38.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.422+0000 7f659fe00640 1 -- 172.21.15.7:0/73631881 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a006b5d0 con 0x7f65a0159c40 2024-09-13T15:09:38.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.422+0000 7f659ea00640 1 --2- 172.21.15.7:0/73631881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a00cbe00 0x7f65a00c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.434+0000 7f659fe00640 1 --2- 172.21.15.7:0/73631881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65a0159c40 0x7f65a00c7640 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6598009e50 tx=0x7f659801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198d5907b76b302d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.434+0000 7f659e000640 1 -- 172.21.15.7:0/73631881 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65980a5800 con 0x7f65a0159c40 2024-09-13T15:09:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.434+0000 7f659e000640 1 -- 172.21.15.7:0/73631881 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65980a5960 con 0x7f65a0159c40 2024-09-13T15:09:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.434+0000 7f659e000640 1 -- 172.21.15.7:0/73631881 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65980a5cf0 con 0x7f65a0159c40 2024-09-13T15:09:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.434+0000 7f65a4e00640 1 -- 172.21.15.7:0/73631881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65a0159c40 msgr2=0x7f65a00c7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.434+0000 7f65a4e00640 1 --2- 172.21.15.7:0/73631881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65a0159c40 0x7f65a00c7640 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6598009e50 tx=0x7f659801c960 comp rx=0 tx=0).stop 2024-09-13T15:09:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.438+0000 7f65a4e00640 1 -- 172.21.15.7:0/73631881 shutdown_connections 2024-09-13T15:09:38.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.438+0000 7f65a4e00640 1 --2- 172.21.15.7:0/73631881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65a0159c40 0x7f65a00c7640 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.438+0000 7f65a4e00640 1 --2- 172.21.15.7:0/73631881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a00cbe00 0x7f65a00c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.438+0000 7f65a4e00640 1 -- 172.21.15.7:0/73631881 >> 172.21.15.7:0/73631881 conn(0x7f65a0071520 msgr2=0x7f65a0071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:38.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.450+0000 7f65a4e00640 1 -- 172.21.15.7:0/73631881 shutdown_connections 2024-09-13T15:09:38.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.454+0000 7f65a4e00640 1 -- 172.21.15.7:0/73631881 wait complete. 2024-09-13T15:09:38.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.466+0000 7f65a4e00640 1 Processor -- start 2024-09-13T15:09:38.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.470+0000 7f65a4e00640 1 -- start start 2024-09-13T15:09:38.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f65a4e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65a00cba20 0x7f65a014ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f65a4e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65a00cbe00 0x7f65a014e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f65a4e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a0159c40 0x7f65a00cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f65a4e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a0151770 con 0x7f65a00cbe00 2024-09-13T15:09:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f65a4e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a014c0f0 con 0x7f65a00cba20 2024-09-13T15:09:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f65a4e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a014c3b0 con 0x7f65a0159c40 2024-09-13T15:09:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f659fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a0159c40 0x7f65a00cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f659fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a0159c40 0x7f65a00cdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:59854/0 (socket says 172.21.15.7:59854) 2024-09-13T15:09:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f659fe00640 1 -- 172.21.15.7:0/1263486690 learned_addr learned my addr 172.21.15.7:0/1263486690 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:09:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f659f400640 1 --2- 172.21.15.7:0/1263486690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65a00cba20 0x7f65a014ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:38.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f659f400640 1 -- 172.21.15.7:0/1263486690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a0159c40 msgr2=0x7f65a00cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:38.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f659f400640 1 --2- 172.21.15.7:0/1263486690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a0159c40 0x7f65a00cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f659f400640 1 -- 172.21.15.7:0/1263486690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65a00cbe00 msgr2=0x7f65a014e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:38.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f659f400640 1 --2- 172.21.15.7:0/1263486690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65a00cbe00 0x7f65a014e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f659f400640 1 -- 172.21.15.7:0/1263486690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c009420 con 0x7f65a00cba20 2024-09-13T15:09:38.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f659f400640 1 --2- 172.21.15.7:0/1263486690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65a00cba20 0x7f65a014ddd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f659000b410 tx=0x7f659000b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:38.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f6597400640 1 -- 172.21.15.7:0/1263486690 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6590004020 con 0x7f65a00cba20 2024-09-13T15:09:38.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f65a4e00640 1 -- 172.21.15.7:0/1263486690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6598009b30 con 0x7f65a00cba20 2024-09-13T15:09:38.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.474+0000 7f6597400640 1 -- 172.21.15.7:0/1263486690 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6590004180 con 0x7f65a00cba20 2024-09-13T15:09:38.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.478+0000 7f6597400640 1 -- 172.21.15.7:0/1263486690 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6590011630 con 0x7f65a00cba20 2024-09-13T15:09:38.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.478+0000 7f65a4e00640 1 -- 172.21.15.7:0/1263486690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a0151120 con 0x7f65a00cba20 2024-09-13T15:09:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.478+0000 7f65a4e00640 1 -- 172.21.15.7:0/1263486690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a0070330 con 0x7f65a00cba20 2024-09-13T15:09:38.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.478+0000 7f6597400640 1 -- 172.21.15.7:0/1263486690 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6590011790 con 0x7f65a00cba20 2024-09-13T15:09:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.482+0000 7f6597400640 1 --2- 172.21.15.7:0/1263486690 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6580066760 0x7f6580068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:38.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.482+0000 7f6597400640 1 -- 172.21.15.7:0/1263486690 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f65900842e0 con 0x7f65a00cba20 2024-09-13T15:09:38.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.482+0000 7f659ea00640 1 --2- 172.21.15.7:0/1263486690 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6580066760 0x7f6580068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:38.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.486+0000 7f659ea00640 1 --2- 172.21.15.7:0/1263486690 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6580066760 0x7f6580068c20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f658c006e90 tx=0x7f658c006de0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:38.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.494+0000 7f6597400640 1 -- 172.21.15.7:0/1263486690 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6590051130 con 0x7f65a00cba20 2024-09-13T15:09:38.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.886+0000 7f65a4e00640 1 -- 172.21.15.7:0/1263486690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65a00c97f0 con 0x7f65a00cba20 2024-09-13T15:09:38.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.886+0000 7f6597400640 1 -- 172.21.15.7:0/1263486690 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+6298 (secure 0 0 0) 0x7f6590054750 con 0x7f65a00cba20 2024-09-13T15:09:38.892 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:09:38.892 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:32.906325+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:09:38.892 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2024-09-13T15:09:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.890+0000 7f6594c00640 1 -- 172.21.15.7:0/1263486690 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6580066760 msgr2=0x7f6580068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.890+0000 7f6594c00640 1 --2- 172.21.15.7:0/1263486690 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6580066760 0x7f6580068c20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f658c006e90 tx=0x7f658c006de0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.890+0000 7f6594c00640 1 -- 172.21.15.7:0/1263486690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65a00cba20 msgr2=0x7f65a014ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.890+0000 7f6594c00640 1 --2- 172.21.15.7:0/1263486690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65a00cba20 0x7f65a014ddd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f659000b410 tx=0x7f659000b8d0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.890+0000 7f6594c00640 1 -- 172.21.15.7:0/1263486690 shutdown_connections 2024-09-13T15:09:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.890+0000 7f6594c00640 1 --2- 172.21.15.7:0/1263486690 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6580066760 0x7f6580068c20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.890+0000 7f6594c00640 1 --2- 172.21.15.7:0/1263486690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f65a0159c40 0x7f65a00cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.890+0000 7f6594c00640 1 --2- 172.21.15.7:0/1263486690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65a00cbe00 0x7f65a014e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.890+0000 7f6594c00640 1 --2- 172.21.15.7:0/1263486690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65a00cba20 0x7f65a014ddd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:38.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.890+0000 7f6594c00640 1 -- 172.21.15.7:0/1263486690 >> 172.21.15.7:0/1263486690 conn(0x7f65a0071520 msgr2=0x7f65a014d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:38.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.890+0000 7f6594c00640 1 -- 172.21.15.7:0/1263486690 shutdown_connections 2024-09-13T15:09:38.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:38.894+0000 7f6594c00640 1 -- 172.21.15.7:0/1263486690 wait complete. 2024-09-13T15:09:38.937 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-09-13T15:09:40.938 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:41.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.174+0000 7f38c5e00640 1 Processor -- start 2024-09-13T15:09:41.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.174+0000 7f38c5e00640 1 -- start start 2024-09-13T15:09:41.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.178+0000 7f38c5e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f38c00c8780 0x7f38c0157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:41.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.178+0000 7f38c5e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c00c20e0 con 0x7f38c01513c0 2024-09-13T15:09:41.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.178+0000 7f38c5e00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c015af50 con 0x7f38c0150fe0 2024-09-13T15:09:41.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.178+0000 7f38c5e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c015b230 con 0x7f38c00c8780 2024-09-13T15:09:41.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.178+0000 7f38bea00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f38c0150fe0 0x7f38c00c6b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:51004/0 (socket says 172.21.15.7:51004) 2024-09-13T15:09:41.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.178+0000 7f38bea00640 1 -- 172.21.15.7:0/2268211808 learned_addr learned my addr 172.21.15.7:0/2268211808 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:09:41.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.178+0000 7f38bf400640 1 --2- 172.21.15.7:0/2268211808 >> v2:172.21.15.7:3300/0 conn(0x7f38c00c8780 0x7f38c0157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:41.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.178+0000 7f38bd600640 1 -- 172.21.15.7:0/2268211808 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818618793 0 0) 0x7f38c015af50 con 0x7f38c0150fe0 2024-09-13T15:09:41.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.178+0000 7f38bd600640 1 -- 172.21.15.7:0/2268211808 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38a4003530 con 0x7f38c0150fe0 2024-09-13T15:09:41.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.178+0000 7f38bf400640 1 -- 172.21.15.7:0/2268211808 >> v1:172.21.15.77:6789/0 conn(0x7f38c0150fe0 legacy=0x7f38c00c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:41.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.178+0000 7f38bf400640 1 -- 172.21.15.7:0/2268211808 >> v1:172.21.15.7:6789/0 conn(0x7f38c01513c0 legacy=0x7f38c0156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:41.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.178+0000 7f38bf400640 1 -- 172.21.15.7:0/2268211808 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c00c3b70 con 0x7f38c00c8780 2024-09-13T15:09:41.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.182+0000 7f38bf400640 1 --2- 172.21.15.7:0/2268211808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c00c8780 0x7f38c0157540 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009d90 tx=0x7f38b801c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7444e90ee0dcd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:41.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.182+0000 7f38bd600640 1 -- 172.21.15.7:0/2268211808 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b80a6440 con 0x7f38c00c8780 2024-09-13T15:09:41.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.182+0000 7f38bd600640 1 -- 172.21.15.7:0/2268211808 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b80a65a0 con 0x7f38c00c8780 2024-09-13T15:09:41.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.182+0000 7f38bd600640 1 -- 172.21.15.7:0/2268211808 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b80a6930 con 0x7f38c00c8780 2024-09-13T15:09:41.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.182+0000 7f38c5e00640 1 -- 172.21.15.7:0/2268211808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c00c8780 msgr2=0x7f38c0157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:41.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.182+0000 7f38c5e00640 1 --2- 172.21.15.7:0/2268211808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c00c8780 0x7f38c0157540 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009d90 tx=0x7f38b801c770 comp rx=0 tx=0).stop 2024-09-13T15:09:41.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.182+0000 7f38c5e00640 1 -- 172.21.15.7:0/2268211808 shutdown_connections 2024-09-13T15:09:41.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.182+0000 7f38c5e00640 1 --2- 172.21.15.7:0/2268211808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c00c8780 0x7f38c0157540 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:41.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.182+0000 7f38c5e00640 1 -- 172.21.15.7:0/2268211808 >> 172.21.15.7:0/2268211808 conn(0x7f38c0071730 msgr2=0x7f38c0071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:41.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.186+0000 7f38c5e00640 1 -- 172.21.15.7:0/2268211808 shutdown_connections 2024-09-13T15:09:41.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.186+0000 7f38c5e00640 1 -- 172.21.15.7:0/2268211808 wait complete. 2024-09-13T15:09:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.186+0000 7f38c5e00640 1 Processor -- start 2024-09-13T15:09:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.186+0000 7f38c5e00640 1 -- start start 2024-09-13T15:09:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.186+0000 7f38c5e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38c00c8780 0x7f38c00c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.186+0000 7f38c5e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c0150fe0 0x7f38c00cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.186+0000 7f38c5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c01513c0 0x7f38c00cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.186+0000 7f38c5e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c01554b0 con 0x7f38c01513c0 2024-09-13T15:09:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.186+0000 7f38c5e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c00cb800 con 0x7f38c0150fe0 2024-09-13T15:09:41.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.186+0000 7f38c5e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c00ccb40 con 0x7f38c00c8780 2024-09-13T15:09:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.190+0000 7f38be000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c0150fe0 0x7f38c00cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.190+0000 7f38be000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c0150fe0 0x7f38c00cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56906/0 (socket says 172.21.15.7:56906) 2024-09-13T15:09:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.190+0000 7f38be000640 1 -- 172.21.15.7:0/2679655512 learned_addr learned my addr 172.21.15.7:0/2679655512 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:09:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.190+0000 7f38bea00640 1 --2- 172.21.15.7:0/2679655512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38c00c8780 0x7f38c00c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.190+0000 7f38be000640 1 -- 172.21.15.7:0/2679655512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38c00c8780 msgr2=0x7f38c00c4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.190+0000 7f38be000640 1 --2- 172.21.15.7:0/2679655512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38c00c8780 0x7f38c00c4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.190+0000 7f38be000640 1 -- 172.21.15.7:0/2679655512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c01513c0 msgr2=0x7f38c00cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.190+0000 7f38be000640 1 --2- 172.21.15.7:0/2679655512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c01513c0 0x7f38c00cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:41.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.190+0000 7f38be000640 1 -- 172.21.15.7:0/2679655512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b8009a70 con 0x7f38c0150fe0 2024-09-13T15:09:41.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.190+0000 7f38be000640 1 --2- 172.21.15.7:0/2679655512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c0150fe0 0x7f38c00cbf30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f38b000c780 tx=0x7f38b000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:41.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.190+0000 7f38b7400640 1 -- 172.21.15.7:0/2679655512 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b0005270 con 0x7f38c0150fe0 2024-09-13T15:09:41.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.190+0000 7f38b7400640 1 -- 172.21.15.7:0/2679655512 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b00053d0 con 0x7f38c0150fe0 2024-09-13T15:09:41.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.190+0000 7f38b7400640 1 -- 172.21.15.7:0/2679655512 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b000a860 con 0x7f38c0150fe0 2024-09-13T15:09:41.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.194+0000 7f38c5e00640 1 -- 172.21.15.7:0/2679655512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c00c6320 con 0x7f38c0150fe0 2024-09-13T15:09:41.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.194+0000 7f38c5e00640 1 -- 172.21.15.7:0/2679655512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c0155140 con 0x7f38c0150fe0 2024-09-13T15:09:41.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.194+0000 7f38c5e00640 1 -- 172.21.15.7:0/2679655512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c0067630 con 0x7f38c0150fe0 2024-09-13T15:09:41.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.194+0000 7f38b7400640 1 -- 172.21.15.7:0/2679655512 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f38b000a9c0 con 0x7f38c0150fe0 2024-09-13T15:09:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.198+0000 7f38b7400640 1 --2- 172.21.15.7:0/2679655512 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f38a0066760 0x7f38a0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:41.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.198+0000 7f38b7400640 1 -- 172.21.15.7:0/2679655512 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f38b0084250 con 0x7f38c0150fe0 2024-09-13T15:09:41.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.198+0000 7f38bea00640 1 --2- 172.21.15.7:0/2679655512 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f38a0066760 0x7f38a0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:41.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.198+0000 7f38bea00640 1 --2- 172.21.15.7:0/2679655512 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f38a0066760 0x7f38a0068c20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0011f0 tx=0x7f38ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:41.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.206+0000 7f38b7400640 1 -- 172.21.15.7:0/2679655512 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f38b0051130 con 0x7f38c0150fe0 2024-09-13T15:09:41.678 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:09:41.678 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:32.906325+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:09:41.678 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2024-09-13T15:09:41.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.670+0000 7f38c5e00640 1 -- 172.21.15.7:0/2679655512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38c00c6b10 con 0x7f38c0150fe0 2024-09-13T15:09:41.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.674+0000 7f38b7400640 1 -- 172.21.15.7:0/2679655512 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+6298 (secure 0 0 0) 0x7f38b0054750 con 0x7f38c0150fe0 2024-09-13T15:09:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.694+0000 7f38c5e00640 1 -- 172.21.15.7:0/2679655512 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f38a0066760 msgr2=0x7f38a0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.694+0000 7f38c5e00640 1 --2- 172.21.15.7:0/2679655512 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f38a0066760 0x7f38a0068c20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0011f0 tx=0x7f38ac009040 comp rx=0 tx=0).stop 2024-09-13T15:09:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.694+0000 7f38c5e00640 1 -- 172.21.15.7:0/2679655512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c0150fe0 msgr2=0x7f38c00cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.694+0000 7f38c5e00640 1 --2- 172.21.15.7:0/2679655512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c0150fe0 0x7f38c00cbf30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f38b000c780 tx=0x7f38b000cc40 comp rx=0 tx=0).stop 2024-09-13T15:09:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.694+0000 7f38c5e00640 1 -- 172.21.15.7:0/2679655512 shutdown_connections 2024-09-13T15:09:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.694+0000 7f38c5e00640 1 --2- 172.21.15.7:0/2679655512 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f38a0066760 0x7f38a0068c20 secure :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f38ac0011f0 tx=0x7f38ac009040 comp rx=0 tx=0).stop 2024-09-13T15:09:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.694+0000 7f38c5e00640 1 --2- 172.21.15.7:0/2679655512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38c01513c0 0x7f38c00cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.694+0000 7f38c5e00640 1 --2- 172.21.15.7:0/2679655512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38c0150fe0 0x7f38c00cbf30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.694+0000 7f38c5e00640 1 --2- 172.21.15.7:0/2679655512 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f38c00c8780 0x7f38c00c4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.694+0000 7f38c5e00640 1 -- 172.21.15.7:0/2679655512 >> 172.21.15.7:0/2679655512 conn(0x7f38c0071730 msgr2=0x7f38c0156f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:41.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.694+0000 7f38c5e00640 1 -- 172.21.15.7:0/2679655512 shutdown_connections 2024-09-13T15:09:41.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:41.694+0000 7f38c5e00640 1 -- 172.21.15.7:0/2679655512 wait complete. 2024-09-13T15:09:41.788 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-09-13T15:09:43.789 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:44.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.486+0000 7f4bb2400640 1 Processor -- start 2024-09-13T15:09:44.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.490+0000 7f4bb2400640 1 -- start start 2024-09-13T15:09:44.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.490+0000 7f4bb2400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4bac0c79f0 0x7f4bac0c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:44.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.490+0000 7f4bb2400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bac06d920 con 0x7f4bac0c1980 2024-09-13T15:09:44.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.490+0000 7f4bb2400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bac06dc00 con 0x7f4bac14f350 2024-09-13T15:09:44.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.490+0000 7f4bb2400640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bac14f730 con 0x7f4bac0c79f0 2024-09-13T15:09:44.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.502+0000 7f4bb1a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4bac0c79f0 0x7f4bac0c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:44.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.502+0000 7f4bb1a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4bac0c79f0 0x7f4bac0c5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56920/0 (socket says 172.21.15.7:56920) 2024-09-13T15:09:44.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.502+0000 7f4bb1a00640 1 -- 172.21.15.7:0/2302616946 learned_addr learned my addr 172.21.15.7:0/2302616946 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:09:44.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.506+0000 7f4bb1a00640 1 -- 172.21.15.7:0/2302616946 >> v1:172.21.15.77:6789/0 conn(0x7f4bac14f350 legacy=0x7f4bac0c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:44.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.506+0000 7f4bb1a00640 1 -- 172.21.15.7:0/2302616946 >> v1:172.21.15.7:6789/0 conn(0x7f4bac0c1980 legacy=0x7f4bac158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:44.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.506+0000 7f4bb1a00640 1 -- 172.21.15.7:0/2302616946 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac0c6ae0 con 0x7f4bac0c79f0 2024-09-13T15:09:44.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.514+0000 7f4bb1a00640 1 --2- 172.21.15.7:0/2302616946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bac0c79f0 0x7f4bac0c5d70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00a890 tx=0x7f4b9c024ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0ca46edfcca10c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:44.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.518+0000 7f4bab400640 1 -- 172.21.15.7:0/2302616946 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0b6410 con 0x7f4bac0c79f0 2024-09-13T15:09:44.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.518+0000 7f4bab400640 1 -- 172.21.15.7:0/2302616946 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c0b0030 con 0x7f4bac0c79f0 2024-09-13T15:09:44.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.518+0000 7f4bab400640 1 -- 172.21.15.7:0/2302616946 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0b6790 con 0x7f4bac0c79f0 2024-09-13T15:09:44.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.522+0000 7f4bb2400640 1 -- 172.21.15.7:0/2302616946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bac0c79f0 msgr2=0x7f4bac0c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:44.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.522+0000 7f4bb2400640 1 --2- 172.21.15.7:0/2302616946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bac0c79f0 0x7f4bac0c5d70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c00a890 tx=0x7f4b9c024ec0 comp rx=0 tx=0).stop 2024-09-13T15:09:44.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.522+0000 7f4bb2400640 1 -- 172.21.15.7:0/2302616946 shutdown_connections 2024-09-13T15:09:44.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.522+0000 7f4bb2400640 1 --2- 172.21.15.7:0/2302616946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bac0c79f0 0x7f4bac0c5d70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:44.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.522+0000 7f4bb2400640 1 -- 172.21.15.7:0/2302616946 >> 172.21.15.7:0/2302616946 conn(0x7f4bac065d40 msgr2=0x7f4bac066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:44.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.526+0000 7f4bb2400640 1 -- 172.21.15.7:0/2302616946 shutdown_connections 2024-09-13T15:09:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.530+0000 7f4bb2400640 1 -- 172.21.15.7:0/2302616946 wait complete. 2024-09-13T15:09:44.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.554+0000 7f4bb2400640 1 Processor -- start 2024-09-13T15:09:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.558+0000 7f4bb2400640 1 -- start start 2024-09-13T15:09:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.562+0000 7f4bb2400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bac0c1980 0x7f4bac150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.562+0000 7f4bb2400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bac0c79f0 0x7f4bac1477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.562+0000 7f4bb2400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bac14f350 0x7f4bac1484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.562+0000 7f4bb2400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac1523a0 con 0x7f4bac0c79f0 2024-09-13T15:09:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.562+0000 7f4bb2400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac1eba10 con 0x7f4bac14f350 2024-09-13T15:09:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.562+0000 7f4bb2400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac151340 con 0x7f4bac0c1980 2024-09-13T15:09:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.566+0000 7f4bb1a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bac14f350 0x7f4bac1484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.566+0000 7f4bb1a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bac14f350 0x7f4bac1484a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:56924/0 (socket says 172.21.15.7:56924) 2024-09-13T15:09:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.566+0000 7f4bb1a00640 1 -- 172.21.15.7:0/4170977208 learned_addr learned my addr 172.21.15.7:0/4170977208 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:09:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.566+0000 7f4bb1a00640 1 -- 172.21.15.7:0/4170977208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bac0c1980 msgr2=0x7f4bac150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.566+0000 7f4bb1a00640 1 --2- 172.21.15.7:0/4170977208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bac0c1980 0x7f4bac150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.566+0000 7f4bb1a00640 1 -- 172.21.15.7:0/4170977208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bac0c79f0 msgr2=0x7f4bac1477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.566+0000 7f4bb1a00640 1 --2- 172.21.15.7:0/4170977208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bac0c79f0 0x7f4bac1477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.566+0000 7f4bb1a00640 1 -- 172.21.15.7:0/4170977208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c00a570 con 0x7f4bac14f350 2024-09-13T15:09:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.566+0000 7f4bb1a00640 1 --2- 172.21.15.7:0/4170977208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bac14f350 0x7f4bac1484a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c023570 tx=0x7f4b9c023700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.566+0000 7f4ba8c00640 1 -- 172.21.15.7:0/4170977208 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0c6070 con 0x7f4bac14f350 2024-09-13T15:09:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.570+0000 7f4ba8c00640 1 -- 172.21.15.7:0/4170977208 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c0b46a0 con 0x7f4bac14f350 2024-09-13T15:09:44.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.570+0000 7f4ba8c00640 1 -- 172.21.15.7:0/4170977208 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0b4a30 con 0x7f4bac14f350 2024-09-13T15:09:44.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.570+0000 7f4bb2400640 1 -- 172.21.15.7:0/4170977208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac147d10 con 0x7f4bac14f350 2024-09-13T15:09:44.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.570+0000 7f4bb2400640 1 -- 172.21.15.7:0/4170977208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac1518c0 con 0x7f4bac14f350 2024-09-13T15:09:44.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.574+0000 7f4bb2400640 1 -- 172.21.15.7:0/4170977208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bac0c3dd0 con 0x7f4bac14f350 2024-09-13T15:09:44.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.578+0000 7f4ba8c00640 1 -- 172.21.15.7:0/4170977208 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4b9c0bd070 con 0x7f4bac14f350 2024-09-13T15:09:44.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.582+0000 7f4ba8c00640 1 --2- 172.21.15.7:0/4170977208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4b8c066790 0x7f4b8c068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.582+0000 7f4ba8c00640 1 -- 172.21.15.7:0/4170977208 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f4b9c127da0 con 0x7f4bac14f350 2024-09-13T15:09:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.582+0000 7f4bb1000640 1 --2- 172.21.15.7:0/4170977208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4b8c066790 0x7f4b8c068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:44.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.582+0000 7f4bb1000640 1 --2- 172.21.15.7:0/4170977208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4b8c066790 0x7f4b8c068c50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40012f0 tx=0x7f4ba4002020 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:44.586+0000 7f4ba8c00640 1 -- 172.21.15.7:0/4170977208 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4b9c0f4c80 con 0x7f4bac14f350 2024-09-13T15:09:45.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:45.098+0000 7f4bb2400640 1 -- 172.21.15.7:0/4170977208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bac0c3dd0 con 0x7f4bac14f350 2024-09-13T15:09:45.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:45.102+0000 7f4ba8c00640 1 -- 172.21.15.7:0/4170977208 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+6298 (secure 0 0 0) 0x7f4b9c0f82a0 con 0x7f4bac14f350 2024-09-13T15:09:45.108 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:09:45.108 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:32.906325+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:09:45.108 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2024-09-13T15:09:45.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:45.106+0000 7f4bb2400640 1 -- 172.21.15.7:0/4170977208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4b8c066790 msgr2=0x7f4b8c068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:45.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:45.106+0000 7f4bb2400640 1 --2- 172.21.15.7:0/4170977208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4b8c066790 0x7f4b8c068c50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4ba40012f0 tx=0x7f4ba4002020 comp rx=0 tx=0).stop 2024-09-13T15:09:45.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:45.106+0000 7f4bb2400640 1 -- 172.21.15.7:0/4170977208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bac14f350 msgr2=0x7f4bac1484a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:45.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:45.106+0000 7f4bb2400640 1 --2- 172.21.15.7:0/4170977208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bac14f350 0x7f4bac1484a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c023570 tx=0x7f4b9c023700 comp rx=0 tx=0).stop 2024-09-13T15:09:45.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:45.106+0000 7f4bb2400640 1 -- 172.21.15.7:0/4170977208 shutdown_connections 2024-09-13T15:09:45.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:45.106+0000 7f4bb2400640 1 --2- 172.21.15.7:0/4170977208 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4b8c066790 0x7f4b8c068c50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:45.106+0000 7f4bb2400640 1 --2- 172.21.15.7:0/4170977208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bac14f350 0x7f4bac1484a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:45.106+0000 7f4bb2400640 1 --2- 172.21.15.7:0/4170977208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bac0c79f0 0x7f4bac1477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:45.106+0000 7f4bb2400640 1 --2- 172.21.15.7:0/4170977208 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bac0c1980 0x7f4bac150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:45.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:45.106+0000 7f4bb2400640 1 -- 172.21.15.7:0/4170977208 >> 172.21.15.7:0/4170977208 conn(0x7f4bac065d40 msgr2=0x7f4bac06f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:45.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:45.110+0000 7f4bb2400640 1 -- 172.21.15.7:0/4170977208 shutdown_connections 2024-09-13T15:09:45.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:45.110+0000 7f4bb2400640 1 -- 172.21.15.7:0/4170977208 wait complete. 2024-09-13T15:09:45.216 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-09-13T15:09:47.217 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:47.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.522+0000 7ff2df200640 1 Processor -- start 2024-09-13T15:09:47.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.522+0000 7ff2df200640 1 -- start start 2024-09-13T15:09:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.526+0000 7ff2df200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff2d80c50c0 0x7ff2d80c7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.526+0000 7ff2df200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2d80733a0 0x7ff2d814f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.526+0000 7ff2df200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d81560f0 con 0x7ff2d814fbf0 2024-09-13T15:09:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.526+0000 7ff2df200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d8156630 con 0x7ff2d80c50c0 2024-09-13T15:09:47.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.526+0000 7ff2df200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d80c7c40 con 0x7ff2d80733a0 2024-09-13T15:09:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.526+0000 7ff2dd200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7ff2d814fbf0 0x7ff2d8070520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:45976/0 (socket says 172.21.15.7:45976) 2024-09-13T15:09:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.526+0000 7ff2d7400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2d80733a0 0x7ff2d814f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.526+0000 7ff2d7400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2d80733a0 0x7ff2d814f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:59870/0 (socket says 172.21.15.7:59870) 2024-09-13T15:09:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.526+0000 7ff2dd200640 1 -- 172.21.15.7:0/1840782328 learned_addr learned my addr 172.21.15.7:0/1840782328 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:09:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.526+0000 7ff2d7e00640 1 --2- 172.21.15.7:0/1840782328 >> v2:172.21.15.7:3300/0 conn(0x7ff2d80c50c0 0x7ff2d80c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:47.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.526+0000 7ff2d7400640 1 -- 172.21.15.7:0/1840782328 >> v2:172.21.15.7:3300/0 conn(0x7ff2d80c50c0 msgr2=0x7ff2d80c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:47.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.526+0000 7ff2d7400640 1 --2- 172.21.15.7:0/1840782328 >> v2:172.21.15.7:3300/0 conn(0x7ff2d80c50c0 0x7ff2d80c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:47.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.526+0000 7ff2d7400640 1 -- 172.21.15.7:0/1840782328 >> v1:172.21.15.7:6789/0 conn(0x7ff2d814fbf0 legacy=0x7ff2d8070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:47.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.526+0000 7ff2d7400640 1 -- 172.21.15.7:0/1840782328 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d8156390 con 0x7ff2d80733a0 2024-09-13T15:09:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.530+0000 7ff2d7400640 1 --2- 172.21.15.7:0/1840782328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2d80733a0 0x7ff2d814f6b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40097c0 tx=0x7ff2c4020ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd2f98c30af1c735 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.530+0000 7ff2d6a00640 1 -- 172.21.15.7:0/1840782328 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c40aaba0 con 0x7ff2d80733a0 2024-09-13T15:09:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.530+0000 7ff2d6a00640 1 -- 172.21.15.7:0/1840782328 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c40aad00 con 0x7ff2d80733a0 2024-09-13T15:09:47.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.530+0000 7ff2d6a00640 1 -- 172.21.15.7:0/1840782328 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c40b2660 con 0x7ff2d80733a0 2024-09-13T15:09:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.530+0000 7ff2df200640 1 -- 172.21.15.7:0/1840782328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2d80733a0 msgr2=0x7ff2d814f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:47.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.530+0000 7ff2df200640 1 --2- 172.21.15.7:0/1840782328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2d80733a0 0x7ff2d814f6b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40097c0 tx=0x7ff2c4020ea0 comp rx=0 tx=0).stop 2024-09-13T15:09:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.530+0000 7ff2df200640 1 -- 172.21.15.7:0/1840782328 shutdown_connections 2024-09-13T15:09:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.530+0000 7ff2df200640 1 --2- 172.21.15.7:0/1840782328 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2d80733a0 0x7ff2d814f6b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.530+0000 7ff2df200640 1 --2- 172.21.15.7:0/1840782328 >> v2:172.21.15.7:3300/0 conn(0x7ff2d80c50c0 0x7ff2d80c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.530+0000 7ff2df200640 1 -- 172.21.15.7:0/1840782328 >> 172.21.15.7:0/1840782328 conn(0x7ff2d806c330 msgr2=0x7ff2d80cb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.534+0000 7ff2df200640 1 -- 172.21.15.7:0/1840782328 shutdown_connections 2024-09-13T15:09:47.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.534+0000 7ff2df200640 1 -- 172.21.15.7:0/1840782328 wait complete. 2024-09-13T15:09:47.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.534+0000 7ff2df200640 1 Processor -- start 2024-09-13T15:09:47.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.534+0000 7ff2df200640 1 -- start start 2024-09-13T15:09:47.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2df200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2d80733a0 0x7ff2d81e3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:47.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2df200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2d80c50c0 0x7ff2d81f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:47.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2df200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2d814c8b0 0x7ff2d814bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:47.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2df200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d814e1a0 con 0x7ff2d80c50c0 2024-09-13T15:09:47.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2df200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8158460 con 0x7ff2d814c8b0 2024-09-13T15:09:47.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2df200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d814e6d0 con 0x7ff2d80733a0 2024-09-13T15:09:47.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2d7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2d80733a0 0x7ff2d81e3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:47.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2d7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2d80733a0 0x7ff2d81e3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:59878/0 (socket says 172.21.15.7:59878) 2024-09-13T15:09:47.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2d7e00640 1 -- 172.21.15.7:0/1610883493 learned_addr learned my addr 172.21.15.7:0/1610883493 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:09:47.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2d7400640 1 --2- 172.21.15.7:0/1610883493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2d80c50c0 0x7ff2d81f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:47.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2dd200640 1 --2- 172.21.15.7:0/1610883493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2d814c8b0 0x7ff2d814bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2d7e00640 1 -- 172.21.15.7:0/1610883493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2d814c8b0 msgr2=0x7ff2d814bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2d7e00640 1 --2- 172.21.15.7:0/1610883493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2d814c8b0 0x7ff2d814bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2d7e00640 1 -- 172.21.15.7:0/1610883493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2d80c50c0 msgr2=0x7ff2d81f2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2d7e00640 1 --2- 172.21.15.7:0/1610883493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2d80c50c0 0x7ff2d81f2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2d7e00640 1 -- 172.21.15.7:0/1610883493 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c4009420 con 0x7ff2d80733a0 2024-09-13T15:09:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2d7e00640 1 --2- 172.21.15.7:0/1610883493 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2d80733a0 0x7ff2d81e3980 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800e930 tx=0x7ff2c800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:47.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2cfe00640 1 -- 172.21.15.7:0/1610883493 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8009690 con 0x7ff2d80733a0 2024-09-13T15:09:47.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2cfe00640 1 -- 172.21.15.7:0/1610883493 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c800ca00 con 0x7ff2d80733a0 2024-09-13T15:09:47.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2cfe00640 1 -- 172.21.15.7:0/1610883493 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c800cd70 con 0x7ff2d80733a0 2024-09-13T15:09:47.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2df200640 1 -- 172.21.15.7:0/1610883493 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d814e9b0 con 0x7ff2d80733a0 2024-09-13T15:09:47.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.538+0000 7ff2df200640 1 -- 172.21.15.7:0/1610883493 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d81580f0 con 0x7ff2d80733a0 2024-09-13T15:09:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.542+0000 7ff2df200640 1 -- 172.21.15.7:0/1610883493 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d814ee60 con 0x7ff2d80733a0 2024-09-13T15:09:47.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.542+0000 7ff2cfe00640 1 -- 172.21.15.7:0/1610883493 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff2c8013470 con 0x7ff2d80733a0 2024-09-13T15:09:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.546+0000 7ff2cfe00640 1 --2- 172.21.15.7:0/1610883493 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff2b80666e0 0x7ff2b8068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:47.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.546+0000 7ff2cfe00640 1 -- 172.21.15.7:0/1610883493 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7ff2c8084890 con 0x7ff2d80733a0 2024-09-13T15:09:47.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.546+0000 7ff2d7400640 1 --2- 172.21.15.7:0/1610883493 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff2b80666e0 0x7ff2b8068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:47.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.546+0000 7ff2d7400640 1 --2- 172.21.15.7:0/1610883493 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff2b80666e0 0x7ff2b8068ba0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40b4000 tx=0x7ff2c4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:47.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:47.562+0000 7ff2cfe00640 1 -- 172.21.15.7:0/1610883493 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff2c8051790 con 0x7ff2d80733a0 2024-09-13T15:09:48.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:48.046+0000 7ff2df200640 1 -- 172.21.15.7:0/1610883493 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2d8159620 con 0x7ff2d80733a0 2024-09-13T15:09:48.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:48.050+0000 7ff2cfe00640 1 -- 172.21.15.7:0/1610883493 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+6298 (secure 0 0 0) 0x7ff2c8017090 con 0x7ff2d80733a0 2024-09-13T15:09:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:09:48.057 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:32.906325+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:09:48.057 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2024-09-13T15:09:48.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:48.054+0000 7ff2df200640 1 -- 172.21.15.7:0/1610883493 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff2b80666e0 msgr2=0x7ff2b8068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:48.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:48.054+0000 7ff2df200640 1 --2- 172.21.15.7:0/1610883493 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff2b80666e0 0x7ff2b8068ba0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40b4000 tx=0x7ff2c4008040 comp rx=0 tx=0).stop 2024-09-13T15:09:48.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:48.054+0000 7ff2df200640 1 -- 172.21.15.7:0/1610883493 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2d80733a0 msgr2=0x7ff2d81e3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:48.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:48.054+0000 7ff2df200640 1 --2- 172.21.15.7:0/1610883493 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2d80733a0 0x7ff2d81e3980 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800e930 tx=0x7ff2c800edf0 comp rx=0 tx=0).stop 2024-09-13T15:09:48.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:48.054+0000 7ff2df200640 1 -- 172.21.15.7:0/1610883493 shutdown_connections 2024-09-13T15:09:48.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:48.054+0000 7ff2df200640 1 --2- 172.21.15.7:0/1610883493 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff2b80666e0 0x7ff2b8068ba0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:48.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:48.054+0000 7ff2df200640 1 --2- 172.21.15.7:0/1610883493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff2d814c8b0 0x7ff2d814bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:48.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:48.054+0000 7ff2df200640 1 --2- 172.21.15.7:0/1610883493 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2d80c50c0 0x7ff2d81f2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:48.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:48.054+0000 7ff2df200640 1 --2- 172.21.15.7:0/1610883493 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff2d80733a0 0x7ff2d81e3980 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:48.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:48.054+0000 7ff2df200640 1 -- 172.21.15.7:0/1610883493 >> 172.21.15.7:0/1610883493 conn(0x7ff2d806c330 msgr2=0x7ff2d81e15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:48.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:48.054+0000 7ff2df200640 1 -- 172.21.15.7:0/1610883493 shutdown_connections 2024-09-13T15:09:48.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:48.054+0000 7ff2df200640 1 -- 172.21.15.7:0/1610883493 wait complete. 2024-09-13T15:09:48.139 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-09-13T15:09:50.140 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:50.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.442+0000 7f8a09800640 1 Processor -- start 2024-09-13T15:09:50.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.442+0000 7f8a09800640 1 -- start start 2024-09-13T15:09:50.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.450+0000 7f8a09800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a040c6890 0x7f8a0406cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:50.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.450+0000 7f8a02000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a040c6890 0x7f8a0406cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:50.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.450+0000 7f8a02000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a040c6890 0x7f8a0406cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:52624/0 (socket says 172.21.15.7:52624) 2024-09-13T15:09:50.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.450+0000 7f8a02000640 1 -- 172.21.15.7:0/2261513072 learned_addr learned my addr 172.21.15.7:0/2261513072 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:09:50.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.450+0000 7f8a09800640 1 -- 172.21.15.7:0/2261513072 --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a04161ab0 con 0x7f8a040c5e90 2024-09-13T15:09:50.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.450+0000 7f8a09800640 1 -- 172.21.15.7:0/2261513072 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0406dbc0 con 0x7f8a040c5ab0 2024-09-13T15:09:50.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.450+0000 7f8a09800640 1 -- 172.21.15.7:0/2261513072 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a04160f80 con 0x7f8a040c6890 2024-09-13T15:09:50.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.450+0000 7f8a02000640 1 -- 172.21.15.7:0/2261513072 >> v1:172.21.15.77:6789/0 conn(0x7f8a040c5ab0 legacy=0x7f8a041613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:50.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.450+0000 7f8a02000640 1 -- 172.21.15.7:0/2261513072 >> v1:172.21.15.7:6789/0 conn(0x7f8a040c5e90 legacy=0x7f8a04157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:50.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.450+0000 7f8a02000640 1 -- 172.21.15.7:0/2261513072 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0406d320 con 0x7f8a040c6890 2024-09-13T15:09:50.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.462+0000 7f8a02000640 1 --2- 172.21.15.7:0/2261513072 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a040c6890 0x7f8a0406cce0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f89f00098a0 tx=0x7f89f001ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e57584d676f5e702 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:50.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.466+0000 7f8a01600640 1 -- 172.21.15.7:0/2261513072 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f00a89b0 con 0x7f8a040c6890 2024-09-13T15:09:50.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.466+0000 7f8a01600640 1 -- 172.21.15.7:0/2261513072 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f00a8b10 con 0x7f8a040c6890 2024-09-13T15:09:50.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.466+0000 7f8a01600640 1 -- 172.21.15.7:0/2261513072 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f00a8ea0 con 0x7f8a040c6890 2024-09-13T15:09:50.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.466+0000 7f8a09800640 1 -- 172.21.15.7:0/2261513072 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a040c6890 msgr2=0x7f8a0406cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:50.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.466+0000 7f8a09800640 1 --2- 172.21.15.7:0/2261513072 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a040c6890 0x7f8a0406cce0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f89f00098a0 tx=0x7f89f001ecf0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.470+0000 7f8a09800640 1 -- 172.21.15.7:0/2261513072 shutdown_connections 2024-09-13T15:09:50.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.470+0000 7f8a09800640 1 --2- 172.21.15.7:0/2261513072 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a040c6890 0x7f8a0406cce0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.470+0000 7f8a09800640 1 -- 172.21.15.7:0/2261513072 >> 172.21.15.7:0/2261513072 conn(0x7f8a04065d40 msgr2=0x7f8a04066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:50.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.470+0000 7f8a09800640 1 -- 172.21.15.7:0/2261513072 shutdown_connections 2024-09-13T15:09:50.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.470+0000 7f8a09800640 1 -- 172.21.15.7:0/2261513072 wait complete. 2024-09-13T15:09:50.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.478+0000 7f8a09800640 1 Processor -- start 2024-09-13T15:09:50.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.482+0000 7f8a09800640 1 -- start start 2024-09-13T15:09:50.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.482+0000 7f8a09800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a040c5ab0 0x7f8a041f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:50.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.482+0000 7f8a09800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a040c5e90 0x7f8a04152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:50.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.482+0000 7f8a09800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a040c6890 0x7f8a04147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:50.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.482+0000 7f8a09800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0414f7b0 con 0x7f8a040c6890 2024-09-13T15:09:50.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.482+0000 7f8a02000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a040c5e90 0x7f8a04152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:50.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.482+0000 7f8a09800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a04154860 con 0x7f8a040c5ab0 2024-09-13T15:09:50.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.482+0000 7f8a09800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a041523a0 con 0x7f8a040c5e90 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.482+0000 7f8a02000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a040c5e90 0x7f8a04152660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:52630/0 (socket says 172.21.15.7:52630) 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.482+0000 7f8a02000640 1 -- 172.21.15.7:0/1800374843 learned_addr learned my addr 172.21.15.7:0/1800374843 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.482+0000 7f8a03400640 1 --2- 172.21.15.7:0/1800374843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a040c6890 0x7f8a04147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.482+0000 7f8a02000640 1 -- 172.21.15.7:0/1800374843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a040c5ab0 msgr2=0x7f8a041f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.482+0000 7f8a02000640 1 --2- 172.21.15.7:0/1800374843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a040c5ab0 0x7f8a041f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.482+0000 7f8a02000640 1 -- 172.21.15.7:0/1800374843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a040c6890 msgr2=0x7f8a04147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.482+0000 7f8a02000640 1 --2- 172.21.15.7:0/1800374843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a040c6890 0x7f8a04147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.482+0000 7f8a02000640 1 -- 172.21.15.7:0/1800374843 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f00094d0 con 0x7f8a040c5e90 2024-09-13T15:09:50.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.486+0000 7f8a03400640 1 --2- 172.21.15.7:0/1800374843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a040c6890 0x7f8a04147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:09:50.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.486+0000 7f8a02000640 1 --2- 172.21.15.7:0/1800374843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a040c5e90 0x7f8a04152660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f89f001f590 tx=0x7f89f001ba90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:50.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.486+0000 7f89faa00640 1 -- 172.21.15.7:0/1800374843 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f00b0e60 con 0x7f8a040c5e90 2024-09-13T15:09:50.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.486+0000 7f89faa00640 1 -- 172.21.15.7:0/1800374843 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f00ba400 con 0x7f8a040c5e90 2024-09-13T15:09:50.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.486+0000 7f89faa00640 1 -- 172.21.15.7:0/1800374843 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f00ba7b0 con 0x7f8a040c5e90 2024-09-13T15:09:50.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.486+0000 7f8a09800640 1 -- 172.21.15.7:0/1800374843 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a041f7840 con 0x7f8a040c5e90 2024-09-13T15:09:50.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.486+0000 7f8a09800640 1 -- 172.21.15.7:0/1800374843 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a04150c80 con 0x7f8a040c5e90 2024-09-13T15:09:50.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.490+0000 7f89efe00640 1 -- 172.21.15.7:0/1800374843 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a04067650 con 0x7f8a040c5e90 2024-09-13T15:09:50.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.490+0000 7f89faa00640 1 -- 172.21.15.7:0/1800374843 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f89f00ba910 con 0x7f8a040c5e90 2024-09-13T15:09:50.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.494+0000 7f89faa00640 1 --2- 172.21.15.7:0/1800374843 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f89e40666e0 0x7f89e4068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:50.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.494+0000 7f89faa00640 1 -- 172.21.15.7:0/1800374843 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6835+0+0 (secure 0 0 0) 0x7f89f01223b0 con 0x7f8a040c5e90 2024-09-13T15:09:50.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.494+0000 7f8a02a00640 1 --2- 172.21.15.7:0/1800374843 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f89e40666e0 0x7f89e4068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:50.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.494+0000 7f8a02a00640 1 --2- 172.21.15.7:0/1800374843 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f89e40666e0 0x7f89e4068ba0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009670 tx=0x7f89f4006bd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:50.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:50.498+0000 7f89faa00640 1 -- 172.21.15.7:0/1800374843 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f89f00ef320 con 0x7f8a040c5e90 2024-09-13T15:09:51.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:51.122+0000 7f89efe00640 1 -- 172.21.15.7:0/1800374843 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a04067650 con 0x7f8a040c5e90 2024-09-13T15:09:51.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:51.130+0000 7f89faa00640 1 -- 172.21.15.7:0/1800374843 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+6298 (secure 0 0 0) 0x7f89f00f2940 con 0x7f8a040c5e90 2024-09-13T15:09:51.138 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:09:51.138 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5069,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:07:32.906325+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":4238,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4238":{"gid":4238,"name":"a","rank":3,"incarnation":15,"state":"up:active","state_seq":44,"addr":"172.21.15.7:6837/3369648543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3369648543},{"type":"v1","addr":"172.21.15.7:6837","nonce":3369648543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:09:51.138 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 30 2024-09-13T15:09:51.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:51.138+0000 7f8a09800640 1 -- 172.21.15.7:0/1800374843 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f89e40666e0 msgr2=0x7f89e4068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:51.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:51.138+0000 7f8a09800640 1 --2- 172.21.15.7:0/1800374843 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f89e40666e0 0x7f89e4068ba0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f89f4009670 tx=0x7f89f4006bd0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:51.138+0000 7f8a09800640 1 -- 172.21.15.7:0/1800374843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a040c5e90 msgr2=0x7f8a04152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:51.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:51.138+0000 7f8a09800640 1 --2- 172.21.15.7:0/1800374843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a040c5e90 0x7f8a04152660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f89f001f590 tx=0x7f89f001ba90 comp rx=0 tx=0).stop 2024-09-13T15:09:51.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:51.146+0000 7f8a09800640 1 -- 172.21.15.7:0/1800374843 shutdown_connections 2024-09-13T15:09:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:51.146+0000 7f8a09800640 1 --2- 172.21.15.7:0/1800374843 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f89e40666e0 0x7f89e4068ba0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:51.146+0000 7f8a09800640 1 --2- 172.21.15.7:0/1800374843 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a040c6890 0x7f8a04147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:51.146+0000 7f8a09800640 1 --2- 172.21.15.7:0/1800374843 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8a040c5e90 0x7f8a04152660 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:51.146+0000 7f8a09800640 1 --2- 172.21.15.7:0/1800374843 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a040c5ab0 0x7f8a041f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:51.146+0000 7f8a09800640 1 -- 172.21.15.7:0/1800374843 >> 172.21.15.7:0/1800374843 conn(0x7f8a04065d40 msgr2=0x7f8a04155d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:51.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:51.174+0000 7f8a09800640 1 -- 172.21.15.7:0/1800374843 shutdown_connections 2024-09-13T15:09:51.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:51.178+0000 7f8a09800640 1 -- 172.21.15.7:0/1800374843 wait complete. 2024-09-13T15:09:51.218 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-09-13T15:09:53.219 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:53.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.642+0000 7f4c1cc00640 1 Processor -- start 2024-09-13T15:09:53.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.642+0000 7f4c1cc00640 1 -- start start 2024-09-13T15:09:53.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.646+0000 7f4c1cc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4c1806e0e0 0x7f4c1806a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:53.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.646+0000 7f4c1cc00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4c1806e4c0 0x7f4c1806c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:53.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.646+0000 7f4c1cc00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c181504e0 con 0x7f4c1806c930 2024-09-13T15:09:53.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.646+0000 7f4c1cc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c18156ca0 con 0x7f4c1806e0e0 2024-09-13T15:09:53.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.646+0000 7f4c1cc00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1806adf0 con 0x7f4c1806e4c0 2024-09-13T15:09:53.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.646+0000 7f4c16800640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4c1806c930 0x7f4c1814f800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:36778/0 (socket says 172.21.15.7:36778) 2024-09-13T15:09:53.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.646+0000 7f4c16800640 1 -- 172.21.15.7:0/1690793231 learned_addr learned my addr 172.21.15.7:0/1690793231 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:09:53.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.646+0000 7f4c15e00640 1 --2- 172.21.15.7:0/1690793231 >> v2:172.21.15.7:3300/0 conn(0x7f4c1806e0e0 0x7f4c1806a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:53.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.646+0000 7f4c15400640 1 --2- 172.21.15.7:0/1690793231 >> v2:172.21.15.77:3300/0 conn(0x7f4c1806e4c0 0x7f4c1806c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:53.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.650+0000 7f4c15400640 1 -- 172.21.15.7:0/1690793231 >> v2:172.21.15.7:3300/0 conn(0x7f4c1806e0e0 msgr2=0x7f4c1806a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:53.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.650+0000 7f4c15400640 1 --2- 172.21.15.7:0/1690793231 >> v2:172.21.15.7:3300/0 conn(0x7f4c1806e0e0 0x7f4c1806a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:53.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.650+0000 7f4c15400640 1 -- 172.21.15.7:0/1690793231 >> v1:172.21.15.77:6789/0 conn(0x7f4c1806c930 legacy=0x7f4c1814f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:53.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.650+0000 7f4c15400640 1 -- 172.21.15.7:0/1690793231 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c180cb8a0 con 0x7f4c1806e4c0 2024-09-13T15:09:53.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.662+0000 7f4c15400640 1 --2- 172.21.15.7:0/1690793231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c1806e4c0 0x7f4c1806c3f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4c180c88c0 tx=0x7f4c08021340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7799101be5bc090 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:53.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.662+0000 7f4c14a00640 1 -- 172.21.15.7:0/1690793231 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c080b1600 con 0x7f4c1806e4c0 2024-09-13T15:09:53.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.662+0000 7f4c14a00640 1 -- 172.21.15.7:0/1690793231 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c080ad050 con 0x7f4c1806e4c0 2024-09-13T15:09:53.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.662+0000 7f4c14a00640 1 -- 172.21.15.7:0/1690793231 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c080b1980 con 0x7f4c1806e4c0 2024-09-13T15:09:53.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.666+0000 7f4c1cc00640 1 -- 172.21.15.7:0/1690793231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c1806e4c0 msgr2=0x7f4c1806c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:53.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.666+0000 7f4c1cc00640 1 --2- 172.21.15.7:0/1690793231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c1806e4c0 0x7f4c1806c3f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4c180c88c0 tx=0x7f4c08021340 comp rx=0 tx=0).stop 2024-09-13T15:09:53.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.666+0000 7f4c1cc00640 1 -- 172.21.15.7:0/1690793231 shutdown_connections 2024-09-13T15:09:53.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.666+0000 7f4c1cc00640 1 --2- 172.21.15.7:0/1690793231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c1806e4c0 0x7f4c1806c3f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:53.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.666+0000 7f4c1cc00640 1 --2- 172.21.15.7:0/1690793231 >> v2:172.21.15.7:3300/0 conn(0x7f4c1806e0e0 0x7f4c1806a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:53.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.666+0000 7f4c1cc00640 1 -- 172.21.15.7:0/1690793231 >> 172.21.15.7:0/1690793231 conn(0x7f4c180cc3f0 msgr2=0x7f4c18069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:53.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.666+0000 7f4c1cc00640 1 -- 172.21.15.7:0/1690793231 shutdown_connections 2024-09-13T15:09:53.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.666+0000 7f4c1cc00640 1 -- 172.21.15.7:0/1690793231 wait complete. 2024-09-13T15:09:53.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.670+0000 7f4c1cc00640 1 Processor -- start 2024-09-13T15:09:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.670+0000 7f4c1cc00640 1 -- start start 2024-09-13T15:09:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.674+0000 7f4c1cc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c1806c930 0x7f4c181fe9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.674+0000 7f4c1cc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c1806e0e0 0x7f4c181fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:53.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.674+0000 7f4c1cc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c1806e4c0 0x7f4c181fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.674+0000 7f4c1cc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c181fc780 con 0x7f4c1806c930 2024-09-13T15:09:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.674+0000 7f4c1cc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c180b0940 con 0x7f4c1806e4c0 2024-09-13T15:09:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.674+0000 7f4c1cc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c180708e0 con 0x7f4c1806e0e0 2024-09-13T15:09:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.674+0000 7f4c16800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c1806e4c0 0x7f4c181fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.674+0000 7f4c16800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c1806e4c0 0x7f4c181fd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:36654/0 (socket says 172.21.15.7:36654) 2024-09-13T15:09:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.674+0000 7f4c16800640 1 -- 172.21.15.7:0/1066143451 learned_addr learned my addr 172.21.15.7:0/1066143451 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:09:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.674+0000 7f4c15400640 1 --2- 172.21.15.7:0/1066143451 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c1806e0e0 0x7f4c181fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.674+0000 7f4c15e00640 1 --2- 172.21.15.7:0/1066143451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c1806c930 0x7f4c181fe9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.678+0000 7f4c16800640 1 -- 172.21.15.7:0/1066143451 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c1806e0e0 msgr2=0x7f4c181fcc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.678+0000 7f4c16800640 1 --2- 172.21.15.7:0/1066143451 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c1806e0e0 0x7f4c181fcc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.678+0000 7f4c16800640 1 -- 172.21.15.7:0/1066143451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c1806c930 msgr2=0x7f4c181fe9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.678+0000 7f4c16800640 1 --2- 172.21.15.7:0/1066143451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c1806c930 0x7f4c181fe9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.678+0000 7f4c16800640 1 -- 172.21.15.7:0/1066143451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0800b6c0 con 0x7f4c1806e4c0 2024-09-13T15:09:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.678+0000 7f4c16800640 1 --2- 172.21.15.7:0/1066143451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c1806e4c0 0x7f4c181fd150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000caa0 tx=0x7f4c1000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.678+0000 7f4c0e000640 1 -- 172.21.15.7:0/1066143451 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000ac00 con 0x7f4c1806e4c0 2024-09-13T15:09:53.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.678+0000 7f4c0e000640 1 -- 172.21.15.7:0/1066143451 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1000ad60 con 0x7f4c1806e4c0 2024-09-13T15:09:53.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.678+0000 7f4c0e000640 1 -- 172.21.15.7:0/1066143451 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10012600 con 0x7f4c1806e4c0 2024-09-13T15:09:53.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.678+0000 7f4c1cc00640 1 -- 172.21.15.7:0/1066143451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c180b06a0 con 0x7f4c1806e4c0 2024-09-13T15:09:53.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.678+0000 7f4c1cc00640 1 -- 172.21.15.7:0/1066143451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c181ff2f0 con 0x7f4c1806e4c0 2024-09-13T15:09:53.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.686+0000 7f4c0e000640 1 -- 172.21.15.7:0/1066143451 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4c10007070 con 0x7f4c1806e4c0 2024-09-13T15:09:53.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.686+0000 7f4c1cc00640 1 -- 172.21.15.7:0/1066143451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c18156780 con 0x7f4c1806e4c0 2024-09-13T15:09:53.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.686+0000 7f4c0e000640 1 --2- 172.21.15.7:0/1066143451 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bf8066760 0x7f4bf8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:53.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.686+0000 7f4c0e000640 1 -- 172.21.15.7:0/1066143451 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f4c100843c0 con 0x7f4c1806e4c0 2024-09-13T15:09:53.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.690+0000 7f4c15e00640 1 --2- 172.21.15.7:0/1066143451 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bf8066760 0x7f4bf8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:53.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.690+0000 7f4c15e00640 1 --2- 172.21.15.7:0/1066143451 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bf8066760 0x7f4bf8068c20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009af0 tx=0x7f4c04008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:53.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:53.694+0000 7f4c0e000640 1 -- 172.21.15.7:0/1066143451 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4c10051390 con 0x7f4c1806e4c0 2024-09-13T15:09:54.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.206+0000 7f4c1cc00640 1 -- 172.21.15.7:0/1066143451 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c180ca670 con 0x7f4c1806e4c0 2024-09-13T15:09:54.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.206+0000 7f4c0e000640 1 -- 172.21.15.7:0/1066143451 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+5544 (secure 0 0 0) 0x7f4c10017020 con 0x7f4c1806e4c0 2024-09-13T15:09:54.214 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:09:54.214 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:09:52.667511+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:09:54.215 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 31 2024-09-13T15:09:54.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.214+0000 7f4c1cc00640 1 -- 172.21.15.7:0/1066143451 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bf8066760 msgr2=0x7f4bf8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:54.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.214+0000 7f4c1cc00640 1 --2- 172.21.15.7:0/1066143451 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bf8066760 0x7f4bf8068c20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4c04009af0 tx=0x7f4c04008040 comp rx=0 tx=0).stop 2024-09-13T15:09:54.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.214+0000 7f4c1cc00640 1 -- 172.21.15.7:0/1066143451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c1806e4c0 msgr2=0x7f4c181fd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:54.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.214+0000 7f4c1cc00640 1 --2- 172.21.15.7:0/1066143451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c1806e4c0 0x7f4c181fd150 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000caa0 tx=0x7f4c1000cf60 comp rx=0 tx=0).stop 2024-09-13T15:09:54.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.214+0000 7f4c1cc00640 1 -- 172.21.15.7:0/1066143451 shutdown_connections 2024-09-13T15:09:54.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.214+0000 7f4c1cc00640 1 --2- 172.21.15.7:0/1066143451 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bf8066760 0x7f4bf8068c20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:54.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.214+0000 7f4c1cc00640 1 --2- 172.21.15.7:0/1066143451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c1806e4c0 0x7f4c181fd150 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:54.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.214+0000 7f4c1cc00640 1 --2- 172.21.15.7:0/1066143451 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4c1806e0e0 0x7f4c181fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:54.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.214+0000 7f4c1cc00640 1 --2- 172.21.15.7:0/1066143451 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c1806c930 0x7f4c181fe9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:54.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.214+0000 7f4c1cc00640 1 -- 172.21.15.7:0/1066143451 >> 172.21.15.7:0/1066143451 conn(0x7f4c180cc3f0 msgr2=0x7f4c1806cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:54.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.214+0000 7f4c1cc00640 1 -- 172.21.15.7:0/1066143451 shutdown_connections 2024-09-13T15:09:54.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.214+0000 7f4c1cc00640 1 -- 172.21.15.7:0/1066143451 wait complete. 2024-09-13T15:09:54.271 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a down, removed from mdsmap 2024-09-13T15:09:54.272 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-09-13T15:09:54.272 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:54.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.614+0000 7f09d0400640 1 Processor -- start 2024-09-13T15:09:54.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.614+0000 7f09d0400640 1 -- start start 2024-09-13T15:09:54.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.618+0000 7f09d0400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c8153130 0x7f09c80cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:54.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.618+0000 7f09d0400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c8159070 con 0x7f09c8159c10 2024-09-13T15:09:54.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.618+0000 7f09d0400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09c8070640 con 0x7f09c80c6840 2024-09-13T15:09:54.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.618+0000 7f09d0400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c8070920 con 0x7f09c8153130 2024-09-13T15:09:54.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.618+0000 7f09ce400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c8153130 0x7f09c80cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:54.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.618+0000 7f09ce400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c8153130 0x7f09c80cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:52652/0 (socket says 172.21.15.7:52652) 2024-09-13T15:09:54.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.618+0000 7f09ce400640 1 -- 172.21.15.7:0/36399752 learned_addr learned my addr 172.21.15.7:0/36399752 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:09:54.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.618+0000 7f09ce400640 1 -- 172.21.15.7:0/36399752 >> v1:172.21.15.77:6789/0 conn(0x7f09c80c6840 legacy=0x7f09c8159500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:09:54.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.618+0000 7f09ce400640 1 -- 172.21.15.7:0/36399752 >> v1:172.21.15.7:6789/0 conn(0x7f09c8159c10 legacy=0x7f09c8152a20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:09:54.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.618+0000 7f09ce400640 1 -- 172.21.15.7:0/36399752 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c8070c00 con 0x7f09c8153130 2024-09-13T15:09:54.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.626+0000 7f09ce400640 1 --2- 172.21.15.7:0/36399752 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c8153130 0x7f09c80cbb70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f09b4013180 tx=0x7f09b4027410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1827244502e0255f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:54.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.626+0000 7f09c7e00640 1 -- 172.21.15.7:0/36399752 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40112d0 con 0x7f09c8153130 2024-09-13T15:09:54.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.626+0000 7f09c7e00640 1 -- 172.21.15.7:0/36399752 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b40b3050 con 0x7f09c8153130 2024-09-13T15:09:54.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.626+0000 7f09c7e00640 1 -- 172.21.15.7:0/36399752 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b4011650 con 0x7f09c8153130 2024-09-13T15:09:54.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.626+0000 7f09d0400640 1 -- 172.21.15.7:0/36399752 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c8153130 msgr2=0x7f09c80cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:54.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.626+0000 7f09d0400640 1 --2- 172.21.15.7:0/36399752 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c8153130 0x7f09c80cbb70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f09b4013180 tx=0x7f09b4027410 comp rx=0 tx=0).stop 2024-09-13T15:09:54.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.634+0000 7f09d0400640 1 -- 172.21.15.7:0/36399752 shutdown_connections 2024-09-13T15:09:54.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.634+0000 7f09d0400640 1 --2- 172.21.15.7:0/36399752 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c8153130 0x7f09c80cbb70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:54.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.634+0000 7f09d0400640 1 -- 172.21.15.7:0/36399752 >> 172.21.15.7:0/36399752 conn(0x7f09c806c120 msgr2=0x7f09c806c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:54.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.638+0000 7f09d0400640 1 -- 172.21.15.7:0/36399752 shutdown_connections 2024-09-13T15:09:54.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.638+0000 7f09d0400640 1 -- 172.21.15.7:0/36399752 wait complete. 2024-09-13T15:09:54.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.642+0000 7f09d0400640 1 Processor -- start 2024-09-13T15:09:54.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.642+0000 7f09d0400640 1 -- start start 2024-09-13T15:09:54.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.646+0000 7f09d0400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09c80c6840 0x7f09c81ee140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:54.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.646+0000 7f09d0400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c8153130 0x7f09c8146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:54.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.646+0000 7f09d0400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09c8159c10 0x7f09c8143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.646+0000 7f09d0400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c8158db0 con 0x7f09c80c6840 2024-09-13T15:09:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.646+0000 7f09d0400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c81edcb0 con 0x7f09c8159c10 2024-09-13T15:09:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.646+0000 7f09d0400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c81ee680 con 0x7f09c8153130 2024-09-13T15:09:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.646+0000 7f09ce400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09c8159c10 0x7f09c8143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.646+0000 7f09cd000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c8153130 0x7f09c8146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.646+0000 7f09cd000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c8153130 0x7f09c8146560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:52654/0 (socket says 172.21.15.7:52654) 2024-09-13T15:09:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.646+0000 7f09ce400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09c8159c10 0x7f09c8143290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:36660/0 (socket says 172.21.15.7:36660) 2024-09-13T15:09:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.646+0000 7f09cd000640 1 -- 172.21.15.7:0/3778078283 learned_addr learned my addr 172.21.15.7:0/3778078283 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:09:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.646+0000 7f09cda00640 1 --2- 172.21.15.7:0/3778078283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09c80c6840 0x7f09c81ee140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:54.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.650+0000 7f09ce400640 1 -- 172.21.15.7:0/3778078283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c8153130 msgr2=0x7f09c8146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.650+0000 7f09ce400640 1 --2- 172.21.15.7:0/3778078283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c8153130 0x7f09c8146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.650+0000 7f09ce400640 1 -- 172.21.15.7:0/3778078283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09c80c6840 msgr2=0x7f09c81ee140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.650+0000 7f09ce400640 1 --2- 172.21.15.7:0/3778078283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09c80c6840 0x7f09c81ee140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.650+0000 7f09ce400640 1 -- 172.21.15.7:0/3778078283 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b4011d70 con 0x7f09c8159c10 2024-09-13T15:09:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.650+0000 7f09ce400640 1 --2- 172.21.15.7:0/3778078283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09c8159c10 0x7f09c8143290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f09b40b6000 tx=0x7f09b4025c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.650+0000 7f09c5600640 1 -- 172.21.15.7:0/3778078283 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b400b040 con 0x7f09c8159c10 2024-09-13T15:09:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.650+0000 7f09c5600640 1 -- 172.21.15.7:0/3778078283 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b40b7810 con 0x7f09c8159c10 2024-09-13T15:09:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.650+0000 7f09c5600640 1 -- 172.21.15.7:0/3778078283 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b400b040 con 0x7f09c8159c10 2024-09-13T15:09:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.650+0000 7f09d0400640 1 -- 172.21.15.7:0/3778078283 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c81440f0 con 0x7f09c8159c10 2024-09-13T15:09:54.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.650+0000 7f09d0400640 1 -- 172.21.15.7:0/3778078283 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c81ed940 con 0x7f09c8159c10 2024-09-13T15:09:54.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.654+0000 7f09d0400640 1 -- 172.21.15.7:0/3778078283 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09c81ed7a0 con 0x7f09c8159c10 2024-09-13T15:09:54.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.658+0000 7f09c5600640 1 -- 172.21.15.7:0/3778078283 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f09b40b7980 con 0x7f09c8159c10 2024-09-13T15:09:54.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.658+0000 7f09c5600640 1 --2- 172.21.15.7:0/3778078283 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f09a80666f0 0x7f09a8068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:54.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.658+0000 7f09c5600640 1 -- 172.21.15.7:0/3778078283 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f09b40f2a60 con 0x7f09c8159c10 2024-09-13T15:09:54.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.666+0000 7f09cda00640 1 --2- 172.21.15.7:0/3778078283 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f09a80666f0 0x7f09a8068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:54.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.670+0000 7f09c5600640 1 -- 172.21.15.7:0/3778078283 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f09b40ef530 con 0x7f09c8159c10 2024-09-13T15:09:54.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:54.674+0000 7f09cda00640 1 --2- 172.21.15.7:0/3778078283 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f09a80666f0 0x7f09a8068bb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f09c001b440 tx=0x7f09c001e040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:55.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:55.242+0000 7f09d0400640 1 -- 172.21.15.7:0/3778078283 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09c81ed7a0 con 0x7f09c8159c10 2024-09-13T15:09:55.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:55.250+0000 7f09c5600640 1 -- 172.21.15.7:0/3778078283 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+5544 (secure 0 0 0) 0x7f09b40bc030 con 0x7f09c8159c10 2024-09-13T15:09:55.257 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:09:55.257 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:09:52.667511+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:09:55.257 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 31 2024-09-13T15:09:55.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:55.258+0000 7f09d0400640 1 -- 172.21.15.7:0/3778078283 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f09a80666f0 msgr2=0x7f09a8068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:55.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:55.258+0000 7f09d0400640 1 --2- 172.21.15.7:0/3778078283 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f09a80666f0 0x7f09a8068bb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f09c001b440 tx=0x7f09c001e040 comp rx=0 tx=0).stop 2024-09-13T15:09:55.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:55.258+0000 7f09d0400640 1 -- 172.21.15.7:0/3778078283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09c8159c10 msgr2=0x7f09c8143290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:55.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:55.258+0000 7f09d0400640 1 --2- 172.21.15.7:0/3778078283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09c8159c10 0x7f09c8143290 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f09b40b6000 tx=0x7f09b4025c50 comp rx=0 tx=0).stop 2024-09-13T15:09:55.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:55.258+0000 7f09d0400640 1 -- 172.21.15.7:0/3778078283 shutdown_connections 2024-09-13T15:09:55.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:55.258+0000 7f09d0400640 1 --2- 172.21.15.7:0/3778078283 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f09a80666f0 0x7f09a8068bb0 secure :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f09c001b440 tx=0x7f09c001e040 comp rx=0 tx=0).stop 2024-09-13T15:09:55.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:55.258+0000 7f09d0400640 1 --2- 172.21.15.7:0/3778078283 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09c8159c10 0x7f09c8143290 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:55.258+0000 7f09d0400640 1 --2- 172.21.15.7:0/3778078283 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09c8153130 0x7f09c8146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:55.258+0000 7f09d0400640 1 --2- 172.21.15.7:0/3778078283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09c80c6840 0x7f09c81ee140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:55.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:55.258+0000 7f09d0400640 1 -- 172.21.15.7:0/3778078283 >> 172.21.15.7:0/3778078283 conn(0x7f09c806c120 msgr2=0x7f09c806e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:55.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:55.274+0000 7f09d0400640 1 -- 172.21.15.7:0/3778078283 shutdown_connections 2024-09-13T15:09:55.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:55.274+0000 7f09d0400640 1 -- 172.21.15.7:0/3778078283 wait complete. 2024-09-13T15:09:55.361 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 31, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-13T15:01:44.789559+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 31, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3, 4 ], "info": { "gid_4252": { "addr": "172.21.15.77:6835/2367107997", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6834", "nonce": 2367107997, "type": "v2" }, { "addr": "172.21.15.77:6835", "nonce": 2367107997, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4252, "incarnation": 13, "join_fscid": -1, "name": "d", "rank": 2, "state": "up:active", "state_seq": 43 }, "gid_4267": { "addr": "172.21.15.77:6839/2233000674", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6837", "nonce": 2233000674, "type": "v2" }, { "addr": "172.21.15.77:6839", "nonce": 2233000674, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4267, "incarnation": 9, "join_fscid": -1, "name": "f", "rank": 1, "state": "up:active", "state_seq": 41 }, "gid_4276": { "addr": "172.21.15.7:6836/2396967179", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6834", "nonce": 2396967179, "type": "v2" }, { "addr": "172.21.15.7:6836", "nonce": 2396967179, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4276, "incarnation": 4, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_5069": { "addr": "172.21.15.77:6838/877425259", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6836", "nonce": 877425259, "type": "v2" }, { "addr": "172.21.15.77:6838", "nonce": 877425259, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5069, "incarnation": 31, "join_fscid": -1, "name": "b", "rank": 3, "state": "up:replay", "state_seq": 1 }, "gid_5230": { "addr": "172.21.15.7:6833/2896136827", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6832", "nonce": 2896136827, "type": "v2" }, { "addr": "172.21.15.7:6833", "nonce": 2896136827, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5230, "incarnation": 25, "join_fscid": -1, "name": "e", "rank": 4, "state": "up:active", "state_seq": 34 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 5, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-13T15:09:52.667511+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4276, "mds_1": 4267, "mds_2": 4252, "mds_3": 5069, "mds_4": 5230 } } } ], "standbys": [] } 2024-09-13T15:09:57.362 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:09:57.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.686+0000 7fedbf600640 1 Processor -- start 2024-09-13T15:09:57.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.686+0000 7fedbf600640 1 -- start start 2024-09-13T15:09:57.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.690+0000 7fedbf600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fedb81513c0 0x7fedb8156e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:57.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.690+0000 7fedbf600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb80c20e0 con 0x7fedb80c8780 2024-09-13T15:09:57.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.690+0000 7fedbf600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb815af50 con 0x7fedb8150fe0 2024-09-13T15:09:57.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.690+0000 7fedbf600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb815b230 con 0x7fedb81513c0 2024-09-13T15:09:57.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.690+0000 7fedb7e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fedb81513c0 0x7fedb8156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:57.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.690+0000 7fedb7e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fedb81513c0 0x7fedb8156e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:36672/0 (socket says 172.21.15.7:36672) 2024-09-13T15:09:57.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.690+0000 7fedb7e00640 1 -- 172.21.15.7:0/2597545228 learned_addr learned my addr 172.21.15.7:0/2597545228 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:09:57.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.690+0000 7fedb7400640 1 -- 172.21.15.7:0/2597545228 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047023306 0 0) 0x7fedb815af50 con 0x7fedb8150fe0 2024-09-13T15:09:57.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.690+0000 7fedb7400640 1 -- 172.21.15.7:0/2597545228 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feda0003530 con 0x7fedb8150fe0 2024-09-13T15:09:57.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.690+0000 7fedb7e00640 1 -- 172.21.15.7:0/2597545228 >> v1:172.21.15.77:6789/0 conn(0x7fedb8150fe0 legacy=0x7fedb80c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:57.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.690+0000 7fedb7e00640 1 -- 172.21.15.7:0/2597545228 >> v1:172.21.15.7:6789/0 conn(0x7fedb80c8780 legacy=0x7fedb8157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:09:57.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.690+0000 7fedb7e00640 1 -- 172.21.15.7:0/2597545228 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb80c3b70 con 0x7fedb81513c0 2024-09-13T15:09:57.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.714+0000 7fedb7e00640 1 --2- 172.21.15.7:0/2597545228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb81513c0 0x7fedb8156e30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feda4009870 tx=0x7feda401c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f60ab6159a49713a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:57.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.718+0000 7fedb7400640 1 -- 172.21.15.7:0/2597545228 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda40ac640 con 0x7fedb81513c0 2024-09-13T15:09:57.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.718+0000 7fedb7400640 1 -- 172.21.15.7:0/2597545228 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda40ac7a0 con 0x7fedb81513c0 2024-09-13T15:09:57.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.718+0000 7fedb7400640 1 -- 172.21.15.7:0/2597545228 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda40acb30 con 0x7fedb81513c0 2024-09-13T15:09:57.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.718+0000 7fedbf600640 1 -- 172.21.15.7:0/2597545228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb81513c0 msgr2=0x7fedb8156e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:57.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.718+0000 7fedbf600640 1 --2- 172.21.15.7:0/2597545228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb81513c0 0x7fedb8156e30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feda4009870 tx=0x7feda401c490 comp rx=0 tx=0).stop 2024-09-13T15:09:57.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.718+0000 7fedbf600640 1 -- 172.21.15.7:0/2597545228 shutdown_connections 2024-09-13T15:09:57.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.718+0000 7fedbf600640 1 --2- 172.21.15.7:0/2597545228 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb81513c0 0x7fedb8156e30 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feda4009870 tx=0x7feda401c490 comp rx=0 tx=0).stop 2024-09-13T15:09:57.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.718+0000 7fedbf600640 1 -- 172.21.15.7:0/2597545228 >> 172.21.15.7:0/2597545228 conn(0x7fedb8071730 msgr2=0x7fedb8071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:57.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.722+0000 7fedbf600640 1 -- 172.21.15.7:0/2597545228 shutdown_connections 2024-09-13T15:09:57.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.722+0000 7fedbf600640 1 -- 172.21.15.7:0/2597545228 wait complete. 2024-09-13T15:09:57.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.722+0000 7fedbf600640 1 Processor -- start 2024-09-13T15:09:57.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.722+0000 7fedbf600640 1 -- start start 2024-09-13T15:09:57.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.726+0000 7fedbf600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedb80c8780 0x7fedb8159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:57.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.726+0000 7fedbf600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb8150fe0 0x7fedb80b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:57.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.726+0000 7fedbf600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedb815a6c0 0x7fedb80cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:57.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.726+0000 7fedbf600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8158810 con 0x7fedb80c8780 2024-09-13T15:09:57.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.726+0000 7fedbf600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80b1ca0 con 0x7fedb8150fe0 2024-09-13T15:09:57.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.726+0000 7fedbf600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80c4c10 con 0x7fedb815a6c0 2024-09-13T15:09:57.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.726+0000 7fedb7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb8150fe0 0x7fedb80b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:57.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.726+0000 7fedb7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb8150fe0 0x7fedb80b23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:36682/0 (socket says 172.21.15.7:36682) 2024-09-13T15:09:57.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.726+0000 7fedb7e00640 1 -- 172.21.15.7:0/3348656076 learned_addr learned my addr 172.21.15.7:0/3348656076 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:09:57.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.726+0000 7fedbd600640 1 --2- 172.21.15.7:0/3348656076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedb815a6c0 0x7fedb80cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:57.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.726+0000 7fedb7e00640 1 -- 172.21.15.7:0/3348656076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedb815a6c0 msgr2=0x7fedb80cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:57.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.726+0000 7fedb7e00640 1 --2- 172.21.15.7:0/3348656076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedb815a6c0 0x7fedb80cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.726+0000 7fedb7e00640 1 -- 172.21.15.7:0/3348656076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedb80c8780 msgr2=0x7fedb8159290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:09:57.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.726+0000 7fedb7e00640 1 --2- 172.21.15.7:0/3348656076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedb80c8780 0x7fedb8159290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:57.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.726+0000 7fedb7e00640 1 -- 172.21.15.7:0/3348656076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda40094d0 con 0x7fedb8150fe0 2024-09-13T15:09:57.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.726+0000 7fedbd600640 1 --2- 172.21.15.7:0/3348656076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedb815a6c0 0x7fedb80cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:09:57.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.726+0000 7fedb7e00640 1 --2- 172.21.15.7:0/3348656076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb8150fe0 0x7fedb80b23d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feda401a0c0 tx=0x7feda4019230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.734+0000 7fedb4c00640 1 -- 172.21.15.7:0/3348656076 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda4004230 con 0x7fedb8150fe0 2024-09-13T15:09:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.734+0000 7fedb4c00640 1 -- 172.21.15.7:0/3348656076 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda4004390 con 0x7fedb8150fe0 2024-09-13T15:09:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.734+0000 7fedb4c00640 1 -- 172.21.15.7:0/3348656076 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda4003820 con 0x7fedb8150fe0 2024-09-13T15:09:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.734+0000 7fedbf600640 1 -- 172.21.15.7:0/3348656076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb80b1f40 con 0x7fedb8150fe0 2024-09-13T15:09:57.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.734+0000 7fedbf600640 1 -- 172.21.15.7:0/3348656076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb80c4e40 con 0x7fedb8150fe0 2024-09-13T15:09:57.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.738+0000 7fedbf600640 1 -- 172.21.15.7:0/3348656076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb8067650 con 0x7fedb8150fe0 2024-09-13T15:09:57.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.738+0000 7fedb4c00640 1 -- 172.21.15.7:0/3348656076 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7feda4003980 con 0x7fedb8150fe0 2024-09-13T15:09:57.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.742+0000 7fedb4c00640 1 --2- 172.21.15.7:0/3348656076 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fed980666e0 0x7fed98068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:09:57.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.742+0000 7fedb4c00640 1 -- 172.21.15.7:0/3348656076 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7feda411dfa0 con 0x7fedb8150fe0 2024-09-13T15:09:57.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.742+0000 7fedbcc00640 1 --2- 172.21.15.7:0/3348656076 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fed980666e0 0x7fed98068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:09:57.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.742+0000 7fedbcc00640 1 --2- 172.21.15.7:0/3348656076 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fed980666e0 0x7fed98068ba0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fedac001480 tx=0x7fedac007850 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:09:57.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:57.770+0000 7fedb4c00640 1 -- 172.21.15.7:0/3348656076 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7feda40eafe0 con 0x7fedb8150fe0 2024-09-13T15:09:58.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:58.246+0000 7fedbf600640 1 -- 172.21.15.7:0/3348656076 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedb80c6b10 con 0x7fedb8150fe0 2024-09-13T15:09:58.257 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:09:58.258 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:09:52.667511+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:09:58.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:58.254+0000 7fedb4c00640 1 -- 172.21.15.7:0/3348656076 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+5544 (secure 0 0 0) 0x7feda40bd090 con 0x7fedb8150fe0 2024-09-13T15:09:58.258 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 31 2024-09-13T15:09:58.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:58.254+0000 7fedbf600640 1 -- 172.21.15.7:0/3348656076 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fed980666e0 msgr2=0x7fed98068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:58.254+0000 7fedbf600640 1 --2- 172.21.15.7:0/3348656076 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fed980666e0 0x7fed98068ba0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fedac001480 tx=0x7fedac007850 comp rx=0 tx=0).stop 2024-09-13T15:09:58.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:58.254+0000 7fedbf600640 1 -- 172.21.15.7:0/3348656076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb8150fe0 msgr2=0x7fedb80b23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:09:58.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:58.254+0000 7fedbf600640 1 --2- 172.21.15.7:0/3348656076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb8150fe0 0x7fedb80b23d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feda401a0c0 tx=0x7feda4019230 comp rx=0 tx=0).stop 2024-09-13T15:09:58.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:58.258+0000 7fedbf600640 1 -- 172.21.15.7:0/3348656076 shutdown_connections 2024-09-13T15:09:58.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:58.258+0000 7fedbf600640 1 --2- 172.21.15.7:0/3348656076 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fed980666e0 0x7fed98068ba0 secure :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fedac001480 tx=0x7fedac007850 comp rx=0 tx=0).stop 2024-09-13T15:09:58.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:58.258+0000 7fedbf600640 1 --2- 172.21.15.7:0/3348656076 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fedb815a6c0 0x7fedb80cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:58.258+0000 7fedbf600640 1 --2- 172.21.15.7:0/3348656076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fedb8150fe0 0x7fedb80b23d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:58.258+0000 7fedbf600640 1 --2- 172.21.15.7:0/3348656076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fedb80c8780 0x7fedb8159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:09:58.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:58.258+0000 7fedbf600640 1 -- 172.21.15.7:0/3348656076 >> 172.21.15.7:0/3348656076 conn(0x7fedb8071730 msgr2=0x7fedb8071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:09:58.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:58.258+0000 7fedbf600640 1 -- 172.21.15.7:0/3348656076 shutdown_connections 2024-09-13T15:09:58.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:09:58.262+0000 7fedbf600640 1 -- 172.21.15.7:0/3348656076 wait complete. 2024-09-13T15:09:58.338 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:10:00.339 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:00.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.622+0000 7fb0d9200640 1 Processor -- start 2024-09-13T15:10:00.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.622+0000 7fb0d9200640 1 -- start start 2024-09-13T15:10:00.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.622+0000 7fb0d9200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb0d4071500 0x7fb0d4071910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:00.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.622+0000 7fb0d9200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d406e0d0 con 0x7fb0d40c37f0 2024-09-13T15:10:00.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.622+0000 7fb0d9200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d406a300 con 0x7fb0d4157480 2024-09-13T15:10:00.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.622+0000 7fb0d9200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0d415d760 con 0x7fb0d4071500 2024-09-13T15:10:00.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.626+0000 7fb0d3e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb0d4071500 0x7fb0d4071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:00.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.626+0000 7fb0d3e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb0d4071500 0x7fb0d4071910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:52214/0 (socket says 172.21.15.7:52214) 2024-09-13T15:10:00.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.626+0000 7fb0d3e00640 1 -- 172.21.15.7:0/113086893 learned_addr learned my addr 172.21.15.7:0/113086893 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:10:00.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.630+0000 7fb0d3e00640 1 -- 172.21.15.7:0/113086893 >> v1:172.21.15.77:6789/0 conn(0x7fb0d4157480 legacy=0x7fb0d415db80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:10:00.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.630+0000 7fb0d3e00640 1 -- 172.21.15.7:0/113086893 >> v1:172.21.15.7:6789/0 conn(0x7fb0d40c37f0 legacy=0x7fb0d406d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:00.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.630+0000 7fb0d3e00640 1 -- 172.21.15.7:0/113086893 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d406a5e0 con 0x7fb0d4071500 2024-09-13T15:10:00.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.634+0000 7fb0d3e00640 1 --2- 172.21.15.7:0/113086893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d4071500 0x7fb0d4071910 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009e50 tx=0x7fb0cc01c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88efc362464bf855 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:00.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.634+0000 7fb0d2a00640 1 -- 172.21.15.7:0/113086893 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0a5620 con 0x7fb0d4071500 2024-09-13T15:10:00.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.638+0000 7fb0d2a00640 1 -- 172.21.15.7:0/113086893 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0cc0a5780 con 0x7fb0d4071500 2024-09-13T15:10:00.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.638+0000 7fb0d2a00640 1 -- 172.21.15.7:0/113086893 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0a5b10 con 0x7fb0d4071500 2024-09-13T15:10:00.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.646+0000 7fb0d9200640 1 -- 172.21.15.7:0/113086893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d4071500 msgr2=0x7fb0d4071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:00.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.646+0000 7fb0d9200640 1 --2- 172.21.15.7:0/113086893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d4071500 0x7fb0d4071910 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009e50 tx=0x7fb0cc01c960 comp rx=0 tx=0).stop 2024-09-13T15:10:00.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.646+0000 7fb0d9200640 1 -- 172.21.15.7:0/113086893 shutdown_connections 2024-09-13T15:10:00.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.646+0000 7fb0d9200640 1 --2- 172.21.15.7:0/113086893 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d4071500 0x7fb0d4071910 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.646+0000 7fb0d9200640 1 -- 172.21.15.7:0/113086893 >> 172.21.15.7:0/113086893 conn(0x7fb0d40cc9b0 msgr2=0x7fb0d40ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:00.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.646+0000 7fb0d9200640 1 -- 172.21.15.7:0/113086893 shutdown_connections 2024-09-13T15:10:00.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.646+0000 7fb0d9200640 1 -- 172.21.15.7:0/113086893 wait complete. 2024-09-13T15:10:00.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.646+0000 7fb0d9200640 1 Processor -- start 2024-09-13T15:10:00.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.646+0000 7fb0d9200640 1 -- start start 2024-09-13T15:10:00.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.650+0000 7fb0d9200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d4071500 0x7fb0d4158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:00.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.650+0000 7fb0d9200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0d40c37f0 0x7fb0d4153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:00.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.650+0000 7fb0d9200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0d4157480 0x7fb0d414fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:00.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.650+0000 7fb0d9200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d4071e50 con 0x7fb0d40c37f0 2024-09-13T15:10:00.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.650+0000 7fb0d9200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d4154b20 con 0x7fb0d4071500 2024-09-13T15:10:00.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.650+0000 7fb0d9200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d414f9c0 con 0x7fb0d4157480 2024-09-13T15:10:00.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.650+0000 7fb0d3400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d4071500 0x7fb0d4158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:00.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.650+0000 7fb0d3e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0d4157480 0x7fb0d414fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:00.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.650+0000 7fb0d3400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d4071500 0x7fb0d4158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:52228/0 (socket says 172.21.15.7:52228) 2024-09-13T15:10:00.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.650+0000 7fb0d3400640 1 -- 172.21.15.7:0/3672389469 learned_addr learned my addr 172.21.15.7:0/3672389469 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:10:00.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.650+0000 7fb0cbe00640 1 --2- 172.21.15.7:0/3672389469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0d40c37f0 0x7fb0d4153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:00.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.650+0000 7fb0cbe00640 1 -- 172.21.15.7:0/3672389469 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0d4157480 msgr2=0x7fb0d414fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:00.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.650+0000 7fb0cbe00640 1 --2- 172.21.15.7:0/3672389469 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0d4157480 0x7fb0d414fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.650+0000 7fb0cbe00640 1 -- 172.21.15.7:0/3672389469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d4071500 msgr2=0x7fb0d4158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:00.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.650+0000 7fb0cbe00640 1 --2- 172.21.15.7:0/3672389469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d4071500 0x7fb0d4158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:00.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.650+0000 7fb0cbe00640 1 -- 172.21.15.7:0/3672389469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc009b30 con 0x7fb0d40c37f0 2024-09-13T15:10:00.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.650+0000 7fb0cbe00640 1 --2- 172.21.15.7:0/3672389469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0d40c37f0 0x7fb0d4153f70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc000f70 tx=0x7fb0bc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:00.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.658+0000 7fb0cb400640 1 -- 172.21.15.7:0/3672389469 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0052d0 con 0x7fb0d40c37f0 2024-09-13T15:10:00.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.658+0000 7fb0cb400640 1 -- 172.21.15.7:0/3672389469 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc005430 con 0x7fb0d40c37f0 2024-09-13T15:10:00.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.658+0000 7fb0cb400640 1 -- 172.21.15.7:0/3672389469 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc003840 con 0x7fb0d40c37f0 2024-09-13T15:10:00.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.658+0000 7fb0d9200640 1 -- 172.21.15.7:0/3672389469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d41592b0 con 0x7fb0d40c37f0 2024-09-13T15:10:00.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.658+0000 7fb0d9200640 1 -- 172.21.15.7:0/3672389469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d414f670 con 0x7fb0d40c37f0 2024-09-13T15:10:00.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.658+0000 7fb0d9200640 1 -- 172.21.15.7:0/3672389469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d4067650 con 0x7fb0d40c37f0 2024-09-13T15:10:00.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.662+0000 7fb0cb400640 1 -- 172.21.15.7:0/3672389469 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb0bc0039a0 con 0x7fb0d40c37f0 2024-09-13T15:10:00.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.670+0000 7fb0cb400640 1 --2- 172.21.15.7:0/3672389469 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb0b0066790 0x7fb0b0068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:00.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.670+0000 7fb0cb400640 1 -- 172.21.15.7:0/3672389469 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fb0bc083ac0 con 0x7fb0d40c37f0 2024-09-13T15:10:00.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.670+0000 7fb0d3400640 1 --2- 172.21.15.7:0/3672389469 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb0b0066790 0x7fb0b0068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:00.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.682+0000 7fb0d3400640 1 --2- 172.21.15.7:0/3672389469 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb0b0066790 0x7fb0b0068c50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40099a0 tx=0x7fb0c40090e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:00.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:00.690+0000 7fb0cb400640 1 -- 172.21.15.7:0/3672389469 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb0bc085e60 con 0x7fb0d40c37f0 2024-09-13T15:10:00.712 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:10:00.716 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:10:01.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:01.242+0000 7fb0d9200640 1 -- 172.21.15.7:0/3672389469 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0d414fb00 con 0x7fb0d40c37f0 2024-09-13T15:10:01.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:01.250+0000 7fb0cb400640 1 -- 172.21.15.7:0/3672389469 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+5546 (secure 0 0 0) 0x7fb0d414fb00 con 0x7fb0d40c37f0 2024-09-13T15:10:01.268 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:10:01.268 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:09:58.887488+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:resolve","state_seq":37,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:10:01.268 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 32 2024-09-13T15:10:01.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:01.266+0000 7fb0d9200640 1 -- 172.21.15.7:0/3672389469 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb0b0066790 msgr2=0x7fb0b0068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:01.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:01.266+0000 7fb0d9200640 1 --2- 172.21.15.7:0/3672389469 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb0b0066790 0x7fb0b0068c50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40099a0 tx=0x7fb0c40090e0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:01.266+0000 7fb0d9200640 1 -- 172.21.15.7:0/3672389469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0d40c37f0 msgr2=0x7fb0d4153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:01.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:01.266+0000 7fb0d9200640 1 --2- 172.21.15.7:0/3672389469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0d40c37f0 0x7fb0d4153f70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc000f70 tx=0x7fb0bc00c890 comp rx=0 tx=0).stop 2024-09-13T15:10:01.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:01.270+0000 7fb0d9200640 1 -- 172.21.15.7:0/3672389469 shutdown_connections 2024-09-13T15:10:01.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:01.270+0000 7fb0d9200640 1 --2- 172.21.15.7:0/3672389469 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb0b0066790 0x7fb0b0068c50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:01.270+0000 7fb0d9200640 1 --2- 172.21.15.7:0/3672389469 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb0d4157480 0x7fb0d414fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:01.270+0000 7fb0d9200640 1 --2- 172.21.15.7:0/3672389469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb0d40c37f0 0x7fb0d4153f70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:01.270+0000 7fb0d9200640 1 --2- 172.21.15.7:0/3672389469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0d4071500 0x7fb0d4158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:01.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:01.270+0000 7fb0d9200640 1 -- 172.21.15.7:0/3672389469 >> 172.21.15.7:0/3672389469 conn(0x7fb0d40cc9b0 msgr2=0x7fb0d415b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:01.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:01.270+0000 7fb0d9200640 1 -- 172.21.15.7:0/3672389469 shutdown_connections 2024-09-13T15:10:01.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:01.270+0000 7fb0d9200640 1 -- 172.21.15.7:0/3672389469 wait complete. 2024-09-13T15:10:01.357 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:10:03.358 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:03.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.718+0000 7f5faee00640 1 Processor -- start 2024-09-13T15:10:03.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.734+0000 7f5faee00640 1 -- start start 2024-09-13T15:10:03.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.742+0000 7f5faee00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5fa80c77f0 0x7f5fa80c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.746+0000 7f5faee00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa80c7bd0 0x7f5fa8158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.746+0000 7f5faee00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5fa8066860 0x7f5fa81590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.746+0000 7f5faee00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa8155130 con 0x7f5fa8066860 2024-09-13T15:10:03.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.746+0000 7f5faee00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa8158720 con 0x7f5fa80c77f0 2024-09-13T15:10:03.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.746+0000 7f5faee00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa8155320 con 0x7f5fa80c7bd0 2024-09-13T15:10:03.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.750+0000 7f5face00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5fa8066860 0x7f5fa81590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.750+0000 7f5face00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5fa8066860 0x7f5fa81590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35510/0 (socket says 172.21.15.7:35510) 2024-09-13T15:10:03.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.750+0000 7f5face00640 1 -- 172.21.15.7:0/3277992712 learned_addr learned my addr 172.21.15.7:0/3277992712 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:10:03.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.750+0000 7f5fa7e00640 1 --2- 172.21.15.7:0/3277992712 >> v2:172.21.15.77:3300/0 conn(0x7f5fa80c77f0 0x7f5fa80c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.750+0000 7f5fa7400640 1 --2- 172.21.15.7:0/3277992712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa80c7bd0 0x7f5fa8158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.750+0000 7f5face00640 1 -- 172.21.15.7:0/3277992712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa80c7bd0 msgr2=0x7f5fa8158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.750+0000 7f5face00640 1 --2- 172.21.15.7:0/3277992712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa80c7bd0 0x7f5fa8158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.750+0000 7f5face00640 1 -- 172.21.15.7:0/3277992712 >> v2:172.21.15.77:3300/0 conn(0x7f5fa80c77f0 msgr2=0x7f5fa80c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.750+0000 7f5face00640 1 --2- 172.21.15.7:0/3277992712 >> v2:172.21.15.77:3300/0 conn(0x7f5fa80c77f0 0x7f5fa80c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.750+0000 7f5face00640 1 -- 172.21.15.7:0/3277992712 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa81555e0 con 0x7f5fa8066860 2024-09-13T15:10:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.750+0000 7f5fa7e00640 1 --2- 172.21.15.7:0/3277992712 >> v2:172.21.15.77:3300/0 conn(0x7f5fa80c77f0 0x7f5fa80c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.754+0000 7f5fa7400640 1 --2- 172.21.15.7:0/3277992712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa80c7bd0 0x7f5fa8158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:03.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.782+0000 7f5face00640 1 --2- 172.21.15.7:0/3277992712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa8066860 0x7f5fa81590f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5fa806deb0 tx=0x7f5fa001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7858e1b6c533a797 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:03.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.802+0000 7f5fa6a00640 1 -- 172.21.15.7:0/3277992712 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa00a5790 con 0x7f5fa8066860 2024-09-13T15:10:03.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.802+0000 7f5fa6a00640 1 -- 172.21.15.7:0/3277992712 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa00a58f0 con 0x7f5fa8066860 2024-09-13T15:10:03.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.802+0000 7f5fa6a00640 1 -- 172.21.15.7:0/3277992712 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa00a5c80 con 0x7f5fa8066860 2024-09-13T15:10:03.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.806+0000 7f5faee00640 1 -- 172.21.15.7:0/3277992712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa8066860 msgr2=0x7f5fa81590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:03.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.806+0000 7f5faee00640 1 --2- 172.21.15.7:0/3277992712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa8066860 0x7f5fa81590f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5fa806deb0 tx=0x7f5fa001ca30 comp rx=0 tx=0).stop 2024-09-13T15:10:03.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.810+0000 7f5faee00640 1 -- 172.21.15.7:0/3277992712 shutdown_connections 2024-09-13T15:10:03.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.810+0000 7f5faee00640 1 --2- 172.21.15.7:0/3277992712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa8066860 0x7f5fa81590f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.810+0000 7f5faee00640 1 --2- 172.21.15.7:0/3277992712 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa80c7bd0 0x7f5fa8158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.810+0000 7f5faee00640 1 --2- 172.21.15.7:0/3277992712 >> v2:172.21.15.77:3300/0 conn(0x7f5fa80c77f0 0x7f5fa80c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.810+0000 7f5faee00640 1 -- 172.21.15.7:0/3277992712 >> 172.21.15.7:0/3277992712 conn(0x7f5fa8065d40 msgr2=0x7f5fa8066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:03.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.814+0000 7f5faee00640 1 -- 172.21.15.7:0/3277992712 shutdown_connections 2024-09-13T15:10:03.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.818+0000 7f5faee00640 1 -- 172.21.15.7:0/3277992712 wait complete. 2024-09-13T15:10:03.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.834+0000 7f5faee00640 1 Processor -- start 2024-09-13T15:10:03.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.834+0000 7f5faee00640 1 -- start start 2024-09-13T15:10:03.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.842+0000 7f5faee00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa8066860 0x7f5fa8153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.842+0000 7f5faee00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa80c77f0 0x7f5fa814a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.842+0000 7f5faee00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fa80c7bd0 0x7f5fa814a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.842+0000 7f5faee00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa814e590 con 0x7f5fa8066860 2024-09-13T15:10:03.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.842+0000 7f5faee00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa8149ca0 con 0x7f5fa80c7bd0 2024-09-13T15:10:03.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.842+0000 7f5faee00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa80cb910 con 0x7f5fa80c77f0 2024-09-13T15:10:03.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.842+0000 7f5fa7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa8066860 0x7f5fa8153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.842+0000 7f5fa7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa8066860 0x7f5fa8153850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35514/0 (socket says 172.21.15.7:35514) 2024-09-13T15:10:03.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.842+0000 7f5fa7e00640 1 -- 172.21.15.7:0/4277942517 learned_addr learned my addr 172.21.15.7:0/4277942517 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:10:03.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.842+0000 7f5fa7400640 1 --2- 172.21.15.7:0/4277942517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa80c77f0 0x7f5fa814a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.846+0000 7f5fa7e00640 1 -- 172.21.15.7:0/4277942517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa80c77f0 msgr2=0x7f5fa814a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:03.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.846+0000 7f5fa7e00640 1 --2- 172.21.15.7:0/4277942517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa80c77f0 0x7f5fa814a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.846+0000 7f5fa7e00640 1 -- 172.21.15.7:0/4277942517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fa80c7bd0 msgr2=0x7f5fa814a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:03.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.846+0000 7f5fa7e00640 1 --2- 172.21.15.7:0/4277942517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fa80c7bd0 0x7f5fa814a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:03.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.846+0000 7f5fa7e00640 1 -- 172.21.15.7:0/4277942517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa0009b30 con 0x7f5fa8066860 2024-09-13T15:10:03.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.854+0000 7f5fa7e00640 1 --2- 172.21.15.7:0/4277942517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa8066860 0x7f5fa8153850 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00c750 tx=0x7f5f9c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:03.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.854+0000 7f5f9be00640 1 -- 172.21.15.7:0/4277942517 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c007a90 con 0x7f5fa8066860 2024-09-13T15:10:03.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.858+0000 7f5f9be00640 1 -- 172.21.15.7:0/4277942517 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9c007bf0 con 0x7f5fa8066860 2024-09-13T15:10:03.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.858+0000 7f5f9be00640 1 -- 172.21.15.7:0/4277942517 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c00ce60 con 0x7f5fa8066860 2024-09-13T15:10:03.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.862+0000 7f5faee00640 1 -- 172.21.15.7:0/4277942517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa81493b0 con 0x7f5fa8066860 2024-09-13T15:10:03.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.862+0000 7f5faee00640 1 -- 172.21.15.7:0/4277942517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa8149650 con 0x7f5fa8066860 2024-09-13T15:10:03.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.862+0000 7f5faee00640 1 -- 172.21.15.7:0/4277942517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa8067650 con 0x7f5fa8066860 2024-09-13T15:10:03.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.866+0000 7f5f9be00640 1 -- 172.21.15.7:0/4277942517 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5f9c0113f0 con 0x7f5fa8066860 2024-09-13T15:10:03.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.870+0000 7f5f9be00640 1 --2- 172.21.15.7:0/4277942517 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5f88066710 0x7f5f88068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:03.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.870+0000 7f5fa7400640 1 --2- 172.21.15.7:0/4277942517 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5f88066710 0x7f5f88068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:03.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.886+0000 7f5f9be00640 1 -- 172.21.15.7:0/4277942517 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f5f9c055280 con 0x7f5fa8066860 2024-09-13T15:10:03.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.886+0000 7f5fa7400640 1 --2- 172.21.15.7:0/4277942517 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5f88066710 0x7f5f88068bd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5fa81671b0 tx=0x7f5f94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:03.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:03.902+0000 7f5f9be00640 1 -- 172.21.15.7:0/4277942517 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5f9c051d50 con 0x7f5fa8066860 2024-09-13T15:10:04.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:04.514+0000 7f5faee00640 1 -- 172.21.15.7:0/4277942517 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fa8068510 con 0x7f5fa8066860 2024-09-13T15:10:04.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:04.518+0000 7f5f9be00640 1 -- 172.21.15.7:0/4277942517 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+5548 (secure 0 0 0) 0x7f5f9c01e070 con 0x7f5fa8066860 2024-09-13T15:10:04.525 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:10:04.525 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:10:03.978312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:reconnect","state_seq":39,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:10:04.525 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 33 2024-09-13T15:10:04.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:04.526+0000 7f5faee00640 1 -- 172.21.15.7:0/4277942517 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5f88066710 msgr2=0x7f5f88068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:04.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:04.526+0000 7f5faee00640 1 --2- 172.21.15.7:0/4277942517 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5f88066710 0x7f5f88068bd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5fa81671b0 tx=0x7f5f94008040 comp rx=0 tx=0).stop 2024-09-13T15:10:04.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:04.526+0000 7f5faee00640 1 -- 172.21.15.7:0/4277942517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa8066860 msgr2=0x7f5fa8153850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:04.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:04.526+0000 7f5faee00640 1 --2- 172.21.15.7:0/4277942517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa8066860 0x7f5fa8153850 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00c750 tx=0x7f5f9c00cc10 comp rx=0 tx=0).stop 2024-09-13T15:10:04.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:04.526+0000 7f5faee00640 1 -- 172.21.15.7:0/4277942517 shutdown_connections 2024-09-13T15:10:04.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:04.526+0000 7f5faee00640 1 --2- 172.21.15.7:0/4277942517 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5f88066710 0x7f5f88068bd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:04.526+0000 7f5faee00640 1 --2- 172.21.15.7:0/4277942517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fa80c7bd0 0x7f5fa814a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:04.526+0000 7f5faee00640 1 --2- 172.21.15.7:0/4277942517 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5fa80c77f0 0x7f5fa814a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:04.526+0000 7f5faee00640 1 --2- 172.21.15.7:0/4277942517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5fa8066860 0x7f5fa8153850 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:04.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:04.526+0000 7f5faee00640 1 -- 172.21.15.7:0/4277942517 >> 172.21.15.7:0/4277942517 conn(0x7f5fa8065d40 msgr2=0x7f5fa8141860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:04.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:04.530+0000 7f5faee00640 1 -- 172.21.15.7:0/4277942517 shutdown_connections 2024-09-13T15:10:04.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:04.530+0000 7f5faee00640 1 -- 172.21.15.7:0/4277942517 wait complete. 2024-09-13T15:10:04.580 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:10:06.580 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:06.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.934+0000 7f39a0a00640 1 Processor -- start 2024-09-13T15:10:06.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.934+0000 7f39a0a00640 1 -- start start 2024-09-13T15:10:06.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.938+0000 7f39a0a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f399c155e80 0x7f399c06f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:06.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.938+0000 7f39a0a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f399c156260 0x7f399c0c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:06.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.938+0000 7f3999e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f399c156260 0x7f399c0c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.938+0000 7f399b200640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f399c14fa90 0x7f399c070d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:35418/0 (socket says 172.21.15.7:35418) 2024-09-13T15:10:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.938+0000 7f3999e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f399c156260 0x7f399c0c15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:52250/0 (socket says 172.21.15.7:52250) 2024-09-13T15:10:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.938+0000 7f399b200640 1 -- 172.21.15.7:0/1827934131 learned_addr learned my addr 172.21.15.7:0/1827934131 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:10:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.938+0000 7f39a0a00640 1 -- 172.21.15.7:0/1827934131 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399c0c6100 con 0x7f399c14fa90 2024-09-13T15:10:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.938+0000 7f399a800640 1 --2- 172.21.15.7:0/1827934131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f399c155e80 0x7f399c06f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:06.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.938+0000 7f39a0a00640 1 -- 172.21.15.7:0/1827934131 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399c06fc60 con 0x7f399c156260 2024-09-13T15:10:06.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.938+0000 7f39a0a00640 1 -- 172.21.15.7:0/1827934131 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399c06fa40 con 0x7f399c155e80 2024-09-13T15:10:06.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.938+0000 7f3999400640 1 -- 172.21.15.7:0/1827934131 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442343018 0 0) 0x7f399c0c6100 con 0x7f399c14fa90 2024-09-13T15:10:06.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.938+0000 7f3999400640 1 -- 172.21.15.7:0/1827934131 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3980005740 con 0x7f399c14fa90 2024-09-13T15:10:06.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.942+0000 7f3999e00640 1 -- 172.21.15.7:0/1827934131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f399c155e80 msgr2=0x7f399c06f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:06.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.942+0000 7f3999e00640 1 --2- 172.21.15.7:0/1827934131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f399c155e80 0x7f399c06f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:06.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.942+0000 7f3999e00640 1 -- 172.21.15.7:0/1827934131 >> v1:172.21.15.77:6789/0 conn(0x7f399c14fa90 legacy=0x7f399c070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:06.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.942+0000 7f3999e00640 1 -- 172.21.15.7:0/1827934131 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c0c5530 con 0x7f399c156260 2024-09-13T15:10:06.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.954+0000 7f3999e00640 1 --2- 172.21.15.7:0/1827934131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f399c156260 0x7f399c0c15f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f39880097f0 tx=0x7f398801ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bb64321270a9ecc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:06.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.954+0000 7f3999400640 1 -- 172.21.15.7:0/1827934131 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39880a8990 con 0x7f399c156260 2024-09-13T15:10:06.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.954+0000 7f3999400640 1 -- 172.21.15.7:0/1827934131 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39880a8af0 con 0x7f399c156260 2024-09-13T15:10:06.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.954+0000 7f3999400640 1 -- 172.21.15.7:0/1827934131 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39880a8990 con 0x7f399c156260 2024-09-13T15:10:06.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.958+0000 7f39a0a00640 1 -- 172.21.15.7:0/1827934131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f399c156260 msgr2=0x7f399c0c15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:06.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.958+0000 7f39a0a00640 1 --2- 172.21.15.7:0/1827934131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f399c156260 0x7f399c0c15f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f39880097f0 tx=0x7f398801ecd0 comp rx=0 tx=0).stop 2024-09-13T15:10:06.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.958+0000 7f39a0a00640 1 -- 172.21.15.7:0/1827934131 shutdown_connections 2024-09-13T15:10:06.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.958+0000 7f39a0a00640 1 --2- 172.21.15.7:0/1827934131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f399c156260 0x7f399c0c15f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:06.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.958+0000 7f39a0a00640 1 --2- 172.21.15.7:0/1827934131 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f399c155e80 0x7f399c06f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:06.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.958+0000 7f39a0a00640 1 -- 172.21.15.7:0/1827934131 >> 172.21.15.7:0/1827934131 conn(0x7f399c065d40 msgr2=0x7f399c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:06.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.966+0000 7f39a0a00640 1 -- 172.21.15.7:0/1827934131 shutdown_connections 2024-09-13T15:10:06.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.970+0000 7f39a0a00640 1 -- 172.21.15.7:0/1827934131 wait complete. 2024-09-13T15:10:06.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.970+0000 7f39a0a00640 1 Processor -- start 2024-09-13T15:10:06.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.986+0000 7f39a0a00640 1 -- start start 2024-09-13T15:10:06.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.990+0000 7f39a0a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f399c14fa90 0x7f399c1f3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:06.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.990+0000 7f39a0a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f399c155e80 0x7f399c1f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:06.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.990+0000 7f39a0a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f399c156260 0x7f399c14c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:06.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.990+0000 7f39a0a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c1f32e0 con 0x7f399c156260 2024-09-13T15:10:06.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.990+0000 7f39a0a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c14d020 con 0x7f399c155e80 2024-09-13T15:10:06.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.990+0000 7f39a0a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399c14c570 con 0x7f399c14fa90 2024-09-13T15:10:06.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.990+0000 7f399a800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f399c14fa90 0x7f399c1f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:06.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.990+0000 7f399a800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f399c14fa90 0x7f399c1f3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:37974/0 (socket says 172.21.15.7:37974) 2024-09-13T15:10:06.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.990+0000 7f399a800640 1 -- 172.21.15.7:0/3209075935 learned_addr learned my addr 172.21.15.7:0/3209075935 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:10:06.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.990+0000 7f399a800640 1 -- 172.21.15.7:0/3209075935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f399c155e80 msgr2=0x7f399c1f6080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:10:06.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.990+0000 7f399a800640 1 --2- 172.21.15.7:0/3209075935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f399c155e80 0x7f399c1f6080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:06.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.990+0000 7f399a800640 1 -- 172.21.15.7:0/3209075935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f399c156260 msgr2=0x7f399c14c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:06.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.990+0000 7f399a800640 1 --2- 172.21.15.7:0/3209075935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f399c156260 0x7f399c14c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:06.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.990+0000 7f399a800640 1 -- 172.21.15.7:0/3209075935 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3988009420 con 0x7f399c14fa90 2024-09-13T15:10:06.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.994+0000 7f399a800640 1 --2- 172.21.15.7:0/3209075935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f399c14fa90 0x7f399c1f3700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3994007f20 tx=0x7f399400e570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:06.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.994+0000 7f3992a00640 1 -- 172.21.15.7:0/3209075935 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994014620 con 0x7f399c14fa90 2024-09-13T15:10:07.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.994+0000 7f3992a00640 1 -- 172.21.15.7:0/3209075935 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3994014780 con 0x7f399c14fa90 2024-09-13T15:10:07.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.994+0000 7f3992a00640 1 -- 172.21.15.7:0/3209075935 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3994014af0 con 0x7f399c14fa90 2024-09-13T15:10:07.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.994+0000 7f39a0a00640 1 -- 172.21.15.7:0/3209075935 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399c14ca60 con 0x7f399c14fa90 2024-09-13T15:10:07.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.994+0000 7f39a0a00640 1 -- 172.21.15.7:0/3209075935 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399c1f2c20 con 0x7f399c14fa90 2024-09-13T15:10:07.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.998+0000 7f39a0a00640 1 -- 172.21.15.7:0/3209075935 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f399c156970 con 0x7f399c14fa90 2024-09-13T15:10:07.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.998+0000 7f3992a00640 1 -- 172.21.15.7:0/3209075935 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3994014c50 con 0x7f399c14fa90 2024-09-13T15:10:07.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.998+0000 7f3992a00640 1 --2- 172.21.15.7:0/3209075935 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f397c0666e0 0x7f397c068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:07.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:06.998+0000 7f3992a00640 1 -- 172.21.15.7:0/3209075935 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f3994085070 con 0x7f399c14fa90 2024-09-13T15:10:07.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:07.002+0000 7f3999e00640 1 --2- 172.21.15.7:0/3209075935 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f397c0666e0 0x7f397c068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:07.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:07.010+0000 7f3992a00640 1 -- 172.21.15.7:0/3209075935 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f39940b6db0 con 0x7f399c14fa90 2024-09-13T15:10:07.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:07.014+0000 7f3999e00640 1 --2- 172.21.15.7:0/3209075935 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f397c0666e0 0x7f397c068ba0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f39880b2000 tx=0x7f39880aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:07.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:07.622+0000 7f39a0a00640 1 -- 172.21.15.7:0/3209075935 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f399c14a790 con 0x7f399c14fa90 2024-09-13T15:10:07.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:07.634+0000 7f3992a00640 1 -- 172.21.15.7:0/3209075935 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+5548 (secure 0 0 0) 0x7f3994051f90 con 0x7f399c14fa90 2024-09-13T15:10:07.651 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:10:07.651 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:10:03.978312+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:reconnect","state_seq":39,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:10:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 33 2024-09-13T15:10:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:07.646+0000 7f39a0a00640 1 -- 172.21.15.7:0/3209075935 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f397c0666e0 msgr2=0x7f397c068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:07.646+0000 7f39a0a00640 1 --2- 172.21.15.7:0/3209075935 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f397c0666e0 0x7f397c068ba0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f39880b2000 tx=0x7f39880aa070 comp rx=0 tx=0).stop 2024-09-13T15:10:07.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:07.646+0000 7f39a0a00640 1 -- 172.21.15.7:0/3209075935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f399c14fa90 msgr2=0x7f399c1f3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:07.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:07.646+0000 7f39a0a00640 1 --2- 172.21.15.7:0/3209075935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f399c14fa90 0x7f399c1f3700 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3994007f20 tx=0x7f399400e570 comp rx=0 tx=0).stop 2024-09-13T15:10:07.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:07.650+0000 7f39a0a00640 1 -- 172.21.15.7:0/3209075935 shutdown_connections 2024-09-13T15:10:07.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:07.650+0000 7f39a0a00640 1 --2- 172.21.15.7:0/3209075935 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f397c0666e0 0x7f397c068ba0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:07.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:07.650+0000 7f39a0a00640 1 --2- 172.21.15.7:0/3209075935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f399c156260 0x7f399c14c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:07.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:07.650+0000 7f39a0a00640 1 --2- 172.21.15.7:0/3209075935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f399c155e80 0x7f399c1f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:07.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:07.650+0000 7f39a0a00640 1 --2- 172.21.15.7:0/3209075935 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f399c14fa90 0x7f399c1f3700 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:07.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:07.650+0000 7f39a0a00640 1 -- 172.21.15.7:0/3209075935 >> 172.21.15.7:0/3209075935 conn(0x7f399c065d40 msgr2=0x7f399c06cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:07.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:07.654+0000 7f39a0a00640 1 -- 172.21.15.7:0/3209075935 shutdown_connections 2024-09-13T15:10:07.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:07.654+0000 7f39a0a00640 1 -- 172.21.15.7:0/3209075935 wait complete. 2024-09-13T15:10:07.768 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:10:09.769 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.098+0000 7fbf53c00640 1 Processor -- start 2024-09-13T15:10:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.098+0000 7fbf53c00640 1 -- start start 2024-09-13T15:10:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.102+0000 7fbf53c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbf4c0c6890 0x7fbf4c06cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.102+0000 7fbf53c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4c161ab0 con 0x7fbf4c0c5e90 2024-09-13T15:10:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.102+0000 7fbf53c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4c06dbc0 con 0x7fbf4c0c5ab0 2024-09-13T15:10:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.102+0000 7fbf53c00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4c160f80 con 0x7fbf4c0c6890 2024-09-13T15:10:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.102+0000 7fbf51200640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbf4c0c5ab0 0x7fbf4c1613a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:37108/0 (socket says 172.21.15.7:37108) 2024-09-13T15:10:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.102+0000 7fbf51200640 1 -- 172.21.15.7:0/3154761969 learned_addr learned my addr 172.21.15.7:0/3154761969 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:10:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.102+0000 7fbf4be00640 1 --2- 172.21.15.7:0/3154761969 >> v2:172.21.15.77:3300/0 conn(0x7fbf4c0c6890 0x7fbf4c06cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:10.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.102+0000 7fbf4be00640 1 -- 172.21.15.7:0/3154761969 >> v1:172.21.15.77:6789/0 conn(0x7fbf4c0c5ab0 legacy=0x7fbf4c1613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:10.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.102+0000 7fbf4be00640 1 -- 172.21.15.7:0/3154761969 >> v1:172.21.15.7:6789/0 conn(0x7fbf4c0c5e90 legacy=0x7fbf4c157280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:10:10.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.102+0000 7fbf4be00640 1 -- 172.21.15.7:0/3154761969 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c06d320 con 0x7fbf4c0c6890 2024-09-13T15:10:10.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.110+0000 7fbf4be00640 1 --2- 172.21.15.7:0/3154761969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf4c0c6890 0x7fbf4c06cce0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbf380097f0 tx=0x7fbf3801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5acb6d8b57dd708e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:10.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.110+0000 7fbf4b400640 1 -- 172.21.15.7:0/3154761969 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf380a8970 con 0x7fbf4c0c6890 2024-09-13T15:10:10.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.110+0000 7fbf4b400640 1 -- 172.21.15.7:0/3154761969 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf380a8ad0 con 0x7fbf4c0c6890 2024-09-13T15:10:10.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.110+0000 7fbf4b400640 1 -- 172.21.15.7:0/3154761969 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf380a8ea0 con 0x7fbf4c0c6890 2024-09-13T15:10:10.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.114+0000 7fbf53c00640 1 -- 172.21.15.7:0/3154761969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf4c0c6890 msgr2=0x7fbf4c06cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:10.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.114+0000 7fbf53c00640 1 --2- 172.21.15.7:0/3154761969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf4c0c6890 0x7fbf4c06cce0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbf380097f0 tx=0x7fbf3801ec70 comp rx=0 tx=0).stop 2024-09-13T15:10:10.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.114+0000 7fbf53c00640 1 -- 172.21.15.7:0/3154761969 shutdown_connections 2024-09-13T15:10:10.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.118+0000 7fbf53c00640 1 --2- 172.21.15.7:0/3154761969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf4c0c6890 0x7fbf4c06cce0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:10.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.118+0000 7fbf53c00640 1 -- 172.21.15.7:0/3154761969 >> 172.21.15.7:0/3154761969 conn(0x7fbf4c065d40 msgr2=0x7fbf4c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:10.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.118+0000 7fbf53c00640 1 -- 172.21.15.7:0/3154761969 shutdown_connections 2024-09-13T15:10:10.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.118+0000 7fbf53c00640 1 -- 172.21.15.7:0/3154761969 wait complete. 2024-09-13T15:10:10.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.122+0000 7fbf53c00640 1 Processor -- start 2024-09-13T15:10:10.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.122+0000 7fbf53c00640 1 -- start start 2024-09-13T15:10:10.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.126+0000 7fbf53c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf4c0c5ab0 0x7fbf4c150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:10.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.126+0000 7fbf51200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf4c0c5ab0 0x7fbf4c150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:10.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.126+0000 7fbf51200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf4c0c5ab0 0x7fbf4c150e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:45124/0 (socket says 172.21.15.7:45124) 2024-09-13T15:10:10.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.126+0000 7fbf53c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf4c0c5e90 0x7fbf4c14be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:10.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.126+0000 7fbf51200640 1 -- 172.21.15.7:0/1076427246 learned_addr learned my addr 172.21.15.7:0/1076427246 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:10:10.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.126+0000 7fbf53c00640 1 --2- 172.21.15.7:0/1076427246 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf4c0c6890 0x7fbf4c1f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:10.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.130+0000 7fbf53c00640 1 -- 172.21.15.7:0/1076427246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c14ea50 con 0x7fbf4c0c5e90 2024-09-13T15:10:10.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.130+0000 7fbf53c00640 1 -- 172.21.15.7:0/1076427246 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0c9400 con 0x7fbf4c0c5ab0 2024-09-13T15:10:10.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.130+0000 7fbf53c00640 1 -- 172.21.15.7:0/1076427246 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0c4400 con 0x7fbf4c0c6890 2024-09-13T15:10:10.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.130+0000 7fbf51c00640 1 --2- 172.21.15.7:0/1076427246 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf4c0c6890 0x7fbf4c1f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:10.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.130+0000 7fbf4be00640 1 --2- 172.21.15.7:0/1076427246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf4c0c5e90 0x7fbf4c14be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:10.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.130+0000 7fbf51200640 1 -- 172.21.15.7:0/1076427246 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf4c0c6890 msgr2=0x7fbf4c1f32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:10.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.130+0000 7fbf51200640 1 --2- 172.21.15.7:0/1076427246 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf4c0c6890 0x7fbf4c1f32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:10.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.130+0000 7fbf51200640 1 -- 172.21.15.7:0/1076427246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf4c0c5e90 msgr2=0x7fbf4c14be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:10.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.130+0000 7fbf51200640 1 --2- 172.21.15.7:0/1076427246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf4c0c5e90 0x7fbf4c14be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:10.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.130+0000 7fbf51200640 1 -- 172.21.15.7:0/1076427246 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf38009420 con 0x7fbf4c0c5ab0 2024-09-13T15:10:10.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.130+0000 7fbf51200640 1 --2- 172.21.15.7:0/1076427246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf4c0c5ab0 0x7fbf4c150e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00c400 tx=0x7fbf3c00c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.130+0000 7fbf48c00640 1 -- 172.21.15.7:0/1076427246 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c005cf0 con 0x7fbf4c0c5ab0 2024-09-13T15:10:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.130+0000 7fbf48c00640 1 -- 172.21.15.7:0/1076427246 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3c005e50 con 0x7fbf4c0c5ab0 2024-09-13T15:10:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.130+0000 7fbf48c00640 1 -- 172.21.15.7:0/1076427246 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c0072d0 con 0x7fbf4c0c5ab0 2024-09-13T15:10:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.130+0000 7fbf53c00640 1 -- 172.21.15.7:0/1076427246 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4c151350 con 0x7fbf4c0c5ab0 2024-09-13T15:10:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.130+0000 7fbf53c00640 1 -- 172.21.15.7:0/1076427246 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4c0c46a0 con 0x7fbf4c0c5ab0 2024-09-13T15:10:10.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.138+0000 7fbf48c00640 1 -- 172.21.15.7:0/1076427246 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbf3c007430 con 0x7fbf4c0c5ab0 2024-09-13T15:10:10.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.138+0000 7fbf48c00640 1 --2- 172.21.15.7:0/1076427246 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbf2c066760 0x7fbf2c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.142+0000 7fbf48c00640 1 -- 172.21.15.7:0/1076427246 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fbf3c083bf0 con 0x7fbf4c0c5ab0 2024-09-13T15:10:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.142+0000 7fbf4be00640 1 --2- 172.21.15.7:0/1076427246 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbf2c066760 0x7fbf2c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.142+0000 7fbf53c00640 1 -- 172.21.15.7:0/1076427246 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4c067650 con 0x7fbf4c0c5ab0 2024-09-13T15:10:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.142+0000 7fbf4be00640 1 --2- 172.21.15.7:0/1076427246 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbf2c066760 0x7fbf2c068c20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbf380b2000 tx=0x7fbf380aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.154+0000 7fbf48c00640 1 -- 172.21.15.7:0/1076427246 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbf3c050aa0 con 0x7fbf4c0c5ab0 2024-09-13T15:10:10.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.610+0000 7fbf53c00640 1 -- 172.21.15.7:0/1076427246 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf4c066d50 con 0x7fbf4c0c5ab0 2024-09-13T15:10:10.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.618+0000 7fbf48c00640 1 -- 172.21.15.7:0/1076427246 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+5545 (secure 0 0 0) 0x7fbf3c017030 con 0x7fbf4c0c5ab0 2024-09-13T15:10:10.623 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:10:10.623 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:10:09.917876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:rejoin","state_seq":41,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:10:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 34 2024-09-13T15:10:10.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.626+0000 7fbf53c00640 1 -- 172.21.15.7:0/1076427246 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbf2c066760 msgr2=0x7fbf2c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:10.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.626+0000 7fbf53c00640 1 --2- 172.21.15.7:0/1076427246 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbf2c066760 0x7fbf2c068c20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbf380b2000 tx=0x7fbf380aa070 comp rx=0 tx=0).stop 2024-09-13T15:10:10.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.626+0000 7fbf53c00640 1 -- 172.21.15.7:0/1076427246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf4c0c5ab0 msgr2=0x7fbf4c150e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:10.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.626+0000 7fbf53c00640 1 --2- 172.21.15.7:0/1076427246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf4c0c5ab0 0x7fbf4c150e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00c400 tx=0x7fbf3c00c8c0 comp rx=0 tx=0).stop 2024-09-13T15:10:10.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.626+0000 7fbf53c00640 1 -- 172.21.15.7:0/1076427246 shutdown_connections 2024-09-13T15:10:10.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.626+0000 7fbf53c00640 1 --2- 172.21.15.7:0/1076427246 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbf2c066760 0x7fbf2c068c20 secure :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbf380b2000 tx=0x7fbf380aa070 comp rx=0 tx=0).stop 2024-09-13T15:10:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.626+0000 7fbf53c00640 1 --2- 172.21.15.7:0/1076427246 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf4c0c6890 0x7fbf4c1f32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.626+0000 7fbf53c00640 1 --2- 172.21.15.7:0/1076427246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf4c0c5e90 0x7fbf4c14be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.626+0000 7fbf53c00640 1 --2- 172.21.15.7:0/1076427246 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf4c0c5ab0 0x7fbf4c150e10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.626+0000 7fbf53c00640 1 -- 172.21.15.7:0/1076427246 >> 172.21.15.7:0/1076427246 conn(0x7fbf4c065d40 msgr2=0x7fbf4c160350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:10.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.634+0000 7fbf53c00640 1 -- 172.21.15.7:0/1076427246 shutdown_connections 2024-09-13T15:10:10.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:10.634+0000 7fbf53c00640 1 -- 172.21.15.7:0/1076427246 wait complete. 2024-09-13T15:10:10.766 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 34, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-13T15:01:44.789559+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 34, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3, 4 ], "info": { "gid_4252": { "addr": "172.21.15.77:6835/2367107997", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6834", "nonce": 2367107997, "type": "v2" }, { "addr": "172.21.15.77:6835", "nonce": 2367107997, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4252, "incarnation": 13, "join_fscid": -1, "name": "d", "rank": 2, "state": "up:active", "state_seq": 43 }, "gid_4267": { "addr": "172.21.15.77:6839/2233000674", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6837", "nonce": 2233000674, "type": "v2" }, { "addr": "172.21.15.77:6839", "nonce": 2233000674, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4267, "incarnation": 9, "join_fscid": -1, "name": "f", "rank": 1, "state": "up:active", "state_seq": 41 }, "gid_4276": { "addr": "172.21.15.7:6836/2396967179", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6834", "nonce": 2396967179, "type": "v2" }, { "addr": "172.21.15.7:6836", "nonce": 2396967179, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4276, "incarnation": 4, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_5069": { "addr": "172.21.15.77:6838/877425259", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6836", "nonce": 877425259, "type": "v2" }, { "addr": "172.21.15.77:6838", "nonce": 877425259, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5069, "incarnation": 31, "join_fscid": -1, "name": "b", "rank": 3, "state": "up:rejoin", "state_seq": 41 }, "gid_5230": { "addr": "172.21.15.7:6833/2896136827", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6832", "nonce": 2896136827, "type": "v2" }, { "addr": "172.21.15.7:6833", "nonce": 2896136827, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5230, "incarnation": 25, "join_fscid": -1, "name": "e", "rank": 4, "state": "up:active", "state_seq": 34 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 5, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-13T15:10:09.917876+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4276, "mds_1": 4267, "mds_2": 4252, "mds_3": 5069, "mds_4": 5230 } } } ], "standbys": [] } 2024-09-13T15:10:12.767 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:13.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.038+0000 7fc13e200640 1 Processor -- start 2024-09-13T15:10:13.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.038+0000 7fc13e200640 1 -- start start 2024-09-13T15:10:13.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.042+0000 7fc13e200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc1380c77f0 0x7fc1380c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:13.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.042+0000 7fc13e200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1380c7bd0 0x7fc138158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.042+0000 7fc13e200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc138158720 con 0x7fc1380c08a0 2024-09-13T15:10:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.042+0000 7fc13e200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc138155130 con 0x7fc1380c77f0 2024-09-13T15:10:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.042+0000 7fc13e200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc138155320 con 0x7fc1380c7bd0 2024-09-13T15:10:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.042+0000 7fc136a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1380c7bd0 0x7fc138158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.042+0000 7fc136a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1380c7bd0 0x7fc138158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:51906/0 (socket says 172.21.15.7:51906) 2024-09-13T15:10:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.042+0000 7fc136a00640 1 -- 172.21.15.7:0/3965560760 learned_addr learned my addr 172.21.15.7:0/3965560760 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:10:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.046+0000 7fc136a00640 1 -- 172.21.15.7:0/3965560760 >> v2:172.21.15.7:3300/0 conn(0x7fc1380c77f0 msgr2=0x7fc1380c5cc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:10:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.046+0000 7fc137400640 1 --2- 172.21.15.7:0/3965560760 >> v2:172.21.15.7:3300/0 conn(0x7fc1380c77f0 0x7fc1380c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:13.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.050+0000 7fc136a00640 1 --2- 172.21.15.7:0/3965560760 >> v2:172.21.15.7:3300/0 conn(0x7fc1380c77f0 0x7fc1380c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.050+0000 7fc136a00640 1 -- 172.21.15.7:0/3965560760 >> v1:172.21.15.77:6789/0 conn(0x7fc1380c08a0 legacy=0x7fc13814edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.050+0000 7fc136a00640 1 -- 172.21.15.7:0/3965560760 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1381555e0 con 0x7fc1380c7bd0 2024-09-13T15:10:13.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.050+0000 7fc137400640 1 --2- 172.21.15.7:0/3965560760 >> v2:172.21.15.7:3300/0 conn(0x7fc1380c77f0 0x7fc1380c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:13.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.054+0000 7fc136a00640 1 --2- 172.21.15.7:0/3965560760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1380c7bd0 0x7fc138158bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc130009e50 tx=0x7fc13001ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f99d4565a200692 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:13.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.058+0000 7fc136000640 1 -- 172.21.15.7:0/3965560760 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1300a7af0 con 0x7fc1380c7bd0 2024-09-13T15:10:13.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.058+0000 7fc136000640 1 -- 172.21.15.7:0/3965560760 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1300a7c50 con 0x7fc1380c7bd0 2024-09-13T15:10:13.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.058+0000 7fc136000640 1 -- 172.21.15.7:0/3965560760 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1300af3f0 con 0x7fc1380c7bd0 2024-09-13T15:10:13.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.070+0000 7fc13e200640 1 -- 172.21.15.7:0/3965560760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1380c7bd0 msgr2=0x7fc138158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.070+0000 7fc13e200640 1 --2- 172.21.15.7:0/3965560760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1380c7bd0 0x7fc138158bb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc130009e50 tx=0x7fc13001ec20 comp rx=0 tx=0).stop 2024-09-13T15:10:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.074+0000 7fc13e200640 1 -- 172.21.15.7:0/3965560760 shutdown_connections 2024-09-13T15:10:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.074+0000 7fc13e200640 1 --2- 172.21.15.7:0/3965560760 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1380c7bd0 0x7fc138158bb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.074+0000 7fc13e200640 1 --2- 172.21.15.7:0/3965560760 >> v2:172.21.15.7:3300/0 conn(0x7fc1380c77f0 0x7fc1380c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.074+0000 7fc13e200640 1 -- 172.21.15.7:0/3965560760 >> 172.21.15.7:0/3965560760 conn(0x7fc138065d40 msgr2=0x7fc138066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:13.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.082+0000 7fc13e200640 1 -- 172.21.15.7:0/3965560760 shutdown_connections 2024-09-13T15:10:13.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.082+0000 7fc13e200640 1 -- 172.21.15.7:0/3965560760 wait complete. 2024-09-13T15:10:13.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.086+0000 7fc13e200640 1 Processor -- start 2024-09-13T15:10:13.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.086+0000 7fc13e200640 1 -- start start 2024-09-13T15:10:13.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.090+0000 7fc13e200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1380c08a0 0x7fc13814dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:13.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.090+0000 7fc13e200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1380c77f0 0x7fc1381f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:13.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.090+0000 7fc13e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1380c7bd0 0x7fc1381f19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:13.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.090+0000 7fc13e200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc138148570 con 0x7fc1380c7bd0 2024-09-13T15:10:13.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.090+0000 7fc13e200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc138148b30 con 0x7fc1380c77f0 2024-09-13T15:10:13.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.090+0000 7fc13e200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc138071e00 con 0x7fc1380c08a0 2024-09-13T15:10:13.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.090+0000 7fc137400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1380c08a0 0x7fc13814dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:13.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.090+0000 7fc137400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1380c08a0 0x7fc13814dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:51908/0 (socket says 172.21.15.7:51908) 2024-09-13T15:10:13.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.090+0000 7fc137400640 1 -- 172.21.15.7:0/1452809132 learned_addr learned my addr 172.21.15.7:0/1452809132 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:10:13.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.090+0000 7fc136a00640 1 --2- 172.21.15.7:0/1452809132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1380c77f0 0x7fc1381f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:13.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.094+0000 7fc137e00640 1 --2- 172.21.15.7:0/1452809132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1380c7bd0 0x7fc1381f19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:13.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.094+0000 7fc137400640 1 -- 172.21.15.7:0/1452809132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1380c77f0 msgr2=0x7fc1381f14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.094+0000 7fc137400640 1 --2- 172.21.15.7:0/1452809132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1380c77f0 0x7fc1381f14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.094+0000 7fc137400640 1 -- 172.21.15.7:0/1452809132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1380c7bd0 msgr2=0x7fc1381f19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.094+0000 7fc137400640 1 --2- 172.21.15.7:0/1452809132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1380c7bd0 0x7fc1381f19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.094+0000 7fc137400640 1 -- 172.21.15.7:0/1452809132 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc130009b30 con 0x7fc1380c08a0 2024-09-13T15:10:13.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.094+0000 7fc137400640 1 --2- 172.21.15.7:0/1452809132 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1380c08a0 0x7fc13814dc20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc12400c7f0 tx=0x7fc12400ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:13.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.094+0000 7fc136a00640 1 --2- 172.21.15.7:0/1452809132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1380c77f0 0x7fc1381f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:13.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.094+0000 7fc12f400640 1 -- 172.21.15.7:0/1452809132 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc124007820 con 0x7fc1380c08a0 2024-09-13T15:10:13.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.094+0000 7fc12f400640 1 -- 172.21.15.7:0/1452809132 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc124007980 con 0x7fc1380c08a0 2024-09-13T15:10:13.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.094+0000 7fc12f400640 1 -- 172.21.15.7:0/1452809132 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc124007d10 con 0x7fc1380c08a0 2024-09-13T15:10:13.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.094+0000 7fc13e200640 1 -- 172.21.15.7:0/1452809132 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc138072030 con 0x7fc1380c08a0 2024-09-13T15:10:13.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.094+0000 7fc13e200640 1 -- 172.21.15.7:0/1452809132 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc138145780 con 0x7fc1380c08a0 2024-09-13T15:10:13.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.094+0000 7fc13e200640 1 -- 172.21.15.7:0/1452809132 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc138067650 con 0x7fc1380c08a0 2024-09-13T15:10:13.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.102+0000 7fc12f400640 1 -- 172.21.15.7:0/1452809132 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc124024480 con 0x7fc1380c08a0 2024-09-13T15:10:13.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.106+0000 7fc12f400640 1 --2- 172.21.15.7:0/1452809132 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc1180776f0 0x7fc118079bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.106+0000 7fc12f400640 1 -- 172.21.15.7:0/1452809132 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fc124084a70 con 0x7fc1380c08a0 2024-09-13T15:10:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.106+0000 7fc12f400640 1 -- 172.21.15.7:0/1452809132 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc124051a90 con 0x7fc1380c08a0 2024-09-13T15:10:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.106+0000 7fc136a00640 1 --2- 172.21.15.7:0/1452809132 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc1180776f0 0x7fc118079bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:13.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.122+0000 7fc136a00640 1 --2- 172.21.15.7:0/1452809132 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc1180776f0 0x7fc118079bb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc1300b0000 tx=0x7fc1300a9070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:13.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.530+0000 7fc13e200640 1 -- 172.21.15.7:0/1452809132 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1381459a0 con 0x7fc1380c08a0 2024-09-13T15:10:13.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.530+0000 7fc12f400640 1 -- 172.21.15.7:0/1452809132 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+5545 (secure 0 0 0) 0x7fc1240550b0 con 0x7fc1380c08a0 2024-09-13T15:10:13.534 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:10:13.534 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:10:09.917876+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:rejoin","state_seq":41,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:10:13.534 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 34 2024-09-13T15:10:13.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.538+0000 7fc13e200640 1 -- 172.21.15.7:0/1452809132 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc1180776f0 msgr2=0x7fc118079bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.538+0000 7fc13e200640 1 --2- 172.21.15.7:0/1452809132 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc1180776f0 0x7fc118079bb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc1300b0000 tx=0x7fc1300a9070 comp rx=0 tx=0).stop 2024-09-13T15:10:13.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.542+0000 7fc13e200640 1 -- 172.21.15.7:0/1452809132 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1380c08a0 msgr2=0x7fc13814dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:13.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.542+0000 7fc13e200640 1 --2- 172.21.15.7:0/1452809132 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1380c08a0 0x7fc13814dc20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc12400c7f0 tx=0x7fc12400ccb0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.542+0000 7fc13e200640 1 -- 172.21.15.7:0/1452809132 shutdown_connections 2024-09-13T15:10:13.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.542+0000 7fc13e200640 1 --2- 172.21.15.7:0/1452809132 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc1180776f0 0x7fc118079bb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.542+0000 7fc13e200640 1 --2- 172.21.15.7:0/1452809132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1380c7bd0 0x7fc1381f19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.542+0000 7fc13e200640 1 --2- 172.21.15.7:0/1452809132 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1380c77f0 0x7fc1381f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.542+0000 7fc13e200640 1 --2- 172.21.15.7:0/1452809132 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc1380c08a0 0x7fc13814dc20 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc12400c7f0 tx=0x7fc12400ccb0 comp rx=0 tx=0).stop 2024-09-13T15:10:13.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.542+0000 7fc13e200640 1 -- 172.21.15.7:0/1452809132 >> 172.21.15.7:0/1452809132 conn(0x7fc138065d40 msgr2=0x7fc1380c6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:13.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.542+0000 7fc13e200640 1 -- 172.21.15.7:0/1452809132 shutdown_connections 2024-09-13T15:10:13.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:13.542+0000 7fc13e200640 1 -- 172.21.15.7:0/1452809132 wait complete. 2024-09-13T15:10:13.582 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:10:15.137 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-09-13T15:10:15.130+0000 7ff9aa000640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-13T15:10:15.584 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:16.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:15.810+0000 7f9e95600640 1 Processor -- start 2024-09-13T15:10:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:15.810+0000 7f9e95600640 1 -- start start 2024-09-13T15:10:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:15.814+0000 7f9e95600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e900c5b60 0x7f9e9006fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:15.814+0000 7f9e95600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9e900c5f40 0x7f9e900c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:15.814+0000 7f9e95600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9e9006cd70 0x7f9e900c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:15.814+0000 7f9e95600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e90070410 con 0x7f9e9006cd70 2024-09-13T15:10:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:15.814+0000 7f9e95600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e900706d0 con 0x7f9e900c5f40 2024-09-13T15:10:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:15.814+0000 7f9e95600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e900709b0 con 0x7f9e900c5b60 2024-09-13T15:10:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:15.814+0000 7f9e94c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9e9006cd70 0x7f9e900c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:15.814+0000 7f9e94c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f9e9006cd70 0x7f9e900c70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38180/0 (socket says 172.21.15.7:38180) 2024-09-13T15:10:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:15.814+0000 7f9e8f400640 1 --2- 172.21.15.7:0/2488264200 >> v2:172.21.15.77:3300/0 conn(0x7f9e900c5f40 0x7f9e900c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:15.814+0000 7f9e8fe00640 1 --2- 172.21.15.7:0/2488264200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e900c5b60 0x7f9e9006fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:15.814+0000 7f9e94c00640 1 -- 172.21.15.7:0/2488264200 learned_addr learned my addr 172.21.15.7:0/2488264200 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:10:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.018+0000 7f9e94c00640 1 -- 172.21.15.7:0/2488264200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e900c5b60 msgr2=0x7f9e9006fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.018+0000 7f9e94c00640 1 --2- 172.21.15.7:0/2488264200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e900c5b60 0x7f9e9006fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.018+0000 7f9e94c00640 1 -- 172.21.15.7:0/2488264200 >> v2:172.21.15.77:3300/0 conn(0x7f9e900c5f40 msgr2=0x7f9e900c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.018+0000 7f9e94c00640 1 --2- 172.21.15.7:0/2488264200 >> v2:172.21.15.77:3300/0 conn(0x7f9e900c5f40 0x7f9e900c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.018+0000 7f9e94c00640 1 -- 172.21.15.7:0/2488264200 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e90070c90 con 0x7f9e9006cd70 2024-09-13T15:10:16.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.026+0000 7f9e94c00640 1 --2- 172.21.15.7:0/2488264200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e9006cd70 0x7f9e900c70e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9e9006ef10 tx=0x7f9e8801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1290a5c9648772 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.026+0000 7f9e8ea00640 1 -- 172.21.15.7:0/2488264200 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e880af400 con 0x7f9e9006cd70 2024-09-13T15:10:16.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.030+0000 7f9e8ea00640 1 -- 172.21.15.7:0/2488264200 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e880ab050 con 0x7f9e9006cd70 2024-09-13T15:10:16.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.030+0000 7f9e8ea00640 1 -- 172.21.15.7:0/2488264200 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e880af780 con 0x7f9e9006cd70 2024-09-13T15:10:16.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.030+0000 7f9e95600640 1 -- 172.21.15.7:0/2488264200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e9006cd70 msgr2=0x7f9e900c70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.030+0000 7f9e95600640 1 --2- 172.21.15.7:0/2488264200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e9006cd70 0x7f9e900c70e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9e9006ef10 tx=0x7f9e8801f1e0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.038+0000 7f9e95600640 1 -- 172.21.15.7:0/2488264200 shutdown_connections 2024-09-13T15:10:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.038+0000 7f9e95600640 1 --2- 172.21.15.7:0/2488264200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e9006cd70 0x7f9e900c70e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.038+0000 7f9e95600640 1 --2- 172.21.15.7:0/2488264200 >> v2:172.21.15.77:3300/0 conn(0x7f9e900c5f40 0x7f9e900c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.038+0000 7f9e95600640 1 --2- 172.21.15.7:0/2488264200 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e900c5b60 0x7f9e9006fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.038+0000 7f9e95600640 1 -- 172.21.15.7:0/2488264200 >> 172.21.15.7:0/2488264200 conn(0x7f9e90065d40 msgr2=0x7f9e90066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.038+0000 7f9e95600640 1 -- 172.21.15.7:0/2488264200 shutdown_connections 2024-09-13T15:10:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.038+0000 7f9e95600640 1 -- 172.21.15.7:0/2488264200 wait complete. 2024-09-13T15:10:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.042+0000 7f9e95600640 1 Processor -- start 2024-09-13T15:10:16.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.042+0000 7f9e95600640 1 -- start start 2024-09-13T15:10:16.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.042+0000 7f9e95600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e9006cd70 0x7f9e90164af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:16.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.042+0000 7f9e95600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e900c5b60 0x7f9e901f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:16.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e95600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e900c5f40 0x7f9e900c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:16.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e95600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9016a4d0 con 0x7f9e900c5f40 2024-09-13T15:10:16.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e95600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e90164660 con 0x7f9e900c5b60 2024-09-13T15:10:16.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e95600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e900c4d80 con 0x7f9e9006cd70 2024-09-13T15:10:16.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e8fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e9006cd70 0x7f9e90164af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:16.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e8fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e9006cd70 0x7f9e90164af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:51918/0 (socket says 172.21.15.7:51918) 2024-09-13T15:10:16.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e8fe00640 1 -- 172.21.15.7:0/3130878564 learned_addr learned my addr 172.21.15.7:0/3130878564 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:10:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e8f400640 1 --2- 172.21.15.7:0/3130878564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e900c5b60 0x7f9e901f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e8fe00640 1 -- 172.21.15.7:0/3130878564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e900c5b60 msgr2=0x7f9e901f6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e8fe00640 1 --2- 172.21.15.7:0/3130878564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e900c5b60 0x7f9e901f6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e8fe00640 1 -- 172.21.15.7:0/3130878564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e900c5f40 msgr2=0x7f9e900c3e90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:10:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e94c00640 1 --2- 172.21.15.7:0/3130878564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e900c5f40 0x7f9e900c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e8fe00640 1 --2- 172.21.15.7:0/3130878564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e900c5f40 0x7f9e900c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e8fe00640 1 -- 172.21.15.7:0/3130878564 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e88009b30 con 0x7f9e9006cd70 2024-09-13T15:10:16.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e8f400640 1 --2- 172.21.15.7:0/3130878564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e900c5b60 0x7f9e901f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e94c00640 1 --2- 172.21.15.7:0/3130878564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e900c5f40 0x7f9e900c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e8fe00640 1 --2- 172.21.15.7:0/3130878564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e9006cd70 0x7f9e90164af0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000d830 tx=0x7f9e8000dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.046+0000 7f9e87e00640 1 -- 172.21.15.7:0/3130878564 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e800096a0 con 0x7f9e9006cd70 2024-09-13T15:10:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.050+0000 7f9e87e00640 1 -- 172.21.15.7:0/3130878564 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e80009800 con 0x7f9e9006cd70 2024-09-13T15:10:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.050+0000 7f9e87e00640 1 -- 172.21.15.7:0/3130878564 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e80009b70 con 0x7f9e9006cd70 2024-09-13T15:10:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.050+0000 7f9e95600640 1 -- 172.21.15.7:0/3130878564 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e9016a1f0 con 0x7f9e9006cd70 2024-09-13T15:10:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.050+0000 7f9e95600640 1 -- 172.21.15.7:0/3130878564 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e901642f0 con 0x7f9e9006cd70 2024-09-13T15:10:16.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.058+0000 7f9e95600640 1 -- 172.21.15.7:0/3130878564 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e90163e70 con 0x7f9e9006cd70 2024-09-13T15:10:16.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.058+0000 7f9e87e00640 1 -- 172.21.15.7:0/3130878564 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9e80014410 con 0x7f9e9006cd70 2024-09-13T15:10:16.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.058+0000 7f9e87e00640 1 --2- 172.21.15.7:0/3130878564 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9e700666c0 0x7f9e70068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:16.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.058+0000 7f9e87e00640 1 -- 172.21.15.7:0/3130878564 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f9e80085050 con 0x7f9e9006cd70 2024-09-13T15:10:16.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.062+0000 7f9e8f400640 1 --2- 172.21.15.7:0/3130878564 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9e700666c0 0x7f9e70068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:16.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.062+0000 7f9e8f400640 1 --2- 172.21.15.7:0/3130878564 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9e700666c0 0x7f9e70068b80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9e900c5020 tx=0x7f9e7c00d040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:16.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.066+0000 7f9e87e00640 1 -- 172.21.15.7:0/3130878564 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9e90163e70 con 0x7f9e9006cd70 2024-09-13T15:10:16.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.538+0000 7f9e95600640 1 -- 172.21.15.7:0/3130878564 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e90163e70 con 0x7f9e9006cd70 2024-09-13T15:10:16.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.550+0000 7f9e87e00640 1 -- 172.21.15.7:0/3130878564 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+5545 (secure 0 0 0) 0x7f9e90163e70 con 0x7f9e9006cd70 2024-09-13T15:10:16.556 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:10:16.556 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:10:14.979329+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:10:16.556 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 35 2024-09-13T15:10:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.558+0000 7f9e95600640 1 -- 172.21.15.7:0/3130878564 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9e700666c0 msgr2=0x7f9e70068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.562+0000 7f9e95600640 1 --2- 172.21.15.7:0/3130878564 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9e700666c0 0x7f9e70068b80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9e900c5020 tx=0x7f9e7c00d040 comp rx=0 tx=0).stop 2024-09-13T15:10:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.562+0000 7f9e95600640 1 -- 172.21.15.7:0/3130878564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e9006cd70 msgr2=0x7f9e90164af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.562+0000 7f9e95600640 1 --2- 172.21.15.7:0/3130878564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e9006cd70 0x7f9e90164af0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000d830 tx=0x7f9e8000dcf0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.570+0000 7f9e95600640 1 -- 172.21.15.7:0/3130878564 shutdown_connections 2024-09-13T15:10:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.570+0000 7f9e95600640 1 --2- 172.21.15.7:0/3130878564 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9e700666c0 0x7f9e70068b80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.570+0000 7f9e95600640 1 --2- 172.21.15.7:0/3130878564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e900c5f40 0x7f9e900c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.570+0000 7f9e95600640 1 --2- 172.21.15.7:0/3130878564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e900c5b60 0x7f9e901f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.570+0000 7f9e95600640 1 --2- 172.21.15.7:0/3130878564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9e9006cd70 0x7f9e90164af0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.570+0000 7f9e95600640 1 -- 172.21.15.7:0/3130878564 >> 172.21.15.7:0/3130878564 conn(0x7f9e90065d40 msgr2=0x7f9e900ca020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:16.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.578+0000 7f9e95600640 1 -- 172.21.15.7:0/3130878564 shutdown_connections 2024-09-13T15:10:16.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:16.578+0000 7f9e95600640 1 -- 172.21.15.7:0/3130878564 wait complete. 2024-09-13T15:10:16.673 INFO:tasks.mds_thrash.fs.[cephfs]:mds.b has gained rank=3, replacing gid=4238 2024-09-13T15:10:16.674 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 1 secs before reviving mds.a 2024-09-13T15:10:17.674 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.a 2024-09-13T15:10:17.675 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T15:10:17.675 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T15:10:17.682 INFO:tasks.ceph.mds.a:Started 2024-09-13T15:10:17.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:18.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.022+0000 7fdb4a400640 1 Processor -- start 2024-09-13T15:10:18.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.022+0000 7fdb4a400640 1 -- start start 2024-09-13T15:10:18.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.022+0000 7fdb4a400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb44150fe0 0x7fdb440c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:18.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.022+0000 7fdb4a400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb440c20e0 con 0x7fdb441513c0 2024-09-13T15:10:18.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.022+0000 7fdb4a400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4406fd30 con 0x7fdb440c8780 2024-09-13T15:10:18.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.022+0000 7fdb4a400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4415af50 con 0x7fdb44150fe0 2024-09-13T15:10:18.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.026+0000 7fdb43400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb44150fe0 0x7fdb440c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:18.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.026+0000 7fdb43400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb44150fe0 0x7fdb440c6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:51928/0 (socket says 172.21.15.7:51928) 2024-09-13T15:10:18.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.026+0000 7fdb43e00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdb440c8780 0x7fdb4406f620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:37124/0 (socket says 172.21.15.7:37124) 2024-09-13T15:10:18.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.026+0000 7fdb43e00640 1 -- 172.21.15.7:0/4126952139 learned_addr learned my addr 172.21.15.7:0/4126952139 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:10:18.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.026+0000 7fdb42000640 1 -- 172.21.15.7:0/4126952139 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069688195 0 0) 0x7fdb4406fd30 con 0x7fdb440c8780 2024-09-13T15:10:18.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.026+0000 7fdb42000640 1 -- 172.21.15.7:0/4126952139 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb28003530 con 0x7fdb440c8780 2024-09-13T15:10:18.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.026+0000 7fdb43400640 1 -- 172.21.15.7:0/4126952139 >> v1:172.21.15.77:6789/0 conn(0x7fdb440c8780 legacy=0x7fdb4406f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:18.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.026+0000 7fdb43400640 1 -- 172.21.15.7:0/4126952139 >> v1:172.21.15.7:6789/0 conn(0x7fdb441513c0 legacy=0x7fdb4406ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:18.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.026+0000 7fdb43400640 1 -- 172.21.15.7:0/4126952139 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4415b230 con 0x7fdb44150fe0 2024-09-13T15:10:18.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.030+0000 7fdb43400640 1 --2- 172.21.15.7:0/4126952139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb44150fe0 0x7fdb440c6b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdb340097f0 tx=0x7fdb3401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2bbf42d784b35e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:18.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.030+0000 7fdb42000640 1 -- 172.21.15.7:0/4126952139 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb340ab600 con 0x7fdb44150fe0 2024-09-13T15:10:18.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.030+0000 7fdb42000640 1 -- 172.21.15.7:0/4126952139 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb340a7050 con 0x7fdb44150fe0 2024-09-13T15:10:18.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.030+0000 7fdb42000640 1 -- 172.21.15.7:0/4126952139 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb340ab980 con 0x7fdb44150fe0 2024-09-13T15:10:18.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.030+0000 7fdb4a400640 1 -- 172.21.15.7:0/4126952139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb44150fe0 msgr2=0x7fdb440c6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:18.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.030+0000 7fdb4a400640 1 --2- 172.21.15.7:0/4126952139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb44150fe0 0x7fdb440c6b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fdb340097f0 tx=0x7fdb3401c430 comp rx=0 tx=0).stop 2024-09-13T15:10:18.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.030+0000 7fdb4a400640 1 -- 172.21.15.7:0/4126952139 shutdown_connections 2024-09-13T15:10:18.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.030+0000 7fdb4a400640 1 --2- 172.21.15.7:0/4126952139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb44150fe0 0x7fdb440c6b10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:18.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.030+0000 7fdb4a400640 1 -- 172.21.15.7:0/4126952139 >> 172.21.15.7:0/4126952139 conn(0x7fdb44071730 msgr2=0x7fdb44071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:18.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.030+0000 7fdb4a400640 1 -- 172.21.15.7:0/4126952139 shutdown_connections 2024-09-13T15:10:18.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.030+0000 7fdb4a400640 1 -- 172.21.15.7:0/4126952139 wait complete. 2024-09-13T15:10:18.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.034+0000 7fdb4a400640 1 Processor -- start 2024-09-13T15:10:18.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.034+0000 7fdb4a400640 1 -- start start 2024-09-13T15:10:18.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.034+0000 7fdb4a400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb440c8780 0x7fdb4406b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:18.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.034+0000 7fdb4a400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb44150fe0 0x7fdb440c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:18.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.034+0000 7fdb4a400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb441513c0 0x7fdb440c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:18.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.034+0000 7fdb4a400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb441f2b10 con 0x7fdb441513c0 2024-09-13T15:10:18.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.034+0000 7fdb4a400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb440c4290 con 0x7fdb44150fe0 2024-09-13T15:10:18.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.034+0000 7fdb4a400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb440c4550 con 0x7fdb440c8780 2024-09-13T15:10:18.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.034+0000 7fdb43400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb440c8780 0x7fdb4406b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:18.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.034+0000 7fdb43400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb440c8780 0x7fdb4406b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:51930/0 (socket says 172.21.15.7:51930) 2024-09-13T15:10:18.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.034+0000 7fdb43400640 1 -- 172.21.15.7:0/3543681447 learned_addr learned my addr 172.21.15.7:0/3543681447 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:10:18.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.034+0000 7fdb43400640 1 -- 172.21.15.7:0/3543681447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb44150fe0 msgr2=0x7fdb440c5140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T15:10:18.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.034+0000 7fdb43400640 1 --2- 172.21.15.7:0/3543681447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb44150fe0 0x7fdb440c5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:18.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.038+0000 7fdb43400640 1 -- 172.21.15.7:0/3543681447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb441513c0 msgr2=0x7fdb440c5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:18.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.038+0000 7fdb43400640 1 --2- 172.21.15.7:0/3543681447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb441513c0 0x7fdb440c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:18.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.038+0000 7fdb43400640 1 -- 172.21.15.7:0/3543681447 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb34009420 con 0x7fdb440c8780 2024-09-13T15:10:18.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.038+0000 7fdb43400640 1 --2- 172.21.15.7:0/3543681447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb440c8780 0x7fdb4406b1e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdb3401a060 tx=0x7fdb3401ac70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:18.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.038+0000 7fdb3b400640 1 -- 172.21.15.7:0/3543681447 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb340bc070 con 0x7fdb440c8780 2024-09-13T15:10:18.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.038+0000 7fdb3b400640 1 -- 172.21.15.7:0/3543681447 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb340abe00 con 0x7fdb440c8780 2024-09-13T15:10:18.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.038+0000 7fdb4a400640 1 -- 172.21.15.7:0/3543681447 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb440c4830 con 0x7fdb440c8780 2024-09-13T15:10:18.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.038+0000 7fdb4a400640 1 -- 172.21.15.7:0/3543681447 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4414d450 con 0x7fdb440c8780 2024-09-13T15:10:18.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.038+0000 7fdb3b400640 1 -- 172.21.15.7:0/3543681447 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb340b7690 con 0x7fdb440c8780 2024-09-13T15:10:18.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.042+0000 7fdb3b400640 1 -- 172.21.15.7:0/3543681447 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdb340b77f0 con 0x7fdb440c8780 2024-09-13T15:10:18.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.046+0000 7fdb3b400640 1 --2- 172.21.15.7:0/3543681447 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdb24066790 0x7fdb24068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:18.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.046+0000 7fdb3b400640 1 -- 172.21.15.7:0/3543681447 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fdb3411e370 con 0x7fdb440c8780 2024-09-13T15:10:18.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.050+0000 7fdb4a400640 1 -- 172.21.15.7:0/3543681447 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1c005260 con 0x7fdb440c8780 2024-09-13T15:10:18.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.050+0000 7fdb42a00640 1 --2- 172.21.15.7:0/3543681447 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdb24066790 0x7fdb24068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:18.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.054+0000 7fdb42a00640 1 --2- 172.21.15.7:0/3543681447 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdb24066790 0x7fdb24068c50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdb30006fd0 tx=0x7fdb30006b40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:18.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.058+0000 7fdb3b400640 1 -- 172.21.15.7:0/3543681447 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdb340eb200 con 0x7fdb440c8780 2024-09-13T15:10:18.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.466+0000 7fdb4a400640 1 -- 172.21.15.7:0/3543681447 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb1c005a90 con 0x7fdb440c8780 2024-09-13T15:10:18.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.466+0000 7fdb3b400640 1 -- 172.21.15.7:0/3543681447 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+5545 (secure 0 0 0) 0x7fdb340b0070 con 0x7fdb440c8780 2024-09-13T15:10:18.480 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:10:18.480 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:10:14.979329+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:10:18.481 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 35 2024-09-13T15:10:18.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.482+0000 7fdb4a400640 1 -- 172.21.15.7:0/3543681447 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdb24066790 msgr2=0x7fdb24068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:18.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.482+0000 7fdb4a400640 1 --2- 172.21.15.7:0/3543681447 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdb24066790 0x7fdb24068c50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdb30006fd0 tx=0x7fdb30006b40 comp rx=0 tx=0).stop 2024-09-13T15:10:18.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.482+0000 7fdb4a400640 1 -- 172.21.15.7:0/3543681447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb440c8780 msgr2=0x7fdb4406b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:18.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.482+0000 7fdb4a400640 1 --2- 172.21.15.7:0/3543681447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb440c8780 0x7fdb4406b1e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdb3401a060 tx=0x7fdb3401ac70 comp rx=0 tx=0).stop 2024-09-13T15:10:18.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.482+0000 7fdb4a400640 1 -- 172.21.15.7:0/3543681447 shutdown_connections 2024-09-13T15:10:18.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.482+0000 7fdb4a400640 1 --2- 172.21.15.7:0/3543681447 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdb24066790 0x7fdb24068c50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:18.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.482+0000 7fdb4a400640 1 --2- 172.21.15.7:0/3543681447 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb441513c0 0x7fdb440c5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:18.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.482+0000 7fdb4a400640 1 --2- 172.21.15.7:0/3543681447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdb44150fe0 0x7fdb440c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:18.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.482+0000 7fdb4a400640 1 --2- 172.21.15.7:0/3543681447 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdb440c8780 0x7fdb4406b1e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:18.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.482+0000 7fdb4a400640 1 -- 172.21.15.7:0/3543681447 >> 172.21.15.7:0/3543681447 conn(0x7fdb44071730 msgr2=0x7fdb4406f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:18.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.482+0000 7fdb4a400640 1 -- 172.21.15.7:0/3543681447 shutdown_connections 2024-09-13T15:10:18.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:18.482+0000 7fdb4a400640 1 -- 172.21.15.7:0/3543681447 wait complete. 2024-09-13T15:10:18.569 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2024-09-13T15:10:19.282 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2024-09-13T15:10:20.570 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:10:20.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.862+0000 7f0e29000640 1 Processor -- start 2024-09-13T15:10:20.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.862+0000 7f0e29000640 1 -- start start 2024-09-13T15:10:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.866+0000 7f0e29000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e24066860 0x7f0e240c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.866+0000 7f0e29000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0e240c08a0 0x7f0e240c7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.866+0000 7f0e29000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f0e240c7ad0 0x7f0e24158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.866+0000 7f0e29000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e240c7ee0 con 0x7f0e240c7ad0 2024-09-13T15:10:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.866+0000 7f0e29000640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e24155130 con 0x7f0e240c08a0 2024-09-13T15:10:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.866+0000 7f0e29000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e24158720 con 0x7f0e24066860 2024-09-13T15:10:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.866+0000 7f0e21e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e24066860 0x7f0e240c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.866+0000 7f0e21e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e24066860 0x7f0e240c5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:59768/0 (socket says 172.21.15.7:59768) 2024-09-13T15:10:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.866+0000 7f0e21e00640 1 -- 172.21.15.7:0/265519906 learned_addr learned my addr 172.21.15.7:0/265519906 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:10:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.866+0000 7f0e21400640 1 --2- 172.21.15.7:0/265519906 >> v2:172.21.15.77:3300/0 conn(0x7f0e240c08a0 0x7f0e240c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.866+0000 7f0e21e00640 1 -- 172.21.15.7:0/265519906 >> v2:172.21.15.77:3300/0 conn(0x7f0e240c08a0 msgr2=0x7f0e240c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.866+0000 7f0e21e00640 1 --2- 172.21.15.7:0/265519906 >> v2:172.21.15.77:3300/0 conn(0x7f0e240c08a0 0x7f0e240c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.866+0000 7f0e21e00640 1 -- 172.21.15.7:0/265519906 >> v2:172.21.15.7:3300/0 conn(0x7f0e240c7ad0 msgr2=0x7f0e24158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:10:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.866+0000 7f0e21e00640 1 --2- 172.21.15.7:0/265519906 >> v2:172.21.15.7:3300/0 conn(0x7f0e240c7ad0 0x7f0e24158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.866+0000 7f0e21e00640 1 -- 172.21.15.7:0/265519906 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e241555e0 con 0x7f0e24066860 2024-09-13T15:10:20.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.878+0000 7f0e21e00640 1 --2- 172.21.15.7:0/265519906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e24066860 0x7f0e240c5cc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e240c8190 tx=0x7f0e1401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61487612335f033c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:20.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.882+0000 7f0e20a00640 1 -- 172.21.15.7:0/265519906 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e140aa610 con 0x7f0e24066860 2024-09-13T15:10:20.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.882+0000 7f0e20a00640 1 -- 172.21.15.7:0/265519906 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e140a6040 con 0x7f0e24066860 2024-09-13T15:10:20.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.882+0000 7f0e20a00640 1 -- 172.21.15.7:0/265519906 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e140aa990 con 0x7f0e24066860 2024-09-13T15:10:20.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.882+0000 7f0e29000640 1 -- 172.21.15.7:0/265519906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e24066860 msgr2=0x7f0e240c5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:20.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.882+0000 7f0e29000640 1 --2- 172.21.15.7:0/265519906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e24066860 0x7f0e240c5cc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0e240c8190 tx=0x7f0e1401c530 comp rx=0 tx=0).stop 2024-09-13T15:10:20.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.890+0000 7f0e29000640 1 -- 172.21.15.7:0/265519906 shutdown_connections 2024-09-13T15:10:20.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.890+0000 7f0e29000640 1 --2- 172.21.15.7:0/265519906 >> v2:172.21.15.7:3300/0 conn(0x7f0e240c7ad0 0x7f0e24158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.890+0000 7f0e29000640 1 --2- 172.21.15.7:0/265519906 >> v2:172.21.15.77:3300/0 conn(0x7f0e240c08a0 0x7f0e240c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.890+0000 7f0e29000640 1 --2- 172.21.15.7:0/265519906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e24066860 0x7f0e240c5cc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.890+0000 7f0e29000640 1 -- 172.21.15.7:0/265519906 >> 172.21.15.7:0/265519906 conn(0x7f0e24065d40 msgr2=0x7f0e24066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:20.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.894+0000 7f0e29000640 1 -- 172.21.15.7:0/265519906 shutdown_connections 2024-09-13T15:10:20.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.894+0000 7f0e29000640 1 -- 172.21.15.7:0/265519906 wait complete. 2024-09-13T15:10:20.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.898+0000 7f0e29000640 1 Processor -- start 2024-09-13T15:10:20.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.906+0000 7f0e29000640 1 -- start start 2024-09-13T15:10:20.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.906+0000 7f0e29000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e24066860 0x7f0e241415a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.906+0000 7f0e29000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e240c08a0 0x7f0e24157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.906+0000 7f0e29000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e240c7ad0 0x7f0e24157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.906+0000 7f0e29000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2416d760 con 0x7f0e240c08a0 2024-09-13T15:10:20.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.906+0000 7f0e29000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e24141ae0 con 0x7f0e24066860 2024-09-13T15:10:20.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.906+0000 7f0e29000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2416d4c0 con 0x7f0e240c7ad0 2024-09-13T15:10:20.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.910+0000 7f0e21400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e240c08a0 0x7f0e24157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:20.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.910+0000 7f0e21400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e240c08a0 0x7f0e24157340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50964/0 (socket says 172.21.15.7:50964) 2024-09-13T15:10:20.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.910+0000 7f0e21400640 1 -- 172.21.15.7:0/2886858673 learned_addr learned my addr 172.21.15.7:0/2886858673 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:10:20.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.914+0000 7f0e21e00640 1 --2- 172.21.15.7:0/2886858673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e24066860 0x7f0e241415a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:20.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.914+0000 7f0e22800640 1 --2- 172.21.15.7:0/2886858673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e240c7ad0 0x7f0e24157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:20.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.914+0000 7f0e21400640 1 -- 172.21.15.7:0/2886858673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e240c7ad0 msgr2=0x7f0e24157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:20.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.914+0000 7f0e21400640 1 --2- 172.21.15.7:0/2886858673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e240c7ad0 0x7f0e24157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.914+0000 7f0e21400640 1 -- 172.21.15.7:0/2886858673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e24066860 msgr2=0x7f0e241415a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:20.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.914+0000 7f0e21400640 1 --2- 172.21.15.7:0/2886858673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e24066860 0x7f0e241415a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:20.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.914+0000 7f0e21400640 1 -- 172.21.15.7:0/2886858673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e140094d0 con 0x7f0e240c08a0 2024-09-13T15:10:20.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.914+0000 7f0e22800640 1 --2- 172.21.15.7:0/2886858673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e240c7ad0 0x7f0e24157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:10:20.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.922+0000 7f0e21e00640 1 --2- 172.21.15.7:0/2886858673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e24066860 0x7f0e241415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:10:20.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.926+0000 7f0e21400640 1 --2- 172.21.15.7:0/2886858673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e240c08a0 0x7f0e24157340 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000e930 tx=0x7f0e1000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.926+0000 7f0e1a000640 1 -- 172.21.15.7:0/2886858673 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e10009690 con 0x7f0e240c08a0 2024-09-13T15:10:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.926+0000 7f0e1a000640 1 -- 172.21.15.7:0/2886858673 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1000ca00 con 0x7f0e240c08a0 2024-09-13T15:10:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.926+0000 7f0e1a000640 1 -- 172.21.15.7:0/2886858673 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1000cd70 con 0x7f0e240c08a0 2024-09-13T15:10:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.926+0000 7f0e29000640 1 -- 172.21.15.7:0/2886858673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e24148ca0 con 0x7f0e240c08a0 2024-09-13T15:10:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.930+0000 7f0e29000640 1 -- 172.21.15.7:0/2886858673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e24140da0 con 0x7f0e240c08a0 2024-09-13T15:10:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.930+0000 7f0e29000640 1 -- 172.21.15.7:0/2886858673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e24067650 con 0x7f0e240c08a0 2024-09-13T15:10:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.930+0000 7f0e1a000640 1 -- 172.21.15.7:0/2886858673 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0e10013470 con 0x7f0e240c08a0 2024-09-13T15:10:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.930+0000 7f0e1a000640 1 --2- 172.21.15.7:0/2886858673 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e040666e0 0x7f0e04068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:10:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.934+0000 7f0e1a000640 1 -- 172.21.15.7:0/2886858673 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f0e100847f0 con 0x7f0e240c08a0 2024-09-13T15:10:20.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.934+0000 7f0e21e00640 1 --2- 172.21.15.7:0/2886858673 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e040666e0 0x7f0e04068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:10:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.934+0000 7f0e21e00640 1 --2- 172.21.15.7:0/2886858673 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e040666e0 0x7f0e04068ba0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0e240c8190 tx=0x7f0e140a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:10:20.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:20.938+0000 7f0e1a000640 1 -- 172.21.15.7:0/2886858673 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0e10051780 con 0x7f0e240c08a0 2024-09-13T15:10:21.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:21.150+0000 7f0e29000640 1 -- 172.21.15.7:0/2886858673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e240cbc20 con 0x7f0e240c08a0 2024-09-13T15:10:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:21.150+0000 7f0e1a000640 1 -- 172.21.15.7:0/2886858673 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+6298 (secure 0 0 0) 0x7f0e10054da0 con 0x7f0e240c08a0 2024-09-13T15:10:21.154 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:10:21.154 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:10:14.979329+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:10:21.154 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 36 2024-09-13T15:10:21.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:21.154+0000 7f0e29000640 1 -- 172.21.15.7:0/2886858673 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e040666e0 msgr2=0x7f0e04068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:21.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:21.154+0000 7f0e29000640 1 --2- 172.21.15.7:0/2886858673 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e040666e0 0x7f0e04068ba0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0e240c8190 tx=0x7f0e140a7000 comp rx=0 tx=0).stop 2024-09-13T15:10:21.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:21.154+0000 7f0e29000640 1 -- 172.21.15.7:0/2886858673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e240c08a0 msgr2=0x7f0e24157340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:10:21.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:21.154+0000 7f0e29000640 1 --2- 172.21.15.7:0/2886858673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e240c08a0 0x7f0e24157340 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000e930 tx=0x7f0e1000edf0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:21.154+0000 7f0e29000640 1 -- 172.21.15.7:0/2886858673 shutdown_connections 2024-09-13T15:10:21.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:21.154+0000 7f0e29000640 1 --2- 172.21.15.7:0/2886858673 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0e040666e0 0x7f0e04068ba0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:21.154+0000 7f0e29000640 1 --2- 172.21.15.7:0/2886858673 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0e240c7ad0 0x7f0e24157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:21.154+0000 7f0e29000640 1 --2- 172.21.15.7:0/2886858673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0e240c08a0 0x7f0e24157340 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:21.154+0000 7f0e29000640 1 --2- 172.21.15.7:0/2886858673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e24066860 0x7f0e241415a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:10:21.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:21.154+0000 7f0e29000640 1 -- 172.21.15.7:0/2886858673 >> 172.21.15.7:0/2886858673 conn(0x7f0e24065d40 msgr2=0x7f0e240c5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:10:21.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:21.154+0000 7f0e29000640 1 -- 172.21.15.7:0/2886858673 shutdown_connections 2024-09-13T15:10:21.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:10:21.154+0000 7f0e29000640 1 -- 172.21.15.7:0/2886858673 wait complete. 2024-09-13T15:10:21.175 INFO:tasks.mds_thrash.fs.[cephfs]:mds.a reported in up:standby state 2024-09-13T15:10:21.176 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 54 secs before thrashing 2024-09-13T15:10:31.242 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:10:31.246 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:11:02.539 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:11:02.547 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:11:15.178 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:15.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.429+0000 7f71e8e00640 1 Processor -- start 2024-09-13T15:11:15.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.429+0000 7f71e8e00640 1 -- start start 2024-09-13T15:11:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.429+0000 7f71e8e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f71e406bc10 0x7f71e40c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.429+0000 7f71e8e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f71e40c20d0 0x7f71e40c7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.429+0000 7f71e8e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e4154f90 con 0x7f71e40c55d0 2024-09-13T15:11:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.429+0000 7f71e8e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e40c6490 con 0x7f71e40c20d0 2024-09-13T15:11:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.429+0000 7f71e8e00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e4155250 con 0x7f71e406bc10 2024-09-13T15:11:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.429+0000 7f71e1e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f71e40c55d0 0x7f71e40c69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52378/0 (socket says 172.21.15.7:52378) 2024-09-13T15:11:15.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.429+0000 7f71e1e00640 1 -- 172.21.15.7:0/1754761522 learned_addr learned my addr 172.21.15.7:0/1754761522 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:11:15.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.433+0000 7f71e2800640 1 --2- 172.21.15.7:0/1754761522 >> v2:172.21.15.7:3300/0 conn(0x7f71e40c20d0 0x7f71e40c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:15.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.433+0000 7f71e1400640 1 --2- 172.21.15.7:0/1754761522 >> v2:172.21.15.77:3300/0 conn(0x7f71e406bc10 0x7f71e40c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:15.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.433+0000 7f71e1400640 1 -- 172.21.15.7:0/1754761522 >> v2:172.21.15.7:3300/0 conn(0x7f71e40c20d0 msgr2=0x7f71e40c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:15.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.433+0000 7f71e1400640 1 --2- 172.21.15.7:0/1754761522 >> v2:172.21.15.7:3300/0 conn(0x7f71e40c20d0 0x7f71e40c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.433+0000 7f71e1400640 1 -- 172.21.15.7:0/1754761522 >> v1:172.21.15.7:6789/0 conn(0x7f71e40c55d0 legacy=0x7f71e40c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:15.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.433+0000 7f71e1400640 1 -- 172.21.15.7:0/1754761522 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e4155530 con 0x7f71e406bc10 2024-09-13T15:11:15.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.445+0000 7f71e1400640 1 --2- 172.21.15.7:0/1754761522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71e406bc10 0x7f71e40c5f50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f71e40c59b0 tx=0x7f71d401ea00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fc173a90c1c4242 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:15.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.445+0000 7f71e0a00640 1 -- 172.21.15.7:0/1754761522 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d40a7a50 con 0x7f71e406bc10 2024-09-13T15:11:15.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.445+0000 7f71e0a00640 1 -- 172.21.15.7:0/1754761522 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d40a7bb0 con 0x7f71e406bc10 2024-09-13T15:11:15.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.445+0000 7f71e0a00640 1 -- 172.21.15.7:0/1754761522 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d40af440 con 0x7f71e406bc10 2024-09-13T15:11:15.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.445+0000 7f71e8e00640 1 -- 172.21.15.7:0/1754761522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71e406bc10 msgr2=0x7f71e40c5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:15.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.445+0000 7f71e8e00640 1 --2- 172.21.15.7:0/1754761522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71e406bc10 0x7f71e40c5f50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f71e40c59b0 tx=0x7f71d401ea00 comp rx=0 tx=0).stop 2024-09-13T15:11:15.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.445+0000 7f71e8e00640 1 -- 172.21.15.7:0/1754761522 shutdown_connections 2024-09-13T15:11:15.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.445+0000 7f71e8e00640 1 --2- 172.21.15.7:0/1754761522 >> v2:172.21.15.7:3300/0 conn(0x7f71e40c20d0 0x7f71e40c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.445+0000 7f71e8e00640 1 --2- 172.21.15.7:0/1754761522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71e406bc10 0x7f71e40c5f50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.445+0000 7f71e8e00640 1 -- 172.21.15.7:0/1754761522 >> 172.21.15.7:0/1754761522 conn(0x7f71e406b0f0 msgr2=0x7f71e406b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:15.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.449+0000 7f71e8e00640 1 -- 172.21.15.7:0/1754761522 shutdown_connections 2024-09-13T15:11:15.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.449+0000 7f71e8e00640 1 -- 172.21.15.7:0/1754761522 wait complete. 2024-09-13T15:11:15.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.457+0000 7f71e8e00640 1 Processor -- start 2024-09-13T15:11:15.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.457+0000 7f71e8e00640 1 -- start start 2024-09-13T15:11:15.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.457+0000 7f71e8e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e406bc10 0x7f71e41eb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:15.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.457+0000 7f71e8e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71e40c20d0 0x7f71e41dfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:15.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.457+0000 7f71e8e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71e40c55d0 0x7f71e40c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:15.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.457+0000 7f71e8e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e41e01d0 con 0x7f71e406bc10 2024-09-13T15:11:15.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.457+0000 7f71e8e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e41db070 con 0x7f71e40c20d0 2024-09-13T15:11:15.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.457+0000 7f71e8e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e41db2c0 con 0x7f71e40c55d0 2024-09-13T15:11:15.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.457+0000 7f71e1400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71e40c20d0 0x7f71e41dfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:15.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.457+0000 7f71e1400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71e40c20d0 0x7f71e41dfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:50214/0 (socket says 172.21.15.7:50214) 2024-09-13T15:11:15.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.457+0000 7f71e1400640 1 -- 172.21.15.7:0/2006548770 learned_addr learned my addr 172.21.15.7:0/2006548770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:15.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.457+0000 7f71e1400640 1 -- 172.21.15.7:0/2006548770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71e40c55d0 msgr2=0x7f71e40c9f30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T15:11:15.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.457+0000 7f71e1400640 1 --2- 172.21.15.7:0/2006548770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71e40c55d0 0x7f71e40c9f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.457+0000 7f71e1400640 1 -- 172.21.15.7:0/2006548770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e406bc10 msgr2=0x7f71e41eb020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:11:15.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.457+0000 7f71e1400640 1 --2- 172.21.15.7:0/2006548770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e406bc10 0x7f71e41eb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.457+0000 7f71e1400640 1 -- 172.21.15.7:0/2006548770 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d400b6c0 con 0x7f71e40c20d0 2024-09-13T15:11:15.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.461+0000 7f71e1400640 1 --2- 172.21.15.7:0/2006548770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71e40c20d0 0x7f71e41dfc90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f71d401d0b0 tx=0x7f71d401b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:15.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.461+0000 7f71da000640 1 -- 172.21.15.7:0/2006548770 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d40b8640 con 0x7f71e40c20d0 2024-09-13T15:11:15.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.461+0000 7f71da000640 1 -- 172.21.15.7:0/2006548770 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d40b87a0 con 0x7f71e40c20d0 2024-09-13T15:11:15.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.461+0000 7f71da000640 1 -- 172.21.15.7:0/2006548770 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d40b8b50 con 0x7f71e40c20d0 2024-09-13T15:11:15.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.461+0000 7f71e8e00640 1 -- 172.21.15.7:0/2006548770 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e41db5a0 con 0x7f71e40c20d0 2024-09-13T15:11:15.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.461+0000 7f71e8e00640 1 -- 172.21.15.7:0/2006548770 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e41dbb60 con 0x7f71e40c20d0 2024-09-13T15:11:15.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.465+0000 7f71da000640 1 -- 172.21.15.7:0/2006548770 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f71d40b6070 con 0x7f71e40c20d0 2024-09-13T15:11:15.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.465+0000 7f71da000640 1 --2- 172.21.15.7:0/2006548770 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f71c0066760 0x7f71c0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:15.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.465+0000 7f71da000640 1 -- 172.21.15.7:0/2006548770 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f71d411f750 con 0x7f71e40c20d0 2024-09-13T15:11:15.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.469+0000 7f71e8e00640 1 -- 172.21.15.7:0/2006548770 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71bc005260 con 0x7f71e40c20d0 2024-09-13T15:11:15.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.469+0000 7f71e1e00640 1 --2- 172.21.15.7:0/2006548770 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f71c0066760 0x7f71c0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:15.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.469+0000 7f71e1e00640 1 --2- 172.21.15.7:0/2006548770 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f71c0066760 0x7f71c0068c20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00e1f0 tx=0x7f71cc001c20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:15.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.481+0000 7f71da000640 1 -- 172.21.15.7:0/2006548770 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f71d40ec700 con 0x7f71e40c20d0 2024-09-13T15:11:15.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.921+0000 7f71e8e00640 1 -- 172.21.15.7:0/2006548770 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71bc005a90 con 0x7f71e40c20d0 2024-09-13T15:11:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.949+0000 7f71da000640 1 -- 172.21.15.7:0/2006548770 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+6298 (secure 0 0 0) 0x7f71d40b4090 con 0x7f71e40c20d0 2024-09-13T15:11:15.956 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:11:15.956 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:10:14.979329+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:11:15.962 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 36 2024-09-13T15:11:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.973+0000 7f71e8e00640 1 -- 172.21.15.7:0/2006548770 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f71c0066760 msgr2=0x7f71c0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.973+0000 7f71e8e00640 1 --2- 172.21.15.7:0/2006548770 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f71c0066760 0x7f71c0068c20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00e1f0 tx=0x7f71cc001c20 comp rx=0 tx=0).stop 2024-09-13T15:11:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.973+0000 7f71e8e00640 1 -- 172.21.15.7:0/2006548770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71e40c20d0 msgr2=0x7f71e41dfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.973+0000 7f71e8e00640 1 --2- 172.21.15.7:0/2006548770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71e40c20d0 0x7f71e41dfc90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f71d401d0b0 tx=0x7f71d401b7a0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.973+0000 7f71e8e00640 1 -- 172.21.15.7:0/2006548770 shutdown_connections 2024-09-13T15:11:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.973+0000 7f71e8e00640 1 --2- 172.21.15.7:0/2006548770 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f71c0066760 0x7f71c0068c20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.973+0000 7f71e8e00640 1 --2- 172.21.15.7:0/2006548770 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f71e40c55d0 0x7f71e40c9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.973+0000 7f71e8e00640 1 --2- 172.21.15.7:0/2006548770 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f71e40c20d0 0x7f71e41dfc90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.973+0000 7f71e8e00640 1 --2- 172.21.15.7:0/2006548770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71e406bc10 0x7f71e41eb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.973+0000 7f71e8e00640 1 -- 172.21.15.7:0/2006548770 >> 172.21.15.7:0/2006548770 conn(0x7f71e406b0f0 msgr2=0x7f71e406cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.973+0000 7f71e8e00640 1 -- 172.21.15.7:0/2006548770 shutdown_connections 2024-09-13T15:11:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:15.973+0000 7f71e8e00640 1 -- 172.21.15.7:0/2006548770 wait complete. 2024-09-13T15:11:16.074 INFO:tasks.mds_thrash.fs.[cephfs]:thrashing max_mds: 5 -> 4 2024-09-13T15:11:16.074 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 4 2024-09-13T15:11:16.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.329+0000 7f5305c00640 1 Processor -- start 2024-09-13T15:11:16.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.329+0000 7f5305c00640 1 -- start start 2024-09-13T15:11:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.329+0000 7f5305c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f530006cf00 0x7f530014f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.329+0000 7f5305c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530006c360 con 0x7f53000cb390 2024-09-13T15:11:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.329+0000 7f5305c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53000c7870 con 0x7f53001593f0 2024-09-13T15:11:16.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.329+0000 7f5305c00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53000c7b50 con 0x7f530006cf00 2024-09-13T15:11:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.333+0000 7f5305200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f530006cf00 0x7f530014f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.333+0000 7f5305200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f530006cf00 0x7f530014f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:50224/0 (socket says 172.21.15.7:50224) 2024-09-13T15:11:16.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.333+0000 7f5305200640 1 -- 172.21.15.7:0/364752855 learned_addr learned my addr 172.21.15.7:0/364752855 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.333+0000 7f52fea00640 1 -- 172.21.15.7:0/364752855 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668182521 0 0) 0x7f53000c7870 con 0x7f53001593f0 2024-09-13T15:11:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.333+0000 7f52fea00640 1 -- 172.21.15.7:0/364752855 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e4003530 con 0x7f53001593f0 2024-09-13T15:11:16.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.333+0000 7f52fea00640 1 -- 172.21.15.7:0/364752855 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415122732 0 0) 0x7f530006c360 con 0x7f53000cb390 2024-09-13T15:11:16.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.333+0000 7f52fea00640 1 -- 172.21.15.7:0/364752855 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53000c7870 con 0x7f53000cb390 2024-09-13T15:11:16.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.333+0000 7f5305200640 1 -- 172.21.15.7:0/364752855 >> v1:172.21.15.77:6789/0 conn(0x7f53001593f0 legacy=0x7f53001597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:16.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.333+0000 7f5305200640 1 -- 172.21.15.7:0/364752855 >> v1:172.21.15.7:6789/0 conn(0x7f53000cb390 legacy=0x7f530006c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:16.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.333+0000 7f5305200640 1 -- 172.21.15.7:0/364752855 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53000c7e30 con 0x7f530006cf00 2024-09-13T15:11:16.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.341+0000 7f5305200640 1 --2- 172.21.15.7:0/364752855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f530006cf00 0x7f530014f910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f52f800d150 tx=0x7f52f80212a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7105d57aa7ef2116 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:16.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.341+0000 7f52fea00640 1 -- 172.21.15.7:0/364752855 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0001680 con 0x7f530006cf00 2024-09-13T15:11:16.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.341+0000 7f52fea00640 1 -- 172.21.15.7:0/364752855 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f80ad050 con 0x7f530006cf00 2024-09-13T15:11:16.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.341+0000 7f5305c00640 1 -- 172.21.15.7:0/364752855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f530006cf00 msgr2=0x7f530014f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:16.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.341+0000 7f52fea00640 1 -- 172.21.15.7:0/364752855 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0001680 con 0x7f530006cf00 2024-09-13T15:11:16.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.341+0000 7f5305c00640 1 --2- 172.21.15.7:0/364752855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f530006cf00 0x7f530014f910 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f52f800d150 tx=0x7f52f80212a0 comp rx=0 tx=0).stop 2024-09-13T15:11:16.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.349+0000 7f5305c00640 1 -- 172.21.15.7:0/364752855 shutdown_connections 2024-09-13T15:11:16.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.349+0000 7f5305c00640 1 --2- 172.21.15.7:0/364752855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f530006cf00 0x7f530014f910 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:16.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.349+0000 7f5305c00640 1 -- 172.21.15.7:0/364752855 >> 172.21.15.7:0/364752855 conn(0x7f53000c8390 msgr2=0x7f53000c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.353+0000 7f5305c00640 1 -- 172.21.15.7:0/364752855 shutdown_connections 2024-09-13T15:11:16.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.353+0000 7f5305c00640 1 -- 172.21.15.7:0/364752855 wait complete. 2024-09-13T15:11:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f5305c00640 1 Processor -- start 2024-09-13T15:11:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f5305c00640 1 -- start start 2024-09-13T15:11:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f5305c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f530006cf00 0x7f5300158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f5305c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53000cb390 0x7f53000c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f5305c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53001593f0 0x7f53001f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f5305c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530014c570 con 0x7f530006cf00 2024-09-13T15:11:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f5305c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53000c5ec0 con 0x7f53000cb390 2024-09-13T15:11:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f5305c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53000c4980 con 0x7f53001593f0 2024-09-13T15:11:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f5305200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53001593f0 0x7f53001f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f5305200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53001593f0 0x7f53001f64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:56214/0 (socket says 172.21.15.7:56214) 2024-09-13T15:11:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f5305200640 1 -- 172.21.15.7:0/1601607539 learned_addr learned my addr 172.21.15.7:0/1601607539 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:16.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f52ffe00640 1 --2- 172.21.15.7:0/1601607539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f530006cf00 0x7f5300158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f5305200640 1 -- 172.21.15.7:0/1601607539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53000cb390 msgr2=0x7f53000c98f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:11:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f5305200640 1 --2- 172.21.15.7:0/1601607539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53000cb390 0x7f53000c98f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f5305200640 1 -- 172.21.15.7:0/1601607539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f530006cf00 msgr2=0x7f5300158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:16.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f5305200640 1 --2- 172.21.15.7:0/1601607539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f530006cf00 0x7f5300158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f5305200640 1 -- 172.21.15.7:0/1601607539 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f800bd40 con 0x7f53001593f0 2024-09-13T15:11:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f52ffe00640 1 --2- 172.21.15.7:0/1601607539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f530006cf00 0x7f5300158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:16.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.357+0000 7f5305200640 1 --2- 172.21.15.7:0/1601607539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53001593f0 0x7f53001f64a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f52f80b4040 tx=0x7f52f801e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.361+0000 7f52f7e00640 1 -- 172.21.15.7:0/1601607539 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f8003db0 con 0x7f53001593f0 2024-09-13T15:11:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.361+0000 7f52f7e00640 1 -- 172.21.15.7:0/1601607539 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f8004040 con 0x7f53001593f0 2024-09-13T15:11:16.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.361+0000 7f52f7e00640 1 -- 172.21.15.7:0/1601607539 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f80043d0 con 0x7f53001593f0 2024-09-13T15:11:16.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.361+0000 7f5305c00640 1 -- 172.21.15.7:0/1601607539 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53000c4c30 con 0x7f53001593f0 2024-09-13T15:11:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.365+0000 7f5305c00640 1 -- 172.21.15.7:0/1601607539 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53000c5be0 con 0x7f53001593f0 2024-09-13T15:11:16.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.365+0000 7f5305c00640 1 -- 172.21.15.7:0/1601607539 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530006fa50 con 0x7f53001593f0 2024-09-13T15:11:16.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.369+0000 7f52f7e00640 1 -- 172.21.15.7:0/1601607539 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f52f80b8070 con 0x7f53001593f0 2024-09-13T15:11:16.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.373+0000 7f52f7e00640 1 --2- 172.21.15.7:0/1601607539 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f52e0066690 0x7f52e0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:16.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.373+0000 7f52f7e00640 1 -- 172.21.15.7:0/1601607539 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f52f8123200 con 0x7f53001593f0 2024-09-13T15:11:16.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.377+0000 7f52ffe00640 1 --2- 172.21.15.7:0/1601607539 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f52e0066690 0x7f52e0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:16.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.385+0000 7f52ffe00640 1 --2- 172.21.15.7:0/1601607539 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f52e0066690 0x7f52e0068b50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f52f0000fc0 tx=0x7f52f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:16.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.389+0000 7f52f7e00640 1 -- 172.21.15.7:0/1601607539 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f52f80f0240 con 0x7f53001593f0 2024-09-13T15:11:16.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.821+0000 7f5305c00640 1 -- 172.21.15.7:0/1601607539 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "4"} v 0) v1 -- 0x7f53001f61c0 con 0x7f53001593f0 2024-09-13T15:11:16.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.957+0000 7f52f7e00640 1 -- 172.21.15.7:0/1601607539 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "4"}]=0 v37) v1 ==== 105+0+0 (secure 0 0 0) 0x7f53001f61c0 con 0x7f53001593f0 2024-09-13T15:11:16.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.985+0000 7f5305c00640 1 -- 172.21.15.7:0/1601607539 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f52e0066690 msgr2=0x7f52e0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:16.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.985+0000 7f5305c00640 1 --2- 172.21.15.7:0/1601607539 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f52e0066690 0x7f52e0068b50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f52f0000fc0 tx=0x7f52f0009040 comp rx=0 tx=0).stop 2024-09-13T15:11:16.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.985+0000 7f5305c00640 1 -- 172.21.15.7:0/1601607539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53001593f0 msgr2=0x7f53001f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:16.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.985+0000 7f5305c00640 1 --2- 172.21.15.7:0/1601607539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53001593f0 0x7f53001f64a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f52f80b4040 tx=0x7f52f801e040 comp rx=0 tx=0).stop 2024-09-13T15:11:16.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.997+0000 7f5305c00640 1 -- 172.21.15.7:0/1601607539 shutdown_connections 2024-09-13T15:11:16.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.997+0000 7f5305c00640 1 --2- 172.21.15.7:0/1601607539 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f52e0066690 0x7f52e0068b50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:16.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.997+0000 7f5305c00640 1 --2- 172.21.15.7:0/1601607539 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f53001593f0 0x7f53001f64a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:16.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.997+0000 7f5305c00640 1 --2- 172.21.15.7:0/1601607539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53000cb390 0x7f53000c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:16.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.997+0000 7f5305c00640 1 --2- 172.21.15.7:0/1601607539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f530006cf00 0x7f5300158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:16.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:16.997+0000 7f5305c00640 1 -- 172.21.15.7:0/1601607539 >> 172.21.15.7:0/1601607539 conn(0x7f53000c8390 msgr2=0x7f53000c8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:17.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.001+0000 7f5305c00640 1 -- 172.21.15.7:0/1601607539 shutdown_connections 2024-09-13T15:11:17.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.001+0000 7f5305c00640 1 -- 172.21.15.7:0/1601607539 wait complete. 2024-09-13T15:11:17.057 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-09-13T15:11:17.058 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:17.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.317+0000 7fbaa8400640 1 Processor -- start 2024-09-13T15:11:17.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.317+0000 7fbaa8400640 1 -- start start 2024-09-13T15:11:17.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.317+0000 7fbaa8400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbaa00c5ab0 0x7fbaa006cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.317+0000 7fbaa5a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbaa00c5ab0 0x7fbaa006cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.317+0000 7fbaa5a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbaa00c5ab0 0x7fbaa006cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:50234/0 (socket says 172.21.15.7:50234) 2024-09-13T15:11:17.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.317+0000 7fbaa5a00640 1 -- 172.21.15.7:0/1523200878 learned_addr learned my addr 172.21.15.7:0/1523200878 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:17.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fbaa8400640 1 --2- 172.21.15.7:0/1523200878 >> v2:172.21.15.7:3300/0 conn(0x7fbaa00c5e90 0x7fbaa00c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fbaa8400640 1 -- 172.21.15.7:0/1523200878 --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa0161ab0 con 0x7fbaa00c6890 2024-09-13T15:11:17.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fbaa8400640 1 -- 172.21.15.7:0/1523200878 --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa0160f80 con 0x7fbaa00c5e90 2024-09-13T15:11:17.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fbaa6400640 1 --2- 172.21.15.7:0/1523200878 >> v2:172.21.15.7:3300/0 conn(0x7fbaa00c5e90 0x7fbaa00c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fbaa8400640 1 -- 172.21.15.7:0/1523200878 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa006dbc0 con 0x7fbaa00c5ab0 2024-09-13T15:11:17.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fba9fe00640 1 -- 172.21.15.7:0/1523200878 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714183901 0 0) 0x7fba8c001120 con 0x7fbaa00c6890 2024-09-13T15:11:17.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fba9fe00640 1 -- 172.21.15.7:0/1523200878 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba88003530 con 0x7fbaa00c6890 2024-09-13T15:11:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fba9fe00640 1 -- 172.21.15.7:0/1523200878 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3639329060 0 0) 0x7fba88003530 con 0x7fbaa00c6890 2024-09-13T15:11:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fba9fe00640 1 -- 172.21.15.7:0/1523200878 >> v2:172.21.15.77:3300/0 conn(0x7fbaa00c5ab0 msgr2=0x7fbaa006cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fba9fe00640 1 --2- 172.21.15.7:0/1523200878 >> v2:172.21.15.77:3300/0 conn(0x7fbaa00c5ab0 0x7fbaa006cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fba9fe00640 1 -- 172.21.15.7:0/1523200878 >> v2:172.21.15.7:3300/0 conn(0x7fbaa00c5e90 msgr2=0x7fbaa00c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:17.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fba9fe00640 1 --2- 172.21.15.7:0/1523200878 >> v2:172.21.15.7:3300/0 conn(0x7fbaa00c5e90 0x7fbaa00c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fba9fe00640 1 -- 172.21.15.7:0/1523200878 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa006d320 con 0x7fbaa00c6890 2024-09-13T15:11:17.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fba9fe00640 1 -- 172.21.15.7:0/1523200878 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7fba8c001810 con 0x7fbaa00c6890 2024-09-13T15:11:17.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fba9fe00640 1 -- 172.21.15.7:0/1523200878 >> v1:172.21.15.7:6789/0 conn(0x7fbaa00c6890 legacy=0x7fbaa01613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fba9fe00640 1 --2- 172.21.15.7:0/1523200878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba88003980 0x7fba88003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fba9fe00640 1 --2- 172.21.15.7:0/1523200878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba880047d0 0x7fba88004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fba9fe00640 1 --2- 172.21.15.7:0/1523200878 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba88005190 0x7fba8800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fba9fe00640 1 -- 172.21.15.7:0/1523200878 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa0160f80 con 0x7fba880047d0 2024-09-13T15:11:17.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fba9fe00640 1 -- 172.21.15.7:0/1523200878 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa006dbc0 con 0x7fba88003980 2024-09-13T15:11:17.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fba9fe00640 1 -- 172.21.15.7:0/1523200878 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8800bfe0 con 0x7fba88005190 2024-09-13T15:11:17.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.321+0000 7fbaa6400640 1 --2- 172.21.15.7:0/1523200878 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba88005190 0x7fba8800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.325+0000 7fbaa5a00640 1 --2- 172.21.15.7:0/1523200878 >> v2:172.21.15.77:3300/0 conn(0x7fbaa00c5ab0 0x7fbaa006cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:17.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.325+0000 7fbaa5000640 1 --2- 172.21.15.7:0/1523200878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba880047d0 0x7fba88004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.325+0000 7fbaa6400640 1 -- 172.21.15.7:0/1523200878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba88003980 msgr2=0x7fba88003da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:11:17.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.325+0000 7fbaa6400640 1 --2- 172.21.15.7:0/1523200878 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba88003980 0x7fba88003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.325+0000 7fbaa6400640 1 -- 172.21.15.7:0/1523200878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba880047d0 msgr2=0x7fba88004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:17.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.325+0000 7fbaa6400640 1 --2- 172.21.15.7:0/1523200878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba880047d0 0x7fba88004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.325+0000 7fbaa6400640 1 -- 172.21.15.7:0/1523200878 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba88003530 con 0x7fba88005190 2024-09-13T15:11:17.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.349+0000 7fbaa6400640 1 -- 172.21.15.7:0/1523200878 reap_dead start 2024-09-13T15:11:17.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.353+0000 7fbaa6400640 1 --2- 172.21.15.7:0/1523200878 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba88005190 0x7fba8800b990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00c5700 tx=0x7fba9801cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e7c7dad844d842b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:17.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.357+0000 7fba9fe00640 1 -- 172.21.15.7:0/1523200878 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba980a5c70 con 0x7fba88005190 2024-09-13T15:11:17.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.357+0000 7fba9fe00640 1 -- 172.21.15.7:0/1523200878 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9800f040 con 0x7fba88005190 2024-09-13T15:11:17.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.357+0000 7fba9fe00640 1 -- 172.21.15.7:0/1523200878 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba980ad440 con 0x7fba88005190 2024-09-13T15:11:17.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.361+0000 7fbaa8400640 1 -- 172.21.15.7:0/1523200878 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba88005190 msgr2=0x7fba8800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.361+0000 7fbaa8400640 1 --2- 172.21.15.7:0/1523200878 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba88005190 0x7fba8800b990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00c5700 tx=0x7fba9801cc60 comp rx=0 tx=0).stop 2024-09-13T15:11:17.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.369+0000 7fbaa8400640 1 -- 172.21.15.7:0/1523200878 shutdown_connections 2024-09-13T15:11:17.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.369+0000 7fbaa8400640 1 --2- 172.21.15.7:0/1523200878 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fba88005190 0x7fba8800b990 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.369+0000 7fbaa8400640 1 -- 172.21.15.7:0/1523200878 >> 172.21.15.7:0/1523200878 conn(0x7fbaa0065d40 msgr2=0x7fbaa0066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:17.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.377+0000 7fbaa8400640 1 -- 172.21.15.7:0/1523200878 shutdown_connections 2024-09-13T15:11:17.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.377+0000 7fbaa8400640 1 -- 172.21.15.7:0/1523200878 wait complete. 2024-09-13T15:11:17.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.377+0000 7fbaa8400640 1 Processor -- start 2024-09-13T15:11:17.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.385+0000 7fbaa8400640 1 -- start start 2024-09-13T15:11:17.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.389+0000 7fbaa8400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba88005190 0x7fbaa00c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.389+0000 7fbaa8400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaa012bfb0 0x7fbaa00caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.389+0000 7fbaa8400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa00c9340 0x7fbaa00cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.389+0000 7fbaa8400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa01fec40 con 0x7fba88005190 2024-09-13T15:11:17.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.389+0000 7fbaa8400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa01fe390 con 0x7fbaa00c9340 2024-09-13T15:11:17.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.389+0000 7fbaa8400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00c25e0 con 0x7fbaa012bfb0 2024-09-13T15:11:17.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.389+0000 7fbaa6400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa00c9340 0x7fbaa00cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.389+0000 7fbaa6400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa00c9340 0x7fbaa00cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:50250/0 (socket says 172.21.15.7:50250) 2024-09-13T15:11:17.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.389+0000 7fbaa6400640 1 -- 172.21.15.7:0/424233025 learned_addr learned my addr 172.21.15.7:0/424233025 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:17.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.389+0000 7fbaa5a00640 1 --2- 172.21.15.7:0/424233025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba88005190 0x7fbaa00c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.389+0000 7fbaa5000640 1 --2- 172.21.15.7:0/424233025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaa012bfb0 0x7fbaa00caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.389+0000 7fbaa6400640 1 -- 172.21.15.7:0/424233025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaa012bfb0 msgr2=0x7fbaa00caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.389+0000 7fbaa6400640 1 --2- 172.21.15.7:0/424233025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaa012bfb0 0x7fbaa00caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.389+0000 7fbaa6400640 1 -- 172.21.15.7:0/424233025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba88005190 msgr2=0x7fbaa00c2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.389+0000 7fbaa6400640 1 --2- 172.21.15.7:0/424233025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba88005190 0x7fbaa00c2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.389+0000 7fbaa6400640 1 -- 172.21.15.7:0/424233025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa00c2880 con 0x7fbaa00c9340 2024-09-13T15:11:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.393+0000 7fbaa6400640 1 --2- 172.21.15.7:0/424233025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa00c9340 0x7fbaa00cb4b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fba98000f90 tx=0x7fba88005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.393+0000 7fba9d600640 1 -- 172.21.15.7:0/424233025 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba980adb80 con 0x7fbaa00c9340 2024-09-13T15:11:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.393+0000 7fba9d600640 1 -- 172.21.15.7:0/424233025 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba980adce0 con 0x7fbaa00c9340 2024-09-13T15:11:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.393+0000 7fba9d600640 1 -- 172.21.15.7:0/424233025 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba980b7620 con 0x7fbaa00c9340 2024-09-13T15:11:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.397+0000 7fbaa8400640 1 -- 172.21.15.7:0/424233025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa01fe5f0 con 0x7fbaa00c9340 2024-09-13T15:11:17.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.397+0000 7fbaa8400640 1 -- 172.21.15.7:0/424233025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa00c3180 con 0x7fbaa00c9340 2024-09-13T15:11:17.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.401+0000 7fbaa8400640 1 -- 172.21.15.7:0/424233025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa0067650 con 0x7fbaa00c9340 2024-09-13T15:11:17.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.401+0000 7fba9d600640 1 -- 172.21.15.7:0/424233025 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fba980b7780 con 0x7fbaa00c9340 2024-09-13T15:11:17.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.409+0000 7fba9d600640 1 --2- 172.21.15.7:0/424233025 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fba80066760 0x7fba80068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:17.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.409+0000 7fba9d600640 1 -- 172.21.15.7:0/424233025 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fba9811fbb0 con 0x7fbaa00c9340 2024-09-13T15:11:17.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.409+0000 7fbaa5a00640 1 --2- 172.21.15.7:0/424233025 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fba80066760 0x7fba80068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:17.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.409+0000 7fbaa5a00640 1 --2- 172.21.15.7:0/424233025 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fba80066760 0x7fba80068c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fba94006b20 tx=0x7fba94008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:17.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.425+0000 7fba9d600640 1 -- 172.21.15.7:0/424233025 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fba980ecca0 con 0x7fbaa00c9340 2024-09-13T15:11:17.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.841+0000 7fbaa8400640 1 -- 172.21.15.7:0/424233025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbaa006cce0 con 0x7fbaa00c9340 2024-09-13T15:11:17.845 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:11:17.846 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:11:16.960861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:stopping","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:11:17.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.845+0000 7fba9d600640 1 -- 172.21.15.7:0/424233025 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+6300 (secure 0 0 0) 0x7fba980f02c0 con 0x7fbaa00c9340 2024-09-13T15:11:17.846 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 38 2024-09-13T15:11:17.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.853+0000 7fbaa8400640 1 -- 172.21.15.7:0/424233025 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fba80066760 msgr2=0x7fba80068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.853+0000 7fbaa8400640 1 --2- 172.21.15.7:0/424233025 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fba80066760 0x7fba80068c20 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fba94006b20 tx=0x7fba94008040 comp rx=0 tx=0).stop 2024-09-13T15:11:17.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.853+0000 7fbaa8400640 1 -- 172.21.15.7:0/424233025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa00c9340 msgr2=0x7fbaa00cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:17.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.853+0000 7fbaa8400640 1 --2- 172.21.15.7:0/424233025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa00c9340 0x7fbaa00cb4b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fba98000f90 tx=0x7fba88005800 comp rx=0 tx=0).stop 2024-09-13T15:11:17.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.853+0000 7fbaa8400640 1 -- 172.21.15.7:0/424233025 shutdown_connections 2024-09-13T15:11:17.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.853+0000 7fbaa8400640 1 --2- 172.21.15.7:0/424233025 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fba80066760 0x7fba80068c20 secure :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fba94006b20 tx=0x7fba94008040 comp rx=0 tx=0).stop 2024-09-13T15:11:17.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.853+0000 7fbaa8400640 1 --2- 172.21.15.7:0/424233025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbaa00c9340 0x7fbaa00cb4b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.853+0000 7fbaa8400640 1 --2- 172.21.15.7:0/424233025 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbaa012bfb0 0x7fbaa00caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.853+0000 7fbaa8400640 1 --2- 172.21.15.7:0/424233025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fba88005190 0x7fbaa00c2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:17.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.853+0000 7fbaa8400640 1 -- 172.21.15.7:0/424233025 >> 172.21.15.7:0/424233025 conn(0x7fbaa0065d40 msgr2=0x7fbaa0155530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:17.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.853+0000 7fbaa8400640 1 -- 172.21.15.7:0/424233025 shutdown_connections 2024-09-13T15:11:17.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:17.853+0000 7fbaa8400640 1 -- 172.21.15.7:0/424233025 wait complete. 2024-09-13T15:11:17.906 INFO:tasks.mds_thrash.fs.[cephfs]:cluster is considered unstable while MDS are in up:stopping (!thrash_while_stopping) 2024-09-13T15:11:17.908 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 38, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-13T15:01:44.789559+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 38, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3, 4 ], "info": { "gid_4252": { "addr": "172.21.15.77:6835/2367107997", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6834", "nonce": 2367107997, "type": "v2" }, { "addr": "172.21.15.77:6835", "nonce": 2367107997, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4252, "incarnation": 13, "join_fscid": -1, "name": "d", "rank": 2, "state": "up:active", "state_seq": 43 }, "gid_4267": { "addr": "172.21.15.77:6839/2233000674", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6837", "nonce": 2233000674, "type": "v2" }, { "addr": "172.21.15.77:6839", "nonce": 2233000674, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4267, "incarnation": 9, "join_fscid": -1, "name": "f", "rank": 1, "state": "up:active", "state_seq": 41 }, "gid_4276": { "addr": "172.21.15.7:6836/2396967179", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6834", "nonce": 2396967179, "type": "v2" }, { "addr": "172.21.15.7:6836", "nonce": 2396967179, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4276, "incarnation": 4, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_5069": { "addr": "172.21.15.77:6838/877425259", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6836", "nonce": 877425259, "type": "v2" }, { "addr": "172.21.15.77:6838", "nonce": 877425259, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5069, "incarnation": 31, "join_fscid": -1, "name": "b", "rank": 3, "state": "up:active", "state_seq": 43 }, "gid_5230": { "addr": "172.21.15.7:6833/2896136827", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6832", "nonce": 2896136827, "type": "v2" }, { "addr": "172.21.15.7:6833", "nonce": 2896136827, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5230, "incarnation": 25, "join_fscid": -1, "name": "e", "rank": 4, "state": "up:stopping", "state_seq": 34 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 4, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-13T15:11:16.960861+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4276, "mds_1": 4267, "mds_2": 4252, "mds_3": 5069, "mds_4": 5230 } } } ], "standbys": [ { "addr": "172.21.15.7:6837/3708232086", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6835", "nonce": 3708232086, "type": "v2" }, { "addr": "172.21.15.7:6837", "nonce": 3708232086, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 36, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5156, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-13T15:11:19.909 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:20.269+0000 7f03f7e00640 1 Processor -- start 2024-09-13T15:11:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:20.269+0000 7f03f7e00640 1 -- start start 2024-09-13T15:11:21.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:20.273+0000 7f03f7e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f03f00f5f90 0x7f03f00065a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:20.273+0000 7f03f7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03f004c320 0x7f03f0006ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:20.273+0000 7f03f7e00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f004aa90 con 0x7f03f00f6370 2024-09-13T15:11:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:20.273+0000 7f03f7e00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f004b050 con 0x7f03f00f5f90 2024-09-13T15:11:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:20.273+0000 7f03f7e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f0006180 con 0x7f03f004c320 2024-09-13T15:11:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:20.273+0000 7f03f6a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f03f00f5f90 0x7f03f00065a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:20.273+0000 7f03f6000640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f03f00f6370 0x7f03f00ff740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:40450/0 (socket says 172.21.15.7:40450) 2024-09-13T15:11:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:20.273+0000 7f03f6000640 1 -- 172.21.15.7:0/4029123851 learned_addr learned my addr 172.21.15.7:0/4029123851 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:11:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:20.273+0000 7f03fdc00640 1 --2- 172.21.15.7:0/4029123851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03f004c320 0x7f03f0006ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:20.273+0000 7f03f5600640 1 -- 172.21.15.7:0/4029123851 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479867783 0 0) 0x7f03f004aa90 con 0x7f03f00f6370 2024-09-13T15:11:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.297+0000 7f03f5600640 1 -- 172.21.15.7:0/4029123851 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03dc005740 con 0x7f03f00f6370 2024-09-13T15:11:21.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.297+0000 7f03f5600640 1 -- 172.21.15.7:0/4029123851 <== mon.1 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1245782304 0 0) 0x7f03dc005740 con 0x7f03f00f6370 2024-09-13T15:11:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.297+0000 7f03fdc00640 1 -- 172.21.15.7:0/4029123851 >> v2:172.21.15.77:3300/0 conn(0x7f03f00f5f90 msgr2=0x7f03f00065a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.297+0000 7f03fdc00640 1 --2- 172.21.15.7:0/4029123851 >> v2:172.21.15.77:3300/0 conn(0x7f03f00f5f90 0x7f03f00065a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.297+0000 7f03fdc00640 1 -- 172.21.15.7:0/4029123851 >> v1:172.21.15.77:6789/0 conn(0x7f03f00f6370 legacy=0x7f03f00ff740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.297+0000 7f03fdc00640 1 -- 172.21.15.7:0/4029123851 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f004ad70 con 0x7f03f004c320 2024-09-13T15:11:21.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.297+0000 7f03f6a00640 1 --2- 172.21.15.7:0/4029123851 >> v2:172.21.15.77:3300/0 conn(0x7f03f00f5f90 0x7f03f00065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:21.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.301+0000 7f03fdc00640 1 --2- 172.21.15.7:0/4029123851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03f004c320 0x7f03f0006ae0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f03f8063c00 tx=0x7f03f8086570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8370be62b005c257 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:21.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.301+0000 7f03f5600640 1 -- 172.21.15.7:0/4029123851 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f806e030 con 0x7f03f004c320 2024-09-13T15:11:21.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.301+0000 7f03f5600640 1 -- 172.21.15.7:0/4029123851 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f8111050 con 0x7f03f004c320 2024-09-13T15:11:21.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.301+0000 7f03f5600640 1 -- 172.21.15.7:0/4029123851 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f810eea0 con 0x7f03f004c320 2024-09-13T15:11:21.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.305+0000 7f03f7e00640 1 -- 172.21.15.7:0/4029123851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03f004c320 msgr2=0x7f03f0006ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.305+0000 7f03f7e00640 1 --2- 172.21.15.7:0/4029123851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03f004c320 0x7f03f0006ae0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f03f8063c00 tx=0x7f03f8086570 comp rx=0 tx=0).stop 2024-09-13T15:11:21.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.305+0000 7f03f7e00640 1 -- 172.21.15.7:0/4029123851 shutdown_connections 2024-09-13T15:11:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.305+0000 7f03f7e00640 1 --2- 172.21.15.7:0/4029123851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03f004c320 0x7f03f0006ae0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.305+0000 7f03f7e00640 1 --2- 172.21.15.7:0/4029123851 >> v2:172.21.15.77:3300/0 conn(0x7f03f00f5f90 0x7f03f00065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.305+0000 7f03f7e00640 1 -- 172.21.15.7:0/4029123851 >> 172.21.15.7:0/4029123851 conn(0x7f03f004fe00 msgr2=0x7f03f0050210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:21.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.309+0000 7f03f7e00640 1 -- 172.21.15.7:0/4029123851 shutdown_connections 2024-09-13T15:11:21.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.309+0000 7f03f7e00640 1 -- 172.21.15.7:0/4029123851 wait complete. 2024-09-13T15:11:21.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.313+0000 7f03f7e00640 1 Processor -- start 2024-09-13T15:11:21.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.329+0000 7f03f7e00640 1 -- start start 2024-09-13T15:11:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.329+0000 7f03f7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03f004c320 0x7f03f0034730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.329+0000 7f03f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03f00f5f90 0x7f03f01a5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.329+0000 7f03f7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03f00f6370 0x7f03f00f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.329+0000 7f03f7e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00eed50 con 0x7f03f00f5f90 2024-09-13T15:11:21.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.329+0000 7f03f7e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00ef030 con 0x7f03f004c320 2024-09-13T15:11:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.329+0000 7f03f7e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00ef310 con 0x7f03f00f6370 2024-09-13T15:11:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.333+0000 7f03fdc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03f00f6370 0x7f03f00f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:21.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.333+0000 7f03fdc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03f00f6370 0x7f03f00f3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:55644/0 (socket says 172.21.15.7:55644) 2024-09-13T15:11:21.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.333+0000 7f03fdc00640 1 -- 172.21.15.7:0/664239874 learned_addr learned my addr 172.21.15.7:0/664239874 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.333+0000 7f03f6a00640 1 --2- 172.21.15.7:0/664239874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03f004c320 0x7f03f0034730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.333+0000 7f03fdc00640 1 -- 172.21.15.7:0/664239874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03f004c320 msgr2=0x7f03f0034730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.333+0000 7f03fdc00640 1 --2- 172.21.15.7:0/664239874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03f004c320 0x7f03f0034730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.333+0000 7f03fdc00640 1 -- 172.21.15.7:0/664239874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03f00f5f90 msgr2=0x7f03f01a5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.333+0000 7f03fdc00640 1 --2- 172.21.15.7:0/664239874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03f00f5f90 0x7f03f01a5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.333+0000 7f03fdc00640 1 -- 172.21.15.7:0/664239874 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f8074490 con 0x7f03f00f6370 2024-09-13T15:11:21.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.337+0000 7f03fdc00640 1 --2- 172.21.15.7:0/664239874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03f00f6370 0x7f03f00f3a20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f03f8075600 tx=0x7f03f80833b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:21.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.341+0000 7f03eea00640 1 -- 172.21.15.7:0/664239874 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f8126070 con 0x7f03f00f6370 2024-09-13T15:11:21.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.341+0000 7f03eea00640 1 -- 172.21.15.7:0/664239874 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f810eea0 con 0x7f03f00f6370 2024-09-13T15:11:21.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.341+0000 7f03eea00640 1 -- 172.21.15.7:0/664239874 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f806e040 con 0x7f03f00f6370 2024-09-13T15:11:21.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.341+0000 7f03f7e00640 1 -- 172.21.15.7:0/664239874 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f00fe810 con 0x7f03f00f6370 2024-09-13T15:11:21.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.341+0000 7f03f7e00640 1 -- 172.21.15.7:0/664239874 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f00fe520 con 0x7f03f00f6370 2024-09-13T15:11:21.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.341+0000 7f03f7e00640 1 -- 172.21.15.7:0/664239874 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f00fed30 con 0x7f03f00f6370 2024-09-13T15:11:21.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.349+0000 7f03eea00640 1 -- 172.21.15.7:0/664239874 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f03f811c040 con 0x7f03f00f6370 2024-09-13T15:11:21.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.349+0000 7f03eea00640 1 --2- 172.21.15.7:0/664239874 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f03d8066710 0x7f03d8068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:21.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.349+0000 7f03eea00640 1 -- 172.21.15.7:0/664239874 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f03f8159090 con 0x7f03f00f6370 2024-09-13T15:11:21.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.349+0000 7f03f6a00640 1 --2- 172.21.15.7:0/664239874 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f03d8066710 0x7f03d8068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:21.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.353+0000 7f03f6a00640 1 --2- 172.21.15.7:0/664239874 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f03d8066710 0x7f03d8068bd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f03e800a9b0 tx=0x7f03e800c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:21.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.361+0000 7f03eea00640 1 -- 172.21.15.7:0/664239874 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f03f8155460 con 0x7f03f00f6370 2024-09-13T15:11:21.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.873+0000 7f03f7e00640 1 -- 172.21.15.7:0/664239874 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03f00fed30 con 0x7f03f00f6370 2024-09-13T15:11:21.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.889+0000 7f03eea00640 1 -- 172.21.15.7:0/664239874 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+6300 (secure 0 0 0) 0x7f03f811a090 con 0x7f03f00f6370 2024-09-13T15:11:21.890 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:11:21.891 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:11:16.960861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:stopping","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:11:21.891 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 38 2024-09-13T15:11:21.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.901+0000 7f03f7e00640 1 -- 172.21.15.7:0/664239874 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f03d8066710 msgr2=0x7f03d8068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.901+0000 7f03f7e00640 1 --2- 172.21.15.7:0/664239874 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f03d8066710 0x7f03d8068bd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f03e800a9b0 tx=0x7f03e800c040 comp rx=0 tx=0).stop 2024-09-13T15:11:21.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.901+0000 7f03f7e00640 1 -- 172.21.15.7:0/664239874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03f00f6370 msgr2=0x7f03f00f3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:21.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.901+0000 7f03f7e00640 1 --2- 172.21.15.7:0/664239874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03f00f6370 0x7f03f00f3a20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f03f8075600 tx=0x7f03f80833b0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.901+0000 7f03f7e00640 1 -- 172.21.15.7:0/664239874 shutdown_connections 2024-09-13T15:11:21.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.901+0000 7f03f7e00640 1 --2- 172.21.15.7:0/664239874 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f03d8066710 0x7f03d8068bd0 secure :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f03e800a9b0 tx=0x7f03e800c040 comp rx=0 tx=0).stop 2024-09-13T15:11:21.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.901+0000 7f03f7e00640 1 --2- 172.21.15.7:0/664239874 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f03f00f6370 0x7f03f00f3a20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.901+0000 7f03f7e00640 1 --2- 172.21.15.7:0/664239874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03f00f5f90 0x7f03f01a5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.901+0000 7f03f7e00640 1 --2- 172.21.15.7:0/664239874 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03f004c320 0x7f03f0034730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:21.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.901+0000 7f03f7e00640 1 -- 172.21.15.7:0/664239874 >> 172.21.15.7:0/664239874 conn(0x7f03f004fe00 msgr2=0x7f03f00fb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:21.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.901+0000 7f03f7e00640 1 -- 172.21.15.7:0/664239874 shutdown_connections 2024-09-13T15:11:21.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:21.901+0000 7f03f7e00640 1 -- 172.21.15.7:0/664239874 wait complete. 2024-09-13T15:11:21.954 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:11:23.955 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:24.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.241+0000 7fcd4dc00640 1 Processor -- start 2024-09-13T15:11:24.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.241+0000 7fcd4dc00640 1 -- start start 2024-09-13T15:11:24.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.241+0000 7fcd4dc00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcd48066860 0x7fcd480c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.241+0000 7fcd4dc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd4814f350 0x7fcd48158b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.241+0000 7fcd4dc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd4806d920 con 0x7fcd480c1980 2024-09-13T15:11:24.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.241+0000 7fcd4dc00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd481593d0 con 0x7fcd48066860 2024-09-13T15:11:24.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.241+0000 7fcd4dc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480c68d0 con 0x7fcd4814f350 2024-09-13T15:11:24.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.241+0000 7fcd47e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcd480c1980 0x7fcd48158470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52984/0 (socket says 172.21.15.7:52984) 2024-09-13T15:11:24.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.241+0000 7fcd47e00640 1 -- 172.21.15.7:0/808201152 learned_addr learned my addr 172.21.15.7:0/808201152 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:11:24.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.241+0000 7fcd4d200640 1 --2- 172.21.15.7:0/808201152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd4814f350 0x7fcd48158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:24.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.241+0000 7fcd47400640 1 --2- 172.21.15.7:0/808201152 >> v2:172.21.15.77:3300/0 conn(0x7fcd48066860 0x7fcd480c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:24.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.245+0000 7fcd4d200640 1 -- 172.21.15.7:0/808201152 >> v2:172.21.15.77:3300/0 conn(0x7fcd48066860 msgr2=0x7fcd480c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:24.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.245+0000 7fcd4d200640 1 --2- 172.21.15.7:0/808201152 >> v2:172.21.15.77:3300/0 conn(0x7fcd48066860 0x7fcd480c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.245+0000 7fcd4d200640 1 -- 172.21.15.7:0/808201152 >> v1:172.21.15.7:6789/0 conn(0x7fcd480c1980 legacy=0x7fcd48158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:24.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.245+0000 7fcd4d200640 1 -- 172.21.15.7:0/808201152 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4806dc00 con 0x7fcd4814f350 2024-09-13T15:11:24.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.245+0000 7fcd47400640 1 --2- 172.21.15.7:0/808201152 >> v2:172.21.15.77:3300/0 conn(0x7fcd48066860 0x7fcd480c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:11:24.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.249+0000 7fcd4d200640 1 --2- 172.21.15.7:0/808201152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd4814f350 0x7fcd48158b80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009d90 tx=0x7fcd4001f120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db04459ffee07165 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:24.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.249+0000 7fcd46a00640 1 -- 172.21.15.7:0/808201152 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd400b0440 con 0x7fcd4814f350 2024-09-13T15:11:24.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.249+0000 7fcd46a00640 1 -- 172.21.15.7:0/808201152 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd400b05a0 con 0x7fcd4814f350 2024-09-13T15:11:24.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.249+0000 7fcd46a00640 1 -- 172.21.15.7:0/808201152 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd400b0930 con 0x7fcd4814f350 2024-09-13T15:11:24.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.253+0000 7fcd4dc00640 1 -- 172.21.15.7:0/808201152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd4814f350 msgr2=0x7fcd48158b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.253+0000 7fcd4dc00640 1 --2- 172.21.15.7:0/808201152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd4814f350 0x7fcd48158b80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcd40009d90 tx=0x7fcd4001f120 comp rx=0 tx=0).stop 2024-09-13T15:11:24.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.253+0000 7fcd4dc00640 1 -- 172.21.15.7:0/808201152 shutdown_connections 2024-09-13T15:11:24.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.253+0000 7fcd4dc00640 1 --2- 172.21.15.7:0/808201152 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd4814f350 0x7fcd48158b80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.253+0000 7fcd4dc00640 1 --2- 172.21.15.7:0/808201152 >> v2:172.21.15.77:3300/0 conn(0x7fcd48066860 0x7fcd480c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.253+0000 7fcd4dc00640 1 -- 172.21.15.7:0/808201152 >> 172.21.15.7:0/808201152 conn(0x7fcd48065d40 msgr2=0x7fcd48066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:24.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.253+0000 7fcd4dc00640 1 -- 172.21.15.7:0/808201152 shutdown_connections 2024-09-13T15:11:24.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.253+0000 7fcd4dc00640 1 -- 172.21.15.7:0/808201152 wait complete. 2024-09-13T15:11:24.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.261+0000 7fcd4dc00640 1 Processor -- start 2024-09-13T15:11:24.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.261+0000 7fcd4dc00640 1 -- start start 2024-09-13T15:11:24.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.265+0000 7fcd4dc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd48066860 0x7fcd481486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.265+0000 7fcd4dc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd480c1980 0x7fcd48149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.265+0000 7fcd4dc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd4814f350 0x7fcd480ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.265+0000 7fcd4dc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd48142d80 con 0x7fcd48066860 2024-09-13T15:11:24.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.265+0000 7fcd4dc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480c9a10 con 0x7fcd4814f350 2024-09-13T15:11:24.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.265+0000 7fcd4dc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd481476a0 con 0x7fcd480c1980 2024-09-13T15:11:24.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.265+0000 7fcd47400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd480c1980 0x7fcd48149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:24.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.265+0000 7fcd4d200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd4814f350 0x7fcd480ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:24.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.265+0000 7fcd47400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd480c1980 0x7fcd48149860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:55656/0 (socket says 172.21.15.7:55656) 2024-09-13T15:11:24.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.265+0000 7fcd47400640 1 -- 172.21.15.7:0/1180040989 learned_addr learned my addr 172.21.15.7:0/1180040989 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:24.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.265+0000 7fcd47400640 1 -- 172.21.15.7:0/1180040989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd4814f350 msgr2=0x7fcd480ca740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.265+0000 7fcd47400640 1 --2- 172.21.15.7:0/1180040989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd4814f350 0x7fcd480ca740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.265+0000 7fcd47400640 1 -- 172.21.15.7:0/1180040989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd48066860 msgr2=0x7fcd481486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.265+0000 7fcd47400640 1 --2- 172.21.15.7:0/1180040989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd48066860 0x7fcd481486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.265+0000 7fcd47400640 1 -- 172.21.15.7:0/1180040989 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd38009420 con 0x7fcd480c1980 2024-09-13T15:11:24.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.265+0000 7fcd4d200640 1 --2- 172.21.15.7:0/1180040989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd4814f350 0x7fcd480ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:24.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.269+0000 7fcd47400640 1 --2- 172.21.15.7:0/1180040989 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd480c1980 0x7fcd48149860 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800ebe0 tx=0x7fcd3800c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:24.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.273+0000 7fcd3fe00640 1 -- 172.21.15.7:0/1180040989 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3800eee0 con 0x7fcd480c1980 2024-09-13T15:11:24.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.273+0000 7fcd3fe00640 1 -- 172.21.15.7:0/1180040989 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3800cc30 con 0x7fcd480c1980 2024-09-13T15:11:24.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.273+0000 7fcd3fe00640 1 -- 172.21.15.7:0/1180040989 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38013470 con 0x7fcd480c1980 2024-09-13T15:11:24.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.277+0000 7fcd4dc00640 1 -- 172.21.15.7:0/1180040989 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd40009a70 con 0x7fcd480c1980 2024-09-13T15:11:24.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.277+0000 7fcd4dc00640 1 -- 172.21.15.7:0/1180040989 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd480c9c60 con 0x7fcd480c1980 2024-09-13T15:11:24.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.277+0000 7fcd4dc00640 1 -- 172.21.15.7:0/1180040989 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd480c66b0 con 0x7fcd480c1980 2024-09-13T15:11:24.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.281+0000 7fcd3fe00640 1 -- 172.21.15.7:0/1180040989 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcd380135d0 con 0x7fcd480c1980 2024-09-13T15:11:24.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.285+0000 7fcd3fe00640 1 --2- 172.21.15.7:0/1180040989 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcd240666e0 0x7fcd24068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:24.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.285+0000 7fcd3fe00640 1 -- 172.21.15.7:0/1180040989 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fcd38085150 con 0x7fcd480c1980 2024-09-13T15:11:24.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.289+0000 7fcd47e00640 1 --2- 172.21.15.7:0/1180040989 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcd240666e0 0x7fcd24068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:24.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.289+0000 7fcd3fe00640 1 -- 172.21.15.7:0/1180040989 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcd38051fe0 con 0x7fcd480c1980 2024-09-13T15:11:24.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.289+0000 7fcd47e00640 1 --2- 172.21.15.7:0/1180040989 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcd240666e0 0x7fcd24068ba0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcd30004fa0 tx=0x7fcd30007ab0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.809+0000 7fcd4dc00640 1 -- 172.21.15.7:0/1180040989 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd480c4de0 con 0x7fcd480c1980 2024-09-13T15:11:24.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.809+0000 7fcd3fe00640 1 -- 172.21.15.7:0/1180040989 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+6300 (secure 0 0 0) 0x7fcd38017090 con 0x7fcd480c1980 2024-09-13T15:11:24.811 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:11:24.811 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:11:16.960861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:stopping","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:11:24.811 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 38 2024-09-13T15:11:24.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.813+0000 7fcd4dc00640 1 -- 172.21.15.7:0/1180040989 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcd240666e0 msgr2=0x7fcd24068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.813+0000 7fcd4dc00640 1 --2- 172.21.15.7:0/1180040989 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcd240666e0 0x7fcd24068ba0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcd30004fa0 tx=0x7fcd30007ab0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.813+0000 7fcd4dc00640 1 -- 172.21.15.7:0/1180040989 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd480c1980 msgr2=0x7fcd48149860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:24.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.813+0000 7fcd4dc00640 1 --2- 172.21.15.7:0/1180040989 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd480c1980 0x7fcd48149860 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800ebe0 tx=0x7fcd3800c520 comp rx=0 tx=0).stop 2024-09-13T15:11:24.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.817+0000 7fcd4dc00640 1 -- 172.21.15.7:0/1180040989 shutdown_connections 2024-09-13T15:11:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.817+0000 7fcd4dc00640 1 --2- 172.21.15.7:0/1180040989 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcd240666e0 0x7fcd24068ba0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.817+0000 7fcd4dc00640 1 --2- 172.21.15.7:0/1180040989 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd4814f350 0x7fcd480ca740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.817+0000 7fcd4dc00640 1 --2- 172.21.15.7:0/1180040989 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcd480c1980 0x7fcd48149860 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.817+0000 7fcd4dc00640 1 --2- 172.21.15.7:0/1180040989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcd48066860 0x7fcd481486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:24.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.817+0000 7fcd4dc00640 1 -- 172.21.15.7:0/1180040989 >> 172.21.15.7:0/1180040989 conn(0x7fcd48065d40 msgr2=0x7fcd4806fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.817+0000 7fcd4dc00640 1 -- 172.21.15.7:0/1180040989 shutdown_connections 2024-09-13T15:11:24.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:24.817+0000 7fcd4dc00640 1 -- 172.21.15.7:0/1180040989 wait complete. 2024-09-13T15:11:24.862 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:11:26.863 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:27.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.133+0000 7ffa51600640 1 Processor -- start 2024-09-13T15:11:27.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.133+0000 7ffa51600640 1 -- start start 2024-09-13T15:11:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.137+0000 7ffa51600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffa4c0c08a0 0x7ffa4c0c7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.137+0000 7ffa51600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffa4c0c7ad0 0x7ffa4c158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.137+0000 7ffa51600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4c158720 con 0x7ffa4c066860 2024-09-13T15:11:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.137+0000 7ffa51600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa4c155130 con 0x7ffa4c0c08a0 2024-09-13T15:11:27.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.137+0000 7ffa51600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa4c1555e0 con 0x7ffa4c0c7ad0 2024-09-13T15:11:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.141+0000 7ffa4aa00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ffa4c066860 0x7ffa4c0c5cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:40462/0 (socket says 172.21.15.7:40462) 2024-09-13T15:11:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.141+0000 7ffa4aa00640 1 -- 172.21.15.7:0/37748433 learned_addr learned my addr 172.21.15.7:0/37748433 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:11:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.141+0000 7ffa4a000640 1 --2- 172.21.15.7:0/37748433 >> v2:172.21.15.7:3300/0 conn(0x7ffa4c0c08a0 0x7ffa4c0c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.141+0000 7ffa4b400640 1 --2- 172.21.15.7:0/37748433 >> v2:172.21.15.77:3300/0 conn(0x7ffa4c0c7ad0 0x7ffa4c158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.141+0000 7ffa49600640 1 -- 172.21.15.7:0/37748433 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071327046 0 0) 0x7ffa4c158720 con 0x7ffa4c066860 2024-09-13T15:11:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.141+0000 7ffa49600640 1 -- 172.21.15.7:0/37748433 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa30003530 con 0x7ffa4c066860 2024-09-13T15:11:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.141+0000 7ffa4a000640 1 -- 172.21.15.7:0/37748433 >> v2:172.21.15.77:3300/0 conn(0x7ffa4c0c7ad0 msgr2=0x7ffa4c158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.141+0000 7ffa4a000640 1 --2- 172.21.15.7:0/37748433 >> v2:172.21.15.77:3300/0 conn(0x7ffa4c0c7ad0 0x7ffa4c158bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.141+0000 7ffa4a000640 1 -- 172.21.15.7:0/37748433 >> v1:172.21.15.77:6789/0 conn(0x7ffa4c066860 legacy=0x7ffa4c0c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:27.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.141+0000 7ffa4a000640 1 -- 172.21.15.7:0/37748433 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c1558c0 con 0x7ffa4c0c08a0 2024-09-13T15:11:27.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.145+0000 7ffa4a000640 1 --2- 172.21.15.7:0/37748433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa4c0c08a0 0x7ffa4c0c7590 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c070a60 tx=0x7ffa4401f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4251451541d901b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:27.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.145+0000 7ffa49600640 1 -- 172.21.15.7:0/37748433 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa440af600 con 0x7ffa4c0c08a0 2024-09-13T15:11:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.149+0000 7ffa49600640 1 -- 172.21.15.7:0/37748433 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa440ab050 con 0x7ffa4c0c08a0 2024-09-13T15:11:27.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.149+0000 7ffa49600640 1 -- 172.21.15.7:0/37748433 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa440af980 con 0x7ffa4c0c08a0 2024-09-13T15:11:27.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.149+0000 7ffa51600640 1 -- 172.21.15.7:0/37748433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa4c0c08a0 msgr2=0x7ffa4c0c7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:27.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.149+0000 7ffa51600640 1 --2- 172.21.15.7:0/37748433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa4c0c08a0 0x7ffa4c0c7590 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c070a60 tx=0x7ffa4401f130 comp rx=0 tx=0).stop 2024-09-13T15:11:27.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.149+0000 7ffa51600640 1 -- 172.21.15.7:0/37748433 shutdown_connections 2024-09-13T15:11:27.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.149+0000 7ffa51600640 1 --2- 172.21.15.7:0/37748433 >> v2:172.21.15.77:3300/0 conn(0x7ffa4c0c7ad0 0x7ffa4c158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.149+0000 7ffa51600640 1 --2- 172.21.15.7:0/37748433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa4c0c08a0 0x7ffa4c0c7590 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.149+0000 7ffa51600640 1 -- 172.21.15.7:0/37748433 >> 172.21.15.7:0/37748433 conn(0x7ffa4c065d40 msgr2=0x7ffa4c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:27.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.153+0000 7ffa51600640 1 -- 172.21.15.7:0/37748433 shutdown_connections 2024-09-13T15:11:27.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.153+0000 7ffa51600640 1 -- 172.21.15.7:0/37748433 wait complete. 2024-09-13T15:11:27.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.153+0000 7ffa51600640 1 Processor -- start 2024-09-13T15:11:27.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.153+0000 7ffa51600640 1 -- start start 2024-09-13T15:11:27.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.157+0000 7ffa51600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa4c066860 0x7ffa4c14ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.157+0000 7ffa51600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa4c0c08a0 0x7ffa4c0cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.157+0000 7ffa51600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa4c0c7ad0 0x7ffa4c0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.157+0000 7ffa4b400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa4c0c7ad0 0x7ffa4c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:27.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.157+0000 7ffa4b400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa4c0c7ad0 0x7ffa4c0cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:58700/0 (socket says 172.21.15.7:58700) 2024-09-13T15:11:27.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.157+0000 7ffa4b400640 1 -- 172.21.15.7:0/1789457598 learned_addr learned my addr 172.21.15.7:0/1789457598 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:27.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.157+0000 7ffa51600640 1 -- 172.21.15.7:0/1789457598 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c0ca3a0 con 0x7ffa4c066860 2024-09-13T15:11:27.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.157+0000 7ffa51600640 1 -- 172.21.15.7:0/1789457598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c0ca930 con 0x7ffa4c0c7ad0 2024-09-13T15:11:27.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.157+0000 7ffa4aa00640 1 --2- 172.21.15.7:0/1789457598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa4c066860 0x7ffa4c14ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:27.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.157+0000 7ffa51600640 1 -- 172.21.15.7:0/1789457598 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4c0b0790 con 0x7ffa4c0c08a0 2024-09-13T15:11:27.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.161+0000 7ffa4b400640 1 -- 172.21.15.7:0/1789457598 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa4c0c08a0 msgr2=0x7ffa4c0cadc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T15:11:27.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.161+0000 7ffa4b400640 1 --2- 172.21.15.7:0/1789457598 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa4c0c08a0 0x7ffa4c0cadc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.161+0000 7ffa4b400640 1 -- 172.21.15.7:0/1789457598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa4c066860 msgr2=0x7ffa4c14ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:27.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.161+0000 7ffa4b400640 1 --2- 172.21.15.7:0/1789457598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa4c066860 0x7ffa4c14ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.161+0000 7ffa4b400640 1 -- 172.21.15.7:0/1789457598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa44009a70 con 0x7ffa4c0c7ad0 2024-09-13T15:11:27.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.161+0000 7ffa4b400640 1 --2- 172.21.15.7:0/1789457598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa4c0c7ad0 0x7ffa4c0cb300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800c590 tx=0x7ffa3800ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:27.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.161+0000 7ffa42a00640 1 -- 172.21.15.7:0/1789457598 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38004220 con 0x7ffa4c0c7ad0 2024-09-13T15:11:27.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.161+0000 7ffa42a00640 1 -- 172.21.15.7:0/1789457598 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa38004380 con 0x7ffa4c0c7ad0 2024-09-13T15:11:27.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.161+0000 7ffa51600640 1 -- 172.21.15.7:0/1789457598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4c0c46a0 con 0x7ffa4c0c7ad0 2024-09-13T15:11:27.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.161+0000 7ffa51600640 1 -- 172.21.15.7:0/1789457598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4c0ca5c0 con 0x7ffa4c0c7ad0 2024-09-13T15:11:27.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.161+0000 7ffa42a00640 1 -- 172.21.15.7:0/1789457598 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38003840 con 0x7ffa4c0c7ad0 2024-09-13T15:11:27.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.161+0000 7ffa51600640 1 -- 172.21.15.7:0/1789457598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa24005260 con 0x7ffa4c0c7ad0 2024-09-13T15:11:27.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.165+0000 7ffa42a00640 1 -- 172.21.15.7:0/1789457598 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffa380039a0 con 0x7ffa4c0c7ad0 2024-09-13T15:11:27.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.165+0000 7ffa42a00640 1 --2- 172.21.15.7:0/1789457598 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa2c066690 0x7ffa2c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:27.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.169+0000 7ffa42a00640 1 -- 172.21.15.7:0/1789457598 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7ffa38084540 con 0x7ffa4c0c7ad0 2024-09-13T15:11:27.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.169+0000 7ffa4aa00640 1 --2- 172.21.15.7:0/1789457598 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa2c066690 0x7ffa2c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:27.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.169+0000 7ffa42a00640 1 -- 172.21.15.7:0/1789457598 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffa38051340 con 0x7ffa4c0c7ad0 2024-09-13T15:11:27.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.169+0000 7ffa4aa00640 1 --2- 172.21.15.7:0/1789457598 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa2c066690 0x7ffa2c068b50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0011f0 tx=0x7ffa3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:27.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.561+0000 7ffa51600640 1 -- 172.21.15.7:0/1789457598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa240057e0 con 0x7ffa4c0c7ad0 2024-09-13T15:11:27.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.561+0000 7ffa42a00640 1 -- 172.21.15.7:0/1789457598 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+6300 (secure 0 0 0) 0x7ffa3801e090 con 0x7ffa4c0c7ad0 2024-09-13T15:11:27.561 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:11:27.561 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:11:16.960861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:stopping","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:11:27.562 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 38 2024-09-13T15:11:27.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.565+0000 7ffa51600640 1 -- 172.21.15.7:0/1789457598 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa2c066690 msgr2=0x7ffa2c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:27.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.565+0000 7ffa51600640 1 --2- 172.21.15.7:0/1789457598 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa2c066690 0x7ffa2c068b50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0011f0 tx=0x7ffa3c009040 comp rx=0 tx=0).stop 2024-09-13T15:11:27.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.565+0000 7ffa51600640 1 -- 172.21.15.7:0/1789457598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa4c0c7ad0 msgr2=0x7ffa4c0cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:27.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.565+0000 7ffa51600640 1 --2- 172.21.15.7:0/1789457598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa4c0c7ad0 0x7ffa4c0cb300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffa3800c590 tx=0x7ffa3800ca50 comp rx=0 tx=0).stop 2024-09-13T15:11:27.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.565+0000 7ffa51600640 1 -- 172.21.15.7:0/1789457598 shutdown_connections 2024-09-13T15:11:27.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.565+0000 7ffa51600640 1 --2- 172.21.15.7:0/1789457598 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffa2c066690 0x7ffa2c068b50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.565+0000 7ffa51600640 1 --2- 172.21.15.7:0/1789457598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa4c0c7ad0 0x7ffa4c0cb300 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.565+0000 7ffa51600640 1 --2- 172.21.15.7:0/1789457598 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffa4c0c08a0 0x7ffa4c0cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.565+0000 7ffa51600640 1 --2- 172.21.15.7:0/1789457598 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffa4c066860 0x7ffa4c14ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:27.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.565+0000 7ffa51600640 1 -- 172.21.15.7:0/1789457598 >> 172.21.15.7:0/1789457598 conn(0x7ffa4c065d40 msgr2=0x7ffa4c0c7040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:27.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.573+0000 7ffa51600640 1 -- 172.21.15.7:0/1789457598 shutdown_connections 2024-09-13T15:11:27.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:27.577+0000 7ffa51600640 1 -- 172.21.15.7:0/1789457598 wait complete. 2024-09-13T15:11:27.616 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:11:29.617 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:29.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.941+0000 7fd3e3400640 1 Processor -- start 2024-09-13T15:11:29.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.941+0000 7fd3e3400640 1 -- start start 2024-09-13T15:11:29.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.941+0000 7fd3e3400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3dc0c6890 0x7fd3dc06cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:29.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.941+0000 7fd3e3400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd3dc0c5e90 0x7fd3dc0c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:29.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.941+0000 7fd3e3400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3dc161ab0 con 0x7fd3dc0c5ab0 2024-09-13T15:11:29.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.941+0000 7fd3e3400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3dc160f80 con 0x7fd3dc0c5e90 2024-09-13T15:11:29.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.941+0000 7fd3e3400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc06dbc0 con 0x7fd3dc0c6890 2024-09-13T15:11:29.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.941+0000 7fd3dbe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3dc0c6890 0x7fd3dc06cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:29.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.941+0000 7fd3e0a00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fd3dc0c5ab0 0x7fd3dc1613a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:51850/0 (socket says 172.21.15.7:51850) 2024-09-13T15:11:29.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.941+0000 7fd3e0a00640 1 -- 172.21.15.7:0/4033792537 learned_addr learned my addr 172.21.15.7:0/4033792537 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:11:29.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.941+0000 7fd3e1400640 1 --2- 172.21.15.7:0/4033792537 >> v2:172.21.15.7:3300/0 conn(0x7fd3dc0c5e90 0x7fd3dc0c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:29.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.945+0000 7fd3e1400640 1 -- 172.21.15.7:0/4033792537 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3dc0c6890 msgr2=0x7fd3dc06cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:29.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.945+0000 7fd3e1400640 1 --2- 172.21.15.7:0/4033792537 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3dc0c6890 0x7fd3dc06cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:29.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.945+0000 7fd3e1400640 1 -- 172.21.15.7:0/4033792537 >> v1:172.21.15.7:6789/0 conn(0x7fd3dc0c5ab0 legacy=0x7fd3dc1613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:29.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.945+0000 7fd3e1400640 1 -- 172.21.15.7:0/4033792537 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc06d320 con 0x7fd3dc0c5e90 2024-09-13T15:11:29.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.949+0000 7fd3e1400640 1 --2- 172.21.15.7:0/4033792537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3dc0c5e90 0x7fd3dc0c6ea0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd3c80097c0 tx=0x7fd3c801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9c41470494a0bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:29.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.949+0000 7fd3db400640 1 -- 172.21.15.7:0/4033792537 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c80a89b0 con 0x7fd3dc0c5e90 2024-09-13T15:11:29.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.949+0000 7fd3db400640 1 -- 172.21.15.7:0/4033792537 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c80a8b10 con 0x7fd3dc0c5e90 2024-09-13T15:11:29.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.949+0000 7fd3db400640 1 -- 172.21.15.7:0/4033792537 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c80a8ea0 con 0x7fd3dc0c5e90 2024-09-13T15:11:29.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.949+0000 7fd3e3400640 1 -- 172.21.15.7:0/4033792537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3dc0c5e90 msgr2=0x7fd3dc0c6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:29.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.949+0000 7fd3e3400640 1 --2- 172.21.15.7:0/4033792537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3dc0c5e90 0x7fd3dc0c6ea0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd3c80097c0 tx=0x7fd3c801ecb0 comp rx=0 tx=0).stop 2024-09-13T15:11:29.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.949+0000 7fd3e3400640 1 -- 172.21.15.7:0/4033792537 shutdown_connections 2024-09-13T15:11:29.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.949+0000 7fd3e3400640 1 --2- 172.21.15.7:0/4033792537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3dc0c5e90 0x7fd3dc0c6ea0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:29.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.949+0000 7fd3e3400640 1 --2- 172.21.15.7:0/4033792537 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3dc0c6890 0x7fd3dc06cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:29.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.949+0000 7fd3e3400640 1 -- 172.21.15.7:0/4033792537 >> 172.21.15.7:0/4033792537 conn(0x7fd3dc065d40 msgr2=0x7fd3dc066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:29.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.969+0000 7fd3e3400640 1 -- 172.21.15.7:0/4033792537 shutdown_connections 2024-09-13T15:11:29.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.989+0000 7fd3e3400640 1 -- 172.21.15.7:0/4033792537 wait complete. 2024-09-13T15:11:29.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.993+0000 7fd3e3400640 1 Processor -- start 2024-09-13T15:11:29.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.993+0000 7fd3e3400640 1 -- start start 2024-09-13T15:11:29.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.993+0000 7fd3e3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3dc0c5ab0 0x7fd3dc150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:29.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.993+0000 7fd3e3400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3dc0c6890 0x7fd3dc0c3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:29.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.993+0000 7fd3e3400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3dc1535b0 0x7fd3dc0c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:29.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.993+0000 7fd3e3400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc1529f0 con 0x7fd3dc0c5ab0 2024-09-13T15:11:29.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.993+0000 7fd3e3400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc153bf0 con 0x7fd3dc0c6890 2024-09-13T15:11:29.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.993+0000 7fd3e3400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3dc0c2b70 con 0x7fd3dc1535b0 2024-09-13T15:11:29.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.993+0000 7fd3e1400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3dc1535b0 0x7fd3dc0c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:29.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.997+0000 7fd3e1400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3dc1535b0 0x7fd3dc0c3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:41496/0 (socket says 172.21.15.7:41496) 2024-09-13T15:11:29.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.997+0000 7fd3e1400640 1 -- 172.21.15.7:0/2692355362 learned_addr learned my addr 172.21.15.7:0/2692355362 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:29.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.997+0000 7fd3e0a00640 1 --2- 172.21.15.7:0/2692355362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3dc0c5ab0 0x7fd3dc150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:29.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.997+0000 7fd3dbe00640 1 --2- 172.21.15.7:0/2692355362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3dc0c6890 0x7fd3dc0c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:29.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.997+0000 7fd3e1400640 1 -- 172.21.15.7:0/2692355362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3dc0c6890 msgr2=0x7fd3dc0c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:29.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.997+0000 7fd3e1400640 1 --2- 172.21.15.7:0/2692355362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3dc0c6890 0x7fd3dc0c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:29.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.997+0000 7fd3e1400640 1 -- 172.21.15.7:0/2692355362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3dc0c5ab0 msgr2=0x7fd3dc150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:29.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.997+0000 7fd3e1400640 1 --2- 172.21.15.7:0/2692355362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3dc0c5ab0 0x7fd3dc150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:29.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.997+0000 7fd3e1400640 1 -- 172.21.15.7:0/2692355362 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c8009420 con 0x7fd3dc1535b0 2024-09-13T15:11:29.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.997+0000 7fd3dbe00640 1 --2- 172.21.15.7:0/2692355362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3dc0c6890 0x7fd3dc0c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:29.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.997+0000 7fd3e1400640 1 --2- 172.21.15.7:0/2692355362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3dc1535b0 0x7fd3dc0c3540 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd3c801c8e0 tx=0x7fd3c801ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:29.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.997+0000 7fd3d8c00640 1 -- 172.21.15.7:0/2692355362 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c80b1db0 con 0x7fd3dc1535b0 2024-09-13T15:11:29.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.997+0000 7fd3d8c00640 1 -- 172.21.15.7:0/2692355362 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c80b9410 con 0x7fd3dc1535b0 2024-09-13T15:11:29.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.997+0000 7fd3d8c00640 1 -- 172.21.15.7:0/2692355362 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c80b97c0 con 0x7fd3dc1535b0 2024-09-13T15:11:29.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.997+0000 7fd3e3400640 1 -- 172.21.15.7:0/2692355362 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3dc153eb0 con 0x7fd3dc1535b0 2024-09-13T15:11:29.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:29.997+0000 7fd3e3400640 1 -- 172.21.15.7:0/2692355362 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3dc154120 con 0x7fd3dc1535b0 2024-09-13T15:11:29.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.001+0000 7fd3d2000640 1 -- 172.21.15.7:0/2692355362 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3dc067650 con 0x7fd3dc1535b0 2024-09-13T15:11:30.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.001+0000 7fd3d8c00640 1 -- 172.21.15.7:0/2692355362 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd3c80b7040 con 0x7fd3dc1535b0 2024-09-13T15:11:30.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.001+0000 7fd3d8c00640 1 --2- 172.21.15.7:0/2692355362 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd3bc0666e0 0x7fd3bc068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:30.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.001+0000 7fd3d8c00640 1 -- 172.21.15.7:0/2692355362 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fd3c8121d80 con 0x7fd3dc1535b0 2024-09-13T15:11:30.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.001+0000 7fd3e0a00640 1 --2- 172.21.15.7:0/2692355362 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd3bc0666e0 0x7fd3bc068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:30.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.005+0000 7fd3e0a00640 1 --2- 172.21.15.7:0/2692355362 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd3bc0666e0 0x7fd3bc068ba0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40012f0 tx=0x7fd3d4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:30.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.009+0000 7fd3d8c00640 1 -- 172.21.15.7:0/2692355362 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd3c80eeca0 con 0x7fd3dc1535b0 2024-09-13T15:11:30.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.525+0000 7fd3d2000640 1 -- 172.21.15.7:0/2692355362 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3dc0c5e90 con 0x7fd3dc1535b0 2024-09-13T15:11:30.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.525+0000 7fd3d8c00640 1 -- 172.21.15.7:0/2692355362 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+6300 (secure 0 0 0) 0x7fd3c80b5020 con 0x7fd3dc1535b0 2024-09-13T15:11:30.526 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:11:30.527 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:11:16.960861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:stopping","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:11:30.527 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 38 2024-09-13T15:11:30.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.529+0000 7fd3d2000640 1 -- 172.21.15.7:0/2692355362 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd3bc0666e0 msgr2=0x7fd3bc068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:30.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.529+0000 7fd3d2000640 1 --2- 172.21.15.7:0/2692355362 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd3bc0666e0 0x7fd3bc068ba0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd3d40012f0 tx=0x7fd3d4009040 comp rx=0 tx=0).stop 2024-09-13T15:11:30.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.529+0000 7fd3d2000640 1 -- 172.21.15.7:0/2692355362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3dc1535b0 msgr2=0x7fd3dc0c3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:30.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.529+0000 7fd3d2000640 1 --2- 172.21.15.7:0/2692355362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3dc1535b0 0x7fd3dc0c3540 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd3c801c8e0 tx=0x7fd3c801ba50 comp rx=0 tx=0).stop 2024-09-13T15:11:30.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.537+0000 7fd3d2000640 1 -- 172.21.15.7:0/2692355362 shutdown_connections 2024-09-13T15:11:30.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.537+0000 7fd3d2000640 1 --2- 172.21.15.7:0/2692355362 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd3bc0666e0 0x7fd3bc068ba0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:30.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.537+0000 7fd3d2000640 1 --2- 172.21.15.7:0/2692355362 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd3dc1535b0 0x7fd3dc0c3540 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:30.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.537+0000 7fd3d2000640 1 --2- 172.21.15.7:0/2692355362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd3dc0c6890 0x7fd3dc0c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:30.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.537+0000 7fd3d2000640 1 --2- 172.21.15.7:0/2692355362 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3dc0c5ab0 0x7fd3dc150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:30.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.537+0000 7fd3d2000640 1 -- 172.21.15.7:0/2692355362 >> 172.21.15.7:0/2692355362 conn(0x7fd3dc065d40 msgr2=0x7fd3dc0b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:30.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.541+0000 7fd3d2000640 1 -- 172.21.15.7:0/2692355362 shutdown_connections 2024-09-13T15:11:30.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:30.541+0000 7fd3d2000640 1 -- 172.21.15.7:0/2692355362 wait complete. 2024-09-13T15:11:30.606 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:11:32.606 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:32.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.877+0000 7f18f6e00640 1 Processor -- start 2024-09-13T15:11:32.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.877+0000 7f18f6e00640 1 -- start start 2024-09-13T15:11:32.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.877+0000 7f18f6e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f18f0157600 0x7f18f0160a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.877+0000 7f18f6e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18f01579e0 0x7f18f00c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.877+0000 7f18f6e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f18f00c68e0 0x7f18f00c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.877+0000 7f18f6e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f00c8f70 con 0x7f18f0157600 2024-09-13T15:11:32.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.877+0000 7f18f6e00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f01610a0 con 0x7f18f00c68e0 2024-09-13T15:11:32.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.877+0000 7f18f6e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0161380 con 0x7f18f01579e0 2024-09-13T15:11:32.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.881+0000 7f18f4e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f18f00c68e0 0x7f18f00c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:32.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.881+0000 7f18efe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f18f0157600 0x7f18f0160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:32.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.881+0000 7f18ef400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18f01579e0 0x7f18f00c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:32.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.881+0000 7f18efe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f18f0157600 0x7f18f0160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50912/0 (socket says 172.21.15.7:50912) 2024-09-13T15:11:32.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.881+0000 7f18efe00640 1 -- 172.21.15.7:0/1390387396 learned_addr learned my addr 172.21.15.7:0/1390387396 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:32.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.881+0000 7f18ef400640 1 -- 172.21.15.7:0/1390387396 >> v2:172.21.15.77:3300/0 conn(0x7f18f00c68e0 msgr2=0x7f18f00c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:32.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.881+0000 7f18ef400640 1 --2- 172.21.15.7:0/1390387396 >> v2:172.21.15.77:3300/0 conn(0x7f18f00c68e0 0x7f18f00c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.881+0000 7f18ef400640 1 -- 172.21.15.7:0/1390387396 >> v2:172.21.15.7:3300/0 conn(0x7f18f0157600 msgr2=0x7f18f0160a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:32.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.881+0000 7f18ef400640 1 --2- 172.21.15.7:0/1390387396 >> v2:172.21.15.7:3300/0 conn(0x7f18f0157600 0x7f18f0160a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.881+0000 7f18ef400640 1 -- 172.21.15.7:0/1390387396 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f0161660 con 0x7f18f01579e0 2024-09-13T15:11:32.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.889+0000 7f18ef400640 1 --2- 172.21.15.7:0/1390387396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18f01579e0 0x7f18f00c8220 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f18f008c5a0 tx=0x7f18e001ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5860efaf26d7c88 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:32.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.889+0000 7f18eea00640 1 -- 172.21.15.7:0/1390387396 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e00a8930 con 0x7f18f01579e0 2024-09-13T15:11:32.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.893+0000 7f18eea00640 1 -- 172.21.15.7:0/1390387396 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e00a8a90 con 0x7f18f01579e0 2024-09-13T15:11:32.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.893+0000 7f18eea00640 1 -- 172.21.15.7:0/1390387396 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e00a8e20 con 0x7f18f01579e0 2024-09-13T15:11:32.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.897+0000 7f18f6e00640 1 -- 172.21.15.7:0/1390387396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18f01579e0 msgr2=0x7f18f00c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:32.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.897+0000 7f18f6e00640 1 --2- 172.21.15.7:0/1390387396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18f01579e0 0x7f18f00c8220 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f18f008c5a0 tx=0x7f18e001ecb0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.901+0000 7f18f6e00640 1 -- 172.21.15.7:0/1390387396 shutdown_connections 2024-09-13T15:11:32.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.901+0000 7f18f6e00640 1 --2- 172.21.15.7:0/1390387396 >> v2:172.21.15.77:3300/0 conn(0x7f18f00c68e0 0x7f18f00c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.901+0000 7f18f6e00640 1 --2- 172.21.15.7:0/1390387396 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18f01579e0 0x7f18f00c8220 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.901+0000 7f18f6e00640 1 --2- 172.21.15.7:0/1390387396 >> v2:172.21.15.7:3300/0 conn(0x7f18f0157600 0x7f18f0160a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.901+0000 7f18f6e00640 1 -- 172.21.15.7:0/1390387396 >> 172.21.15.7:0/1390387396 conn(0x7f18f00cb5a0 msgr2=0x7f18f00cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:32.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.901+0000 7f18f6e00640 1 -- 172.21.15.7:0/1390387396 shutdown_connections 2024-09-13T15:11:32.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.901+0000 7f18f6e00640 1 -- 172.21.15.7:0/1390387396 wait complete. 2024-09-13T15:11:32.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.905+0000 7f18f6e00640 1 Processor -- start 2024-09-13T15:11:32.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.909+0000 7f18f6e00640 1 -- start start 2024-09-13T15:11:32.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.909+0000 7f18f6e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18f00c68e0 0x7f18f0149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.909+0000 7f18f6e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18f0157600 0x7f18f0150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.909+0000 7f18f6e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18f01579e0 0x7f18f0152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.909+0000 7f18f6e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f0148970 con 0x7f18f0157600 2024-09-13T15:11:32.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.909+0000 7f18f6e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f00c1fe0 con 0x7f18f00c68e0 2024-09-13T15:11:32.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.909+0000 7f18f6e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f014b460 con 0x7f18f01579e0 2024-09-13T15:11:32.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.913+0000 7f18efe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18f00c68e0 0x7f18f0149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:32.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.913+0000 7f18efe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18f00c68e0 0x7f18f0149000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:55470/0 (socket says 172.21.15.7:55470) 2024-09-13T15:11:32.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.913+0000 7f18efe00640 1 -- 172.21.15.7:0/1759396019 learned_addr learned my addr 172.21.15.7:0/1759396019 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:32.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.913+0000 7f18efe00640 1 -- 172.21.15.7:0/1759396019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18f01579e0 msgr2=0x7f18f0152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:32.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.913+0000 7f18efe00640 1 --2- 172.21.15.7:0/1759396019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18f01579e0 0x7f18f0152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.913+0000 7f18efe00640 1 -- 172.21.15.7:0/1759396019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18f0157600 msgr2=0x7f18f0150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:32.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.913+0000 7f18efe00640 1 --2- 172.21.15.7:0/1759396019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18f0157600 0x7f18f0150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:32.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.913+0000 7f18efe00640 1 -- 172.21.15.7:0/1759396019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e0009420 con 0x7f18f00c68e0 2024-09-13T15:11:32.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.913+0000 7f18efe00640 1 --2- 172.21.15.7:0/1759396019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18f00c68e0 0x7f18f0149000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f18e8007dd0 tx=0x7f18e800d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:32.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.917+0000 7f18e7e00640 1 -- 172.21.15.7:0/1759396019 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e8009e40 con 0x7f18f00c68e0 2024-09-13T15:11:32.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.917+0000 7f18f6e00640 1 -- 172.21.15.7:0/1759396019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f014e650 con 0x7f18f00c68e0 2024-09-13T15:11:32.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.917+0000 7f18f6e00640 1 -- 172.21.15.7:0/1759396019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f01e8b70 con 0x7f18f00c68e0 2024-09-13T15:11:32.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.917+0000 7f18e7e00640 1 -- 172.21.15.7:0/1759396019 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e800f040 con 0x7f18f00c68e0 2024-09-13T15:11:32.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.917+0000 7f18e7e00640 1 -- 172.21.15.7:0/1759396019 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e8015600 con 0x7f18f00c68e0 2024-09-13T15:11:32.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.917+0000 7f18e5600640 1 -- 172.21.15.7:0/1759396019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f00c7dd0 con 0x7f18f00c68e0 2024-09-13T15:11:32.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.921+0000 7f18e7e00640 1 -- 172.21.15.7:0/1759396019 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f18e8015760 con 0x7f18f00c68e0 2024-09-13T15:11:32.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.921+0000 7f18e7e00640 1 --2- 172.21.15.7:0/1759396019 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18d0066690 0x7f18d0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:32.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.921+0000 7f18e7e00640 1 -- 172.21.15.7:0/1759396019 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f18e8084b10 con 0x7f18f00c68e0 2024-09-13T15:11:32.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.921+0000 7f18ef400640 1 --2- 172.21.15.7:0/1759396019 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18d0066690 0x7f18d0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:32.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.925+0000 7f18ef400640 1 --2- 172.21.15.7:0/1759396019 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18d0066690 0x7f18d0068b50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f18e00b2000 tx=0x7f18e0004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:32.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:32.953+0000 7f18e7e00640 1 -- 172.21.15.7:0/1759396019 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f18e8051ac0 con 0x7f18f00c68e0 2024-09-13T15:11:33.440 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:11:33.440 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:11:16.960861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:stopping","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:11:33.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:33.437+0000 7f18e5600640 1 -- 172.21.15.7:0/1759396019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18f0160a60 con 0x7f18f00c68e0 2024-09-13T15:11:33.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:33.437+0000 7f18e7e00640 1 -- 172.21.15.7:0/1759396019 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+6300 (secure 0 0 0) 0x7f18e801a090 con 0x7f18f00c68e0 2024-09-13T15:11:33.441 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 38 2024-09-13T15:11:33.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:33.441+0000 7f18e5600640 1 -- 172.21.15.7:0/1759396019 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18d0066690 msgr2=0x7f18d0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:33.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:33.441+0000 7f18e5600640 1 --2- 172.21.15.7:0/1759396019 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18d0066690 0x7f18d0068b50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f18e00b2000 tx=0x7f18e0004740 comp rx=0 tx=0).stop 2024-09-13T15:11:33.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:33.441+0000 7f18e5600640 1 -- 172.21.15.7:0/1759396019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18f00c68e0 msgr2=0x7f18f0149000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:33.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:33.441+0000 7f18e5600640 1 --2- 172.21.15.7:0/1759396019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18f00c68e0 0x7f18f0149000 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f18e8007dd0 tx=0x7f18e800d4a0 comp rx=0 tx=0).stop 2024-09-13T15:11:33.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:33.441+0000 7f18e5600640 1 -- 172.21.15.7:0/1759396019 shutdown_connections 2024-09-13T15:11:33.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:33.441+0000 7f18e5600640 1 --2- 172.21.15.7:0/1759396019 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18d0066690 0x7f18d0068b50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:33.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:33.441+0000 7f18e5600640 1 --2- 172.21.15.7:0/1759396019 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18f01579e0 0x7f18f0152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:33.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:33.441+0000 7f18e5600640 1 --2- 172.21.15.7:0/1759396019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18f0157600 0x7f18f0150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:33.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:33.441+0000 7f18e5600640 1 --2- 172.21.15.7:0/1759396019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18f00c68e0 0x7f18f0149000 secure :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f18e8007dd0 tx=0x7f18e800d4a0 comp rx=0 tx=0).stop 2024-09-13T15:11:33.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:33.441+0000 7f18e5600640 1 -- 172.21.15.7:0/1759396019 >> 172.21.15.7:0/1759396019 conn(0x7f18f00cb5a0 msgr2=0x7f18f00c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:33.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:33.441+0000 7f18e5600640 1 -- 172.21.15.7:0/1759396019 shutdown_connections 2024-09-13T15:11:33.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:33.441+0000 7f18e5600640 1 -- 172.21.15.7:0/1759396019 wait complete. 2024-09-13T15:11:33.484 INFO:tasks.mds_thrash.fs.[cephfs]:cluster is considered unstable while MDS are in up:stopping (!thrash_while_stopping) 2024-09-13T15:11:33.485 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 38, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-13T15:01:44.789559+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 38, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3, 4 ], "info": { "gid_4252": { "addr": "172.21.15.77:6835/2367107997", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6834", "nonce": 2367107997, "type": "v2" }, { "addr": "172.21.15.77:6835", "nonce": 2367107997, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4252, "incarnation": 13, "join_fscid": -1, "name": "d", "rank": 2, "state": "up:active", "state_seq": 43 }, "gid_4267": { "addr": "172.21.15.77:6839/2233000674", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6837", "nonce": 2233000674, "type": "v2" }, { "addr": "172.21.15.77:6839", "nonce": 2233000674, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4267, "incarnation": 9, "join_fscid": -1, "name": "f", "rank": 1, "state": "up:active", "state_seq": 41 }, "gid_4276": { "addr": "172.21.15.7:6836/2396967179", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6834", "nonce": 2396967179, "type": "v2" }, { "addr": "172.21.15.7:6836", "nonce": 2396967179, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4276, "incarnation": 4, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_5069": { "addr": "172.21.15.77:6838/877425259", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6836", "nonce": 877425259, "type": "v2" }, { "addr": "172.21.15.77:6838", "nonce": 877425259, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5069, "incarnation": 31, "join_fscid": -1, "name": "b", "rank": 3, "state": "up:active", "state_seq": 43 }, "gid_5230": { "addr": "172.21.15.7:6833/2896136827", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6832", "nonce": 2896136827, "type": "v2" }, { "addr": "172.21.15.7:6833", "nonce": 2896136827, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5230, "incarnation": 25, "join_fscid": -1, "name": "e", "rank": 4, "state": "up:stopping", "state_seq": 34 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 4, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-13T15:11:16.960861+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4276, "mds_1": 4267, "mds_2": 4252, "mds_3": 5069, "mds_4": 5230 } } } ], "standbys": [ { "addr": "172.21.15.7:6837/3708232086", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6835", "nonce": 3708232086, "type": "v2" }, { "addr": "172.21.15.7:6837", "nonce": 3708232086, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 36, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5156, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-13T15:11:34.207 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:11:34.213 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:11:35.487 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:36.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.165+0000 7fb5bee00640 1 Processor -- start 2024-09-13T15:11:36.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.165+0000 7fb5bee00640 1 -- start start 2024-09-13T15:11:36.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.169+0000 7fb5bee00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5b8155e90 0x7fb5b80c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:36.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.169+0000 7fb5bee00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5b806f600 0x7fb5b8158750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:36.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.169+0000 7fb5bee00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b8158c90 con 0x7fb5b80b0ce0 2024-09-13T15:11:36.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.169+0000 7fb5bee00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b80c73b0 con 0x7fb5b8155e90 2024-09-13T15:11:36.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.169+0000 7fb5bee00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b8072640 con 0x7fb5b806f600 2024-09-13T15:11:36.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.173+0000 7fb5b7400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5b806f600 0x7fb5b8158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:36.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.173+0000 7fb5b7400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5b806f600 0x7fb5b8158750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:41526/0 (socket says 172.21.15.7:41526) 2024-09-13T15:11:36.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.173+0000 7fb5b7400640 1 -- 172.21.15.7:0/1157391941 learned_addr learned my addr 172.21.15.7:0/1157391941 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:36.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.173+0000 7fb5b7e00640 1 --2- 172.21.15.7:0/1157391941 >> v2:172.21.15.7:3300/0 conn(0x7fb5b8155e90 0x7fb5b80c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:36.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.173+0000 7fb5b7400640 1 -- 172.21.15.7:0/1157391941 >> v2:172.21.15.7:3300/0 conn(0x7fb5b8155e90 msgr2=0x7fb5b80c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:36.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.173+0000 7fb5b7400640 1 --2- 172.21.15.7:0/1157391941 >> v2:172.21.15.7:3300/0 conn(0x7fb5b8155e90 0x7fb5b80c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:36.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.173+0000 7fb5b7400640 1 -- 172.21.15.7:0/1157391941 >> v1:172.21.15.7:6789/0 conn(0x7fb5b80b0ce0 legacy=0x7fb5b814f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:36.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.173+0000 7fb5b7400640 1 -- 172.21.15.7:0/1157391941 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b80c70d0 con 0x7fb5b806f600 2024-09-13T15:11:36.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.189+0000 7fb5b7400640 1 --2- 172.21.15.7:0/1157391941 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5b806f600 0x7fb5b8158750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009870 tx=0x7fb5a401ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=372d744c378d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:36.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.193+0000 7fb5b6a00640 1 -- 172.21.15.7:0/1157391941 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a40a89f0 con 0x7fb5b806f600 2024-09-13T15:11:36.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.193+0000 7fb5b6a00640 1 -- 172.21.15.7:0/1157391941 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a40a8b50 con 0x7fb5b806f600 2024-09-13T15:11:36.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.193+0000 7fb5b6a00640 1 -- 172.21.15.7:0/1157391941 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a40b0440 con 0x7fb5b806f600 2024-09-13T15:11:36.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.201+0000 7fb5bee00640 1 -- 172.21.15.7:0/1157391941 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5b806f600 msgr2=0x7fb5b8158750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:36.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.201+0000 7fb5bee00640 1 --2- 172.21.15.7:0/1157391941 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5b806f600 0x7fb5b8158750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009870 tx=0x7fb5a401ed30 comp rx=0 tx=0).stop 2024-09-13T15:11:36.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.205+0000 7fb5bee00640 1 -- 172.21.15.7:0/1157391941 shutdown_connections 2024-09-13T15:11:36.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.205+0000 7fb5bee00640 1 --2- 172.21.15.7:0/1157391941 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5b806f600 0x7fb5b8158750 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009870 tx=0x7fb5a401ed30 comp rx=0 tx=0).stop 2024-09-13T15:11:36.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.205+0000 7fb5bee00640 1 --2- 172.21.15.7:0/1157391941 >> v2:172.21.15.7:3300/0 conn(0x7fb5b8155e90 0x7fb5b80c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:36.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.205+0000 7fb5bee00640 1 -- 172.21.15.7:0/1157391941 >> 172.21.15.7:0/1157391941 conn(0x7fb5b8065d40 msgr2=0x7fb5b8066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:36.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.221+0000 7fb5bee00640 1 -- 172.21.15.7:0/1157391941 shutdown_connections 2024-09-13T15:11:36.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.225+0000 7fb5bee00640 1 -- 172.21.15.7:0/1157391941 wait complete. 2024-09-13T15:11:36.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.229+0000 7fb5bee00640 1 Processor -- start 2024-09-13T15:11:36.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.229+0000 7fb5bee00640 1 -- start start 2024-09-13T15:11:36.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.233+0000 7fb5bee00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5b80b0ce0 0x7fb5b81fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:36.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.233+0000 7fb5bee00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b8155e90 0x7fb5b813c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:36.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.233+0000 7fb5bee00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5b813f870 0x7fb5b813c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:36.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.233+0000 7fb5bee00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b8142090 con 0x7fb5b8155e90 2024-09-13T15:11:36.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.233+0000 7fb5bee00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b8141750 con 0x7fb5b80b0ce0 2024-09-13T15:11:36.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.233+0000 7fb5bee00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b8145050 con 0x7fb5b813f870 2024-09-13T15:11:36.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.233+0000 7fb5bce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5b813f870 0x7fb5b813c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:36.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.233+0000 7fb5bce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5b813f870 0x7fb5b813c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:41542/0 (socket says 172.21.15.7:41542) 2024-09-13T15:11:36.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.233+0000 7fb5bce00640 1 -- 172.21.15.7:0/2091711882 learned_addr learned my addr 172.21.15.7:0/2091711882 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:36.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.233+0000 7fb5b7e00640 1 --2- 172.21.15.7:0/2091711882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5b80b0ce0 0x7fb5b81fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:36.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.233+0000 7fb5bce00640 1 -- 172.21.15.7:0/2091711882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5b80b0ce0 msgr2=0x7fb5b81fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:36.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.233+0000 7fb5bce00640 1 --2- 172.21.15.7:0/2091711882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5b80b0ce0 0x7fb5b81fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:36.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.233+0000 7fb5bce00640 1 -- 172.21.15.7:0/2091711882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b8155e90 msgr2=0x7fb5b813c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:36.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.233+0000 7fb5bce00640 1 --2- 172.21.15.7:0/2091711882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b8155e90 0x7fb5b813c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:36.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.233+0000 7fb5bce00640 1 -- 172.21.15.7:0/2091711882 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a40094d0 con 0x7fb5b813f870 2024-09-13T15:11:36.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.233+0000 7fb5bce00640 1 --2- 172.21.15.7:0/2091711882 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5b813f870 0x7fb5b813c630 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb5b000c7b0 tx=0x7fb5b000cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.237+0000 7fb5afe00640 1 -- 172.21.15.7:0/2091711882 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0003d90 con 0x7fb5b813f870 2024-09-13T15:11:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.237+0000 7fb5afe00640 1 -- 172.21.15.7:0/2091711882 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b0005070 con 0x7fb5b813f870 2024-09-13T15:11:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.237+0000 7fb5afe00640 1 -- 172.21.15.7:0/2091711882 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0005420 con 0x7fb5b813f870 2024-09-13T15:11:36.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.237+0000 7fb5bee00640 1 -- 172.21.15.7:0/2091711882 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b81fcbd0 con 0x7fb5b813f870 2024-09-13T15:11:36.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.241+0000 7fb5bee00640 1 -- 172.21.15.7:0/2091711882 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b81406b0 con 0x7fb5b813f870 2024-09-13T15:11:36.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.249+0000 7fb5afe00640 1 -- 172.21.15.7:0/2091711882 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb5b0005580 con 0x7fb5b813f870 2024-09-13T15:11:36.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.249+0000 7fb5afe00640 1 --2- 172.21.15.7:0/2091711882 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb598066760 0x7fb598068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:36.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.249+0000 7fb5afe00640 1 -- 172.21.15.7:0/2091711882 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fb5b0083d80 con 0x7fb5b813f870 2024-09-13T15:11:36.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.249+0000 7fb5b7e00640 1 --2- 172.21.15.7:0/2091711882 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb598066760 0x7fb598068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:36.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.253+0000 7fb5b7e00640 1 --2- 172.21.15.7:0/2091711882 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb598066760 0x7fb598068c20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009a50 tx=0x7fb5a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:36.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.269+0000 7fb5bee00640 1 -- 172.21.15.7:0/2091711882 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b8067650 con 0x7fb5b813f870 2024-09-13T15:11:36.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.289+0000 7fb5afe00640 1 -- 172.21.15.7:0/2091711882 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb5b0050c30 con 0x7fb5b813f870 2024-09-13T15:11:36.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.813+0000 7fb5bee00640 1 -- 172.21.15.7:0/2091711882 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5b81fcbd0 con 0x7fb5b813f870 2024-09-13T15:11:36.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.813+0000 7fb5afe00640 1 -- 172.21.15.7:0/2091711882 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+6300 (secure 0 0 0) 0x7fb5b81fcbd0 con 0x7fb5b813f870 2024-09-13T15:11:36.865 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:11:36.865 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:11:16.960861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3,4],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069,"mds_4":5230},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5230":{"gid":5230,"name":"e","rank":4,"incarnation":25,"state":"up:stopping","state_seq":34,"addr":"172.21.15.7:6833/2896136827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":2896136827},{"type":"v1","addr":"172.21.15.7:6833","nonce":2896136827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:11:36.866 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 38 2024-09-13T15:11:36.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.821+0000 7fb5bee00640 1 -- 172.21.15.7:0/2091711882 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb598066760 msgr2=0x7fb598068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:36.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.821+0000 7fb5bee00640 1 --2- 172.21.15.7:0/2091711882 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb598066760 0x7fb598068c20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8009a50 tx=0x7fb5a8008040 comp rx=0 tx=0).stop 2024-09-13T15:11:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.821+0000 7fb5bee00640 1 -- 172.21.15.7:0/2091711882 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5b813f870 msgr2=0x7fb5b813c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.821+0000 7fb5bee00640 1 --2- 172.21.15.7:0/2091711882 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5b813f870 0x7fb5b813c630 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb5b000c7b0 tx=0x7fb5b000cc70 comp rx=0 tx=0).stop 2024-09-13T15:11:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.821+0000 7fb5bee00640 1 -- 172.21.15.7:0/2091711882 shutdown_connections 2024-09-13T15:11:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.821+0000 7fb5bee00640 1 --2- 172.21.15.7:0/2091711882 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb598066760 0x7fb598068c20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.821+0000 7fb5bee00640 1 --2- 172.21.15.7:0/2091711882 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5b813f870 0x7fb5b813c630 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.821+0000 7fb5bee00640 1 --2- 172.21.15.7:0/2091711882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b8155e90 0x7fb5b813c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.821+0000 7fb5bee00640 1 --2- 172.21.15.7:0/2091711882 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5b80b0ce0 0x7fb5b81fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.821+0000 7fb5bee00640 1 -- 172.21.15.7:0/2091711882 >> 172.21.15.7:0/2091711882 conn(0x7fb5b8065d40 msgr2=0x7fb5b806d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.821+0000 7fb5bee00640 1 -- 172.21.15.7:0/2091711882 shutdown_connections 2024-09-13T15:11:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:36.821+0000 7fb5bee00640 1 -- 172.21.15.7:0/2091711882 wait complete. 2024-09-13T15:11:36.881 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:11:38.136 INFO:tasks.ceph.mds.e.smithi007.stdout:starting mds.e at 2024-09-13T15:11:38.882 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:39.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.793+0000 7f338de00640 1 Processor -- start 2024-09-13T15:11:39.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.801+0000 7f338de00640 1 -- start start 2024-09-13T15:11:39.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f338de00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33800dd110 0x7f338004e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f338de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f338004d080 0x7f3380051e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f338de00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3380008250 con 0x7f33800523d0 2024-09-13T15:11:39.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f338de00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33800dd4f0 con 0x7f338004d080 2024-09-13T15:11:39.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f338de00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33800527e0 con 0x7f33800dd110 2024-09-13T15:11:39.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3386a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33800dd110 0x7f338004e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:39.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3386a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33800dd110 0x7f338004e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:46272/0 (socket says 172.21.15.7:46272) 2024-09-13T15:11:39.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3386a00640 1 -- 172.21.15.7:0/1374304496 learned_addr learned my addr 172.21.15.7:0/1374304496 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3385600640 1 -- 172.21.15.7:0/1374304496 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945005644 0 0) 0x7f3380008250 con 0x7f33800523d0 2024-09-13T15:11:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3385600640 1 -- 172.21.15.7:0/1374304496 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f336c003530 con 0x7f33800523d0 2024-09-13T15:11:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3385600640 1 -- 172.21.15.7:0/1374304496 <== mon.1 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3765640616 0 0) 0x7f336c003530 con 0x7f33800523d0 2024-09-13T15:11:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3385600640 1 -- 172.21.15.7:0/1374304496 >> v2:172.21.15.77:3300/0 conn(0x7f33800dd110 msgr2=0x7f338004e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3385600640 1 --2- 172.21.15.7:0/1374304496 >> v2:172.21.15.77:3300/0 conn(0x7f33800dd110 0x7f338004e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3385600640 1 -- 172.21.15.7:0/1374304496 >> v2:172.21.15.7:3300/0 conn(0x7f338004d080 msgr2=0x7f3380051e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:11:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3385600640 1 --2- 172.21.15.7:0/1374304496 >> v2:172.21.15.7:3300/0 conn(0x7f338004d080 0x7f3380051e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3385600640 1 -- 172.21.15.7:0/1374304496 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33800e6340 con 0x7f33800523d0 2024-09-13T15:11:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3385600640 1 -- 172.21.15.7:0/1374304496 <== mon.1 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f3388074490 con 0x7f33800523d0 2024-09-13T15:11:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3385600640 1 -- 172.21.15.7:0/1374304496 >> v1:172.21.15.77:6789/0 conn(0x7f33800523d0 legacy=0x7f33800e3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3385600640 1 --2- 172.21.15.7:0/1374304496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f336c003980 0x7f336c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3385600640 1 --2- 172.21.15.7:0/1374304496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f336c0047d0 0x7f336c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3385600640 1 --2- 172.21.15.7:0/1374304496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f336c005190 0x7f336c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3385600640 1 -- 172.21.15.7:0/1374304496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33800dd4f0 con 0x7f336c003980 2024-09-13T15:11:39.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3385600640 1 -- 172.21.15.7:0/1374304496 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33800527e0 con 0x7f336c0047d0 2024-09-13T15:11:39.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.817+0000 7f3385600640 1 -- 172.21.15.7:0/1374304496 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336c00c0c0 con 0x7f336c005190 2024-09-13T15:11:39.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.821+0000 7f3387400640 1 --2- 172.21.15.7:0/1374304496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f336c005190 0x7f336c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:39.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.821+0000 7f3387400640 1 -- 172.21.15.7:0/1374304496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f336c0047d0 msgr2=0x7f336c004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:11:39.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.821+0000 7f3387400640 1 --2- 172.21.15.7:0/1374304496 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f336c0047d0 0x7f336c004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.821+0000 7f3387400640 1 -- 172.21.15.7:0/1374304496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f336c003980 msgr2=0x7f336c003da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:11:39.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.821+0000 7f3387400640 1 --2- 172.21.15.7:0/1374304496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f336c003980 0x7f336c003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.821+0000 7f3387400640 1 -- 172.21.15.7:0/1374304496 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33800e6340 con 0x7f336c005190 2024-09-13T15:11:39.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.825+0000 7f3387400640 1 -- 172.21.15.7:0/1374304496 reap_dead start 2024-09-13T15:11:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.829+0000 7f3387400640 1 --2- 172.21.15.7:0/1374304496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f336c005190 0x7f336c00b990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3388063da0 tx=0x7f3388097c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10cba753117e29df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.829+0000 7f3385600640 1 -- 172.21.15.7:0/1374304496 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338806e030 con 0x7f336c005190 2024-09-13T15:11:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.829+0000 7f3385600640 1 -- 172.21.15.7:0/1374304496 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3388120a00 con 0x7f336c005190 2024-09-13T15:11:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.829+0000 7f3385600640 1 -- 172.21.15.7:0/1374304496 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388120d70 con 0x7f336c005190 2024-09-13T15:11:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.829+0000 7f338de00640 1 -- 172.21.15.7:0/1374304496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f336c005190 msgr2=0x7f336c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.829+0000 7f338de00640 1 --2- 172.21.15.7:0/1374304496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f336c005190 0x7f336c00b990 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3388063da0 tx=0x7f3388097c50 comp rx=0 tx=0).stop 2024-09-13T15:11:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.829+0000 7f338de00640 1 -- 172.21.15.7:0/1374304496 shutdown_connections 2024-09-13T15:11:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.829+0000 7f338de00640 1 --2- 172.21.15.7:0/1374304496 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f336c005190 0x7f336c00b990 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.829+0000 7f338de00640 1 -- 172.21.15.7:0/1374304496 >> 172.21.15.7:0/1374304496 conn(0x7f33800099c0 msgr2=0x7f3380009dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:39.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.833+0000 7f338de00640 1 -- 172.21.15.7:0/1374304496 shutdown_connections 2024-09-13T15:11:39.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.833+0000 7f338de00640 1 -- 172.21.15.7:0/1374304496 wait complete. 2024-09-13T15:11:39.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.837+0000 7f338de00640 1 Processor -- start 2024-09-13T15:11:39.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.837+0000 7f338de00640 1 -- start start 2024-09-13T15:11:39.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.837+0000 7f338de00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f336c005190 0x7f3380178930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.837+0000 7f338de00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33800dd630 0x7f33800e5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.837+0000 7f338de00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33800e1970 0x7f33800de060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.837+0000 7f338de00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3380037980 con 0x7f33800e1970 2024-09-13T15:11:39.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.837+0000 7f338de00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33800df6d0 con 0x7f33800dd630 2024-09-13T15:11:39.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.837+0000 7f338de00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33800ddbd0 con 0x7f336c005190 2024-09-13T15:11:39.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.837+0000 7f3386000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33800dd630 0x7f33800e5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:39.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.837+0000 7f3386000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33800dd630 0x7f33800e5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:46282/0 (socket says 172.21.15.7:46282) 2024-09-13T15:11:39.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.837+0000 7f3386000640 1 -- 172.21.15.7:0/2110873586 learned_addr learned my addr 172.21.15.7:0/2110873586 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:39.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.841+0000 7f3386000640 1 -- 172.21.15.7:0/2110873586 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f336c005190 msgr2=0x7f3380178930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:11:39.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.841+0000 7f3386000640 1 --2- 172.21.15.7:0/2110873586 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f336c005190 0x7f3380178930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.841+0000 7f3386000640 1 -- 172.21.15.7:0/2110873586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33800e1970 msgr2=0x7f33800de060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:39.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.841+0000 7f3386000640 1 --2- 172.21.15.7:0/2110873586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33800e1970 0x7f33800de060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:39.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.841+0000 7f3386000640 1 -- 172.21.15.7:0/2110873586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3380037ed0 con 0x7f33800dd630 2024-09-13T15:11:39.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.841+0000 7f3386000640 1 --2- 172.21.15.7:0/2110873586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33800dd630 0x7f33800e5400 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3374009f80 tx=0x7f337400b7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:39.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.841+0000 7f337f400640 1 -- 172.21.15.7:0/2110873586 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374022640 con 0x7f33800dd630 2024-09-13T15:11:39.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.841+0000 7f337f400640 1 -- 172.21.15.7:0/2110873586 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33740227a0 con 0x7f33800dd630 2024-09-13T15:11:39.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.841+0000 7f337f400640 1 -- 172.21.15.7:0/2110873586 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374022b30 con 0x7f33800dd630 2024-09-13T15:11:39.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.841+0000 7f338de00640 1 -- 172.21.15.7:0/2110873586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33800e1eb0 con 0x7f33800dd630 2024-09-13T15:11:39.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.845+0000 7f338de00640 1 -- 172.21.15.7:0/2110873586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33800e2470 con 0x7f33800dd630 2024-09-13T15:11:39.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.845+0000 7f337cc00640 1 -- 172.21.15.7:0/2110873586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33800475c0 con 0x7f33800dd630 2024-09-13T15:11:39.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.861+0000 7f337f400640 1 -- 172.21.15.7:0/2110873586 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3374022c90 con 0x7f33800dd630 2024-09-13T15:11:39.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.869+0000 7f337f400640 1 --2- 172.21.15.7:0/2110873586 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3368066760 0x7f3368068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:39.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.869+0000 7f337f400640 1 -- 172.21.15.7:0/2110873586 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7f33740957c0 con 0x7f33800dd630 2024-09-13T15:11:39.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.869+0000 7f337f400640 1 -- 172.21.15.7:0/2110873586 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3374095c40 con 0x7f33800dd630 2024-09-13T15:11:39.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.873+0000 7f3386a00640 1 --2- 172.21.15.7:0/2110873586 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3368066760 0x7f3368068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:39.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:39.873+0000 7f3386a00640 1 --2- 172.21.15.7:0/2110873586 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3368066760 0x7f3368068c20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f33780095f0 tx=0x7f3378008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:40.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:40.289+0000 7f337cc00640 1 -- 172.21.15.7:0/2110873586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f338004d9e0 con 0x7f33800dd630 2024-09-13T15:11:40.295 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:11:40.295 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5198,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:11:37.947195+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:11:40.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:40.293+0000 7f337f400640 1 -- 172.21.15.7:0/2110873586 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+6284 (secure 0 0 0) 0x7f3374062650 con 0x7f33800dd630 2024-09-13T15:11:40.295 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 40 2024-09-13T15:11:40.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:40.297+0000 7f337cc00640 1 -- 172.21.15.7:0/2110873586 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3368066760 msgr2=0x7f3368068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:40.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:40.297+0000 7f337cc00640 1 --2- 172.21.15.7:0/2110873586 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3368066760 0x7f3368068c20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f33780095f0 tx=0x7f3378008040 comp rx=0 tx=0).stop 2024-09-13T15:11:40.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:40.297+0000 7f337cc00640 1 -- 172.21.15.7:0/2110873586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33800dd630 msgr2=0x7f33800e5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:40.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:40.297+0000 7f337cc00640 1 --2- 172.21.15.7:0/2110873586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33800dd630 0x7f33800e5400 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3374009f80 tx=0x7f337400b7f0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:40.301+0000 7f337cc00640 1 -- 172.21.15.7:0/2110873586 shutdown_connections 2024-09-13T15:11:40.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:40.301+0000 7f337cc00640 1 --2- 172.21.15.7:0/2110873586 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3368066760 0x7f3368068c20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:40.301+0000 7f337cc00640 1 --2- 172.21.15.7:0/2110873586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33800e1970 0x7f33800de060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:40.301+0000 7f337cc00640 1 --2- 172.21.15.7:0/2110873586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33800dd630 0x7f33800e5400 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:40.301+0000 7f337cc00640 1 --2- 172.21.15.7:0/2110873586 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f336c005190 0x7f3380178930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:40.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:40.301+0000 7f337cc00640 1 -- 172.21.15.7:0/2110873586 >> 172.21.15.7:0/2110873586 conn(0x7f33800099c0 msgr2=0x7f338004dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:40.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:40.301+0000 7f337cc00640 1 -- 172.21.15.7:0/2110873586 shutdown_connections 2024-09-13T15:11:40.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:40.301+0000 7f337cc00640 1 -- 172.21.15.7:0/2110873586 wait complete. 2024-09-13T15:11:40.356 INFO:tasks.mds_thrash.fs.[cephfs]:mds cluster has 4 alive and active, now stable! 2024-09-13T15:11:40.356 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.d (rank=2) 2024-09-13T15:11:40.356 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T15:11:40.356 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:11:46.056 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-13T15:11:46.459 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T15:11:46.459 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:52.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.700+0000 7fb538c00640 1 Processor -- start 2024-09-13T15:11:52.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.700+0000 7fb538c00640 1 -- start start 2024-09-13T15:11:52.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.704+0000 7fb538c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5340c5e90 0x7fb53406cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:52.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.704+0000 7fb538c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb534161ab0 con 0x7fb5340c6890 2024-09-13T15:11:52.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.704+0000 7fb538c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53406dbc0 con 0x7fb5340c5ab0 2024-09-13T15:11:52.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.704+0000 7fb538c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb534160f80 con 0x7fb5340c5e90 2024-09-13T15:11:52.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.704+0000 7fb531e00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb5340c5ab0 0x7fb5341613a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:56602/0 (socket says 172.21.15.7:56602) 2024-09-13T15:11:52.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.704+0000 7fb531e00640 1 -- 172.21.15.7:0/1427958272 learned_addr learned my addr 172.21.15.7:0/1427958272 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:11:52.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.704+0000 7fb532800640 1 --2- 172.21.15.7:0/1427958272 >> v2:172.21.15.7:3300/0 conn(0x7fb5340c5e90 0x7fb53406cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:52.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.704+0000 7fb532800640 1 -- 172.21.15.7:0/1427958272 >> v1:172.21.15.77:6789/0 conn(0x7fb5340c5ab0 legacy=0x7fb5341613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:52.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.704+0000 7fb532800640 1 -- 172.21.15.7:0/1427958272 >> v1:172.21.15.7:6789/0 conn(0x7fb5340c6890 legacy=0x7fb534157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:52.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.704+0000 7fb532800640 1 -- 172.21.15.7:0/1427958272 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53406d320 con 0x7fb5340c5e90 2024-09-13T15:11:52.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.712+0000 7fb532800640 1 --2- 172.21.15.7:0/1427958272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5340c5e90 0x7fb53406cce0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009dc0 tx=0x7fb52c01f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e3262e9a359dba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:52.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.712+0000 7fb530a00640 1 -- 172.21.15.7:0/1427958272 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c0af600 con 0x7fb5340c5e90 2024-09-13T15:11:52.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.724+0000 7fb530a00640 1 -- 172.21.15.7:0/1427958272 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c0ab050 con 0x7fb5340c5e90 2024-09-13T15:11:52.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.724+0000 7fb530a00640 1 -- 172.21.15.7:0/1427958272 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c0af980 con 0x7fb5340c5e90 2024-09-13T15:11:52.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.724+0000 7fb538c00640 1 -- 172.21.15.7:0/1427958272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5340c5e90 msgr2=0x7fb53406cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:52.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.724+0000 7fb538c00640 1 --2- 172.21.15.7:0/1427958272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5340c5e90 0x7fb53406cce0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009dc0 tx=0x7fb52c01f100 comp rx=0 tx=0).stop 2024-09-13T15:11:52.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.724+0000 7fb538c00640 1 -- 172.21.15.7:0/1427958272 shutdown_connections 2024-09-13T15:11:52.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.724+0000 7fb538c00640 1 --2- 172.21.15.7:0/1427958272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5340c5e90 0x7fb53406cce0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:52.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.724+0000 7fb538c00640 1 -- 172.21.15.7:0/1427958272 >> 172.21.15.7:0/1427958272 conn(0x7fb534065d40 msgr2=0x7fb534066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:52.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.724+0000 7fb538c00640 1 -- 172.21.15.7:0/1427958272 shutdown_connections 2024-09-13T15:11:52.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.728+0000 7fb538c00640 1 -- 172.21.15.7:0/1427958272 wait complete. 2024-09-13T15:11:52.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.732+0000 7fb538c00640 1 Processor -- start 2024-09-13T15:11:52.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.732+0000 7fb538c00640 1 -- start start 2024-09-13T15:11:52.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.732+0000 7fb538c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5340c5ab0 0x7fb53414f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:52.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.732+0000 7fb538c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5340c5e90 0x7fb53414c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:52.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.732+0000 7fb538c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5340c6890 0x7fb5341e8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:52.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.732+0000 7fb531e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5340c5ab0 0x7fb53414f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:52.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.732+0000 7fb531e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5340c5ab0 0x7fb53414f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47222/0 (socket says 172.21.15.7:47222) 2024-09-13T15:11:52.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.732+0000 7fb532800640 1 --2- 172.21.15.7:0/2947966146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5340c6890 0x7fb5341e8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:52.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.732+0000 7fb531e00640 1 -- 172.21.15.7:0/2947966146 learned_addr learned my addr 172.21.15.7:0/2947966146 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:52.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.732+0000 7fb538c00640 1 -- 172.21.15.7:0/2947966146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5340c2bf0 con 0x7fb5340c5ab0 2024-09-13T15:11:52.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.736+0000 7fb538c00640 1 -- 172.21.15.7:0/2947966146 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5341e7b30 con 0x7fb5340c6890 2024-09-13T15:11:52.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.736+0000 7fb538c00640 1 -- 172.21.15.7:0/2947966146 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5341e8e90 con 0x7fb5340c5e90 2024-09-13T15:11:52.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.736+0000 7fb531e00640 1 -- 172.21.15.7:0/2947966146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5340c5e90 msgr2=0x7fb53414c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:52.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.736+0000 7fb531e00640 1 --2- 172.21.15.7:0/2947966146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5340c5e90 0x7fb53414c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:52.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.736+0000 7fb531e00640 1 -- 172.21.15.7:0/2947966146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5340c6890 msgr2=0x7fb5341e8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:52.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.736+0000 7fb531e00640 1 --2- 172.21.15.7:0/2947966146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5340c6890 0x7fb5341e8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:52.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.736+0000 7fb531e00640 1 -- 172.21.15.7:0/2947966146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c009a70 con 0x7fb5340c5ab0 2024-09-13T15:11:52.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.736+0000 7fb531e00640 1 --2- 172.21.15.7:0/2947966146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5340c5ab0 0x7fb53414f290 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb52400c400 tx=0x7fb52400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:52.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.740+0000 7fb52a000640 1 -- 172.21.15.7:0/2947966146 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb524005cf0 con 0x7fb5340c5ab0 2024-09-13T15:11:52.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.740+0000 7fb52a000640 1 -- 172.21.15.7:0/2947966146 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb524005e50 con 0x7fb5340c5ab0 2024-09-13T15:11:52.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.740+0000 7fb52a000640 1 -- 172.21.15.7:0/2947966146 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5240072d0 con 0x7fb5340c5ab0 2024-09-13T15:11:52.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.740+0000 7fb538c00640 1 -- 172.21.15.7:0/2947966146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5341e9170 con 0x7fb5340c5ab0 2024-09-13T15:11:52.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.740+0000 7fb538c00640 1 -- 172.21.15.7:0/2947966146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5341f7230 con 0x7fb5340c5ab0 2024-09-13T15:11:52.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.744+0000 7fb538c00640 1 -- 172.21.15.7:0/2947966146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb534067650 con 0x7fb5340c5ab0 2024-09-13T15:11:52.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.756+0000 7fb52a000640 1 -- 172.21.15.7:0/2947966146 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb524007430 con 0x7fb5340c5ab0 2024-09-13T15:11:52.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.756+0000 7fb52a000640 1 --2- 172.21.15.7:0/2947966146 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb514066690 0x7fb514068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:52.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.756+0000 7fb52a000640 1 -- 172.21.15.7:0/2947966146 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7fb524054710 con 0x7fb5340c5ab0 2024-09-13T15:11:52.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.760+0000 7fb531400640 1 --2- 172.21.15.7:0/2947966146 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb514066690 0x7fb514068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:52.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.760+0000 7fb531400640 1 --2- 172.21.15.7:0/2947966146 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb514066690 0x7fb514068b50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb53414fa60 tx=0x7fb520006bd0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:52.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:52.776+0000 7fb52a000640 1 -- 172.21.15.7:0/2947966146 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb524086070 con 0x7fb5340c5ab0 2024-09-13T15:11:52.871 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-13T15:11:53.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:53.152+0000 7fb538c00640 1 -- 172.21.15.7:0/2947966146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5341e7ca0 con 0x7fb5340c5ab0 2024-09-13T15:11:53.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:53.152+0000 7fb52a000640 1 -- 172.21.15.7:0/2947966146 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+6284 (secure 0 0 0) 0x7fb524017090 con 0x7fb5340c5ab0 2024-09-13T15:11:53.154 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:11:53.155 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5198,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:11:37.947195+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:11:53.155 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 40 2024-09-13T15:11:53.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:53.156+0000 7fb538c00640 1 -- 172.21.15.7:0/2947966146 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb514066690 msgr2=0x7fb514068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:53.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:53.156+0000 7fb538c00640 1 --2- 172.21.15.7:0/2947966146 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb514066690 0x7fb514068b50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb53414fa60 tx=0x7fb520006bd0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:53.156+0000 7fb538c00640 1 -- 172.21.15.7:0/2947966146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5340c5ab0 msgr2=0x7fb53414f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:53.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:53.156+0000 7fb538c00640 1 --2- 172.21.15.7:0/2947966146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5340c5ab0 0x7fb53414f290 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb52400c400 tx=0x7fb52400c8c0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:53.156+0000 7fb538c00640 1 -- 172.21.15.7:0/2947966146 shutdown_connections 2024-09-13T15:11:53.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:53.156+0000 7fb538c00640 1 --2- 172.21.15.7:0/2947966146 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb514066690 0x7fb514068b50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:53.156+0000 7fb538c00640 1 --2- 172.21.15.7:0/2947966146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5340c6890 0x7fb5341e8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:53.156+0000 7fb538c00640 1 --2- 172.21.15.7:0/2947966146 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5340c5e90 0x7fb53414c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:53.156+0000 7fb538c00640 1 --2- 172.21.15.7:0/2947966146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5340c5ab0 0x7fb53414f290 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:53.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:53.156+0000 7fb538c00640 1 -- 172.21.15.7:0/2947966146 >> 172.21.15.7:0/2947966146 conn(0x7fb534065d40 msgr2=0x7fb534071650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:53.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:53.156+0000 7fb538c00640 1 -- 172.21.15.7:0/2947966146 shutdown_connections 2024-09-13T15:11:53.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:53.160+0000 7fb538c00640 1 -- 172.21.15.7:0/2947966146 wait complete. 2024-09-13T15:11:53.202 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-13T15:11:55.203 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:55.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.456+0000 7efea7200640 1 Processor -- start 2024-09-13T15:11:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.460+0000 7efea7200640 1 -- start start 2024-09-13T15:11:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.460+0000 7efea7200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efea00c77f0 0x7efea00c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.460+0000 7efea7200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efea00c7bd0 0x7efea0158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.460+0000 7efea7200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea0158720 con 0x7efea00c08a0 2024-09-13T15:11:55.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.460+0000 7efea7200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea0155130 con 0x7efea00c7bd0 2024-09-13T15:11:55.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.460+0000 7efea7200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea0155320 con 0x7efea00c77f0 2024-09-13T15:11:55.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.460+0000 7efe9fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efea00c77f0 0x7efea00c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:55.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.460+0000 7efe9fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efea00c77f0 0x7efea00c5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:56156/0 (socket says 172.21.15.7:56156) 2024-09-13T15:11:55.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.460+0000 7efe9fe00640 1 -- 172.21.15.7:0/2874807690 learned_addr learned my addr 172.21.15.7:0/2874807690 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:55.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.464+0000 7efe9f400640 1 --2- 172.21.15.7:0/2874807690 >> v2:172.21.15.77:3300/0 conn(0x7efea00c7bd0 0x7efea0158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:55.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.464+0000 7efe9fe00640 1 -- 172.21.15.7:0/2874807690 >> v2:172.21.15.77:3300/0 conn(0x7efea00c7bd0 msgr2=0x7efea0158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:55.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.464+0000 7efe9fe00640 1 --2- 172.21.15.7:0/2874807690 >> v2:172.21.15.77:3300/0 conn(0x7efea00c7bd0 0x7efea0158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:55.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.464+0000 7efe9fe00640 1 -- 172.21.15.7:0/2874807690 >> v1:172.21.15.7:6789/0 conn(0x7efea00c08a0 legacy=0x7efea014edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:55.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.464+0000 7efe9fe00640 1 -- 172.21.15.7:0/2874807690 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea01555e0 con 0x7efea00c77f0 2024-09-13T15:11:55.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.464+0000 7efe9f400640 1 --2- 172.21.15.7:0/2874807690 >> v2:172.21.15.77:3300/0 conn(0x7efea00c7bd0 0x7efea0158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:11:55.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.472+0000 7efe9fe00640 1 --2- 172.21.15.7:0/2874807690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efea00c77f0 0x7efea00c5cc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efe900091e0 tx=0x7efe9001d760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=accd993c28dabdc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:55.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.472+0000 7efe9ea00640 1 -- 172.21.15.7:0/2874807690 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe900a6810 con 0x7efea00c77f0 2024-09-13T15:11:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.472+0000 7efe9ea00640 1 -- 172.21.15.7:0/2874807690 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe900a6970 con 0x7efea00c77f0 2024-09-13T15:11:55.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.472+0000 7efe9ea00640 1 -- 172.21.15.7:0/2874807690 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe900a6810 con 0x7efea00c77f0 2024-09-13T15:11:55.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.476+0000 7efea7200640 1 -- 172.21.15.7:0/2874807690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efea00c77f0 msgr2=0x7efea00c5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:55.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.480+0000 7efea7200640 1 --2- 172.21.15.7:0/2874807690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efea00c77f0 0x7efea00c5cc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efe900091e0 tx=0x7efe9001d760 comp rx=0 tx=0).stop 2024-09-13T15:11:55.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.480+0000 7efea7200640 1 -- 172.21.15.7:0/2874807690 shutdown_connections 2024-09-13T15:11:55.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.480+0000 7efea7200640 1 --2- 172.21.15.7:0/2874807690 >> v2:172.21.15.77:3300/0 conn(0x7efea00c7bd0 0x7efea0158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:55.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.480+0000 7efea7200640 1 --2- 172.21.15.7:0/2874807690 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efea00c77f0 0x7efea00c5cc0 secure :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efe900091e0 tx=0x7efe9001d760 comp rx=0 tx=0).stop 2024-09-13T15:11:55.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.480+0000 7efea7200640 1 -- 172.21.15.7:0/2874807690 >> 172.21.15.7:0/2874807690 conn(0x7efea0065d40 msgr2=0x7efea0066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:55.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.480+0000 7efea7200640 1 -- 172.21.15.7:0/2874807690 shutdown_connections 2024-09-13T15:11:55.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.484+0000 7efea7200640 1 -- 172.21.15.7:0/2874807690 wait complete. 2024-09-13T15:11:55.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.488+0000 7efea7200640 1 Processor -- start 2024-09-13T15:11:55.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.488+0000 7efea7200640 1 -- start start 2024-09-13T15:11:55.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.492+0000 7efea7200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efea00c08a0 0x7efea0157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.492+0000 7efea7200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efea00c7bd0 0x7efea0134ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.492+0000 7efea7200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efea006d450 0x7efea0156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.492+0000 7efea7200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea0141f20 con 0x7efea00c7bd0 2024-09-13T15:11:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.492+0000 7efea7200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea01571c0 con 0x7efea006d450 2024-09-13T15:11:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.492+0000 7efea7200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea0142110 con 0x7efea00c08a0 2024-09-13T15:11:55.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.492+0000 7efea5200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efea006d450 0x7efea0156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:55.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.492+0000 7efea5200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efea006d450 0x7efea0156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:57776/0 (socket says 172.21.15.7:57776) 2024-09-13T15:11:55.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.492+0000 7efea5200640 1 -- 172.21.15.7:0/1683509797 learned_addr learned my addr 172.21.15.7:0/1683509797 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:55.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.492+0000 7efe9f400640 1 --2- 172.21.15.7:0/1683509797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efea00c7bd0 0x7efea0134ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:55.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.496+0000 7efea5200640 1 -- 172.21.15.7:0/1683509797 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efea00c08a0 msgr2=0x7efea0157ea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:11:55.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.496+0000 7efea5200640 1 --2- 172.21.15.7:0/1683509797 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efea00c08a0 0x7efea0157ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:55.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.496+0000 7efea5200640 1 -- 172.21.15.7:0/1683509797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efea00c7bd0 msgr2=0x7efea0134ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:55.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.496+0000 7efea5200640 1 --2- 172.21.15.7:0/1683509797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efea00c7bd0 0x7efea0134ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:55.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.496+0000 7efea5200640 1 -- 172.21.15.7:0/1683509797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe90009d60 con 0x7efea006d450 2024-09-13T15:11:55.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.504+0000 7efea5200640 1 --2- 172.21.15.7:0/1683509797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efea006d450 0x7efea0156380 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efe9800c790 tx=0x7efe9800cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:55.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.504+0000 7efe97e00640 1 -- 172.21.15.7:0/1683509797 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9800cea0 con 0x7efea006d450 2024-09-13T15:11:55.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.504+0000 7efe97e00640 1 -- 172.21.15.7:0/1683509797 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe98003b80 con 0x7efea006d450 2024-09-13T15:11:55.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.504+0000 7efe97e00640 1 -- 172.21.15.7:0/1683509797 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9800a7f0 con 0x7efea006d450 2024-09-13T15:11:55.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.508+0000 7efea7200640 1 -- 172.21.15.7:0/1683509797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea0138470 con 0x7efea006d450 2024-09-13T15:11:55.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.508+0000 7efea7200640 1 -- 172.21.15.7:0/1683509797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea01576a0 con 0x7efea006d450 2024-09-13T15:11:55.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.512+0000 7efea7200640 1 -- 172.21.15.7:0/1683509797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea0067650 con 0x7efea006d450 2024-09-13T15:11:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.520+0000 7efe97e00640 1 -- 172.21.15.7:0/1683509797 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efe9800a950 con 0x7efea006d450 2024-09-13T15:11:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.520+0000 7efe97e00640 1 --2- 172.21.15.7:0/1683509797 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efe80066760 0x7efe80068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:55.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.520+0000 7efe97e00640 1 -- 172.21.15.7:0/1683509797 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6921+0+0 (secure 0 0 0) 0x7efe98084b80 con 0x7efea006d450 2024-09-13T15:11:55.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.520+0000 7efe9fe00640 1 --2- 172.21.15.7:0/1683509797 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efe80066760 0x7efe80068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:55.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.528+0000 7efe9fe00640 1 --2- 172.21.15.7:0/1683509797 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efe80066760 0x7efe80068c20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efe900b0000 tx=0x7efe900a8070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:55.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.540+0000 7efe97e00640 1 -- 172.21.15.7:0/1683509797 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efe98051aa0 con 0x7efea006d450 2024-09-13T15:11:55.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.964+0000 7efea7200640 1 -- 172.21.15.7:0/1683509797 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efea00c5cc0 con 0x7efea006d450 2024-09-13T15:11:55.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.964+0000 7efe97e00640 1 -- 172.21.15.7:0/1683509797 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+6284 (secure 0 0 0) 0x7efe980550c0 con 0x7efea006d450 2024-09-13T15:11:55.972 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:11:55.972 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5198,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:11:37.947195+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":4252,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4252":{"gid":4252,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6835/2367107997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2367107997},{"type":"v1","addr":"172.21.15.77:6835","nonce":2367107997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:11:55.972 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 40 2024-09-13T15:11:55.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.976+0000 7efea7200640 1 -- 172.21.15.7:0/1683509797 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efe80066760 msgr2=0x7efe80068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:55.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.976+0000 7efea7200640 1 --2- 172.21.15.7:0/1683509797 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efe80066760 0x7efe80068c20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efe900b0000 tx=0x7efe900a8070 comp rx=0 tx=0).stop 2024-09-13T15:11:55.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.976+0000 7efea7200640 1 -- 172.21.15.7:0/1683509797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efea006d450 msgr2=0x7efea0156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:55.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.976+0000 7efea7200640 1 --2- 172.21.15.7:0/1683509797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efea006d450 0x7efea0156380 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efe9800c790 tx=0x7efe9800cc50 comp rx=0 tx=0).stop 2024-09-13T15:11:55.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.976+0000 7efea7200640 1 -- 172.21.15.7:0/1683509797 shutdown_connections 2024-09-13T15:11:55.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.976+0000 7efea7200640 1 --2- 172.21.15.7:0/1683509797 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efe80066760 0x7efe80068c20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:55.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.976+0000 7efea7200640 1 --2- 172.21.15.7:0/1683509797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efea006d450 0x7efea0156380 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:55.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.976+0000 7efea7200640 1 --2- 172.21.15.7:0/1683509797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efea00c7bd0 0x7efea0134ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:55.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.976+0000 7efea7200640 1 --2- 172.21.15.7:0/1683509797 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efea00c08a0 0x7efea0157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:55.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.976+0000 7efea7200640 1 -- 172.21.15.7:0/1683509797 >> 172.21.15.7:0/1683509797 conn(0x7efea0065d40 msgr2=0x7efea0071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:55.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.976+0000 7efea7200640 1 -- 172.21.15.7:0/1683509797 shutdown_connections 2024-09-13T15:11:55.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:55.980+0000 7efea7200640 1 -- 172.21.15.7:0/1683509797 wait complete. 2024-09-13T15:11:56.017 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-09-13T15:11:58.019 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:58.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.276+0000 7fecd8c00640 1 Processor -- start 2024-09-13T15:11:58.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.280+0000 7fecd8c00640 1 -- start start 2024-09-13T15:11:58.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.280+0000 7fecd8c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecd406fd80 0x7fecd40c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:58.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.280+0000 7fecd8c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fecd40c5e40 0x7fecd40c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:58.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.280+0000 7fecd8c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd4070160 con 0x7fecd40c70e0 2024-09-13T15:11:58.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.280+0000 7fecd8c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd40c6240 con 0x7fecd40c5e40 2024-09-13T15:11:58.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.280+0000 7fecd8c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd40c7510 con 0x7fecd406fd80 2024-09-13T15:11:58.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.280+0000 7fecd3e00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fecd40c70e0 0x7fecd4169220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:56604/0 (socket says 172.21.15.7:56604) 2024-09-13T15:11:58.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.280+0000 7fecd3e00640 1 -- 172.21.15.7:0/960844498 learned_addr learned my addr 172.21.15.7:0/960844498 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:11:58.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.280+0000 7fecd2a00640 1 -- 172.21.15.7:0/960844498 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553781309 0 0) 0x7fecd4070160 con 0x7fecd40c70e0 2024-09-13T15:11:58.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.280+0000 7fecd2a00640 1 -- 172.21.15.7:0/960844498 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecb8003530 con 0x7fecd40c70e0 2024-09-13T15:11:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.280+0000 7fecd3400640 1 --2- 172.21.15.7:0/960844498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecd406fd80 0x7fecd40c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7fecd2a00640 1 -- 172.21.15.7:0/960844498 <== mon.1 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 934964466 0 0) 0x7fecb8003530 con 0x7fecd40c70e0 2024-09-13T15:11:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7fecd2a00640 1 -- 172.21.15.7:0/960844498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecd406fd80 msgr2=0x7fecd40c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7fecd2a00640 1 --2- 172.21.15.7:0/960844498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecd406fd80 0x7fecd40c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7fecd2a00640 1 -- 172.21.15.7:0/960844498 >> v2:172.21.15.7:3300/0 conn(0x7fecd40c5e40 msgr2=0x7fecd40c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7fecd2a00640 1 --2- 172.21.15.7:0/960844498 >> v2:172.21.15.7:3300/0 conn(0x7fecd40c5e40 0x7fecd40c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7fecd2a00640 1 -- 172.21.15.7:0/960844498 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd40706d0 con 0x7fecd40c70e0 2024-09-13T15:11:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7fecd2a00640 1 -- 172.21.15.7:0/960844498 <== mon.1 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7feccc001a00 con 0x7fecd40c70e0 2024-09-13T15:11:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7fecd2a00640 1 -- 172.21.15.7:0/960844498 >> v1:172.21.15.77:6789/0 conn(0x7fecd40c70e0 legacy=0x7fecd4169220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7fecd2a00640 1 --2- 172.21.15.7:0/960844498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecb8003980 0x7fecb8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7fecd2a00640 1 --2- 172.21.15.7:0/960844498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecb80047d0 0x7fecb8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7fecd2a00640 1 --2- 172.21.15.7:0/960844498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecb8005190 0x7fecb800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7fecd2a00640 1 -- 172.21.15.7:0/960844498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd40c7510 con 0x7fecb8003980 2024-09-13T15:11:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7fecd2a00640 1 -- 172.21.15.7:0/960844498 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb800c010 con 0x7fecb8005190 2024-09-13T15:11:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7fecd2a00640 1 -- 172.21.15.7:0/960844498 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb800c1d0 con 0x7fecb80047d0 2024-09-13T15:11:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7feccbe00640 1 --2- 172.21.15.7:0/960844498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecb80047d0 0x7fecb8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7fecd3e00640 1 --2- 172.21.15.7:0/960844498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecb8005190 0x7fecb800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7feccbe00640 1 -- 172.21.15.7:0/960844498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecb8005190 msgr2=0x7fecb800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7feccbe00640 1 --2- 172.21.15.7:0/960844498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecb8005190 0x7fecb800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7feccbe00640 1 -- 172.21.15.7:0/960844498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecb8003980 msgr2=0x7fecb8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7feccbe00640 1 --2- 172.21.15.7:0/960844498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecb8003980 0x7fecb8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.284+0000 7feccbe00640 1 -- 172.21.15.7:0/960844498 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd40706d0 con 0x7fecb80047d0 2024-09-13T15:11:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.288+0000 7feccbe00640 1 --2- 172.21.15.7:0/960844498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecb80047d0 0x7fecb8004c50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009890 tx=0x7fecbc01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=599c58ab6892c697 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.288+0000 7fecd2a00640 1 -- 172.21.15.7:0/960844498 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0ab600 con 0x7fecb80047d0 2024-09-13T15:11:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.288+0000 7fecd2a00640 1 -- 172.21.15.7:0/960844498 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc0a7050 con 0x7fecb80047d0 2024-09-13T15:11:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.288+0000 7fecd2a00640 1 -- 172.21.15.7:0/960844498 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0aba00 con 0x7fecb80047d0 2024-09-13T15:11:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.292+0000 7fecd8c00640 1 -- 172.21.15.7:0/960844498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecb80047d0 msgr2=0x7fecb8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.292+0000 7fecd8c00640 1 --2- 172.21.15.7:0/960844498 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecb80047d0 0x7fecb8004c50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fecbc009890 tx=0x7fecbc01c3c0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.292+0000 7fecd3e00640 1 -- 172.21.15.7:0/960844498 reap_dead start 2024-09-13T15:11:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.292+0000 7fecd8c00640 1 -- 172.21.15.7:0/960844498 shutdown_connections 2024-09-13T15:11:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.292+0000 7fecd8c00640 1 -- 172.21.15.7:0/960844498 >> 172.21.15.7:0/960844498 conn(0x7fecd4065d40 msgr2=0x7fecd4066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.292+0000 7fecd8c00640 1 -- 172.21.15.7:0/960844498 shutdown_connections 2024-09-13T15:11:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.292+0000 7fecd8c00640 1 -- 172.21.15.7:0/960844498 wait complete. 2024-09-13T15:11:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.300+0000 7fecd8c00640 1 Processor -- start 2024-09-13T15:11:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.300+0000 7fecd8c00640 1 -- start start 2024-09-13T15:11:58.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7fecd8c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecb80047d0 0x7fecd4169430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:58.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7fecd8c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecd4169c20 0x7fecd41fc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:58.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7fecd8c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecd41fe650 0x7fecd40bc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:58.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7fecd8c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4169010 con 0x7fecb80047d0 2024-09-13T15:11:58.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7fecd8c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd40bcb90 con 0x7fecd4169c20 2024-09-13T15:11:58.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7fecd8c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4167e60 con 0x7fecd41fe650 2024-09-13T15:11:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7fecd3e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecd41fe650 0x7fecd40bc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7fecd3e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecd41fe650 0x7fecd40bc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:35556/0 (socket says 172.21.15.7:35556) 2024-09-13T15:11:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7fecd3e00640 1 -- 172.21.15.7:0/2683013064 learned_addr learned my addr 172.21.15.7:0/2683013064 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7feccbe00640 1 --2- 172.21.15.7:0/2683013064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecd4169c20 0x7fecd41fc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7feccbe00640 1 -- 172.21.15.7:0/2683013064 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecd41fe650 msgr2=0x7fecd40bc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7feccbe00640 1 --2- 172.21.15.7:0/2683013064 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecd41fe650 0x7fecd40bc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7feccbe00640 1 -- 172.21.15.7:0/2683013064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecb80047d0 msgr2=0x7fecd4169430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7feccbe00640 1 --2- 172.21.15.7:0/2683013064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecb80047d0 0x7fecd4169430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7feccbe00640 1 -- 172.21.15.7:0/2683013064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd41680b0 con 0x7fecd4169c20 2024-09-13T15:11:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7feccbe00640 1 --2- 172.21.15.7:0/2683013064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecd4169c20 0x7fecd41fc550 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fecb800c360 tx=0x7fecb8005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7feccb400640 1 -- 172.21.15.7:0/2683013064 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc003dc0 con 0x7fecd4169c20 2024-09-13T15:11:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7feccb400640 1 -- 172.21.15.7:0/2683013064 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc0bd850 con 0x7fecd4169c20 2024-09-13T15:11:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.304+0000 7feccb400640 1 -- 172.21.15.7:0/2683013064 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc0bdc00 con 0x7fecd4169c20 2024-09-13T15:11:58.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.308+0000 7fecd8c00640 1 -- 172.21.15.7:0/2683013064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd4168390 con 0x7fecd4169c20 2024-09-13T15:11:58.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.308+0000 7fecd8c00640 1 -- 172.21.15.7:0/2683013064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd4168950 con 0x7fecd4169c20 2024-09-13T15:11:58.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.312+0000 7fecd8c00640 1 -- 172.21.15.7:0/2683013064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd406f570 con 0x7fecd4169c20 2024-09-13T15:11:58.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.312+0000 7feccb400640 1 -- 172.21.15.7:0/2683013064 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fecbc0bd2e0 con 0x7fecd4169c20 2024-09-13T15:11:58.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.316+0000 7feccb400640 1 --2- 172.21.15.7:0/2683013064 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fecb0077710 0x7fecb0079bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:58.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.316+0000 7feccb400640 1 -- 172.21.15.7:0/2683013064 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fecbc11e590 con 0x7fecd4169c20 2024-09-13T15:11:58.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.316+0000 7fecd3400640 1 --2- 172.21.15.7:0/2683013064 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fecb0077710 0x7fecb0079bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:58.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.316+0000 7fecd3400640 1 --2- 172.21.15.7:0/2683013064 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fecb0077710 0x7fecb0079bd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fecd406dff0 tx=0x7fecc4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:58.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.320+0000 7feccb400640 1 -- 172.21.15.7:0/2683013064 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fecbc0eb2b0 con 0x7fecd4169c20 2024-09-13T15:11:58.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.768+0000 7fecd8c00640 1 -- 172.21.15.7:0/2683013064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecd4169150 con 0x7fecd4169c20 2024-09-13T15:11:58.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.776+0000 7feccb400640 1 -- 172.21.15.7:0/2683013064 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+5526 (secure 0 0 0) 0x7fecd4169150 con 0x7fecd4169c20 2024-09-13T15:11:58.779 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:11:58.779 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:11:57.742114+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:11:58.779 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 41 2024-09-13T15:11:58.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.784+0000 7fecd8c00640 1 -- 172.21.15.7:0/2683013064 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fecb0077710 msgr2=0x7fecb0079bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:58.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.784+0000 7fecd8c00640 1 --2- 172.21.15.7:0/2683013064 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fecb0077710 0x7fecb0079bd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fecd406dff0 tx=0x7fecc4008040 comp rx=0 tx=0).stop 2024-09-13T15:11:58.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.784+0000 7fecd8c00640 1 -- 172.21.15.7:0/2683013064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecd4169c20 msgr2=0x7fecd41fc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:58.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.784+0000 7fecd8c00640 1 --2- 172.21.15.7:0/2683013064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecd4169c20 0x7fecd41fc550 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fecb800c360 tx=0x7fecb8005800 comp rx=0 tx=0).stop 2024-09-13T15:11:58.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.788+0000 7fecd8c00640 1 -- 172.21.15.7:0/2683013064 shutdown_connections 2024-09-13T15:11:58.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.788+0000 7fecd8c00640 1 --2- 172.21.15.7:0/2683013064 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fecb0077710 0x7fecb0079bd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.788+0000 7fecd8c00640 1 --2- 172.21.15.7:0/2683013064 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fecd41fe650 0x7fecd40bc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.788+0000 7fecd8c00640 1 --2- 172.21.15.7:0/2683013064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fecd4169c20 0x7fecd41fc550 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.788+0000 7fecd8c00640 1 --2- 172.21.15.7:0/2683013064 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fecb80047d0 0x7fecd4169430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:58.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.788+0000 7fecd8c00640 1 -- 172.21.15.7:0/2683013064 >> 172.21.15.7:0/2683013064 conn(0x7fecd4065d40 msgr2=0x7fecd40ca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.788+0000 7fecd8c00640 1 -- 172.21.15.7:0/2683013064 shutdown_connections 2024-09-13T15:11:58.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:58.792+0000 7fecd8c00640 1 -- 172.21.15.7:0/2683013064 wait complete. 2024-09-13T15:11:58.849 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d down, removed from mdsmap 2024-09-13T15:11:58.849 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-09-13T15:11:58.850 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:11:59.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.196+0000 7f7c26600640 1 Processor -- start 2024-09-13T15:11:59.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.196+0000 7f7c26600640 1 -- start start 2024-09-13T15:11:59.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.200+0000 7f7c26600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c200c6890 0x7f7c2006cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:59.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.200+0000 7f7c26600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7c200c5e90 0x7f7c200c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:59.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.200+0000 7f7c26600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c20161ab0 con 0x7f7c200c5ab0 2024-09-13T15:11:59.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.200+0000 7f7c26600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c20160f80 con 0x7f7c200c5e90 2024-09-13T15:11:59.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.200+0000 7f7c26600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2006dbc0 con 0x7f7c200c6890 2024-09-13T15:11:59.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.200+0000 7f7c1f400640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f7c200c5ab0 0x7f7c201613a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:45364/0 (socket says 172.21.15.7:45364) 2024-09-13T15:11:59.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.200+0000 7f7c1f400640 1 -- 172.21.15.7:0/863395404 learned_addr learned my addr 172.21.15.7:0/863395404 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:11:59.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.200+0000 7f7c1fe00640 1 --2- 172.21.15.7:0/863395404 >> v2:172.21.15.77:3300/0 conn(0x7f7c200c5e90 0x7f7c200c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:59.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.200+0000 7f7c1e000640 1 -- 172.21.15.7:0/863395404 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370262423 0 0) 0x7f7c180014a0 con 0x7f7c200c5ab0 2024-09-13T15:11:59.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.200+0000 7f7c1e000640 1 -- 172.21.15.7:0/863395404 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c04003530 con 0x7f7c200c5ab0 2024-09-13T15:11:59.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.200+0000 7f7c1ea00640 1 --2- 172.21.15.7:0/863395404 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c200c6890 0x7f7c2006cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:59.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.200+0000 7f7c1fe00640 1 -- 172.21.15.7:0/863395404 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c200c6890 msgr2=0x7f7c2006cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:11:59.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.200+0000 7f7c1fe00640 1 --2- 172.21.15.7:0/863395404 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c200c6890 0x7f7c2006cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.200+0000 7f7c1fe00640 1 -- 172.21.15.7:0/863395404 >> v1:172.21.15.77:6789/0 conn(0x7f7c200c5ab0 legacy=0x7f7c201613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:59.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.200+0000 7f7c1fe00640 1 -- 172.21.15.7:0/863395404 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2006d320 con 0x7f7c200c5e90 2024-09-13T15:11:59.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.212+0000 7f7c1fe00640 1 --2- 172.21.15.7:0/863395404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c200c5e90 0x7f7c200c6ea0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0097c0 tx=0x7f7c0c01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c4de5fe8b371c58 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:59.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.212+0000 7f7c1e000640 1 -- 172.21.15.7:0/863395404 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c0a8990 con 0x7f7c200c5e90 2024-09-13T15:11:59.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.212+0000 7f7c1e000640 1 -- 172.21.15.7:0/863395404 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c0a8af0 con 0x7f7c200c5e90 2024-09-13T15:11:59.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.212+0000 7f7c1e000640 1 -- 172.21.15.7:0/863395404 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c0a8990 con 0x7f7c200c5e90 2024-09-13T15:11:59.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.212+0000 7f7c26600640 1 -- 172.21.15.7:0/863395404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c200c5e90 msgr2=0x7f7c200c6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:59.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.212+0000 7f7c26600640 1 --2- 172.21.15.7:0/863395404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c200c5e90 0x7f7c200c6ea0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0097c0 tx=0x7f7c0c01ec90 comp rx=0 tx=0).stop 2024-09-13T15:11:59.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.212+0000 7f7c26600640 1 -- 172.21.15.7:0/863395404 shutdown_connections 2024-09-13T15:11:59.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.212+0000 7f7c26600640 1 --2- 172.21.15.7:0/863395404 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c200c5e90 0x7f7c200c6ea0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.212+0000 7f7c26600640 1 --2- 172.21.15.7:0/863395404 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c200c6890 0x7f7c2006cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.212+0000 7f7c26600640 1 -- 172.21.15.7:0/863395404 >> 172.21.15.7:0/863395404 conn(0x7f7c20065d40 msgr2=0x7f7c20066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:59.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.212+0000 7f7c26600640 1 -- 172.21.15.7:0/863395404 shutdown_connections 2024-09-13T15:11:59.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.212+0000 7f7c26600640 1 -- 172.21.15.7:0/863395404 wait complete. 2024-09-13T15:11:59.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.220+0000 7f7c26600640 1 Processor -- start 2024-09-13T15:11:59.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.220+0000 7f7c26600640 1 -- start start 2024-09-13T15:11:59.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.220+0000 7f7c26600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c200c5ab0 0x7f7c20157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:59.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.220+0000 7f7c26600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c200c5e90 0x7f7c201f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:59.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.220+0000 7f7c26600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c200c6890 0x7f7c2014cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:59.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.220+0000 7f7c26600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200c8cb0 con 0x7f7c200c5e90 2024-09-13T15:11:59.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.220+0000 7f7c26600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c201f7080 con 0x7f7c200c6890 2024-09-13T15:11:59.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.220+0000 7f7c26600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c201f7360 con 0x7f7c200c5ab0 2024-09-13T15:11:59.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.220+0000 7f7c1fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c200c6890 0x7f7c2014cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:59.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.220+0000 7f7c1fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c200c6890 0x7f7c2014cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:57372/0 (socket says 172.21.15.7:57372) 2024-09-13T15:11:59.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.220+0000 7f7c1fe00640 1 -- 172.21.15.7:0/1284757210 learned_addr learned my addr 172.21.15.7:0/1284757210 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:11:59.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.224+0000 7f7c1fe00640 1 -- 172.21.15.7:0/1284757210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c200c5ab0 msgr2=0x7f7c20157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:59.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.220+0000 7f7c1ea00640 1 --2- 172.21.15.7:0/1284757210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c200c5e90 0x7f7c201f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:59.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.220+0000 7f7c1f400640 1 --2- 172.21.15.7:0/1284757210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c200c5ab0 0x7f7c20157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:59.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.228+0000 7f7c1fe00640 1 --2- 172.21.15.7:0/1284757210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c200c5ab0 0x7f7c20157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.228+0000 7f7c1fe00640 1 -- 172.21.15.7:0/1284757210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c200c5e90 msgr2=0x7f7c201f2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:59.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.228+0000 7f7c1fe00640 1 --2- 172.21.15.7:0/1284757210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c200c5e90 0x7f7c201f2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.228+0000 7f7c1fe00640 1 -- 172.21.15.7:0/1284757210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c009420 con 0x7f7c200c6890 2024-09-13T15:11:59.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.228+0000 7f7c1fe00640 1 --2- 172.21.15.7:0/1284757210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c200c6890 0x7f7c2014cb80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0b3040 tx=0x7f7c0c01ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:59.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.228+0000 7f7c17400640 1 -- 172.21.15.7:0/1284757210 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c003820 con 0x7f7c200c6890 2024-09-13T15:11:59.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.228+0000 7f7c17400640 1 -- 172.21.15.7:0/1284757210 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c003980 con 0x7f7c200c6890 2024-09-13T15:11:59.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.228+0000 7f7c17400640 1 -- 172.21.15.7:0/1284757210 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c003cf0 con 0x7f7c200c6890 2024-09-13T15:11:59.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.232+0000 7f7c1ea00640 1 --2- 172.21.15.7:0/1284757210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c200c5e90 0x7f7c201f2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:59.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.232+0000 7f7c26600640 1 -- 172.21.15.7:0/1284757210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2015a980 con 0x7f7c200c6890 2024-09-13T15:11:59.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.232+0000 7f7c26600640 1 -- 172.21.15.7:0/1284757210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2015af40 con 0x7f7c200c6890 2024-09-13T15:11:59.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.232+0000 7f7c1f400640 1 --2- 172.21.15.7:0/1284757210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c200c5ab0 0x7f7c20157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:11:59.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.236+0000 7f7c26600640 1 -- 172.21.15.7:0/1284757210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf8005260 con 0x7f7c200c6890 2024-09-13T15:11:59.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.236+0000 7f7c17400640 1 -- 172.21.15.7:0/1284757210 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c0c0b7040 con 0x7f7c200c6890 2024-09-13T15:11:59.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.240+0000 7f7c17400640 1 --2- 172.21.15.7:0/1284757210 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c00066690 0x7f7c00068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:11:59.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.240+0000 7f7c17400640 1 -- 172.21.15.7:0/1284757210 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f7c0c1223f0 con 0x7f7c200c6890 2024-09-13T15:11:59.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.240+0000 7f7c1f400640 1 --2- 172.21.15.7:0/1284757210 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c00066690 0x7f7c00068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:11:59.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.240+0000 7f7c1f400640 1 --2- 172.21.15.7:0/1284757210 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c00066690 0x7f7c00068b50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7c18007fd0 tx=0x7f7c18009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:11:59.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.248+0000 7f7c17400640 1 -- 172.21.15.7:0/1284757210 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7c0c0ef1c0 con 0x7f7c200c6890 2024-09-13T15:11:59.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.676+0000 7f7c26600640 1 -- 172.21.15.7:0/1284757210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bf8005a90 con 0x7f7c200c6890 2024-09-13T15:11:59.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.676+0000 7f7c17400640 1 -- 172.21.15.7:0/1284757210 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+5526 (secure 0 0 0) 0x7f7c0c0f27e0 con 0x7f7c200c6890 2024-09-13T15:11:59.680 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:11:59.680 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:11:57.742114+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:11:59.680 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 41 2024-09-13T15:11:59.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.680+0000 7f7c26600640 1 -- 172.21.15.7:0/1284757210 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c00066690 msgr2=0x7f7c00068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:59.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.680+0000 7f7c26600640 1 --2- 172.21.15.7:0/1284757210 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c00066690 0x7f7c00068b50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7c18007fd0 tx=0x7f7c18009040 comp rx=0 tx=0).stop 2024-09-13T15:11:59.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.680+0000 7f7c26600640 1 -- 172.21.15.7:0/1284757210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c200c6890 msgr2=0x7f7c2014cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:11:59.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.680+0000 7f7c26600640 1 --2- 172.21.15.7:0/1284757210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c200c6890 0x7f7c2014cb80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c0b3040 tx=0x7f7c0c01ba30 comp rx=0 tx=0).stop 2024-09-13T15:11:59.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.688+0000 7f7c26600640 1 -- 172.21.15.7:0/1284757210 shutdown_connections 2024-09-13T15:11:59.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.688+0000 7f7c26600640 1 --2- 172.21.15.7:0/1284757210 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7c00066690 0x7f7c00068b50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.688+0000 7f7c26600640 1 --2- 172.21.15.7:0/1284757210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7c200c6890 0x7f7c2014cb80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.688+0000 7f7c26600640 1 --2- 172.21.15.7:0/1284757210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7c200c5e90 0x7f7c201f2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.688+0000 7f7c26600640 1 --2- 172.21.15.7:0/1284757210 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7c200c5ab0 0x7f7c20157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:11:59.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.688+0000 7f7c26600640 1 -- 172.21.15.7:0/1284757210 >> 172.21.15.7:0/1284757210 conn(0x7f7c20065d40 msgr2=0x7f7c200b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:11:59.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.692+0000 7f7c26600640 1 -- 172.21.15.7:0/1284757210 shutdown_connections 2024-09-13T15:11:59.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:11:59.692+0000 7f7c26600640 1 -- 172.21.15.7:0/1284757210 wait complete. 2024-09-13T15:11:59.744 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 41, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-13T15:01:44.789559+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 41, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3 ], "info": { "gid_4267": { "addr": "172.21.15.77:6839/2233000674", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6837", "nonce": 2233000674, "type": "v2" }, { "addr": "172.21.15.77:6839", "nonce": 2233000674, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4267, "incarnation": 9, "join_fscid": -1, "name": "f", "rank": 1, "state": "up:active", "state_seq": 41 }, "gid_4276": { "addr": "172.21.15.7:6836/2396967179", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6834", "nonce": 2396967179, "type": "v2" }, { "addr": "172.21.15.7:6836", "nonce": 2396967179, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4276, "incarnation": 4, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_5069": { "addr": "172.21.15.77:6838/877425259", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6836", "nonce": 877425259, "type": "v2" }, { "addr": "172.21.15.77:6838", "nonce": 877425259, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5069, "incarnation": 31, "join_fscid": -1, "name": "b", "rank": 3, "state": "up:active", "state_seq": 43 }, "gid_5198": { "addr": "172.21.15.7:6833/1355774527", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6832", "nonce": 1355774527, "type": "v2" }, { "addr": "172.21.15.7:6833", "nonce": 1355774527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5198, "incarnation": 41, "join_fscid": -1, "name": "e", "rank": 2, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 4, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-13T15:11:57.742114+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [ 4 ], "tableserver": 0, "up": { "mds_0": 4276, "mds_1": 4267, "mds_2": 5198, "mds_3": 5069 } } } ], "standbys": [ { "addr": "172.21.15.7:6837/3708232086", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6835", "nonce": 3708232086, "type": "v2" }, { "addr": "172.21.15.7:6837", "nonce": 3708232086, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 36, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5156, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-13T15:12:01.745 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:02.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.004+0000 7f72b4a00640 1 Processor -- start 2024-09-13T15:12:02.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.008+0000 7f72b4a00640 1 -- start start 2024-09-13T15:12:02.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.008+0000 7f72b4a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f72b00c6890 0x7f72b006cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:02.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.008+0000 7f72b4a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b0161ab0 con 0x7f72b00c5e90 2024-09-13T15:12:02.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.008+0000 7f72b4a00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b006dbc0 con 0x7f72b00c5ab0 2024-09-13T15:12:02.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.008+0000 7f72b4a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b0160f80 con 0x7f72b00c6890 2024-09-13T15:12:02.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.008+0000 7f72ae800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f72b00c5e90 0x7f72b0157280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:54460/0 (socket says 172.21.15.7:54460) 2024-09-13T15:12:02.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.008+0000 7f72ae800640 1 -- 172.21.15.7:0/3692834527 learned_addr learned my addr 172.21.15.7:0/3692834527 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:12:02.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72aca00640 1 -- 172.21.15.7:0/3692834527 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447546094 0 0) 0x7f72a80014a0 con 0x7f72b00c5e90 2024-09-13T15:12:02.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72aca00640 1 -- 172.21.15.7:0/3692834527 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7294003530 con 0x7f72b00c5e90 2024-09-13T15:12:02.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72aca00640 1 -- 172.21.15.7:0/3692834527 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2893947013 0 0) 0x7f72b006dbc0 con 0x7f72b00c5ab0 2024-09-13T15:12:02.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72aca00640 1 -- 172.21.15.7:0/3692834527 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7294003850 con 0x7f72b00c5ab0 2024-09-13T15:12:02.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72aca00640 1 -- 172.21.15.7:0/3692834527 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2967244287 0 0) 0x7f7294003530 con 0x7f72b00c5e90 2024-09-13T15:12:02.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72aca00640 1 -- 172.21.15.7:0/3692834527 >> v2:172.21.15.7:3300/0 conn(0x7f72b00c6890 msgr2=0x7f72b006cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:02.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72aca00640 1 --2- 172.21.15.7:0/3692834527 >> v2:172.21.15.7:3300/0 conn(0x7f72b00c6890 0x7f72b006cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72aca00640 1 -- 172.21.15.7:0/3692834527 >> v1:172.21.15.77:6789/0 conn(0x7f72b00c5ab0 legacy=0x7f72b01613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:02.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72aca00640 1 -- 172.21.15.7:0/3692834527 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b006d320 con 0x7f72b00c5e90 2024-09-13T15:12:02.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72aca00640 1 -- 172.21.15.7:0/3692834527 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f72a8001b70 con 0x7f72b00c5e90 2024-09-13T15:12:02.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72aca00640 1 -- 172.21.15.7:0/3692834527 >> v1:172.21.15.7:6789/0 conn(0x7f72b00c5e90 legacy=0x7f72b0157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:02.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72aca00640 1 --2- 172.21.15.7:0/3692834527 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7294003cc0 0x7f72940040e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:02.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72aca00640 1 --2- 172.21.15.7:0/3692834527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72940047d0 0x7f7294004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:02.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72aca00640 1 --2- 172.21.15.7:0/3692834527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7294009980 0x7f729400bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:02.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72aca00640 1 -- 172.21.15.7:0/3692834527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b0160f80 con 0x7f7294009980 2024-09-13T15:12:02.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72aca00640 1 -- 172.21.15.7:0/3692834527 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729400c370 con 0x7f72940047d0 2024-09-13T15:12:02.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72aca00640 1 -- 172.21.15.7:0/3692834527 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729400c530 con 0x7f7294003cc0 2024-09-13T15:12:02.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72ade00640 1 --2- 172.21.15.7:0/3692834527 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7294003cc0 0x7f72940040e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:02.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72ae800640 1 --2- 172.21.15.7:0/3692834527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7294009980 0x7f729400bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:02.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72ade00640 1 -- 172.21.15.7:0/3692834527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72940047d0 msgr2=0x7f7294004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:12:02.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72ade00640 1 --2- 172.21.15.7:0/3692834527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72940047d0 0x7f7294004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72ade00640 1 -- 172.21.15.7:0/3692834527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7294009980 msgr2=0x7f729400bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:02.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72ade00640 1 --2- 172.21.15.7:0/3692834527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7294009980 0x7f729400bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72ade00640 1 -- 172.21.15.7:0/3692834527 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7294003530 con 0x7f7294003cc0 2024-09-13T15:12:02.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72ae800640 1 --2- 172.21.15.7:0/3692834527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7294009980 0x7f729400bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:02.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.012+0000 7f72ae800640 1 -- 172.21.15.7:0/3692834527 reap_dead start 2024-09-13T15:12:02.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.016+0000 7f72ade00640 1 --2- 172.21.15.7:0/3692834527 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7294003cc0 0x7f72940040e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f72a00018d0 tx=0x7f72a001c580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e21f8bff81c5f070 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:02.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.020+0000 7f72aca00640 1 -- 172.21.15.7:0/3692834527 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a00052d0 con 0x7f7294003cc0 2024-09-13T15:12:02.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.020+0000 7f72aca00640 1 -- 172.21.15.7:0/3692834527 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a0005450 con 0x7f7294003cc0 2024-09-13T15:12:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.020+0000 7f72aca00640 1 -- 172.21.15.7:0/3692834527 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a0003840 con 0x7f7294003cc0 2024-09-13T15:12:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.020+0000 7f72b4a00640 1 -- 172.21.15.7:0/3692834527 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7294003cc0 msgr2=0x7f72940040e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:02.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.020+0000 7f72b4a00640 1 --2- 172.21.15.7:0/3692834527 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7294003cc0 0x7f72940040e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f72a00018d0 tx=0x7f72a001c580 comp rx=0 tx=0).stop 2024-09-13T15:12:02.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.032+0000 7f72b4a00640 1 -- 172.21.15.7:0/3692834527 shutdown_connections 2024-09-13T15:12:02.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.032+0000 7f72b4a00640 1 --2- 172.21.15.7:0/3692834527 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7294003cc0 0x7f72940040e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.032+0000 7f72b4a00640 1 -- 172.21.15.7:0/3692834527 >> 172.21.15.7:0/3692834527 conn(0x7f72b0065d40 msgr2=0x7f72b0066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:02.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.036+0000 7f72b4a00640 1 -- 172.21.15.7:0/3692834527 shutdown_connections 2024-09-13T15:12:02.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.036+0000 7f72b4a00640 1 -- 172.21.15.7:0/3692834527 wait complete. 2024-09-13T15:12:02.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.040+0000 7f72b4a00640 1 Processor -- start 2024-09-13T15:12:02.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.048+0000 7f72b4a00640 1 -- start start 2024-09-13T15:12:02.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.048+0000 7f72b4a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7294003cc0 0x7f72b015b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:02.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.048+0000 7f72b4a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72b015ac80 0x7f72b00c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:02.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72ade00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7294003cc0 0x7f72b015b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:02.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72ade00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7294003cc0 0x7f72b015b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:35592/0 (socket says 172.21.15.7:35592) 2024-09-13T15:12:02.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72ad400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72b015ac80 0x7f72b00c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:02.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72ade00640 1 -- 172.21.15.7:0/638964163 learned_addr learned my addr 172.21.15.7:0/638964163 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:12:02.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72b4a00640 1 --2- 172.21.15.7:0/638964163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72b0158380 0x7f72b00c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:02.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72b4a00640 1 -- 172.21.15.7:0/638964163 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b015b920 con 0x7f72b015ac80 2024-09-13T15:12:02.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72b4a00640 1 -- 172.21.15.7:0/638964163 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b00c4e10 con 0x7f72b0158380 2024-09-13T15:12:02.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72b4a00640 1 -- 172.21.15.7:0/638964163 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b015a730 con 0x7f7294003cc0 2024-09-13T15:12:02.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72ae800640 1 --2- 172.21.15.7:0/638964163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72b0158380 0x7f72b00c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:02.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72ae800640 1 -- 172.21.15.7:0/638964163 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7294003cc0 msgr2=0x7f72b015b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:02.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72ae800640 1 --2- 172.21.15.7:0/638964163 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7294003cc0 0x7f72b015b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72ae800640 1 -- 172.21.15.7:0/638964163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72b015ac80 msgr2=0x7f72b00c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:02.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72ae800640 1 --2- 172.21.15.7:0/638964163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72b015ac80 0x7f72b00c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72ae800640 1 -- 172.21.15.7:0/638964163 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b015a170 con 0x7f72b0158380 2024-09-13T15:12:02.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72ae800640 1 --2- 172.21.15.7:0/638964163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72b0158380 0x7f72b00c47e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f72b00c6c70 tx=0x7f72a800b4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:02.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72a6000640 1 -- 172.21.15.7:0/638964163 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a800bb80 con 0x7f72b0158380 2024-09-13T15:12:02.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72a6000640 1 -- 172.21.15.7:0/638964163 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a800bce0 con 0x7f72b0158380 2024-09-13T15:12:02.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.052+0000 7f72a6000640 1 -- 172.21.15.7:0/638964163 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a8007290 con 0x7f72b0158380 2024-09-13T15:12:02.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.056+0000 7f72b4a00640 1 -- 172.21.15.7:0/638964163 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b015a450 con 0x7f72b0158380 2024-09-13T15:12:02.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.056+0000 7f72b4a00640 1 -- 172.21.15.7:0/638964163 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b00c23b0 con 0x7f72b0158380 2024-09-13T15:12:02.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.060+0000 7f72b4a00640 1 -- 172.21.15.7:0/638964163 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b0067650 con 0x7f72b0158380 2024-09-13T15:12:02.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.060+0000 7f72a6000640 1 -- 172.21.15.7:0/638964163 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f72a80073f0 con 0x7f72b0158380 2024-09-13T15:12:02.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.064+0000 7f72a6000640 1 --2- 172.21.15.7:0/638964163 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7290066760 0x7f7290068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:02.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.064+0000 7f72a6000640 1 -- 172.21.15.7:0/638964163 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f72a8084800 con 0x7f72b0158380 2024-09-13T15:12:02.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.072+0000 7f72ade00640 1 --2- 172.21.15.7:0/638964163 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7290066760 0x7f7290068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:02.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.076+0000 7f72ade00640 1 --2- 172.21.15.7:0/638964163 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7290066760 0x7f7290068c20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f72a001c3b0 tx=0x7f72a00a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:02.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.080+0000 7f72a6000640 1 -- 172.21.15.7:0/638964163 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f72a80515b0 con 0x7f72b0158380 2024-09-13T15:12:02.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.544+0000 7f72b4a00640 1 -- 172.21.15.7:0/638964163 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72b0161ab0 con 0x7f72b0158380 2024-09-13T15:12:02.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.548+0000 7f72a6000640 1 -- 172.21.15.7:0/638964163 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+5526 (secure 0 0 0) 0x7f72b0161ab0 con 0x7f72b0158380 2024-09-13T15:12:02.549 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:12:02.552 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":41,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:11:57.742114+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:replay","state_seq":1,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:12:02.552 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 41 2024-09-13T15:12:02.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.572+0000 7f72b4a00640 1 -- 172.21.15.7:0/638964163 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7290066760 msgr2=0x7f7290068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:02.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.572+0000 7f72b4a00640 1 --2- 172.21.15.7:0/638964163 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7290066760 0x7f7290068c20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f72a001c3b0 tx=0x7f72a00a7000 comp rx=0 tx=0).stop 2024-09-13T15:12:02.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.572+0000 7f72b4a00640 1 -- 172.21.15.7:0/638964163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72b0158380 msgr2=0x7f72b00c47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:02.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.572+0000 7f72b4a00640 1 --2- 172.21.15.7:0/638964163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72b0158380 0x7f72b00c47e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f72b00c6c70 tx=0x7f72a800b4a0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.576+0000 7f72b4a00640 1 -- 172.21.15.7:0/638964163 shutdown_connections 2024-09-13T15:12:02.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.576+0000 7f72b4a00640 1 --2- 172.21.15.7:0/638964163 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7290066760 0x7f7290068c20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.576+0000 7f72b4a00640 1 --2- 172.21.15.7:0/638964163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72b0158380 0x7f72b00c47e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.576+0000 7f72b4a00640 1 --2- 172.21.15.7:0/638964163 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72b015ac80 0x7f72b00c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.576+0000 7f72b4a00640 1 --2- 172.21.15.7:0/638964163 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7294003cc0 0x7f72b015b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:02.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.576+0000 7f72b4a00640 1 -- 172.21.15.7:0/638964163 >> 172.21.15.7:0/638964163 conn(0x7f72b0065d40 msgr2=0x7f72b0156810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:02.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.584+0000 7f72b4a00640 1 -- 172.21.15.7:0/638964163 shutdown_connections 2024-09-13T15:12:02.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:02.584+0000 7f72b4a00640 1 -- 172.21.15.7:0/638964163 wait complete. 2024-09-13T15:12:02.642 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:12:04.643 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:04.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.948+0000 7f92b5200640 1 Processor -- start 2024-09-13T15:12:04.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.948+0000 7f92b5200640 1 -- start start 2024-09-13T15:12:04.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.952+0000 7f92b5200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f92b00c77f0 0x7f92b00c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:04.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.952+0000 7f92ade00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f92b00c77f0 0x7f92b00c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:04.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.952+0000 7f92ade00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f92b00c77f0 0x7f92b00c5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:57412/0 (socket says 172.21.15.7:57412) 2024-09-13T15:12:04.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.952+0000 7f92ade00640 1 -- 172.21.15.7:0/82711636 learned_addr learned my addr 172.21.15.7:0/82711636 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:12:04.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.952+0000 7f92b5200640 1 --2- 172.21.15.7:0/82711636 >> v2:172.21.15.7:3300/0 conn(0x7f92b01592c0 0x7f92b014edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:04.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.952+0000 7f92b5200640 1 -- 172.21.15.7:0/82711636 --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b0158720 con 0x7f92b00c7bd0 2024-09-13T15:12:04.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.952+0000 7f92b5200640 1 -- 172.21.15.7:0/82711636 --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b0155130 con 0x7f92b01592c0 2024-09-13T15:12:04.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.952+0000 7f92b5200640 1 -- 172.21.15.7:0/82711636 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b0155320 con 0x7f92b00c77f0 2024-09-13T15:12:04.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.952+0000 7f92ae800640 1 --2- 172.21.15.7:0/82711636 >> v2:172.21.15.7:3300/0 conn(0x7f92b01592c0 0x7f92b014edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:04.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.952+0000 7f92ade00640 1 -- 172.21.15.7:0/82711636 >> v2:172.21.15.7:3300/0 conn(0x7f92b01592c0 msgr2=0x7f92b014edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:04.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.952+0000 7f92ade00640 1 --2- 172.21.15.7:0/82711636 >> v2:172.21.15.7:3300/0 conn(0x7f92b01592c0 0x7f92b014edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.952+0000 7f92ade00640 1 -- 172.21.15.7:0/82711636 >> v1:172.21.15.7:6789/0 conn(0x7f92b00c7bd0 legacy=0x7f92b0158bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:12:04.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.952+0000 7f92ade00640 1 -- 172.21.15.7:0/82711636 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b01555e0 con 0x7f92b00c77f0 2024-09-13T15:12:04.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.956+0000 7f92ae800640 1 --2- 172.21.15.7:0/82711636 >> v2:172.21.15.7:3300/0 conn(0x7f92b01592c0 0x7f92b014edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:04.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.964+0000 7f92ade00640 1 --2- 172.21.15.7:0/82711636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b00c77f0 0x7f92b00c5cc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f92b006deb0 tx=0x7f92a001d4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c2113bf8eab125c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:04.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.964+0000 7f92aca00640 1 -- 172.21.15.7:0/82711636 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0008be0 con 0x7f92b00c77f0 2024-09-13T15:12:04.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.964+0000 7f92aca00640 1 -- 172.21.15.7:0/82711636 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a0008d40 con 0x7f92b00c77f0 2024-09-13T15:12:04.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.964+0000 7f92aca00640 1 -- 172.21.15.7:0/82711636 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a000a2f0 con 0x7f92b00c77f0 2024-09-13T15:12:04.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.964+0000 7f92b5200640 1 -- 172.21.15.7:0/82711636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b00c77f0 msgr2=0x7f92b00c5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:04.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.964+0000 7f92b5200640 1 --2- 172.21.15.7:0/82711636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b00c77f0 0x7f92b00c5cc0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f92b006deb0 tx=0x7f92a001d4c0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.964+0000 7f92b5200640 1 -- 172.21.15.7:0/82711636 shutdown_connections 2024-09-13T15:12:04.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.964+0000 7f92b5200640 1 --2- 172.21.15.7:0/82711636 >> v2:172.21.15.7:3300/0 conn(0x7f92b01592c0 0x7f92b014edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.964+0000 7f92b5200640 1 --2- 172.21.15.7:0/82711636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b00c77f0 0x7f92b00c5cc0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.964+0000 7f92b5200640 1 -- 172.21.15.7:0/82711636 >> 172.21.15.7:0/82711636 conn(0x7f92b0065d40 msgr2=0x7f92b0066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:04.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.968+0000 7f92b5200640 1 -- 172.21.15.7:0/82711636 shutdown_connections 2024-09-13T15:12:04.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.968+0000 7f92b5200640 1 -- 172.21.15.7:0/82711636 wait complete. 2024-09-13T15:12:04.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.972+0000 7f92b5200640 1 Processor -- start 2024-09-13T15:12:04.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.976+0000 7f92b5200640 1 -- start start 2024-09-13T15:12:04.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.980+0000 7f92b5200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b00c77f0 0x7f92b00caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:04.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.980+0000 7f92b5200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92b00c7bd0 0x7f92b0200060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:04.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.980+0000 7f92b5200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92b01592c0 0x7f92b014d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:04.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.980+0000 7f92b5200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b01454f0 con 0x7f92b00c7bd0 2024-09-13T15:12:04.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.980+0000 7f92b5200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b02030c0 con 0x7f92b00c77f0 2024-09-13T15:12:04.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.980+0000 7f92b5200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0145880 con 0x7f92b01592c0 2024-09-13T15:12:04.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.980+0000 7f92ade00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b00c77f0 0x7f92b00caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:04.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.980+0000 7f92ade00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b00c77f0 0x7f92b00caf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:57424/0 (socket says 172.21.15.7:57424) 2024-09-13T15:12:04.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.980+0000 7f92ade00640 1 -- 172.21.15.7:0/1269230916 learned_addr learned my addr 172.21.15.7:0/1269230916 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:12:04.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.980+0000 7f92ae800640 1 --2- 172.21.15.7:0/1269230916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92b01592c0 0x7f92b014d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:04.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.980+0000 7f92ae800640 1 -- 172.21.15.7:0/1269230916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b00c77f0 msgr2=0x7f92b00caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:04.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.980+0000 7f92ae800640 1 --2- 172.21.15.7:0/1269230916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b00c77f0 0x7f92b00caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.980+0000 7f92ae800640 1 -- 172.21.15.7:0/1269230916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92b00c7bd0 msgr2=0x7f92b0200060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:12:04.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.980+0000 7f92ae800640 1 --2- 172.21.15.7:0/1269230916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92b00c7bd0 0x7f92b0200060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:04.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.980+0000 7f92ae800640 1 -- 172.21.15.7:0/1269230916 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a0007040 con 0x7f92b01592c0 2024-09-13T15:12:04.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.980+0000 7f92ae800640 1 --2- 172.21.15.7:0/1269230916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92b01592c0 0x7f92b014d890 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f92a800ccc0 tx=0x7f92a800a650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:04.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.984+0000 7f92a6000640 1 -- 172.21.15.7:0/1269230916 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a800f680 con 0x7f92b01592c0 2024-09-13T15:12:04.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.984+0000 7f92a6000640 1 -- 172.21.15.7:0/1269230916 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a800f800 con 0x7f92b01592c0 2024-09-13T15:12:04.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.984+0000 7f92a6000640 1 -- 172.21.15.7:0/1269230916 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a800fbb0 con 0x7f92b01592c0 2024-09-13T15:12:04.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.984+0000 7f92b5200640 1 -- 172.21.15.7:0/1269230916 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b0202c30 con 0x7f92b01592c0 2024-09-13T15:12:04.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.984+0000 7f92b5200640 1 -- 172.21.15.7:0/1269230916 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b0144310 con 0x7f92b01592c0 2024-09-13T15:12:04.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.988+0000 7f92b5200640 1 -- 172.21.15.7:0/1269230916 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9288005260 con 0x7f92b01592c0 2024-09-13T15:12:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.988+0000 7f92a6000640 1 -- 172.21.15.7:0/1269230916 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f92a800b040 con 0x7f92b01592c0 2024-09-13T15:12:04.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.992+0000 7f92a6000640 1 --2- 172.21.15.7:0/1269230916 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9290066790 0x7f9290068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:04.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.992+0000 7f92a6000640 1 -- 172.21.15.7:0/1269230916 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f92a8084f20 con 0x7f92b01592c0 2024-09-13T15:12:04.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.992+0000 7f92ade00640 1 --2- 172.21.15.7:0/1269230916 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9290066790 0x7f9290068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:04.996+0000 7f92ade00640 1 --2- 172.21.15.7:0/1269230916 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9290066790 0x7f9290068c50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f92a0000c10 tx=0x7f92a00b5040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:05.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:05.004+0000 7f92a6000640 1 -- 172.21.15.7:0/1269230916 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f92a8051d60 con 0x7f92b01592c0 2024-09-13T15:12:05.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:05.432+0000 7f92b5200640 1 -- 172.21.15.7:0/1269230916 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9288005a90 con 0x7f92b01592c0 2024-09-13T15:12:05.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:05.432+0000 7f92a6000640 1 -- 172.21.15.7:0/1269230916 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+5527 (secure 0 0 0) 0x7f92a8055380 con 0x7f92b01592c0 2024-09-13T15:12:05.434 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:12:05.434 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:12:03.617875+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:resolve","state_seq":8,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:12:05.434 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 42 2024-09-13T15:12:05.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:05.440+0000 7f92b5200640 1 -- 172.21.15.7:0/1269230916 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9290066790 msgr2=0x7f9290068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:05.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:05.440+0000 7f92b5200640 1 --2- 172.21.15.7:0/1269230916 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9290066790 0x7f9290068c50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f92a0000c10 tx=0x7f92a00b5040 comp rx=0 tx=0).stop 2024-09-13T15:12:05.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:05.440+0000 7f92b5200640 1 -- 172.21.15.7:0/1269230916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92b01592c0 msgr2=0x7f92b014d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:05.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:05.440+0000 7f92b5200640 1 --2- 172.21.15.7:0/1269230916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92b01592c0 0x7f92b014d890 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f92a800ccc0 tx=0x7f92a800a650 comp rx=0 tx=0).stop 2024-09-13T15:12:05.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:05.464+0000 7f92b5200640 1 -- 172.21.15.7:0/1269230916 shutdown_connections 2024-09-13T15:12:05.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:05.464+0000 7f92b5200640 1 --2- 172.21.15.7:0/1269230916 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9290066790 0x7f9290068c50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:05.464+0000 7f92b5200640 1 --2- 172.21.15.7:0/1269230916 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f92b01592c0 0x7f92b014d890 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:05.464+0000 7f92b5200640 1 --2- 172.21.15.7:0/1269230916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f92b00c7bd0 0x7f92b0200060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:05.464+0000 7f92b5200640 1 --2- 172.21.15.7:0/1269230916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b00c77f0 0x7f92b00caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:05.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:05.464+0000 7f92b5200640 1 -- 172.21.15.7:0/1269230916 >> 172.21.15.7:0/1269230916 conn(0x7f92b0065d40 msgr2=0x7f92b014eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:05.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:05.480+0000 7f92b5200640 1 -- 172.21.15.7:0/1269230916 shutdown_connections 2024-09-13T15:12:05.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:05.480+0000 7f92b5200640 1 -- 172.21.15.7:0/1269230916 wait complete. 2024-09-13T15:12:05.583 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:12:07.583 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:07.844 DEBUG:teuthology.orchestra.run.smithi007:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:12:07.862 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T15:12:08.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.004+0000 7f707b200640 1 Processor -- start 2024-09-13T15:12:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.004+0000 7f707b200640 1 -- start start 2024-09-13T15:12:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.008+0000 7f707b200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f707c0c5b60 0x7f707c06fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.008+0000 7f707b200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f707c0c72b0 0x7f707c165d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.008+0000 7f707b200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707c070410 con 0x7f707c0c5f40 2024-09-13T15:12:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.008+0000 7f707b200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f707c0706d0 con 0x7f707c0c72b0 2024-09-13T15:12:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.008+0000 7f707b200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f707c0709b0 con 0x7f707c0c5b60 2024-09-13T15:12:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.008+0000 7f707a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f707c0c72b0 0x7f707c165d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.008+0000 7f707a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f707c0c72b0 0x7f707c165d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59112/0 (socket says 172.21.15.7:59112) 2024-09-13T15:12:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.008+0000 7f707a800640 1 -- 172.21.15.7:0/803535256 learned_addr learned my addr 172.21.15.7:0/803535256 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:12:08.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.012+0000 7f7078a00640 1 -- 172.21.15.7:0/803535256 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361173305 0 0) 0x7f707c070410 con 0x7f707c0c5f40 2024-09-13T15:12:08.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.044+0000 7f7078a00640 1 -- 172.21.15.7:0/803535256 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7060005740 con 0x7f707c0c5f40 2024-09-13T15:12:08.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.048+0000 7f7078a00640 1 -- 172.21.15.7:0/803535256 <== mon.1 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1453977581 0 0) 0x7f7060005740 con 0x7f707c0c5f40 2024-09-13T15:12:08.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.048+0000 7f7078a00640 1 -- 172.21.15.7:0/803535256 >> v2:172.21.15.77:3300/0 conn(0x7f707c0c5b60 msgr2=0x7f707c06fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:08.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.016+0000 7f7079e00640 1 --2- 172.21.15.7:0/803535256 >> v2:172.21.15.77:3300/0 conn(0x7f707c0c5b60 0x7f707c06fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:08.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.056+0000 7f7078a00640 1 --2- 172.21.15.7:0/803535256 >> v2:172.21.15.77:3300/0 conn(0x7f707c0c5b60 0x7f707c06fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.056+0000 7f7078a00640 1 -- 172.21.15.7:0/803535256 >> v2:172.21.15.7:3300/0 conn(0x7f707c0c72b0 msgr2=0x7f707c165d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:08.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.056+0000 7f7078a00640 1 --2- 172.21.15.7:0/803535256 >> v2:172.21.15.7:3300/0 conn(0x7f707c0c72b0 0x7f707c165d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.056+0000 7f7078a00640 1 -- 172.21.15.7:0/803535256 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c070c90 con 0x7f707c0c5f40 2024-09-13T15:12:08.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.056+0000 7f7078a00640 1 -- 172.21.15.7:0/803535256 <== mon.1 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f7068001680 con 0x7f707c0c5f40 2024-09-13T15:12:08.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.056+0000 7f7078a00640 1 -- 172.21.15.7:0/803535256 >> v1:172.21.15.77:6789/0 conn(0x7f707c0c5f40 legacy=0x7f707c0c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:08.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.056+0000 7f7078a00640 1 --2- 172.21.15.7:0/803535256 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7060005b90 0x7f7060005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:08.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.056+0000 7f7078a00640 1 --2- 172.21.15.7:0/803535256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70600064f0 0x7f70600069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:08.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.056+0000 7f7078a00640 1 --2- 172.21.15.7:0/803535256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060007150 0x7f706000ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:08.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.056+0000 7f7078a00640 1 -- 172.21.15.7:0/803535256 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0706d0 con 0x7f70600064f0 2024-09-13T15:12:08.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.056+0000 7f7078a00640 1 -- 172.21.15.7:0/803535256 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0709b0 con 0x7f7060007150 2024-09-13T15:12:08.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.056+0000 7f7078a00640 1 -- 172.21.15.7:0/803535256 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7060010510 con 0x7f7060005b90 2024-09-13T15:12:08.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.060+0000 7f7079400640 1 --2- 172.21.15.7:0/803535256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70600064f0 0x7f70600069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.060+0000 7f707a800640 1 --2- 172.21.15.7:0/803535256 >> v2:172.21.15.7:3300/0 conn(0x7f707c0c72b0 0x7f707c165d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:08.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.060+0000 7f7079e00640 1 --2- 172.21.15.7:0/803535256 >> v2:172.21.15.77:3300/0 conn(0x7f707c0c5b60 0x7f707c06fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.060+0000 7f7079e00640 1 --2- 172.21.15.7:0/803535256 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7060005b90 0x7f7060005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:08.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.060+0000 7f707a800640 1 --2- 172.21.15.7:0/803535256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060007150 0x7f706000ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.060+0000 7f7079e00640 1 -- 172.21.15.7:0/803535256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060007150 msgr2=0x7f706000ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.060+0000 7f7079e00640 1 --2- 172.21.15.7:0/803535256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7060007150 0x7f706000ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.060+0000 7f7079e00640 1 -- 172.21.15.7:0/803535256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70600064f0 msgr2=0x7f70600069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.060+0000 7f7079e00640 1 --2- 172.21.15.7:0/803535256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70600064f0 0x7f70600069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.060+0000 7f7079e00640 1 -- 172.21.15.7:0/803535256 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c070c90 con 0x7f7060005b90 2024-09-13T15:12:08.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.060+0000 7f707a800640 1 -- 172.21.15.7:0/803535256 reap_dead start 2024-09-13T15:12:08.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.068+0000 7f7079e00640 1 --2- 172.21.15.7:0/803535256 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7060005b90 0x7f7060005fb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f706c00aaa0 tx=0x7f706c01c590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c6341bf7f586bd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:08.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.068+0000 7f7078a00640 1 -- 172.21.15.7:0/803535256 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c0aa660 con 0x7f7060005b90 2024-09-13T15:12:08.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.068+0000 7f7078a00640 1 -- 172.21.15.7:0/803535256 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c0aa7c0 con 0x7f7060005b90 2024-09-13T15:12:08.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.068+0000 7f7078a00640 1 -- 172.21.15.7:0/803535256 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c0aab70 con 0x7f7060005b90 2024-09-13T15:12:08.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.068+0000 7f707b200640 1 -- 172.21.15.7:0/803535256 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7060005b90 msgr2=0x7f7060005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:08.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.068+0000 7f707b200640 1 --2- 172.21.15.7:0/803535256 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7060005b90 0x7f7060005fb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f706c00aaa0 tx=0x7f706c01c590 comp rx=0 tx=0).stop 2024-09-13T15:12:08.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.076+0000 7f707b200640 1 -- 172.21.15.7:0/803535256 shutdown_connections 2024-09-13T15:12:08.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.076+0000 7f707b200640 1 --2- 172.21.15.7:0/803535256 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7060005b90 0x7f7060005fb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.076+0000 7f707b200640 1 -- 172.21.15.7:0/803535256 >> 172.21.15.7:0/803535256 conn(0x7f707c065d40 msgr2=0x7f707c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:08.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.076+0000 7f707b200640 1 -- 172.21.15.7:0/803535256 shutdown_connections 2024-09-13T15:12:08.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.076+0000 7f707b200640 1 -- 172.21.15.7:0/803535256 wait complete. 2024-09-13T15:12:08.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.120+0000 7f707b200640 1 Processor -- start 2024-09-13T15:12:08.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.120+0000 7f707b200640 1 -- start start 2024-09-13T15:12:08.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.120+0000 7f707b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7060005b90 0x7f707c203fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:08.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.120+0000 7f707b200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f707c164a90 0x7f707c0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.120+0000 7f707b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f707c169280 0x7f707c1696e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.120+0000 7f707b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0c0ea0 con 0x7f707c169280 2024-09-13T15:12:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.120+0000 7f707b200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c169c20 con 0x7f707c164a90 2024-09-13T15:12:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.120+0000 7f707b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0c10f0 con 0x7f7060005b90 2024-09-13T15:12:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.124+0000 7f7079400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f707c164a90 0x7f707c0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.124+0000 7f7079400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f707c164a90 0x7f707c0c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:57456/0 (socket says 172.21.15.7:57456) 2024-09-13T15:12:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.124+0000 7f7079400640 1 -- 172.21.15.7:0/3063329593 learned_addr learned my addr 172.21.15.7:0/3063329593 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:12:08.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.124+0000 7f707a800640 1 --2- 172.21.15.7:0/3063329593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f707c169280 0x7f707c1696e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:08.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.124+0000 7f7079e00640 1 --2- 172.21.15.7:0/3063329593 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7060005b90 0x7f707c203fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:08.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.124+0000 7f707a800640 1 -- 172.21.15.7:0/3063329593 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7060005b90 msgr2=0x7f707c203fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:08.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.124+0000 7f707a800640 1 --2- 172.21.15.7:0/3063329593 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7060005b90 0x7f707c203fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.124+0000 7f707a800640 1 -- 172.21.15.7:0/3063329593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f707c164a90 msgr2=0x7f707c0c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:08.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.124+0000 7f707a800640 1 --2- 172.21.15.7:0/3063329593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f707c164a90 0x7f707c0c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.124+0000 7f707a800640 1 -- 172.21.15.7:0/3063329593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c0c13d0 con 0x7f707c169280 2024-09-13T15:12:08.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.124+0000 7f7079400640 1 --2- 172.21.15.7:0/3063329593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f707c164a90 0x7f707c0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:12:08.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.124+0000 7f707a800640 1 --2- 172.21.15.7:0/3063329593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f707c169280 0x7f707c1696e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f707c08bf10 tx=0x7f707400e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:08.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.124+0000 7f7072000640 1 -- 172.21.15.7:0/3063329593 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7074019070 con 0x7f707c169280 2024-09-13T15:12:08.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.124+0000 7f7072000640 1 -- 172.21.15.7:0/3063329593 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707400ec40 con 0x7f707c169280 2024-09-13T15:12:08.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.124+0000 7f707b200640 1 -- 172.21.15.7:0/3063329593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707c164110 con 0x7f707c169280 2024-09-13T15:12:08.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.124+0000 7f7072000640 1 -- 172.21.15.7:0/3063329593 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70740039a0 con 0x7f707c169280 2024-09-13T15:12:08.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.124+0000 7f707b200640 1 -- 172.21.15.7:0/3063329593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707c0c7980 con 0x7f707c169280 2024-09-13T15:12:08.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.128+0000 7f707b200640 1 -- 172.21.15.7:0/3063329593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707c06cd70 con 0x7f707c169280 2024-09-13T15:12:08.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.132+0000 7f7072000640 1 -- 172.21.15.7:0/3063329593 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f707401e410 con 0x7f707c169280 2024-09-13T15:12:08.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.132+0000 7f7072000640 1 --2- 172.21.15.7:0/3063329593 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f705c066690 0x7f705c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:08.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.136+0000 7f7072000640 1 -- 172.21.15.7:0/3063329593 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f707400d040 con 0x7f707c169280 2024-09-13T15:12:08.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.136+0000 7f7079e00640 1 --2- 172.21.15.7:0/3063329593 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f705c066690 0x7f705c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:08.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.136+0000 7f7079e00640 1 --2- 172.21.15.7:0/3063329593 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f705c066690 0x7f705c068b50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f706c0ae000 tx=0x7f706c0046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:08.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.136+0000 7f7072000640 1 -- 172.21.15.7:0/3063329593 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f70740512b0 con 0x7f707c169280 2024-09-13T15:12:08.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.500+0000 7f707b200640 1 -- 172.21.15.7:0/3063329593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f707c0662a0 con 0x7f707c169280 2024-09-13T15:12:08.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.500+0000 7f7072000640 1 -- 172.21.15.7:0/3063329593 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+5527 (secure 0 0 0) 0x7f70740548d0 con 0x7f707c169280 2024-09-13T15:12:08.504 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:12:08.504 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":42,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:12:03.617875+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:resolve","state_seq":8,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:12:08.504 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 42 2024-09-13T15:12:08.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.508+0000 7f707b200640 1 -- 172.21.15.7:0/3063329593 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f705c066690 msgr2=0x7f705c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:08.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.508+0000 7f707b200640 1 --2- 172.21.15.7:0/3063329593 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f705c066690 0x7f705c068b50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f706c0ae000 tx=0x7f706c0046d0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.508+0000 7f707b200640 1 -- 172.21.15.7:0/3063329593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f707c169280 msgr2=0x7f707c1696e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:08.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.508+0000 7f707b200640 1 --2- 172.21.15.7:0/3063329593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f707c169280 0x7f707c1696e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f707c08bf10 tx=0x7f707400e5e0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.508+0000 7f707b200640 1 -- 172.21.15.7:0/3063329593 shutdown_connections 2024-09-13T15:12:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.508+0000 7f707b200640 1 --2- 172.21.15.7:0/3063329593 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f705c066690 0x7f705c068b50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.508+0000 7f707b200640 1 --2- 172.21.15.7:0/3063329593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f707c169280 0x7f707c1696e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.508+0000 7f707b200640 1 --2- 172.21.15.7:0/3063329593 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f707c164a90 0x7f707c0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.508+0000 7f707b200640 1 --2- 172.21.15.7:0/3063329593 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7060005b90 0x7f707c203fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.508+0000 7f707b200640 1 -- 172.21.15.7:0/3063329593 >> 172.21.15.7:0/3063329593 conn(0x7f707c065d40 msgr2=0x7f707c0cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.508+0000 7f707b200640 1 -- 172.21.15.7:0/3063329593 shutdown_connections 2024-09-13T15:12:08.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:08.508+0000 7f707b200640 1 -- 172.21.15.7:0/3063329593 wait complete. 2024-09-13T15:12:08.574 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:12:08.608 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-13T15:12:08.604+0000 7f3e6f600640 -1 Fail to open '/proc/40245/cmdline' error = (2) No such file or directory 2024-09-13T15:12:08.608 INFO:tasks.ceph.osd.0.smithi007.stderr:2024-09-13T15:12:08.604+0000 7f3e6f600640 -1 received signal: Hangup from (PID: 40245) UID: 0 2024-09-13T15:12:08.609 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-13T15:12:08.604+0000 7f145e200640 -1 Fail to open '/proc/40245/cmdline' error = (2) No such file or directory 2024-09-13T15:12:08.609 INFO:tasks.ceph.osd.3.smithi007.stderr:2024-09-13T15:12:08.604+0000 7f145e200640 -1 received signal: Hangup from (PID: 40245) UID: 0 2024-09-13T15:12:08.611 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-13T15:12:08.604+0000 7f1060600640 -1 Fail to open '/proc/40245/cmdline' error = (2) No such file or directory 2024-09-13T15:12:08.611 INFO:tasks.ceph.osd.2.smithi007.stderr:2024-09-13T15:12:08.604+0000 7f1060600640 -1 received signal: Hangup from (PID: 40245) UID: 0 2024-09-13T15:12:08.613 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-13T15:12:08.604+0000 7f3074800640 -1 Fail to open '/proc/40245/cmdline' error = (2) No such file or directory 2024-09-13T15:12:08.613 INFO:tasks.ceph.osd.1.smithi007.stderr:2024-09-13T15:12:08.612+0000 7f3074800640 -1 received signal: Hangup from (PID: 40245) UID: 0 2024-09-13T15:12:10.576 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:10.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.860+0000 7fca74a00640 1 Processor -- start 2024-09-13T15:12:10.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.860+0000 7fca74a00640 1 -- start start 2024-09-13T15:12:10.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.868+0000 7fca74a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca70155e90 0x7fca700c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.868+0000 7fca74a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fca700b0ce0 0x7fca700c5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.868+0000 7fca74a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca700c6df0 con 0x7fca7014f3f0 2024-09-13T15:12:10.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.868+0000 7fca74a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca700c73b0 con 0x7fca700b0ce0 2024-09-13T15:12:10.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.868+0000 7fca74a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca70072640 con 0x7fca70155e90 2024-09-13T15:12:10.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.868+0000 7fca6d400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca70155e90 0x7fca700c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.868+0000 7fca6d400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca70155e90 0x7fca700c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:43096/0 (socket says 172.21.15.7:43096) 2024-09-13T15:12:10.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.868+0000 7fca6d400640 1 -- 172.21.15.7:0/1199642165 learned_addr learned my addr 172.21.15.7:0/1199642165 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:12:10.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.872+0000 7fca6e800640 1 --2- 172.21.15.7:0/1199642165 >> v2:172.21.15.7:3300/0 conn(0x7fca700b0ce0 0x7fca700c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.872+0000 7fca6e800640 1 -- 172.21.15.7:0/1199642165 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca70155e90 msgr2=0x7fca700c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:10.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.872+0000 7fca6e800640 1 --2- 172.21.15.7:0/1199642165 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca70155e90 0x7fca700c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.872+0000 7fca6e800640 1 -- 172.21.15.7:0/1199642165 >> v1:172.21.15.7:6789/0 conn(0x7fca7014f3f0 legacy=0x7fca70158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:10.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.872+0000 7fca6e800640 1 -- 172.21.15.7:0/1199642165 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca700c70d0 con 0x7fca700b0ce0 2024-09-13T15:12:10.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.876+0000 7fca6e800640 1 --2- 172.21.15.7:0/1199642165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca700b0ce0 0x7fca700c5850 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fca600071d0 tx=0x7fca6001d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46936d71d7d391b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:10.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.876+0000 7fca6ca00640 1 -- 172.21.15.7:0/1199642165 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca60008be0 con 0x7fca700b0ce0 2024-09-13T15:12:10.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.876+0000 7fca6ca00640 1 -- 172.21.15.7:0/1199642165 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca60008d40 con 0x7fca700b0ce0 2024-09-13T15:12:10.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.876+0000 7fca6ca00640 1 -- 172.21.15.7:0/1199642165 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6000a2f0 con 0x7fca700b0ce0 2024-09-13T15:12:10.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.880+0000 7fca74a00640 1 -- 172.21.15.7:0/1199642165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca700b0ce0 msgr2=0x7fca700c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:10.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.880+0000 7fca74a00640 1 --2- 172.21.15.7:0/1199642165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca700b0ce0 0x7fca700c5850 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fca600071d0 tx=0x7fca6001d420 comp rx=0 tx=0).stop 2024-09-13T15:12:10.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.880+0000 7fca74a00640 1 -- 172.21.15.7:0/1199642165 shutdown_connections 2024-09-13T15:12:10.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.880+0000 7fca74a00640 1 --2- 172.21.15.7:0/1199642165 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca700b0ce0 0x7fca700c5850 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.880+0000 7fca74a00640 1 --2- 172.21.15.7:0/1199642165 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca70155e90 0x7fca700c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.880+0000 7fca74a00640 1 -- 172.21.15.7:0/1199642165 >> 172.21.15.7:0/1199642165 conn(0x7fca70065d40 msgr2=0x7fca70066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:10.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.884+0000 7fca74a00640 1 -- 172.21.15.7:0/1199642165 shutdown_connections 2024-09-13T15:12:10.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.884+0000 7fca74a00640 1 -- 172.21.15.7:0/1199642165 wait complete. 2024-09-13T15:12:10.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.888+0000 7fca74a00640 1 Processor -- start 2024-09-13T15:12:10.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.888+0000 7fca74a00640 1 -- start start 2024-09-13T15:12:10.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.888+0000 7fca74a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca700b0ce0 0x7fca7014a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.888+0000 7fca74a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca7014f3f0 0x7fca700c2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.888+0000 7fca74a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca70155e90 0x7fca700c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.888+0000 7fca74a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca700cae40 con 0x7fca70155e90 2024-09-13T15:12:10.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.888+0000 7fca74a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca700cb370 con 0x7fca700b0ce0 2024-09-13T15:12:10.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.888+0000 7fca74a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca701fa820 con 0x7fca7014f3f0 2024-09-13T15:12:10.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.888+0000 7fca6d400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca7014f3f0 0x7fca700c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.888+0000 7fca6d400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca7014f3f0 0x7fca700c2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:43110/0 (socket says 172.21.15.7:43110) 2024-09-13T15:12:10.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.888+0000 7fca6d400640 1 -- 172.21.15.7:0/2249529914 learned_addr learned my addr 172.21.15.7:0/2249529914 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:12:10.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.888+0000 7fca6e800640 1 --2- 172.21.15.7:0/2249529914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca70155e90 0x7fca700c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.892+0000 7fca6d400640 1 -- 172.21.15.7:0/2249529914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca700b0ce0 msgr2=0x7fca7014a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:10.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.892+0000 7fca6d400640 1 --2- 172.21.15.7:0/2249529914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca700b0ce0 0x7fca7014a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.892+0000 7fca6d400640 1 -- 172.21.15.7:0/2249529914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca70155e90 msgr2=0x7fca700c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:10.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.892+0000 7fca6d400640 1 --2- 172.21.15.7:0/2249529914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca70155e90 0x7fca700c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:10.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.892+0000 7fca6d400640 1 -- 172.21.15.7:0/2249529914 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6000ae50 con 0x7fca7014f3f0 2024-09-13T15:12:10.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.892+0000 7fca6d400640 1 --2- 172.21.15.7:0/2249529914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca7014f3f0 0x7fca700c2200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fca680070b0 tx=0x7fca6800d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:10.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.892+0000 7fca66000640 1 -- 172.21.15.7:0/2249529914 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6800dd80 con 0x7fca7014f3f0 2024-09-13T15:12:10.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.892+0000 7fca66000640 1 -- 172.21.15.7:0/2249529914 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6800f040 con 0x7fca7014f3f0 2024-09-13T15:12:10.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.892+0000 7fca66000640 1 -- 172.21.15.7:0/2249529914 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca68015620 con 0x7fca7014f3f0 2024-09-13T15:12:10.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.892+0000 7fca74a00640 1 -- 172.21.15.7:0/2249529914 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca700cb090 con 0x7fca7014f3f0 2024-09-13T15:12:10.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.892+0000 7fca74a00640 1 -- 172.21.15.7:0/2249529914 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7014b5a0 con 0x7fca7014f3f0 2024-09-13T15:12:10.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.896+0000 7fca66000640 1 -- 172.21.15.7:0/2249529914 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fca68015780 con 0x7fca7014f3f0 2024-09-13T15:12:10.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.896+0000 7fca74a00640 1 -- 172.21.15.7:0/2249529914 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca70067650 con 0x7fca7014f3f0 2024-09-13T15:12:10.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.896+0000 7fca66000640 1 --2- 172.21.15.7:0/2249529914 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fca500666c0 0x7fca50068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:10.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.896+0000 7fca66000640 1 -- 172.21.15.7:0/2249529914 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fca68084550 con 0x7fca7014f3f0 2024-09-13T15:12:10.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.896+0000 7fca6de00640 1 --2- 172.21.15.7:0/2249529914 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fca500666c0 0x7fca50068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:10.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.900+0000 7fca6de00640 1 --2- 172.21.15.7:0/2249529914 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fca500666c0 0x7fca50068b80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fca5c000f70 tx=0x7fca5c0079c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:10.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:10.908+0000 7fca66000640 1 -- 172.21.15.7:0/2249529914 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fca6801a080 con 0x7fca7014f3f0 2024-09-13T15:12:11.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:11.324+0000 7fca74a00640 1 -- 172.21.15.7:0/2249529914 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca7014b7c0 con 0x7fca7014f3f0 2024-09-13T15:12:11.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:11.324+0000 7fca66000640 1 -- 172.21.15.7:0/2249529914 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+5530 (secure 0 0 0) 0x7fca68051450 con 0x7fca7014f3f0 2024-09-13T15:12:11.328 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:12:11.329 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:12:08.916084+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:12:11.329 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 43 2024-09-13T15:12:11.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:11.328+0000 7fca74a00640 1 -- 172.21.15.7:0/2249529914 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fca500666c0 msgr2=0x7fca50068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:11.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:11.328+0000 7fca74a00640 1 --2- 172.21.15.7:0/2249529914 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fca500666c0 0x7fca50068b80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fca5c000f70 tx=0x7fca5c0079c0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:11.328+0000 7fca74a00640 1 -- 172.21.15.7:0/2249529914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca7014f3f0 msgr2=0x7fca700c2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:11.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:11.328+0000 7fca74a00640 1 --2- 172.21.15.7:0/2249529914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca7014f3f0 0x7fca700c2200 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fca680070b0 tx=0x7fca6800d4a0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:11.332+0000 7fca74a00640 1 -- 172.21.15.7:0/2249529914 shutdown_connections 2024-09-13T15:12:11.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:11.332+0000 7fca74a00640 1 --2- 172.21.15.7:0/2249529914 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fca500666c0 0x7fca50068b80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:11.332+0000 7fca74a00640 1 --2- 172.21.15.7:0/2249529914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca70155e90 0x7fca700c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:11.332+0000 7fca74a00640 1 --2- 172.21.15.7:0/2249529914 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fca7014f3f0 0x7fca700c2200 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:11.332+0000 7fca74a00640 1 --2- 172.21.15.7:0/2249529914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fca700b0ce0 0x7fca7014a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:11.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:11.332+0000 7fca74a00640 1 -- 172.21.15.7:0/2249529914 >> 172.21.15.7:0/2249529914 conn(0x7fca70065d40 msgr2=0x7fca70152db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:11.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:11.332+0000 7fca74a00640 1 -- 172.21.15.7:0/2249529914 shutdown_connections 2024-09-13T15:12:11.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:11.332+0000 7fca74a00640 1 -- 172.21.15.7:0/2249529914 wait complete. 2024-09-13T15:12:11.376 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:12:13.377 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:13.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.632+0000 7f4ad7c00640 1 Processor -- start 2024-09-13T15:12:13.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.632+0000 7f4ad7c00640 1 -- start start 2024-09-13T15:12:13.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.632+0000 7f4ad7c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad01590d0 0x7f4ad0159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.636+0000 7f4ad7c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4ad00c7720 0x7f4ad01594b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.636+0000 7f4ad5200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad01590d0 0x7f4ad0159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:13.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.636+0000 7f4ad5200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad01590d0 0x7f4ad0159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:43112/0 (socket says 172.21.15.7:43112) 2024-09-13T15:12:13.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.636+0000 7f4ad5200640 1 -- 172.21.15.7:0/3902435212 learned_addr learned my addr 172.21.15.7:0/3902435212 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:12:13.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.636+0000 7f4ad7c00640 1 -- 172.21.15.7:0/3902435212 --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad00cc410 con 0x7f4ad006b6a0 2024-09-13T15:12:13.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.636+0000 7f4ad7c00640 1 -- 172.21.15.7:0/3902435212 --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad01599f0 con 0x7f4ad00c7720 2024-09-13T15:12:13.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.636+0000 7f4ad7c00640 1 -- 172.21.15.7:0/3902435212 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0156b10 con 0x7f4ad01590d0 2024-09-13T15:12:13.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.636+0000 7f4ad5200640 1 -- 172.21.15.7:0/3902435212 >> v2:172.21.15.7:3300/0 conn(0x7f4ad00c7720 msgr2=0x7f4ad01594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:13.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.636+0000 7f4ad5200640 1 --2- 172.21.15.7:0/3902435212 >> v2:172.21.15.7:3300/0 conn(0x7f4ad00c7720 0x7f4ad01594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.640+0000 7f4ad5200640 1 -- 172.21.15.7:0/3902435212 >> v1:172.21.15.7:6789/0 conn(0x7f4ad006b6a0 legacy=0x7f4ad015a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.640+0000 7f4ad5200640 1 -- 172.21.15.7:0/3902435212 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad00c6130 con 0x7f4ad01590d0 2024-09-13T15:12:13.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.644+0000 7f4ad5200640 1 --2- 172.21.15.7:0/3902435212 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad01590d0 0x7f4ad0159bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4abc009870 tx=0x7f4abc01ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4df4a095b6e44246 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:13.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.644+0000 7f4acf400640 1 -- 172.21.15.7:0/3902435212 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc0a8a50 con 0x7f4ad01590d0 2024-09-13T15:12:13.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.644+0000 7f4acf400640 1 -- 172.21.15.7:0/3902435212 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc0a8bb0 con 0x7f4ad01590d0 2024-09-13T15:12:13.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.644+0000 7f4ad7c00640 1 -- 172.21.15.7:0/3902435212 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad01590d0 msgr2=0x7f4ad0159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.648+0000 7f4acf400640 1 -- 172.21.15.7:0/3902435212 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc0a8a50 con 0x7f4ad01590d0 2024-09-13T15:12:13.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.648+0000 7f4ad7c00640 1 --2- 172.21.15.7:0/3902435212 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad01590d0 0x7f4ad0159bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4abc009870 tx=0x7f4abc01ed90 comp rx=0 tx=0).stop 2024-09-13T15:12:13.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.648+0000 7f4ad7c00640 1 -- 172.21.15.7:0/3902435212 shutdown_connections 2024-09-13T15:12:13.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.648+0000 7f4ad7c00640 1 --2- 172.21.15.7:0/3902435212 >> v2:172.21.15.7:3300/0 conn(0x7f4ad00c7720 0x7f4ad01594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.648+0000 7f4ad7c00640 1 --2- 172.21.15.7:0/3902435212 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad01590d0 0x7f4ad0159bf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.648+0000 7f4ad7c00640 1 -- 172.21.15.7:0/3902435212 >> 172.21.15.7:0/3902435212 conn(0x7f4ad00cb5a0 msgr2=0x7f4ad00cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:13.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.648+0000 7f4ad7c00640 1 -- 172.21.15.7:0/3902435212 shutdown_connections 2024-09-13T15:12:13.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.648+0000 7f4ad7c00640 1 -- 172.21.15.7:0/3902435212 wait complete. 2024-09-13T15:12:13.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4ad7c00640 1 Processor -- start 2024-09-13T15:12:13.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4ad7c00640 1 -- start start 2024-09-13T15:12:13.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4ad7c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad006b6a0 0x7f4ad01e4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4ad7c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ad00c7720 0x7f4ad00cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4ad7c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad01590d0 0x7f4ad01eea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4ad7c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad01e49a0 con 0x7f4ad00c7720 2024-09-13T15:12:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4ad7c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad01f2f50 con 0x7f4ad01590d0 2024-09-13T15:12:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4ad7c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad01f2ac0 con 0x7f4ad006b6a0 2024-09-13T15:12:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4acfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ad00c7720 0x7f4ad00cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4acfe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ad00c7720 0x7f4ad00cdce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53974/0 (socket says 172.21.15.7:53974) 2024-09-13T15:12:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4acfe00640 1 -- 172.21.15.7:0/327382981 learned_addr learned my addr 172.21.15.7:0/327382981 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:12:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4ad5200640 1 --2- 172.21.15.7:0/327382981 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad006b6a0 0x7f4ad01e4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4ad5c00640 1 --2- 172.21.15.7:0/327382981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad01590d0 0x7f4ad01eea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4ad5c00640 1 -- 172.21.15.7:0/327382981 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad006b6a0 msgr2=0x7f4ad01e4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4ad5c00640 1 --2- 172.21.15.7:0/327382981 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad006b6a0 0x7f4ad01e4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4ad5c00640 1 -- 172.21.15.7:0/327382981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ad00c7720 msgr2=0x7f4ad00cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:13.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4ad5c00640 1 --2- 172.21.15.7:0/327382981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ad00c7720 0x7f4ad00cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:13.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4ad5c00640 1 -- 172.21.15.7:0/327382981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc0094d0 con 0x7f4ad01590d0 2024-09-13T15:12:13.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.652+0000 7f4ad5c00640 1 --2- 172.21.15.7:0/327382981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad01590d0 0x7f4ad01eea70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800c700 tx=0x7f4ac800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:13.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.656+0000 7f4accc00640 1 -- 172.21.15.7:0/327382981 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac8003b80 con 0x7f4ad01590d0 2024-09-13T15:12:13.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.656+0000 7f4accc00640 1 -- 172.21.15.7:0/327382981 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac8003ce0 con 0x7f4ad01590d0 2024-09-13T15:12:13.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.656+0000 7f4accc00640 1 -- 172.21.15.7:0/327382981 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac800aa30 con 0x7f4ad01590d0 2024-09-13T15:12:13.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.656+0000 7f4ad7c00640 1 -- 172.21.15.7:0/327382981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad0155310 con 0x7f4ad01590d0 2024-09-13T15:12:13.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.656+0000 7f4ad7c00640 1 -- 172.21.15.7:0/327382981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad01f2470 con 0x7f4ad01590d0 2024-09-13T15:12:13.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.656+0000 7f4ac6000640 1 -- 172.21.15.7:0/327382981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad01f2c30 con 0x7f4ad01590d0 2024-09-13T15:12:13.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.660+0000 7f4accc00640 1 -- 172.21.15.7:0/327382981 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4ac800ab90 con 0x7f4ad01590d0 2024-09-13T15:12:13.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.660+0000 7f4accc00640 1 --2- 172.21.15.7:0/327382981 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4ab0066690 0x7f4ab0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.660+0000 7f4accc00640 1 -- 172.21.15.7:0/327382981 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f4ac80842e0 con 0x7f4ad01590d0 2024-09-13T15:12:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.660+0000 7f4ad5200640 1 --2- 172.21.15.7:0/327382981 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4ab0066690 0x7f4ab0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:13.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.664+0000 7f4ad5200640 1 --2- 172.21.15.7:0/327382981 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4ab0066690 0x7f4ab0068b50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0b2000 tx=0x7f4abc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:13.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:13.668+0000 7f4accc00640 1 -- 172.21.15.7:0/327382981 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4ac80511e0 con 0x7f4ad01590d0 2024-09-13T15:12:14.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:14.028+0000 7f4ac6000640 1 -- 172.21.15.7:0/327382981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ad00cfc70 con 0x7f4ad01590d0 2024-09-13T15:12:14.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:14.032+0000 7f4accc00640 1 -- 172.21.15.7:0/327382981 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+5527 (secure 0 0 0) 0x7f4ac8054800 con 0x7f4ad01590d0 2024-09-13T15:12:14.033 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:12:14.033 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:12:14.015450+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:rejoin","state_seq":12,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:12:14.033 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 44 2024-09-13T15:12:14.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:14.044+0000 7f4ac6000640 1 -- 172.21.15.7:0/327382981 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4ab0066690 msgr2=0x7f4ab0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:14.044+0000 7f4ac6000640 1 --2- 172.21.15.7:0/327382981 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4ab0066690 0x7f4ab0068b50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0b2000 tx=0x7f4abc009040 comp rx=0 tx=0).stop 2024-09-13T15:12:14.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:14.044+0000 7f4ac6000640 1 -- 172.21.15.7:0/327382981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad01590d0 msgr2=0x7f4ad01eea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:14.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:14.044+0000 7f4ac6000640 1 --2- 172.21.15.7:0/327382981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad01590d0 0x7f4ad01eea70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800c700 tx=0x7f4ac800cbc0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:14.044+0000 7f4ac6000640 1 -- 172.21.15.7:0/327382981 shutdown_connections 2024-09-13T15:12:14.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:14.044+0000 7f4ac6000640 1 --2- 172.21.15.7:0/327382981 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4ab0066690 0x7f4ab0068b50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:14.044+0000 7f4ac6000640 1 --2- 172.21.15.7:0/327382981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4ad01590d0 0x7f4ad01eea70 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:14.044+0000 7f4ac6000640 1 --2- 172.21.15.7:0/327382981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4ad00c7720 0x7f4ad00cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:14.044+0000 7f4ac6000640 1 --2- 172.21.15.7:0/327382981 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4ad006b6a0 0x7f4ad01e4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:14.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:14.044+0000 7f4ac6000640 1 -- 172.21.15.7:0/327382981 >> 172.21.15.7:0/327382981 conn(0x7f4ad00cb5a0 msgr2=0x7f4ad014c610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:14.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:14.044+0000 7f4ac6000640 1 -- 172.21.15.7:0/327382981 shutdown_connections 2024-09-13T15:12:14.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:14.044+0000 7f4ac6000640 1 -- 172.21.15.7:0/327382981 wait complete. 2024-09-13T15:12:14.112 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 44, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-13T15:01:44.789559+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 44, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3 ], "info": { "gid_4267": { "addr": "172.21.15.77:6839/2233000674", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6837", "nonce": 2233000674, "type": "v2" }, { "addr": "172.21.15.77:6839", "nonce": 2233000674, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4267, "incarnation": 9, "join_fscid": -1, "name": "f", "rank": 1, "state": "up:active", "state_seq": 41 }, "gid_4276": { "addr": "172.21.15.7:6836/2396967179", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6834", "nonce": 2396967179, "type": "v2" }, { "addr": "172.21.15.7:6836", "nonce": 2396967179, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4276, "incarnation": 4, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_5069": { "addr": "172.21.15.77:6838/877425259", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6836", "nonce": 877425259, "type": "v2" }, { "addr": "172.21.15.77:6838", "nonce": 877425259, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5069, "incarnation": 31, "join_fscid": -1, "name": "b", "rank": 3, "state": "up:active", "state_seq": 43 }, "gid_5198": { "addr": "172.21.15.7:6833/1355774527", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6832", "nonce": 1355774527, "type": "v2" }, { "addr": "172.21.15.7:6833", "nonce": 1355774527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5198, "incarnation": 41, "join_fscid": -1, "name": "e", "rank": 2, "state": "up:rejoin", "state_seq": 12 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 4, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-13T15:12:14.015450+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [ 4 ], "tableserver": 0, "up": { "mds_0": 4276, "mds_1": 4267, "mds_2": 5198, "mds_3": 5069 } } } ], "standbys": [ { "addr": "172.21.15.7:6837/3708232086", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6835", "nonce": 3708232086, "type": "v2" }, { "addr": "172.21.15.7:6837", "nonce": 3708232086, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 36, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5156, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-13T15:12:16.113 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:16.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.276+0000 7f7859400640 1 Processor -- start 2024-09-13T15:12:16.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.276+0000 7f7859400640 1 -- start start 2024-09-13T15:12:16.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.280+0000 7f7859400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78540c5ab0 0x7f78540c6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:16.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.280+0000 7f7859400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f785406d530 0x7f78540c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:16.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.280+0000 7f7859400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78541660b0 con 0x7f78540c5e90 2024-09-13T15:12:16.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.280+0000 7f7859400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7854166d30 con 0x7f785406d530 2024-09-13T15:12:16.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.280+0000 7f7859400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785406fdf0 con 0x7f78540c5ab0 2024-09-13T15:12:16.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.288+0000 7f7852800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78540c5ab0 0x7f78540c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:16.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.288+0000 7f7852800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78540c5ab0 0x7f78540c6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:43144/0 (socket says 172.21.15.7:43144) 2024-09-13T15:12:16.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.288+0000 7f7852800640 1 -- 172.21.15.7:0/1866590637 learned_addr learned my addr 172.21.15.7:0/1866590637 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:12:16.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.288+0000 7f7852800640 1 -- 172.21.15.7:0/1866590637 >> v2:172.21.15.7:3300/0 conn(0x7f785406d530 msgr2=0x7f78540c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:16.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.288+0000 7f7852800640 1 --2- 172.21.15.7:0/1866590637 >> v2:172.21.15.7:3300/0 conn(0x7f785406d530 0x7f78540c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:16.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.288+0000 7f7852800640 1 -- 172.21.15.7:0/1866590637 >> v1:172.21.15.77:6789/0 conn(0x7f78540c5e90 legacy=0x7f785406ce20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:12:16.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.288+0000 7f7852800640 1 -- 172.21.15.7:0/1866590637 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7854166390 con 0x7f78540c5ab0 2024-09-13T15:12:16.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.308+0000 7f7852800640 1 --2- 172.21.15.7:0/1866590637 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78540c5ab0 0x7f78540c6800 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f784400aa90 tx=0x7f78440277d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b74e67e01bd46ff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:16.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.308+0000 7f7851400640 1 -- 172.21.15.7:0/1866590637 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78440b6630 con 0x7f78540c5ab0 2024-09-13T15:12:16.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.308+0000 7f7851400640 1 -- 172.21.15.7:0/1866590637 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78440b6790 con 0x7f78540c5ab0 2024-09-13T15:12:16.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.308+0000 7f7851400640 1 -- 172.21.15.7:0/1866590637 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78440b6b80 con 0x7f78540c5ab0 2024-09-13T15:12:16.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.308+0000 7f7859400640 1 -- 172.21.15.7:0/1866590637 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78540c5ab0 msgr2=0x7f78540c6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:16.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.308+0000 7f7859400640 1 --2- 172.21.15.7:0/1866590637 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78540c5ab0 0x7f78540c6800 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f784400aa90 tx=0x7f78440277d0 comp rx=0 tx=0).stop 2024-09-13T15:12:16.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.308+0000 7f7859400640 1 -- 172.21.15.7:0/1866590637 shutdown_connections 2024-09-13T15:12:16.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.308+0000 7f7859400640 1 --2- 172.21.15.7:0/1866590637 >> v2:172.21.15.7:3300/0 conn(0x7f785406d530 0x7f78540c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:16.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.308+0000 7f7859400640 1 --2- 172.21.15.7:0/1866590637 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78540c5ab0 0x7f78540c6800 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:16.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.308+0000 7f7859400640 1 -- 172.21.15.7:0/1866590637 >> 172.21.15.7:0/1866590637 conn(0x7f7854065d40 msgr2=0x7f7854066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:16.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.308+0000 7f7859400640 1 -- 172.21.15.7:0/1866590637 shutdown_connections 2024-09-13T15:12:16.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.312+0000 7f7859400640 1 -- 172.21.15.7:0/1866590637 wait complete. 2024-09-13T15:12:16.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.312+0000 7f7859400640 1 Processor -- start 2024-09-13T15:12:16.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.312+0000 7f7859400640 1 -- start start 2024-09-13T15:12:16.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f7859400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f785406d530 0x7f785420ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:16.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f7859400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78540c5ab0 0x7f785408a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:16.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f7859400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78540c5e90 0x7f785408a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:16.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f7859400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78542029c0 con 0x7f785406d530 2024-09-13T15:12:16.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f7859400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7854202770 con 0x7f78540c5ab0 2024-09-13T15:12:16.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f7859400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7854210ac0 con 0x7f78540c5e90 2024-09-13T15:12:16.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f7853200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78540c5e90 0x7f785408a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:16.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f7853200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78540c5e90 0x7f785408a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:43160/0 (socket says 172.21.15.7:43160) 2024-09-13T15:12:16.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f7853200640 1 -- 172.21.15.7:0/831892333 learned_addr learned my addr 172.21.15.7:0/831892333 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:12:16.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f7851e00640 1 --2- 172.21.15.7:0/831892333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78540c5ab0 0x7f785408a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:16.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f7853200640 1 -- 172.21.15.7:0/831892333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78540c5ab0 msgr2=0x7f785408a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:16.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f7853200640 1 --2- 172.21.15.7:0/831892333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78540c5ab0 0x7f785408a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:16.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f7853200640 1 -- 172.21.15.7:0/831892333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f785406d530 msgr2=0x7f785420ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:16.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f7853200640 1 --2- 172.21.15.7:0/831892333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f785406d530 0x7f785420ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f7853200640 1 -- 172.21.15.7:0/831892333 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784400a6f0 con 0x7f78540c5e90 2024-09-13T15:12:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f7853200640 1 --2- 172.21.15.7:0/831892333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78540c5e90 0x7f785408a8f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f784c00b970 tx=0x7f784c00be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f784aa00640 1 -- 172.21.15.7:0/831892333 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c00cb40 con 0x7f78540c5e90 2024-09-13T15:12:16.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.320+0000 7f7859400640 1 -- 172.21.15.7:0/831892333 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7854089f20 con 0x7f78540c5e90 2024-09-13T15:12:16.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.324+0000 7f7859400640 1 -- 172.21.15.7:0/831892333 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78540c17e0 con 0x7f78540c5e90 2024-09-13T15:12:16.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.324+0000 7f784aa00640 1 -- 172.21.15.7:0/831892333 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c00cca0 con 0x7f78540c5e90 2024-09-13T15:12:16.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.324+0000 7f784aa00640 1 -- 172.21.15.7:0/831892333 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c00cb40 con 0x7f78540c5e90 2024-09-13T15:12:16.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.324+0000 7f784aa00640 1 -- 172.21.15.7:0/831892333 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f784c01d3b0 con 0x7f78540c5e90 2024-09-13T15:12:16.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.328+0000 7f784aa00640 1 --2- 172.21.15.7:0/831892333 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f78340666b0 0x7f7834068b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:16.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.328+0000 7f784aa00640 1 -- 172.21.15.7:0/831892333 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f784c083f70 con 0x7f78540c5e90 2024-09-13T15:12:16.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.328+0000 7f7852800640 1 --2- 172.21.15.7:0/831892333 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f78340666b0 0x7f7834068b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.328+0000 7f7852800640 1 --2- 172.21.15.7:0/831892333 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f78340666b0 0x7f7834068b70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f78440bc000 tx=0x7f7844004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:16.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.328+0000 7f7859400640 1 -- 172.21.15.7:0/831892333 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c005260 con 0x7f78540c5e90 2024-09-13T15:12:16.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.340+0000 7f784aa00640 1 -- 172.21.15.7:0/831892333 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f784c050e60 con 0x7f78540c5e90 2024-09-13T15:12:16.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.900+0000 7f7859400640 1 -- 172.21.15.7:0/831892333 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f782c005510 con 0x7f78540c5e90 2024-09-13T15:12:16.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.912+0000 7f784aa00640 1 -- 172.21.15.7:0/831892333 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+5527 (secure 0 0 0) 0x7f784c019030 con 0x7f78540c5e90 2024-09-13T15:12:16.916 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:12:16.916 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:12:14.015450+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:rejoin","state_seq":12,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:12:16.916 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 44 2024-09-13T15:12:16.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.928+0000 7f7859400640 1 -- 172.21.15.7:0/831892333 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f78340666b0 msgr2=0x7f7834068b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:16.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.928+0000 7f7859400640 1 --2- 172.21.15.7:0/831892333 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f78340666b0 0x7f7834068b70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f78440bc000 tx=0x7f7844004740 comp rx=0 tx=0).stop 2024-09-13T15:12:16.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.928+0000 7f7859400640 1 -- 172.21.15.7:0/831892333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78540c5e90 msgr2=0x7f785408a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:16.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.928+0000 7f7859400640 1 --2- 172.21.15.7:0/831892333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78540c5e90 0x7f785408a8f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f784c00b970 tx=0x7f784c00be30 comp rx=0 tx=0).stop 2024-09-13T15:12:16.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.928+0000 7f7859400640 1 -- 172.21.15.7:0/831892333 shutdown_connections 2024-09-13T15:12:16.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.928+0000 7f7859400640 1 --2- 172.21.15.7:0/831892333 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f78340666b0 0x7f7834068b70 secure :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f78440bc000 tx=0x7f7844004740 comp rx=0 tx=0).stop 2024-09-13T15:12:16.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.928+0000 7f7859400640 1 --2- 172.21.15.7:0/831892333 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f78540c5e90 0x7f785408a8f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:16.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.928+0000 7f7859400640 1 --2- 172.21.15.7:0/831892333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78540c5ab0 0x7f785408a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:16.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.928+0000 7f7859400640 1 --2- 172.21.15.7:0/831892333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f785406d530 0x7f785420ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:16.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.928+0000 7f7859400640 1 -- 172.21.15.7:0/831892333 >> 172.21.15.7:0/831892333 conn(0x7f7854065d40 msgr2=0x7f7854070900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:16.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.928+0000 7f7859400640 1 -- 172.21.15.7:0/831892333 shutdown_connections 2024-09-13T15:12:16.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:16.928+0000 7f7859400640 1 -- 172.21.15.7:0/831892333 wait complete. 2024-09-13T15:12:16.975 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:12:18.976 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:19.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.256+0000 7f896e200640 1 Processor -- start 2024-09-13T15:12:19.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.260+0000 7f896e200640 1 -- start start 2024-09-13T15:12:19.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.264+0000 7f896e200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89600d8a00 0x7f8960050310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.264+0000 7f896e200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f89600493f0 0x7f89600dede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.264+0000 7f896e200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89600067a0 con 0x7f8960048ff0 2024-09-13T15:12:19.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.264+0000 7f896e200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8960037640 con 0x7f89600493f0 2024-09-13T15:12:19.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.264+0000 7f896e200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8960050850 con 0x7f89600d8a00 2024-09-13T15:12:19.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.268+0000 7f8966a00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8960048ff0 0x7f89600de6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:36052/0 (socket says 172.21.15.7:36052) 2024-09-13T15:12:19.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.268+0000 7f8966a00640 1 -- 172.21.15.7:0/137311033 learned_addr learned my addr 172.21.15.7:0/137311033 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:12:19.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.268+0000 7f8967e00640 1 --2- 172.21.15.7:0/137311033 >> v2:172.21.15.77:3300/0 conn(0x7f89600493f0 0x7f89600dede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.272+0000 7f8967400640 1 --2- 172.21.15.7:0/137311033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89600d8a00 0x7f8960050310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.272+0000 7f8967e00640 1 -- 172.21.15.7:0/137311033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89600d8a00 msgr2=0x7f8960050310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:19.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.272+0000 7f8967e00640 1 --2- 172.21.15.7:0/137311033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89600d8a00 0x7f8960050310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.272+0000 7f8967e00640 1 -- 172.21.15.7:0/137311033 >> v1:172.21.15.77:6789/0 conn(0x7f8960048ff0 legacy=0x7f89600de6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.272+0000 7f8967e00640 1 -- 172.21.15.7:0/137311033 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8960007320 con 0x7f89600493f0 2024-09-13T15:12:19.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.284+0000 7f8967e00640 1 --2- 172.21.15.7:0/137311033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89600493f0 0x7f89600dede0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f895c0097f0 tx=0x7f895c01ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46b18238c4f3dcf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.284+0000 7f8966000640 1 -- 172.21.15.7:0/137311033 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c0a8890 con 0x7f89600493f0 2024-09-13T15:12:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.284+0000 7f8966000640 1 -- 172.21.15.7:0/137311033 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c0a89f0 con 0x7f89600493f0 2024-09-13T15:12:19.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.284+0000 7f8966000640 1 -- 172.21.15.7:0/137311033 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c0a8d80 con 0x7f89600493f0 2024-09-13T15:12:19.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.288+0000 7f896e200640 1 -- 172.21.15.7:0/137311033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89600493f0 msgr2=0x7f89600dede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.288+0000 7f896e200640 1 --2- 172.21.15.7:0/137311033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89600493f0 0x7f89600dede0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f895c0097f0 tx=0x7f895c01ecd0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.288+0000 7f896e200640 1 -- 172.21.15.7:0/137311033 shutdown_connections 2024-09-13T15:12:19.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.288+0000 7f896e200640 1 --2- 172.21.15.7:0/137311033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89600493f0 0x7f89600dede0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.288+0000 7f896e200640 1 --2- 172.21.15.7:0/137311033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f89600d8a00 0x7f8960050310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.288+0000 7f896e200640 1 -- 172.21.15.7:0/137311033 >> 172.21.15.7:0/137311033 conn(0x7f8960054070 msgr2=0x7f8960054480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:19.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.288+0000 7f896e200640 1 -- 172.21.15.7:0/137311033 shutdown_connections 2024-09-13T15:12:19.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.288+0000 7f896e200640 1 -- 172.21.15.7:0/137311033 wait complete. 2024-09-13T15:12:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.292+0000 7f896e200640 1 Processor -- start 2024-09-13T15:12:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.292+0000 7f896e200640 1 -- start start 2024-09-13T15:12:19.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.296+0000 7f896e200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8960048ff0 0x7f8960053200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.296+0000 7f896e200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89600493f0 0x7f8960053740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.296+0000 7f896e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89600d8a00 0x7f896016b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.296+0000 7f896e200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8960038200 con 0x7f89600d8a00 2024-09-13T15:12:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.296+0000 7f896e200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8960167bf0 con 0x7f89600493f0 2024-09-13T15:12:19.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.296+0000 7f896e200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89600384a0 con 0x7f8960048ff0 2024-09-13T15:12:19.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.296+0000 7f8967400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8960048ff0 0x7f8960053200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.296+0000 7f8967400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8960048ff0 0x7f8960053200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:50030/0 (socket says 172.21.15.7:50030) 2024-09-13T15:12:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.296+0000 7f8967400640 1 -- 172.21.15.7:0/3334765573 learned_addr learned my addr 172.21.15.7:0/3334765573 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:12:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.300+0000 7f8967400640 1 -- 172.21.15.7:0/3334765573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89600493f0 msgr2=0x7f8960053740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.300+0000 7f8967400640 1 --2- 172.21.15.7:0/3334765573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89600493f0 0x7f8960053740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.300+0000 7f8967400640 1 -- 172.21.15.7:0/3334765573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89600d8a00 msgr2=0x7f896016b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.300+0000 7f8967400640 1 --2- 172.21.15.7:0/3334765573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89600d8a00 0x7f896016b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.300+0000 7f8967400640 1 -- 172.21.15.7:0/3334765573 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c009420 con 0x7f8960048ff0 2024-09-13T15:12:19.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.304+0000 7f8967400640 1 --2- 172.21.15.7:0/3334765573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8960048ff0 0x7f8960053200 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8968063da0 tx=0x7f896804ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.324+0000 7f895b400640 1 -- 172.21.15.7:0/3334765573 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896806e030 con 0x7f8960048ff0 2024-09-13T15:12:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.324+0000 7f895b400640 1 -- 172.21.15.7:0/3334765573 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8968068040 con 0x7f8960048ff0 2024-09-13T15:12:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.324+0000 7f895b400640 1 -- 172.21.15.7:0/3334765573 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8968090070 con 0x7f8960048ff0 2024-09-13T15:12:19.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.328+0000 7f896e200640 1 -- 172.21.15.7:0/3334765573 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8960038780 con 0x7f8960048ff0 2024-09-13T15:12:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.328+0000 7f896e200640 1 -- 172.21.15.7:0/3334765573 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896003a170 con 0x7f8960048ff0 2024-09-13T15:12:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.332+0000 7f895b400640 1 -- 172.21.15.7:0/3334765573 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f89680681b0 con 0x7f8960048ff0 2024-09-13T15:12:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.332+0000 7f896e200640 1 -- 172.21.15.7:0/3334765573 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89600498a0 con 0x7f8960048ff0 2024-09-13T15:12:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.336+0000 7f895b400640 1 --2- 172.21.15.7:0/3334765573 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f89480666e0 0x7f8948068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.336+0000 7f8966a00640 1 --2- 172.21.15.7:0/3334765573 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f89480666e0 0x7f8948068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:19.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.340+0000 7f8966a00640 1 --2- 172.21.15.7:0/3334765573 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f89480666e0 0x7f8948068ba0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8954000fc0 tx=0x7f8954007a80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:19.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.348+0000 7f895b400640 1 -- 172.21.15.7:0/3334765573 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f896806f070 con 0x7f8960048ff0 2024-09-13T15:12:19.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.352+0000 7f895b400640 1 -- 172.21.15.7:0/3334765573 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f89680cb5d0 con 0x7f8960048ff0 2024-09-13T15:12:19.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.748+0000 7f896e200640 1 -- 172.21.15.7:0/3334765573 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f896004fae0 con 0x7f8960048ff0 2024-09-13T15:12:19.751 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:12:19.751 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:12:14.015450+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:rejoin","state_seq":12,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:12:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.748+0000 7f895b400640 1 -- 172.21.15.7:0/3334765573 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+5527 (secure 0 0 0) 0x7f89680cebf0 con 0x7f8960048ff0 2024-09-13T15:12:19.751 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 44 2024-09-13T15:12:19.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.752+0000 7f896e200640 1 -- 172.21.15.7:0/3334765573 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f89480666e0 msgr2=0x7f8948068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.752+0000 7f896e200640 1 --2- 172.21.15.7:0/3334765573 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f89480666e0 0x7f8948068ba0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8954000fc0 tx=0x7f8954007a80 comp rx=0 tx=0).stop 2024-09-13T15:12:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.752+0000 7f896e200640 1 -- 172.21.15.7:0/3334765573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8960048ff0 msgr2=0x7f8960053200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:19.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.752+0000 7f896e200640 1 --2- 172.21.15.7:0/3334765573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8960048ff0 0x7f8960053200 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8968063da0 tx=0x7f896804ec60 comp rx=0 tx=0).stop 2024-09-13T15:12:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.756+0000 7f896e200640 1 -- 172.21.15.7:0/3334765573 shutdown_connections 2024-09-13T15:12:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.756+0000 7f896e200640 1 --2- 172.21.15.7:0/3334765573 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f89480666e0 0x7f8948068ba0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.756+0000 7f896e200640 1 --2- 172.21.15.7:0/3334765573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89600d8a00 0x7f896016b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.756+0000 7f896e200640 1 --2- 172.21.15.7:0/3334765573 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89600493f0 0x7f8960053740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.756+0000 7f896e200640 1 --2- 172.21.15.7:0/3334765573 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8960048ff0 0x7f8960053200 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.756+0000 7f896e200640 1 -- 172.21.15.7:0/3334765573 >> 172.21.15.7:0/3334765573 conn(0x7f8960054070 msgr2=0x7f8960049ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:19.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.756+0000 7f896e200640 1 -- 172.21.15.7:0/3334765573 shutdown_connections 2024-09-13T15:12:19.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:19.756+0000 7f896e200640 1 -- 172.21.15.7:0/3334765573 wait complete. 2024-09-13T15:12:19.821 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:12:20.165 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-09-13T15:12:20.164+0000 7ff9aa000640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-13T15:12:21.822 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:22.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.140+0000 7f1095400640 1 Processor -- start 2024-09-13T15:12:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.140+0000 7f1095400640 1 -- start start 2024-09-13T15:12:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.144+0000 7f1095400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1090150380 0x7f10900c6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.144+0000 7f1095400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f10901598d0 0x7f1090159d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.144+0000 7f1095400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1090159440 con 0x7f10900c7fa0 2024-09-13T15:12:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.144+0000 7f1095400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10900c1370 con 0x7f10901598d0 2024-09-13T15:12:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.144+0000 7f1095400640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1090155ed0 con 0x7f1090150380 2024-09-13T15:12:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.144+0000 7f1087e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f10900c7fa0 0x7f10900c7460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57002/0 (socket says 172.21.15.7:57002) 2024-09-13T15:12:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.144+0000 7f1087e00640 1 -- 172.21.15.7:0/282127809 learned_addr learned my addr 172.21.15.7:0/282127809 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:12:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.148+0000 7f108de00640 1 -- 172.21.15.7:0/282127809 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055421540 0 0) 0x7f1090159440 con 0x7f10900c7fa0 2024-09-13T15:12:22.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.148+0000 7f108de00640 1 -- 172.21.15.7:0/282127809 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1074003530 con 0x7f10900c7fa0 2024-09-13T15:12:22.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.148+0000 7f108de00640 1 -- 172.21.15.7:0/282127809 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2557177478 0 0) 0x7f1074003530 con 0x7f10900c7fa0 2024-09-13T15:12:22.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.148+0000 7f108de00640 1 -- 172.21.15.7:0/282127809 >> v2:172.21.15.77:3300/0 conn(0x7f1090150380 msgr2=0x7f10900c6690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:12:22.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.148+0000 7f108de00640 1 --2- 172.21.15.7:0/282127809 >> v2:172.21.15.77:3300/0 conn(0x7f1090150380 0x7f10900c6690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.148+0000 7f108de00640 1 -- 172.21.15.7:0/282127809 >> v2:172.21.15.7:3300/0 conn(0x7f10901598d0 msgr2=0x7f1090159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:22.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.148+0000 7f108de00640 1 --2- 172.21.15.7:0/282127809 >> v2:172.21.15.7:3300/0 conn(0x7f10901598d0 0x7f1090159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.148+0000 7f108de00640 1 -- 172.21.15.7:0/282127809 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109015a260 con 0x7f10900c7fa0 2024-09-13T15:12:22.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.148+0000 7f108de00640 1 -- 172.21.15.7:0/282127809 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f1078001660 con 0x7f10900c7fa0 2024-09-13T15:12:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.148+0000 7f108de00640 1 -- 172.21.15.7:0/282127809 >> v1:172.21.15.7:6789/0 conn(0x7f10900c7fa0 legacy=0x7f10900c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:22.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.152+0000 7f108de00640 1 --2- 172.21.15.7:0/282127809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740039e0 0x7f1074003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.152+0000 7f108de00640 1 --2- 172.21.15.7:0/282127809 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10740047d0 0x7f1074004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.152+0000 7f108de00640 1 --2- 172.21.15.7:0/282127809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1074005190 0x7f107400ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.152+0000 7f108de00640 1 -- 172.21.15.7:0/282127809 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10900c1370 con 0x7f10740039e0 2024-09-13T15:12:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.152+0000 7f108de00640 1 -- 172.21.15.7:0/282127809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1090155ed0 con 0x7f1074005190 2024-09-13T15:12:22.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.152+0000 7f108de00640 1 -- 172.21.15.7:0/282127809 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1074010780 con 0x7f10740047d0 2024-09-13T15:12:22.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.152+0000 7f108e800640 1 --2- 172.21.15.7:0/282127809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740039e0 0x7f1074003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.152+0000 7f108f200640 1 --2- 172.21.15.7:0/282127809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1074005190 0x7f107400ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.156+0000 7f1087e00640 1 --2- 172.21.15.7:0/282127809 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10740047d0 0x7f1074004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.156+0000 7f108f200640 1 -- 172.21.15.7:0/282127809 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10740047d0 msgr2=0x7f1074004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:22.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.156+0000 7f108f200640 1 --2- 172.21.15.7:0/282127809 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10740047d0 0x7f1074004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.156+0000 7f108f200640 1 -- 172.21.15.7:0/282127809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740039e0 msgr2=0x7f1074003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:22.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.156+0000 7f108f200640 1 --2- 172.21.15.7:0/282127809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740039e0 0x7f1074003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.156+0000 7f108f200640 1 -- 172.21.15.7:0/282127809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1074010a00 con 0x7f1074005190 2024-09-13T15:12:22.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.156+0000 7f108e800640 1 --2- 172.21.15.7:0/282127809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10740039e0 0x7f1074003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:12:22.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.156+0000 7f1087e00640 1 --2- 172.21.15.7:0/282127809 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10740047d0 0x7f1074004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:12:22.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.160+0000 7f108f200640 1 -- 172.21.15.7:0/282127809 reap_dead start 2024-09-13T15:12:22.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.160+0000 7f108f200640 1 --2- 172.21.15.7:0/282127809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1074005190 0x7f107400ffa0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1088009ca0 tx=0x7f108801cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e8da0cf2e3cc69a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:22.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.160+0000 7f108de00640 1 -- 172.21.15.7:0/282127809 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088003ba0 con 0x7f1074005190 2024-09-13T15:12:22.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.160+0000 7f108de00640 1 -- 172.21.15.7:0/282127809 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1088003d20 con 0x7f1074005190 2024-09-13T15:12:22.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.160+0000 7f108de00640 1 -- 172.21.15.7:0/282127809 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10880a5b80 con 0x7f1074005190 2024-09-13T15:12:22.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.164+0000 7f1095400640 1 -- 172.21.15.7:0/282127809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1074005190 msgr2=0x7f107400ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:22.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.164+0000 7f1095400640 1 --2- 172.21.15.7:0/282127809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1074005190 0x7f107400ffa0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1088009ca0 tx=0x7f108801cc50 comp rx=0 tx=0).stop 2024-09-13T15:12:22.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.168+0000 7f1095400640 1 -- 172.21.15.7:0/282127809 shutdown_connections 2024-09-13T15:12:22.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.168+0000 7f1095400640 1 --2- 172.21.15.7:0/282127809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1074005190 0x7f107400ffa0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.168+0000 7f1095400640 1 -- 172.21.15.7:0/282127809 >> 172.21.15.7:0/282127809 conn(0x7f1090069f30 msgr2=0x7f109006a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:22.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.176+0000 7f1095400640 1 -- 172.21.15.7:0/282127809 shutdown_connections 2024-09-13T15:12:22.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.184+0000 7f1095400640 1 -- 172.21.15.7:0/282127809 wait complete. 2024-09-13T15:12:22.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.188+0000 7f1095400640 1 Processor -- start 2024-09-13T15:12:22.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.188+0000 7f1095400640 1 -- start start 2024-09-13T15:12:22.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.188+0000 7f1095400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1074005190 0x7f10900cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.188+0000 7f1095400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10900cb5c0 0x7f1090157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.188+0000 7f1095400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1090157670 0x7f109013ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.192+0000 7f1095400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109013ebf0 con 0x7f1074005190 2024-09-13T15:12:22.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.192+0000 7f1095400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1090157af0 con 0x7f1090157670 2024-09-13T15:12:22.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.192+0000 7f108f200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1090157670 0x7f109013ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.192+0000 7f108f200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1090157670 0x7f109013ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:42718/0 (socket says 172.21.15.7:42718) 2024-09-13T15:12:22.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.192+0000 7f108f200640 1 -- 172.21.15.7:0/1043659585 learned_addr learned my addr 172.21.15.7:0/1043659585 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:12:22.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.192+0000 7f1095400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109013dcd0 con 0x7f10900cb5c0 2024-09-13T15:12:22.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.192+0000 7f1087e00640 1 --2- 172.21.15.7:0/1043659585 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10900cb5c0 0x7f1090157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.192+0000 7f108f200640 1 -- 172.21.15.7:0/1043659585 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10900cb5c0 msgr2=0x7f1090157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:22.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.192+0000 7f108f200640 1 --2- 172.21.15.7:0/1043659585 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10900cb5c0 0x7f1090157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.192+0000 7f108f200640 1 -- 172.21.15.7:0/1043659585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1074005190 msgr2=0x7f10900cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:22.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.192+0000 7f108e800640 1 --2- 172.21.15.7:0/1043659585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1074005190 0x7f10900cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.192+0000 7f108f200640 1 --2- 172.21.15.7:0/1043659585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1074005190 0x7f10900cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.192+0000 7f108f200640 1 -- 172.21.15.7:0/1043659585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f109013df70 con 0x7f1090157670 2024-09-13T15:12:22.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.192+0000 7f108e800640 1 --2- 172.21.15.7:0/1043659585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1074005190 0x7f10900cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:22.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.196+0000 7f108f200640 1 --2- 172.21.15.7:0/1043659585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1090157670 0x7f109013ccc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f108801d4f0 tx=0x7f1074005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:22.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.196+0000 7f1086a00640 1 -- 172.21.15.7:0/1043659585 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088003b80 con 0x7f1090157670 2024-09-13T15:12:22.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.196+0000 7f1086a00640 1 -- 172.21.15.7:0/1043659585 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10880b3040 con 0x7f1090157670 2024-09-13T15:12:22.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.196+0000 7f1086a00640 1 -- 172.21.15.7:0/1043659585 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088004240 con 0x7f1090157670 2024-09-13T15:12:22.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.196+0000 7f1095400640 1 -- 172.21.15.7:0/1043659585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f109013e250 con 0x7f1090157670 2024-09-13T15:12:22.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.196+0000 7f1095400640 1 -- 172.21.15.7:0/1043659585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f109013e810 con 0x7f1090157670 2024-09-13T15:12:22.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.200+0000 7f1095400640 1 -- 172.21.15.7:0/1043659585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10900c6e90 con 0x7f1090157670 2024-09-13T15:12:22.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.208+0000 7f1086a00640 1 -- 172.21.15.7:0/1043659585 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f10880043a0 con 0x7f1090157670 2024-09-13T15:12:22.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.208+0000 7f1086a00640 1 --2- 172.21.15.7:0/1043659585 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f106c066760 0x7f106c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:22.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.208+0000 7f1086a00640 1 -- 172.21.15.7:0/1043659585 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f108811e2e0 con 0x7f1090157670 2024-09-13T15:12:22.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.212+0000 7f108e800640 1 --2- 172.21.15.7:0/1043659585 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f106c066760 0x7f106c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:22.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.216+0000 7f108e800640 1 --2- 172.21.15.7:0/1043659585 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f106c066760 0x7f106c068c20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1080009910 tx=0x7f1080008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:22.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.216+0000 7f1086a00640 1 -- 172.21.15.7:0/1043659585 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f10880eb1b0 con 0x7f1090157670 2024-09-13T15:12:22.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.612+0000 7f1095400640 1 -- 172.21.15.7:0/1043659585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10900c7240 con 0x7f1090157670 2024-09-13T15:12:22.614 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:12:22.614 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:12:19.980748+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:12:22.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.612+0000 7f1086a00640 1 -- 172.21.15.7:0/1043659585 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+5527 (secure 0 0 0) 0x7f10880ee7d0 con 0x7f1090157670 2024-09-13T15:12:22.614 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 45 2024-09-13T15:12:22.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.616+0000 7f1095400640 1 -- 172.21.15.7:0/1043659585 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f106c066760 msgr2=0x7f106c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:22.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.616+0000 7f1095400640 1 --2- 172.21.15.7:0/1043659585 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f106c066760 0x7f106c068c20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1080009910 tx=0x7f1080008040 comp rx=0 tx=0).stop 2024-09-13T15:12:22.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.616+0000 7f1095400640 1 -- 172.21.15.7:0/1043659585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1090157670 msgr2=0x7f109013ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:22.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.616+0000 7f1095400640 1 --2- 172.21.15.7:0/1043659585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1090157670 0x7f109013ccc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f108801d4f0 tx=0x7f1074005800 comp rx=0 tx=0).stop 2024-09-13T15:12:22.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.616+0000 7f1095400640 1 -- 172.21.15.7:0/1043659585 shutdown_connections 2024-09-13T15:12:22.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.616+0000 7f1095400640 1 --2- 172.21.15.7:0/1043659585 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f106c066760 0x7f106c068c20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.616+0000 7f1095400640 1 --2- 172.21.15.7:0/1043659585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1090157670 0x7f109013ccc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.616+0000 7f1095400640 1 --2- 172.21.15.7:0/1043659585 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f10900cb5c0 0x7f1090157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.616+0000 7f1095400640 1 --2- 172.21.15.7:0/1043659585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1074005190 0x7f10900cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:22.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.616+0000 7f1095400640 1 -- 172.21.15.7:0/1043659585 >> 172.21.15.7:0/1043659585 conn(0x7f1090069f30 msgr2=0x7f109006e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:22.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.628+0000 7f1095400640 1 -- 172.21.15.7:0/1043659585 shutdown_connections 2024-09-13T15:12:22.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:22.628+0000 7f1095400640 1 -- 172.21.15.7:0/1043659585 wait complete. 2024-09-13T15:12:22.687 INFO:tasks.mds_thrash.fs.[cephfs]:mds.e has gained rank=2, replacing gid=4252 2024-09-13T15:12:22.687 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 2 secs before reviving mds.d 2024-09-13T15:12:24.688 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.d 2024-09-13T15:12:24.688 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T15:12:24.688 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T15:12:24.690 INFO:tasks.ceph.mds.d:Started 2024-09-13T15:12:24.691 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:25.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.012+0000 7fd220c00640 1 Processor -- start 2024-09-13T15:12:25.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.012+0000 7fd220c00640 1 -- start start 2024-09-13T15:12:25.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.016+0000 7fd220c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd2140d6a80 0x7fd2140dd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:25.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.016+0000 7fd220c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2140e07d0 0x7fd2140e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:25.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.016+0000 7fd219e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd2140d6a80 0x7fd2140dd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:25.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.016+0000 7fd219e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd2140d6a80 0x7fd2140dd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:42724/0 (socket says 172.21.15.7:42724) 2024-09-13T15:12:25.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.016+0000 7fd219e00640 1 -- 172.21.15.7:0/2833649548 learned_addr learned my addr 172.21.15.7:0/2833649548 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:12:25.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.016+0000 7fd21a800640 1 --2- 172.21.15.7:0/2833649548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2140e07d0 0x7fd2140e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:25.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.016+0000 7fd219400640 1 --1- 172.21.15.7:0/2833649548 >> v1:172.21.15.77:6789/0 conn(0x7fd2140e03a0 0x7fd214051e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:36064/0 (socket says 172.21.15.7:36064) 2024-09-13T15:12:25.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.016+0000 7fd220c00640 1 -- 172.21.15.7:0/2833649548 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd214046df0 con 0x7fd2140e03a0 2024-09-13T15:12:25.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.016+0000 7fd220c00640 1 -- 172.21.15.7:0/2833649548 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2140dd5d0 con 0x7fd2140d6a80 2024-09-13T15:12:25.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.016+0000 7fd220c00640 1 -- 172.21.15.7:0/2833649548 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21404d780 con 0x7fd2140e07d0 2024-09-13T15:12:25.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.016+0000 7fd21a800640 1 -- 172.21.15.7:0/2833649548 >> v2:172.21.15.77:3300/0 conn(0x7fd2140d6a80 msgr2=0x7fd2140dd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:12:25.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.016+0000 7fd21a800640 1 --2- 172.21.15.7:0/2833649548 >> v2:172.21.15.77:3300/0 conn(0x7fd2140d6a80 0x7fd2140dd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:25.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.016+0000 7fd21a800640 1 -- 172.21.15.7:0/2833649548 >> v1:172.21.15.77:6789/0 conn(0x7fd2140e03a0 legacy=0x7fd214051e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:25.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.016+0000 7fd21a800640 1 -- 172.21.15.7:0/2833649548 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2140dfbe0 con 0x7fd2140e07d0 2024-09-13T15:12:25.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.024+0000 7fd21a800640 1 --2- 172.21.15.7:0/2833649548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2140e07d0 0x7fd2140e6f70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd21c063c00 tx=0x7fd21c099eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a52305a3a8050257 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:25.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.024+0000 7fd218a00640 1 -- 172.21.15.7:0/2833649548 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c06e030 con 0x7fd2140e07d0 2024-09-13T15:12:25.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.024+0000 7fd218a00640 1 -- 172.21.15.7:0/2833649548 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c1239a0 con 0x7fd2140e07d0 2024-09-13T15:12:25.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.024+0000 7fd218a00640 1 -- 172.21.15.7:0/2833649548 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c123d90 con 0x7fd2140e07d0 2024-09-13T15:12:25.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.024+0000 7fd220c00640 1 -- 172.21.15.7:0/2833649548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2140e07d0 msgr2=0x7fd2140e6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:25.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.024+0000 7fd220c00640 1 --2- 172.21.15.7:0/2833649548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2140e07d0 0x7fd2140e6f70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd21c063c00 tx=0x7fd21c099eb0 comp rx=0 tx=0).stop 2024-09-13T15:12:25.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.024+0000 7fd220c00640 1 -- 172.21.15.7:0/2833649548 shutdown_connections 2024-09-13T15:12:25.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.028+0000 7fd220c00640 1 --2- 172.21.15.7:0/2833649548 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2140e07d0 0x7fd2140e6f70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:25.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.028+0000 7fd220c00640 1 --2- 172.21.15.7:0/2833649548 >> v2:172.21.15.77:3300/0 conn(0x7fd2140d6a80 0x7fd2140dd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:25.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.028+0000 7fd220c00640 1 -- 172.21.15.7:0/2833649548 >> 172.21.15.7:0/2833649548 conn(0x7fd214009990 msgr2=0x7fd214009da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:25.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.028+0000 7fd220c00640 1 -- 172.21.15.7:0/2833649548 shutdown_connections 2024-09-13T15:12:25.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.028+0000 7fd220c00640 1 -- 172.21.15.7:0/2833649548 wait complete. 2024-09-13T15:12:25.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.032+0000 7fd220c00640 1 Processor -- start 2024-09-13T15:12:25.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.032+0000 7fd220c00640 1 -- start start 2024-09-13T15:12:25.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.036+0000 7fd220c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2140d6a80 0x7fd2140d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:25.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.036+0000 7fd220c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2140e03a0 0x7fd214008020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:25.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.036+0000 7fd220c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2140e07d0 0x7fd2140cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:25.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.036+0000 7fd220c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd214009350 con 0x7fd2140d6a80 2024-09-13T15:12:25.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.036+0000 7fd220c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd214009580 con 0x7fd2140e03a0 2024-09-13T15:12:25.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.036+0000 7fd220c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140dc4a0 con 0x7fd2140e07d0 2024-09-13T15:12:25.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.036+0000 7fd219400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2140e03a0 0x7fd214008020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:25.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.036+0000 7fd219400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2140e03a0 0x7fd214008020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:42732/0 (socket says 172.21.15.7:42732) 2024-09-13T15:12:25.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.036+0000 7fd219400640 1 -- 172.21.15.7:0/318465492 learned_addr learned my addr 172.21.15.7:0/318465492 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:12:25.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.036+0000 7fd219e00640 1 --2- 172.21.15.7:0/318465492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2140d6a80 0x7fd2140d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:25.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.036+0000 7fd21a800640 1 --2- 172.21.15.7:0/318465492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2140e07d0 0x7fd2140cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:25.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.036+0000 7fd219e00640 1 -- 172.21.15.7:0/318465492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2140e07d0 msgr2=0x7fd2140cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:25.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.036+0000 7fd219e00640 1 --2- 172.21.15.7:0/318465492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2140e07d0 0x7fd2140cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:25.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.036+0000 7fd219e00640 1 -- 172.21.15.7:0/318465492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2140e03a0 msgr2=0x7fd214008020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:25.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.036+0000 7fd219e00640 1 --2- 172.21.15.7:0/318465492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2140e03a0 0x7fd214008020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:25.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.036+0000 7fd219e00640 1 -- 172.21.15.7:0/318465492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21c074490 con 0x7fd2140d6a80 2024-09-13T15:12:25.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.036+0000 7fd21a800640 1 --2- 172.21.15.7:0/318465492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2140e07d0 0x7fd2140cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:12:25.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.040+0000 7fd219e00640 1 --2- 172.21.15.7:0/318465492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2140d6a80 0x7fd2140d00f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00bb20 tx=0x7fd20c00df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:25.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.044+0000 7fd212000640 1 -- 172.21.15.7:0/318465492 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00f950 con 0x7fd2140d6a80 2024-09-13T15:12:25.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.044+0000 7fd212000640 1 -- 172.21.15.7:0/318465492 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c00fab0 con 0x7fd2140d6a80 2024-09-13T15:12:25.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.044+0000 7fd212000640 1 -- 172.21.15.7:0/318465492 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00fe60 con 0x7fd2140d6a80 2024-09-13T15:12:25.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.048+0000 7fd220c00640 1 -- 172.21.15.7:0/318465492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2140dc780 con 0x7fd2140d6a80 2024-09-13T15:12:25.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.048+0000 7fd220c00640 1 -- 172.21.15.7:0/318465492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd214007820 con 0x7fd2140d6a80 2024-09-13T15:12:25.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.052+0000 7fd220c00640 1 -- 172.21.15.7:0/318465492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f4005260 con 0x7fd2140d6a80 2024-09-13T15:12:25.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.056+0000 7fd212000640 1 -- 172.21.15.7:0/318465492 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd20c014070 con 0x7fd2140d6a80 2024-09-13T15:12:25.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.060+0000 7fd212000640 1 --2- 172.21.15.7:0/318465492 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd1fc0666e0 0x7fd1fc068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:25.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.060+0000 7fd212000640 1 -- 172.21.15.7:0/318465492 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fd20c083c90 con 0x7fd2140d6a80 2024-09-13T15:12:25.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.060+0000 7fd219400640 1 --2- 172.21.15.7:0/318465492 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd1fc0666e0 0x7fd1fc068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:25.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.060+0000 7fd219400640 1 --2- 172.21.15.7:0/318465492 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd1fc0666e0 0x7fd1fc068ba0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd2140092e0 tx=0x7fd208007f20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:25.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.068+0000 7fd212000640 1 -- 172.21.15.7:0/318465492 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd20c050c10 con 0x7fd2140d6a80 2024-09-13T15:12:25.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.472+0000 7fd220c00640 1 -- 172.21.15.7:0/318465492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1f4005a90 con 0x7fd2140d6a80 2024-09-13T15:12:25.502 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:12:25.502 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:12:19.980748+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:12:25.503 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 45 2024-09-13T15:12:25.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.496+0000 7fd212000640 1 -- 172.21.15.7:0/318465492 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+5527 (secure 0 0 0) 0x7fd20c01b090 con 0x7fd2140d6a80 2024-09-13T15:12:25.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.524+0000 7fd220c00640 1 -- 172.21.15.7:0/318465492 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd1fc0666e0 msgr2=0x7fd1fc068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:25.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.524+0000 7fd220c00640 1 --2- 172.21.15.7:0/318465492 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd1fc0666e0 0x7fd1fc068ba0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd2140092e0 tx=0x7fd208007f20 comp rx=0 tx=0).stop 2024-09-13T15:12:25.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.524+0000 7fd220c00640 1 -- 172.21.15.7:0/318465492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2140d6a80 msgr2=0x7fd2140d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:25.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.524+0000 7fd220c00640 1 --2- 172.21.15.7:0/318465492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2140d6a80 0x7fd2140d00f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00bb20 tx=0x7fd20c00df70 comp rx=0 tx=0).stop 2024-09-13T15:12:25.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.528+0000 7fd220c00640 1 -- 172.21.15.7:0/318465492 shutdown_connections 2024-09-13T15:12:25.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.528+0000 7fd220c00640 1 --2- 172.21.15.7:0/318465492 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd1fc0666e0 0x7fd1fc068ba0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:25.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.528+0000 7fd220c00640 1 --2- 172.21.15.7:0/318465492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd2140e07d0 0x7fd2140cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:25.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.528+0000 7fd220c00640 1 --2- 172.21.15.7:0/318465492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd2140e03a0 0x7fd214008020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:25.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.528+0000 7fd220c00640 1 --2- 172.21.15.7:0/318465492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2140d6a80 0x7fd2140d00f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:25.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.528+0000 7fd220c00640 1 -- 172.21.15.7:0/318465492 >> 172.21.15.7:0/318465492 conn(0x7fd214009990 msgr2=0x7fd214048030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:25.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.528+0000 7fd220c00640 1 -- 172.21.15.7:0/318465492 shutdown_connections 2024-09-13T15:12:25.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:25.528+0000 7fd220c00640 1 -- 172.21.15.7:0/318465492 wait complete. 2024-09-13T15:12:25.620 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2024-09-13T15:12:26.574 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-13T15:12:27.621 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:12:28.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.016+0000 7f2299400640 1 Processor -- start 2024-09-13T15:12:28.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.016+0000 7f2299400640 1 -- start start 2024-09-13T15:12:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.028+0000 7f2299400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2294159260 0x7f22940c4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.028+0000 7f2299400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2294158dd0 con 0x7f22940c7660 2024-09-13T15:12:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.028+0000 7f2299400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22940c5ea0 con 0x7f22940c7a40 2024-09-13T15:12:28.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.028+0000 7f2299400640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22941585a0 con 0x7f2294159260 2024-09-13T15:12:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.028+0000 7f2293e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f22940c7660 0x7f2294155030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:57016/0 (socket says 172.21.15.7:57016) 2024-09-13T15:12:28.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.028+0000 7f2293e00640 1 -- 172.21.15.7:0/1052282862 learned_addr learned my addr 172.21.15.7:0/1052282862 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:12:28.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.028+0000 7f2293400640 1 --2- 172.21.15.7:0/1052282862 >> v2:172.21.15.77:3300/0 conn(0x7f2294159260 0x7f22940c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:28.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.032+0000 7f2292a00640 1 -- 172.21.15.7:0/1052282862 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237084960 0 0) 0x7f2294158dd0 con 0x7f22940c7660 2024-09-13T15:12:28.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.032+0000 7f2292a00640 1 -- 172.21.15.7:0/1052282862 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2278003450 con 0x7f22940c7660 2024-09-13T15:12:28.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.032+0000 7f2292a00640 1 -- 172.21.15.7:0/1052282862 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502411972 0 0) 0x7f22940c5ea0 con 0x7f22940c7a40 2024-09-13T15:12:28.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.032+0000 7f2292a00640 1 -- 172.21.15.7:0/1052282862 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2294158dd0 con 0x7f22940c7a40 2024-09-13T15:12:28.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.032+0000 7f2293400640 1 -- 172.21.15.7:0/1052282862 >> v1:172.21.15.77:6789/0 conn(0x7f22940c7a40 legacy=0x7f22941522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:28.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.032+0000 7f2293400640 1 -- 172.21.15.7:0/1052282862 >> v1:172.21.15.7:6789/0 conn(0x7f22940c7660 legacy=0x7f2294155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:28.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.032+0000 7f2293400640 1 -- 172.21.15.7:0/1052282862 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22940c6140 con 0x7f2294159260 2024-09-13T15:12:28.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.056+0000 7f2293400640 1 --2- 172.21.15.7:0/1052282862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2294159260 0x7f22940c4450 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2284009740 tx=0x7f228401ea90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3746a1d71f68a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.060+0000 7f2292a00640 1 -- 172.21.15.7:0/1052282862 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c0018b0 con 0x7f2294159260 2024-09-13T15:12:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.060+0000 7f2292a00640 1 -- 172.21.15.7:0/1052282862 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22840a85d0 con 0x7f2294159260 2024-09-13T15:12:28.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.060+0000 7f2292a00640 1 -- 172.21.15.7:0/1052282862 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c0018b0 con 0x7f2294159260 2024-09-13T15:12:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.060+0000 7f2299400640 1 -- 172.21.15.7:0/1052282862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2294159260 msgr2=0x7f22940c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:28.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.060+0000 7f2299400640 1 --2- 172.21.15.7:0/1052282862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2294159260 0x7f22940c4450 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2284009740 tx=0x7f228401ea90 comp rx=0 tx=0).stop 2024-09-13T15:12:28.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.064+0000 7f2299400640 1 -- 172.21.15.7:0/1052282862 shutdown_connections 2024-09-13T15:12:28.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.064+0000 7f2299400640 1 --2- 172.21.15.7:0/1052282862 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2294159260 0x7f22940c4450 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:28.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.064+0000 7f2299400640 1 -- 172.21.15.7:0/1052282862 >> 172.21.15.7:0/1052282862 conn(0x7f2294065d40 msgr2=0x7f2294066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:28.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.064+0000 7f2299400640 1 -- 172.21.15.7:0/1052282862 shutdown_connections 2024-09-13T15:12:28.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.064+0000 7f2299400640 1 -- 172.21.15.7:0/1052282862 wait complete. 2024-09-13T15:12:28.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.072+0000 7f2299400640 1 Processor -- start 2024-09-13T15:12:28.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.088+0000 7f2299400640 1 -- start start 2024-09-13T15:12:28.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.092+0000 7f2299400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22940c7660 0x7f22941575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:28.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.092+0000 7f2299400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22940c7a40 0x7f22940c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:28.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.092+0000 7f2299400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2294159260 0x7f22941f5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:28.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.092+0000 7f2299400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22941fc3f0 con 0x7f22940c7660 2024-09-13T15:12:28.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.092+0000 7f2299400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22941fb4f0 con 0x7f2294159260 2024-09-13T15:12:28.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.092+0000 7f2299400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22941fb770 con 0x7f22940c7a40 2024-09-13T15:12:28.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.092+0000 7f2298a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2294159260 0x7f22941f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:28.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.092+0000 7f2298a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2294159260 0x7f22941f5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:42760/0 (socket says 172.21.15.7:42760) 2024-09-13T15:12:28.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.092+0000 7f2298a00640 1 -- 172.21.15.7:0/1439164399 learned_addr learned my addr 172.21.15.7:0/1439164399 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:12:28.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.092+0000 7f2293e00640 1 --2- 172.21.15.7:0/1439164399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22940c7660 0x7f22941575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:28.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.092+0000 7f2293400640 1 --2- 172.21.15.7:0/1439164399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22940c7a40 0x7f22940c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:28.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.096+0000 7f2298a00640 1 -- 172.21.15.7:0/1439164399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22940c7a40 msgr2=0x7f22940c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:28.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.096+0000 7f2298a00640 1 --2- 172.21.15.7:0/1439164399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22940c7a40 0x7f22940c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:28.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.096+0000 7f2298a00640 1 -- 172.21.15.7:0/1439164399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22940c7660 msgr2=0x7f22941575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:28.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.096+0000 7f2298a00640 1 --2- 172.21.15.7:0/1439164399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22940c7660 0x7f22941575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:28.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.096+0000 7f2298a00640 1 -- 172.21.15.7:0/1439164399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2284009420 con 0x7f2294159260 2024-09-13T15:12:28.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.100+0000 7f2298a00640 1 --2- 172.21.15.7:0/1439164399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2294159260 0x7f22941f5380 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f228c00ca40 tx=0x7f228c00cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:28.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.100+0000 7f228be00640 1 -- 172.21.15.7:0/1439164399 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c003d90 con 0x7f2294159260 2024-09-13T15:12:28.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.100+0000 7f228be00640 1 -- 172.21.15.7:0/1439164399 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228c00a7c0 con 0x7f2294159260 2024-09-13T15:12:28.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.100+0000 7f228be00640 1 -- 172.21.15.7:0/1439164399 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228c00ab70 con 0x7f2294159260 2024-09-13T15:12:28.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.100+0000 7f2299400640 1 -- 172.21.15.7:0/1439164399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22941fba50 con 0x7f2294159260 2024-09-13T15:12:28.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.100+0000 7f2299400640 1 -- 172.21.15.7:0/1439164399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22941fc010 con 0x7f2294159260 2024-09-13T15:12:28.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.108+0000 7f2289600640 1 -- 172.21.15.7:0/1439164399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2264005260 con 0x7f2294159260 2024-09-13T15:12:28.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.116+0000 7f228be00640 1 -- 172.21.15.7:0/1439164399 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f228c00acd0 con 0x7f2294159260 2024-09-13T15:12:28.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.120+0000 7f228be00640 1 --2- 172.21.15.7:0/1439164399 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2270066760 0x7f2270068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:12:28.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.120+0000 7f228be00640 1 -- 172.21.15.7:0/1439164399 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f228c0841c0 con 0x7f2294159260 2024-09-13T15:12:28.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.128+0000 7f2293e00640 1 --2- 172.21.15.7:0/1439164399 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2270066760 0x7f2270068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:12:28.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.132+0000 7f2293e00640 1 --2- 172.21.15.7:0/1439164399 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2270066760 0x7f2270068c20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f227c000f70 tx=0x7f227c001160 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:12:28.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.136+0000 7f228be00640 1 -- 172.21.15.7:0/1439164399 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f228c0510b0 con 0x7f2294159260 2024-09-13T15:12:28.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.712+0000 7f2289600640 1 -- 172.21.15.7:0/1439164399 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2264005a90 con 0x7f2294159260 2024-09-13T15:12:28.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.712+0000 7f228be00640 1 -- 172.21.15.7:0/1439164399 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+6284 (secure 0 0 0) 0x7f228c0546d0 con 0x7f2294159260 2024-09-13T15:12:28.716 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:12:28.718 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:12:19.980748+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:12:28.718 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 46 2024-09-13T15:12:28.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.724+0000 7f2289600640 1 -- 172.21.15.7:0/1439164399 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2270066760 msgr2=0x7f2270068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:28.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.724+0000 7f2289600640 1 --2- 172.21.15.7:0/1439164399 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2270066760 0x7f2270068c20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f227c000f70 tx=0x7f227c001160 comp rx=0 tx=0).stop 2024-09-13T15:12:28.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.724+0000 7f2289600640 1 -- 172.21.15.7:0/1439164399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2294159260 msgr2=0x7f22941f5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:12:28.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.724+0000 7f2289600640 1 --2- 172.21.15.7:0/1439164399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2294159260 0x7f22941f5380 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f228c00ca40 tx=0x7f228c00cf00 comp rx=0 tx=0).stop 2024-09-13T15:12:28.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.728+0000 7f2289600640 1 -- 172.21.15.7:0/1439164399 shutdown_connections 2024-09-13T15:12:28.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.728+0000 7f2289600640 1 --2- 172.21.15.7:0/1439164399 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2270066760 0x7f2270068c20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:28.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.728+0000 7f2289600640 1 --2- 172.21.15.7:0/1439164399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2294159260 0x7f22941f5380 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:28.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.728+0000 7f2289600640 1 --2- 172.21.15.7:0/1439164399 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f22940c7a40 0x7f22940c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:28.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.728+0000 7f2289600640 1 --2- 172.21.15.7:0/1439164399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22940c7660 0x7f22941575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:12:28.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.728+0000 7f2289600640 1 -- 172.21.15.7:0/1439164399 >> 172.21.15.7:0/1439164399 conn(0x7f2294065d40 msgr2=0x7f22941520a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:12:28.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.728+0000 7f2289600640 1 -- 172.21.15.7:0/1439164399 shutdown_connections 2024-09-13T15:12:28.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:12:28.728+0000 7f2289600640 1 -- 172.21.15.7:0/1439164399 wait complete. 2024-09-13T15:12:28.774 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d reported in up:standby state 2024-09-13T15:12:28.774 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 41 secs before thrashing 2024-09-13T15:13:09.776 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:10.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.028+0000 7fb457400640 1 Processor -- start 2024-09-13T15:13:10.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.028+0000 7fb457400640 1 -- start start 2024-09-13T15:13:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb457400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb450071a70 0x7fb4501576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb457400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb4500b0bf0 0x7fb450150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb457400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb45006ddb0 0x7fb450151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb457400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb450151750 con 0x7fb45006ddb0 2024-09-13T15:13:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb457400640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4500c5530 con 0x7fb4500b0bf0 2024-09-13T15:13:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb457400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4501583b0 con 0x7fb450071a70 2024-09-13T15:13:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb454a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb450071a70 0x7fb4501576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb454a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb450071a70 0x7fb4501576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:36628/0 (socket says 172.21.15.7:36628) 2024-09-13T15:13:10.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb454a00640 1 -- 172.21.15.7:0/365820610 learned_addr learned my addr 172.21.15.7:0/365820610 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb44fe00640 1 --2- 172.21.15.7:0/365820610 >> v2:172.21.15.77:3300/0 conn(0x7fb4500b0bf0 0x7fb450150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb455400640 1 --2- 172.21.15.7:0/365820610 >> v2:172.21.15.7:3300/0 conn(0x7fb45006ddb0 0x7fb450151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb454a00640 1 -- 172.21.15.7:0/365820610 >> v2:172.21.15.77:3300/0 conn(0x7fb4500b0bf0 msgr2=0x7fb450150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb454a00640 1 --2- 172.21.15.7:0/365820610 >> v2:172.21.15.77:3300/0 conn(0x7fb4500b0bf0 0x7fb450150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb454a00640 1 -- 172.21.15.7:0/365820610 >> v2:172.21.15.7:3300/0 conn(0x7fb45006ddb0 msgr2=0x7fb450151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb454a00640 1 --2- 172.21.15.7:0/365820610 >> v2:172.21.15.7:3300/0 conn(0x7fb45006ddb0 0x7fb450151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb454a00640 1 -- 172.21.15.7:0/365820610 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb450156f40 con 0x7fb450071a70 2024-09-13T15:13:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb455400640 1 --2- 172.21.15.7:0/365820610 >> v2:172.21.15.7:3300/0 conn(0x7fb45006ddb0 0x7fb450151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:13:10.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.032+0000 7fb44fe00640 1 --2- 172.21.15.7:0/365820610 >> v2:172.21.15.77:3300/0 conn(0x7fb4500b0bf0 0x7fb450150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:13:10.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.040+0000 7fb454a00640 1 --2- 172.21.15.7:0/365820610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb450071a70 0x7fb4501576e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb450066c60 tx=0x7fb43c01c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=833f60155e7ed73d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.040+0000 7fb44f400640 1 -- 172.21.15.7:0/365820610 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c0aa610 con 0x7fb450071a70 2024-09-13T15:13:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.040+0000 7fb44f400640 1 -- 172.21.15.7:0/365820610 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c0a6040 con 0x7fb450071a70 2024-09-13T15:13:10.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.040+0000 7fb44f400640 1 -- 172.21.15.7:0/365820610 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c0aa990 con 0x7fb450071a70 2024-09-13T15:13:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.044+0000 7fb457400640 1 -- 172.21.15.7:0/365820610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb450071a70 msgr2=0x7fb4501576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:10.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.044+0000 7fb457400640 1 --2- 172.21.15.7:0/365820610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb450071a70 0x7fb4501576e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb450066c60 tx=0x7fb43c01c4f0 comp rx=0 tx=0).stop 2024-09-13T15:13:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.044+0000 7fb457400640 1 -- 172.21.15.7:0/365820610 shutdown_connections 2024-09-13T15:13:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.044+0000 7fb457400640 1 --2- 172.21.15.7:0/365820610 >> v2:172.21.15.7:3300/0 conn(0x7fb45006ddb0 0x7fb450151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:10.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.044+0000 7fb457400640 1 --2- 172.21.15.7:0/365820610 >> v2:172.21.15.77:3300/0 conn(0x7fb4500b0bf0 0x7fb450150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.044+0000 7fb457400640 1 --2- 172.21.15.7:0/365820610 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb450071a70 0x7fb4501576e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.044+0000 7fb457400640 1 -- 172.21.15.7:0/365820610 >> 172.21.15.7:0/365820610 conn(0x7fb450065d40 msgr2=0x7fb450066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.044+0000 7fb457400640 1 -- 172.21.15.7:0/365820610 shutdown_connections 2024-09-13T15:13:10.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.044+0000 7fb457400640 1 -- 172.21.15.7:0/365820610 wait complete. 2024-09-13T15:13:10.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.056+0000 7fb457400640 1 Processor -- start 2024-09-13T15:13:10.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.056+0000 7fb457400640 1 -- start start 2024-09-13T15:13:10.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.056+0000 7fb457400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45006ddb0 0x7fb450070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:10.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.056+0000 7fb457400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb450071a70 0x7fb4500c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:10.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.056+0000 7fb454a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45006ddb0 0x7fb450070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:10.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.060+0000 7fb454a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45006ddb0 0x7fb450070db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:36632/0 (socket says 172.21.15.7:36632) 2024-09-13T15:13:10.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.060+0000 7fb44fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb450071a70 0x7fb4500c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:10.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.060+0000 7fb44fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb450071a70 0x7fb4500c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55650/0 (socket says 172.21.15.7:55650) 2024-09-13T15:13:10.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.060+0000 7fb454a00640 1 -- 172.21.15.7:0/180787405 learned_addr learned my addr 172.21.15.7:0/180787405 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:10.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.060+0000 7fb457400640 1 --2- 172.21.15.7:0/180787405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4500b0bf0 0x7fb4500c3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:10.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.060+0000 7fb457400640 1 -- 172.21.15.7:0/180787405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4500708e0 con 0x7fb450071a70 2024-09-13T15:13:10.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.060+0000 7fb455400640 1 --2- 172.21.15.7:0/180787405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4500b0bf0 0x7fb4500c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:10.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.060+0000 7fb457400640 1 -- 172.21.15.7:0/180787405 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4500c7d70 con 0x7fb4500b0bf0 2024-09-13T15:13:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.060+0000 7fb457400640 1 -- 172.21.15.7:0/180787405 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45013d9b0 con 0x7fb45006ddb0 2024-09-13T15:13:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.060+0000 7fb454a00640 1 -- 172.21.15.7:0/180787405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4500b0bf0 msgr2=0x7fb4500c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.060+0000 7fb454a00640 1 --2- 172.21.15.7:0/180787405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4500b0bf0 0x7fb4500c3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.060+0000 7fb454a00640 1 -- 172.21.15.7:0/180787405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb450071a70 msgr2=0x7fb4500c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.060+0000 7fb454a00640 1 --2- 172.21.15.7:0/180787405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb450071a70 0x7fb4500c4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:10.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.060+0000 7fb454a00640 1 -- 172.21.15.7:0/180787405 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c0094d0 con 0x7fb45006ddb0 2024-09-13T15:13:10.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.064+0000 7fb454a00640 1 --2- 172.21.15.7:0/180787405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45006ddb0 0x7fb450070db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb43c01aba0 tx=0x7fb43c01ad30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:10.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.064+0000 7fb44cc00640 1 -- 172.21.15.7:0/180787405 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c0bd5f0 con 0x7fb45006ddb0 2024-09-13T15:13:10.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.064+0000 7fb457400640 1 -- 172.21.15.7:0/180787405 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb450070620 con 0x7fb45006ddb0 2024-09-13T15:13:10.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.064+0000 7fb457400640 1 -- 172.21.15.7:0/180787405 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4500c2680 con 0x7fb45006ddb0 2024-09-13T15:13:10.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.064+0000 7fb44cc00640 1 -- 172.21.15.7:0/180787405 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c0bd750 con 0x7fb45006ddb0 2024-09-13T15:13:10.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.076+0000 7fb457400640 1 -- 172.21.15.7:0/180787405 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb428005260 con 0x7fb45006ddb0 2024-09-13T15:13:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.076+0000 7fb44cc00640 1 -- 172.21.15.7:0/180787405 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb43c0bd5f0 con 0x7fb45006ddb0 2024-09-13T15:13:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.076+0000 7fb44cc00640 1 -- 172.21.15.7:0/180787405 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb43c0059a0 con 0x7fb45006ddb0 2024-09-13T15:13:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.080+0000 7fb44cc00640 1 --2- 172.21.15.7:0/180787405 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb4300666f0 0x7fb430068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.080+0000 7fb44cc00640 1 -- 172.21.15.7:0/180787405 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7fb43c11ee60 con 0x7fb45006ddb0 2024-09-13T15:13:10.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.080+0000 7fb44fe00640 1 --2- 172.21.15.7:0/180787405 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb4300666f0 0x7fb430068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:10.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.080+0000 7fb44cc00640 1 -- 172.21.15.7:0/180787405 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb43c0ebf00 con 0x7fb45006ddb0 2024-09-13T15:13:10.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.084+0000 7fb44fe00640 1 --2- 172.21.15.7:0/180787405 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb4300666f0 0x7fb430068bb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb450071790 tx=0x7fb440008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:10.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.516+0000 7fb457400640 1 -- 172.21.15.7:0/180787405 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4280057e0 con 0x7fb45006ddb0 2024-09-13T15:13:10.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.516+0000 7fb44cc00640 1 -- 172.21.15.7:0/180787405 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+6284 (secure 0 0 0) 0x7fb43c0c3090 con 0x7fb45006ddb0 2024-09-13T15:13:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:10.519 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:12:19.980748+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:10.519 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 46 2024-09-13T15:13:10.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.520+0000 7fb457400640 1 -- 172.21.15.7:0/180787405 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb4300666f0 msgr2=0x7fb430068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:10.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.520+0000 7fb457400640 1 --2- 172.21.15.7:0/180787405 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb4300666f0 0x7fb430068bb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb450071790 tx=0x7fb440008040 comp rx=0 tx=0).stop 2024-09-13T15:13:10.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.520+0000 7fb457400640 1 -- 172.21.15.7:0/180787405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45006ddb0 msgr2=0x7fb450070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:10.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.520+0000 7fb457400640 1 --2- 172.21.15.7:0/180787405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45006ddb0 0x7fb450070db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb43c01aba0 tx=0x7fb43c01ad30 comp rx=0 tx=0).stop 2024-09-13T15:13:10.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.520+0000 7fb457400640 1 -- 172.21.15.7:0/180787405 shutdown_connections 2024-09-13T15:13:10.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.520+0000 7fb457400640 1 --2- 172.21.15.7:0/180787405 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb4300666f0 0x7fb430068bb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:10.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.520+0000 7fb457400640 1 --2- 172.21.15.7:0/180787405 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4500b0bf0 0x7fb4500c3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:10.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.520+0000 7fb457400640 1 --2- 172.21.15.7:0/180787405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb450071a70 0x7fb4500c4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:10.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.520+0000 7fb457400640 1 --2- 172.21.15.7:0/180787405 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45006ddb0 0x7fb450070db0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:10.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.520+0000 7fb457400640 1 -- 172.21.15.7:0/180787405 >> 172.21.15.7:0/180787405 conn(0x7fb450065d40 msgr2=0x7fb4500c8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:10.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.520+0000 7fb457400640 1 -- 172.21.15.7:0/180787405 shutdown_connections 2024-09-13T15:13:10.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.520+0000 7fb457400640 1 -- 172.21.15.7:0/180787405 wait complete. 2024-09-13T15:13:10.554 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.f (rank=1) 2024-09-13T15:13:10.554 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-09-13T15:13:10.554 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:13:10.567 INFO:tasks.ceph.mds.f:Stopped 2024-09-13T15:13:10.567 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:10.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.848+0000 7f675f200640 1 Processor -- start 2024-09-13T15:13:10.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.848+0000 7f675f200640 1 -- start start 2024-09-13T15:13:10.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.848+0000 7f675f200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67600c9780 0x7f676006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:10.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.848+0000 7f675f200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f67600ca8e0 0x7f67600cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:10.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.848+0000 7f675f200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67600c8150 con 0x7f67600c9b60 2024-09-13T15:13:10.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.848+0000 7f675f200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67600c7580 con 0x7f67600ca8e0 2024-09-13T15:13:10.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.848+0000 7f675f200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67600cad90 con 0x7f67600c9780 2024-09-13T15:13:10.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.848+0000 7f675e800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f67600ca8e0 0x7f67600cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:10.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.848+0000 7f675e800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f67600ca8e0 0x7f67600cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:54580/0 (socket says 172.21.15.7:54580) 2024-09-13T15:13:10.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.848+0000 7f675de00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67600c9780 0x7f676006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:10.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.848+0000 7f6755400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f67600c9b60 0x7f6760157310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:47632/0 (socket says 172.21.15.7:47632) 2024-09-13T15:13:10.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.852+0000 7f6755400640 1 -- 172.21.15.7:0/3113400737 learned_addr learned my addr 172.21.15.7:0/3113400737 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:13:10.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.852+0000 7f675d400640 1 -- 172.21.15.7:0/3113400737 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002280865 0 0) 0x7f67600c8150 con 0x7f67600c9b60 2024-09-13T15:13:10.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.852+0000 7f675d400640 1 -- 172.21.15.7:0/3113400737 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6744003530 con 0x7f67600c9b60 2024-09-13T15:13:10.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.852+0000 7f675de00640 1 -- 172.21.15.7:0/3113400737 >> v2:172.21.15.77:3300/0 conn(0x7f67600ca8e0 msgr2=0x7f67600cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:10.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.852+0000 7f675de00640 1 --2- 172.21.15.7:0/3113400737 >> v2:172.21.15.77:3300/0 conn(0x7f67600ca8e0 0x7f67600cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:10.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.852+0000 7f675de00640 1 -- 172.21.15.7:0/3113400737 >> v1:172.21.15.7:6789/0 conn(0x7f67600c9b60 legacy=0x7f6760157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:10.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.852+0000 7f675de00640 1 -- 172.21.15.7:0/3113400737 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67600c7820 con 0x7f67600c9780 2024-09-13T15:13:10.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.856+0000 7f675de00640 1 --2- 172.21.15.7:0/3113400737 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67600c9780 0x7f676006ddb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6750009d90 tx=0x7f675001c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79d9f59ac1b1150a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.856+0000 7f675d400640 1 -- 172.21.15.7:0/3113400737 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67500a58f0 con 0x7f67600c9780 2024-09-13T15:13:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.856+0000 7f675d400640 1 -- 172.21.15.7:0/3113400737 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67500a5a50 con 0x7f67600c9780 2024-09-13T15:13:10.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.856+0000 7f675d400640 1 -- 172.21.15.7:0/3113400737 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67500a5de0 con 0x7f67600c9780 2024-09-13T15:13:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.860+0000 7f675f200640 1 -- 172.21.15.7:0/3113400737 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67600c9780 msgr2=0x7f676006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:10.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.860+0000 7f675f200640 1 --2- 172.21.15.7:0/3113400737 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67600c9780 0x7f676006ddb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6750009d90 tx=0x7f675001c890 comp rx=0 tx=0).stop 2024-09-13T15:13:10.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.860+0000 7f675f200640 1 -- 172.21.15.7:0/3113400737 shutdown_connections 2024-09-13T15:13:10.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.860+0000 7f675f200640 1 --2- 172.21.15.7:0/3113400737 >> v2:172.21.15.77:3300/0 conn(0x7f67600ca8e0 0x7f67600cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:10.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.860+0000 7f675f200640 1 --2- 172.21.15.7:0/3113400737 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67600c9780 0x7f676006ddb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:10.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.860+0000 7f675f200640 1 -- 172.21.15.7:0/3113400737 >> 172.21.15.7:0/3113400737 conn(0x7f6760065d40 msgr2=0x7f6760066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:10.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.860+0000 7f675f200640 1 -- 172.21.15.7:0/3113400737 shutdown_connections 2024-09-13T15:13:10.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.860+0000 7f675f200640 1 -- 172.21.15.7:0/3113400737 wait complete. 2024-09-13T15:13:10.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.864+0000 7f675f200640 1 Processor -- start 2024-09-13T15:13:10.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.864+0000 7f675f200640 1 -- start start 2024-09-13T15:13:10.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.864+0000 7f675f200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67600c9780 0x7f676015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:10.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.864+0000 7f675f200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67600c9b60 0x7f676015b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:10.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.864+0000 7f675f200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67600ca8e0 0x7f676015d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:10.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.864+0000 7f675f200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676015e3f0 con 0x7f67600c9780 2024-09-13T15:13:10.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.864+0000 7f675f200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67601497f0 con 0x7f67600ca8e0 2024-09-13T15:13:10.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.864+0000 7f675f200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f676015e130 con 0x7f67600c9b60 2024-09-13T15:13:10.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.864+0000 7f675e800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67600ca8e0 0x7f676015d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:10.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.864+0000 7f675e800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67600ca8e0 0x7f676015d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:54592/0 (socket says 172.21.15.7:54592) 2024-09-13T15:13:10.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.864+0000 7f675e800640 1 -- 172.21.15.7:0/1056407907 learned_addr learned my addr 172.21.15.7:0/1056407907 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:10.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.864+0000 7f675e800640 1 -- 172.21.15.7:0/1056407907 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67600c9b60 msgr2=0x7f676015b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:10.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.864+0000 7f675e800640 1 --2- 172.21.15.7:0/1056407907 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67600c9b60 0x7f676015b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:10.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.864+0000 7f675e800640 1 -- 172.21.15.7:0/1056407907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67600c9780 msgr2=0x7f676015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:10.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.864+0000 7f675e800640 1 --2- 172.21.15.7:0/1056407907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67600c9780 0x7f676015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:10.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.864+0000 7f675e800640 1 -- 172.21.15.7:0/1056407907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6750009a70 con 0x7f67600ca8e0 2024-09-13T15:13:10.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.868+0000 7f675e800640 1 --2- 172.21.15.7:0/1056407907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67600ca8e0 0x7f676015d400 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f675800e7f0 tx=0x7f675800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:10.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.872+0000 7f6756a00640 1 -- 172.21.15.7:0/1056407907 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6758009530 con 0x7f67600ca8e0 2024-09-13T15:13:10.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.872+0000 7f6756a00640 1 -- 172.21.15.7:0/1056407907 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675800eea0 con 0x7f67600ca8e0 2024-09-13T15:13:10.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.872+0000 7f6756a00640 1 -- 172.21.15.7:0/1056407907 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675800cb60 con 0x7f67600ca8e0 2024-09-13T15:13:10.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.872+0000 7f675f200640 1 -- 172.21.15.7:0/1056407907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676014d480 con 0x7f67600ca8e0 2024-09-13T15:13:10.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.872+0000 7f675f200640 1 -- 172.21.15.7:0/1056407907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676014f940 con 0x7f67600ca8e0 2024-09-13T15:13:10.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.876+0000 7f675f200640 1 -- 172.21.15.7:0/1056407907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676014f7a0 con 0x7f67600ca8e0 2024-09-13T15:13:10.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.876+0000 7f6756a00640 1 -- 172.21.15.7:0/1056407907 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f675800ccc0 con 0x7f67600ca8e0 2024-09-13T15:13:10.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.880+0000 7f6756a00640 1 --2- 172.21.15.7:0/1056407907 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f673c066710 0x7f673c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:10.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.880+0000 7f6756a00640 1 -- 172.21.15.7:0/1056407907 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f6758084ca0 con 0x7f67600ca8e0 2024-09-13T15:13:10.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.880+0000 7f675de00640 1 --2- 172.21.15.7:0/1056407907 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f673c066710 0x7f673c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:10.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.880+0000 7f675de00640 1 --2- 172.21.15.7:0/1056407907 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f673c066710 0x7f673c068bd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f67500af000 tx=0x7f6750004ac0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:10.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:10.904+0000 7f6756a00640 1 -- 172.21.15.7:0/1056407907 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6758084e60 con 0x7f67600ca8e0 2024-09-13T15:13:11.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:11.432+0000 7f675f200640 1 -- 172.21.15.7:0/1056407907 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6760067680 con 0x7f67600ca8e0 2024-09-13T15:13:11.434 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:11.434 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:12:19.980748+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:11.435 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 46 2024-09-13T15:13:11.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:11.432+0000 7f6756a00640 1 -- 172.21.15.7:0/1056407907 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+6284 (secure 0 0 0) 0x7f6758084e60 con 0x7f67600ca8e0 2024-09-13T15:13:11.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:11.436+0000 7f675f200640 1 -- 172.21.15.7:0/1056407907 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f673c066710 msgr2=0x7f673c068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:11.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:11.436+0000 7f675f200640 1 --2- 172.21.15.7:0/1056407907 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f673c066710 0x7f673c068bd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f67500af000 tx=0x7f6750004ac0 comp rx=0 tx=0).stop 2024-09-13T15:13:11.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:11.436+0000 7f675f200640 1 -- 172.21.15.7:0/1056407907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67600ca8e0 msgr2=0x7f676015d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:11.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:11.436+0000 7f675f200640 1 --2- 172.21.15.7:0/1056407907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67600ca8e0 0x7f676015d400 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f675800e7f0 tx=0x7f675800ecb0 comp rx=0 tx=0).stop 2024-09-13T15:13:11.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:11.436+0000 7f675f200640 1 -- 172.21.15.7:0/1056407907 shutdown_connections 2024-09-13T15:13:11.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:11.436+0000 7f675f200640 1 --2- 172.21.15.7:0/1056407907 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f673c066710 0x7f673c068bd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:11.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:11.436+0000 7f675f200640 1 --2- 172.21.15.7:0/1056407907 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f67600ca8e0 0x7f676015d400 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:11.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:11.436+0000 7f675f200640 1 --2- 172.21.15.7:0/1056407907 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f67600c9b60 0x7f676015b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:11.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:11.436+0000 7f675f200640 1 --2- 172.21.15.7:0/1056407907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67600c9780 0x7f676015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:11.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:11.436+0000 7f675f200640 1 -- 172.21.15.7:0/1056407907 >> 172.21.15.7:0/1056407907 conn(0x7f6760065d40 msgr2=0x7f6760154da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:11.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:11.436+0000 7f675f200640 1 -- 172.21.15.7:0/1056407907 shutdown_connections 2024-09-13T15:13:11.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:11.436+0000 7f675f200640 1 -- 172.21.15.7:0/1056407907 wait complete. 2024-09-13T15:13:11.740 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.f is laggy/crashed, in failed state, or mds.f is removed from mdsmap 2024-09-13T15:13:13.741 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:14.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.232+0000 7f2581e00640 1 Processor -- start 2024-09-13T15:13:14.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.236+0000 7f2581e00640 1 -- start start 2024-09-13T15:13:14.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.248+0000 7f2581e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f257c159260 0x7f257c0c4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:14.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.248+0000 7f2580a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f257c159260 0x7f257c0c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:14.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.248+0000 7f2580a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f257c159260 0x7f257c0c4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:36660/0 (socket says 172.21.15.7:36660) 2024-09-13T15:13:14.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.248+0000 7f2580a00640 1 -- 172.21.15.7:0/1733686001 learned_addr learned my addr 172.21.15.7:0/1733686001 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:14.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.252+0000 7f2581e00640 1 --2- 172.21.15.7:0/1733686001 >> v2:172.21.15.77:3300/0 conn(0x7f257c0c18f0 0x7f257c1522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:14.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.252+0000 7f2581400640 1 --2- 172.21.15.7:0/1733686001 >> v2:172.21.15.77:3300/0 conn(0x7f257c0c18f0 0x7f257c1522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:14.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.252+0000 7f2581e00640 1 -- 172.21.15.7:0/1733686001 --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257c158dd0 con 0x7f257c066860 2024-09-13T15:13:14.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.252+0000 7f2581e00640 1 -- 172.21.15.7:0/1733686001 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257c1585a0 con 0x7f257c0c18f0 2024-09-13T15:13:14.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.252+0000 7f2581e00640 1 -- 172.21.15.7:0/1733686001 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c155740 con 0x7f257c159260 2024-09-13T15:13:14.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.252+0000 7f257b400640 1 -- 172.21.15.7:0/1733686001 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982007116 0 0) 0x7f257c158dd0 con 0x7f257c066860 2024-09-13T15:13:14.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.256+0000 7f257b400640 1 -- 172.21.15.7:0/1733686001 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2560003530 con 0x7f257c066860 2024-09-13T15:13:14.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.256+0000 7f2580a00640 1 -- 172.21.15.7:0/1733686001 >> v2:172.21.15.77:3300/0 conn(0x7f257c0c18f0 msgr2=0x7f257c1522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:14.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.256+0000 7f2580a00640 1 --2- 172.21.15.7:0/1733686001 >> v2:172.21.15.77:3300/0 conn(0x7f257c0c18f0 0x7f257c1522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:14.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.256+0000 7f2580a00640 1 -- 172.21.15.7:0/1733686001 >> v1:172.21.15.7:6789/0 conn(0x7f257c066860 legacy=0x7f257c155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:14.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.256+0000 7f2580a00640 1 -- 172.21.15.7:0/1733686001 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c0c6140 con 0x7f257c159260 2024-09-13T15:13:14.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.272+0000 7f2580a00640 1 --2- 172.21.15.7:0/1733686001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f257c159260 0x7f257c0c4450 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f256c009870 tx=0x7f256c01ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8063448768c53342 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:14.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.272+0000 7f257b400640 1 -- 172.21.15.7:0/1733686001 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c0a89d0 con 0x7f257c159260 2024-09-13T15:13:14.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.272+0000 7f257b400640 1 -- 172.21.15.7:0/1733686001 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c0a8b30 con 0x7f257c159260 2024-09-13T15:13:14.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.272+0000 7f257b400640 1 -- 172.21.15.7:0/1733686001 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c0b0440 con 0x7f257c159260 2024-09-13T15:13:14.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.276+0000 7f2581e00640 1 -- 172.21.15.7:0/1733686001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f257c159260 msgr2=0x7f257c0c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:14.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.276+0000 7f2581e00640 1 --2- 172.21.15.7:0/1733686001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f257c159260 0x7f257c0c4450 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f256c009870 tx=0x7f256c01ed30 comp rx=0 tx=0).stop 2024-09-13T15:13:14.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.276+0000 7f2581e00640 1 -- 172.21.15.7:0/1733686001 shutdown_connections 2024-09-13T15:13:14.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.276+0000 7f2581e00640 1 --2- 172.21.15.7:0/1733686001 >> v2:172.21.15.77:3300/0 conn(0x7f257c0c18f0 0x7f257c1522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:14.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.276+0000 7f2581e00640 1 --2- 172.21.15.7:0/1733686001 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f257c159260 0x7f257c0c4450 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:14.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.276+0000 7f2581e00640 1 -- 172.21.15.7:0/1733686001 >> 172.21.15.7:0/1733686001 conn(0x7f257c065d40 msgr2=0x7f257c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:14.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.284+0000 7f2581e00640 1 -- 172.21.15.7:0/1733686001 shutdown_connections 2024-09-13T15:13:14.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.284+0000 7f2581e00640 1 -- 172.21.15.7:0/1733686001 wait complete. 2024-09-13T15:13:14.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.288+0000 7f2581e00640 1 Processor -- start 2024-09-13T15:13:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.296+0000 7f2581e00640 1 -- start start 2024-09-13T15:13:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.296+0000 7f2581e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f257c066860 0x7f257c14b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.296+0000 7f2581e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f257c0c18f0 0x7f257c150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.296+0000 7f2581e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f257c159260 0x7f257c0c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:14.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.296+0000 7f2581e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c150dc0 con 0x7f257c159260 2024-09-13T15:13:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.296+0000 7f2581e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c14db30 con 0x7f257c0c18f0 2024-09-13T15:13:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.296+0000 7f2581e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257c14de10 con 0x7f257c066860 2024-09-13T15:13:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.300+0000 7f257be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f257c0c18f0 0x7f257c150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.300+0000 7f257be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f257c0c18f0 0x7f257c150880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:54622/0 (socket says 172.21.15.7:54622) 2024-09-13T15:13:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.300+0000 7f257be00640 1 -- 172.21.15.7:0/206840949 learned_addr learned my addr 172.21.15.7:0/206840949 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.300+0000 7f2580a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f257c066860 0x7f257c14b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:14.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.300+0000 7f2581400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f257c159260 0x7f257c0c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.300+0000 7f2581400640 1 -- 172.21.15.7:0/206840949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f257c066860 msgr2=0x7f257c14b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.300+0000 7f2581400640 1 --2- 172.21.15.7:0/206840949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f257c066860 0x7f257c14b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.300+0000 7f2581400640 1 -- 172.21.15.7:0/206840949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f257c0c18f0 msgr2=0x7f257c150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.300+0000 7f2581400640 1 --2- 172.21.15.7:0/206840949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f257c0c18f0 0x7f257c150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.300+0000 7f2581400640 1 -- 172.21.15.7:0/206840949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c0094d0 con 0x7f257c159260 2024-09-13T15:13:14.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.304+0000 7f2581400640 1 --2- 172.21.15.7:0/206840949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f257c159260 0x7f257c0c71c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2574009fd0 tx=0x7f2574008990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:14.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.308+0000 7f2578c00640 1 -- 172.21.15.7:0/206840949 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257400d520 con 0x7f257c159260 2024-09-13T15:13:14.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.308+0000 7f2581e00640 1 -- 172.21.15.7:0/206840949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257c14f7e0 con 0x7f257c159260 2024-09-13T15:13:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.308+0000 7f2581e00640 1 -- 172.21.15.7:0/206840949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257c1ed060 con 0x7f257c159260 2024-09-13T15:13:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.316+0000 7f2581e00640 1 -- 172.21.15.7:0/206840949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257c067650 con 0x7f257c159260 2024-09-13T15:13:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.308+0000 7f2578c00640 1 -- 172.21.15.7:0/206840949 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25740039a0 con 0x7f257c159260 2024-09-13T15:13:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.320+0000 7f2578c00640 1 -- 172.21.15.7:0/206840949 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257400d520 con 0x7f257c159260 2024-09-13T15:13:14.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.324+0000 7f2578c00640 1 -- 172.21.15.7:0/206840949 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2574003b10 con 0x7f257c159260 2024-09-13T15:13:14.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.328+0000 7f2578c00640 1 --2- 172.21.15.7:0/206840949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f255c0666f0 0x7f255c068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:14.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.328+0000 7f2578c00640 1 -- 172.21.15.7:0/206840949 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f25740855a0 con 0x7f257c159260 2024-09-13T15:13:14.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.328+0000 7f2580a00640 1 --2- 172.21.15.7:0/206840949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f255c0666f0 0x7f255c068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:14.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.336+0000 7f2580a00640 1 --2- 172.21.15.7:0/206840949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f255c0666f0 0x7f255c068bb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f256c0b2000 tx=0x7f256c0aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:14.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.372+0000 7f2578c00640 1 -- 172.21.15.7:0/206840949 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2574052500 con 0x7f257c159260 2024-09-13T15:13:14.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.856+0000 7f2581e00640 1 -- 172.21.15.7:0/206840949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f257c1ed280 con 0x7f257c159260 2024-09-13T15:13:14.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.860+0000 7f2578c00640 1 -- 172.21.15.7:0/206840949 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+6284 (secure 0 0 0) 0x7f2574052500 con 0x7f257c159260 2024-09-13T15:13:14.866 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:14.866 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:12:19.980748+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:14.866 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 46 2024-09-13T15:13:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.868+0000 7f2581e00640 1 -- 172.21.15.7:0/206840949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f255c0666f0 msgr2=0x7f255c068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.868+0000 7f2581e00640 1 --2- 172.21.15.7:0/206840949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f255c0666f0 0x7f255c068bb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f256c0b2000 tx=0x7f256c0aa070 comp rx=0 tx=0).stop 2024-09-13T15:13:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.868+0000 7f2581e00640 1 -- 172.21.15.7:0/206840949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f257c159260 msgr2=0x7f257c0c71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.868+0000 7f2581e00640 1 --2- 172.21.15.7:0/206840949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f257c159260 0x7f257c0c71c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2574009fd0 tx=0x7f2574008990 comp rx=0 tx=0).stop 2024-09-13T15:13:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.868+0000 7f2581e00640 1 -- 172.21.15.7:0/206840949 shutdown_connections 2024-09-13T15:13:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.872+0000 7f2581e00640 1 --2- 172.21.15.7:0/206840949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f255c0666f0 0x7f255c068bb0 secure :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f256c0b2000 tx=0x7f256c0aa070 comp rx=0 tx=0).stop 2024-09-13T15:13:14.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.872+0000 7f2581e00640 1 --2- 172.21.15.7:0/206840949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f257c159260 0x7f257c0c71c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.872+0000 7f2581e00640 1 --2- 172.21.15.7:0/206840949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f257c0c18f0 0x7f257c150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.872+0000 7f2581e00640 1 --2- 172.21.15.7:0/206840949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f257c066860 0x7f257c14b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.872+0000 7f2581e00640 1 -- 172.21.15.7:0/206840949 >> 172.21.15.7:0/206840949 conn(0x7f257c065d40 msgr2=0x7f257c0c4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:14.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.876+0000 7f2581e00640 1 -- 172.21.15.7:0/206840949 shutdown_connections 2024-09-13T15:13:14.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:14.880+0000 7f2581e00640 1 -- 172.21.15.7:0/206840949 wait complete. 2024-09-13T15:13:14.940 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.f is laggy/crashed, in failed state, or mds.f is removed from mdsmap 2024-09-13T15:13:16.941 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:17.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.264+0000 7f285a000640 1 Processor -- start 2024-09-13T15:13:17.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.264+0000 7f285a000640 1 -- start start 2024-09-13T15:13:17.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.268+0000 7f285a000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f28540c7660 0x7f2854158f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:17.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.268+0000 7f285a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28540c7a40 0x7f285406cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:17.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.268+0000 7f285a000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28540c56b0 con 0x7f28540c6100 2024-09-13T15:13:17.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.268+0000 7f285a000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285406d670 con 0x7f28540c7660 2024-09-13T15:13:17.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.268+0000 7f285a000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285406d950 con 0x7f28540c7a40 2024-09-13T15:13:17.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.268+0000 7f2853e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28540c7a40 0x7f285406cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:17.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.268+0000 7f2853e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28540c7a40 0x7f285406cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:36672/0 (socket says 172.21.15.7:36672) 2024-09-13T15:13:17.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.268+0000 7f2853e00640 1 -- 172.21.15.7:0/1033971559 learned_addr learned my addr 172.21.15.7:0/1033971559 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:17.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.268+0000 7f2858c00640 1 --2- 172.21.15.7:0/1033971559 >> v2:172.21.15.7:3300/0 conn(0x7f28540c7660 0x7f2854158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:17.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.272+0000 7f2853e00640 1 -- 172.21.15.7:0/1033971559 >> v2:172.21.15.7:3300/0 conn(0x7f28540c7660 msgr2=0x7f2854158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:17.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.272+0000 7f2853e00640 1 --2- 172.21.15.7:0/1033971559 >> v2:172.21.15.7:3300/0 conn(0x7f28540c7660 0x7f2854158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:17.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.272+0000 7f2853e00640 1 -- 172.21.15.7:0/1033971559 >> v1:172.21.15.77:6789/0 conn(0x7f28540c6100 legacy=0x7f28540c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:17.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.272+0000 7f2853e00640 1 -- 172.21.15.7:0/1033971559 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285406dc30 con 0x7f28540c7a40 2024-09-13T15:13:17.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.272+0000 7f2858c00640 1 --2- 172.21.15.7:0/1033971559 >> v2:172.21.15.7:3300/0 conn(0x7f28540c7660 0x7f2854158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:13:17.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.276+0000 7f2853e00640 1 --2- 172.21.15.7:0/1033971559 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28540c7a40 0x7f285406cd70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2840009870 tx=0x7f284001ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53a4240b2be56892 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:17.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.280+0000 7f2853400640 1 -- 172.21.15.7:0/1033971559 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28400a89d0 con 0x7f28540c7a40 2024-09-13T15:13:17.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.280+0000 7f2853400640 1 -- 172.21.15.7:0/1033971559 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28400a8b30 con 0x7f28540c7a40 2024-09-13T15:13:17.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.280+0000 7f2853400640 1 -- 172.21.15.7:0/1033971559 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28400b0440 con 0x7f28540c7a40 2024-09-13T15:13:17.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.280+0000 7f285a000640 1 -- 172.21.15.7:0/1033971559 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28540c7a40 msgr2=0x7f285406cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:17.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.280+0000 7f285a000640 1 --2- 172.21.15.7:0/1033971559 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28540c7a40 0x7f285406cd70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2840009870 tx=0x7f284001ed10 comp rx=0 tx=0).stop 2024-09-13T15:13:17.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.296+0000 7f285a000640 1 -- 172.21.15.7:0/1033971559 shutdown_connections 2024-09-13T15:13:17.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.296+0000 7f285a000640 1 --2- 172.21.15.7:0/1033971559 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28540c7a40 0x7f285406cd70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:17.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.296+0000 7f285a000640 1 --2- 172.21.15.7:0/1033971559 >> v2:172.21.15.7:3300/0 conn(0x7f28540c7660 0x7f2854158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:17.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.296+0000 7f285a000640 1 -- 172.21.15.7:0/1033971559 >> 172.21.15.7:0/1033971559 conn(0x7f2854065d40 msgr2=0x7f2854066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:17.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.296+0000 7f285a000640 1 -- 172.21.15.7:0/1033971559 shutdown_connections 2024-09-13T15:13:17.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.296+0000 7f285a000640 1 -- 172.21.15.7:0/1033971559 wait complete. 2024-09-13T15:13:17.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.300+0000 7f285a000640 1 Processor -- start 2024-09-13T15:13:17.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.300+0000 7f285a000640 1 -- start start 2024-09-13T15:13:17.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.300+0000 7f285a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28540c6100 0x7f28540c1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.300+0000 7f285a000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28540c7660 0x7f28540c2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.300+0000 7f285a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28540c7a40 0x7f28541f50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.300+0000 7f285a000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285415d190 con 0x7f28540c6100 2024-09-13T15:13:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.300+0000 7f285a000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285415cc40 con 0x7f28540c7660 2024-09-13T15:13:17.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.300+0000 7f285a000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285414c5d0 con 0x7f28540c7a40 2024-09-13T15:13:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.300+0000 7f2853e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28540c7660 0x7f28540c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.300+0000 7f2859600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28540c7a40 0x7f28541f50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.300+0000 7f2859600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28540c7a40 0x7f28541f50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:36680/0 (socket says 172.21.15.7:36680) 2024-09-13T15:13:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.300+0000 7f2859600640 1 -- 172.21.15.7:0/334635130 learned_addr learned my addr 172.21.15.7:0/334635130 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.304+0000 7f2859600640 1 -- 172.21.15.7:0/334635130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28540c7660 msgr2=0x7f28540c2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.304+0000 7f2859600640 1 --2- 172.21.15.7:0/334635130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28540c7660 0x7f28540c2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.304+0000 7f2859600640 1 -- 172.21.15.7:0/334635130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28540c6100 msgr2=0x7f28540c1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:17.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.304+0000 7f2859600640 1 --2- 172.21.15.7:0/334635130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28540c6100 0x7f28540c1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:17.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.304+0000 7f2859600640 1 -- 172.21.15.7:0/334635130 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28400094d0 con 0x7f28540c7a40 2024-09-13T15:13:17.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.304+0000 7f2859600640 1 --2- 172.21.15.7:0/334635130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28540c7a40 0x7f28541f50e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f284400b440 tx=0x7f284400b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:17.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.308+0000 7f2850c00640 1 -- 172.21.15.7:0/334635130 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844011830 con 0x7f28540c7a40 2024-09-13T15:13:17.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.308+0000 7f2850c00640 1 -- 172.21.15.7:0/334635130 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28440119b0 con 0x7f28540c7a40 2024-09-13T15:13:17.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.308+0000 7f285a000640 1 -- 172.21.15.7:0/334635130 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28540c4920 con 0x7f28540c7a40 2024-09-13T15:13:17.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.308+0000 7f2850c00640 1 -- 172.21.15.7:0/334635130 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844011d60 con 0x7f28540c7a40 2024-09-13T15:13:17.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.308+0000 7f285a000640 1 -- 172.21.15.7:0/334635130 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28540c4360 con 0x7f28540c7a40 2024-09-13T15:13:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.316+0000 7f284a000640 1 -- 172.21.15.7:0/334635130 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2828005260 con 0x7f28540c7a40 2024-09-13T15:13:17.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.316+0000 7f2850c00640 1 -- 172.21.15.7:0/334635130 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f284401a400 con 0x7f28540c7a40 2024-09-13T15:13:17.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.316+0000 7f2850c00640 1 --2- 172.21.15.7:0/334635130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2834066760 0x7f2834068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:17.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.316+0000 7f2850c00640 1 -- 172.21.15.7:0/334635130 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f28440846c0 con 0x7f28540c7a40 2024-09-13T15:13:17.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.316+0000 7f2858c00640 1 --2- 172.21.15.7:0/334635130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2834066760 0x7f2834068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:17.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.320+0000 7f2858c00640 1 --2- 172.21.15.7:0/334635130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2834066760 0x7f2834068c20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f284c009f50 tx=0x7f284c0094a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:17.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.324+0000 7f2850c00640 1 -- 172.21.15.7:0/334635130 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2844051590 con 0x7f28540c7a40 2024-09-13T15:13:17.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.776+0000 7f284a000640 1 -- 172.21.15.7:0/334635130 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2828005a90 con 0x7f28540c7a40 2024-09-13T15:13:17.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.780+0000 7f2850c00640 1 -- 172.21.15.7:0/334635130 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+6284 (secure 0 0 0) 0x7f2844015090 con 0x7f28540c7a40 2024-09-13T15:13:17.790 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:17.791 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:12:19.980748+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:17.791 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 46 2024-09-13T15:13:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.800+0000 7f284a000640 1 -- 172.21.15.7:0/334635130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2834066760 msgr2=0x7f2834068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.800+0000 7f284a000640 1 --2- 172.21.15.7:0/334635130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2834066760 0x7f2834068c20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f284c009f50 tx=0x7f284c0094a0 comp rx=0 tx=0).stop 2024-09-13T15:13:17.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.800+0000 7f284a000640 1 -- 172.21.15.7:0/334635130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28540c7a40 msgr2=0x7f28541f50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.800+0000 7f284a000640 1 --2- 172.21.15.7:0/334635130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28540c7a40 0x7f28541f50e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f284400b440 tx=0x7f284400b900 comp rx=0 tx=0).stop 2024-09-13T15:13:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.800+0000 7f284a000640 1 -- 172.21.15.7:0/334635130 shutdown_connections 2024-09-13T15:13:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.800+0000 7f284a000640 1 --2- 172.21.15.7:0/334635130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2834066760 0x7f2834068c20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.800+0000 7f284a000640 1 --2- 172.21.15.7:0/334635130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28540c7a40 0x7f28541f50e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.800+0000 7f284a000640 1 --2- 172.21.15.7:0/334635130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28540c7660 0x7f28540c2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.800+0000 7f284a000640 1 --2- 172.21.15.7:0/334635130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28540c6100 0x7f28540c1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.800+0000 7f284a000640 1 -- 172.21.15.7:0/334635130 >> 172.21.15.7:0/334635130 conn(0x7f2854065d40 msgr2=0x7f2854070710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.800+0000 7f284a000640 1 -- 172.21.15.7:0/334635130 shutdown_connections 2024-09-13T15:13:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:17.800+0000 7f284a000640 1 -- 172.21.15.7:0/334635130 wait complete. 2024-09-13T15:13:17.854 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.f is laggy/crashed, in failed state, or mds.f is removed from mdsmap 2024-09-13T15:13:19.855 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:20.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.152+0000 7f2a5f000640 1 Processor -- start 2024-09-13T15:13:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.156+0000 7f2a5f000640 1 -- start start 2024-09-13T15:13:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.156+0000 7f2a5f000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2a50032920 0x7f2a500fc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.156+0000 7f2a5f000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a500fc630 0x7f2a50006820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.156+0000 7f2a5f000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a500fcaa0 con 0x7f2a500355e0 2024-09-13T15:13:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.156+0000 7f2a5f000640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a50006390 con 0x7f2a50032920 2024-09-13T15:13:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.156+0000 7f2a5f000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a500fccd0 con 0x7f2a500fc630 2024-09-13T15:13:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.160+0000 7f2a57e00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2a500355e0 0x7f2a5004aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:52440/0 (socket says 172.21.15.7:52440) 2024-09-13T15:13:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.160+0000 7f2a57e00640 1 -- 172.21.15.7:0/3240075372 learned_addr learned my addr 172.21.15.7:0/3240075372 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:13:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.160+0000 7f2a57400640 1 --2- 172.21.15.7:0/3240075372 >> v2:172.21.15.77:3300/0 conn(0x7f2a50032920 0x7f2a500fc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.164+0000 7f2a56a00640 1 -- 172.21.15.7:0/3240075372 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718066568 0 0) 0x7f2a500fcaa0 con 0x7f2a500355e0 2024-09-13T15:13:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.847+0000 7f2a56a00640 1 -- 172.21.15.7:0/3240075372 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a40003530 con 0x7f2a500355e0 2024-09-13T15:13:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.168+0000 7f2a5d000640 1 --2- 172.21.15.7:0/3240075372 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a500fc630 0x7f2a50006820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.847+0000 7f2a57400640 1 -- 172.21.15.7:0/3240075372 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a500fc630 msgr2=0x7f2a50006820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.847+0000 7f2a57400640 1 --2- 172.21.15.7:0/3240075372 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a500fc630 0x7f2a50006820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.847+0000 7f2a57400640 1 -- 172.21.15.7:0/3240075372 >> v1:172.21.15.77:6789/0 conn(0x7f2a500355e0 legacy=0x7f2a5004aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.847+0000 7f2a57400640 1 -- 172.21.15.7:0/3240075372 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a500fcfb0 con 0x7f2a50032920 2024-09-13T15:13:20.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.855+0000 7f2a57400640 1 --2- 172.21.15.7:0/3240075372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a50032920 0x7f2a500fc0f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2a440097c0 tx=0x7f2a4401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff4e3d86d61f81a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.855+0000 7f2a56a00640 1 -- 172.21.15.7:0/3240075372 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440ab600 con 0x7f2a50032920 2024-09-13T15:13:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.855+0000 7f2a56a00640 1 -- 172.21.15.7:0/3240075372 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a440a7050 con 0x7f2a50032920 2024-09-13T15:13:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.855+0000 7f2a56a00640 1 -- 172.21.15.7:0/3240075372 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440ab980 con 0x7f2a50032920 2024-09-13T15:13:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.863+0000 7f2a5f000640 1 -- 172.21.15.7:0/3240075372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a50032920 msgr2=0x7f2a500fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.863+0000 7f2a5f000640 1 --2- 172.21.15.7:0/3240075372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a50032920 0x7f2a500fc0f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2a440097c0 tx=0x7f2a4401c370 comp rx=0 tx=0).stop 2024-09-13T15:13:20.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.863+0000 7f2a5f000640 1 -- 172.21.15.7:0/3240075372 shutdown_connections 2024-09-13T15:13:20.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.863+0000 7f2a5f000640 1 --2- 172.21.15.7:0/3240075372 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a500fc630 0x7f2a50006820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:20.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.863+0000 7f2a5f000640 1 --2- 172.21.15.7:0/3240075372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a50032920 0x7f2a500fc0f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:20.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.863+0000 7f2a5f000640 1 -- 172.21.15.7:0/3240075372 >> 172.21.15.7:0/3240075372 conn(0x7f2a5004fc60 msgr2=0x7f2a50050040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:20.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.863+0000 7f2a5f000640 1 -- 172.21.15.7:0/3240075372 shutdown_connections 2024-09-13T15:13:20.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.863+0000 7f2a5f000640 1 -- 172.21.15.7:0/3240075372 wait complete. 2024-09-13T15:13:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.867+0000 7f2a5f000640 1 Processor -- start 2024-09-13T15:13:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.867+0000 7f2a5f000640 1 -- start start 2024-09-13T15:13:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.867+0000 7f2a5f000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a50032920 0x7f2a500490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.867+0000 7f2a5f000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a500355e0 0x7f2a500f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:20.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.871+0000 7f2a57e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a50032920 0x7f2a500490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:20.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.871+0000 7f2a57e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a50032920 0x7f2a500490e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:52678/0 (socket says 172.21.15.7:52678) 2024-09-13T15:13:20.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.871+0000 7f2a5f000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a500fc630 0x7f2a50045be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:20.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.871+0000 7f2a5f000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a50049fc0 con 0x7f2a500fc630 2024-09-13T15:13:20.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.871+0000 7f2a5f000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a500f0770 con 0x7f2a50032920 2024-09-13T15:13:20.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.871+0000 7f2a5f000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a50049a00 con 0x7f2a500355e0 2024-09-13T15:13:20.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.871+0000 7f2a57e00640 1 -- 172.21.15.7:0/750212236 learned_addr learned my addr 172.21.15.7:0/750212236 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:20.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.871+0000 7f2a57400640 1 --2- 172.21.15.7:0/750212236 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a500355e0 0x7f2a500f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.871+0000 7f2a5d000640 1 --2- 172.21.15.7:0/750212236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a500fc630 0x7f2a50045be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.875+0000 7f2a57400640 1 -- 172.21.15.7:0/750212236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a50032920 msgr2=0x7f2a500490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.875+0000 7f2a57400640 1 --2- 172.21.15.7:0/750212236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a50032920 0x7f2a500490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.875+0000 7f2a57400640 1 -- 172.21.15.7:0/750212236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a500fc630 msgr2=0x7f2a50045be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.875+0000 7f2a57400640 1 --2- 172.21.15.7:0/750212236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a500fc630 0x7f2a50045be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.875+0000 7f2a57400640 1 -- 172.21.15.7:0/750212236 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a44009420 con 0x7f2a500355e0 2024-09-13T15:13:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.875+0000 7f2a57400640 1 --2- 172.21.15.7:0/750212236 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a500355e0 0x7f2a500f3090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2a440ab000 tx=0x7f2a44019110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.879+0000 7f2a4be00640 1 -- 172.21.15.7:0/750212236 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440b4840 con 0x7f2a500355e0 2024-09-13T15:13:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.879+0000 7f2a4be00640 1 -- 172.21.15.7:0/750212236 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a440b49c0 con 0x7f2a500355e0 2024-09-13T15:13:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.879+0000 7f2a4be00640 1 -- 172.21.15.7:0/750212236 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a440b4d70 con 0x7f2a500355e0 2024-09-13T15:13:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.879+0000 7f2a5f000640 1 -- 172.21.15.7:0/750212236 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a50049ce0 con 0x7f2a500355e0 2024-09-13T15:13:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.879+0000 7f2a5f000640 1 -- 172.21.15.7:0/750212236 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a50047510 con 0x7f2a500355e0 2024-09-13T15:13:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.887+0000 7f2a4be00640 1 -- 172.21.15.7:0/750212236 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2a440b2040 con 0x7f2a500355e0 2024-09-13T15:13:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.887+0000 7f2a4be00640 1 --2- 172.21.15.7:0/750212236 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2a38066760 0x7f2a38068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.887+0000 7f2a4be00640 1 -- 172.21.15.7:0/750212236 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f2a4411ea80 con 0x7f2a500355e0 2024-09-13T15:13:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.887+0000 7f2a57e00640 1 --2- 172.21.15.7:0/750212236 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2a38066760 0x7f2a38068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:20.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.891+0000 7f2a5f000640 1 -- 172.21.15.7:0/750212236 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a50007a00 con 0x7f2a500355e0 2024-09-13T15:13:20.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.891+0000 7f2a57e00640 1 --2- 172.21.15.7:0/750212236 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2a38066760 0x7f2a38068c20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c007fd0 tx=0x7f2a4c007c20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:20.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:20.903+0000 7f2a4be00640 1 -- 172.21.15.7:0/750212236 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2a440eb8c0 con 0x7f2a500355e0 2024-09-13T15:13:21.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:21.387+0000 7f2a5f000640 1 -- 172.21.15.7:0/750212236 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a500503c0 con 0x7f2a500355e0 2024-09-13T15:13:21.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:21.387+0000 7f2a4be00640 1 -- 172.21.15.7:0/750212236 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+6284 (secure 0 0 0) 0x7f2a440b0090 con 0x7f2a500355e0 2024-09-13T15:13:21.388 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:21.388 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:12:19.980748+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:21.389 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 46 2024-09-13T15:13:21.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:21.423+0000 7f2a5f000640 1 -- 172.21.15.7:0/750212236 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2a38066760 msgr2=0x7f2a38068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:21.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:21.423+0000 7f2a5f000640 1 --2- 172.21.15.7:0/750212236 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2a38066760 0x7f2a38068c20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c007fd0 tx=0x7f2a4c007c20 comp rx=0 tx=0).stop 2024-09-13T15:13:21.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:21.423+0000 7f2a5f000640 1 -- 172.21.15.7:0/750212236 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a500355e0 msgr2=0x7f2a500f3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:21.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:21.423+0000 7f2a5f000640 1 --2- 172.21.15.7:0/750212236 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a500355e0 0x7f2a500f3090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2a440ab000 tx=0x7f2a44019110 comp rx=0 tx=0).stop 2024-09-13T15:13:21.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:21.435+0000 7f2a5f000640 1 -- 172.21.15.7:0/750212236 shutdown_connections 2024-09-13T15:13:21.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:21.435+0000 7f2a5f000640 1 --2- 172.21.15.7:0/750212236 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2a38066760 0x7f2a38068c20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:21.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:21.435+0000 7f2a5f000640 1 --2- 172.21.15.7:0/750212236 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a500fc630 0x7f2a50045be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:21.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:21.435+0000 7f2a5f000640 1 --2- 172.21.15.7:0/750212236 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2a500355e0 0x7f2a500f3090 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:21.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:21.435+0000 7f2a5f000640 1 --2- 172.21.15.7:0/750212236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a50032920 0x7f2a500490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:21.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:21.435+0000 7f2a5f000640 1 -- 172.21.15.7:0/750212236 >> 172.21.15.7:0/750212236 conn(0x7f2a5004fc60 msgr2=0x7f2a50044b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:21.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:21.435+0000 7f2a5f000640 1 -- 172.21.15.7:0/750212236 shutdown_connections 2024-09-13T15:13:21.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:21.439+0000 7f2a5f000640 1 -- 172.21.15.7:0/750212236 wait complete. 2024-09-13T15:13:21.802 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.f is laggy/crashed, in failed state, or mds.f is removed from mdsmap 2024-09-13T15:13:23.803 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:24.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.123+0000 7f6266000640 1 Processor -- start 2024-09-13T15:13:24.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.123+0000 7f6266000640 1 -- start start 2024-09-13T15:13:24.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.123+0000 7f6266000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f62600c79f0 0x7f62600c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:24.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.123+0000 7f6266000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f626006d920 con 0x7f626014f350 2024-09-13T15:13:24.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.123+0000 7f6266000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f626006dc00 con 0x7f62600c1980 2024-09-13T15:13:24.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.123+0000 7f6266000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626014f730 con 0x7f62600c79f0 2024-09-13T15:13:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.127+0000 7f6264c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f626014f350 0x7f62600c72e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:37308/0 (socket says 172.21.15.7:37308) 2024-09-13T15:13:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.127+0000 7f6264c00640 1 -- 172.21.15.7:0/3061750860 learned_addr learned my addr 172.21.15.7:0/3061750860 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:13:24.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.127+0000 7f6265600640 1 --2- 172.21.15.7:0/3061750860 >> v2:172.21.15.7:3300/0 conn(0x7f62600c79f0 0x7f62600c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.131+0000 7f625f400640 1 -- 172.21.15.7:0/3061750860 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360647506 0 0) 0x7f626006d920 con 0x7f626014f350 2024-09-13T15:13:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.131+0000 7f625f400640 1 -- 172.21.15.7:0/3061750860 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6244003530 con 0x7f626014f350 2024-09-13T15:13:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.131+0000 7f6265600640 1 -- 172.21.15.7:0/3061750860 >> v1:172.21.15.77:6789/0 conn(0x7f62600c1980 legacy=0x7f6260158470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:13:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.131+0000 7f6265600640 1 -- 172.21.15.7:0/3061750860 >> v1:172.21.15.7:6789/0 conn(0x7f626014f350 legacy=0x7f62600c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:24.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.131+0000 7f6265600640 1 -- 172.21.15.7:0/3061750860 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62600c6ae0 con 0x7f62600c79f0 2024-09-13T15:13:24.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.139+0000 7f6265600640 1 --2- 172.21.15.7:0/3061750860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62600c79f0 0x7f62600c5d70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f624c00ba50 tx=0x7f624c021310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b650d9321313b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:24.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.143+0000 7f625f400640 1 -- 172.21.15.7:0/3061750860 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c0b3410 con 0x7f62600c79f0 2024-09-13T15:13:24.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.143+0000 7f625f400640 1 -- 172.21.15.7:0/3061750860 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c0ad030 con 0x7f62600c79f0 2024-09-13T15:13:24.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.143+0000 7f625f400640 1 -- 172.21.15.7:0/3061750860 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c0b3790 con 0x7f62600c79f0 2024-09-13T15:13:24.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.147+0000 7f6266000640 1 -- 172.21.15.7:0/3061750860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62600c79f0 msgr2=0x7f62600c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:24.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.147+0000 7f6266000640 1 --2- 172.21.15.7:0/3061750860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62600c79f0 0x7f62600c5d70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f624c00ba50 tx=0x7f624c021310 comp rx=0 tx=0).stop 2024-09-13T15:13:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.147+0000 7f6266000640 1 -- 172.21.15.7:0/3061750860 shutdown_connections 2024-09-13T15:13:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.147+0000 7f6266000640 1 --2- 172.21.15.7:0/3061750860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62600c79f0 0x7f62600c5d70 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:24.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.147+0000 7f6266000640 1 -- 172.21.15.7:0/3061750860 >> 172.21.15.7:0/3061750860 conn(0x7f6260065d40 msgr2=0x7f6260066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:24.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.159+0000 7f6266000640 1 -- 172.21.15.7:0/3061750860 shutdown_connections 2024-09-13T15:13:24.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.159+0000 7f6266000640 1 -- 172.21.15.7:0/3061750860 wait complete. 2024-09-13T15:13:24.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.179+0000 7f6266000640 1 Processor -- start 2024-09-13T15:13:24.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.179+0000 7f6266000640 1 -- start start 2024-09-13T15:13:24.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.179+0000 7f6266000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62600c1980 0x7f62600c3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:24.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.179+0000 7f6266000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62600c79f0 0x7f62601f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:24.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.187+0000 7f625fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62600c79f0 0x7f62601f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:24.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.187+0000 7f625fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62600c79f0 0x7f62601f2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:45214/0 (socket says 172.21.15.7:45214) 2024-09-13T15:13:24.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.187+0000 7f6266000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f626014f350 0x7f62601451e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:24.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.187+0000 7f625fe00640 1 -- 172.21.15.7:0/2145037483 learned_addr learned my addr 172.21.15.7:0/2145037483 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:24.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.187+0000 7f6264c00640 1 --2- 172.21.15.7:0/2145037483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62600c1980 0x7f62600c3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:24.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.187+0000 7f6266000640 1 -- 172.21.15.7:0/2145037483 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62601f2870 con 0x7f62600c1980 2024-09-13T15:13:24.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.187+0000 7f6266000640 1 -- 172.21.15.7:0/2145037483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62601588c0 con 0x7f626014f350 2024-09-13T15:13:24.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.187+0000 7f6266000640 1 -- 172.21.15.7:0/2145037483 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62600c88b0 con 0x7f62600c79f0 2024-09-13T15:13:24.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.187+0000 7f6265600640 1 --2- 172.21.15.7:0/2145037483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f626014f350 0x7f62601451e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:24.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.191+0000 7f6265600640 1 -- 172.21.15.7:0/2145037483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62600c79f0 msgr2=0x7f62601f2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:24.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.191+0000 7f6265600640 1 --2- 172.21.15.7:0/2145037483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62600c79f0 0x7f62601f2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:24.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.191+0000 7f6265600640 1 -- 172.21.15.7:0/2145037483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62600c1980 msgr2=0x7f62600c3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:24.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.191+0000 7f6265600640 1 --2- 172.21.15.7:0/2145037483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62600c1980 0x7f62600c3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.191+0000 7f6265600640 1 -- 172.21.15.7:0/2145037483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c00b6b0 con 0x7f626014f350 2024-09-13T15:13:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.191+0000 7f6265600640 1 --2- 172.21.15.7:0/2145037483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f626014f350 0x7f62601451e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f624c0b2000 tx=0x7f624c01fb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.191+0000 7f625cc00640 1 -- 172.21.15.7:0/2145037483 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c0b3ca0 con 0x7f626014f350 2024-09-13T15:13:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.191+0000 7f625cc00640 1 -- 172.21.15.7:0/2145037483 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c0b3e00 con 0x7f626014f350 2024-09-13T15:13:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.191+0000 7f625cc00640 1 -- 172.21.15.7:0/2145037483 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c0be690 con 0x7f626014f350 2024-09-13T15:13:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.195+0000 7f6266000640 1 -- 172.21.15.7:0/2145037483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62601f5a20 con 0x7f626014f350 2024-09-13T15:13:24.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.195+0000 7f6266000640 1 -- 172.21.15.7:0/2145037483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62601f24b0 con 0x7f626014f350 2024-09-13T15:13:24.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.195+0000 7f6266000640 1 -- 172.21.15.7:0/2145037483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62601f29b0 con 0x7f626014f350 2024-09-13T15:13:24.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.199+0000 7f625cc00640 1 -- 172.21.15.7:0/2145037483 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f624c0ba070 con 0x7f626014f350 2024-09-13T15:13:24.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.199+0000 7f625cc00640 1 --2- 172.21.15.7:0/2145037483 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6240066760 0x7f6240068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:24.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.199+0000 7f625cc00640 1 -- 172.21.15.7:0/2145037483 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f624c123240 con 0x7f626014f350 2024-09-13T15:13:24.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.199+0000 7f6264c00640 1 --2- 172.21.15.7:0/2145037483 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6240066760 0x7f6240068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:24.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.207+0000 7f6264c00640 1 --2- 172.21.15.7:0/2145037483 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6240066760 0x7f6240068c20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6258004f10 tx=0x7f6258009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:24.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.207+0000 7f625cc00640 1 -- 172.21.15.7:0/2145037483 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f624c0efff0 con 0x7f626014f350 2024-09-13T15:13:24.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.767+0000 7f6266000640 1 -- 172.21.15.7:0/2145037483 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62601f29b0 con 0x7f626014f350 2024-09-13T15:13:24.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.771+0000 7f625cc00640 1 -- 172.21.15.7:0/2145037483 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+6284 (secure 0 0 0) 0x7f62601f29b0 con 0x7f626014f350 2024-09-13T15:13:24.780 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:24.780 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:12:19.980748+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:24.781 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 46 2024-09-13T15:13:24.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.779+0000 7f6266000640 1 -- 172.21.15.7:0/2145037483 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6240066760 msgr2=0x7f6240068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:24.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.783+0000 7f6266000640 1 --2- 172.21.15.7:0/2145037483 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6240066760 0x7f6240068c20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6258004f10 tx=0x7f6258009040 comp rx=0 tx=0).stop 2024-09-13T15:13:24.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.783+0000 7f6266000640 1 -- 172.21.15.7:0/2145037483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f626014f350 msgr2=0x7f62601451e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:24.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.783+0000 7f6266000640 1 --2- 172.21.15.7:0/2145037483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f626014f350 0x7f62601451e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f624c0b2000 tx=0x7f624c01fb50 comp rx=0 tx=0).stop 2024-09-13T15:13:24.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.791+0000 7f6266000640 1 -- 172.21.15.7:0/2145037483 shutdown_connections 2024-09-13T15:13:24.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.791+0000 7f6266000640 1 --2- 172.21.15.7:0/2145037483 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6240066760 0x7f6240068c20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:24.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.791+0000 7f6266000640 1 --2- 172.21.15.7:0/2145037483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f626014f350 0x7f62601451e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:24.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.791+0000 7f6266000640 1 --2- 172.21.15.7:0/2145037483 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f62600c79f0 0x7f62601f2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:24.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.791+0000 7f6266000640 1 --2- 172.21.15.7:0/2145037483 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62600c1980 0x7f62600c3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:24.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.791+0000 7f6266000640 1 -- 172.21.15.7:0/2145037483 >> 172.21.15.7:0/2145037483 conn(0x7f6260065d40 msgr2=0x7f62600c72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:24.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.791+0000 7f6266000640 1 -- 172.21.15.7:0/2145037483 shutdown_connections 2024-09-13T15:13:24.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:24.791+0000 7f6266000640 1 -- 172.21.15.7:0/2145037483 wait complete. 2024-09-13T15:13:24.901 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.f is laggy/crashed, in failed state, or mds.f is removed from mdsmap 2024-09-13T15:13:26.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:27.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.183+0000 7f1063c00640 1 Processor -- start 2024-09-13T15:13:27.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.183+0000 7f1063c00640 1 -- start start 2024-09-13T15:13:27.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.183+0000 7f1063c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f105c0c5ab0 0x7f105c153020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:27.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.183+0000 7f1063c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f105c15d350 0x7f105c153560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:27.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.183+0000 7f1063c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105c0c8380 con 0x7f105c0c5e90 2024-09-13T15:13:27.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.183+0000 7f1063c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105c06cce0 con 0x7f105c0c5ab0 2024-09-13T15:13:27.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.183+0000 7f1063c00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105c06cf30 con 0x7f105c15d350 2024-09-13T15:13:27.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.183+0000 7f1061c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f105c15d350 0x7f105c153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:27.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.183+0000 7f1061c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f105c15d350 0x7f105c153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:52706/0 (socket says 172.21.15.7:52706) 2024-09-13T15:13:27.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.183+0000 7f1061c00640 1 -- 172.21.15.7:0/14846319 learned_addr learned my addr 172.21.15.7:0/14846319 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:27.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.187+0000 7f105b400640 1 -- 172.21.15.7:0/14846319 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845914466 0 0) 0x7f1048001120 con 0x7f105c0c5e90 2024-09-13T15:13:27.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.187+0000 7f105b400640 1 -- 172.21.15.7:0/14846319 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1044003530 con 0x7f105c0c5e90 2024-09-13T15:13:27.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.187+0000 7f1061c00640 1 -- 172.21.15.7:0/14846319 >> v2:172.21.15.7:3300/0 conn(0x7f105c0c5ab0 msgr2=0x7f105c153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:27.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.187+0000 7f1061c00640 1 --2- 172.21.15.7:0/14846319 >> v2:172.21.15.7:3300/0 conn(0x7f105c0c5ab0 0x7f105c153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:27.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.187+0000 7f105b400640 1 -- 172.21.15.7:0/14846319 <== mon.1 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3652428775 0 0) 0x7f1044003530 con 0x7f105c0c5e90 2024-09-13T15:13:27.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.187+0000 7f1061c00640 1 -- 172.21.15.7:0/14846319 >> v1:172.21.15.77:6789/0 conn(0x7f105c0c5e90 legacy=0x7f105c15cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:27.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.187+0000 7f1061c00640 1 -- 172.21.15.7:0/14846319 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c06d210 con 0x7f105c15d350 2024-09-13T15:13:27.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.195+0000 7f1061c00640 1 --2- 172.21.15.7:0/14846319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105c15d350 0x7f105c153560 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f105c06ddc0 tx=0x7f105401c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d2a8047cdefa509 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:27.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.203+0000 7f105b400640 1 -- 172.21.15.7:0/14846319 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048001810 con 0x7f105c15d350 2024-09-13T15:13:27.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.203+0000 7f105b400640 1 -- 172.21.15.7:0/14846319 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10540090d0 con 0x7f105c15d350 2024-09-13T15:13:27.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.203+0000 7f105b400640 1 -- 172.21.15.7:0/14846319 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10540a5940 con 0x7f105c15d350 2024-09-13T15:13:27.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.203+0000 7f1063c00640 1 -- 172.21.15.7:0/14846319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105c15d350 msgr2=0x7f105c153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:27.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.203+0000 7f1063c00640 1 --2- 172.21.15.7:0/14846319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105c15d350 0x7f105c153560 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f105c06ddc0 tx=0x7f105401c900 comp rx=0 tx=0).stop 2024-09-13T15:13:27.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.203+0000 7f1063c00640 1 -- 172.21.15.7:0/14846319 shutdown_connections 2024-09-13T15:13:27.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.203+0000 7f1063c00640 1 --2- 172.21.15.7:0/14846319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105c15d350 0x7f105c153560 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:27.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.203+0000 7f1063c00640 1 --2- 172.21.15.7:0/14846319 >> v2:172.21.15.7:3300/0 conn(0x7f105c0c5ab0 0x7f105c153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:27.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.203+0000 7f1063c00640 1 -- 172.21.15.7:0/14846319 >> 172.21.15.7:0/14846319 conn(0x7f105c065d40 msgr2=0x7f105c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:27.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.207+0000 7f1063c00640 1 -- 172.21.15.7:0/14846319 shutdown_connections 2024-09-13T15:13:27.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.207+0000 7f1063c00640 1 -- 172.21.15.7:0/14846319 wait complete. 2024-09-13T15:13:27.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.211+0000 7f1063c00640 1 Processor -- start 2024-09-13T15:13:27.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.211+0000 7f1063c00640 1 -- start start 2024-09-13T15:13:27.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.223+0000 7f1063c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105c0c5ab0 0x7f105c0c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.223+0000 7f1063c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f105c0c5e90 0x7f105c1f6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.223+0000 7f1063c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f105c15d350 0x7f105c1f9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.223+0000 7f1063c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c14d160 con 0x7f105c0c5e90 2024-09-13T15:13:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.223+0000 7f1063c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c1fa310 con 0x7f105c0c5ab0 2024-09-13T15:13:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.223+0000 7f1063c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105c1f64d0 con 0x7f105c15d350 2024-09-13T15:13:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.223+0000 7f1061200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105c0c5ab0 0x7f105c0c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.223+0000 7f1061200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105c0c5ab0 0x7f105c0c8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:52716/0 (socket says 172.21.15.7:52716) 2024-09-13T15:13:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.223+0000 7f1061200640 1 -- 172.21.15.7:0/2352250570 learned_addr learned my addr 172.21.15.7:0/2352250570 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.223+0000 7f1061200640 1 -- 172.21.15.7:0/2352250570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f105c15d350 msgr2=0x7f105c1f9dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:13:27.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.223+0000 7f1061200640 1 --2- 172.21.15.7:0/2352250570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f105c15d350 0x7f105c1f9dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.223+0000 7f1061200640 1 -- 172.21.15.7:0/2352250570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f105c0c5e90 msgr2=0x7f105c1f6960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:13:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.223+0000 7f1061200640 1 --2- 172.21.15.7:0/2352250570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f105c0c5e90 0x7f105c1f6960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.223+0000 7f1061200640 1 -- 172.21.15.7:0/2352250570 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1054009b30 con 0x7f105c0c5ab0 2024-09-13T15:13:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.223+0000 7f1061200640 1 --2- 172.21.15.7:0/2352250570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105c0c5ab0 0x7f105c0c8cb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f105000b500 tx=0x7f105000b9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.227+0000 7f1058c00640 1 -- 172.21.15.7:0/2352250570 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050021880 con 0x7f105c0c5ab0 2024-09-13T15:13:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.227+0000 7f1058c00640 1 -- 172.21.15.7:0/2352250570 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10500219e0 con 0x7f105c0c5ab0 2024-09-13T15:13:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.227+0000 7f1058c00640 1 -- 172.21.15.7:0/2352250570 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050021d90 con 0x7f105c0c5ab0 2024-09-13T15:13:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.227+0000 7f1063c00640 1 -- 172.21.15.7:0/2352250570 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105c0ca180 con 0x7f105c0c5ab0 2024-09-13T15:13:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.227+0000 7f1063c00640 1 -- 172.21.15.7:0/2352250570 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105c0ca740 con 0x7f105c0c5ab0 2024-09-13T15:13:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.227+0000 7f1063c00640 1 -- 172.21.15.7:0/2352250570 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105c067650 con 0x7f105c0c5ab0 2024-09-13T15:13:27.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.231+0000 7f1058c00640 1 -- 172.21.15.7:0/2352250570 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f105002a450 con 0x7f105c0c5ab0 2024-09-13T15:13:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.235+0000 7f1058c00640 1 --2- 172.21.15.7:0/2352250570 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f103c066690 0x7f103c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.235+0000 7f1058c00640 1 -- 172.21.15.7:0/2352250570 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 7007+0+0 (secure 0 0 0) 0x7f1050095980 con 0x7f105c0c5ab0 2024-09-13T15:13:27.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.235+0000 7f105be00640 1 --2- 172.21.15.7:0/2352250570 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f103c066690 0x7f103c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:27.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.239+0000 7f1058c00640 1 -- 172.21.15.7:0/2352250570 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f10500661d0 con 0x7f105c0c5ab0 2024-09-13T15:13:27.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.239+0000 7f105be00640 1 --2- 172.21.15.7:0/2352250570 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f103c066690 0x7f103c068b50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f105c144420 tx=0x7f1048001720 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:27.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.691+0000 7f1063c00640 1 -- 172.21.15.7:0/2352250570 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f105c15cc40 con 0x7f105c0c5ab0 2024-09-13T15:13:27.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.695+0000 7f1058c00640 1 -- 172.21.15.7:0/2352250570 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+6284 (secure 0 0 0) 0x7f1050065d60 con 0x7f105c0c5ab0 2024-09-13T15:13:27.713 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:27.714 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5569,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":46}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:12:19.980748+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":4267,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4267":{"gid":4267,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":41,"addr":"172.21.15.77:6839/2233000674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":2233000674},{"type":"v1","addr":"172.21.15.77:6839","nonce":2233000674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:27.714 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 46 2024-09-13T15:13:27.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.743+0000 7f1063c00640 1 -- 172.21.15.7:0/2352250570 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f103c066690 msgr2=0x7f103c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:27.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.743+0000 7f1063c00640 1 --2- 172.21.15.7:0/2352250570 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f103c066690 0x7f103c068b50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f105c144420 tx=0x7f1048001720 comp rx=0 tx=0).stop 2024-09-13T15:13:27.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.743+0000 7f1063c00640 1 -- 172.21.15.7:0/2352250570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105c0c5ab0 msgr2=0x7f105c0c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:27.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.743+0000 7f1063c00640 1 --2- 172.21.15.7:0/2352250570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105c0c5ab0 0x7f105c0c8cb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f105000b500 tx=0x7f105000b9c0 comp rx=0 tx=0).stop 2024-09-13T15:13:27.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.743+0000 7f1063c00640 1 -- 172.21.15.7:0/2352250570 shutdown_connections 2024-09-13T15:13:27.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.743+0000 7f1063c00640 1 --2- 172.21.15.7:0/2352250570 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f103c066690 0x7f103c068b50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:27.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.743+0000 7f1063c00640 1 --2- 172.21.15.7:0/2352250570 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f105c15d350 0x7f105c1f9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:27.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.743+0000 7f1063c00640 1 --2- 172.21.15.7:0/2352250570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f105c0c5e90 0x7f105c1f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:27.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.743+0000 7f1063c00640 1 --2- 172.21.15.7:0/2352250570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105c0c5ab0 0x7f105c0c8cb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:27.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.743+0000 7f1063c00640 1 -- 172.21.15.7:0/2352250570 >> 172.21.15.7:0/2352250570 conn(0x7f105c065d40 msgr2=0x7f105c0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:27.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.751+0000 7f1063c00640 1 -- 172.21.15.7:0/2352250570 shutdown_connections 2024-09-13T15:13:27.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:27.751+0000 7f1063c00640 1 -- 172.21.15.7:0/2352250570 wait complete. 2024-09-13T15:13:27.800 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.f is laggy/crashed, in failed state, or mds.f is removed from mdsmap 2024-09-13T15:13:29.801 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:30.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.059+0000 7fae47200640 1 Processor -- start 2024-09-13T15:13:30.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.059+0000 7fae47200640 1 -- start start 2024-09-13T15:13:30.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.063+0000 7fae47200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fae480cba20 0x7fae480c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:30.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.063+0000 7fae47200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fae480cbe00 0x7fae480c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:30.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.063+0000 7fae47200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4806ad30 con 0x7fae48159c40 2024-09-13T15:13:30.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.063+0000 7fae47200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4806b010 con 0x7fae480cbe00 2024-09-13T15:13:30.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.063+0000 7fae47200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4806b2f0 con 0x7fae480cba20 2024-09-13T15:13:30.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.063+0000 7fae45400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fae480cbe00 0x7fae480c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:30.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.063+0000 7fae45400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fae480cbe00 0x7fae480c7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50722/0 (socket says 172.21.15.7:50722) 2024-09-13T15:13:30.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.063+0000 7fae45400640 1 -- 172.21.15.7:0/1585758304 learned_addr learned my addr 172.21.15.7:0/1585758304 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:30.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.063+0000 7fae45e00640 1 --2- 172.21.15.7:0/1585758304 >> v2:172.21.15.77:3300/0 conn(0x7fae480cba20 0x7fae480c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:30.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.063+0000 7fae45400640 1 -- 172.21.15.7:0/1585758304 >> v2:172.21.15.77:3300/0 conn(0x7fae480cba20 msgr2=0x7fae480c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:30.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.063+0000 7fae45400640 1 --2- 172.21.15.7:0/1585758304 >> v2:172.21.15.77:3300/0 conn(0x7fae480cba20 0x7fae480c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:30.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.063+0000 7fae45400640 1 -- 172.21.15.7:0/1585758304 >> v1:172.21.15.7:6789/0 conn(0x7fae48159c40 legacy=0x7fae480c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:30.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.063+0000 7fae45400640 1 -- 172.21.15.7:0/1585758304 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4806b5d0 con 0x7fae480cbe00 2024-09-13T15:13:30.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.067+0000 7fae45400640 1 --2- 172.21.15.7:0/1585758304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae480cbe00 0x7fae480c7100 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fae480cfa60 tx=0x7fae3401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9b4ad03c2ebdf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:30.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.067+0000 7fae44a00640 1 -- 172.21.15.7:0/1585758304 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae340a7070 con 0x7fae480cbe00 2024-09-13T15:13:30.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.067+0000 7fae44a00640 1 -- 172.21.15.7:0/1585758304 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae340ab430 con 0x7fae480cbe00 2024-09-13T15:13:30.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.067+0000 7fae44a00640 1 -- 172.21.15.7:0/1585758304 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae340ab7c0 con 0x7fae480cbe00 2024-09-13T15:13:30.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.071+0000 7fae47200640 1 -- 172.21.15.7:0/1585758304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae480cbe00 msgr2=0x7fae480c7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:30.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.071+0000 7fae47200640 1 --2- 172.21.15.7:0/1585758304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae480cbe00 0x7fae480c7100 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fae480cfa60 tx=0x7fae3401c520 comp rx=0 tx=0).stop 2024-09-13T15:13:30.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.071+0000 7fae47200640 1 -- 172.21.15.7:0/1585758304 shutdown_connections 2024-09-13T15:13:30.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.071+0000 7fae47200640 1 --2- 172.21.15.7:0/1585758304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae480cbe00 0x7fae480c7100 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:30.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.071+0000 7fae47200640 1 --2- 172.21.15.7:0/1585758304 >> v2:172.21.15.77:3300/0 conn(0x7fae480cba20 0x7fae480c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:30.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.071+0000 7fae47200640 1 -- 172.21.15.7:0/1585758304 >> 172.21.15.7:0/1585758304 conn(0x7fae48071520 msgr2=0x7fae48071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:30.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.071+0000 7fae47200640 1 -- 172.21.15.7:0/1585758304 shutdown_connections 2024-09-13T15:13:30.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.071+0000 7fae47200640 1 -- 172.21.15.7:0/1585758304 wait complete. 2024-09-13T15:13:30.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.071+0000 7fae47200640 1 Processor -- start 2024-09-13T15:13:30.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.071+0000 7fae47200640 1 -- start start 2024-09-13T15:13:30.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.075+0000 7fae47200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae480cba20 0x7fae481f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:30.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.075+0000 7fae47200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae480cbe00 0x7fae4814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:30.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.075+0000 7fae47200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae48159c40 0x7fae4814f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:30.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.075+0000 7fae47200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae481502b0 con 0x7fae480cba20 2024-09-13T15:13:30.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.075+0000 7fae47200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae481f6020 con 0x7fae48159c40 2024-09-13T15:13:30.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.075+0000 7fae47200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae481f6300 con 0x7fae480cbe00 2024-09-13T15:13:30.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.075+0000 7fae45400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae480cbe00 0x7fae4814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:30.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.075+0000 7fae45400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae480cbe00 0x7fae4814ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:54738/0 (socket says 172.21.15.7:54738) 2024-09-13T15:13:30.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.075+0000 7fae45400640 1 -- 172.21.15.7:0/487876297 learned_addr learned my addr 172.21.15.7:0/487876297 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:30.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.075+0000 7fae46800640 1 --2- 172.21.15.7:0/487876297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae48159c40 0x7fae4814f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.075+0000 7fae45e00640 1 --2- 172.21.15.7:0/487876297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae480cba20 0x7fae481f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.075+0000 7fae45400640 1 -- 172.21.15.7:0/487876297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae48159c40 msgr2=0x7fae4814f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.075+0000 7fae45400640 1 --2- 172.21.15.7:0/487876297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae48159c40 0x7fae4814f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.075+0000 7fae45400640 1 -- 172.21.15.7:0/487876297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae480cba20 msgr2=0x7fae481f5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.075+0000 7fae45400640 1 --2- 172.21.15.7:0/487876297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae480cba20 0x7fae481f5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.075+0000 7fae45400640 1 -- 172.21.15.7:0/487876297 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae340094d0 con 0x7fae480cbe00 2024-09-13T15:13:30.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.075+0000 7fae45400640 1 --2- 172.21.15.7:0/487876297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae480cbe00 0x7fae4814ec20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fae34019130 tx=0x7fae3401ad60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:30.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.079+0000 7fae3e000640 1 -- 172.21.15.7:0/487876297 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae340be5f0 con 0x7fae480cbe00 2024-09-13T15:13:30.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.079+0000 7fae3e000640 1 -- 172.21.15.7:0/487876297 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae340be750 con 0x7fae480cbe00 2024-09-13T15:13:30.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.079+0000 7fae3e000640 1 -- 172.21.15.7:0/487876297 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae340beb00 con 0x7fae480cbe00 2024-09-13T15:13:30.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.079+0000 7fae47200640 1 -- 172.21.15.7:0/487876297 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4814fbf0 con 0x7fae480cbe00 2024-09-13T15:13:30.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.079+0000 7fae47200640 1 -- 172.21.15.7:0/487876297 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4814a840 con 0x7fae480cbe00 2024-09-13T15:13:30.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.079+0000 7fae47200640 1 -- 172.21.15.7:0/487876297 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4814dc50 con 0x7fae480cbe00 2024-09-13T15:13:30.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.083+0000 7fae3e000640 1 -- 172.21.15.7:0/487876297 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fae340b43f0 con 0x7fae480cbe00 2024-09-13T15:13:30.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.083+0000 7fae3e000640 1 --2- 172.21.15.7:0/487876297 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fae28066760 0x7fae28068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:30.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.083+0000 7fae3e000640 1 -- 172.21.15.7:0/487876297 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fae3411ee40 con 0x7fae480cbe00 2024-09-13T15:13:30.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.083+0000 7fae45e00640 1 --2- 172.21.15.7:0/487876297 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fae28066760 0x7fae28068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:30.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.083+0000 7fae45e00640 1 --2- 172.21.15.7:0/487876297 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fae28066760 0x7fae28068c20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fae38009af0 tx=0x7fae38008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:30.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.099+0000 7fae3e000640 1 -- 172.21.15.7:0/487876297 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fae340ebdf0 con 0x7fae480cbe00 2024-09-13T15:13:30.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.491+0000 7fae47200640 1 -- 172.21.15.7:0/487876297 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae480c97f0 con 0x7fae480cbe00 2024-09-13T15:13:30.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.495+0000 7fae3e000640 1 -- 172.21.15.7:0/487876297 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5527 (secure 0 0 0) 0x7fae340ef410 con 0x7fae480cbe00 2024-09-13T15:13:30.496 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:30.496 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:13:27.796181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:30.496 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 47 2024-09-13T15:13:30.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.495+0000 7fae47200640 1 -- 172.21.15.7:0/487876297 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fae28066760 msgr2=0x7fae28068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:30.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.495+0000 7fae47200640 1 --2- 172.21.15.7:0/487876297 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fae28066760 0x7fae28068c20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fae38009af0 tx=0x7fae38008040 comp rx=0 tx=0).stop 2024-09-13T15:13:30.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.495+0000 7fae47200640 1 -- 172.21.15.7:0/487876297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae480cbe00 msgr2=0x7fae4814ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:30.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.495+0000 7fae47200640 1 --2- 172.21.15.7:0/487876297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae480cbe00 0x7fae4814ec20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fae34019130 tx=0x7fae3401ad60 comp rx=0 tx=0).stop 2024-09-13T15:13:30.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.495+0000 7fae47200640 1 -- 172.21.15.7:0/487876297 shutdown_connections 2024-09-13T15:13:30.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.495+0000 7fae47200640 1 --2- 172.21.15.7:0/487876297 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fae28066760 0x7fae28068c20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:30.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.495+0000 7fae47200640 1 --2- 172.21.15.7:0/487876297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fae48159c40 0x7fae4814f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:30.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.495+0000 7fae47200640 1 --2- 172.21.15.7:0/487876297 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fae480cbe00 0x7fae4814ec20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:30.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.495+0000 7fae47200640 1 --2- 172.21.15.7:0/487876297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fae480cba20 0x7fae481f5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:30.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.495+0000 7fae47200640 1 -- 172.21.15.7:0/487876297 >> 172.21.15.7:0/487876297 conn(0x7fae48071520 msgr2=0x7fae480c5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:30.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.495+0000 7fae47200640 1 -- 172.21.15.7:0/487876297 shutdown_connections 2024-09-13T15:13:30.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.495+0000 7fae47200640 1 -- 172.21.15.7:0/487876297 wait complete. 2024-09-13T15:13:30.531 INFO:tasks.mds_thrash.fs.[cephfs]:mds.f down, removed from mdsmap 2024-09-13T15:13:30.531 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-09-13T15:13:30.531 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:30.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.723+0000 7f9787200640 1 Processor -- start 2024-09-13T15:13:30.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.723+0000 7f9787200640 1 -- start start 2024-09-13T15:13:30.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.727+0000 7f9787200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f978814f9e0 0x7f97881595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:30.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.727+0000 7f9787200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978815c4d0 con 0x7f978806ee90 2024-09-13T15:13:30.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.727+0000 7f9787200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978814fdc0 con 0x7f9788159b30 2024-09-13T15:13:30.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.727+0000 7f9787200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97881591d0 con 0x7f978814f9e0 2024-09-13T15:13:30.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.727+0000 7f9785e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f978814f9e0 0x7f97881595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:30.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.727+0000 7f9785400640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9788159b30 0x7f97880c9c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:47880/0 (socket says 172.21.15.7:47880) 2024-09-13T15:13:30.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.727+0000 7f9785400640 1 -- 172.21.15.7:0/1014645431 learned_addr learned my addr 172.21.15.7:0/1014645431 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:13:30.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.727+0000 7f9784a00640 1 -- 172.21.15.7:0/1014645431 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122240042 0 0) 0x7f978815c4d0 con 0x7f978806ee90 2024-09-13T15:13:30.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.727+0000 7f9785e00640 1 -- 172.21.15.7:0/1014645431 >> v1:172.21.15.77:6789/0 conn(0x7f9788159b30 legacy=0x7f97880c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:30.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.727+0000 7f9785e00640 1 -- 172.21.15.7:0/1014645431 >> v1:172.21.15.7:6789/0 conn(0x7f978806ee90 legacy=0x7f978806f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:30.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.727+0000 7f9785e00640 1 -- 172.21.15.7:0/1014645431 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9788069f30 con 0x7f978814f9e0 2024-09-13T15:13:30.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.731+0000 7f9785e00640 1 --2- 172.21.15.7:0/1014645431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f978814f9e0 0x7f97881595f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f97780097c0 tx=0x7f977801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77d41483a9cf3d51 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:30.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.731+0000 7f9784a00640 1 -- 172.21.15.7:0/1014645431 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97780a8990 con 0x7f978814f9e0 2024-09-13T15:13:30.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.731+0000 7f9784a00640 1 -- 172.21.15.7:0/1014645431 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97780a8af0 con 0x7f978814f9e0 2024-09-13T15:13:30.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.731+0000 7f9784a00640 1 -- 172.21.15.7:0/1014645431 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97780a8e80 con 0x7f978814f9e0 2024-09-13T15:13:30.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.731+0000 7f9787200640 1 -- 172.21.15.7:0/1014645431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f978814f9e0 msgr2=0x7f97881595f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:30.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.731+0000 7f9787200640 1 --2- 172.21.15.7:0/1014645431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f978814f9e0 0x7f97881595f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f97780097c0 tx=0x7f977801ec90 comp rx=0 tx=0).stop 2024-09-13T15:13:30.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.731+0000 7f9787200640 1 -- 172.21.15.7:0/1014645431 shutdown_connections 2024-09-13T15:13:30.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.731+0000 7f9787200640 1 --2- 172.21.15.7:0/1014645431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f978814f9e0 0x7f97881595f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:30.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.731+0000 7f9787200640 1 -- 172.21.15.7:0/1014645431 >> 172.21.15.7:0/1014645431 conn(0x7f97880733a0 msgr2=0x7f97880737b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:30.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.731+0000 7f9787200640 1 -- 172.21.15.7:0/1014645431 shutdown_connections 2024-09-13T15:13:30.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.731+0000 7f9787200640 1 -- 172.21.15.7:0/1014645431 wait complete. 2024-09-13T15:13:30.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9787200640 1 Processor -- start 2024-09-13T15:13:30.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9787200640 1 -- start start 2024-09-13T15:13:30.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9787200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f978806ee90 0x7f9788150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:30.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9787200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f978814f9e0 0x7f9788152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:30.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9787200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9788159b30 0x7f97881542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:30.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9787200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9788153fd0 con 0x7f978814f9e0 2024-09-13T15:13:30.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9787200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9788153b40 con 0x7f978806ee90 2024-09-13T15:13:30.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9787200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9788150d80 con 0x7f9788159b30 2024-09-13T15:13:30.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9785400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f978814f9e0 0x7f9788152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:30.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9785e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f978806ee90 0x7f9788150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:30.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9785400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f978814f9e0 0x7f9788152840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:50736/0 (socket says 172.21.15.7:50736) 2024-09-13T15:13:30.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9785400640 1 -- 172.21.15.7:0/1649285580 learned_addr learned my addr 172.21.15.7:0/1649285580 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:30.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9786800640 1 --2- 172.21.15.7:0/1649285580 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9788159b30 0x7f97881542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:30.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9785400640 1 -- 172.21.15.7:0/1649285580 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9788159b30 msgr2=0x7f97881542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:30.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9785400640 1 --2- 172.21.15.7:0/1649285580 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9788159b30 0x7f97881542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:30.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9785400640 1 -- 172.21.15.7:0/1649285580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f978806ee90 msgr2=0x7f9788150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:30.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9785400640 1 --2- 172.21.15.7:0/1649285580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f978806ee90 0x7f9788150440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:30.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9785400640 1 -- 172.21.15.7:0/1649285580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9778009420 con 0x7f978814f9e0 2024-09-13T15:13:30.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9785e00640 1 --2- 172.21.15.7:0/1649285580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f978806ee90 0x7f9788150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:13:30.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.735+0000 7f9785400640 1 --2- 172.21.15.7:0/1649285580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f978814f9e0 0x7f9788152840 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f977400c430 tx=0x7f977400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:30.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.739+0000 7f977e000640 1 -- 172.21.15.7:0/1649285580 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774005cf0 con 0x7f978814f9e0 2024-09-13T15:13:30.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.739+0000 7f977e000640 1 -- 172.21.15.7:0/1649285580 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9774005e50 con 0x7f978814f9e0 2024-09-13T15:13:30.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.739+0000 7f977e000640 1 -- 172.21.15.7:0/1649285580 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97740072d0 con 0x7f978814f9e0 2024-09-13T15:13:30.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.739+0000 7f9787200640 1 -- 172.21.15.7:0/1649285580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97881568b0 con 0x7f978814f9e0 2024-09-13T15:13:30.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.739+0000 7f9787200640 1 -- 172.21.15.7:0/1649285580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97881537d0 con 0x7f978814f9e0 2024-09-13T15:13:30.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.739+0000 7f9787200640 1 -- 172.21.15.7:0/1649285580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978806a750 con 0x7f978814f9e0 2024-09-13T15:13:30.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.739+0000 7f977e000640 1 -- 172.21.15.7:0/1649285580 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9774007430 con 0x7f978814f9e0 2024-09-13T15:13:30.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.739+0000 7f977e000640 1 --2- 172.21.15.7:0/1649285580 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9768066690 0x7f9768068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:30.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.739+0000 7f977e000640 1 -- 172.21.15.7:0/1649285580 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f9774083b00 con 0x7f978814f9e0 2024-09-13T15:13:30.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.739+0000 7f9785e00640 1 --2- 172.21.15.7:0/1649285580 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9768066690 0x7f9768068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:30.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.743+0000 7f9785e00640 1 --2- 172.21.15.7:0/1649285580 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9768066690 0x7f9768068b50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f97780b2000 tx=0x7f9778008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:30.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:30.743+0000 7f977e000640 1 -- 172.21.15.7:0/1649285580 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9774050a40 con 0x7f978814f9e0 2024-09-13T15:13:31.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:31.055+0000 7f9787200640 1 -- 172.21.15.7:0/1649285580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9788153c80 con 0x7f978814f9e0 2024-09-13T15:13:31.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:31.055+0000 7f977e000640 1 -- 172.21.15.7:0/1649285580 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5527 (secure 0 0 0) 0x7f9774054060 con 0x7f978814f9e0 2024-09-13T15:13:31.059 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:31.059 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:13:27.796181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:31.059 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 47 2024-09-13T15:13:31.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:31.059+0000 7f9787200640 1 -- 172.21.15.7:0/1649285580 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9768066690 msgr2=0x7f9768068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:31.059+0000 7f9787200640 1 --2- 172.21.15.7:0/1649285580 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9768066690 0x7f9768068b50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f97780b2000 tx=0x7f9778008040 comp rx=0 tx=0).stop 2024-09-13T15:13:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:31.059+0000 7f9787200640 1 -- 172.21.15.7:0/1649285580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f978814f9e0 msgr2=0x7f9788152840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:31.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:31.059+0000 7f9787200640 1 --2- 172.21.15.7:0/1649285580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f978814f9e0 0x7f9788152840 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f977400c430 tx=0x7f977400c8f0 comp rx=0 tx=0).stop 2024-09-13T15:13:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:31.063+0000 7f9787200640 1 -- 172.21.15.7:0/1649285580 shutdown_connections 2024-09-13T15:13:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:31.063+0000 7f9787200640 1 --2- 172.21.15.7:0/1649285580 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9768066690 0x7f9768068b50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:31.063+0000 7f9787200640 1 --2- 172.21.15.7:0/1649285580 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9788159b30 0x7f97881542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:31.063+0000 7f9787200640 1 --2- 172.21.15.7:0/1649285580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f978814f9e0 0x7f9788152840 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:31.063+0000 7f9787200640 1 --2- 172.21.15.7:0/1649285580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f978806ee90 0x7f9788150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:31.063+0000 7f9787200640 1 -- 172.21.15.7:0/1649285580 >> 172.21.15.7:0/1649285580 conn(0x7f97880733a0 msgr2=0x7f978815cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:31.063+0000 7f9787200640 1 -- 172.21.15.7:0/1649285580 shutdown_connections 2024-09-13T15:13:31.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:31.063+0000 7f9787200640 1 -- 172.21.15.7:0/1649285580 wait complete. 2024-09-13T15:13:31.119 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 47, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-13T15:01:44.789559+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 47, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3 ], "info": { "gid_4276": { "addr": "172.21.15.7:6836/2396967179", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6834", "nonce": 2396967179, "type": "v2" }, { "addr": "172.21.15.7:6836", "nonce": 2396967179, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4276, "incarnation": 4, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_5069": { "addr": "172.21.15.77:6838/877425259", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6836", "nonce": 877425259, "type": "v2" }, { "addr": "172.21.15.77:6838", "nonce": 877425259, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5069, "incarnation": 31, "join_fscid": -1, "name": "b", "rank": 3, "state": "up:active", "state_seq": 43 }, "gid_5198": { "addr": "172.21.15.7:6833/1355774527", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6832", "nonce": 1355774527, "type": "v2" }, { "addr": "172.21.15.7:6833", "nonce": 1355774527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5198, "incarnation": 41, "join_fscid": -1, "name": "e", "rank": 2, "state": "up:active", "state_seq": 14 }, "gid_5569": { "addr": "172.21.15.77:6835/1536067351", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6834", "nonce": 1536067351, "type": "v2" }, { "addr": "172.21.15.77:6835", "nonce": 1536067351, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5569, "incarnation": 47, "join_fscid": -1, "name": "d", "rank": 1, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 4, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-13T15:13:27.796181+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [ 4 ], "tableserver": 0, "up": { "mds_0": 4276, "mds_1": 5569, "mds_2": 5198, "mds_3": 5069 } } } ], "standbys": [ { "addr": "172.21.15.7:6837/3708232086", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6835", "nonce": 3708232086, "type": "v2" }, { "addr": "172.21.15.7:6837", "nonce": 3708232086, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 36, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5156, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-13T15:13:33.120 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:33.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.443+0000 7f070a400640 1 Processor -- start 2024-09-13T15:13:33.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.443+0000 7f070a400640 1 -- start start 2024-09-13T15:13:33.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.447+0000 7f070a400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07040c1980 0x7f07040c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:33.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.447+0000 7f070a400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07040c79f0 0x7f0704158470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:33.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.447+0000 7f070a400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f070406d920 con 0x7f070414f350 2024-09-13T15:13:33.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.447+0000 7f070a400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f070414f730 con 0x7f07040c79f0 2024-09-13T15:13:33.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.447+0000 7f070a400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07041593d0 con 0x7f07040c1980 2024-09-13T15:13:33.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.447+0000 7f0703e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07040c1980 0x7f07040c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:33.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.447+0000 7f0703e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07040c1980 0x7f07040c5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:54760/0 (socket says 172.21.15.7:54760) 2024-09-13T15:13:33.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.447+0000 7f0703e00640 1 -- 172.21.15.7:0/582394611 learned_addr learned my addr 172.21.15.7:0/582394611 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:33.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.451+0000 7f0703e00640 1 -- 172.21.15.7:0/582394611 >> v2:172.21.15.7:3300/0 conn(0x7f07040c79f0 msgr2=0x7f0704158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:33.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.451+0000 7f0703e00640 1 --2- 172.21.15.7:0/582394611 >> v2:172.21.15.7:3300/0 conn(0x7f07040c79f0 0x7f0704158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:33.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.451+0000 7f0703e00640 1 -- 172.21.15.7:0/582394611 >> v1:172.21.15.7:6789/0 conn(0x7f070414f350 legacy=0x7f07040c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:33.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.451+0000 7f0703e00640 1 -- 172.21.15.7:0/582394611 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070406dc00 con 0x7f07040c1980 2024-09-13T15:13:33.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.459+0000 7f0703e00640 1 --2- 172.21.15.7:0/582394611 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07040c1980 0x7f07040c5d70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009870 tx=0x7f06ec020f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4853028ee24f3b1f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:33.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.463+0000 7f0703400640 1 -- 172.21.15.7:0/582394611 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0aabe0 con 0x7f07040c1980 2024-09-13T15:13:33.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.463+0000 7f0703400640 1 -- 172.21.15.7:0/582394611 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec0aad40 con 0x7f07040c1980 2024-09-13T15:13:33.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.463+0000 7f0703400640 1 -- 172.21.15.7:0/582394611 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec0b2660 con 0x7f07040c1980 2024-09-13T15:13:33.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.475+0000 7f070a400640 1 -- 172.21.15.7:0/582394611 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07040c1980 msgr2=0x7f07040c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:33.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.475+0000 7f070a400640 1 --2- 172.21.15.7:0/582394611 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07040c1980 0x7f07040c5d70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009870 tx=0x7f06ec020f20 comp rx=0 tx=0).stop 2024-09-13T15:13:33.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.479+0000 7f070a400640 1 -- 172.21.15.7:0/582394611 shutdown_connections 2024-09-13T15:13:33.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.479+0000 7f070a400640 1 --2- 172.21.15.7:0/582394611 >> v2:172.21.15.7:3300/0 conn(0x7f07040c79f0 0x7f0704158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:33.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.479+0000 7f070a400640 1 --2- 172.21.15.7:0/582394611 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07040c1980 0x7f07040c5d70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:33.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.479+0000 7f070a400640 1 -- 172.21.15.7:0/582394611 >> 172.21.15.7:0/582394611 conn(0x7f0704065d40 msgr2=0x7f0704066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:33.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.479+0000 7f070a400640 1 -- 172.21.15.7:0/582394611 shutdown_connections 2024-09-13T15:13:33.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.479+0000 7f070a400640 1 -- 172.21.15.7:0/582394611 wait complete. 2024-09-13T15:13:33.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.479+0000 7f070a400640 1 Processor -- start 2024-09-13T15:13:33.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.479+0000 7f070a400640 1 -- start start 2024-09-13T15:13:33.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.483+0000 7f070a400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07040c1980 0x7f0704157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:33.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.483+0000 7f070a400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07040c79f0 0x7f070414e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:33.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.483+0000 7f070a400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f070414f350 0x7f07041f8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:33.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.483+0000 7f070a400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07041585a0 con 0x7f07040c79f0 2024-09-13T15:13:33.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.483+0000 7f070a400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07040c8b40 con 0x7f07040c1980 2024-09-13T15:13:33.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.483+0000 7f070a400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07040c8e20 con 0x7f070414f350 2024-09-13T15:13:33.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.483+0000 7f0709a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f070414f350 0x7f07041f8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:33.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.483+0000 7f0709a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f070414f350 0x7f07041f8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:54772/0 (socket says 172.21.15.7:54772) 2024-09-13T15:13:33.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.483+0000 7f0709a00640 1 -- 172.21.15.7:0/2481791265 learned_addr learned my addr 172.21.15.7:0/2481791265 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.483+0000 7f0709a00640 1 -- 172.21.15.7:0/2481791265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07040c1980 msgr2=0x7f0704157be0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T15:13:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.483+0000 7f0709a00640 1 --2- 172.21.15.7:0/2481791265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07040c1980 0x7f0704157be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.483+0000 7f0709a00640 1 -- 172.21.15.7:0/2481791265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07040c79f0 msgr2=0x7f070414e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.483+0000 7f0709a00640 1 --2- 172.21.15.7:0/2481791265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07040c79f0 0x7f070414e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:33.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.483+0000 7f0709a00640 1 -- 172.21.15.7:0/2481791265 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec0094d0 con 0x7f070414f350 2024-09-13T15:13:33.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.491+0000 7f0709a00640 1 --2- 172.21.15.7:0/2481791265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f070414f350 0x7f07041f8980 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00b430 tx=0x7f06fc00b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.491+0000 7f0700c00640 1 -- 172.21.15.7:0/2481791265 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc011830 con 0x7f070414f350 2024-09-13T15:13:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.491+0000 7f0700c00640 1 -- 172.21.15.7:0/2481791265 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc011990 con 0x7f070414f350 2024-09-13T15:13:33.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.491+0000 7f0700c00640 1 -- 172.21.15.7:0/2481791265 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc011d40 con 0x7f070414f350 2024-09-13T15:13:33.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.491+0000 7f070a400640 1 -- 172.21.15.7:0/2481791265 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07040c9100 con 0x7f070414f350 2024-09-13T15:13:33.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.491+0000 7f070a400640 1 -- 172.21.15.7:0/2481791265 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07040c96c0 con 0x7f070414f350 2024-09-13T15:13:33.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.499+0000 7f0700c00640 1 -- 172.21.15.7:0/2481791265 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f06fc01a400 con 0x7f070414f350 2024-09-13T15:13:33.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.499+0000 7f070a400640 1 -- 172.21.15.7:0/2481791265 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06dc005260 con 0x7f070414f350 2024-09-13T15:13:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.503+0000 7f0700c00640 1 --2- 172.21.15.7:0/2481791265 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f06e00666e0 0x7f06e0068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:33.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.503+0000 7f0700c00640 1 -- 172.21.15.7:0/2481791265 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f06fc0847b0 con 0x7f070414f350 2024-09-13T15:13:33.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.503+0000 7f0709000640 1 --2- 172.21.15.7:0/2481791265 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f06e00666e0 0x7f06e0068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:33.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.507+0000 7f0709000640 1 --2- 172.21.15.7:0/2481791265 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f06e00666e0 0x7f06e0068ba0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f06f400ab90 tx=0x7f06f4009230 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:33.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:33.515+0000 7f0700c00640 1 -- 172.21.15.7:0/2481791265 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f06fc051720 con 0x7f070414f350 2024-09-13T15:13:34.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:34.035+0000 7f070a400640 1 -- 172.21.15.7:0/2481791265 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06dc005510 con 0x7f070414f350 2024-09-13T15:13:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:34.040 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:13:27.796181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:34.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:34.035+0000 7f0700c00640 1 -- 172.21.15.7:0/2481791265 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5527 (secure 0 0 0) 0x7f06fc015090 con 0x7f070414f350 2024-09-13T15:13:34.041 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 47 2024-09-13T15:13:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:34.039+0000 7f070a400640 1 -- 172.21.15.7:0/2481791265 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f06e00666e0 msgr2=0x7f06e0068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:34.039+0000 7f070a400640 1 --2- 172.21.15.7:0/2481791265 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f06e00666e0 0x7f06e0068ba0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f06f400ab90 tx=0x7f06f4009230 comp rx=0 tx=0).stop 2024-09-13T15:13:34.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:34.039+0000 7f070a400640 1 -- 172.21.15.7:0/2481791265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f070414f350 msgr2=0x7f07041f8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:34.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:34.039+0000 7f070a400640 1 --2- 172.21.15.7:0/2481791265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f070414f350 0x7f07041f8980 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00b430 tx=0x7f06fc00b8f0 comp rx=0 tx=0).stop 2024-09-13T15:13:34.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:34.043+0000 7f070a400640 1 -- 172.21.15.7:0/2481791265 shutdown_connections 2024-09-13T15:13:34.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:34.043+0000 7f070a400640 1 --2- 172.21.15.7:0/2481791265 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f06e00666e0 0x7f06e0068ba0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:34.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:34.043+0000 7f070a400640 1 --2- 172.21.15.7:0/2481791265 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f070414f350 0x7f07041f8980 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:34.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:34.043+0000 7f070a400640 1 --2- 172.21.15.7:0/2481791265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07040c79f0 0x7f070414e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:34.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:34.043+0000 7f070a400640 1 --2- 172.21.15.7:0/2481791265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07040c1980 0x7f0704157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:34.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:34.043+0000 7f070a400640 1 -- 172.21.15.7:0/2481791265 >> 172.21.15.7:0/2481791265 conn(0x7f0704065d40 msgr2=0x7f070414af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:34.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:34.047+0000 7f070a400640 1 -- 172.21.15.7:0/2481791265 shutdown_connections 2024-09-13T15:13:34.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:34.047+0000 7f070a400640 1 -- 172.21.15.7:0/2481791265 wait complete. 2024-09-13T15:13:34.099 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:13:36.101 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:36.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.403+0000 7fb25fe00640 1 Processor -- start 2024-09-13T15:13:36.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.403+0000 7fb25fe00640 1 -- start start 2024-09-13T15:13:36.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.407+0000 7fb25fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb2600c7420 0x7fb2600c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:36.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.407+0000 7fb25fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2600c6c90 0x7fb260152e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:36.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.407+0000 7fb25fe00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb260159ef0 con 0x7fb2600c7800 2024-09-13T15:13:36.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.407+0000 7fb25fe00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb260158f60 con 0x7fb2600c7420 2024-09-13T15:13:36.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.407+0000 7fb25fe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600c5fc0 con 0x7fb2600c6c90 2024-09-13T15:13:36.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.407+0000 7fb25f400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2600c6c90 0x7fb260152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:36.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.407+0000 7fb25f400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2600c6c90 0x7fb260152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:54780/0 (socket says 172.21.15.7:54780) 2024-09-13T15:13:36.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.407+0000 7fb25f400640 1 -- 172.21.15.7:0/2572541176 learned_addr learned my addr 172.21.15.7:0/2572541176 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:36.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.407+0000 7fb25ea00640 1 --2- 172.21.15.7:0/2572541176 >> v2:172.21.15.7:3300/0 conn(0x7fb2600c7420 0x7fb2600c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:36.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.407+0000 7fb25f400640 1 -- 172.21.15.7:0/2572541176 >> v2:172.21.15.7:3300/0 conn(0x7fb2600c7420 msgr2=0x7fb2600c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:36.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.411+0000 7fb25f400640 1 --2- 172.21.15.7:0/2572541176 >> v2:172.21.15.7:3300/0 conn(0x7fb2600c7420 0x7fb2600c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:36.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.411+0000 7fb25f400640 1 -- 172.21.15.7:0/2572541176 >> v1:172.21.15.7:6789/0 conn(0x7fb2600c7800 legacy=0x7fb26006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:36.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.411+0000 7fb25f400640 1 -- 172.21.15.7:0/2572541176 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb260159150 con 0x7fb2600c6c90 2024-09-13T15:13:36.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.411+0000 7fb25ea00640 1 --2- 172.21.15.7:0/2572541176 >> v2:172.21.15.7:3300/0 conn(0x7fb2600c7420 0x7fb2600c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:13:36.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.419+0000 7fb25f400640 1 --2- 172.21.15.7:0/2572541176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2600c6c90 0x7fb260152e00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb258009e50 tx=0x7fb25801f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e61c2b0fee3160cc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:36.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.419+0000 7fb25d600640 1 -- 172.21.15.7:0/2572541176 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2580af400 con 0x7fb2600c6c90 2024-09-13T15:13:36.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.419+0000 7fb25d600640 1 -- 172.21.15.7:0/2572541176 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2580ab050 con 0x7fb2600c6c90 2024-09-13T15:13:36.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.419+0000 7fb25d600640 1 -- 172.21.15.7:0/2572541176 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2580af780 con 0x7fb2600c6c90 2024-09-13T15:13:36.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.419+0000 7fb25fe00640 1 -- 172.21.15.7:0/2572541176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2600c6c90 msgr2=0x7fb260152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:36.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.419+0000 7fb25fe00640 1 --2- 172.21.15.7:0/2572541176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2600c6c90 0x7fb260152e00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb258009e50 tx=0x7fb25801f1e0 comp rx=0 tx=0).stop 2024-09-13T15:13:36.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.423+0000 7fb25fe00640 1 -- 172.21.15.7:0/2572541176 shutdown_connections 2024-09-13T15:13:36.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.423+0000 7fb25fe00640 1 --2- 172.21.15.7:0/2572541176 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2600c6c90 0x7fb260152e00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:36.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.423+0000 7fb25fe00640 1 --2- 172.21.15.7:0/2572541176 >> v2:172.21.15.7:3300/0 conn(0x7fb2600c7420 0x7fb2600c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:36.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.423+0000 7fb25fe00640 1 -- 172.21.15.7:0/2572541176 >> 172.21.15.7:0/2572541176 conn(0x7fb260065d40 msgr2=0x7fb260066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:36.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.427+0000 7fb25fe00640 1 -- 172.21.15.7:0/2572541176 shutdown_connections 2024-09-13T15:13:36.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.427+0000 7fb25fe00640 1 -- 172.21.15.7:0/2572541176 wait complete. 2024-09-13T15:13:36.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.427+0000 7fb25fe00640 1 Processor -- start 2024-09-13T15:13:36.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.427+0000 7fb25fe00640 1 -- start start 2024-09-13T15:13:36.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.431+0000 7fb25fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2600c6c90 0x7fb2601f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:36.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.431+0000 7fb25fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2600c7420 0x7fb260158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:36.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.431+0000 7fb25fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2600c7800 0x7fb260146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:36.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.431+0000 7fb25e000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2600c7420 0x7fb260158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:36.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.431+0000 7fb25e000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2600c7420 0x7fb260158080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:54792/0 (socket says 172.21.15.7:54792) 2024-09-13T15:13:36.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.431+0000 7fb25e000640 1 -- 172.21.15.7:0/4047263033 learned_addr learned my addr 172.21.15.7:0/4047263033 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:36.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.431+0000 7fb25fe00640 1 -- 172.21.15.7:0/4047263033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2601e0990 con 0x7fb2600c7800 2024-09-13T15:13:36.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.431+0000 7fb25fe00640 1 -- 172.21.15.7:0/4047263033 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2601e4640 con 0x7fb2600c6c90 2024-09-13T15:13:36.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.431+0000 7fb25fe00640 1 -- 172.21.15.7:0/4047263033 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2601df250 con 0x7fb2600c7420 2024-09-13T15:13:36.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.431+0000 7fb25f400640 1 --2- 172.21.15.7:0/4047263033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2600c7800 0x7fb260146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:36.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.435+0000 7fb25ea00640 1 --2- 172.21.15.7:0/4047263033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2600c6c90 0x7fb2601f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:36.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.435+0000 7fb25ea00640 1 -- 172.21.15.7:0/4047263033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2600c7420 msgr2=0x7fb260158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:36.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.435+0000 7fb25ea00640 1 --2- 172.21.15.7:0/4047263033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2600c7420 0x7fb260158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:36.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.435+0000 7fb25ea00640 1 -- 172.21.15.7:0/4047263033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2600c7800 msgr2=0x7fb260146420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:36.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.435+0000 7fb25ea00640 1 --2- 172.21.15.7:0/4047263033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2600c7800 0x7fb260146420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:36.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.435+0000 7fb25ea00640 1 -- 172.21.15.7:0/4047263033 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb258009b30 con 0x7fb2600c6c90 2024-09-13T15:13:36.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.435+0000 7fb25ea00640 1 --2- 172.21.15.7:0/4047263033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2600c6c90 0x7fb2601f2c70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb25000c7c0 tx=0x7fb25000cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:36.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.439+0000 7fb256a00640 1 -- 172.21.15.7:0/4047263033 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb250007820 con 0x7fb2600c6c90 2024-09-13T15:13:36.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.439+0000 7fb256a00640 1 -- 172.21.15.7:0/4047263033 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb250007980 con 0x7fb2600c6c90 2024-09-13T15:13:36.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.439+0000 7fb256a00640 1 -- 172.21.15.7:0/4047263033 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb250007d10 con 0x7fb2600c6c90 2024-09-13T15:13:36.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.439+0000 7fb25fe00640 1 -- 172.21.15.7:0/4047263033 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2601e4bc0 con 0x7fb2600c6c90 2024-09-13T15:13:36.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.439+0000 7fb25fe00640 1 -- 172.21.15.7:0/4047263033 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2601e48e0 con 0x7fb2600c6c90 2024-09-13T15:13:36.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.443+0000 7fb25fe00640 1 -- 172.21.15.7:0/4047263033 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb260067650 con 0x7fb2600c6c90 2024-09-13T15:13:36.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.451+0000 7fb256a00640 1 -- 172.21.15.7:0/4047263033 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb250024480 con 0x7fb2600c6c90 2024-09-13T15:13:36.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.455+0000 7fb256a00640 1 --2- 172.21.15.7:0/4047263033 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb240066790 0x7fb240068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:36.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.455+0000 7fb256a00640 1 -- 172.21.15.7:0/4047263033 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fb250084aa0 con 0x7fb2600c6c90 2024-09-13T15:13:36.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.455+0000 7fb25e000640 1 --2- 172.21.15.7:0/4047263033 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb240066790 0x7fb240068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:36.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.455+0000 7fb256a00640 1 -- 172.21.15.7:0/4047263033 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb250054fe0 con 0x7fb2600c6c90 2024-09-13T15:13:36.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.455+0000 7fb25e000640 1 --2- 172.21.15.7:0/4047263033 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb240066790 0x7fb240068c50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb2600c7da0 tx=0x7fb24c0090e0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:36.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.883+0000 7fb25fe00640 1 -- 172.21.15.7:0/4047263033 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2601599d0 con 0x7fb2600c6c90 2024-09-13T15:13:36.885 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:36.885 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:13:27.796181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:36.885 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 47 2024-09-13T15:13:37.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.883+0000 7fb256a00640 1 -- 172.21.15.7:0/4047263033 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5527 (secure 0 0 0) 0x7fb25001f090 con 0x7fb2600c6c90 2024-09-13T15:13:37.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.887+0000 7fb25fe00640 1 -- 172.21.15.7:0/4047263033 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb240066790 msgr2=0x7fb240068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:37.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.887+0000 7fb25fe00640 1 --2- 172.21.15.7:0/4047263033 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb240066790 0x7fb240068c50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb2600c7da0 tx=0x7fb24c0090e0 comp rx=0 tx=0).stop 2024-09-13T15:13:37.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.887+0000 7fb25fe00640 1 -- 172.21.15.7:0/4047263033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2600c6c90 msgr2=0x7fb2601f2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:37.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.887+0000 7fb25fe00640 1 --2- 172.21.15.7:0/4047263033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2600c6c90 0x7fb2601f2c70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb25000c7c0 tx=0x7fb25000cc80 comp rx=0 tx=0).stop 2024-09-13T15:13:37.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.887+0000 7fb25fe00640 1 -- 172.21.15.7:0/4047263033 shutdown_connections 2024-09-13T15:13:37.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.887+0000 7fb25fe00640 1 --2- 172.21.15.7:0/4047263033 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb240066790 0x7fb240068c50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:37.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.887+0000 7fb25fe00640 1 --2- 172.21.15.7:0/4047263033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2600c7800 0x7fb260146420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:37.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.887+0000 7fb25fe00640 1 --2- 172.21.15.7:0/4047263033 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb2600c7420 0x7fb260158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:37.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.887+0000 7fb25fe00640 1 --2- 172.21.15.7:0/4047263033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb2600c6c90 0x7fb2601f2c70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:37.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.887+0000 7fb25fe00640 1 -- 172.21.15.7:0/4047263033 >> 172.21.15.7:0/4047263033 conn(0x7fb260065d40 msgr2=0x7fb2600c36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:37.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.887+0000 7fb25fe00640 1 -- 172.21.15.7:0/4047263033 shutdown_connections 2024-09-13T15:13:37.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:36.887+0000 7fb25fe00640 1 -- 172.21.15.7:0/4047263033 wait complete. 2024-09-13T15:13:37.114 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:13:39.114 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.419+0000 7fbf19600640 1 Processor -- start 2024-09-13T15:13:39.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.419+0000 7fbf19600640 1 -- start start 2024-09-13T15:13:39.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.423+0000 7fbf19600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fbf0c0dcd60 0x7fbf0c04be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:39.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.423+0000 7fbf19600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbf0c045c80 0x7fbf0c0e5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:39.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.423+0000 7fbf19600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0c035680 con 0x7fbf0c046090 2024-09-13T15:13:39.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.423+0000 7fbf19600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0c0dd140 con 0x7fbf0c0dcd60 2024-09-13T15:13:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.423+0000 7fbf19600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0c0457d0 con 0x7fbf0c045c80 2024-09-13T15:13:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.423+0000 7fbf13400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbf0c045c80 0x7fbf0c0e5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.423+0000 7fbf13400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbf0c045c80 0x7fbf0c0e5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:42186/0 (socket says 172.21.15.7:42186) 2024-09-13T15:13:39.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.423+0000 7fbf13400640 1 -- 172.21.15.7:0/1682909013 learned_addr learned my addr 172.21.15.7:0/1682909013 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:39.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.427+0000 7fbf12a00640 1 -- 172.21.15.7:0/1682909013 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439782608 0 0) 0x7fbf08001120 con 0x7fbf0c046090 2024-09-13T15:13:39.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.427+0000 7fbf12a00640 1 -- 172.21.15.7:0/1682909013 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbefc003530 con 0x7fbf0c046090 2024-09-13T15:13:39.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.427+0000 7fbf13e00640 1 --2- 172.21.15.7:0/1682909013 >> v2:172.21.15.7:3300/0 conn(0x7fbf0c0dcd60 0x7fbf0c04be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.431+0000 7fbf13400640 1 -- 172.21.15.7:0/1682909013 >> v2:172.21.15.7:3300/0 conn(0x7fbf0c0dcd60 msgr2=0x7fbf0c04be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.431+0000 7fbf13400640 1 --2- 172.21.15.7:0/1682909013 >> v2:172.21.15.7:3300/0 conn(0x7fbf0c0dcd60 0x7fbf0c04be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:39.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.431+0000 7fbf13400640 1 -- 172.21.15.7:0/1682909013 >> v1:172.21.15.7:6789/0 conn(0x7fbf0c046090 legacy=0x7fbf0c0e64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:39.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.431+0000 7fbf13400640 1 -- 172.21.15.7:0/1682909013 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c04bb00 con 0x7fbf0c045c80 2024-09-13T15:13:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.443+0000 7fbf13400640 1 --2- 172.21.15.7:0/1682909013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf0c045c80 0x7fbf0c0e5f70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0e05d0 tx=0x7fbf0001eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=569a801a1837b4f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.443+0000 7fbf12a00640 1 -- 172.21.15.7:0/1682909013 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf08001810 con 0x7fbf0c045c80 2024-09-13T15:13:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.443+0000 7fbf12a00640 1 -- 172.21.15.7:0/1682909013 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf000a8510 con 0x7fbf0c045c80 2024-09-13T15:13:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.443+0000 7fbf12a00640 1 -- 172.21.15.7:0/1682909013 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf000a88a0 con 0x7fbf0c045c80 2024-09-13T15:13:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.443+0000 7fbf19600640 1 -- 172.21.15.7:0/1682909013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf0c045c80 msgr2=0x7fbf0c0e5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.443+0000 7fbf19600640 1 --2- 172.21.15.7:0/1682909013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf0c045c80 0x7fbf0c0e5f70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0e05d0 tx=0x7fbf0001eb50 comp rx=0 tx=0).stop 2024-09-13T15:13:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.447+0000 7fbf19600640 1 -- 172.21.15.7:0/1682909013 shutdown_connections 2024-09-13T15:13:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.451+0000 7fbf19600640 1 --2- 172.21.15.7:0/1682909013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf0c045c80 0x7fbf0c0e5f70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.451+0000 7fbf19600640 1 --2- 172.21.15.7:0/1682909013 >> v2:172.21.15.7:3300/0 conn(0x7fbf0c0dcd60 0x7fbf0c04be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.451+0000 7fbf19600640 1 -- 172.21.15.7:0/1682909013 >> 172.21.15.7:0/1682909013 conn(0x7fbf0c04fc30 msgr2=0x7fbf0c050010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:39.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.451+0000 7fbf19600640 1 -- 172.21.15.7:0/1682909013 shutdown_connections 2024-09-13T15:13:39.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.451+0000 7fbf19600640 1 -- 172.21.15.7:0/1682909013 wait complete. 2024-09-13T15:13:39.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.459+0000 7fbf19600640 1 Processor -- start 2024-09-13T15:13:39.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.463+0000 7fbf19600640 1 -- start start 2024-09-13T15:13:39.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.463+0000 7fbf19600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf0c045c80 0x7fbf0c16fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:39.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.463+0000 7fbf19600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf0c046090 0x7fbf0c16ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:39.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.463+0000 7fbf19600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf0c0dcd60 0x7fbf0c0d2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:39.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.467+0000 7fbf13e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf0c045c80 0x7fbf0c16fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:39.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.467+0000 7fbf13e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf0c045c80 0x7fbf0c16fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:37410/0 (socket says 172.21.15.7:37410) 2024-09-13T15:13:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.467+0000 7fbf19600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c0df1f0 con 0x7fbf0c046090 2024-09-13T15:13:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.467+0000 7fbf19600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c16bd90 con 0x7fbf0c0dcd60 2024-09-13T15:13:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.467+0000 7fbf19600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c047bb0 con 0x7fbf0c045c80 2024-09-13T15:13:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.467+0000 7fbf13e00640 1 -- 172.21.15.7:0/3706501792 learned_addr learned my addr 172.21.15.7:0/3706501792 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.467+0000 7fbf13e00640 1 -- 172.21.15.7:0/3706501792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf0c0dcd60 msgr2=0x7fbf0c0d2f40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T15:13:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.467+0000 7fbf13e00640 1 --2- 172.21.15.7:0/3706501792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf0c0dcd60 0x7fbf0c0d2f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.467+0000 7fbf13e00640 1 -- 172.21.15.7:0/3706501792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf0c046090 msgr2=0x7fbf0c16ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.467+0000 7fbf13e00640 1 --2- 172.21.15.7:0/3706501792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf0c046090 0x7fbf0c16ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:39.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.467+0000 7fbf13e00640 1 -- 172.21.15.7:0/3706501792 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf000094d0 con 0x7fbf0c045c80 2024-09-13T15:13:39.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.475+0000 7fbf13e00640 1 --2- 172.21.15.7:0/3706501792 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf0c045c80 0x7fbf0c16fa40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbf140677e0 tx=0x7fbf14067500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:39.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.475+0000 7fbf07e00640 1 -- 172.21.15.7:0/3706501792 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1406e030 con 0x7fbf0c045c80 2024-09-13T15:13:39.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.475+0000 7fbf07e00640 1 -- 172.21.15.7:0/3706501792 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf14068040 con 0x7fbf0c045c80 2024-09-13T15:13:39.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.475+0000 7fbf07e00640 1 -- 172.21.15.7:0/3706501792 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf14090070 con 0x7fbf0c045c80 2024-09-13T15:13:39.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.475+0000 7fbf19600640 1 -- 172.21.15.7:0/3706501792 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0c0df3d0 con 0x7fbf0c045c80 2024-09-13T15:13:39.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.475+0000 7fbf19600640 1 -- 172.21.15.7:0/3706501792 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0c0df990 con 0x7fbf0c045c80 2024-09-13T15:13:39.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.479+0000 7fbf19600640 1 -- 172.21.15.7:0/3706501792 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf0c032fa0 con 0x7fbf0c045c80 2024-09-13T15:13:39.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.479+0000 7fbf07e00640 1 -- 172.21.15.7:0/3706501792 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbf140681b0 con 0x7fbf0c045c80 2024-09-13T15:13:39.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.479+0000 7fbf07e00640 1 --2- 172.21.15.7:0/3706501792 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbef40666c0 0x7fbef4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:39.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.483+0000 7fbf07e00640 1 -- 172.21.15.7:0/3706501792 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fbf1406f070 con 0x7fbf0c045c80 2024-09-13T15:13:39.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.483+0000 7fbf13400640 1 --2- 172.21.15.7:0/3706501792 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbef40666c0 0x7fbef4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:39.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.487+0000 7fbf07e00640 1 -- 172.21.15.7:0/3706501792 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbf140cfdf0 con 0x7fbf0c045c80 2024-09-13T15:13:39.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:39.503+0000 7fbf13400640 1 --2- 172.21.15.7:0/3706501792 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbef40666c0 0x7fbef4068b80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbf000b2000 tx=0x7fbf00004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:40.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:40.011+0000 7fbf19600640 1 -- 172.21.15.7:0/3706501792 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf0c04ae80 con 0x7fbf0c045c80 2024-09-13T15:13:40.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:40.019+0000 7fbf07e00640 1 -- 172.21.15.7:0/3706501792 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5527 (secure 0 0 0) 0x7fbf140cf980 con 0x7fbf0c045c80 2024-09-13T15:13:40.022 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:40.022 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:13:27.796181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:40.023 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 47 2024-09-13T15:13:40.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:40.027+0000 7fbf19600640 1 -- 172.21.15.7:0/3706501792 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbef40666c0 msgr2=0x7fbef4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:40.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:40.027+0000 7fbf19600640 1 --2- 172.21.15.7:0/3706501792 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbef40666c0 0x7fbef4068b80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbf000b2000 tx=0x7fbf00004740 comp rx=0 tx=0).stop 2024-09-13T15:13:40.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:40.027+0000 7fbf19600640 1 -- 172.21.15.7:0/3706501792 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf0c045c80 msgr2=0x7fbf0c16fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:40.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:40.027+0000 7fbf19600640 1 --2- 172.21.15.7:0/3706501792 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf0c045c80 0x7fbf0c16fa40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbf140677e0 tx=0x7fbf14067500 comp rx=0 tx=0).stop 2024-09-13T15:13:40.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:40.027+0000 7fbf19600640 1 -- 172.21.15.7:0/3706501792 shutdown_connections 2024-09-13T15:13:40.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:40.027+0000 7fbf19600640 1 --2- 172.21.15.7:0/3706501792 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fbef40666c0 0x7fbef4068b80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:40.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:40.027+0000 7fbf19600640 1 --2- 172.21.15.7:0/3706501792 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf0c0dcd60 0x7fbf0c0d2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:40.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:40.027+0000 7fbf19600640 1 --2- 172.21.15.7:0/3706501792 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbf0c046090 0x7fbf0c16ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:40.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:40.027+0000 7fbf19600640 1 --2- 172.21.15.7:0/3706501792 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fbf0c045c80 0x7fbf0c16fa40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:40.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:40.027+0000 7fbf19600640 1 -- 172.21.15.7:0/3706501792 >> 172.21.15.7:0/3706501792 conn(0x7fbf0c04fc30 msgr2=0x7fbf0c04da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:40.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:40.027+0000 7fbf19600640 1 -- 172.21.15.7:0/3706501792 shutdown_connections 2024-09-13T15:13:40.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:40.031+0000 7fbf19600640 1 -- 172.21.15.7:0/3706501792 wait complete. 2024-09-13T15:13:40.114 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:13:42.115 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:42.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.375+0000 7fa96ec00640 1 Processor -- start 2024-09-13T15:13:42.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.375+0000 7fa96ec00640 1 -- start start 2024-09-13T15:13:42.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.375+0000 7fa96ec00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa9680c77f0 0x7fa9680c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:42.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.375+0000 7fa96ec00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9680c7bd0 0x7fa968158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:42.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.379+0000 7fa967400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9680c7bd0 0x7fa968158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:42.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.379+0000 7fa96cc00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa9680c08a0 0x7fa96814edb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:54830/0 (socket says 172.21.15.7:54830) 2024-09-13T15:13:42.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.379+0000 7fa967e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa9680c77f0 0x7fa9680c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:42.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.379+0000 7fa96cc00640 1 -- 172.21.15.7:0/3541219460 learned_addr learned my addr 172.21.15.7:0/3541219460 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:13:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.379+0000 7fa96ec00640 1 -- 172.21.15.7:0/3541219460 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa968158720 con 0x7fa9680c08a0 2024-09-13T15:13:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.379+0000 7fa96ec00640 1 -- 172.21.15.7:0/3541219460 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa968155130 con 0x7fa9680c77f0 2024-09-13T15:13:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.379+0000 7fa96ec00640 1 -- 172.21.15.7:0/3541219460 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa968155320 con 0x7fa9680c7bd0 2024-09-13T15:13:42.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.379+0000 7fa966a00640 1 -- 172.21.15.7:0/3541219460 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206533830 0 0) 0x7fa968158720 con 0x7fa9680c08a0 2024-09-13T15:13:42.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.379+0000 7fa966a00640 1 -- 172.21.15.7:0/3541219460 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa94c003530 con 0x7fa9680c08a0 2024-09-13T15:13:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.383+0000 7fa967400640 1 -- 172.21.15.7:0/3541219460 >> v2:172.21.15.77:3300/0 conn(0x7fa9680c77f0 msgr2=0x7fa9680c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.383+0000 7fa967400640 1 --2- 172.21.15.7:0/3541219460 >> v2:172.21.15.77:3300/0 conn(0x7fa9680c77f0 0x7fa9680c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.383+0000 7fa967400640 1 -- 172.21.15.7:0/3541219460 >> v1:172.21.15.77:6789/0 conn(0x7fa9680c08a0 legacy=0x7fa96814edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.383+0000 7fa967400640 1 -- 172.21.15.7:0/3541219460 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9681555e0 con 0x7fa9680c7bd0 2024-09-13T15:13:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.399+0000 7fa967400640 1 --2- 172.21.15.7:0/3541219460 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9680c7bd0 0x7fa968158bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa958009d90 tx=0x7fa95801c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c918b4acc59bde20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.399+0000 7fa966a00640 1 -- 172.21.15.7:0/3541219460 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9580a5a00 con 0x7fa9680c7bd0 2024-09-13T15:13:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.399+0000 7fa966a00640 1 -- 172.21.15.7:0/3541219460 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9580a5b60 con 0x7fa9680c7bd0 2024-09-13T15:13:42.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.399+0000 7fa966a00640 1 -- 172.21.15.7:0/3541219460 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9580ad440 con 0x7fa9680c7bd0 2024-09-13T15:13:42.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.403+0000 7fa96ec00640 1 -- 172.21.15.7:0/3541219460 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9680c7bd0 msgr2=0x7fa968158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:42.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.403+0000 7fa96ec00640 1 --2- 172.21.15.7:0/3541219460 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9680c7bd0 0x7fa968158bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa958009d90 tx=0x7fa95801c960 comp rx=0 tx=0).stop 2024-09-13T15:13:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.407+0000 7fa96ec00640 1 -- 172.21.15.7:0/3541219460 shutdown_connections 2024-09-13T15:13:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.407+0000 7fa96ec00640 1 --2- 172.21.15.7:0/3541219460 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9680c7bd0 0x7fa968158bb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.407+0000 7fa96ec00640 1 --2- 172.21.15.7:0/3541219460 >> v2:172.21.15.77:3300/0 conn(0x7fa9680c77f0 0x7fa9680c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.407+0000 7fa96ec00640 1 -- 172.21.15.7:0/3541219460 >> 172.21.15.7:0/3541219460 conn(0x7fa968065d40 msgr2=0x7fa968066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.407+0000 7fa96ec00640 1 -- 172.21.15.7:0/3541219460 shutdown_connections 2024-09-13T15:13:42.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.407+0000 7fa96ec00640 1 -- 172.21.15.7:0/3541219460 wait complete. 2024-09-13T15:13:42.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.411+0000 7fa96ec00640 1 Processor -- start 2024-09-13T15:13:42.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.411+0000 7fa96ec00640 1 -- start start 2024-09-13T15:13:42.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.411+0000 7fa96ec00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9680c08a0 0x7fa968147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:42.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.415+0000 7fa96ec00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9680c77f0 0x7fa96813c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:42.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.415+0000 7fa967e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9680c08a0 0x7fa968147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.415+0000 7fa967e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9680c08a0 0x7fa968147f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:37418/0 (socket says 172.21.15.7:37418) 2024-09-13T15:13:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.415+0000 7fa96ec00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9680c7bd0 0x7fa9681f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.415+0000 7fa967e00640 1 -- 172.21.15.7:0/3529055949 learned_addr learned my addr 172.21.15.7:0/3529055949 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.415+0000 7fa96ec00640 1 -- 172.21.15.7:0/3529055949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa968147480 con 0x7fa9680c77f0 2024-09-13T15:13:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.415+0000 7fa96ec00640 1 -- 172.21.15.7:0/3529055949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa968157f10 con 0x7fa9680c7bd0 2024-09-13T15:13:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.415+0000 7fa96ec00640 1 -- 172.21.15.7:0/3529055949 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96813cf20 con 0x7fa9680c08a0 2024-09-13T15:13:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.415+0000 7fa96cc00640 1 --2- 172.21.15.7:0/3529055949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9680c7bd0 0x7fa9681f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.415+0000 7fa96cc00640 1 -- 172.21.15.7:0/3529055949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9680c08a0 msgr2=0x7fa968147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.415+0000 7fa96cc00640 1 --2- 172.21.15.7:0/3529055949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9680c08a0 0x7fa968147f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.415+0000 7fa96cc00640 1 -- 172.21.15.7:0/3529055949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9680c77f0 msgr2=0x7fa96813c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:42.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.415+0000 7fa96cc00640 1 --2- 172.21.15.7:0/3529055949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9680c77f0 0x7fa96813c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:42.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.415+0000 7fa96cc00640 1 -- 172.21.15.7:0/3529055949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa958009a70 con 0x7fa9680c7bd0 2024-09-13T15:13:42.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.423+0000 7fa96cc00640 1 --2- 172.21.15.7:0/3529055949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9680c7bd0 0x7fa9681f19c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa96000c3f0 tx=0x7fa96000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:42.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.423+0000 7fa95fe00640 1 -- 172.21.15.7:0/3529055949 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960005cf0 con 0x7fa9680c7bd0 2024-09-13T15:13:42.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.423+0000 7fa95fe00640 1 -- 172.21.15.7:0/3529055949 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa960005e50 con 0x7fa9680c7bd0 2024-09-13T15:13:42.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.423+0000 7fa95fe00640 1 -- 172.21.15.7:0/3529055949 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9600072d0 con 0x7fa9680c7bd0 2024-09-13T15:13:42.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.423+0000 7fa96ec00640 1 -- 172.21.15.7:0/3529055949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa968158100 con 0x7fa9680c7bd0 2024-09-13T15:13:42.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.423+0000 7fa96ec00640 1 -- 172.21.15.7:0/3529055949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa968148bc0 con 0x7fa9680c7bd0 2024-09-13T15:13:42.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.427+0000 7fa95fe00640 1 -- 172.21.15.7:0/3529055949 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa960007430 con 0x7fa9680c7bd0 2024-09-13T15:13:42.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.427+0000 7fa96ec00640 1 -- 172.21.15.7:0/3529055949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa968067650 con 0x7fa9680c7bd0 2024-09-13T15:13:42.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.431+0000 7fa95fe00640 1 --2- 172.21.15.7:0/3529055949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa944066760 0x7fa944068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:42.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.431+0000 7fa967e00640 1 --2- 172.21.15.7:0/3529055949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa944066760 0x7fa944068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:42.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.431+0000 7fa95fe00640 1 -- 172.21.15.7:0/3529055949 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fa960083b10 con 0x7fa9680c7bd0 2024-09-13T15:13:42.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.431+0000 7fa967e00640 1 --2- 172.21.15.7:0/3529055949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa944066760 0x7fa944068c20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa95000d440 tx=0x7fa950008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:42.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.435+0000 7fa95fe00640 1 -- 172.21.15.7:0/3529055949 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa960050a30 con 0x7fa9680c7bd0 2024-09-13T15:13:42.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.851+0000 7fa96ec00640 1 -- 172.21.15.7:0/3529055949 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9680c5cc0 con 0x7fa9680c7bd0 2024-09-13T15:13:42.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.855+0000 7fa95fe00640 1 -- 172.21.15.7:0/3529055949 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5527 (secure 0 0 0) 0x7fa960054050 con 0x7fa9680c7bd0 2024-09-13T15:13:42.860 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:42.860 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:13:27.796181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:42.860 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 47 2024-09-13T15:13:42.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.859+0000 7fa96ec00640 1 -- 172.21.15.7:0/3529055949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa944066760 msgr2=0x7fa944068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:42.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.859+0000 7fa96ec00640 1 --2- 172.21.15.7:0/3529055949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa944066760 0x7fa944068c20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa95000d440 tx=0x7fa950008040 comp rx=0 tx=0).stop 2024-09-13T15:13:42.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.859+0000 7fa96ec00640 1 -- 172.21.15.7:0/3529055949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9680c7bd0 msgr2=0x7fa9681f19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:42.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.859+0000 7fa96ec00640 1 --2- 172.21.15.7:0/3529055949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9680c7bd0 0x7fa9681f19c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa96000c3f0 tx=0x7fa96000c8b0 comp rx=0 tx=0).stop 2024-09-13T15:13:42.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.871+0000 7fa96ec00640 1 -- 172.21.15.7:0/3529055949 shutdown_connections 2024-09-13T15:13:42.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.871+0000 7fa96ec00640 1 --2- 172.21.15.7:0/3529055949 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa944066760 0x7fa944068c20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:42.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.871+0000 7fa96ec00640 1 --2- 172.21.15.7:0/3529055949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa9680c7bd0 0x7fa9681f19c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:42.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.871+0000 7fa96ec00640 1 --2- 172.21.15.7:0/3529055949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9680c77f0 0x7fa96813c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:42.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.871+0000 7fa96ec00640 1 --2- 172.21.15.7:0/3529055949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa9680c08a0 0x7fa968147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:42.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.871+0000 7fa96ec00640 1 -- 172.21.15.7:0/3529055949 >> 172.21.15.7:0/3529055949 conn(0x7fa968065d40 msgr2=0x7fa968070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:42.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.879+0000 7fa96ec00640 1 -- 172.21.15.7:0/3529055949 shutdown_connections 2024-09-13T15:13:42.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:42.883+0000 7fa96ec00640 1 -- 172.21.15.7:0/3529055949 wait complete. 2024-09-13T15:13:42.940 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:13:44.941 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:45.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.291+0000 7f93b3000640 1 Processor -- start 2024-09-13T15:13:45.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.291+0000 7f93b3000640 1 -- start start 2024-09-13T15:13:45.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.295+0000 7f93b3000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f93ac0c7660 0x7f93ac06d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:45.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.295+0000 7f93b3000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ac0c7a40 0x7f93ac06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:45.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.295+0000 7f93b2600640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f93ac157090 0x7f93ac1574e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:54842/0 (socket says 172.21.15.7:54842) 2024-09-13T15:13:45.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.295+0000 7f93b2600640 1 -- 172.21.15.7:0/1302133170 learned_addr learned my addr 172.21.15.7:0/1302133170 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:13:45.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.295+0000 7f93b3000640 1 -- 172.21.15.7:0/1302133170 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93ac06cd70 con 0x7f93ac157090 2024-09-13T15:13:45.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.295+0000 7f93b3000640 1 -- 172.21.15.7:0/1302133170 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ac1608f0 con 0x7f93ac0c7660 2024-09-13T15:13:45.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.295+0000 7f93b3000640 1 -- 172.21.15.7:0/1302133170 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac160b90 con 0x7f93ac0c7a40 2024-09-13T15:13:45.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.299+0000 7f93abe00640 1 -- 172.21.15.7:0/1302133170 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724955118 0 0) 0x7f93ac06cd70 con 0x7f93ac157090 2024-09-13T15:13:45.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.299+0000 7f93abe00640 1 -- 172.21.15.7:0/1302133170 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9394003530 con 0x7f93ac157090 2024-09-13T15:13:45.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.299+0000 7f93abe00640 1 -- 172.21.15.7:0/1302133170 <== mon.1 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4286108525 0 0) 0x7f9394003530 con 0x7f93ac157090 2024-09-13T15:13:45.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.299+0000 7f93abe00640 1 -- 172.21.15.7:0/1302133170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ac0c7a40 msgr2=0x7f93ac06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:45.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.299+0000 7f93abe00640 1 --2- 172.21.15.7:0/1302133170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ac0c7a40 0x7f93ac06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:45.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.299+0000 7f93abe00640 1 -- 172.21.15.7:0/1302133170 >> v2:172.21.15.77:3300/0 conn(0x7f93ac0c7660 msgr2=0x7f93ac06d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:45.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.299+0000 7f93abe00640 1 --2- 172.21.15.7:0/1302133170 >> v2:172.21.15.77:3300/0 conn(0x7f93ac0c7660 0x7f93ac06d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:45.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.299+0000 7f93abe00640 1 -- 172.21.15.7:0/1302133170 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac160e30 con 0x7f93ac157090 2024-09-13T15:13:45.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.299+0000 7f93abe00640 1 -- 172.21.15.7:0/1302133170 <== mon.1 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f93a4001a00 con 0x7f93ac157090 2024-09-13T15:13:45.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.299+0000 7f93abe00640 1 -- 172.21.15.7:0/1302133170 >> v1:172.21.15.77:6789/0 conn(0x7f93ac157090 legacy=0x7f93ac1574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:45.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.299+0000 7f93abe00640 1 --2- 172.21.15.7:0/1302133170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9394003980 0x7f9394003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:45.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.299+0000 7f93abe00640 1 --2- 172.21.15.7:0/1302133170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93940047d0 0x7f9394004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:45.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.299+0000 7f93abe00640 1 --2- 172.21.15.7:0/1302133170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93940051e0 0x7f939400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:45.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.299+0000 7f93abe00640 1 -- 172.21.15.7:0/1302133170 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac1608f0 con 0x7f93940051e0 2024-09-13T15:13:45.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.299+0000 7f93abe00640 1 -- 172.21.15.7:0/1302133170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac160b90 con 0x7f9394003980 2024-09-13T15:13:45.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.299+0000 7f93abe00640 1 -- 172.21.15.7:0/1302133170 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939400c190 con 0x7f93940047d0 2024-09-13T15:13:45.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.299+0000 7f93b2600640 1 --2- 172.21.15.7:0/1302133170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93940051e0 0x7f939400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:45.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.303+0000 7f93b1c00640 1 --2- 172.21.15.7:0/1302133170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9394003980 0x7f9394003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:45.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.303+0000 7f93b1200640 1 --2- 172.21.15.7:0/1302133170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93940047d0 0x7f9394004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:45.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.303+0000 7f93b1200640 1 -- 172.21.15.7:0/1302133170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9394003980 msgr2=0x7f9394003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:45.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.303+0000 7f93b1200640 1 --2- 172.21.15.7:0/1302133170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9394003980 0x7f9394003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:45.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.303+0000 7f93b1200640 1 -- 172.21.15.7:0/1302133170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93940051e0 msgr2=0x7f939400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:45.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.303+0000 7f93b1200640 1 --2- 172.21.15.7:0/1302133170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93940051e0 0x7f939400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:45.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.303+0000 7f93b1200640 1 -- 172.21.15.7:0/1302133170 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac160e30 con 0x7f93940047d0 2024-09-13T15:13:45.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.315+0000 7f93b1200640 1 --2- 172.21.15.7:0/1302133170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93940047d0 0x7f9394004c50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0c7e20 tx=0x7f939c01c240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13ed5a53b7d56e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:45.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.315+0000 7f93abe00640 1 -- 172.21.15.7:0/1302133170 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c0ab600 con 0x7f93940047d0 2024-09-13T15:13:45.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.315+0000 7f93abe00640 1 -- 172.21.15.7:0/1302133170 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c0a7050 con 0x7f93940047d0 2024-09-13T15:13:45.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.315+0000 7f93abe00640 1 -- 172.21.15.7:0/1302133170 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c0aba20 con 0x7f93940047d0 2024-09-13T15:13:45.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.315+0000 7f93b3000640 1 -- 172.21.15.7:0/1302133170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93940047d0 msgr2=0x7f9394004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:45.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.315+0000 7f93b3000640 1 --2- 172.21.15.7:0/1302133170 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93940047d0 0x7f9394004c50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0c7e20 tx=0x7f939c01c240 comp rx=0 tx=0).stop 2024-09-13T15:13:45.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.315+0000 7f93b2600640 1 -- 172.21.15.7:0/1302133170 reap_dead start 2024-09-13T15:13:45.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.315+0000 7f93b3000640 1 -- 172.21.15.7:0/1302133170 shutdown_connections 2024-09-13T15:13:45.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.315+0000 7f93b3000640 1 -- 172.21.15.7:0/1302133170 >> 172.21.15.7:0/1302133170 conn(0x7f93ac065d40 msgr2=0x7f93ac066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:45.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.319+0000 7f93b3000640 1 -- 172.21.15.7:0/1302133170 shutdown_connections 2024-09-13T15:13:45.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.319+0000 7f93b3000640 1 -- 172.21.15.7:0/1302133170 wait complete. 2024-09-13T15:13:45.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.319+0000 7f93b3000640 1 Processor -- start 2024-09-13T15:13:45.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.323+0000 7f93b3000640 1 -- start start 2024-09-13T15:13:45.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.323+0000 7f93b3000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93ac154d80 0x7f93ac0c9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:45.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.323+0000 7f93b3000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ac155160 0x7f93ac0c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:45.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.323+0000 7f93b3000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ac14f760 0x7f93ac1fe790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:45.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.323+0000 7f93b3000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0c4e60 con 0x7f93ac154d80 2024-09-13T15:13:45.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.323+0000 7f93b3000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0c8910 con 0x7f93ac14f760 2024-09-13T15:13:45.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.323+0000 7f93b3000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ac0c8bb0 con 0x7f93ac155160 2024-09-13T15:13:45.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.323+0000 7f93b1200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ac155160 0x7f93ac0c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:45.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.323+0000 7f93b1200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ac155160 0x7f93ac0c9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:37440/0 (socket says 172.21.15.7:37440) 2024-09-13T15:13:45.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.327+0000 7f93b1200640 1 -- 172.21.15.7:0/2463231254 learned_addr learned my addr 172.21.15.7:0/2463231254 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:45.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.327+0000 7f93b1c00640 1 --2- 172.21.15.7:0/2463231254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93ac154d80 0x7f93ac0c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:45.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.327+0000 7f93b2600640 1 --2- 172.21.15.7:0/2463231254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ac14f760 0x7f93ac1fe790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:45.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.331+0000 7f93b2600640 1 -- 172.21.15.7:0/2463231254 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ac155160 msgr2=0x7f93ac0c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:45.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.331+0000 7f93b2600640 1 --2- 172.21.15.7:0/2463231254 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ac155160 0x7f93ac0c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:45.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.331+0000 7f93b2600640 1 -- 172.21.15.7:0/2463231254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93ac154d80 msgr2=0x7f93ac0c9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:45.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.331+0000 7f93b2600640 1 --2- 172.21.15.7:0/2463231254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93ac154d80 0x7f93ac0c9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:45.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.331+0000 7f93b2600640 1 -- 172.21.15.7:0/2463231254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ac0c8e90 con 0x7f93ac14f760 2024-09-13T15:13:45.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.331+0000 7f93b2600640 1 --2- 172.21.15.7:0/2463231254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ac14f760 0x7f93ac1fe790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0c8840 tx=0x7f93a400e5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:45.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.331+0000 7f93a9600640 1 -- 172.21.15.7:0/2463231254 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a4013420 con 0x7f93ac14f760 2024-09-13T15:13:45.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.331+0000 7f93a9600640 1 -- 172.21.15.7:0/2463231254 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a4013580 con 0x7f93ac14f760 2024-09-13T15:13:45.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.331+0000 7f93b3000640 1 -- 172.21.15.7:0/2463231254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ac0c9170 con 0x7f93ac14f760 2024-09-13T15:13:45.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.335+0000 7f93a9600640 1 -- 172.21.15.7:0/2463231254 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a40138f0 con 0x7f93ac14f760 2024-09-13T15:13:45.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.335+0000 7f93b3000640 1 -- 172.21.15.7:0/2463231254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ac0c4b20 con 0x7f93ac14f760 2024-09-13T15:13:45.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.335+0000 7f93a9600640 1 -- 172.21.15.7:0/2463231254 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f93a4013a50 con 0x7f93ac14f760 2024-09-13T15:13:45.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.339+0000 7f93a9600640 1 --2- 172.21.15.7:0/2463231254 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9390066760 0x7f9390068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:45.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.339+0000 7f93a9600640 1 -- 172.21.15.7:0/2463231254 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f93a4084d60 con 0x7f93ac14f760 2024-09-13T15:13:45.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.339+0000 7f93b3000640 1 -- 172.21.15.7:0/2463231254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ac0c8cf0 con 0x7f93ac14f760 2024-09-13T15:13:45.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.339+0000 7f93b1c00640 1 --2- 172.21.15.7:0/2463231254 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9390066760 0x7f9390068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:45.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.339+0000 7f93b1c00640 1 --2- 172.21.15.7:0/2463231254 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9390066760 0x7f9390068c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f93a0004710 tx=0x7f93a0009060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:45.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.343+0000 7f93a9600640 1 -- 172.21.15.7:0/2463231254 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f93ac0c8cf0 con 0x7f93ac14f760 2024-09-13T15:13:45.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.839+0000 7f93b3000640 1 -- 172.21.15.7:0/2463231254 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93ac0c8cf0 con 0x7f93ac14f760 2024-09-13T15:13:45.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.839+0000 7f93a9600640 1 -- 172.21.15.7:0/2463231254 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5527 (secure 0 0 0) 0x7f93ac0c8cf0 con 0x7f93ac14f760 2024-09-13T15:13:45.845 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:45.845 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:13:27.796181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:45.846 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 47 2024-09-13T15:13:45.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.851+0000 7f93b3000640 1 -- 172.21.15.7:0/2463231254 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9390066760 msgr2=0x7f9390068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:45.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.851+0000 7f93b3000640 1 --2- 172.21.15.7:0/2463231254 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9390066760 0x7f9390068c20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f93a0004710 tx=0x7f93a0009060 comp rx=0 tx=0).stop 2024-09-13T15:13:45.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.851+0000 7f93b3000640 1 -- 172.21.15.7:0/2463231254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ac14f760 msgr2=0x7f93ac1fe790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:45.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.851+0000 7f93b3000640 1 --2- 172.21.15.7:0/2463231254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ac14f760 0x7f93ac1fe790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f93ac0c8840 tx=0x7f93a400e5b0 comp rx=0 tx=0).stop 2024-09-13T15:13:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.855+0000 7f93b3000640 1 -- 172.21.15.7:0/2463231254 shutdown_connections 2024-09-13T15:13:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.855+0000 7f93b3000640 1 --2- 172.21.15.7:0/2463231254 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9390066760 0x7f9390068c20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.855+0000 7f93b3000640 1 --2- 172.21.15.7:0/2463231254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93ac14f760 0x7f93ac1fe790 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.855+0000 7f93b3000640 1 --2- 172.21.15.7:0/2463231254 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93ac155160 0x7f93ac0c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.855+0000 7f93b3000640 1 --2- 172.21.15.7:0/2463231254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93ac154d80 0x7f93ac0c9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:45.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.855+0000 7f93b3000640 1 -- 172.21.15.7:0/2463231254 >> 172.21.15.7:0/2463231254 conn(0x7f93ac065d40 msgr2=0x7f93ac15f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:45.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.855+0000 7f93b3000640 1 -- 172.21.15.7:0/2463231254 shutdown_connections 2024-09-13T15:13:45.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:45.855+0000 7f93b3000640 1 -- 172.21.15.7:0/2463231254 wait complete. 2024-09-13T15:13:45.894 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 47, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-13T15:01:44.789559+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 47, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3 ], "info": { "gid_4276": { "addr": "172.21.15.7:6836/2396967179", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6834", "nonce": 2396967179, "type": "v2" }, { "addr": "172.21.15.7:6836", "nonce": 2396967179, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4276, "incarnation": 4, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_5069": { "addr": "172.21.15.77:6838/877425259", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6836", "nonce": 877425259, "type": "v2" }, { "addr": "172.21.15.77:6838", "nonce": 877425259, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5069, "incarnation": 31, "join_fscid": -1, "name": "b", "rank": 3, "state": "up:active", "state_seq": 43 }, "gid_5198": { "addr": "172.21.15.7:6833/1355774527", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6832", "nonce": 1355774527, "type": "v2" }, { "addr": "172.21.15.7:6833", "nonce": 1355774527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5198, "incarnation": 41, "join_fscid": -1, "name": "e", "rank": 2, "state": "up:active", "state_seq": 14 }, "gid_5569": { "addr": "172.21.15.77:6835/1536067351", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6834", "nonce": 1536067351, "type": "v2" }, { "addr": "172.21.15.77:6835", "nonce": 1536067351, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5569, "incarnation": 47, "join_fscid": -1, "name": "d", "rank": 1, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 4, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-13T15:13:27.796181+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [ 4 ], "tableserver": 0, "up": { "mds_0": 4276, "mds_1": 5569, "mds_2": 5198, "mds_3": 5069 } } } ], "standbys": [ { "addr": "172.21.15.7:6837/3708232086", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6835", "nonce": 3708232086, "type": "v2" }, { "addr": "172.21.15.7:6837", "nonce": 3708232086, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 36, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5156, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-13T15:13:47.897 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:48.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.175+0000 7f98c3600640 1 Processor -- start 2024-09-13T15:13:48.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.175+0000 7f98c3600640 1 -- start start 2024-09-13T15:13:48.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.175+0000 7f98c3600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98bc0c5ab0 0x7f98bc06cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:48.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.175+0000 7f98c3600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f98bc0c5e90 0x7f98bc0c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:48.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.175+0000 7f98c3600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98bc161ab0 con 0x7f98bc0c6890 2024-09-13T15:13:48.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.175+0000 7f98c3600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98bc160f80 con 0x7f98bc0c5e90 2024-09-13T15:13:48.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.175+0000 7f98c3600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc06dbc0 con 0x7f98bc0c5ab0 2024-09-13T15:13:48.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.175+0000 7f98c0c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98bc0c5ab0 0x7f98bc06cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:48.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.175+0000 7f98bbe00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f98bc0c6890 0x7f98bc1613a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:54850/0 (socket says 172.21.15.7:54850) 2024-09-13T15:13:48.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.175+0000 7f98bbe00640 1 -- 172.21.15.7:0/3734614161 learned_addr learned my addr 172.21.15.7:0/3734614161 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:13:48.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.179+0000 7f98c1600640 1 --2- 172.21.15.7:0/3734614161 >> v2:172.21.15.7:3300/0 conn(0x7f98bc0c5e90 0x7f98bc0c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:48.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.179+0000 7f98c1600640 1 -- 172.21.15.7:0/3734614161 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98bc0c5ab0 msgr2=0x7f98bc06cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:48.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.179+0000 7f98c1600640 1 --2- 172.21.15.7:0/3734614161 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98bc0c5ab0 0x7f98bc06cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:48.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.179+0000 7f98c1600640 1 -- 172.21.15.7:0/3734614161 >> v1:172.21.15.77:6789/0 conn(0x7f98bc0c6890 legacy=0x7f98bc1613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:48.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.179+0000 7f98c1600640 1 -- 172.21.15.7:0/3734614161 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98bc06d320 con 0x7f98bc0c5e90 2024-09-13T15:13:48.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.179+0000 7f98bb400640 1 -- 172.21.15.7:0/3734614161 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000519500 0 0) 0x7f98b0001120 con 0x7f98bc0c6890 2024-09-13T15:13:48.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.183+0000 7f98c1600640 1 --2- 172.21.15.7:0/3734614161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98bc0c5e90 0x7f98bc0c6ea0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f98b4009d90 tx=0x7f98b401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2623611322401b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:48.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.183+0000 7f98bb400640 1 -- 172.21.15.7:0/3734614161 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b40af600 con 0x7f98bc0c5e90 2024-09-13T15:13:48.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.183+0000 7f98bb400640 1 -- 172.21.15.7:0/3734614161 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b40ab050 con 0x7f98bc0c5e90 2024-09-13T15:13:48.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.183+0000 7f98bb400640 1 -- 172.21.15.7:0/3734614161 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b40af980 con 0x7f98bc0c5e90 2024-09-13T15:13:48.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.183+0000 7f98c3600640 1 -- 172.21.15.7:0/3734614161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98bc0c5e90 msgr2=0x7f98bc0c6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:48.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.183+0000 7f98c3600640 1 --2- 172.21.15.7:0/3734614161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98bc0c5e90 0x7f98bc0c6ea0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f98b4009d90 tx=0x7f98b401f150 comp rx=0 tx=0).stop 2024-09-13T15:13:48.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.187+0000 7f98c3600640 1 -- 172.21.15.7:0/3734614161 shutdown_connections 2024-09-13T15:13:48.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.187+0000 7f98c3600640 1 --2- 172.21.15.7:0/3734614161 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98bc0c5e90 0x7f98bc0c6ea0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:48.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.187+0000 7f98c3600640 1 --2- 172.21.15.7:0/3734614161 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98bc0c5ab0 0x7f98bc06cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:48.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.187+0000 7f98c3600640 1 -- 172.21.15.7:0/3734614161 >> 172.21.15.7:0/3734614161 conn(0x7f98bc065d40 msgr2=0x7f98bc066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:48.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.187+0000 7f98c3600640 1 -- 172.21.15.7:0/3734614161 shutdown_connections 2024-09-13T15:13:48.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.187+0000 7f98c3600640 1 -- 172.21.15.7:0/3734614161 wait complete. 2024-09-13T15:13:48.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.187+0000 7f98c3600640 1 Processor -- start 2024-09-13T15:13:48.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.187+0000 7f98c3600640 1 -- start start 2024-09-13T15:13:48.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98c3600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98bc0c5ab0 0x7f98bc1588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:48.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98c3600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98bc0c5e90 0x7f98bc158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:48.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98c3600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98bc0c6890 0x7f98bc14c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:48.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98c3600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc15a5c0 con 0x7f98bc0c5ab0 2024-09-13T15:13:48.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98c3600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc158460 con 0x7f98bc0c6890 2024-09-13T15:13:48.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98c3600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc159370 con 0x7f98bc0c5e90 2024-09-13T15:13:48.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98bbe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98bc0c5e90 0x7f98bc158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:48.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98c0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98bc0c5ab0 0x7f98bc1588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:48.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98bbe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98bc0c5e90 0x7f98bc158e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:37458/0 (socket says 172.21.15.7:37458) 2024-09-13T15:13:48.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98bbe00640 1 -- 172.21.15.7:0/134129388 learned_addr learned my addr 172.21.15.7:0/134129388 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:48.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98c1600640 1 --2- 172.21.15.7:0/134129388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98bc0c6890 0x7f98bc14c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:48.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98c1600640 1 -- 172.21.15.7:0/134129388 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98bc0c5e90 msgr2=0x7f98bc158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:48.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98c1600640 1 --2- 172.21.15.7:0/134129388 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98bc0c5e90 0x7f98bc158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:48.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98c1600640 1 -- 172.21.15.7:0/134129388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98bc0c5ab0 msgr2=0x7f98bc1588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:48.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98c1600640 1 --2- 172.21.15.7:0/134129388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98bc0c5ab0 0x7f98bc1588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:48.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98c1600640 1 -- 172.21.15.7:0/134129388 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b4009a70 con 0x7f98bc0c6890 2024-09-13T15:13:48.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98c0c00640 1 --2- 172.21.15.7:0/134129388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98bc0c5ab0 0x7f98bc1588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:13:48.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.191+0000 7f98c1600640 1 --2- 172.21.15.7:0/134129388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98bc0c6890 0x7f98bc14c530 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f98b40af000 tx=0x7f98b401bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:48.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.195+0000 7f98b8c00640 1 -- 172.21.15.7:0/134129388 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b40b9410 con 0x7f98bc0c6890 2024-09-13T15:13:48.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.195+0000 7f98b8c00640 1 -- 172.21.15.7:0/134129388 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b40b9570 con 0x7f98bc0c6890 2024-09-13T15:13:48.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.195+0000 7f98b8c00640 1 -- 172.21.15.7:0/134129388 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b40b98e0 con 0x7f98bc0c6890 2024-09-13T15:13:48.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.195+0000 7f98c3600640 1 -- 172.21.15.7:0/134129388 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98bc158130 con 0x7f98bc0c6890 2024-09-13T15:13:48.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.195+0000 7f98c3600640 1 -- 172.21.15.7:0/134129388 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98bc15a940 con 0x7f98bc0c6890 2024-09-13T15:13:48.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.195+0000 7f98c3600640 1 -- 172.21.15.7:0/134129388 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98bc067650 con 0x7f98bc0c6890 2024-09-13T15:13:48.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.199+0000 7f98b8c00640 1 -- 172.21.15.7:0/134129388 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f98b40b6050 con 0x7f98bc0c6890 2024-09-13T15:13:48.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.203+0000 7f98b8c00640 1 --2- 172.21.15.7:0/134129388 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f989c066760 0x7f989c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:48.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.203+0000 7f98b8c00640 1 -- 172.21.15.7:0/134129388 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f98b4122d20 con 0x7f98bc0c6890 2024-09-13T15:13:48.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.211+0000 7f98c0c00640 1 --2- 172.21.15.7:0/134129388 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f989c066760 0x7f989c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:48.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.211+0000 7f98c0c00640 1 --2- 172.21.15.7:0/134129388 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f989c066760 0x7f989c068c20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f98a8009f50 tx=0x7f98a8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:48.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.215+0000 7f98b8c00640 1 -- 172.21.15.7:0/134129388 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f98b40efc40 con 0x7f98bc0c6890 2024-09-13T15:13:48.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.647+0000 7f98c3600640 1 -- 172.21.15.7:0/134129388 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98bc158610 con 0x7f98bc0c6890 2024-09-13T15:13:48.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.651+0000 7f98b8c00640 1 -- 172.21.15.7:0/134129388 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5527 (secure 0 0 0) 0x7f98bc158610 con 0x7f98bc0c6890 2024-09-13T15:13:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:48.653 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:13:27.796181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:48.653 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 47 2024-09-13T15:13:48.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.655+0000 7f98c3600640 1 -- 172.21.15.7:0/134129388 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f989c066760 msgr2=0x7f989c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:48.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.655+0000 7f98c3600640 1 --2- 172.21.15.7:0/134129388 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f989c066760 0x7f989c068c20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f98a8009f50 tx=0x7f98a8009190 comp rx=0 tx=0).stop 2024-09-13T15:13:48.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.655+0000 7f98c3600640 1 -- 172.21.15.7:0/134129388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98bc0c6890 msgr2=0x7f98bc14c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:48.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.655+0000 7f98c3600640 1 --2- 172.21.15.7:0/134129388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98bc0c6890 0x7f98bc14c530 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f98b40af000 tx=0x7f98b401bef0 comp rx=0 tx=0).stop 2024-09-13T15:13:48.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.655+0000 7f98c3600640 1 -- 172.21.15.7:0/134129388 shutdown_connections 2024-09-13T15:13:48.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.655+0000 7f98c3600640 1 --2- 172.21.15.7:0/134129388 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f989c066760 0x7f989c068c20 secure :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f98a8009f50 tx=0x7f98a8009190 comp rx=0 tx=0).stop 2024-09-13T15:13:48.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.655+0000 7f98c3600640 1 --2- 172.21.15.7:0/134129388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98bc0c6890 0x7f98bc14c530 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:48.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.655+0000 7f98c3600640 1 --2- 172.21.15.7:0/134129388 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f98bc0c5e90 0x7f98bc158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:48.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.655+0000 7f98c3600640 1 --2- 172.21.15.7:0/134129388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98bc0c5ab0 0x7f98bc1588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:48.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.655+0000 7f98c3600640 1 -- 172.21.15.7:0/134129388 >> 172.21.15.7:0/134129388 conn(0x7f98bc065d40 msgr2=0x7f98bc0b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.663+0000 7f98c3600640 1 -- 172.21.15.7:0/134129388 shutdown_connections 2024-09-13T15:13:48.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:48.663+0000 7f98c3600640 1 -- 172.21.15.7:0/134129388 wait complete. 2024-09-13T15:13:48.719 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:13:50.720 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:50.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.975+0000 7f4c01800640 1 Processor -- start 2024-09-13T15:13:50.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.975+0000 7f4c01800640 1 -- start start 2024-09-13T15:13:50.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.979+0000 7f4c01800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4bfc0c5ab0 0x7f4bfc06cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:50.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.979+0000 7f4c01800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bfc0c6890 0x7f4bfc0c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:50.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.979+0000 7f4c01800640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bfc161ab0 con 0x7f4bfc0c5e90 2024-09-13T15:13:50.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.979+0000 7f4c01800640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bfc160f80 con 0x7f4bfc0c5ab0 2024-09-13T15:13:50.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.979+0000 7f4c01800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc06dbc0 con 0x7f4bfc0c6890 2024-09-13T15:13:50.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.979+0000 7f4bfaa00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4bfc0c5ab0 0x7f4bfc06cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:50.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.979+0000 7f4bfaa00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4bfc0c5ab0 0x7f4bfc06cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:60038/0 (socket says 172.21.15.7:60038) 2024-09-13T15:13:50.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.979+0000 7f4bfaa00640 1 -- 172.21.15.7:0/3590677572 learned_addr learned my addr 172.21.15.7:0/3590677572 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:50.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.979+0000 7f4bfa000640 1 --2- 172.21.15.7:0/3590677572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bfc0c6890 0x7f4bfc0c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:50.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.983+0000 7f4bfaa00640 1 -- 172.21.15.7:0/3590677572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bfc0c6890 msgr2=0x7f4bfc0c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:50.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.983+0000 7f4bfaa00640 1 --2- 172.21.15.7:0/3590677572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bfc0c6890 0x7f4bfc0c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:50.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.983+0000 7f4bfaa00640 1 -- 172.21.15.7:0/3590677572 >> v1:172.21.15.77:6789/0 conn(0x7f4bfc0c5e90 legacy=0x7f4bfc1613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:50.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.983+0000 7f4bfaa00640 1 -- 172.21.15.7:0/3590677572 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc06d320 con 0x7f4bfc0c5ab0 2024-09-13T15:13:50.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.991+0000 7f4bfaa00640 1 --2- 172.21.15.7:0/3590677572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bfc0c5ab0 0x7f4bfc06cce0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009870 tx=0x7f4bec01ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c817dff48e8437e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:50.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.991+0000 7f4bf9600640 1 -- 172.21.15.7:0/3590677572 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0a89d0 con 0x7f4bfc0c5ab0 2024-09-13T15:13:50.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.995+0000 7f4bf9600640 1 -- 172.21.15.7:0/3590677572 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec0a8b30 con 0x7f4bfc0c5ab0 2024-09-13T15:13:50.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.995+0000 7f4bf9600640 1 -- 172.21.15.7:0/3590677572 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0b0440 con 0x7f4bfc0c5ab0 2024-09-13T15:13:50.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.995+0000 7f4c01800640 1 -- 172.21.15.7:0/3590677572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bfc0c5ab0 msgr2=0x7f4bfc06cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:50.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.995+0000 7f4c01800640 1 --2- 172.21.15.7:0/3590677572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bfc0c5ab0 0x7f4bfc06cce0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4bec009870 tx=0x7f4bec01ed30 comp rx=0 tx=0).stop 2024-09-13T15:13:50.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.999+0000 7f4c01800640 1 -- 172.21.15.7:0/3590677572 shutdown_connections 2024-09-13T15:13:50.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.999+0000 7f4c01800640 1 --2- 172.21.15.7:0/3590677572 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bfc0c6890 0x7f4bfc0c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:50.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.999+0000 7f4c01800640 1 --2- 172.21.15.7:0/3590677572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bfc0c5ab0 0x7f4bfc06cce0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:50.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.999+0000 7f4c01800640 1 -- 172.21.15.7:0/3590677572 >> 172.21.15.7:0/3590677572 conn(0x7f4bfc065d40 msgr2=0x7f4bfc066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:51.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.999+0000 7f4c01800640 1 -- 172.21.15.7:0/3590677572 shutdown_connections 2024-09-13T15:13:51.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.999+0000 7f4c01800640 1 -- 172.21.15.7:0/3590677572 wait complete. 2024-09-13T15:13:51.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.999+0000 7f4c01800640 1 Processor -- start 2024-09-13T15:13:51.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:50.999+0000 7f4c01800640 1 -- start start 2024-09-13T15:13:51.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.003+0000 7f4c01800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bfc0c5ab0 0x7f4bfc153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:51.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4c01800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bfc0c5e90 0x7f4bfc1f6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:51.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4c01800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bfc0c6890 0x7f4bfc0c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:51.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4c01800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc1f7340 con 0x7f4bfc0c6890 2024-09-13T15:13:51.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4c01800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc1f2e80 con 0x7f4bfc0c5e90 2024-09-13T15:13:51.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4c01800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bfc154410 con 0x7f4bfc0c5ab0 2024-09-13T15:13:51.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4bfaa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bfc0c5ab0 0x7f4bfc153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:51.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4bfaa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bfc0c5ab0 0x7f4bfc153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:53804/0 (socket says 172.21.15.7:53804) 2024-09-13T15:13:51.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4bfaa00640 1 -- 172.21.15.7:0/3531960007 learned_addr learned my addr 172.21.15.7:0/3531960007 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:51.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4bfa000640 1 --2- 172.21.15.7:0/3531960007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bfc0c5e90 0x7f4bfc1f6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:51.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4bfaa00640 1 -- 172.21.15.7:0/3531960007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bfc0c5e90 msgr2=0x7f4bfc1f6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:51.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4bfaa00640 1 --2- 172.21.15.7:0/3531960007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bfc0c5e90 0x7f4bfc1f6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:51.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4bfaa00640 1 -- 172.21.15.7:0/3531960007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bfc0c6890 msgr2=0x7f4bfc0c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:51.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4bfaa00640 1 --2- 172.21.15.7:0/3531960007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bfc0c6890 0x7f4bfc0c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:51.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4bfaa00640 1 -- 172.21.15.7:0/3531960007 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec0094d0 con 0x7f4bfc0c5ab0 2024-09-13T15:13:51.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4bfaa00640 1 --2- 172.21.15.7:0/3531960007 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bfc0c5ab0 0x7f4bfc153d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4bec01c960 tx=0x7f4bec01bad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:51.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4bf2a00640 1 -- 172.21.15.7:0/3531960007 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0b1df0 con 0x7f4bfc0c5ab0 2024-09-13T15:13:51.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4bf2a00640 1 -- 172.21.15.7:0/3531960007 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bec0bb470 con 0x7f4bfc0c5ab0 2024-09-13T15:13:51.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4bf2a00640 1 -- 172.21.15.7:0/3531960007 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bec0bb800 con 0x7f4bfc0c5ab0 2024-09-13T15:13:51.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4c01800640 1 -- 172.21.15.7:0/3531960007 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bfc1546f0 con 0x7f4bfc0c5ab0 2024-09-13T15:13:51.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4c01800640 1 -- 172.21.15.7:0/3531960007 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bfc1f33e0 con 0x7f4bfc0c5ab0 2024-09-13T15:13:51.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.007+0000 7f4c01800640 1 -- 172.21.15.7:0/3531960007 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bfc067650 con 0x7f4bfc0c5ab0 2024-09-13T15:13:51.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.011+0000 7f4bf2a00640 1 -- 172.21.15.7:0/3531960007 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4bec0b7070 con 0x7f4bfc0c5ab0 2024-09-13T15:13:51.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.011+0000 7f4bf2a00640 1 --2- 172.21.15.7:0/3531960007 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bdc0666e0 0x7f4bdc068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:51.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.011+0000 7f4bf2a00640 1 -- 172.21.15.7:0/3531960007 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f4bec1226a0 con 0x7f4bfc0c5ab0 2024-09-13T15:13:51.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.015+0000 7f4bfa000640 1 --2- 172.21.15.7:0/3531960007 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bdc0666e0 0x7f4bdc068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:51.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.015+0000 7f4bfa000640 1 --2- 172.21.15.7:0/3531960007 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bdc0666e0 0x7f4bdc068ba0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc154cc0 tx=0x7f4be8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:51.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.019+0000 7f4bf2a00640 1 -- 172.21.15.7:0/3531960007 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4bec0ef3f0 con 0x7f4bfc0c5ab0 2024-09-13T15:13:51.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.415+0000 7f4c01800640 1 -- 172.21.15.7:0/3531960007 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bfc161ab0 con 0x7f4bfc0c5ab0 2024-09-13T15:13:51.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.415+0000 7f4bf2a00640 1 -- 172.21.15.7:0/3531960007 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+5527 (secure 0 0 0) 0x7f4bfc161ab0 con 0x7f4bfc0c5ab0 2024-09-13T15:13:51.422 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:51.422 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:13:27.796181+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:51.422 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 47 2024-09-13T15:13:51.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.419+0000 7f4be7e00640 1 -- 172.21.15.7:0/3531960007 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bdc0666e0 msgr2=0x7f4bdc068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:51.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.419+0000 7f4be7e00640 1 --2- 172.21.15.7:0/3531960007 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bdc0666e0 0x7f4bdc068ba0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc154cc0 tx=0x7f4be8008040 comp rx=0 tx=0).stop 2024-09-13T15:13:51.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.419+0000 7f4be7e00640 1 -- 172.21.15.7:0/3531960007 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bfc0c5ab0 msgr2=0x7f4bfc153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:51.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.419+0000 7f4be7e00640 1 --2- 172.21.15.7:0/3531960007 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bfc0c5ab0 0x7f4bfc153d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4bec01c960 tx=0x7f4bec01bad0 comp rx=0 tx=0).stop 2024-09-13T15:13:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.423+0000 7f4be7e00640 1 -- 172.21.15.7:0/3531960007 shutdown_connections 2024-09-13T15:13:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.423+0000 7f4be7e00640 1 --2- 172.21.15.7:0/3531960007 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bdc0666e0 0x7f4bdc068ba0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.423+0000 7f4be7e00640 1 --2- 172.21.15.7:0/3531960007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bfc0c6890 0x7f4bfc0c3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.423+0000 7f4be7e00640 1 --2- 172.21.15.7:0/3531960007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bfc0c5e90 0x7f4bfc1f6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.423+0000 7f4be7e00640 1 --2- 172.21.15.7:0/3531960007 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bfc0c5ab0 0x7f4bfc153d80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.423+0000 7f4be7e00640 1 -- 172.21.15.7:0/3531960007 >> 172.21.15.7:0/3531960007 conn(0x7f4bfc065d40 msgr2=0x7f4bfc15ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.423+0000 7f4be7e00640 1 -- 172.21.15.7:0/3531960007 shutdown_connections 2024-09-13T15:13:51.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:51.423+0000 7f4be7e00640 1 -- 172.21.15.7:0/3531960007 wait complete. 2024-09-13T15:13:51.465 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:13:53.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:53.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.775+0000 7fe8ca600640 1 Processor -- start 2024-09-13T15:13:53.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.775+0000 7fe8ca600640 1 -- start start 2024-09-13T15:13:53.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.775+0000 7fe8ca600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8c40c08a0 0x7fe8c40c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:53.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.775+0000 7fe8c2a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8c40c08a0 0x7fe8c40c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:53.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.779+0000 7fe8c3400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe8c4066860 0x7fe8c40c5cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:42140/0 (socket says 172.21.15.7:42140) 2024-09-13T15:13:53.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.779+0000 7fe8ca600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c4158720 con 0x7fe8c4066860 2024-09-13T15:13:53.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.779+0000 7fe8ca600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c4155320 con 0x7fe8c4158bb0 2024-09-13T15:13:53.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.779+0000 7fe8ca600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c4155130 con 0x7fe8c40c08a0 2024-09-13T15:13:53.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.779+0000 7fe8c3400640 1 -- 172.21.15.7:0/913520858 learned_addr learned my addr 172.21.15.7:0/913520858 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:13:53.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.779+0000 7fe8c2000640 1 -- 172.21.15.7:0/913520858 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48235402 0 0) 0x7fe8c4155320 con 0x7fe8c4158bb0 2024-09-13T15:13:53.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.779+0000 7fe8c2000640 1 -- 172.21.15.7:0/913520858 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a8003530 con 0x7fe8c4158bb0 2024-09-13T15:13:53.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.779+0000 7fe8c2000640 1 -- 172.21.15.7:0/913520858 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460060478 0 0) 0x7fe8c4158720 con 0x7fe8c4066860 2024-09-13T15:13:53.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.779+0000 7fe8c2000640 1 -- 172.21.15.7:0/913520858 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8c4155320 con 0x7fe8c4066860 2024-09-13T15:13:53.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.779+0000 7fe8c2a00640 1 -- 172.21.15.7:0/913520858 >> v1:172.21.15.77:6789/0 conn(0x7fe8c4158bb0 legacy=0x7fe8c4158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:53.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.779+0000 7fe8c2a00640 1 -- 172.21.15.7:0/913520858 >> v1:172.21.15.7:6789/0 conn(0x7fe8c4066860 legacy=0x7fe8c40c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:53.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.779+0000 7fe8c2a00640 1 -- 172.21.15.7:0/913520858 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c41555e0 con 0x7fe8c40c08a0 2024-09-13T15:13:53.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.783+0000 7fe8c2a00640 1 --2- 172.21.15.7:0/913520858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8c40c08a0 0x7fe8c40c77f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00097f0 tx=0x7fe8b001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4582d6310b6e4b10 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:53.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.783+0000 7fe8c2000640 1 -- 172.21.15.7:0/913520858 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b00ab5f0 con 0x7fe8c40c08a0 2024-09-13T15:13:53.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.783+0000 7fe8c2000640 1 -- 172.21.15.7:0/913520858 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b00ab750 con 0x7fe8c40c08a0 2024-09-13T15:13:53.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.783+0000 7fe8c2000640 1 -- 172.21.15.7:0/913520858 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b00ab5f0 con 0x7fe8c40c08a0 2024-09-13T15:13:53.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.787+0000 7fe8ca600640 1 -- 172.21.15.7:0/913520858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8c40c08a0 msgr2=0x7fe8c40c77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:53.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.787+0000 7fe8ca600640 1 --2- 172.21.15.7:0/913520858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8c40c08a0 0x7fe8c40c77f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00097f0 tx=0x7fe8b001c430 comp rx=0 tx=0).stop 2024-09-13T15:13:53.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.787+0000 7fe8ca600640 1 -- 172.21.15.7:0/913520858 shutdown_connections 2024-09-13T15:13:53.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.787+0000 7fe8ca600640 1 --2- 172.21.15.7:0/913520858 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8c40c08a0 0x7fe8c40c77f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:53.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.787+0000 7fe8ca600640 1 -- 172.21.15.7:0/913520858 >> 172.21.15.7:0/913520858 conn(0x7fe8c4065d40 msgr2=0x7fe8c4066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:53.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.791+0000 7fe8ca600640 1 -- 172.21.15.7:0/913520858 shutdown_connections 2024-09-13T15:13:53.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.791+0000 7fe8ca600640 1 -- 172.21.15.7:0/913520858 wait complete. 2024-09-13T15:13:53.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.795+0000 7fe8ca600640 1 Processor -- start 2024-09-13T15:13:53.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.795+0000 7fe8ca600640 1 -- start start 2024-09-13T15:13:53.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.795+0000 7fe8ca600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c4066860 0x7fe8c40c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.795+0000 7fe8ca600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8c40c08a0 0x7fe8c4141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.795+0000 7fe8ca600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8c4158bb0 0x7fe8c413f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.795+0000 7fe8ca600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c414ad70 con 0x7fe8c4066860 2024-09-13T15:13:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.795+0000 7fe8ca600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c4140ad0 con 0x7fe8c40c08a0 2024-09-13T15:13:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.795+0000 7fe8ca600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c4140640 con 0x7fe8c4158bb0 2024-09-13T15:13:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.795+0000 7fe8c3e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8c4158bb0 0x7fe8c413f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.795+0000 7fe8c3400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c4066860 0x7fe8c40c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:53.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.795+0000 7fe8c3e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8c4158bb0 0x7fe8c413f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:53826/0 (socket says 172.21.15.7:53826) 2024-09-13T15:13:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.795+0000 7fe8c3e00640 1 -- 172.21.15.7:0/4239470384 learned_addr learned my addr 172.21.15.7:0/4239470384 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.799+0000 7fe8c3e00640 1 -- 172.21.15.7:0/4239470384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8c40c08a0 msgr2=0x7fe8c4141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.799+0000 7fe8c2a00640 1 --2- 172.21.15.7:0/4239470384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8c40c08a0 0x7fe8c4141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.799+0000 7fe8c3e00640 1 --2- 172.21.15.7:0/4239470384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8c40c08a0 0x7fe8c4141770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:53.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.799+0000 7fe8c3e00640 1 -- 172.21.15.7:0/4239470384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c4066860 msgr2=0x7fe8c40c0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.799+0000 7fe8c3e00640 1 --2- 172.21.15.7:0/4239470384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c4066860 0x7fe8c40c0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.799+0000 7fe8c3e00640 1 -- 172.21.15.7:0/4239470384 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b0009420 con 0x7fe8c4158bb0 2024-09-13T15:13:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.799+0000 7fe8c2a00640 1 --2- 172.21.15.7:0/4239470384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8c40c08a0 0x7fe8c4141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:13:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.799+0000 7fe8c3e00640 1 --2- 172.21.15.7:0/4239470384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8c4158bb0 0x7fe8c413f530 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400c450 tx=0x7fe8b400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.799+0000 7fe8bb400640 1 -- 172.21.15.7:0/4239470384 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40054e0 con 0x7fe8c4158bb0 2024-09-13T15:13:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.799+0000 7fe8bb400640 1 -- 172.21.15.7:0/4239470384 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b4003600 con 0x7fe8c4158bb0 2024-09-13T15:13:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.799+0000 7fe8bb400640 1 -- 172.21.15.7:0/4239470384 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4003970 con 0x7fe8c4158bb0 2024-09-13T15:13:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.799+0000 7fe8ca600640 1 -- 172.21.15.7:0/4239470384 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c414b280 con 0x7fe8c4158bb0 2024-09-13T15:13:53.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.799+0000 7fe8ca600640 1 -- 172.21.15.7:0/4239470384 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c414a640 con 0x7fe8c4158bb0 2024-09-13T15:13:53.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.799+0000 7fe8ca600640 1 -- 172.21.15.7:0/4239470384 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c4067650 con 0x7fe8c4158bb0 2024-09-13T15:13:53.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.803+0000 7fe8bb400640 1 -- 172.21.15.7:0/4239470384 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe8b4003ad0 con 0x7fe8c4158bb0 2024-09-13T15:13:53.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.807+0000 7fe8bb400640 1 --2- 172.21.15.7:0/4239470384 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe8a4066790 0x7fe8a4068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:53.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.807+0000 7fe8bb400640 1 -- 172.21.15.7:0/4239470384 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fe8b4084120 con 0x7fe8c4158bb0 2024-09-13T15:13:53.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.811+0000 7fe8c3400640 1 --2- 172.21.15.7:0/4239470384 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe8a4066790 0x7fe8a4068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:53.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.811+0000 7fe8c3400640 1 --2- 172.21.15.7:0/4239470384 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe8a4066790 0x7fe8a4068c50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc007fd0 tx=0x7fe8bc005b80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:53.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:53.815+0000 7fe8bb400640 1 -- 172.21.15.7:0/4239470384 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe8b4051040 con 0x7fe8c4158bb0 2024-09-13T15:13:54.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:54.243+0000 7fe8ca600640 1 -- 172.21.15.7:0/4239470384 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8c40b0f40 con 0x7fe8c4158bb0 2024-09-13T15:13:54.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:54.255+0000 7fe8bb400640 1 -- 172.21.15.7:0/4239470384 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+5529 (secure 0 0 0) 0x7fe8b4017070 con 0x7fe8c4158bb0 2024-09-13T15:13:54.262 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:54.262 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:13:53.969781+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:resolve","state_seq":23,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:54.263 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 48 2024-09-13T15:13:54.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:54.263+0000 7fe8ca600640 1 -- 172.21.15.7:0/4239470384 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe8a4066790 msgr2=0x7fe8a4068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:54.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:54.267+0000 7fe8ca600640 1 --2- 172.21.15.7:0/4239470384 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe8a4066790 0x7fe8a4068c50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc007fd0 tx=0x7fe8bc005b80 comp rx=0 tx=0).stop 2024-09-13T15:13:54.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:54.267+0000 7fe8ca600640 1 -- 172.21.15.7:0/4239470384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8c4158bb0 msgr2=0x7fe8c413f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:54.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:54.267+0000 7fe8ca600640 1 --2- 172.21.15.7:0/4239470384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8c4158bb0 0x7fe8c413f530 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe8b400c450 tx=0x7fe8b400c910 comp rx=0 tx=0).stop 2024-09-13T15:13:54.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:54.267+0000 7fe8ca600640 1 -- 172.21.15.7:0/4239470384 shutdown_connections 2024-09-13T15:13:54.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:54.267+0000 7fe8ca600640 1 --2- 172.21.15.7:0/4239470384 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe8a4066790 0x7fe8a4068c50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:54.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:54.267+0000 7fe8ca600640 1 --2- 172.21.15.7:0/4239470384 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8c4158bb0 0x7fe8c413f530 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:54.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:54.267+0000 7fe8ca600640 1 --2- 172.21.15.7:0/4239470384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8c40c08a0 0x7fe8c4141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:54.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:54.267+0000 7fe8ca600640 1 --2- 172.21.15.7:0/4239470384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8c4066860 0x7fe8c40c0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:54.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:54.267+0000 7fe8ca600640 1 -- 172.21.15.7:0/4239470384 >> 172.21.15.7:0/4239470384 conn(0x7fe8c4065d40 msgr2=0x7fe8c4066120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:54.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:54.271+0000 7fe8ca600640 1 -- 172.21.15.7:0/4239470384 shutdown_connections 2024-09-13T15:13:54.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:54.271+0000 7fe8ca600640 1 -- 172.21.15.7:0/4239470384 wait complete. 2024-09-13T15:13:54.362 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:13:56.363 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:56.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.659+0000 7f2807800640 1 Processor -- start 2024-09-13T15:13:56.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.659+0000 7f2807800640 1 -- start start 2024-09-13T15:13:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.659+0000 7f2807800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28000c5ab0 0x7f280006cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.659+0000 7f2807800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f28000c5e90 0x7f28000c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.659+0000 7f2807800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2800161ab0 con 0x7f28000c6890 2024-09-13T15:13:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.659+0000 7f2807800640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2800160f80 con 0x7f28000c5e90 2024-09-13T15:13:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.659+0000 7f2807800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280006dbc0 con 0x7f28000c5ab0 2024-09-13T15:13:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.663+0000 7f2805800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f28000c5e90 0x7f28000c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.663+0000 7f2805800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f28000c5e90 0x7f28000c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:60072/0 (socket says 172.21.15.7:60072) 2024-09-13T15:13:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.663+0000 7f2805800640 1 -- 172.21.15.7:0/2160341851 learned_addr learned my addr 172.21.15.7:0/2160341851 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.663+0000 7f2805800640 1 -- 172.21.15.7:0/2160341851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28000c5ab0 msgr2=0x7f280006cce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:13:56.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.663+0000 7f2805800640 1 --2- 172.21.15.7:0/2160341851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28000c5ab0 0x7f280006cce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:56.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.663+0000 7f2805800640 1 -- 172.21.15.7:0/2160341851 >> v1:172.21.15.7:6789/0 conn(0x7f28000c6890 legacy=0x7f28001613a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:13:56.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.667+0000 7f27ff400640 1 -- 172.21.15.7:0/2160341851 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49808579 0 0) 0x7f27ec001120 con 0x7f28000c6890 2024-09-13T15:13:56.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.667+0000 7f2805800640 1 -- 172.21.15.7:0/2160341851 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280006d320 con 0x7f28000c5e90 2024-09-13T15:13:56.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.675+0000 7f2805800640 1 --2- 172.21.15.7:0/2160341851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28000c5e90 0x7f28000c6ea0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009870 tx=0x7f27f001ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a43fc1741a6efd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:56.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.675+0000 7f27ff400640 1 -- 172.21.15.7:0/2160341851 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00a8a70 con 0x7f28000c5e90 2024-09-13T15:13:56.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.675+0000 7f27ff400640 1 -- 172.21.15.7:0/2160341851 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f00a8bd0 con 0x7f28000c5e90 2024-09-13T15:13:56.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.675+0000 7f27ff400640 1 -- 172.21.15.7:0/2160341851 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00a8a70 con 0x7f28000c5e90 2024-09-13T15:13:56.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.679+0000 7f2807800640 1 -- 172.21.15.7:0/2160341851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28000c5e90 msgr2=0x7f28000c6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:56.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.679+0000 7f2807800640 1 --2- 172.21.15.7:0/2160341851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28000c5e90 0x7f28000c6ea0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009870 tx=0x7f27f001ed70 comp rx=0 tx=0).stop 2024-09-13T15:13:56.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.683+0000 7f2807800640 1 -- 172.21.15.7:0/2160341851 shutdown_connections 2024-09-13T15:13:56.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.683+0000 7f2807800640 1 --2- 172.21.15.7:0/2160341851 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28000c5e90 0x7f28000c6ea0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:56.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.683+0000 7f2807800640 1 --2- 172.21.15.7:0/2160341851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28000c5ab0 0x7f280006cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:56.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.683+0000 7f2807800640 1 -- 172.21.15.7:0/2160341851 >> 172.21.15.7:0/2160341851 conn(0x7f2800065d40 msgr2=0x7f2800066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:56.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.683+0000 7f2807800640 1 -- 172.21.15.7:0/2160341851 shutdown_connections 2024-09-13T15:13:56.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.683+0000 7f2807800640 1 -- 172.21.15.7:0/2160341851 wait complete. 2024-09-13T15:13:56.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.691+0000 7f2807800640 1 Processor -- start 2024-09-13T15:13:56.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.691+0000 7f2807800640 1 -- start start 2024-09-13T15:13:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.695+0000 7f2807800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28000c5ab0 0x7f2800160650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.695+0000 7f2804e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28000c5ab0 0x7f2800160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.695+0000 7f2804e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28000c5ab0 0x7f2800160650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55612/0 (socket says 172.21.15.7:55612) 2024-09-13T15:13:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.695+0000 7f2804e00640 1 -- 172.21.15.7:0/2382533247 learned_addr learned my addr 172.21.15.7:0/2382533247 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.695+0000 7f2807800640 1 --2- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28000c5e90 0x7f28001f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:56.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.699+0000 7f27ffe00640 1 --2- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28000c5e90 0x7f28001f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:56.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.699+0000 7f2807800640 1 --2- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28000c6890 0x7f28001f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:56.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.699+0000 7f2807800640 1 -- 172.21.15.7:0/2382533247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28000ca910 con 0x7f28000c5ab0 2024-09-13T15:13:56.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.699+0000 7f2807800640 1 -- 172.21.15.7:0/2382533247 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28001f6570 con 0x7f28000c5e90 2024-09-13T15:13:56.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.699+0000 7f2807800640 1 -- 172.21.15.7:0/2382533247 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28000c8ef0 con 0x7f28000c6890 2024-09-13T15:13:56.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.699+0000 7f2805800640 1 --2- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28000c6890 0x7f28001f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:56.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.699+0000 7f2805800640 1 -- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28000c5e90 msgr2=0x7f28001f6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:56.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.699+0000 7f2805800640 1 --2- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28000c5e90 0x7f28001f6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:56.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.699+0000 7f2805800640 1 -- 172.21.15.7:0/2382533247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28000c5ab0 msgr2=0x7f2800160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:56.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.699+0000 7f2805800640 1 --2- 172.21.15.7:0/2382533247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28000c5ab0 0x7f2800160650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:56.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.699+0000 7f2805800640 1 -- 172.21.15.7:0/2382533247 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00094d0 con 0x7f28000c6890 2024-09-13T15:13:56.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.703+0000 7f27ffe00640 1 --2- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28000c5e90 0x7f28001f6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:13:56.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.703+0000 7f2805800640 1 --2- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28000c6890 0x7f28001f6f40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f28000c1f00 tx=0x7f27f001bb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:56.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.707+0000 7f27fcc00640 1 -- 172.21.15.7:0/2382533247 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0003820 con 0x7f28000c6890 2024-09-13T15:13:56.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.707+0000 7f27fcc00640 1 -- 172.21.15.7:0/2382533247 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f0003980 con 0x7f28000c6890 2024-09-13T15:13:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.711+0000 7f27fcc00640 1 -- 172.21.15.7:0/2382533247 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0003d10 con 0x7f28000c6890 2024-09-13T15:13:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.711+0000 7f2807800640 1 -- 172.21.15.7:0/2382533247 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28001f39d0 con 0x7f28000c6890 2024-09-13T15:13:56.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.711+0000 7f2807800640 1 -- 172.21.15.7:0/2382533247 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28000c8930 con 0x7f28000c6890 2024-09-13T15:13:56.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.715+0000 7f27f6000640 1 -- 172.21.15.7:0/2382533247 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2800067650 con 0x7f28000c6890 2024-09-13T15:13:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.715+0000 7f27fcc00640 1 -- 172.21.15.7:0/2382533247 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f27f00b7070 con 0x7f28000c6890 2024-09-13T15:13:56.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.719+0000 7f27fcc00640 1 --2- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f27e00666e0 0x7f27e0068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.719+0000 7f27fcc00640 1 -- 172.21.15.7:0/2382533247 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f27f00c2360 con 0x7f28000c6890 2024-09-13T15:13:56.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.719+0000 7f2804e00640 1 --2- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f27e00666e0 0x7f27e0068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:56.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.731+0000 7f27fcc00640 1 -- 172.21.15.7:0/2382533247 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f27f00eff80 con 0x7f28000c6890 2024-09-13T15:13:56.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:56.735+0000 7f2804e00640 1 --2- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f27e00666e0 0x7f27e0068ba0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009f90 tx=0x7f27f80095b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:57.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:57.267+0000 7f27f6000640 1 -- 172.21.15.7:0/2382533247 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28001f66b0 con 0x7f28000c6890 2024-09-13T15:13:57.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:57.275+0000 7f27fcc00640 1 -- 172.21.15.7:0/2382533247 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+5529 (secure 0 0 0) 0x7f27f00b5020 con 0x7f28000c6890 2024-09-13T15:13:57.281 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:13:57.283 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:13:53.969781+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:resolve","state_seq":23,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:13:57.283 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 48 2024-09-13T15:13:57.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:57.283+0000 7f27f6000640 1 -- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f27e00666e0 msgr2=0x7f27e0068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:57.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:57.283+0000 7f27f6000640 1 --2- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f27e00666e0 0x7f27e0068ba0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009f90 tx=0x7f27f80095b0 comp rx=0 tx=0).stop 2024-09-13T15:13:57.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:57.283+0000 7f27f6000640 1 -- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28000c6890 msgr2=0x7f28001f6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:57.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:57.283+0000 7f27f6000640 1 --2- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28000c6890 0x7f28001f6f40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f28000c1f00 tx=0x7f27f001bb10 comp rx=0 tx=0).stop 2024-09-13T15:13:57.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:57.283+0000 7f27f6000640 1 -- 172.21.15.7:0/2382533247 shutdown_connections 2024-09-13T15:13:57.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:57.283+0000 7f27f6000640 1 --2- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f27e00666e0 0x7f27e0068ba0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:57.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:57.287+0000 7f27f6000640 1 --2- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f28000c6890 0x7f28001f6f40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:57.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:57.287+0000 7f27f6000640 1 --2- 172.21.15.7:0/2382533247 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f28000c5e90 0x7f28001f6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:57.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:57.287+0000 7f27f6000640 1 --2- 172.21.15.7:0/2382533247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28000c5ab0 0x7f2800160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:57.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:57.287+0000 7f27f6000640 1 -- 172.21.15.7:0/2382533247 >> 172.21.15.7:0/2382533247 conn(0x7f2800065d40 msgr2=0x7f2800071410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:57.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:57.287+0000 7f27f6000640 1 -- 172.21.15.7:0/2382533247 shutdown_connections 2024-09-13T15:13:57.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:57.287+0000 7f27f6000640 1 -- 172.21.15.7:0/2382533247 wait complete. 2024-09-13T15:13:57.350 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:13:59.351 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:13:59.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.679+0000 7fd781400640 1 Processor -- start 2024-09-13T15:13:59.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.679+0000 7fd781400640 1 -- start start 2024-09-13T15:13:59.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.683+0000 7fd781400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd77c0c6ad0 0x7fd77c1559e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:59.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.683+0000 7fd781400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd77c14eff0 0x7fd77c06f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:59.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.683+0000 7fd781400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77c0c6080 con 0x7fd77c06fa40 2024-09-13T15:13:59.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.683+0000 7fd781400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77c155f20 con 0x7fd77c0c6ad0 2024-09-13T15:13:59.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.683+0000 7fd781400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c0c5ac0 con 0x7fd77c14eff0 2024-09-13T15:13:59.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.687+0000 7fd77b400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd77c14eff0 0x7fd77c06f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:59.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.687+0000 7fd77b400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd77c14eff0 0x7fd77c06f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:38226/0 (socket says 172.21.15.7:38226) 2024-09-13T15:13:59.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.687+0000 7fd77b400640 1 -- 172.21.15.7:0/999760119 learned_addr learned my addr 172.21.15.7:0/999760119 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:59.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.691+0000 7fd77b400640 1 -- 172.21.15.7:0/999760119 >> v2:172.21.15.7:3300/0 conn(0x7fd77c0c6ad0 msgr2=0x7fd77c1559e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:59.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.691+0000 7fd77b400640 1 --2- 172.21.15.7:0/999760119 >> v2:172.21.15.7:3300/0 conn(0x7fd77c0c6ad0 0x7fd77c1559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:59.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.691+0000 7fd77b400640 1 -- 172.21.15.7:0/999760119 >> v1:172.21.15.7:6789/0 conn(0x7fd77c06fa40 legacy=0x7fd77c06d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:13:59.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.691+0000 7fd77b400640 1 -- 172.21.15.7:0/999760119 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77c0c5da0 con 0x7fd77c14eff0 2024-09-13T15:13:59.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.699+0000 7fd77b400640 1 --2- 172.21.15.7:0/999760119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd77c14eff0 0x7fd77c06f500 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009870 tx=0x7fd76c01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3309f1d0579e4f6c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:59.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.703+0000 7fd77aa00640 1 -- 172.21.15.7:0/999760119 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c0aa430 con 0x7fd77c14eff0 2024-09-13T15:13:59.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.703+0000 7fd77aa00640 1 -- 172.21.15.7:0/999760119 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c0aa590 con 0x7fd77c14eff0 2024-09-13T15:13:59.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.703+0000 7fd77aa00640 1 -- 172.21.15.7:0/999760119 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c0aa920 con 0x7fd77c14eff0 2024-09-13T15:13:59.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.707+0000 7fd781400640 1 -- 172.21.15.7:0/999760119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd77c14eff0 msgr2=0x7fd77c06f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:59.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.707+0000 7fd781400640 1 --2- 172.21.15.7:0/999760119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd77c14eff0 0x7fd77c06f500 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009870 tx=0x7fd76c01c510 comp rx=0 tx=0).stop 2024-09-13T15:13:59.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.707+0000 7fd781400640 1 -- 172.21.15.7:0/999760119 shutdown_connections 2024-09-13T15:13:59.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.707+0000 7fd781400640 1 --2- 172.21.15.7:0/999760119 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd77c14eff0 0x7fd77c06f500 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:59.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.707+0000 7fd781400640 1 --2- 172.21.15.7:0/999760119 >> v2:172.21.15.7:3300/0 conn(0x7fd77c0c6ad0 0x7fd77c1559e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:59.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.707+0000 7fd781400640 1 -- 172.21.15.7:0/999760119 >> 172.21.15.7:0/999760119 conn(0x7fd77c065d40 msgr2=0x7fd77c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:13:59.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.723+0000 7fd781400640 1 -- 172.21.15.7:0/999760119 shutdown_connections 2024-09-13T15:13:59.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.723+0000 7fd781400640 1 -- 172.21.15.7:0/999760119 wait complete. 2024-09-13T15:13:59.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.723+0000 7fd781400640 1 Processor -- start 2024-09-13T15:13:59.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd781400640 1 -- start start 2024-09-13T15:13:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd781400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd77c0c6ad0 0x7fd77c0c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd781400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd77c14eff0 0x7fd77c0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd781400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd77c070fe0 0x7fd77c15ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd781400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c0cad70 con 0x7fd77c070fe0 2024-09-13T15:13:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd781400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c145640 con 0x7fd77c14eff0 2024-09-13T15:13:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd781400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77c145030 con 0x7fd77c0c6ad0 2024-09-13T15:13:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd77be00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd77c0c6ad0 0x7fd77c0c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd77be00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd77c0c6ad0 0x7fd77c0c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:38240/0 (socket says 172.21.15.7:38240) 2024-09-13T15:13:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd77be00640 1 -- 172.21.15.7:0/2221124860 learned_addr learned my addr 172.21.15.7:0/2221124860 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:13:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd780a00640 1 --2- 172.21.15.7:0/2221124860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd77c070fe0 0x7fd77c15ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd77b400640 1 --2- 172.21.15.7:0/2221124860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd77c14eff0 0x7fd77c0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd77be00640 1 -- 172.21.15.7:0/2221124860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd77c14eff0 msgr2=0x7fd77c0c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd77be00640 1 --2- 172.21.15.7:0/2221124860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd77c14eff0 0x7fd77c0c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd77be00640 1 -- 172.21.15.7:0/2221124860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd77c070fe0 msgr2=0x7fd77c15ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:13:59.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd77be00640 1 --2- 172.21.15.7:0/2221124860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd77c070fe0 0x7fd77c15ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:13:59.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd77be00640 1 -- 172.21.15.7:0/2221124860 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c0094d0 con 0x7fd77c0c6ad0 2024-09-13T15:13:59.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.727+0000 7fd77b400640 1 --2- 172.21.15.7:0/2221124860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd77c14eff0 0x7fd77c0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:13:59.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.731+0000 7fd77be00640 1 --2- 172.21.15.7:0/2221124860 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd77c0c6ad0 0x7fd77c0c8b70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd76800b580 tx=0x7fd76800ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:13:59.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.731+0000 7fd773e00640 1 -- 172.21.15.7:0/2221124860 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd768010870 con 0x7fd77c0c6ad0 2024-09-13T15:13:59.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.731+0000 7fd773e00640 1 -- 172.21.15.7:0/2221124860 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7680109d0 con 0x7fd77c0c6ad0 2024-09-13T15:13:59.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.731+0000 7fd773e00640 1 -- 172.21.15.7:0/2221124860 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd768010870 con 0x7fd77c0c6ad0 2024-09-13T15:13:59.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.731+0000 7fd781400640 1 -- 172.21.15.7:0/2221124860 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd77c0caf60 con 0x7fd77c0c6ad0 2024-09-13T15:13:59.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.731+0000 7fd781400640 1 -- 172.21.15.7:0/2221124860 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77c1452d0 con 0x7fd77c0c6ad0 2024-09-13T15:13:59.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.731+0000 7fd781400640 1 -- 172.21.15.7:0/2221124860 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77c1559e0 con 0x7fd77c0c6ad0 2024-09-13T15:13:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.743+0000 7fd773e00640 1 -- 172.21.15.7:0/2221124860 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd768010b40 con 0x7fd77c0c6ad0 2024-09-13T15:13:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.743+0000 7fd773e00640 1 --2- 172.21.15.7:0/2221124860 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd760066890 0x7fd760068d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:13:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.743+0000 7fd773e00640 1 -- 172.21.15.7:0/2221124860 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fd768084530 con 0x7fd77c0c6ad0 2024-09-13T15:13:59.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.743+0000 7fd773e00640 1 -- 172.21.15.7:0/2221124860 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd768084a50 con 0x7fd77c0c6ad0 2024-09-13T15:13:59.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.743+0000 7fd77b400640 1 --2- 172.21.15.7:0/2221124860 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd760066890 0x7fd760068d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:13:59.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:13:59.747+0000 7fd77b400640 1 --2- 172.21.15.7:0/2221124860 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd760066890 0x7fd760068d50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd76c0ae000 tx=0x7fd76c0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:00.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:00.155+0000 7fd781400640 1 -- 172.21.15.7:0/2221124860 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd77c0c6230 con 0x7fd77c0c6ad0 2024-09-13T15:14:00.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:00.163+0000 7fd773e00640 1 -- 172.21.15.7:0/2221124860 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+5531 (secure 0 0 0) 0x7fd768051340 con 0x7fd77c0c6ad0 2024-09-13T15:14:00.165 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:14:00.165 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:13:59.071804+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:reconnect","state_seq":25,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:14:00.165 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 49 2024-09-13T15:14:00.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:00.167+0000 7fd781400640 1 -- 172.21.15.7:0/2221124860 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd760066890 msgr2=0x7fd760068d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:00.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:00.167+0000 7fd781400640 1 --2- 172.21.15.7:0/2221124860 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd760066890 0x7fd760068d50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd76c0ae000 tx=0x7fd76c0a7000 comp rx=0 tx=0).stop 2024-09-13T15:14:00.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:00.167+0000 7fd781400640 1 -- 172.21.15.7:0/2221124860 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd77c0c6ad0 msgr2=0x7fd77c0c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:00.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:00.167+0000 7fd781400640 1 --2- 172.21.15.7:0/2221124860 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd77c0c6ad0 0x7fd77c0c8b70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd76800b580 tx=0x7fd76800ba40 comp rx=0 tx=0).stop 2024-09-13T15:14:00.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:00.171+0000 7fd781400640 1 -- 172.21.15.7:0/2221124860 shutdown_connections 2024-09-13T15:14:00.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:00.171+0000 7fd781400640 1 --2- 172.21.15.7:0/2221124860 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd760066890 0x7fd760068d50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:00.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:00.171+0000 7fd781400640 1 --2- 172.21.15.7:0/2221124860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd77c070fe0 0x7fd77c15ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:00.171+0000 7fd781400640 1 --2- 172.21.15.7:0/2221124860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd77c14eff0 0x7fd77c0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:00.171+0000 7fd781400640 1 --2- 172.21.15.7:0/2221124860 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd77c0c6ad0 0x7fd77c0c8b70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:00.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:00.171+0000 7fd781400640 1 -- 172.21.15.7:0/2221124860 >> 172.21.15.7:0/2221124860 conn(0x7fd77c065d40 msgr2=0x7fd77c164080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:14:00.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:00.175+0000 7fd781400640 1 -- 172.21.15.7:0/2221124860 shutdown_connections 2024-09-13T15:14:00.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:00.175+0000 7fd781400640 1 -- 172.21.15.7:0/2221124860 wait complete. 2024-09-13T15:14:00.275 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 49, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-13T15:01:44.789559+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 49, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3 ], "info": { "gid_4276": { "addr": "172.21.15.7:6836/2396967179", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6834", "nonce": 2396967179, "type": "v2" }, { "addr": "172.21.15.7:6836", "nonce": 2396967179, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 4276, "incarnation": 4, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 4 }, "gid_5069": { "addr": "172.21.15.77:6838/877425259", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6836", "nonce": 877425259, "type": "v2" }, { "addr": "172.21.15.77:6838", "nonce": 877425259, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5069, "incarnation": 31, "join_fscid": -1, "name": "b", "rank": 3, "state": "up:active", "state_seq": 43 }, "gid_5198": { "addr": "172.21.15.7:6833/1355774527", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6832", "nonce": 1355774527, "type": "v2" }, { "addr": "172.21.15.7:6833", "nonce": 1355774527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5198, "incarnation": 41, "join_fscid": -1, "name": "e", "rank": 2, "state": "up:active", "state_seq": 14 }, "gid_5569": { "addr": "172.21.15.77:6835/1536067351", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6834", "nonce": 1536067351, "type": "v2" }, { "addr": "172.21.15.77:6835", "nonce": 1536067351, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5569, "incarnation": 47, "join_fscid": -1, "name": "d", "rank": 1, "state": "up:reconnect", "state_seq": 25 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 4, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-13T15:13:59.071804+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [ 4 ], "tableserver": 0, "up": { "mds_0": 4276, "mds_1": 5569, "mds_2": 5198, "mds_3": 5069 } } } ], "standbys": [ { "addr": "172.21.15.7:6837/3708232086", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6835", "nonce": 3708232086, "type": "v2" }, { "addr": "172.21.15.7:6837", "nonce": 3708232086, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 36, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5156, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-13T15:14:02.276 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:14:02.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.459+0000 7fab6da00640 1 Processor -- start 2024-09-13T15:14:02.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.459+0000 7fab6da00640 1 -- start start 2024-09-13T15:14:02.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.459+0000 7fab6da00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fab68071a70 0x7fab681576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:02.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.459+0000 7fab6da00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fab680b0bf0 0x7fab68150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:02.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.459+0000 7fab6da00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab680c5530 con 0x7fab6806ddb0 2024-09-13T15:14:02.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.459+0000 7fab6da00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab681583b0 con 0x7fab68071a70 2024-09-13T15:14:02.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.459+0000 7fab6da00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab68156f40 con 0x7fab680b0bf0 2024-09-13T15:14:02.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.463+0000 7fab66000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fab680b0bf0 0x7fab68150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:02.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.463+0000 7fab66000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fab680b0bf0 0x7fab68150cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:34584/0 (socket says 172.21.15.7:34584) 2024-09-13T15:14:02.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.463+0000 7fab66000640 1 -- 172.21.15.7:0/112629884 learned_addr learned my addr 172.21.15.7:0/112629884 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:14:02.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.463+0000 7fab66000640 1 -- 172.21.15.7:0/112629884 >> v2:172.21.15.7:3300/0 conn(0x7fab68071a70 msgr2=0x7fab681576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:14:02.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.463+0000 7fab66000640 1 --2- 172.21.15.7:0/112629884 >> v2:172.21.15.7:3300/0 conn(0x7fab68071a70 0x7fab681576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:02.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.463+0000 7fab66000640 1 -- 172.21.15.7:0/112629884 >> v1:172.21.15.7:6789/0 conn(0x7fab6806ddb0 legacy=0x7fab6815a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:14:02.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.463+0000 7fab66000640 1 -- 172.21.15.7:0/112629884 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab680b10c0 con 0x7fab680b0bf0 2024-09-13T15:14:02.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.475+0000 7fab66000640 1 --2- 172.21.15.7:0/112629884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab680b0bf0 0x7fab68150cd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fab68072760 tx=0x7fab5401c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4d689714e5c3a1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:02.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.479+0000 7fab65600640 1 -- 172.21.15.7:0/112629884 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540aa610 con 0x7fab680b0bf0 2024-09-13T15:14:02.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.479+0000 7fab65600640 1 -- 172.21.15.7:0/112629884 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab540a6040 con 0x7fab680b0bf0 2024-09-13T15:14:02.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.479+0000 7fab65600640 1 -- 172.21.15.7:0/112629884 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540aa990 con 0x7fab680b0bf0 2024-09-13T15:14:02.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.479+0000 7fab6da00640 1 -- 172.21.15.7:0/112629884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab680b0bf0 msgr2=0x7fab68150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:02.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.479+0000 7fab6da00640 1 --2- 172.21.15.7:0/112629884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab680b0bf0 0x7fab68150cd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fab68072760 tx=0x7fab5401c4b0 comp rx=0 tx=0).stop 2024-09-13T15:14:02.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.479+0000 7fab6da00640 1 -- 172.21.15.7:0/112629884 shutdown_connections 2024-09-13T15:14:02.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.479+0000 7fab6da00640 1 --2- 172.21.15.7:0/112629884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab680b0bf0 0x7fab68150cd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:02.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.479+0000 7fab6da00640 1 --2- 172.21.15.7:0/112629884 >> v2:172.21.15.7:3300/0 conn(0x7fab68071a70 0x7fab681576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:02.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.479+0000 7fab6da00640 1 -- 172.21.15.7:0/112629884 >> 172.21.15.7:0/112629884 conn(0x7fab68065d40 msgr2=0x7fab68066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:14:02.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.483+0000 7fab6da00640 1 -- 172.21.15.7:0/112629884 shutdown_connections 2024-09-13T15:14:02.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.483+0000 7fab6da00640 1 -- 172.21.15.7:0/112629884 wait complete. 2024-09-13T15:14:02.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.483+0000 7fab6da00640 1 Processor -- start 2024-09-13T15:14:02.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.487+0000 7fab6da00640 1 -- start start 2024-09-13T15:14:02.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.491+0000 7fab6da00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab6806ddb0 0x7fab68070d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:02.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.491+0000 7fab6da00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab68071a70 0x7fab680c2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:02.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.491+0000 7fab6da00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab680b0bf0 0x7fab681f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:02.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.491+0000 7fab6da00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab680c7eb0 con 0x7fab6806ddb0 2024-09-13T15:14:02.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.491+0000 7fab6da00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab680c8110 con 0x7fab68071a70 2024-09-13T15:14:02.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.491+0000 7fab6da00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab68147260 con 0x7fab680b0bf0 2024-09-13T15:14:02.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.495+0000 7fab67400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab680b0bf0 0x7fab681f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:02.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.495+0000 7fab67400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab680b0bf0 0x7fab681f6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:38254/0 (socket says 172.21.15.7:38254) 2024-09-13T15:14:02.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.495+0000 7fab67400640 1 -- 172.21.15.7:0/759839735 learned_addr learned my addr 172.21.15.7:0/759839735 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:14:02.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.495+0000 7fab66000640 1 --2- 172.21.15.7:0/759839735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab68071a70 0x7fab680c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:02.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.495+0000 7fab67400640 1 -- 172.21.15.7:0/759839735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab68071a70 msgr2=0x7fab680c2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:02.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.495+0000 7fab67400640 1 --2- 172.21.15.7:0/759839735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab68071a70 0x7fab680c2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:02.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.495+0000 7fab67400640 1 -- 172.21.15.7:0/759839735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab6806ddb0 msgr2=0x7fab68070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:02.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.495+0000 7fab67400640 1 --2- 172.21.15.7:0/759839735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab6806ddb0 0x7fab68070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:02.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.495+0000 7fab67400640 1 -- 172.21.15.7:0/759839735 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab540094d0 con 0x7fab680b0bf0 2024-09-13T15:14:02.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.495+0000 7fab67400640 1 --2- 172.21.15.7:0/759839735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab680b0bf0 0x7fab681f6600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fab6000b3e0 tx=0x7fab6000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:02.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.495+0000 7fab5ea00640 1 -- 172.21.15.7:0/759839735 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60011830 con 0x7fab680b0bf0 2024-09-13T15:14:02.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.495+0000 7fab5ea00640 1 -- 172.21.15.7:0/759839735 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab600119b0 con 0x7fab680b0bf0 2024-09-13T15:14:02.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.495+0000 7fab5ea00640 1 -- 172.21.15.7:0/759839735 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60011d60 con 0x7fab680b0bf0 2024-09-13T15:14:02.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.507+0000 7fab6da00640 1 -- 172.21.15.7:0/759839735 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab68146f80 con 0x7fab680b0bf0 2024-09-13T15:14:02.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.507+0000 7fab6da00640 1 -- 172.21.15.7:0/759839735 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab680c4630 con 0x7fab680b0bf0 2024-09-13T15:14:02.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.515+0000 7fab6da00640 1 -- 172.21.15.7:0/759839735 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab68067650 con 0x7fab680b0bf0 2024-09-13T15:14:02.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.515+0000 7fab5ea00640 1 -- 172.21.15.7:0/759839735 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fab6001a400 con 0x7fab680b0bf0 2024-09-13T15:14:02.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.519+0000 7fab5ea00640 1 --2- 172.21.15.7:0/759839735 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fab48066790 0x7fab48068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:02.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.519+0000 7fab5ea00640 1 -- 172.21.15.7:0/759839735 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fab600846e0 con 0x7fab680b0bf0 2024-09-13T15:14:02.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.519+0000 7fab66a00640 1 --2- 172.21.15.7:0/759839735 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fab48066790 0x7fab48068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:02.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.519+0000 7fab66a00640 1 --2- 172.21.15.7:0/759839735 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fab48066790 0x7fab48068c50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fab5800ab90 tx=0x7fab58009250 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:02.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.519+0000 7fab5ea00640 1 -- 172.21.15.7:0/759839735 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fab60051550 con 0x7fab680b0bf0 2024-09-13T15:14:02.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.979+0000 7fab6da00640 1 -- 172.21.15.7:0/759839735 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab68066d50 con 0x7fab680b0bf0 2024-09-13T15:14:02.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.983+0000 7fab5ea00640 1 -- 172.21.15.7:0/759839735 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+5531 (secure 0 0 0) 0x7fab60015090 con 0x7fab680b0bf0 2024-09-13T15:14:02.984 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:14:02.984 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:13:59.071804+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:reconnect","state_seq":25,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:14:02.984 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 49 2024-09-13T15:14:02.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.999+0000 7fab6da00640 1 -- 172.21.15.7:0/759839735 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fab48066790 msgr2=0x7fab48068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:02.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.999+0000 7fab6da00640 1 --2- 172.21.15.7:0/759839735 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fab48066790 0x7fab48068c50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fab5800ab90 tx=0x7fab58009250 comp rx=0 tx=0).stop 2024-09-13T15:14:03.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.999+0000 7fab6da00640 1 -- 172.21.15.7:0/759839735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab680b0bf0 msgr2=0x7fab681f6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:03.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.999+0000 7fab6da00640 1 --2- 172.21.15.7:0/759839735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab680b0bf0 0x7fab681f6600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fab6000b3e0 tx=0x7fab6000b8a0 comp rx=0 tx=0).stop 2024-09-13T15:14:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.999+0000 7fab6da00640 1 -- 172.21.15.7:0/759839735 shutdown_connections 2024-09-13T15:14:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.999+0000 7fab6da00640 1 --2- 172.21.15.7:0/759839735 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fab48066790 0x7fab48068c50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.999+0000 7fab6da00640 1 --2- 172.21.15.7:0/759839735 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fab680b0bf0 0x7fab681f6600 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.999+0000 7fab6da00640 1 --2- 172.21.15.7:0/759839735 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab68071a70 0x7fab680c2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.999+0000 7fab6da00640 1 --2- 172.21.15.7:0/759839735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fab6806ddb0 0x7fab68070d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:02.999+0000 7fab6da00640 1 -- 172.21.15.7:0/759839735 >> 172.21.15.7:0/759839735 conn(0x7fab68065d40 msgr2=0x7fab680ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:14:03.005 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:03.003+0000 7fab6da00640 1 -- 172.21.15.7:0/759839735 shutdown_connections 2024-09-13T15:14:03.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:03.003+0000 7fab6da00640 1 -- 172.21.15.7:0/759839735 wait complete. 2024-09-13T15:14:03.090 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:14:05.091 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:14:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.383+0000 7f4287e00640 1 Processor -- start 2024-09-13T15:14:05.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.387+0000 7f4287e00640 1 -- start start 2024-09-13T15:14:05.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.391+0000 7f4287e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f428814f350 0x7f42880c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:05.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.395+0000 7f4287e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4288066860 0x7f4288158b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:05.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.395+0000 7f4287e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428806d920 con 0x7f42880c1980 2024-09-13T15:14:05.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.395+0000 7f4287e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428814f730 con 0x7f4288066860 2024-09-13T15:14:05.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.395+0000 7f4287e00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42881593d0 con 0x7f428814f350 2024-09-13T15:14:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.399+0000 7f4286a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f428814f350 0x7f42880c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:05.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.399+0000 7f4286a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f428814f350 0x7f42880c5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:34600/0 (socket says 172.21.15.7:34600) 2024-09-13T15:14:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.399+0000 7f4286a00640 1 -- 172.21.15.7:0/1139568574 learned_addr learned my addr 172.21.15.7:0/1139568574 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:14:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.399+0000 7f4286a00640 1 -- 172.21.15.7:0/1139568574 >> v2:172.21.15.7:3300/0 conn(0x7f4288066860 msgr2=0x7f4288158b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:14:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.399+0000 7f4287400640 1 --2- 172.21.15.7:0/1139568574 >> v2:172.21.15.7:3300/0 conn(0x7f4288066860 0x7f4288158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.399+0000 7f4286a00640 1 --2- 172.21.15.7:0/1139568574 >> v2:172.21.15.7:3300/0 conn(0x7f4288066860 0x7f4288158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.399+0000 7f4286a00640 1 -- 172.21.15.7:0/1139568574 >> v1:172.21.15.7:6789/0 conn(0x7f42880c1980 legacy=0x7f4288158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:05.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.399+0000 7f4286a00640 1 -- 172.21.15.7:0/1139568574 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428806dc00 con 0x7f428814f350 2024-09-13T15:14:05.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.411+0000 7f4287400640 1 --2- 172.21.15.7:0/1139568574 >> v2:172.21.15.7:3300/0 conn(0x7f4288066860 0x7f4288158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:14:05.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.419+0000 7f4286a00640 1 --2- 172.21.15.7:0/1139568574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f428814f350 0x7f42880c5d70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f428806dfc0 tx=0x7f427801ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c72b9b6a6325876d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:05.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.419+0000 7f4285600640 1 -- 172.21.15.7:0/1139568574 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780a8a10 con 0x7f428814f350 2024-09-13T15:14:05.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.419+0000 7f4285600640 1 -- 172.21.15.7:0/1139568574 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42780a8b70 con 0x7f428814f350 2024-09-13T15:14:05.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.419+0000 7f4285600640 1 -- 172.21.15.7:0/1139568574 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780b0440 con 0x7f428814f350 2024-09-13T15:14:05.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.419+0000 7f4287e00640 1 -- 172.21.15.7:0/1139568574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f428814f350 msgr2=0x7f42880c5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:05.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.419+0000 7f4287e00640 1 --2- 172.21.15.7:0/1139568574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f428814f350 0x7f42880c5d70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f428806dfc0 tx=0x7f427801ed50 comp rx=0 tx=0).stop 2024-09-13T15:14:05.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.419+0000 7f4287e00640 1 -- 172.21.15.7:0/1139568574 shutdown_connections 2024-09-13T15:14:05.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.419+0000 7f4287e00640 1 --2- 172.21.15.7:0/1139568574 >> v2:172.21.15.7:3300/0 conn(0x7f4288066860 0x7f4288158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:05.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.419+0000 7f4287e00640 1 --2- 172.21.15.7:0/1139568574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f428814f350 0x7f42880c5d70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:05.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.419+0000 7f4287e00640 1 -- 172.21.15.7:0/1139568574 >> 172.21.15.7:0/1139568574 conn(0x7f4288065d40 msgr2=0x7f4288066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:14:05.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.423+0000 7f4287e00640 1 -- 172.21.15.7:0/1139568574 shutdown_connections 2024-09-13T15:14:05.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.427+0000 7f4287e00640 1 -- 172.21.15.7:0/1139568574 wait complete. 2024-09-13T15:14:05.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.431+0000 7f4287e00640 1 Processor -- start 2024-09-13T15:14:05.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.435+0000 7f4287e00640 1 -- start start 2024-09-13T15:14:05.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.439+0000 7f4287e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4288066860 0x7f42881fafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:05.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.439+0000 7f4287e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42880c1980 0x7f4288157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:05.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.439+0000 7f4287e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f428814f350 0x7f42880c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:05.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.439+0000 7f4287e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42880c8ac0 con 0x7f42880c1980 2024-09-13T15:14:05.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.439+0000 7f4287e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4288146570 con 0x7f4288066860 2024-09-13T15:14:05.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.439+0000 7f4287e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4288146850 con 0x7f428814f350 2024-09-13T15:14:05.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.443+0000 7f4286a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4288066860 0x7f42881fafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:05.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.443+0000 7f4286a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4288066860 0x7f42881fafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:34602/0 (socket says 172.21.15.7:34602) 2024-09-13T15:14:05.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.443+0000 7f4286a00640 1 -- 172.21.15.7:0/2023208887 learned_addr learned my addr 172.21.15.7:0/2023208887 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:14:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.443+0000 7f4286a00640 1 -- 172.21.15.7:0/2023208887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f428814f350 msgr2=0x7f42880c8f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:14:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.443+0000 7f4286a00640 1 --2- 172.21.15.7:0/2023208887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f428814f350 0x7f42880c8f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.443+0000 7f4286a00640 1 -- 172.21.15.7:0/2023208887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42880c1980 msgr2=0x7f4288157dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:14:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.443+0000 7f4286a00640 1 --2- 172.21.15.7:0/2023208887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42880c1980 0x7f4288157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.443+0000 7f4286a00640 1 -- 172.21.15.7:0/2023208887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42780094d0 con 0x7f4288066860 2024-09-13T15:14:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.443+0000 7f4286a00640 1 --2- 172.21.15.7:0/2023208887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4288066860 0x7f42881fafb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f427801b960 tx=0x7f427801baf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:05.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.443+0000 7f427f400640 1 -- 172.21.15.7:0/2023208887 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780b9630 con 0x7f4288066860 2024-09-13T15:14:05.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.443+0000 7f427f400640 1 -- 172.21.15.7:0/2023208887 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42780b97b0 con 0x7f4288066860 2024-09-13T15:14:05.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.443+0000 7f427f400640 1 -- 172.21.15.7:0/2023208887 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780b9b60 con 0x7f4288066860 2024-09-13T15:14:05.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.443+0000 7f4287e00640 1 -- 172.21.15.7:0/2023208887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4288146b30 con 0x7f4288066860 2024-09-13T15:14:05.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.447+0000 7f4287e00640 1 -- 172.21.15.7:0/2023208887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4288158300 con 0x7f4288066860 2024-09-13T15:14:05.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.447+0000 7f4287e00640 1 -- 172.21.15.7:0/2023208887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4288147050 con 0x7f4288066860 2024-09-13T15:14:05.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.451+0000 7f427f400640 1 -- 172.21.15.7:0/2023208887 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f42780b7040 con 0x7f4288066860 2024-09-13T15:14:05.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.451+0000 7f427f400640 1 --2- 172.21.15.7:0/2023208887 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4268066790 0x7f4268068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:05.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.451+0000 7f4286000640 1 --2- 172.21.15.7:0/2023208887 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4268066790 0x7f4268068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:05.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.451+0000 7f427f400640 1 -- 172.21.15.7:0/2023208887 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f4278121c20 con 0x7f4288066860 2024-09-13T15:14:05.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.451+0000 7f4286000640 1 --2- 172.21.15.7:0/2023208887 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4268066790 0x7f4268068c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4274000f70 tx=0x7f42740079c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:05.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.463+0000 7f427f400640 1 -- 172.21.15.7:0/2023208887 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4288147050 con 0x7f4288066860 2024-09-13T15:14:05.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.911+0000 7f4287e00640 1 -- 172.21.15.7:0/2023208887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4288147050 con 0x7f4288066860 2024-09-13T15:14:05.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.911+0000 7f427f400640 1 -- 172.21.15.7:0/2023208887 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+5528 (secure 0 0 0) 0x7f4288147050 con 0x7f4288066860 2024-09-13T15:14:05.917 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:14:05.917 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:14:04.966263+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:rejoin","state_seq":27,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:14:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 50 2024-09-13T15:14:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.915+0000 7f4287e00640 1 -- 172.21.15.7:0/2023208887 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4268066790 msgr2=0x7f4268068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.915+0000 7f4287e00640 1 --2- 172.21.15.7:0/2023208887 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4268066790 0x7f4268068c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4274000f70 tx=0x7f42740079c0 comp rx=0 tx=0).stop 2024-09-13T15:14:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.915+0000 7f4287e00640 1 -- 172.21.15.7:0/2023208887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4288066860 msgr2=0x7f42881fafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.915+0000 7f4287e00640 1 --2- 172.21.15.7:0/2023208887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4288066860 0x7f42881fafb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f427801b960 tx=0x7f427801baf0 comp rx=0 tx=0).stop 2024-09-13T15:14:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.915+0000 7f4287e00640 1 -- 172.21.15.7:0/2023208887 shutdown_connections 2024-09-13T15:14:05.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.915+0000 7f4287e00640 1 --2- 172.21.15.7:0/2023208887 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4268066790 0x7f4268068c50 secure :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4274000f70 tx=0x7f42740079c0 comp rx=0 tx=0).stop 2024-09-13T15:14:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.915+0000 7f4287e00640 1 --2- 172.21.15.7:0/2023208887 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f428814f350 0x7f42880c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.915+0000 7f4287e00640 1 --2- 172.21.15.7:0/2023208887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f42880c1980 0x7f4288157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.915+0000 7f4287e00640 1 --2- 172.21.15.7:0/2023208887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4288066860 0x7f42881fafb0 secure :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f427801b960 tx=0x7f427801baf0 comp rx=0 tx=0).stop 2024-09-13T15:14:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.915+0000 7f4287e00640 1 -- 172.21.15.7:0/2023208887 >> 172.21.15.7:0/2023208887 conn(0x7f4288065d40 msgr2=0x7f428814e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:14:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.915+0000 7f4287e00640 1 -- 172.21.15.7:0/2023208887 shutdown_connections 2024-09-13T15:14:05.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:05.919+0000 7f4287e00640 1 -- 172.21.15.7:0/2023208887 wait complete. 2024-09-13T15:14:06.018 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:14:08.019 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:14:08.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.307+0000 7f18e7e00640 1 Processor -- start 2024-09-13T15:14:08.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.307+0000 7f18e7e00640 1 -- start start 2024-09-13T15:14:08.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.311+0000 7f18e7e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f18e00c9e50 0x7f18e00c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:08.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.311+0000 7f18e7e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e015cd50 con 0x7f18e00cae60 2024-09-13T15:14:08.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.311+0000 7f18e7e00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e015d030 con 0x7f18e015c810 2024-09-13T15:14:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.311+0000 7f18e7e00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e015a220 con 0x7f18e00c9e50 2024-09-13T15:14:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.311+0000 7f18e4a00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f18e015c810 0x7f18e00cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:37524/0 (socket says 172.21.15.7:37524) 2024-09-13T15:14:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.311+0000 7f18e4a00640 1 -- 172.21.15.7:0/312609309 learned_addr learned my addr 172.21.15.7:0/312609309 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:14:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.315+0000 7f18dfe00640 1 -- 172.21.15.7:0/312609309 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195390438 0 0) 0x7f18e015d030 con 0x7f18e015c810 2024-09-13T15:14:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.315+0000 7f18dfe00640 1 -- 172.21.15.7:0/312609309 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18c8003530 con 0x7f18e015c810 2024-09-13T15:14:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.315+0000 7f18dfe00640 1 -- 172.21.15.7:0/312609309 <== mon.1 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 67029086 0 0) 0x7f18c8003530 con 0x7f18e015c810 2024-09-13T15:14:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.315+0000 7f18dfe00640 1 -- 172.21.15.7:0/312609309 >> v2:172.21.15.77:3300/0 conn(0x7f18e00c9e50 msgr2=0x7f18e00c9820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:14:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.315+0000 7f18dfe00640 1 --2- 172.21.15.7:0/312609309 >> v2:172.21.15.77:3300/0 conn(0x7f18e00c9e50 0x7f18e00c9820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.315+0000 7f18dfe00640 1 -- 172.21.15.7:0/312609309 >> v1:172.21.15.7:6789/0 conn(0x7f18e00cae60 legacy=0x7f18e0159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:14:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.315+0000 7f18dfe00640 1 -- 172.21.15.7:0/312609309 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e015d310 con 0x7f18e015c810 2024-09-13T15:14:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.315+0000 7f18dfe00640 1 -- 172.21.15.7:0/312609309 <== mon.1 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f18d4001680 con 0x7f18e015c810 2024-09-13T15:14:08.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.315+0000 7f18dfe00640 1 -- 172.21.15.7:0/312609309 >> v1:172.21.15.77:6789/0 conn(0x7f18e015c810 legacy=0x7f18e00cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.315+0000 7f18dfe00640 1 --2- 172.21.15.7:0/312609309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18c8003980 0x7f18c8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.315+0000 7f18dfe00640 1 --2- 172.21.15.7:0/312609309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18c80047d0 0x7f18c8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.315+0000 7f18dfe00640 1 --2- 172.21.15.7:0/312609309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18c8005390 0x7f18c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.315+0000 7f18dfe00640 1 -- 172.21.15.7:0/312609309 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e015a220 con 0x7f18c80047d0 2024-09-13T15:14:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.315+0000 7f18dfe00640 1 -- 172.21.15.7:0/312609309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c800c230 con 0x7f18c8003980 2024-09-13T15:14:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.315+0000 7f18dfe00640 1 -- 172.21.15.7:0/312609309 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c800c3f0 con 0x7f18c8005390 2024-09-13T15:14:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.319+0000 7f18e5400640 1 --2- 172.21.15.7:0/312609309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18c8003980 0x7f18c8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.319+0000 7f18e5400640 1 -- 172.21.15.7:0/312609309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18c8005390 msgr2=0x7f18c800b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:14:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.319+0000 7f18e5400640 1 --2- 172.21.15.7:0/312609309 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18c8005390 0x7f18c800b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.319+0000 7f18e5400640 1 -- 172.21.15.7:0/312609309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18c80047d0 msgr2=0x7f18c8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:14:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.319+0000 7f18e5400640 1 --2- 172.21.15.7:0/312609309 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18c80047d0 0x7f18c8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:08.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.319+0000 7f18e5400640 1 -- 172.21.15.7:0/312609309 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e015d310 con 0x7f18c8003980 2024-09-13T15:14:08.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.327+0000 7f18e5400640 1 --2- 172.21.15.7:0/312609309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18c8003980 0x7f18c8003d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f18d8001d50 tx=0x7f18d803e680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7f945d3bccd7bc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:08.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.331+0000 7f18dfe00640 1 -- 172.21.15.7:0/312609309 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8003ba0 con 0x7f18c8003980 2024-09-13T15:14:08.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.331+0000 7f18dfe00640 1 -- 172.21.15.7:0/312609309 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d8003d00 con 0x7f18c8003980 2024-09-13T15:14:08.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.331+0000 7f18dfe00640 1 -- 172.21.15.7:0/312609309 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d80052b0 con 0x7f18c8003980 2024-09-13T15:14:08.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.331+0000 7f18e7e00640 1 -- 172.21.15.7:0/312609309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18c8003980 msgr2=0x7f18c8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:08.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.331+0000 7f18e7e00640 1 --2- 172.21.15.7:0/312609309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18c8003980 0x7f18c8003d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f18d8001d50 tx=0x7f18d803e680 comp rx=0 tx=0).stop 2024-09-13T15:14:08.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.347+0000 7f18e5e00640 1 -- 172.21.15.7:0/312609309 reap_dead start 2024-09-13T15:14:08.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.347+0000 7f18e7e00640 1 -- 172.21.15.7:0/312609309 shutdown_connections 2024-09-13T15:14:08.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.347+0000 7f18e7e00640 1 -- 172.21.15.7:0/312609309 >> 172.21.15.7:0/312609309 conn(0x7f18e0065f10 msgr2=0x7f18e0066320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:14:08.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.347+0000 7f18e7e00640 1 -- 172.21.15.7:0/312609309 shutdown_connections 2024-09-13T15:14:08.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.347+0000 7f18e7e00640 1 -- 172.21.15.7:0/312609309 wait complete. 2024-09-13T15:14:08.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.351+0000 7f18e7e00640 1 Processor -- start 2024-09-13T15:14:08.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.351+0000 7f18e7e00640 1 -- start start 2024-09-13T15:14:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.351+0000 7f18e7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18e0158060 0x7f18e006fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.351+0000 7f18e7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18e0158440 0x7f18e0155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.351+0000 7f18e7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18e006d790 0x7f18e0155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.351+0000 7f18e7e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0154d90 con 0x7f18e0158060 2024-09-13T15:14:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.351+0000 7f18e7e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e0156750 con 0x7f18e006d790 2024-09-13T15:14:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.351+0000 7f18e7e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00cc340 con 0x7f18e0158440 2024-09-13T15:14:08.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.351+0000 7f18e4a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18e0158440 0x7f18e0155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:08.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.351+0000 7f18e4a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18e0158440 0x7f18e0155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:47534/0 (socket says 172.21.15.7:47534) 2024-09-13T15:14:08.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.351+0000 7f18e4a00640 1 -- 172.21.15.7:0/604346957 learned_addr learned my addr 172.21.15.7:0/604346957 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:14:08.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.355+0000 7f18e4a00640 1 -- 172.21.15.7:0/604346957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18e006d790 msgr2=0x7f18e0155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:08.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.355+0000 7f18e4a00640 1 --2- 172.21.15.7:0/604346957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18e006d790 0x7f18e0155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:08.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.355+0000 7f18e4a00640 1 -- 172.21.15.7:0/604346957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18e0158060 msgr2=0x7f18e006fce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:14:08.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.355+0000 7f18e5400640 1 --2- 172.21.15.7:0/604346957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18e0158060 0x7f18e006fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:08.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.355+0000 7f18e4a00640 1 --2- 172.21.15.7:0/604346957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18e0158060 0x7f18e006fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:08.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.355+0000 7f18e4a00640 1 -- 172.21.15.7:0/604346957 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e01f0f60 con 0x7f18e0158440 2024-09-13T15:14:08.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.355+0000 7f18e5400640 1 --2- 172.21.15.7:0/604346957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18e0158060 0x7f18e006fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:14:08.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.355+0000 7f18e4a00640 1 --2- 172.21.15.7:0/604346957 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18e0158440 0x7f18e0155220 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f18d400caf0 tx=0x7f18d4007e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:08.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.355+0000 7f18dd600640 1 -- 172.21.15.7:0/604346957 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d4004cc0 con 0x7f18e0158440 2024-09-13T15:14:08.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.355+0000 7f18dd600640 1 -- 172.21.15.7:0/604346957 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d4004e20 con 0x7f18e0158440 2024-09-13T15:14:08.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.355+0000 7f18dd600640 1 -- 172.21.15.7:0/604346957 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d4007310 con 0x7f18e0158440 2024-09-13T15:14:08.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.355+0000 7f18e7e00640 1 -- 172.21.15.7:0/604346957 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e01f1240 con 0x7f18e0158440 2024-09-13T15:14:08.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.355+0000 7f18e7e00640 1 -- 172.21.15.7:0/604346957 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e0156c80 con 0x7f18e0158440 2024-09-13T15:14:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.359+0000 7f18dd600640 1 -- 172.21.15.7:0/604346957 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f18d4007470 con 0x7f18e0158440 2024-09-13T15:14:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.359+0000 7f18e7e00640 1 -- 172.21.15.7:0/604346957 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e0067650 con 0x7f18e0158440 2024-09-13T15:14:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.359+0000 7f18dd600640 1 --2- 172.21.15.7:0/604346957 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18c0066760 0x7f18c0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.359+0000 7f18dd600640 1 -- 172.21.15.7:0/604346957 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f18d4084160 con 0x7f18e0158440 2024-09-13T15:14:08.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.359+0000 7f18e5400640 1 --2- 172.21.15.7:0/604346957 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18c0066760 0x7f18c0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:08.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.363+0000 7f18e5400640 1 --2- 172.21.15.7:0/604346957 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18c0066760 0x7f18c0068c20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f18d80cc000 tx=0x7f18d8005040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:08.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.371+0000 7f18dd600640 1 -- 172.21.15.7:0/604346957 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f18d4018070 con 0x7f18e0158440 2024-09-13T15:14:08.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.975+0000 7f18e7e00640 1 -- 172.21.15.7:0/604346957 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18e0154f40 con 0x7f18e0158440 2024-09-13T15:14:08.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.975+0000 7f18dd600640 1 -- 172.21.15.7:0/604346957 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+5528 (secure 0 0 0) 0x7f18e0154f40 con 0x7f18e0158440 2024-09-13T15:14:08.979 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:14:08.979 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:14:04.966263+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:rejoin","state_seq":27,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:14:08.979 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 50 2024-09-13T15:14:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.983+0000 7f18e7e00640 1 -- 172.21.15.7:0/604346957 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18c0066760 msgr2=0x7f18c0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.983+0000 7f18e7e00640 1 --2- 172.21.15.7:0/604346957 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18c0066760 0x7f18c0068c20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f18d80cc000 tx=0x7f18d8005040 comp rx=0 tx=0).stop 2024-09-13T15:14:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.983+0000 7f18e7e00640 1 -- 172.21.15.7:0/604346957 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18e0158440 msgr2=0x7f18e0155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:08.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.983+0000 7f18e7e00640 1 --2- 172.21.15.7:0/604346957 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18e0158440 0x7f18e0155220 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f18d400caf0 tx=0x7f18d4007e60 comp rx=0 tx=0).stop 2024-09-13T15:14:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.983+0000 7f18e7e00640 1 -- 172.21.15.7:0/604346957 shutdown_connections 2024-09-13T15:14:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.983+0000 7f18e7e00640 1 --2- 172.21.15.7:0/604346957 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18c0066760 0x7f18c0068c20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:08.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.983+0000 7f18e7e00640 1 --2- 172.21.15.7:0/604346957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18e006d790 0x7f18e0155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.983+0000 7f18e7e00640 1 --2- 172.21.15.7:0/604346957 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f18e0158440 0x7f18e0155220 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.983+0000 7f18e7e00640 1 --2- 172.21.15.7:0/604346957 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f18e0158060 0x7f18e006fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.983+0000 7f18e7e00640 1 -- 172.21.15.7:0/604346957 >> 172.21.15.7:0/604346957 conn(0x7f18e0065f10 msgr2=0x7f18e00c7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:14:08.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.983+0000 7f18e7e00640 1 -- 172.21.15.7:0/604346957 shutdown_connections 2024-09-13T15:14:08.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:08.983+0000 7f18e7e00640 1 -- 172.21.15.7:0/604346957 wait complete. 2024-09-13T15:14:09.032 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:14:11.033 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:14:11.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.295+0000 7efe3a200640 1 Processor -- start 2024-09-13T15:14:11.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.295+0000 7efe3a200640 1 -- start start 2024-09-13T15:14:11.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.295+0000 7efe3a200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efe340c4890 0x7efe34161320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:11.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.295+0000 7efe3a200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe340c4c70 0x7efe340c7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:11.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.295+0000 7efe3a200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3406da90 con 0x7efe340c18c0 2024-09-13T15:14:11.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.295+0000 7efe3a200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe340c7220 con 0x7efe340c4890 2024-09-13T15:14:11.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.295+0000 7efe3a200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3406cea0 con 0x7efe340c4c70 2024-09-13T15:14:11.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.299+0000 7efe38e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efe340c4890 0x7efe34161320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:11.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.299+0000 7efe38e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efe340c4890 0x7efe34161320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:60592/0 (socket says 172.21.15.7:60592) 2024-09-13T15:14:11.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.299+0000 7efe38e00640 1 -- 172.21.15.7:0/2418633603 learned_addr learned my addr 172.21.15.7:0/2418633603 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:14:11.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.299+0000 7efe33e00640 1 --2- 172.21.15.7:0/2418633603 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe340c4c70 0x7efe340c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:11.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.299+0000 7efe38e00640 1 -- 172.21.15.7:0/2418633603 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe340c4c70 msgr2=0x7efe340c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:14:11.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.299+0000 7efe38e00640 1 --2- 172.21.15.7:0/2418633603 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe340c4c70 0x7efe340c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:11.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.299+0000 7efe38e00640 1 -- 172.21.15.7:0/2418633603 >> v1:172.21.15.7:6789/0 conn(0x7efe340c18c0 legacy=0x7efe340c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:14:11.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.303+0000 7efe38e00640 1 -- 172.21.15.7:0/2418633603 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3406d160 con 0x7efe340c4890 2024-09-13T15:14:11.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.311+0000 7efe38e00640 1 --2- 172.21.15.7:0/2418633603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe340c4890 0x7efe34161320 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efe20009870 tx=0x7efe2001c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7abd087235fa58b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:11.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.311+0000 7efe33400640 1 -- 172.21.15.7:0/2418633603 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe200ab5f0 con 0x7efe340c4890 2024-09-13T15:14:11.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.311+0000 7efe33400640 1 -- 172.21.15.7:0/2418633603 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe200ab750 con 0x7efe340c4890 2024-09-13T15:14:11.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.311+0000 7efe33400640 1 -- 172.21.15.7:0/2418633603 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe200abae0 con 0x7efe340c4890 2024-09-13T15:14:11.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.311+0000 7efe3a200640 1 -- 172.21.15.7:0/2418633603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe340c4890 msgr2=0x7efe34161320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:11.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.311+0000 7efe3a200640 1 --2- 172.21.15.7:0/2418633603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe340c4890 0x7efe34161320 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efe20009870 tx=0x7efe2001c520 comp rx=0 tx=0).stop 2024-09-13T15:14:11.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.311+0000 7efe3a200640 1 -- 172.21.15.7:0/2418633603 shutdown_connections 2024-09-13T15:14:11.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.311+0000 7efe3a200640 1 --2- 172.21.15.7:0/2418633603 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe340c4c70 0x7efe340c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:11.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.311+0000 7efe3a200640 1 --2- 172.21.15.7:0/2418633603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe340c4890 0x7efe34161320 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:11.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.311+0000 7efe3a200640 1 -- 172.21.15.7:0/2418633603 >> 172.21.15.7:0/2418633603 conn(0x7efe34065d40 msgr2=0x7efe34066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:14:11.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.311+0000 7efe3a200640 1 -- 172.21.15.7:0/2418633603 shutdown_connections 2024-09-13T15:14:11.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.311+0000 7efe3a200640 1 -- 172.21.15.7:0/2418633603 wait complete. 2024-09-13T15:14:11.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.315+0000 7efe3a200640 1 Processor -- start 2024-09-13T15:14:11.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe3a200640 1 -- start start 2024-09-13T15:14:11.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe3a200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe340c18c0 0x7efe341f0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:11.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe3a200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe340c4890 0x7efe341f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:11.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe3a200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe340c4c70 0x7efe34153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:11.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe3a200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe34154220 con 0x7efe340c18c0 2024-09-13T15:14:11.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe3a200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe341f6cd0 con 0x7efe340c4890 2024-09-13T15:14:11.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe3a200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe341efcb0 con 0x7efe340c4c70 2024-09-13T15:14:11.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe39800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe340c4c70 0x7efe34153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:11.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe39800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe340c4c70 0x7efe34153a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:47560/0 (socket says 172.21.15.7:47560) 2024-09-13T15:14:11.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe39800640 1 -- 172.21.15.7:0/3387251359 learned_addr learned my addr 172.21.15.7:0/3387251359 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:14:11.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe33e00640 1 --2- 172.21.15.7:0/3387251359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe340c4890 0x7efe341f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:11.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe38e00640 1 --2- 172.21.15.7:0/3387251359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe340c18c0 0x7efe341f0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:11.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe39800640 1 -- 172.21.15.7:0/3387251359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe340c4890 msgr2=0x7efe341f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:11.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe39800640 1 --2- 172.21.15.7:0/3387251359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe340c4890 0x7efe341f6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:11.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe39800640 1 -- 172.21.15.7:0/3387251359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe340c18c0 msgr2=0x7efe341f0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:11.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe39800640 1 --2- 172.21.15.7:0/3387251359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe340c18c0 0x7efe341f0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:11.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe39800640 1 -- 172.21.15.7:0/3387251359 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe200094d0 con 0x7efe340c4c70 2024-09-13T15:14:11.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.319+0000 7efe39800640 1 --2- 172.21.15.7:0/3387251359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe340c4c70 0x7efe34153a90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00c7a0 tx=0x7efe2c00cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:11.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.335+0000 7efe30c00640 1 -- 172.21.15.7:0/3387251359 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c00aa50 con 0x7efe340c4c70 2024-09-13T15:14:11.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.335+0000 7efe30c00640 1 -- 172.21.15.7:0/3387251359 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c00abb0 con 0x7efe340c4c70 2024-09-13T15:14:11.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.335+0000 7efe30c00640 1 -- 172.21.15.7:0/3387251359 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c012420 con 0x7efe340c4c70 2024-09-13T15:14:11.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.335+0000 7efe3a200640 1 -- 172.21.15.7:0/3387251359 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe34153fd0 con 0x7efe340c4c70 2024-09-13T15:14:11.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.335+0000 7efe3a200640 1 -- 172.21.15.7:0/3387251359 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe34154710 con 0x7efe340c4c70 2024-09-13T15:14:11.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.335+0000 7efe3a200640 1 -- 172.21.15.7:0/3387251359 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe34067650 con 0x7efe340c4c70 2024-09-13T15:14:11.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.339+0000 7efe30c00640 1 -- 172.21.15.7:0/3387251359 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efe2c003980 con 0x7efe340c4c70 2024-09-13T15:14:11.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.343+0000 7efe30c00640 1 --2- 172.21.15.7:0/3387251359 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efe14066710 0x7efe14068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:11.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.343+0000 7efe30c00640 1 -- 172.21.15.7:0/3387251359 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7efe2c084b60 con 0x7efe340c4c70 2024-09-13T15:14:11.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.343+0000 7efe38e00640 1 --2- 172.21.15.7:0/3387251359 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efe14066710 0x7efe14068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:11.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.343+0000 7efe30c00640 1 -- 172.21.15.7:0/3387251359 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efe2c051a50 con 0x7efe340c4c70 2024-09-13T15:14:11.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.347+0000 7efe38e00640 1 --2- 172.21.15.7:0/3387251359 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efe14066710 0x7efe14068bd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efe200af000 tx=0x7efe20008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:11.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.743+0000 7efe3a200640 1 -- 172.21.15.7:0/3387251359 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe34161320 con 0x7efe340c4c70 2024-09-13T15:14:11.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.743+0000 7efe30c00640 1 -- 172.21.15.7:0/3387251359 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+5528 (secure 0 0 0) 0x7efe2c055070 con 0x7efe340c4c70 2024-09-13T15:14:11.747 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:14:11.748 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:14:04.966263+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:rejoin","state_seq":27,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:14:11.748 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 50 2024-09-13T15:14:11.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.747+0000 7efe3a200640 1 -- 172.21.15.7:0/3387251359 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efe14066710 msgr2=0x7efe14068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:11.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.747+0000 7efe3a200640 1 --2- 172.21.15.7:0/3387251359 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efe14066710 0x7efe14068bd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efe200af000 tx=0x7efe20008040 comp rx=0 tx=0).stop 2024-09-13T15:14:11.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.747+0000 7efe3a200640 1 -- 172.21.15.7:0/3387251359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe340c4c70 msgr2=0x7efe34153a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:11.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.747+0000 7efe3a200640 1 --2- 172.21.15.7:0/3387251359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe340c4c70 0x7efe34153a90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00c7a0 tx=0x7efe2c00cc60 comp rx=0 tx=0).stop 2024-09-13T15:14:11.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.747+0000 7efe3a200640 1 -- 172.21.15.7:0/3387251359 shutdown_connections 2024-09-13T15:14:11.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.747+0000 7efe3a200640 1 --2- 172.21.15.7:0/3387251359 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efe14066710 0x7efe14068bd0 secure :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efe200af000 tx=0x7efe20008040 comp rx=0 tx=0).stop 2024-09-13T15:14:11.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.747+0000 7efe3a200640 1 --2- 172.21.15.7:0/3387251359 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efe340c4c70 0x7efe34153a90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:11.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.747+0000 7efe3a200640 1 --2- 172.21.15.7:0/3387251359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe340c4890 0x7efe341f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:11.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.747+0000 7efe3a200640 1 --2- 172.21.15.7:0/3387251359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe340c18c0 0x7efe341f0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:11.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.747+0000 7efe3a200640 1 -- 172.21.15.7:0/3387251359 >> 172.21.15.7:0/3387251359 conn(0x7efe34065d40 msgr2=0x7efe340c2950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:14:11.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.751+0000 7efe3a200640 1 -- 172.21.15.7:0/3387251359 shutdown_connections 2024-09-13T15:14:11.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:11.751+0000 7efe3a200640 1 -- 172.21.15.7:0/3387251359 wait complete. 2024-09-13T15:14:11.794 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:14:13.795 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:14:14.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.151+0000 7fb763e00640 1 Processor -- start 2024-09-13T15:14:14.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.151+0000 7fb763e00640 1 -- start start 2024-09-13T15:14:14.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.155+0000 7fb763e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb7640caac0 0x7fb76406a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:14.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.159+0000 7fb763e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76406be00 con 0x7fb7640caea0 2024-09-13T15:14:14.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.159+0000 7fb763e00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76415de90 con 0x7fb76415e320 2024-09-13T15:14:14.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.159+0000 7fb763e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7640c8ab0 con 0x7fb7640caac0 2024-09-13T15:14:14.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.159+0000 7fb762a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb7640caac0 0x7fb76406a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:14.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.159+0000 7fb762a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb7640caac0 0x7fb76406a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53302/0 (socket says 172.21.15.7:53302) 2024-09-13T15:14:14.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.159+0000 7fb762a00640 1 -- 172.21.15.7:0/2169891648 learned_addr learned my addr 172.21.15.7:0/2169891648 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:14:14.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.159+0000 7fb761600640 1 -- 172.21.15.7:0/2169891648 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2531175638 0 0) 0x7fb76415de90 con 0x7fb76415e320 2024-09-13T15:14:14.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.159+0000 7fb761600640 1 -- 172.21.15.7:0/2169891648 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb748003530 con 0x7fb76415e320 2024-09-13T15:14:14.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.163+0000 7fb762a00640 1 -- 172.21.15.7:0/2169891648 >> v1:172.21.15.77:6789/0 conn(0x7fb76415e320 legacy=0x7fb7640702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:14.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.163+0000 7fb762a00640 1 -- 172.21.15.7:0/2169891648 >> v1:172.21.15.7:6789/0 conn(0x7fb7640caea0 legacy=0x7fb7640c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:14.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.163+0000 7fb762a00640 1 -- 172.21.15.7:0/2169891648 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76406b060 con 0x7fb7640caac0 2024-09-13T15:14:14.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.167+0000 7fb762a00640 1 --2- 172.21.15.7:0/2169891648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7640caac0 0x7fb76406a9d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb750009870 tx=0x7fb75001ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8837b1bfe03a423 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:14.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.167+0000 7fb761600640 1 -- 172.21.15.7:0/2169891648 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7500a8a50 con 0x7fb7640caac0 2024-09-13T15:14:14.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.171+0000 7fb761600640 1 -- 172.21.15.7:0/2169891648 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7500a8bb0 con 0x7fb7640caac0 2024-09-13T15:14:14.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.171+0000 7fb761600640 1 -- 172.21.15.7:0/2169891648 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7500b0440 con 0x7fb7640caac0 2024-09-13T15:14:14.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.171+0000 7fb763e00640 1 -- 172.21.15.7:0/2169891648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7640caac0 msgr2=0x7fb76406a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:14.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.171+0000 7fb763e00640 1 --2- 172.21.15.7:0/2169891648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7640caac0 0x7fb76406a9d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb750009870 tx=0x7fb75001ed70 comp rx=0 tx=0).stop 2024-09-13T15:14:14.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.171+0000 7fb763e00640 1 -- 172.21.15.7:0/2169891648 shutdown_connections 2024-09-13T15:14:14.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.171+0000 7fb763e00640 1 --2- 172.21.15.7:0/2169891648 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7640caac0 0x7fb76406a9d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:14.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.171+0000 7fb763e00640 1 -- 172.21.15.7:0/2169891648 >> 172.21.15.7:0/2169891648 conn(0x7fb7640ce9c0 msgr2=0x7fb7640cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:14:14.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.171+0000 7fb763e00640 1 -- 172.21.15.7:0/2169891648 shutdown_connections 2024-09-13T15:14:14.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.171+0000 7fb763e00640 1 -- 172.21.15.7:0/2169891648 wait complete. 2024-09-13T15:14:14.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.175+0000 7fb763e00640 1 Processor -- start 2024-09-13T15:14:14.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.175+0000 7fb763e00640 1 -- start start 2024-09-13T15:14:14.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.179+0000 7fb763e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7640caac0 0x7fb76415f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:14.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.179+0000 7fb763e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7640caea0 0x7fb76415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:14.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.179+0000 7fb763e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb76415e320 0x7fb7641f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:14.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.179+0000 7fb763e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7641f2c90 con 0x7fb7640caac0 2024-09-13T15:14:14.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.179+0000 7fb763e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7641f7190 con 0x7fb76415e320 2024-09-13T15:14:14.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.179+0000 7fb763e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb764160460 con 0x7fb7640caea0 2024-09-13T15:14:14.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.179+0000 7fb762000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7640caea0 0x7fb76415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:14.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.179+0000 7fb762000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7640caea0 0x7fb76415c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:47576/0 (socket says 172.21.15.7:47576) 2024-09-13T15:14:14.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.179+0000 7fb762000640 1 -- 172.21.15.7:0/556839089 learned_addr learned my addr 172.21.15.7:0/556839089 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:14:14.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.179+0000 7fb763400640 1 --2- 172.21.15.7:0/556839089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb76415e320 0x7fb7641f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:14.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.179+0000 7fb762a00640 1 --2- 172.21.15.7:0/556839089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7640caac0 0x7fb76415f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:14.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.179+0000 7fb762000640 1 -- 172.21.15.7:0/556839089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb76415e320 msgr2=0x7fb7641f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:14.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.179+0000 7fb762000640 1 --2- 172.21.15.7:0/556839089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb76415e320 0x7fb7641f3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:14.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.179+0000 7fb762000640 1 -- 172.21.15.7:0/556839089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7640caac0 msgr2=0x7fb76415f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:14.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.179+0000 7fb762000640 1 --2- 172.21.15.7:0/556839089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7640caac0 0x7fb76415f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:14.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.179+0000 7fb762000640 1 -- 172.21.15.7:0/556839089 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7500094d0 con 0x7fb7640caea0 2024-09-13T15:14:14.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.183+0000 7fb762000640 1 --2- 172.21.15.7:0/556839089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7640caea0 0x7fb76415c3e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb75400c480 tx=0x7fb75400c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:14.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.183+0000 7fb75aa00640 1 -- 172.21.15.7:0/556839089 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7540052d0 con 0x7fb7640caea0 2024-09-13T15:14:14.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.183+0000 7fb763e00640 1 -- 172.21.15.7:0/556839089 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7641f6c10 con 0x7fb7640caea0 2024-09-13T15:14:14.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.183+0000 7fb75aa00640 1 -- 172.21.15.7:0/556839089 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb754005430 con 0x7fb7640caea0 2024-09-13T15:14:14.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.183+0000 7fb75aa00640 1 -- 172.21.15.7:0/556839089 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754012870 con 0x7fb7640caea0 2024-09-13T15:14:14.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.183+0000 7fb763e00640 1 -- 172.21.15.7:0/556839089 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7641f6eb0 con 0x7fb7640caea0 2024-09-13T15:14:14.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.187+0000 7fb763e00640 1 -- 172.21.15.7:0/556839089 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7640b49f0 con 0x7fb7640caea0 2024-09-13T15:14:14.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.195+0000 7fb75aa00640 1 -- 172.21.15.7:0/556839089 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb7540129d0 con 0x7fb7640caea0 2024-09-13T15:14:14.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.199+0000 7fb75aa00640 1 --2- 172.21.15.7:0/556839089 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb744066690 0x7fb744068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:14.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.199+0000 7fb75aa00640 1 -- 172.21.15.7:0/556839089 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fb754084d10 con 0x7fb7640caea0 2024-09-13T15:14:14.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.199+0000 7fb75aa00640 1 -- 172.21.15.7:0/556839089 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb754085150 con 0x7fb7640caea0 2024-09-13T15:14:14.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.199+0000 7fb762a00640 1 --2- 172.21.15.7:0/556839089 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb744066690 0x7fb744068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:14.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.207+0000 7fb762a00640 1 --2- 172.21.15.7:0/556839089 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb744066690 0x7fb744068b50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb7500b2000 tx=0x7fb750008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:14.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.791+0000 7fb763e00640 1 -- 172.21.15.7:0/556839089 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7640c5dc0 con 0x7fb7640caea0 2024-09-13T15:14:14.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.795+0000 7fb75aa00640 1 -- 172.21.15.7:0/556839089 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+5528 (secure 0 0 0) 0x7fb754051af0 con 0x7fb7640caea0 2024-09-13T15:14:14.800 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:14:14.800 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":51,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:14:13.112535+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:14:14.801 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 51 2024-09-13T15:14:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.803+0000 7fb763e00640 1 -- 172.21.15.7:0/556839089 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb744066690 msgr2=0x7fb744068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.803+0000 7fb763e00640 1 --2- 172.21.15.7:0/556839089 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb744066690 0x7fb744068b50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb7500b2000 tx=0x7fb750008040 comp rx=0 tx=0).stop 2024-09-13T15:14:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.803+0000 7fb763e00640 1 -- 172.21.15.7:0/556839089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7640caea0 msgr2=0x7fb76415c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.803+0000 7fb763e00640 1 --2- 172.21.15.7:0/556839089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7640caea0 0x7fb76415c3e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb75400c480 tx=0x7fb75400c940 comp rx=0 tx=0).stop 2024-09-13T15:14:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.803+0000 7fb763e00640 1 -- 172.21.15.7:0/556839089 shutdown_connections 2024-09-13T15:14:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.803+0000 7fb763e00640 1 --2- 172.21.15.7:0/556839089 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb744066690 0x7fb744068b50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.803+0000 7fb763e00640 1 --2- 172.21.15.7:0/556839089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb76415e320 0x7fb7641f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:14.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.803+0000 7fb763e00640 1 --2- 172.21.15.7:0/556839089 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb7640caea0 0x7fb76415c3e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.803+0000 7fb763e00640 1 --2- 172.21.15.7:0/556839089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb7640caac0 0x7fb76415f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.803+0000 7fb763e00640 1 -- 172.21.15.7:0/556839089 >> 172.21.15.7:0/556839089 conn(0x7fb7640ce9c0 msgr2=0x7fb7640cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:14:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.803+0000 7fb763e00640 1 -- 172.21.15.7:0/556839089 shutdown_connections 2024-09-13T15:14:14.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:14.803+0000 7fb763e00640 1 -- 172.21.15.7:0/556839089 wait complete. 2024-09-13T15:14:14.849 INFO:tasks.mds_thrash.fs.[cephfs]:mds.d has gained rank=1, replacing gid=4267 2024-09-13T15:14:14.849 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 6 secs before reviving mds.f 2024-09-13T15:14:15.200 INFO:tasks.ceph.mds.c.smithi007.stderr:2024-09-13T15:14:15.199+0000 7ff9aa000640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-13T15:14:20.850 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.f 2024-09-13T15:14:20.851 INFO:tasks.ceph.mds.f:Restarting daemon 2024-09-13T15:14:20.851 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-09-13T15:14:20.853 INFO:tasks.ceph.mds.f:Started 2024-09-13T15:14:20.853 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:14:21.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.163+0000 7ff0eaa00640 1 Processor -- start 2024-09-13T15:14:21.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.163+0000 7ff0eaa00640 1 -- start start 2024-09-13T15:14:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.167+0000 7ff0eaa00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ff0dc0508f0 0x7ff0dc0db0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.167+0000 7ff0eaa00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff0dc045100 0x7ff0dc0d46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:21.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.167+0000 7ff0eaa00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc0db5f0 con 0x7ff0dc005c00 2024-09-13T15:14:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.167+0000 7ff0eaa00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc033010 con 0x7ff0dc0508f0 2024-09-13T15:14:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.167+0000 7ff0eaa00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0dc045a40 con 0x7ff0dc045100 2024-09-13T15:14:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.167+0000 7ff0e3e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff0dc045100 0x7ff0dc0d46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.167+0000 7ff0e3e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff0dc045100 0x7ff0dc0d46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:59794/0 (socket says 172.21.15.7:59794) 2024-09-13T15:14:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.167+0000 7ff0e3e00640 1 -- 172.21.15.7:0/3440733454 learned_addr learned my addr 172.21.15.7:0/3440733454 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:14:21.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.171+0000 7ff0e8c00640 1 --2- 172.21.15.7:0/3440733454 >> v2:172.21.15.7:3300/0 conn(0x7ff0dc0508f0 0x7ff0dc0db0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:21.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.171+0000 7ff0e3e00640 1 -- 172.21.15.7:0/3440733454 >> v2:172.21.15.7:3300/0 conn(0x7ff0dc0508f0 msgr2=0x7ff0dc0db0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:14:21.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.171+0000 7ff0e3e00640 1 --2- 172.21.15.7:0/3440733454 >> v2:172.21.15.7:3300/0 conn(0x7ff0dc0508f0 0x7ff0dc0db0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:21.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.171+0000 7ff0e3e00640 1 -- 172.21.15.7:0/3440733454 >> v1:172.21.15.7:6789/0 conn(0x7ff0dc005c00 legacy=0x7ff0dc04adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:21.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.171+0000 7ff0e3e00640 1 -- 172.21.15.7:0/3440733454 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc045d20 con 0x7ff0dc045100 2024-09-13T15:14:21.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.175+0000 7ff0e3e00640 1 --2- 172.21.15.7:0/3440733454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0dc045100 0x7ff0dc0d46c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc00df20 tx=0x7ff0d001c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41ee1ab8e6816d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:21.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.175+0000 7ff0ec000640 1 -- 172.21.15.7:0/3440733454 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00ab610 con 0x7ff0dc045100 2024-09-13T15:14:21.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.175+0000 7ff0ec000640 1 -- 172.21.15.7:0/3440733454 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d00ab770 con 0x7ff0dc045100 2024-09-13T15:14:21.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.175+0000 7ff0ec000640 1 -- 172.21.15.7:0/3440733454 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00abb00 con 0x7ff0dc045100 2024-09-13T15:14:21.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.179+0000 7ff0eaa00640 1 -- 172.21.15.7:0/3440733454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0dc045100 msgr2=0x7ff0dc0d46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.179+0000 7ff0eaa00640 1 --2- 172.21.15.7:0/3440733454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0dc045100 0x7ff0dc0d46c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc00df20 tx=0x7ff0d001c4f0 comp rx=0 tx=0).stop 2024-09-13T15:14:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.179+0000 7ff0eaa00640 1 -- 172.21.15.7:0/3440733454 shutdown_connections 2024-09-13T15:14:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.179+0000 7ff0eaa00640 1 --2- 172.21.15.7:0/3440733454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0dc045100 0x7ff0dc0d46c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.179+0000 7ff0eaa00640 1 --2- 172.21.15.7:0/3440733454 >> v2:172.21.15.7:3300/0 conn(0x7ff0dc0508f0 0x7ff0dc0db0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.179+0000 7ff0eaa00640 1 -- 172.21.15.7:0/3440733454 >> 172.21.15.7:0/3440733454 conn(0x7ff0dc04fe00 msgr2=0x7ff0dc0501e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:14:21.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.179+0000 7ff0eaa00640 1 -- 172.21.15.7:0/3440733454 shutdown_connections 2024-09-13T15:14:21.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.179+0000 7ff0eaa00640 1 -- 172.21.15.7:0/3440733454 wait complete. 2024-09-13T15:14:21.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.183+0000 7ff0eaa00640 1 Processor -- start 2024-09-13T15:14:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.187+0000 7ff0eaa00640 1 -- start start 2024-09-13T15:14:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.187+0000 7ff0eaa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0dc005c00 0x7ff0dc0d9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.187+0000 7ff0eaa00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0dc045100 0x7ff0dc0cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.187+0000 7ff0eaa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0dc0508f0 0x7ff0dc0d7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.187+0000 7ff0eaa00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0cf110 con 0x7ff0dc0508f0 2024-09-13T15:14:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.187+0000 7ff0eaa00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0da7f0 con 0x7ff0dc045100 2024-09-13T15:14:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.187+0000 7ff0eaa00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0da230 con 0x7ff0dc005c00 2024-09-13T15:14:21.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.187+0000 7ff0e8c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0dc005c00 0x7ff0dc0d9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:21.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.187+0000 7ff0e8c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0dc005c00 0x7ff0dc0d9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:37172/0 (socket says 172.21.15.7:37172) 2024-09-13T15:14:21.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.187+0000 7ff0e8c00640 1 -- 172.21.15.7:0/1734441558 learned_addr learned my addr 172.21.15.7:0/1734441558 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:14:21.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.187+0000 7ff0e3e00640 1 --2- 172.21.15.7:0/1734441558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0dc045100 0x7ff0dc0cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.191+0000 7ff0e9600640 1 --2- 172.21.15.7:0/1734441558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0dc0508f0 0x7ff0dc0d7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.191+0000 7ff0e8c00640 1 -- 172.21.15.7:0/1734441558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0dc045100 msgr2=0x7ff0dc0cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.191+0000 7ff0e8c00640 1 --2- 172.21.15.7:0/1734441558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0dc045100 0x7ff0dc0cebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.191+0000 7ff0e8c00640 1 -- 172.21.15.7:0/1734441558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0dc0508f0 msgr2=0x7ff0dc0d7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.191+0000 7ff0e8c00640 1 --2- 172.21.15.7:0/1734441558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0dc0508f0 0x7ff0dc0d7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.191+0000 7ff0e8c00640 1 -- 172.21.15.7:0/1734441558 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d00094d0 con 0x7ff0dc005c00 2024-09-13T15:14:21.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.191+0000 7ff0e3e00640 1 --2- 172.21.15.7:0/1734441558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0dc045100 0x7ff0dc0cebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:14:21.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.191+0000 7ff0e9600640 1 --2- 172.21.15.7:0/1734441558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0dc0508f0 0x7ff0dc0d7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:14:21.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.195+0000 7ff0e8c00640 1 --2- 172.21.15.7:0/1734441558 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0dc005c00 0x7ff0dc0d9c10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4063c50 tx=0x7ff0e4067500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:21.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.195+0000 7ff0e1600640 1 -- 172.21.15.7:0/1734441558 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e406e050 con 0x7ff0dc005c00 2024-09-13T15:14:21.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.195+0000 7ff0e1600640 1 -- 172.21.15.7:0/1734441558 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e406f040 con 0x7ff0dc005c00 2024-09-13T15:14:21.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.195+0000 7ff0e1600640 1 -- 172.21.15.7:0/1734441558 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4068650 con 0x7ff0dc005c00 2024-09-13T15:14:21.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.195+0000 7ff0eaa00640 1 -- 172.21.15.7:0/1734441558 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0dc0da510 con 0x7ff0dc005c00 2024-09-13T15:14:21.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.195+0000 7ff0eaa00640 1 -- 172.21.15.7:0/1734441558 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0dc17c200 con 0x7ff0dc005c00 2024-09-13T15:14:21.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.199+0000 7ff0e1600640 1 -- 172.21.15.7:0/1734441558 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff0e409e440 con 0x7ff0dc005c00 2024-09-13T15:14:21.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.199+0000 7ff0d6a00640 1 -- 172.21.15.7:0/1734441558 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b8005260 con 0x7ff0dc005c00 2024-09-13T15:14:21.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.203+0000 7ff0e1600640 1 --2- 172.21.15.7:0/1734441558 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff0c40666e0 0x7ff0c4068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:21.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.203+0000 7ff0e1600640 1 -- 172.21.15.7:0/1734441558 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7ff0e40febb0 con 0x7ff0dc005c00 2024-09-13T15:14:21.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.203+0000 7ff0e3e00640 1 --2- 172.21.15.7:0/1734441558 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff0c40666e0 0x7ff0c4068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:21.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.207+0000 7ff0e3e00640 1 --2- 172.21.15.7:0/1734441558 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff0c40666e0 0x7ff0c4068ba0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00af000 tx=0x7ff0d00a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:21.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.211+0000 7ff0e1600640 1 -- 172.21.15.7:0/1734441558 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff0e4105080 con 0x7ff0dc005c00 2024-09-13T15:14:21.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.675+0000 7ff0d6a00640 1 -- 172.21.15.7:0/1734441558 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0b8005510 con 0x7ff0dc005c00 2024-09-13T15:14:21.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.675+0000 7ff0e1600640 1 -- 172.21.15.7:0/1734441558 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+5528 (secure 0 0 0) 0x7ff0e40cba30 con 0x7ff0dc005c00 2024-09-13T15:14:21.677 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:14:21.677 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":51,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:14:13.112535+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:14:21.678 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 51 2024-09-13T15:14:21.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.679+0000 7ff0d6a00640 1 -- 172.21.15.7:0/1734441558 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff0c40666e0 msgr2=0x7ff0c4068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:21.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.679+0000 7ff0d6a00640 1 --2- 172.21.15.7:0/1734441558 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff0c40666e0 0x7ff0c4068ba0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00af000 tx=0x7ff0d00a7000 comp rx=0 tx=0).stop 2024-09-13T15:14:21.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.679+0000 7ff0d6a00640 1 -- 172.21.15.7:0/1734441558 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0dc005c00 msgr2=0x7ff0dc0d9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:21.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.679+0000 7ff0d6a00640 1 --2- 172.21.15.7:0/1734441558 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0dc005c00 0x7ff0dc0d9c10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4063c50 tx=0x7ff0e4067500 comp rx=0 tx=0).stop 2024-09-13T15:14:21.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.679+0000 7ff0d6a00640 1 -- 172.21.15.7:0/1734441558 shutdown_connections 2024-09-13T15:14:21.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.679+0000 7ff0d6a00640 1 --2- 172.21.15.7:0/1734441558 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ff0c40666e0 0x7ff0c4068ba0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:21.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.679+0000 7ff0d6a00640 1 --2- 172.21.15.7:0/1734441558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff0dc0508f0 0x7ff0dc0d7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:21.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.679+0000 7ff0d6a00640 1 --2- 172.21.15.7:0/1734441558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0dc045100 0x7ff0dc0cebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:21.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.679+0000 7ff0d6a00640 1 --2- 172.21.15.7:0/1734441558 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ff0dc005c00 0x7ff0dc0d9c10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:21.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.679+0000 7ff0d6a00640 1 -- 172.21.15.7:0/1734441558 >> 172.21.15.7:0/1734441558 conn(0x7ff0dc04fe00 msgr2=0x7ff0dc004b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:14:21.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.679+0000 7ff0d6a00640 1 -- 172.21.15.7:0/1734441558 shutdown_connections 2024-09-13T15:14:21.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:21.679+0000 7ff0d6a00640 1 -- 172.21.15.7:0/1734441558 wait complete. 2024-09-13T15:14:21.719 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.f is in active, standby or standby-replay 2024-09-13T15:14:21.935 INFO:tasks.ceph.mds.f.smithi077.stdout:starting mds.f at 2024-09-13T15:14:23.721 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:14:24.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.019+0000 7f41ffc00640 1 Processor -- start 2024-09-13T15:14:24.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.019+0000 7f41ffc00640 1 -- start start 2024-09-13T15:14:24.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.023+0000 7f41ffc00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f41f80c5ab0 0x7f41f80c6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:24.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.023+0000 7f41ffc00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f41f80c5e90 0x7f41f80c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:24.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.023+0000 7f41ffc00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f81660b0 con 0x7f41f80c8060 2024-09-13T15:14:24.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.023+0000 7f41ffc00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f8166d30 con 0x7f41f80c5ab0 2024-09-13T15:14:24.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.023+0000 7f41ffc00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f806fdf0 con 0x7f41f80c5e90 2024-09-13T15:14:24.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.027+0000 7f41f7e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f41f80c5e90 0x7f41f80c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:24.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.027+0000 7f41f7e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f41f80c5e90 0x7f41f80c6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:59810/0 (socket says 172.21.15.7:59810) 2024-09-13T15:14:24.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.027+0000 7f41f7e00640 1 -- 172.21.15.7:0/2538056935 learned_addr learned my addr 172.21.15.7:0/2538056935 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:14:24.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.031+0000 7f41fd200640 1 --2- 172.21.15.7:0/2538056935 >> v2:172.21.15.7:3300/0 conn(0x7f41f80c5ab0 0x7f41f80c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:24.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.031+0000 7f41f7400640 1 -- 172.21.15.7:0/2538056935 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999002512 0 0) 0x7f41f81660b0 con 0x7f41f80c8060 2024-09-13T15:14:24.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.327+0000 7f41fd200640 1 -- 172.21.15.7:0/2538056935 >> v2:172.21.15.77:3300/0 conn(0x7f41f80c5e90 msgr2=0x7f41f80c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:14:24.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.327+0000 7f41fd200640 1 --2- 172.21.15.7:0/2538056935 >> v2:172.21.15.77:3300/0 conn(0x7f41f80c5e90 0x7f41f80c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:24.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.327+0000 7f41fd200640 1 -- 172.21.15.7:0/2538056935 >> v1:172.21.15.7:6789/0 conn(0x7f41f80c8060 legacy=0x7f41f806ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:24.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.327+0000 7f41fd200640 1 -- 172.21.15.7:0/2538056935 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f8166390 con 0x7f41f80c5ab0 2024-09-13T15:14:24.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.339+0000 7f41fd200640 1 --2- 172.21.15.7:0/2538056935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f80c5ab0 0x7f41f80c6800 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f41f806ad20 tx=0x7f41e8027540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeafba946b48accd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:24.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.355+0000 7f41f7400640 1 -- 172.21.15.7:0/2538056935 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e800b0d0 con 0x7f41f80c5ab0 2024-09-13T15:14:24.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.355+0000 7f41f7400640 1 -- 172.21.15.7:0/2538056935 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e800b230 con 0x7f41f80c5ab0 2024-09-13T15:14:24.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.355+0000 7f41f7400640 1 -- 172.21.15.7:0/2538056935 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e8009640 con 0x7f41f80c5ab0 2024-09-13T15:14:24.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.375+0000 7f41ffc00640 1 -- 172.21.15.7:0/2538056935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f80c5ab0 msgr2=0x7f41f80c6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:24.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.375+0000 7f41ffc00640 1 --2- 172.21.15.7:0/2538056935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f80c5ab0 0x7f41f80c6800 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f41f806ad20 tx=0x7f41e8027540 comp rx=0 tx=0).stop 2024-09-13T15:14:24.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.375+0000 7f41ffc00640 1 -- 172.21.15.7:0/2538056935 shutdown_connections 2024-09-13T15:14:24.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.375+0000 7f41ffc00640 1 --2- 172.21.15.7:0/2538056935 >> v2:172.21.15.77:3300/0 conn(0x7f41f80c5e90 0x7f41f80c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:24.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.375+0000 7f41ffc00640 1 --2- 172.21.15.7:0/2538056935 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f80c5ab0 0x7f41f80c6800 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:24.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.375+0000 7f41ffc00640 1 -- 172.21.15.7:0/2538056935 >> 172.21.15.7:0/2538056935 conn(0x7f41f8065d40 msgr2=0x7f41f8066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:14:24.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.379+0000 7f41ffc00640 1 -- 172.21.15.7:0/2538056935 shutdown_connections 2024-09-13T15:14:24.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.379+0000 7f41ffc00640 1 -- 172.21.15.7:0/2538056935 wait complete. 2024-09-13T15:14:24.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.379+0000 7f41ffc00640 1 Processor -- start 2024-09-13T15:14:24.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.387+0000 7f41ffc00640 1 -- start start 2024-09-13T15:14:24.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.387+0000 7f41ffc00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41f80c5ab0 0x7f41f81fc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:24.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.387+0000 7f41ffc00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f80c5e90 0x7f41f815de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:24.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.387+0000 7f41ffc00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f80c8060 0x7f41f80a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:24.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.387+0000 7f41ffc00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80c30a0 con 0x7f41f80c8060 2024-09-13T15:14:24.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.387+0000 7f41ffc00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80c3bb0 con 0x7f41f80c5e90 2024-09-13T15:14:24.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.387+0000 7f41ffc00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f80aa260 con 0x7f41f80c5ab0 2024-09-13T15:14:24.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.391+0000 7f41f7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f80c5e90 0x7f41f815de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:24.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.391+0000 7f41f7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f80c5e90 0x7f41f815de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:59820/0 (socket says 172.21.15.7:59820) 2024-09-13T15:14:24.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.391+0000 7f41f7e00640 1 -- 172.21.15.7:0/1784078415 learned_addr learned my addr 172.21.15.7:0/1784078415 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:14:24.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.391+0000 7f41fd200640 1 --2- 172.21.15.7:0/1784078415 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41f80c5ab0 0x7f41f81fc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:24.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.391+0000 7f41f7e00640 1 -- 172.21.15.7:0/1784078415 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41f80c5ab0 msgr2=0x7f41f81fc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:24.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.391+0000 7f41f7e00640 1 --2- 172.21.15.7:0/1784078415 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41f80c5ab0 0x7f41f81fc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:24.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.391+0000 7f41fdc00640 1 --2- 172.21.15.7:0/1784078415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f80c8060 0x7f41f80a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:24.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.391+0000 7f41f7e00640 1 -- 172.21.15.7:0/1784078415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f80c8060 msgr2=0x7f41f80a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:24.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.391+0000 7f41f7e00640 1 --2- 172.21.15.7:0/1784078415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f80c8060 0x7f41f80a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:24.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.391+0000 7f41f7e00640 1 -- 172.21.15.7:0/1784078415 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e800b6a0 con 0x7f41f80c5e90 2024-09-13T15:14:24.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.391+0000 7f41fdc00640 1 --2- 172.21.15.7:0/1784078415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f80c8060 0x7f41f80a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:14:24.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.391+0000 7f41f7e00640 1 --2- 172.21.15.7:0/1784078415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f80c5e90 0x7f41f815de40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f41e400eb00 tx=0x7f41e400a810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:24.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.391+0000 7f41f4c00640 1 -- 172.21.15.7:0/1784078415 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e400f040 con 0x7f41f80c5e90 2024-09-13T15:14:24.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.391+0000 7f41f4c00640 1 -- 172.21.15.7:0/1784078415 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e400cb60 con 0x7f41f80c5e90 2024-09-13T15:14:24.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.391+0000 7f41ffc00640 1 -- 172.21.15.7:0/1784078415 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f81fc870 con 0x7f41f80c5e90 2024-09-13T15:14:24.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.391+0000 7f41f4c00640 1 -- 172.21.15.7:0/1784078415 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e400ced0 con 0x7f41f80c5e90 2024-09-13T15:14:24.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.391+0000 7f41ffc00640 1 -- 172.21.15.7:0/1784078415 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f80c25b0 con 0x7f41f80c5e90 2024-09-13T15:14:24.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.395+0000 7f41ffc00640 1 -- 172.21.15.7:0/1784078415 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f8067650 con 0x7f41f80c5e90 2024-09-13T15:14:24.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.395+0000 7f41f4c00640 1 -- 172.21.15.7:0/1784078415 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f41e4014470 con 0x7f41f80c5e90 2024-09-13T15:14:24.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.395+0000 7f41f4c00640 1 --2- 172.21.15.7:0/1784078415 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f41d8066760 0x7f41d8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:14:24.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.395+0000 7f41f4c00640 1 -- 172.21.15.7:0/1784078415 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f41e40848e0 con 0x7f41f80c5e90 2024-09-13T15:14:24.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.399+0000 7f41fd200640 1 --2- 172.21.15.7:0/1784078415 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f41d8066760 0x7f41d8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:14:24.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.399+0000 7f41fd200640 1 --2- 172.21.15.7:0/1784078415 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f41d8066760 0x7f41d8068c20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f41e80ba000 tx=0x7f41e80b2040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:14:24.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.411+0000 7f41f4c00640 1 -- 172.21.15.7:0/1784078415 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f41e40516c0 con 0x7f41f80c5e90 2024-09-13T15:14:24.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.819+0000 7f41ffc00640 1 -- 172.21.15.7:0/1784078415 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41f80c3910 con 0x7f41f80c5e90 2024-09-13T15:14:24.822 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:14:24.822 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5710,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:14:13.112535+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:14:24.823 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 52 2024-09-13T15:14:24.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.819+0000 7f41f4c00640 1 -- 172.21.15.7:0/1784078415 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6285 (secure 0 0 0) 0x7f41f80c3910 con 0x7f41f80c5e90 2024-09-13T15:14:24.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.831+0000 7f41ffc00640 1 -- 172.21.15.7:0/1784078415 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f41d8066760 msgr2=0x7f41d8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:24.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.831+0000 7f41ffc00640 1 --2- 172.21.15.7:0/1784078415 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f41d8066760 0x7f41d8068c20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f41e80ba000 tx=0x7f41e80b2040 comp rx=0 tx=0).stop 2024-09-13T15:14:24.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.831+0000 7f41ffc00640 1 -- 172.21.15.7:0/1784078415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f80c5e90 msgr2=0x7f41f815de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:14:24.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.831+0000 7f41ffc00640 1 --2- 172.21.15.7:0/1784078415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f80c5e90 0x7f41f815de40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f41e400eb00 tx=0x7f41e400a810 comp rx=0 tx=0).stop 2024-09-13T15:14:24.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.831+0000 7f41ffc00640 1 -- 172.21.15.7:0/1784078415 shutdown_connections 2024-09-13T15:14:24.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.831+0000 7f41ffc00640 1 --2- 172.21.15.7:0/1784078415 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f41d8066760 0x7f41d8068c20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:24.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.831+0000 7f41ffc00640 1 --2- 172.21.15.7:0/1784078415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f41f80c8060 0x7f41f80a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:24.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.831+0000 7f41ffc00640 1 --2- 172.21.15.7:0/1784078415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f80c5e90 0x7f41f815de40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:24.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.831+0000 7f41ffc00640 1 --2- 172.21.15.7:0/1784078415 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f41f80c5ab0 0x7f41f81fc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:14:24.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.831+0000 7f41ffc00640 1 -- 172.21.15.7:0/1784078415 >> 172.21.15.7:0/1784078415 conn(0x7f41f8065d40 msgr2=0x7f41f80c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:14:24.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.831+0000 7f41ffc00640 1 -- 172.21.15.7:0/1784078415 shutdown_connections 2024-09-13T15:14:24.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:14:24.831+0000 7f41ffc00640 1 -- 172.21.15.7:0/1784078415 wait complete. 2024-09-13T15:14:24.884 INFO:tasks.mds_thrash.fs.[cephfs]:mds.f reported in up:standby state 2024-09-13T15:14:24.885 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 47 secs before thrashing 2024-09-13T15:14:58.909 INFO:tasks.workunit.client.0.smithi007.stdout:Syncing()...118 sec 2024-09-13T15:14:58.909 INFO:tasks.workunit.client.0.smithi007.stdout:FFSB benchmark finished at: Fri Sep 13 15:14:58 2024 2024-09-13T15:14:58.909 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:14:58.909 INFO:tasks.workunit.client.0.smithi007.stdout:Results: 2024-09-13T15:14:58.909 INFO:tasks.workunit.client.0.smithi007.stdout:Benchmark took 434.65 sec 2024-09-13T15:14:58.909 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:14:58.909 INFO:tasks.workunit.client.0.smithi007.stdout:Total Results 2024-09-13T15:14:58.910 INFO:tasks.workunit.client.0.smithi007.stdout:=============== 2024-09-13T15:14:58.910 INFO:tasks.workunit.client.0.smithi007.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-13T15:14:58.910 INFO:tasks.workunit.client.0.smithi007.stdout: ======= ============ ========= ======= =========== ========== 2024-09-13T15:14:58.910 INFO:tasks.workunit.client.0.smithi007.stdout: write : 6730240 15484.10 100.000% 100.000% 60.5MB/sec 2024-09-13T15:14:58.910 INFO:tasks.workunit.client.0.smithi007.stdout:- 2024-09-13T15:14:58.910 INFO:tasks.workunit.client.0.smithi007.stdout:15484.10 Transactions per Second 2024-09-13T15:14:58.910 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:14:58.910 INFO:tasks.workunit.client.0.smithi007.stdout:Throughput Results 2024-09-13T15:14:58.910 INFO:tasks.workunit.client.0.smithi007.stdout:=================== 2024-09-13T15:14:58.910 INFO:tasks.workunit.client.0.smithi007.stdout:Write Throughput: 60.5MB/sec 2024-09-13T15:14:58.979 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:14:58.979 INFO:tasks.workunit.client.0.smithi007.stdout:System Call Latency statistics in millisecs 2024-09-13T15:14:58.979 INFO:tasks.workunit.client.0.smithi007.stdout:===== 2024-09-13T15:14:58.979 INFO:tasks.workunit.client.0.smithi007.stdout: Min Avg Max Total Calls 2024-09-13T15:14:58.979 INFO:tasks.workunit.client.0.smithi007.stdout: ======== ======== ======== ============ 2024-09-13T15:14:58.979 INFO:tasks.workunit.client.0.smithi007.stdout:[ open] 0.017000 1.772214 420.585999 5258 2024-09-13T15:14:58.980 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-13T15:14:58.980 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-13T15:14:58.980 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-13T15:14:58.980 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-13T15:14:58.980 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[4] 200.000000 - 500.000000 : 14 2024-09-13T15:14:58.980 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[5] 100.000000 - 200.000000 : 14 2024-09-13T15:14:58.980 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[6] 50.000000 - 100.000000 : 14 2024-09-13T15:14:58.980 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[7] 20.000000 - 50.000000 : 33 2024-09-13T15:14:58.980 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[8] 10.000000 - 20.000000 : 44 2024-09-13T15:14:58.980 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[9] 5.000000 - 10.000000 : 66 2024-09-13T15:14:58.980 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[10] 2.000000 - 5.000000 : 55 2024-09-13T15:14:58.980 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[11] 1.000000 - 2.000000 : 53 2024-09-13T15:14:58.980 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[12] 0.500000 - 1.000000 : 20 2024-09-13T15:14:58.981 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[13] 0.200000 - 0.500000 : 58 2024-09-13T15:14:58.981 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[14] 0.100000 - 0.200000 : 177 2024-09-13T15:14:58.981 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[15] 0.050000 - 0.100000 : 290 2024-09-13T15:14:58.981 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[16] 0.020000 - 0.050000 : 4411 2024-09-13T15:14:58.981 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[17] 0.010000 - 0.020000 : 9 2024-09-13T15:14:58.981 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-13T15:14:58.981 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:14:58.981 INFO:tasks.workunit.client.0.smithi007.stdout:[ write] 0.003000 1.446743 20779.111328 6730240 2024-09-13T15:14:58.981 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[0] 5000.000000 - 10000.000000 : 248 2024-09-13T15:14:58.981 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[1] 2000.000000 - 5000.000000 : 317 2024-09-13T15:14:58.981 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[2] 1000.000000 - 2000.000000 : 214 2024-09-13T15:14:58.981 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[3] 500.000000 - 1000.000000 : 224 2024-09-13T15:14:58.981 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[4] 200.000000 - 500.000000 : 2130 2024-09-13T15:14:58.982 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[5] 100.000000 - 200.000000 : 11552 2024-09-13T15:14:58.982 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[6] 50.000000 - 100.000000 : 30725 2024-09-13T15:14:58.982 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[7] 20.000000 - 50.000000 : 2854 2024-09-13T15:14:58.982 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[8] 10.000000 - 20.000000 : 2139 2024-09-13T15:14:58.982 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[9] 5.000000 - 10.000000 : 2237 2024-09-13T15:14:58.982 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[10] 2.000000 - 5.000000 : 4274 2024-09-13T15:14:58.982 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[11] 1.000000 - 2.000000 : 3317 2024-09-13T15:14:58.982 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[12] 0.500000 - 1.000000 : 3203 2024-09-13T15:14:58.982 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[13] 0.200000 - 0.500000 : 5925 2024-09-13T15:14:58.982 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[14] 0.100000 - 0.200000 : 8700 2024-09-13T15:14:58.982 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[15] 0.050000 - 0.100000 : 19214 2024-09-13T15:14:58.982 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[16] 0.020000 - 0.050000 : 145987 2024-09-13T15:14:58.982 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[17] 0.010000 - 0.020000 : 2540769 2024-09-13T15:14:58.982 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[18] 0.000000 - 0.010000 : 3946082 2024-09-13T15:14:58.983 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:14:58.983 INFO:tasks.workunit.client.0.smithi007.stdout:[ lseek] 0.000000 0.002208 95.500999 6730240 2024-09-13T15:14:58.983 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-13T15:14:58.983 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-13T15:14:58.983 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-13T15:14:58.983 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-13T15:14:58.983 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-13T15:14:58.983 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-13T15:14:58.983 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[6] 50.000000 - 100.000000 : 8 2024-09-13T15:14:58.983 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[7] 20.000000 - 50.000000 : 57 2024-09-13T15:14:58.983 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[8] 10.000000 - 20.000000 : 162 2024-09-13T15:14:58.983 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[9] 5.000000 - 10.000000 : 163 2024-09-13T15:14:58.983 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[10] 2.000000 - 5.000000 : 346 2024-09-13T15:14:58.983 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[11] 1.000000 - 2.000000 : 258 2024-09-13T15:14:58.984 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[12] 0.500000 - 1.000000 : 261 2024-09-13T15:14:58.984 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[13] 0.200000 - 0.500000 : 385 2024-09-13T15:14:58.984 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[14] 0.100000 - 0.200000 : 493 2024-09-13T15:14:58.984 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[15] 0.050000 - 0.100000 : 955 2024-09-13T15:14:58.984 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[16] 0.020000 - 0.050000 : 3847 2024-09-13T15:14:58.984 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[17] 0.010000 - 0.020000 : 2046 2024-09-13T15:14:58.984 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[18] 0.000000 - 0.010000 : 6721259 2024-09-13T15:14:58.984 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:14:58.984 INFO:tasks.workunit.client.0.smithi007.stdout:[ close] 0.004000 0.015857 12.150000 5258 2024-09-13T15:14:58.984 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-13T15:14:58.984 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-13T15:14:58.984 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-13T15:14:58.985 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-13T15:14:58.985 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-13T15:14:58.985 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-13T15:14:58.985 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-13T15:14:58.985 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[7] 20.000000 - 50.000000 : 0 2024-09-13T15:14:58.985 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[8] 10.000000 - 20.000000 : 1 2024-09-13T15:14:58.985 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[9] 5.000000 - 10.000000 : 1 2024-09-13T15:14:58.985 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[10] 2.000000 - 5.000000 : 2 2024-09-13T15:14:58.985 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[11] 1.000000 - 2.000000 : 2 2024-09-13T15:14:58.985 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[12] 0.500000 - 1.000000 : 1 2024-09-13T15:14:58.985 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[13] 0.200000 - 0.500000 : 3 2024-09-13T15:14:58.985 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[14] 0.100000 - 0.200000 : 3 2024-09-13T15:14:58.985 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[15] 0.050000 - 0.100000 : 8 2024-09-13T15:14:58.986 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[16] 0.020000 - 0.050000 : 24 2024-09-13T15:14:58.986 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[17] 0.010000 - 0.020000 : 2875 2024-09-13T15:14:58.986 INFO:tasks.workunit.client.0.smithi007.stdout: msec_range[18] 0.000000 - 0.010000 : 2338 2024-09-13T15:14:58.986 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:14:58.986 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:14:58.986 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:14:58.986 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-13T15:14:58.986 INFO:tasks.workunit.client.0.smithi007.stdout:1.7% User Time 2024-09-13T15:14:58.986 INFO:tasks.workunit.client.0.smithi007.stdout:17.4% System Time 2024-09-13T15:14:58.986 INFO:tasks.workunit.client.0.smithi007.stdout:19.1% CPU Utilization 2024-09-13T15:15:07.483 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T15:15:07.483 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T15:15:07.698 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-09-13T15:15:07.698 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T15:15:11.886 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:12.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.154+0000 7f88ada00640 1 Processor -- start 2024-09-13T15:15:12.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.154+0000 7f88ada00640 1 -- start start 2024-09-13T15:15:12.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.158+0000 7f88ada00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88a8066860 0x7f88a80c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:12.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.162+0000 7f88ada00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f88a8158bb0 0x7f88a8158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:12.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.162+0000 7f88ada00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a8158720 con 0x7f88a80c08a0 2024-09-13T15:15:12.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.162+0000 7f88ada00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a8155130 con 0x7f88a8158bb0 2024-09-13T15:15:12.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.162+0000 7f88a6a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88a8066860 0x7f88a80c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:12.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.162+0000 7f88a6a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88a8066860 0x7f88a80c5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:40060/0 (socket says 172.21.15.7:40060) 2024-09-13T15:15:12.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.162+0000 7f88a6a00640 1 -- 172.21.15.7:0/1802993635 learned_addr learned my addr 172.21.15.7:0/1802993635 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:12.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.162+0000 7f88ada00640 1 -- 172.21.15.7:0/1802993635 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a81555e0 con 0x7f88a8066860 2024-09-13T15:15:12.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.162+0000 7f88a6a00640 1 -- 172.21.15.7:0/1802993635 >> v2:172.21.15.7:3300/0 conn(0x7f88a8158bb0 msgr2=0x7f88a8158fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:15:12.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.162+0000 7f88a6a00640 1 --2- 172.21.15.7:0/1802993635 >> v2:172.21.15.7:3300/0 conn(0x7f88a8158bb0 0x7f88a8158fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:12.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.162+0000 7f88a6a00640 1 -- 172.21.15.7:0/1802993635 >> v1:172.21.15.7:6789/0 conn(0x7f88a80c08a0 legacy=0x7f88a80c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:12.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.162+0000 7f88a6a00640 1 -- 172.21.15.7:0/1802993635 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a81558c0 con 0x7f88a8066860 2024-09-13T15:15:12.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.166+0000 7f88a6a00640 1 --2- 172.21.15.7:0/1802993635 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88a8066860 0x7f88a80c5cc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8898009870 tx=0x7f8898020980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dcd479768f9fafc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:12.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.170+0000 7f88a5600640 1 -- 172.21.15.7:0/1802993635 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88980a9920 con 0x7f88a8066860 2024-09-13T15:15:12.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.170+0000 7f88a5600640 1 -- 172.21.15.7:0/1802993635 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88980a9a80 con 0x7f88a8066860 2024-09-13T15:15:12.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.170+0000 7f88a5600640 1 -- 172.21.15.7:0/1802993635 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88980a9e10 con 0x7f88a8066860 2024-09-13T15:15:12.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.170+0000 7f88ada00640 1 -- 172.21.15.7:0/1802993635 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88a8066860 msgr2=0x7f88a80c5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:12.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.170+0000 7f88ada00640 1 --2- 172.21.15.7:0/1802993635 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88a8066860 0x7f88a80c5cc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8898009870 tx=0x7f8898020980 comp rx=0 tx=0).stop 2024-09-13T15:15:12.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.174+0000 7f88ada00640 1 -- 172.21.15.7:0/1802993635 shutdown_connections 2024-09-13T15:15:12.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.174+0000 7f88ada00640 1 --2- 172.21.15.7:0/1802993635 >> v2:172.21.15.7:3300/0 conn(0x7f88a8158bb0 0x7f88a8158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:12.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.174+0000 7f88ada00640 1 --2- 172.21.15.7:0/1802993635 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88a8066860 0x7f88a80c5cc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:12.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.174+0000 7f88ada00640 1 -- 172.21.15.7:0/1802993635 >> 172.21.15.7:0/1802993635 conn(0x7f88a8065d40 msgr2=0x7f88a8066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:12.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.178+0000 7f88ada00640 1 -- 172.21.15.7:0/1802993635 shutdown_connections 2024-09-13T15:15:12.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.178+0000 7f88ada00640 1 -- 172.21.15.7:0/1802993635 wait complete. 2024-09-13T15:15:12.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.182+0000 7f88ada00640 1 Processor -- start 2024-09-13T15:15:12.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.182+0000 7f88ada00640 1 -- start start 2024-09-13T15:15:12.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.182+0000 7f88ada00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88a8066860 0x7f88a8201860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:12.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.182+0000 7f88ada00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a80c08a0 0x7f88a81ebda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:12.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.182+0000 7f88ada00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88a8158bb0 0x7f88a81ec2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:12.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.182+0000 7f88a6a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88a8066860 0x7f88a8201860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:12.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.186+0000 7f88a6a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88a8066860 0x7f88a8201860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:40064/0 (socket says 172.21.15.7:40064) 2024-09-13T15:15:12.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.186+0000 7f88a6000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a80c08a0 0x7f88a81ebda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:12.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.186+0000 7f88a6000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a80c08a0 0x7f88a81ebda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:40234/0 (socket says 172.21.15.7:40234) 2024-09-13T15:15:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.186+0000 7f88ada00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a81ff500 con 0x7f88a8158bb0 2024-09-13T15:15:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.186+0000 7f88ada00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a812bf40 con 0x7f88a80c08a0 2024-09-13T15:15:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.186+0000 7f88ada00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a80c3ad0 con 0x7f88a8066860 2024-09-13T15:15:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.186+0000 7f88a6a00640 1 -- 172.21.15.7:0/2101438367 learned_addr learned my addr 172.21.15.7:0/2101438367 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.186+0000 7f88a7400640 1 --2- 172.21.15.7:0/2101438367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88a8158bb0 0x7f88a81ec2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.186+0000 7f88a6000640 1 -- 172.21.15.7:0/2101438367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88a8066860 msgr2=0x7f88a8201860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.186+0000 7f88a6000640 1 --2- 172.21.15.7:0/2101438367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88a8066860 0x7f88a8201860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:12.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.186+0000 7f88a6000640 1 -- 172.21.15.7:0/2101438367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88a8158bb0 msgr2=0x7f88a81ec2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:12.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.186+0000 7f88a6000640 1 --2- 172.21.15.7:0/2101438367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88a8158bb0 0x7f88a81ec2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:12.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.186+0000 7f88a6000640 1 -- 172.21.15.7:0/2101438367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88980094d0 con 0x7f88a80c08a0 2024-09-13T15:15:12.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.190+0000 7f88a6a00640 1 --2- 172.21.15.7:0/2101438367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88a8066860 0x7f88a8201860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-13T15:15:12.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.190+0000 7f88a6000640 1 --2- 172.21.15.7:0/2101438367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a80c08a0 0x7f88a81ebda0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f889400c3c0 tx=0x7f889400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:12.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.194+0000 7f889ea00640 1 -- 172.21.15.7:0/2101438367 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88940052d0 con 0x7f88a80c08a0 2024-09-13T15:15:12.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.194+0000 7f88ada00640 1 -- 172.21.15.7:0/2101438367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a80c4ee0 con 0x7f88a80c08a0 2024-09-13T15:15:12.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.194+0000 7f88ada00640 1 -- 172.21.15.7:0/2101438367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a8202410 con 0x7f88a80c08a0 2024-09-13T15:15:12.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.194+0000 7f889ea00640 1 -- 172.21.15.7:0/2101438367 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8894005430 con 0x7f88a80c08a0 2024-09-13T15:15:12.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.194+0000 7f889ea00640 1 -- 172.21.15.7:0/2101438367 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894007260 con 0x7f88a80c08a0 2024-09-13T15:15:12.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.194+0000 7f88ada00640 1 -- 172.21.15.7:0/2101438367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8880005260 con 0x7f88a80c08a0 2024-09-13T15:15:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.198+0000 7f889ea00640 1 -- 172.21.15.7:0/2101438367 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8894007480 con 0x7f88a80c08a0 2024-09-13T15:15:12.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.202+0000 7f889ea00640 1 --2- 172.21.15.7:0/2101438367 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8888066690 0x7f8888068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.206+0000 7f889ea00640 1 -- 172.21.15.7:0/2101438367 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f8894083930 con 0x7f88a80c08a0 2024-09-13T15:15:12.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.210+0000 7f88a6a00640 1 --2- 172.21.15.7:0/2101438367 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8888066690 0x7f8888068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:12.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.210+0000 7f88a6a00640 1 --2- 172.21.15.7:0/2101438367 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8888066690 0x7f8888068b50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f889801e5b0 tx=0x7f88980ab070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:12.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.210+0000 7f889ea00640 1 -- 172.21.15.7:0/2101438367 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f88940507d0 con 0x7f88a80c08a0 2024-09-13T15:15:12.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.550+0000 7f88ada00640 1 -- 172.21.15.7:0/2101438367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8880005a90 con 0x7f88a80c08a0 2024-09-13T15:15:12.555 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:12.555 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5710,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:14:13.112535+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:12.555 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 52 2024-09-13T15:15:12.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.554+0000 7f889ea00640 1 -- 172.21.15.7:0/2101438367 <== mon.1 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6285 (secure 0 0 0) 0x7f8894053df0 con 0x7f88a80c08a0 2024-09-13T15:15:12.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.554+0000 7f88ada00640 1 -- 172.21.15.7:0/2101438367 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8888066690 msgr2=0x7f8888068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:12.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.554+0000 7f88ada00640 1 --2- 172.21.15.7:0/2101438367 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8888066690 0x7f8888068b50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f889801e5b0 tx=0x7f88980ab070 comp rx=0 tx=0).stop 2024-09-13T15:15:12.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.554+0000 7f88ada00640 1 -- 172.21.15.7:0/2101438367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a80c08a0 msgr2=0x7f88a81ebda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:12.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.554+0000 7f88ada00640 1 --2- 172.21.15.7:0/2101438367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a80c08a0 0x7f88a81ebda0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f889400c3c0 tx=0x7f889400c880 comp rx=0 tx=0).stop 2024-09-13T15:15:12.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.554+0000 7f88ada00640 1 -- 172.21.15.7:0/2101438367 shutdown_connections 2024-09-13T15:15:12.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.554+0000 7f88ada00640 1 --2- 172.21.15.7:0/2101438367 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8888066690 0x7f8888068b50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:12.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.554+0000 7f88ada00640 1 --2- 172.21.15.7:0/2101438367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f88a8158bb0 0x7f88a81ec2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:12.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.554+0000 7f88ada00640 1 --2- 172.21.15.7:0/2101438367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a80c08a0 0x7f88a81ebda0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:12.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.554+0000 7f88ada00640 1 --2- 172.21.15.7:0/2101438367 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f88a8066860 0x7f88a8201860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:12.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.554+0000 7f88ada00640 1 -- 172.21.15.7:0/2101438367 >> 172.21.15.7:0/2101438367 conn(0x7f88a8065d40 msgr2=0x7f88a814b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:12.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.554+0000 7f88ada00640 1 -- 172.21.15.7:0/2101438367 shutdown_connections 2024-09-13T15:15:12.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.554+0000 7f88ada00640 1 -- 172.21.15.7:0/2101438367 wait complete. 2024-09-13T15:15:12.723 INFO:tasks.mds_thrash.fs.[cephfs]:kill mds.c (rank=0) 2024-09-13T15:15:12.723 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T15:15:12.723 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:15:12.761 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T15:15:12.761 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:12.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86e6600640 1 Processor -- start 2024-09-13T15:15:12.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86e6600640 1 -- start start 2024-09-13T15:15:12.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86e6600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86e00c00f0 0x7f86e00c5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:12.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86e6600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f86e00c04d0 0x7f86e006f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:12.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86e6600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f86e00b0cb0 0x7f86e014f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86e6600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e0071000 con 0x7f86e00c04d0 2024-09-13T15:15:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86e6600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e0155ec0 con 0x7f86e00b0cb0 2024-09-13T15:15:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86e6600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e006ff60 con 0x7f86e00c00f0 2024-09-13T15:15:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86d6a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f86e00c04d0 0x7f86e006f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86d6a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f86e00c04d0 0x7f86e006f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42534/0 (socket says 172.21.15.7:42534) 2024-09-13T15:15:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86d6a00640 1 -- 172.21.15.7:0/3428251398 learned_addr learned my addr 172.21.15.7:0/3428251398 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86dfe00640 1 --2- 172.21.15.7:0/3428251398 >> v2:172.21.15.77:3300/0 conn(0x7f86e00b0cb0 0x7f86e014f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86df400640 1 --2- 172.21.15.7:0/3428251398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86e00c00f0 0x7f86e00c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86d6a00640 1 -- 172.21.15.7:0/3428251398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86e00c00f0 msgr2=0x7f86e00c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86d6a00640 1 --2- 172.21.15.7:0/3428251398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86e00c00f0 0x7f86e00c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86d6a00640 1 -- 172.21.15.7:0/3428251398 >> v2:172.21.15.77:3300/0 conn(0x7f86e00b0cb0 msgr2=0x7f86e014f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86d6a00640 1 --2- 172.21.15.7:0/3428251398 >> v2:172.21.15.77:3300/0 conn(0x7f86e00b0cb0 0x7f86e014f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:12.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.946+0000 7f86d6a00640 1 -- 172.21.15.7:0/3428251398 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e0156160 con 0x7f86e00c04d0 2024-09-13T15:15:12.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.950+0000 7f86d6a00640 1 --2- 172.21.15.7:0/3428251398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00c04d0 0x7f86e006f600 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f86e00c68d0 tx=0x7f86c801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0829ba11b7e570 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.950+0000 7f86dea00640 1 -- 172.21.15.7:0/3428251398 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c80a89d0 con 0x7f86e00c04d0 2024-09-13T15:15:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.950+0000 7f86dea00640 1 -- 172.21.15.7:0/3428251398 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c80a8b30 con 0x7f86e00c04d0 2024-09-13T15:15:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.950+0000 7f86dea00640 1 -- 172.21.15.7:0/3428251398 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c80b0440 con 0x7f86e00c04d0 2024-09-13T15:15:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.950+0000 7f86e6600640 1 -- 172.21.15.7:0/3428251398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00c04d0 msgr2=0x7f86e006f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:12.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.950+0000 7f86e6600640 1 --2- 172.21.15.7:0/3428251398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00c04d0 0x7f86e006f600 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f86e00c68d0 tx=0x7f86c801ed10 comp rx=0 tx=0).stop 2024-09-13T15:15:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.950+0000 7f86e6600640 1 -- 172.21.15.7:0/3428251398 shutdown_connections 2024-09-13T15:15:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.950+0000 7f86e6600640 1 --2- 172.21.15.7:0/3428251398 >> v2:172.21.15.77:3300/0 conn(0x7f86e00b0cb0 0x7f86e014f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.950+0000 7f86e6600640 1 --2- 172.21.15.7:0/3428251398 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00c04d0 0x7f86e006f600 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.950+0000 7f86e6600640 1 --2- 172.21.15.7:0/3428251398 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86e00c00f0 0x7f86e00c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.950+0000 7f86e6600640 1 -- 172.21.15.7:0/3428251398 >> 172.21.15.7:0/3428251398 conn(0x7f86e0065d40 msgr2=0x7f86e0066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.950+0000 7f86e6600640 1 -- 172.21.15.7:0/3428251398 shutdown_connections 2024-09-13T15:15:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.950+0000 7f86e6600640 1 -- 172.21.15.7:0/3428251398 wait complete. 2024-09-13T15:15:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86e6600640 1 Processor -- start 2024-09-13T15:15:12.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86e6600640 1 -- start start 2024-09-13T15:15:12.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86e6600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00b0cb0 0x7f86e00c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86e6600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86e00c00f0 0x7f86e00ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86e6600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86e00c04d0 0x7f86e01f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86e6600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00c9ae0 con 0x7f86e00b0cb0 2024-09-13T15:15:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86e6600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00aed50 con 0x7f86e00c00f0 2024-09-13T15:15:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86e6600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e00cb3b0 con 0x7f86e00c04d0 2024-09-13T15:15:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86df400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00b0cb0 0x7f86e00c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86df400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00b0cb0 0x7f86e00c9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42542/0 (socket says 172.21.15.7:42542) 2024-09-13T15:15:12.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86df400640 1 -- 172.21.15.7:0/1865229833 learned_addr learned my addr 172.21.15.7:0/1865229833 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86d6a00640 1 --2- 172.21.15.7:0/1865229833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86e00c00f0 0x7f86e00ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86dfe00640 1 --2- 172.21.15.7:0/1865229833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86e00c04d0 0x7f86e01f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86df400640 1 -- 172.21.15.7:0/1865229833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86e00c04d0 msgr2=0x7f86e01f1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86df400640 1 --2- 172.21.15.7:0/1865229833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86e00c04d0 0x7f86e01f1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86df400640 1 -- 172.21.15.7:0/1865229833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86e00c00f0 msgr2=0x7f86e00ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86df400640 1 --2- 172.21.15.7:0/1865229833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86e00c00f0 0x7f86e00ae810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:12.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86df400640 1 -- 172.21.15.7:0/1865229833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c80094d0 con 0x7f86e00b0cb0 2024-09-13T15:15:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86df400640 1 --2- 172.21.15.7:0/1865229833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00b0cb0 0x7f86e00c9340 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f86d000d830 tx=0x7f86d000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86d7e00640 1 -- 172.21.15.7:0/1865229833 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d000b6c0 con 0x7f86e00b0cb0 2024-09-13T15:15:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86d7e00640 1 -- 172.21.15.7:0/1865229833 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d000b820 con 0x7f86e00b0cb0 2024-09-13T15:15:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86e6600640 1 -- 172.21.15.7:0/1865229833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e00ae250 con 0x7f86e00b0cb0 2024-09-13T15:15:12.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86d7e00640 1 -- 172.21.15.7:0/1865229833 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d000bb90 con 0x7f86e00b0cb0 2024-09-13T15:15:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86e6600640 1 -- 172.21.15.7:0/1865229833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e00cad60 con 0x7f86e00b0cb0 2024-09-13T15:15:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.954+0000 7f86e6600640 1 -- 172.21.15.7:0/1865229833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e0067650 con 0x7f86e00b0cb0 2024-09-13T15:15:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.958+0000 7f86d7e00640 1 -- 172.21.15.7:0/1865229833 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f86d001e460 con 0x7f86e00b0cb0 2024-09-13T15:15:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.958+0000 7f86d7e00640 1 --2- 172.21.15.7:0/1865229833 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f86bc066690 0x7f86bc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.958+0000 7f86d7e00640 1 -- 172.21.15.7:0/1865229833 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f86d0084d60 con 0x7f86e00b0cb0 2024-09-13T15:15:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.958+0000 7f86d6a00640 1 --2- 172.21.15.7:0/1865229833 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f86bc066690 0x7f86bc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:12.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.958+0000 7f86d6a00640 1 --2- 172.21.15.7:0/1865229833 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f86bc066690 0x7f86bc068b50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f86c80b2000 tx=0x7f86c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:12.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:12.962+0000 7f86d7e00640 1 -- 172.21.15.7:0/1865229833 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f86d0051c00 con 0x7f86e00b0cb0 2024-09-13T15:15:13.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:13.158+0000 7f86e6600640 1 -- 172.21.15.7:0/1865229833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86e0070240 con 0x7f86e00b0cb0 2024-09-13T15:15:13.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:13.162+0000 7f86d7e00640 1 -- 172.21.15.7:0/1865229833 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6285 (secure 0 0 0) 0x7f86d0055220 con 0x7f86e00b0cb0 2024-09-13T15:15:13.163 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:13.164 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5710,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:14:13.112535+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:13.164 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 52 2024-09-13T15:15:13.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:13.162+0000 7f86e6600640 1 -- 172.21.15.7:0/1865229833 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f86bc066690 msgr2=0x7f86bc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:13.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:13.162+0000 7f86e6600640 1 --2- 172.21.15.7:0/1865229833 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f86bc066690 0x7f86bc068b50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f86c80b2000 tx=0x7f86c8009040 comp rx=0 tx=0).stop 2024-09-13T15:15:13.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:13.162+0000 7f86e6600640 1 -- 172.21.15.7:0/1865229833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00b0cb0 msgr2=0x7f86e00c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:13.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:13.162+0000 7f86e6600640 1 --2- 172.21.15.7:0/1865229833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00b0cb0 0x7f86e00c9340 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f86d000d830 tx=0x7f86d000dcf0 comp rx=0 tx=0).stop 2024-09-13T15:15:13.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:13.162+0000 7f86e6600640 1 -- 172.21.15.7:0/1865229833 shutdown_connections 2024-09-13T15:15:13.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:13.162+0000 7f86e6600640 1 --2- 172.21.15.7:0/1865229833 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f86bc066690 0x7f86bc068b50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:13.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:13.162+0000 7f86e6600640 1 --2- 172.21.15.7:0/1865229833 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86e00c04d0 0x7f86e01f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:13.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:13.162+0000 7f86e6600640 1 --2- 172.21.15.7:0/1865229833 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86e00c00f0 0x7f86e00ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:13.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:13.162+0000 7f86e6600640 1 --2- 172.21.15.7:0/1865229833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86e00b0cb0 0x7f86e00c9340 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:13.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:13.162+0000 7f86e6600640 1 -- 172.21.15.7:0/1865229833 >> 172.21.15.7:0/1865229833 conn(0x7f86e0065d40 msgr2=0x7f86e014de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:13.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:13.162+0000 7f86e6600640 1 -- 172.21.15.7:0/1865229833 shutdown_connections 2024-09-13T15:15:13.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:13.162+0000 7f86e6600640 1 -- 172.21.15.7:0/1865229833 wait complete. 2024-09-13T15:15:13.185 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-09-13T15:15:15.186 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:15.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.334+0000 7fc23ae00640 1 Processor -- start 2024-09-13T15:15:15.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.334+0000 7fc23ae00640 1 -- start start 2024-09-13T15:15:15.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.334+0000 7fc23ae00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2340c04d0 0x7fc23406f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:15.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.334+0000 7fc23ae00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc2340b0cb0 0x7fc23414f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.334+0000 7fc23ae00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc234155ec0 con 0x7fc2340c00f0 2024-09-13T15:15:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.334+0000 7fc23ae00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc234071000 con 0x7fc2340c04d0 2024-09-13T15:15:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.334+0000 7fc23ae00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2340c5c40 con 0x7fc2340b0cb0 2024-09-13T15:15:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.338+0000 7fc22be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2340c04d0 0x7fc23406f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.338+0000 7fc22be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2340c04d0 0x7fc23406f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42552/0 (socket says 172.21.15.7:42552) 2024-09-13T15:15:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.338+0000 7fc22be00640 1 -- 172.21.15.7:0/1242977488 learned_addr learned my addr 172.21.15.7:0/1242977488 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.338+0000 7fc238e00640 1 --2- 172.21.15.7:0/1242977488 >> v2:172.21.15.77:3300/0 conn(0x7fc2340b0cb0 0x7fc23414f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.338+0000 7fc22be00640 1 -- 172.21.15.7:0/1242977488 >> v2:172.21.15.77:3300/0 conn(0x7fc2340b0cb0 msgr2=0x7fc23414f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.338+0000 7fc22be00640 1 --2- 172.21.15.7:0/1242977488 >> v2:172.21.15.77:3300/0 conn(0x7fc2340b0cb0 0x7fc23414f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.338+0000 7fc22be00640 1 -- 172.21.15.7:0/1242977488 >> v1:172.21.15.77:6789/0 conn(0x7fc2340c00f0 legacy=0x7fc2340c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:15.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.338+0000 7fc22be00640 1 -- 172.21.15.7:0/1242977488 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23406ff60 con 0x7fc2340c04d0 2024-09-13T15:15:15.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.338+0000 7fc22be00640 1 --2- 172.21.15.7:0/1242977488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2340c04d0 0x7fc23406f600 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc2340c68a0 tx=0x7fc21c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0af35453b16514 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.338+0000 7fc233400640 1 -- 172.21.15.7:0/1242977488 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c0a8a10 con 0x7fc2340c04d0 2024-09-13T15:15:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.338+0000 7fc233400640 1 -- 172.21.15.7:0/1242977488 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21c0a8b70 con 0x7fc2340c04d0 2024-09-13T15:15:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.338+0000 7fc233400640 1 -- 172.21.15.7:0/1242977488 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c0b0440 con 0x7fc2340c04d0 2024-09-13T15:15:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc23ae00640 1 -- 172.21.15.7:0/1242977488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2340c04d0 msgr2=0x7fc23406f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:15.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc23ae00640 1 --2- 172.21.15.7:0/1242977488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2340c04d0 0x7fc23406f600 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fc2340c68a0 tx=0x7fc21c01ed10 comp rx=0 tx=0).stop 2024-09-13T15:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc23ae00640 1 -- 172.21.15.7:0/1242977488 shutdown_connections 2024-09-13T15:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc23ae00640 1 --2- 172.21.15.7:0/1242977488 >> v2:172.21.15.77:3300/0 conn(0x7fc2340b0cb0 0x7fc23414f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc23ae00640 1 --2- 172.21.15.7:0/1242977488 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2340c04d0 0x7fc23406f600 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc23ae00640 1 -- 172.21.15.7:0/1242977488 >> 172.21.15.7:0/1242977488 conn(0x7fc234065d40 msgr2=0x7fc234066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc23ae00640 1 -- 172.21.15.7:0/1242977488 shutdown_connections 2024-09-13T15:15:15.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc23ae00640 1 -- 172.21.15.7:0/1242977488 wait complete. 2024-09-13T15:15:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc23ae00640 1 Processor -- start 2024-09-13T15:15:15.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc23ae00640 1 -- start start 2024-09-13T15:15:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc23ae00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2340b0cb0 0x7fc234149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc23ae00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2340c00f0 0x7fc234155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:15.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc23ae00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2340c04d0 0x7fc2340ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc23ae00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc234154e60 con 0x7fc2340c00f0 2024-09-13T15:15:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc23ae00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc234154910 con 0x7fc2340b0cb0 2024-09-13T15:15:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc23ae00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc234149d90 con 0x7fc2340c04d0 2024-09-13T15:15:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc22be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2340c00f0 0x7fc234155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc22be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2340c00f0 0x7fc234155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42556/0 (socket says 172.21.15.7:42556) 2024-09-13T15:15:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc22be00640 1 -- 172.21.15.7:0/1552498687 learned_addr learned my addr 172.21.15.7:0/1552498687 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc233e00640 1 --2- 172.21.15.7:0/1552498687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2340b0cb0 0x7fc234149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc238e00640 1 --2- 172.21.15.7:0/1552498687 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2340c04d0 0x7fc2340ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc22be00640 1 -- 172.21.15.7:0/1552498687 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2340c04d0 msgr2=0x7fc2340ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc22be00640 1 --2- 172.21.15.7:0/1552498687 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2340c04d0 0x7fc2340ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:15.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc22be00640 1 -- 172.21.15.7:0/1552498687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2340b0cb0 msgr2=0x7fc234149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc22be00640 1 --2- 172.21.15.7:0/1552498687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2340b0cb0 0x7fc234149850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc22be00640 1 -- 172.21.15.7:0/1552498687 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c0094d0 con 0x7fc2340c00f0 2024-09-13T15:15:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.342+0000 7fc238e00640 1 --2- 172.21.15.7:0/1552498687 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2340c04d0 0x7fc2340ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:15:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.346+0000 7fc22be00640 1 --2- 172.21.15.7:0/1552498687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2340c00f0 0x7fc234155400 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc21c0b3040 tx=0x7fc21c01bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.346+0000 7fc230c00640 1 -- 172.21.15.7:0/1552498687 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c0b9620 con 0x7fc2340c00f0 2024-09-13T15:15:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.346+0000 7fc230c00640 1 -- 172.21.15.7:0/1552498687 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21c0b9780 con 0x7fc2340c00f0 2024-09-13T15:15:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.346+0000 7fc23ae00640 1 -- 172.21.15.7:0/1552498687 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2341eeaa0 con 0x7fc2340c00f0 2024-09-13T15:15:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.346+0000 7fc230c00640 1 -- 172.21.15.7:0/1552498687 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c0b9b30 con 0x7fc2340c00f0 2024-09-13T15:15:15.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.346+0000 7fc23ae00640 1 -- 172.21.15.7:0/1552498687 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2340c9090 con 0x7fc2340c00f0 2024-09-13T15:15:15.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.346+0000 7fc23ae00640 1 -- 172.21.15.7:0/1552498687 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc234067650 con 0x7fc2340c00f0 2024-09-13T15:15:15.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.346+0000 7fc230c00640 1 -- 172.21.15.7:0/1552498687 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc21c0b7070 con 0x7fc2340c00f0 2024-09-13T15:15:15.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.346+0000 7fc230c00640 1 --2- 172.21.15.7:0/1552498687 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc210066690 0x7fc210068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:15.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.346+0000 7fc230c00640 1 -- 172.21.15.7:0/1552498687 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fc21c1226c0 con 0x7fc2340c00f0 2024-09-13T15:15:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.346+0000 7fc233e00640 1 --2- 172.21.15.7:0/1552498687 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc210066690 0x7fc210068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:15.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.350+0000 7fc233e00640 1 --2- 172.21.15.7:0/1552498687 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc210066690 0x7fc210068b50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc224000f70 tx=0x7fc224009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:15.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.350+0000 7fc230c00640 1 -- 172.21.15.7:0/1552498687 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc21c0ef420 con 0x7fc2340c00f0 2024-09-13T15:15:15.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.554+0000 7fc23ae00640 1 -- 172.21.15.7:0/1552498687 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc234156cd0 con 0x7fc2340c00f0 2024-09-13T15:15:15.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.554+0000 7fc230c00640 1 -- 172.21.15.7:0/1552498687 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6285 (secure 0 0 0) 0x7fc21c0f2a40 con 0x7fc2340c00f0 2024-09-13T15:15:15.556 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:15.556 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5710,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:14:13.112535+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:15.557 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 52 2024-09-13T15:15:15.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.554+0000 7fc23ae00640 1 -- 172.21.15.7:0/1552498687 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc210066690 msgr2=0x7fc210068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:15.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.554+0000 7fc23ae00640 1 --2- 172.21.15.7:0/1552498687 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc210066690 0x7fc210068b50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc224000f70 tx=0x7fc224009040 comp rx=0 tx=0).stop 2024-09-13T15:15:15.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.554+0000 7fc23ae00640 1 -- 172.21.15.7:0/1552498687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2340c00f0 msgr2=0x7fc234155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:15.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.554+0000 7fc23ae00640 1 --2- 172.21.15.7:0/1552498687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2340c00f0 0x7fc234155400 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fc21c0b3040 tx=0x7fc21c01bab0 comp rx=0 tx=0).stop 2024-09-13T15:15:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.554+0000 7fc23ae00640 1 -- 172.21.15.7:0/1552498687 shutdown_connections 2024-09-13T15:15:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.554+0000 7fc23ae00640 1 --2- 172.21.15.7:0/1552498687 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc210066690 0x7fc210068b50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.554+0000 7fc23ae00640 1 --2- 172.21.15.7:0/1552498687 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2340c04d0 0x7fc2340ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.554+0000 7fc23ae00640 1 --2- 172.21.15.7:0/1552498687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2340c00f0 0x7fc234155400 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.554+0000 7fc23ae00640 1 --2- 172.21.15.7:0/1552498687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2340b0cb0 0x7fc234149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.554+0000 7fc23ae00640 1 -- 172.21.15.7:0/1552498687 >> 172.21.15.7:0/1552498687 conn(0x7fc234065d40 msgr2=0x7fc23406d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.554+0000 7fc23ae00640 1 -- 172.21.15.7:0/1552498687 shutdown_connections 2024-09-13T15:15:15.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:15.554+0000 7fc23ae00640 1 -- 172.21.15.7:0/1552498687 wait complete. 2024-09-13T15:15:15.578 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-09-13T15:15:17.579 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:17.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.730+0000 7f9762a00640 1 Processor -- start 2024-09-13T15:15:17.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.730+0000 7f9762a00640 1 -- start start 2024-09-13T15:15:17.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.734+0000 7f9762a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f975c0c5e90 0x7f975c06ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:17.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.734+0000 7f9762a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f975c0c6f10 0x7f975c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:17.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.734+0000 7f9762a00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975c1660b0 con 0x7f975c0c5ab0 2024-09-13T15:15:17.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.734+0000 7f9762a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c166d30 con 0x7f975c0c5e90 2024-09-13T15:15:17.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.734+0000 7f9762a00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f975c06fdf0 con 0x7f975c0c6f10 2024-09-13T15:15:17.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.734+0000 7f9753400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f975c0c5e90 0x7f975c06ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:17.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.734+0000 7f9753400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f975c0c5e90 0x7f975c06ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42562/0 (socket says 172.21.15.7:42562) 2024-09-13T15:15:17.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.734+0000 7f9753400640 1 -- 172.21.15.7:0/3768394930 learned_addr learned my addr 172.21.15.7:0/3768394930 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:17.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.734+0000 7f9760a00640 1 --2- 172.21.15.7:0/3768394930 >> v2:172.21.15.77:3300/0 conn(0x7f975c0c6f10 0x7f975c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:17.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.734+0000 7f975b400640 1 -- 172.21.15.7:0/3768394930 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007405020 0 0) 0x7f975c1660b0 con 0x7f975c0c5ab0 2024-09-13T15:15:17.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.938+0000 7f975b400640 1 -- 172.21.15.7:0/3768394930 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9740005740 con 0x7f975c0c5ab0 2024-09-13T15:15:17.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.938+0000 7f9753400640 1 -- 172.21.15.7:0/3768394930 >> v2:172.21.15.77:3300/0 conn(0x7f975c0c6f10 msgr2=0x7f975c06d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:17.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.938+0000 7f9753400640 1 --2- 172.21.15.7:0/3768394930 >> v2:172.21.15.77:3300/0 conn(0x7f975c0c6f10 0x7f975c06d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:17.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.938+0000 7f9753400640 1 -- 172.21.15.7:0/3768394930 >> v1:172.21.15.77:6789/0 conn(0x7f975c0c5ab0 legacy=0x7f975c0c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:17.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.938+0000 7f9753400640 1 -- 172.21.15.7:0/3768394930 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c166390 con 0x7f975c0c5e90 2024-09-13T15:15:17.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.942+0000 7f9753400640 1 --2- 172.21.15.7:0/3768394930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975c0c5e90 0x7f975c06ce20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f975c0c5790 tx=0x7f974401efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e526330acc8146 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:17.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.942+0000 7f975b400640 1 -- 172.21.15.7:0/3768394930 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97440a8dc0 con 0x7f975c0c5e90 2024-09-13T15:15:17.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.942+0000 7f975b400640 1 -- 172.21.15.7:0/3768394930 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9744004030 con 0x7f975c0c5e90 2024-09-13T15:15:17.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.942+0000 7f975b400640 1 -- 172.21.15.7:0/3768394930 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9744004420 con 0x7f975c0c5e90 2024-09-13T15:15:17.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.942+0000 7f9762a00640 1 -- 172.21.15.7:0/3768394930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975c0c5e90 msgr2=0x7f975c06ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:17.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.942+0000 7f9762a00640 1 --2- 172.21.15.7:0/3768394930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975c0c5e90 0x7f975c06ce20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f975c0c5790 tx=0x7f974401efb0 comp rx=0 tx=0).stop 2024-09-13T15:15:17.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.942+0000 7f9762a00640 1 -- 172.21.15.7:0/3768394930 shutdown_connections 2024-09-13T15:15:17.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.942+0000 7f9762a00640 1 --2- 172.21.15.7:0/3768394930 >> v2:172.21.15.77:3300/0 conn(0x7f975c0c6f10 0x7f975c06d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:17.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.942+0000 7f9762a00640 1 --2- 172.21.15.7:0/3768394930 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975c0c5e90 0x7f975c06ce20 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:17.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.942+0000 7f9762a00640 1 -- 172.21.15.7:0/3768394930 >> 172.21.15.7:0/3768394930 conn(0x7f975c065d40 msgr2=0x7f975c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:17.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.942+0000 7f9762a00640 1 -- 172.21.15.7:0/3768394930 shutdown_connections 2024-09-13T15:15:17.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.942+0000 7f9762a00640 1 -- 172.21.15.7:0/3768394930 wait complete. 2024-09-13T15:15:17.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f9762a00640 1 Processor -- start 2024-09-13T15:15:17.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f9762a00640 1 -- start start 2024-09-13T15:15:17.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f9762a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f975c0c5ab0 0x7f975c0adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:17.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f9762a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975c0c5e90 0x7f975c15fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:17.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f9762a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f975c0c6f10 0x7f975c15ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:17.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f9762a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c15f5f0 con 0x7f975c0c5e90 2024-09-13T15:15:17.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f9762a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c15d000 con 0x7f975c0c6f10 2024-09-13T15:15:17.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f9762a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c0aed40 con 0x7f975c0c5ab0 2024-09-13T15:15:17.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f9753400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975c0c5e90 0x7f975c15fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:17.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f9753400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975c0c5e90 0x7f975c15fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42574/0 (socket says 172.21.15.7:42574) 2024-09-13T15:15:17.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f9753400640 1 -- 172.21.15.7:0/468921094 learned_addr learned my addr 172.21.15.7:0/468921094 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:17.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f9760a00640 1 --2- 172.21.15.7:0/468921094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f975c0c6f10 0x7f975c15ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:17.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f975be00640 1 --2- 172.21.15.7:0/468921094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f975c0c5ab0 0x7f975c0adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:17.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f9753400640 1 -- 172.21.15.7:0/468921094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f975c0c5ab0 msgr2=0x7f975c0adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:17.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f9753400640 1 --2- 172.21.15.7:0/468921094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f975c0c5ab0 0x7f975c0adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:17.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f9753400640 1 -- 172.21.15.7:0/468921094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f975c0c6f10 msgr2=0x7f975c15ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:17.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f9753400640 1 --2- 172.21.15.7:0/468921094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f975c0c6f10 0x7f975c15ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:17.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f9753400640 1 -- 172.21.15.7:0/468921094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974400a580 con 0x7f975c0c5e90 2024-09-13T15:15:17.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.946+0000 7f975be00640 1 --2- 172.21.15.7:0/468921094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f975c0c5ab0 0x7f975c0adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:15:17.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.950+0000 7f9753400640 1 --2- 172.21.15.7:0/468921094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975c0c5e90 0x7f975c15fa80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f97440b2040 tx=0x7f974401bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:17.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.950+0000 7f9758c00640 1 -- 172.21.15.7:0/468921094 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97440044f0 con 0x7f975c0c5e90 2024-09-13T15:15:17.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.950+0000 7f9758c00640 1 -- 172.21.15.7:0/468921094 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9744003620 con 0x7f975c0c5e90 2024-09-13T15:15:17.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.950+0000 7f9758c00640 1 -- 172.21.15.7:0/468921094 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9744003990 con 0x7f975c0c5e90 2024-09-13T15:15:17.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.950+0000 7f9762a00640 1 -- 172.21.15.7:0/468921094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975c0af020 con 0x7f975c0c5e90 2024-09-13T15:15:17.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.950+0000 7f9762a00640 1 -- 172.21.15.7:0/468921094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975c0af5e0 con 0x7f975c0c5e90 2024-09-13T15:15:17.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.950+0000 7f9762a00640 1 -- 172.21.15.7:0/468921094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975c067650 con 0x7f975c0c5e90 2024-09-13T15:15:17.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.950+0000 7f9758c00640 1 -- 172.21.15.7:0/468921094 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9744003af0 con 0x7f975c0c5e90 2024-09-13T15:15:17.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.950+0000 7f9758c00640 1 --2- 172.21.15.7:0/468921094 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9738066690 0x7f9738068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:17.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.950+0000 7f9758c00640 1 -- 172.21.15.7:0/468921094 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f9744122a50 con 0x7f975c0c5e90 2024-09-13T15:15:17.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.954+0000 7f975be00640 1 --2- 172.21.15.7:0/468921094 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9738066690 0x7f9738068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:17.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.954+0000 7f975be00640 1 --2- 172.21.15.7:0/468921094 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9738066690 0x7f9738068b50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f974c0011f0 tx=0x7f974c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:17.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:17.962+0000 7f9758c00640 1 -- 172.21.15.7:0/468921094 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f97440ef720 con 0x7f975c0c5e90 2024-09-13T15:15:18.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:18.162+0000 7f9762a00640 1 -- 172.21.15.7:0/468921094 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f975c0c6800 con 0x7f975c0c5e90 2024-09-13T15:15:18.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:18.162+0000 7f9758c00640 1 -- 172.21.15.7:0/468921094 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6285 (secure 0 0 0) 0x7f974400b040 con 0x7f975c0c5e90 2024-09-13T15:15:18.166 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:18.167 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5710,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:14:13.112535+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:18.167 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 52 2024-09-13T15:15:18.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:18.162+0000 7f9762a00640 1 -- 172.21.15.7:0/468921094 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9738066690 msgr2=0x7f9738068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:18.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:18.162+0000 7f9762a00640 1 --2- 172.21.15.7:0/468921094 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9738066690 0x7f9738068b50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f974c0011f0 tx=0x7f974c009040 comp rx=0 tx=0).stop 2024-09-13T15:15:18.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:18.162+0000 7f9762a00640 1 -- 172.21.15.7:0/468921094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975c0c5e90 msgr2=0x7f975c15fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:18.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:18.162+0000 7f9762a00640 1 --2- 172.21.15.7:0/468921094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975c0c5e90 0x7f975c15fa80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f97440b2040 tx=0x7f974401bd50 comp rx=0 tx=0).stop 2024-09-13T15:15:18.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:18.162+0000 7f9762a00640 1 -- 172.21.15.7:0/468921094 shutdown_connections 2024-09-13T15:15:18.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:18.162+0000 7f9762a00640 1 --2- 172.21.15.7:0/468921094 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9738066690 0x7f9738068b50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:18.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:18.162+0000 7f9762a00640 1 --2- 172.21.15.7:0/468921094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f975c0c6f10 0x7f975c15ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:18.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:18.162+0000 7f9762a00640 1 --2- 172.21.15.7:0/468921094 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f975c0c5e90 0x7f975c15fa80 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:18.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:18.162+0000 7f9762a00640 1 --2- 172.21.15.7:0/468921094 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f975c0c5ab0 0x7f975c0adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:18.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:18.162+0000 7f9762a00640 1 -- 172.21.15.7:0/468921094 >> 172.21.15.7:0/468921094 conn(0x7f975c065d40 msgr2=0x7f975c0cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:18.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:18.162+0000 7f9762a00640 1 -- 172.21.15.7:0/468921094 shutdown_connections 2024-09-13T15:15:18.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:18.162+0000 7f9762a00640 1 -- 172.21.15.7:0/468921094 wait complete. 2024-09-13T15:15:18.186 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-09-13T15:15:20.187 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:20.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.342+0000 7fd22fe00640 1 Processor -- start 2024-09-13T15:15:20.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.342+0000 7fd22fe00640 1 -- start start 2024-09-13T15:15:20.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.342+0000 7fd22fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd230155e80 0x7fd23006f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:20.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.342+0000 7fd22fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd230156260 0x7fd2300c15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:20.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.342+0000 7fd22fe00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2300c6100 con 0x7fd23014fa90 2024-09-13T15:15:20.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.342+0000 7fd22fe00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23006fc60 con 0x7fd230156260 2024-09-13T15:15:20.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.342+0000 7fd22fe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23006fa40 con 0x7fd230155e80 2024-09-13T15:15:20.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.342+0000 7fd226000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd230156260 0x7fd2300c15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:20.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.342+0000 7fd226000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fd230156260 0x7fd2300c15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49596/0 (socket says 172.21.15.7:49596) 2024-09-13T15:15:20.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.342+0000 7fd226000640 1 -- 172.21.15.7:0/553032378 learned_addr learned my addr 172.21.15.7:0/553032378 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:20.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.342+0000 7fd22ea00640 1 --2- 172.21.15.7:0/553032378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd230155e80 0x7fd23006f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:20.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.342+0000 7fd226000640 1 -- 172.21.15.7:0/553032378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd230155e80 msgr2=0x7fd23006f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:20.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.342+0000 7fd226000640 1 --2- 172.21.15.7:0/553032378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd230155e80 0x7fd23006f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:20.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.342+0000 7fd226000640 1 -- 172.21.15.7:0/553032378 >> v1:172.21.15.77:6789/0 conn(0x7fd23014fa90 legacy=0x7fd230070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:20.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.342+0000 7fd226000640 1 -- 172.21.15.7:0/553032378 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2300c5530 con 0x7fd230156260 2024-09-13T15:15:20.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.346+0000 7fd226000640 1 --2- 172.21.15.7:0/553032378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd230156260 0x7fd2300c15f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd2180098a0 tx=0x7fd21801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d306bb7bf1e60ecb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:20.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.346+0000 7fd22e000640 1 -- 172.21.15.7:0/553032378 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2180a8a30 con 0x7fd230156260 2024-09-13T15:15:20.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.346+0000 7fd22e000640 1 -- 172.21.15.7:0/553032378 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2180a8b90 con 0x7fd230156260 2024-09-13T15:15:20.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.346+0000 7fd22e000640 1 -- 172.21.15.7:0/553032378 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2180b0440 con 0x7fd230156260 2024-09-13T15:15:20.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.346+0000 7fd22fe00640 1 -- 172.21.15.7:0/553032378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd230156260 msgr2=0x7fd2300c15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:20.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.346+0000 7fd22fe00640 1 --2- 172.21.15.7:0/553032378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd230156260 0x7fd2300c15f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd2180098a0 tx=0x7fd21801ed30 comp rx=0 tx=0).stop 2024-09-13T15:15:20.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.346+0000 7fd22fe00640 1 -- 172.21.15.7:0/553032378 shutdown_connections 2024-09-13T15:15:20.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.346+0000 7fd22fe00640 1 --2- 172.21.15.7:0/553032378 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd230156260 0x7fd2300c15f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:20.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.346+0000 7fd22fe00640 1 --2- 172.21.15.7:0/553032378 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd230155e80 0x7fd23006f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:20.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.346+0000 7fd22fe00640 1 -- 172.21.15.7:0/553032378 >> 172.21.15.7:0/553032378 conn(0x7fd230065d40 msgr2=0x7fd230066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:20.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.346+0000 7fd22fe00640 1 -- 172.21.15.7:0/553032378 shutdown_connections 2024-09-13T15:15:20.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.346+0000 7fd22fe00640 1 -- 172.21.15.7:0/553032378 wait complete. 2024-09-13T15:15:20.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22fe00640 1 Processor -- start 2024-09-13T15:15:20.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22fe00640 1 -- start start 2024-09-13T15:15:20.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd23014fa90 0x7fd2301e3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:20.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd230155e80 0x7fd2301eeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:20.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd230156260 0x7fd230140fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:20.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2301f2ae0 con 0x7fd23014fa90 2024-09-13T15:15:20.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22fe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23014ef50 con 0x7fd230155e80 2024-09-13T15:15:20.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22fe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23014f1f0 con 0x7fd230156260 2024-09-13T15:15:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd23014fa90 0x7fd2301e3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd23014fa90 0x7fd2301e3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49606/0 (socket says 172.21.15.7:49606) 2024-09-13T15:15:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22ea00640 1 -- 172.21.15.7:0/778521900 learned_addr learned my addr 172.21.15.7:0/778521900 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd226000640 1 --2- 172.21.15.7:0/778521900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd230155e80 0x7fd2301eeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22f400640 1 --2- 172.21.15.7:0/778521900 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd230156260 0x7fd230140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22ea00640 1 -- 172.21.15.7:0/778521900 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd230156260 msgr2=0x7fd230140fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22ea00640 1 --2- 172.21.15.7:0/778521900 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd230156260 0x7fd230140fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22ea00640 1 -- 172.21.15.7:0/778521900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd230155e80 msgr2=0x7fd2301eeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22ea00640 1 --2- 172.21.15.7:0/778521900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd230155e80 0x7fd2301eeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22ea00640 1 -- 172.21.15.7:0/778521900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2180094d0 con 0x7fd23014fa90 2024-09-13T15:15:20.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd226000640 1 --2- 172.21.15.7:0/778521900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd230155e80 0x7fd2301eeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:15:20.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22ea00640 1 --2- 172.21.15.7:0/778521900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd23014fa90 0x7fd2301e3650 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd22000efc0 tx=0x7fd22000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:20.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd227e00640 1 -- 172.21.15.7:0/778521900 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220014480 con 0x7fd23014fa90 2024-09-13T15:15:20.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd227e00640 1 -- 172.21.15.7:0/778521900 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22000f040 con 0x7fd23014fa90 2024-09-13T15:15:20.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd227e00640 1 -- 172.21.15.7:0/778521900 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220014800 con 0x7fd23014fa90 2024-09-13T15:15:20.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22fe00640 1 -- 172.21.15.7:0/778521900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23014f4d0 con 0x7fd23014fa90 2024-09-13T15:15:20.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.350+0000 7fd22fe00640 1 -- 172.21.15.7:0/778521900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2301f2420 con 0x7fd23014fa90 2024-09-13T15:15:20.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.354+0000 7fd22fe00640 1 -- 172.21.15.7:0/778521900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd230156970 con 0x7fd23014fa90 2024-09-13T15:15:20.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.354+0000 7fd227e00640 1 -- 172.21.15.7:0/778521900 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd220014960 con 0x7fd23014fa90 2024-09-13T15:15:20.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.354+0000 7fd227e00640 1 --2- 172.21.15.7:0/778521900 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd20c066690 0x7fd20c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:20.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.354+0000 7fd227e00640 1 -- 172.21.15.7:0/778521900 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fd220085320 con 0x7fd23014fa90 2024-09-13T15:15:20.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.354+0000 7fd226000640 1 --2- 172.21.15.7:0/778521900 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd20c066690 0x7fd20c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:20.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.354+0000 7fd226000640 1 --2- 172.21.15.7:0/778521900 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd20c066690 0x7fd20c068b50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd2180b2000 tx=0x7fd218008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:20.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.358+0000 7fd227e00640 1 -- 172.21.15.7:0/778521900 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd220052090 con 0x7fd23014fa90 2024-09-13T15:15:20.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.558+0000 7fd22fe00640 1 -- 172.21.15.7:0/778521900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd230147f70 con 0x7fd23014fa90 2024-09-13T15:15:20.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.558+0000 7fd227e00640 1 -- 172.21.15.7:0/778521900 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6285 (secure 0 0 0) 0x7fd2200556b0 con 0x7fd23014fa90 2024-09-13T15:15:20.560 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:20.560 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5710,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:14:13.112535+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:20.560 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 52 2024-09-13T15:15:20.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.558+0000 7fd22fe00640 1 -- 172.21.15.7:0/778521900 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd20c066690 msgr2=0x7fd20c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:20.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.558+0000 7fd22fe00640 1 --2- 172.21.15.7:0/778521900 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd20c066690 0x7fd20c068b50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd2180b2000 tx=0x7fd218008040 comp rx=0 tx=0).stop 2024-09-13T15:15:20.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.558+0000 7fd22fe00640 1 -- 172.21.15.7:0/778521900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd23014fa90 msgr2=0x7fd2301e3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:20.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.558+0000 7fd22fe00640 1 --2- 172.21.15.7:0/778521900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd23014fa90 0x7fd2301e3650 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fd22000efc0 tx=0x7fd22000c490 comp rx=0 tx=0).stop 2024-09-13T15:15:20.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.558+0000 7fd22fe00640 1 -- 172.21.15.7:0/778521900 shutdown_connections 2024-09-13T15:15:20.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.558+0000 7fd22fe00640 1 --2- 172.21.15.7:0/778521900 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd20c066690 0x7fd20c068b50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:20.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.558+0000 7fd22fe00640 1 --2- 172.21.15.7:0/778521900 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd230156260 0x7fd230140fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:20.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.558+0000 7fd22fe00640 1 --2- 172.21.15.7:0/778521900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd230155e80 0x7fd2301eeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:20.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.558+0000 7fd22fe00640 1 --2- 172.21.15.7:0/778521900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd23014fa90 0x7fd2301e3650 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:20.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.558+0000 7fd22fe00640 1 -- 172.21.15.7:0/778521900 >> 172.21.15.7:0/778521900 conn(0x7fd230065d40 msgr2=0x7fd23006fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:20.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.558+0000 7fd22fe00640 1 -- 172.21.15.7:0/778521900 shutdown_connections 2024-09-13T15:15:20.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:20.558+0000 7fd22fe00640 1 -- 172.21.15.7:0/778521900 wait complete. 2024-09-13T15:15:20.582 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-09-13T15:15:22.583 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:22.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea37400640 1 Processor -- start 2024-09-13T15:15:22.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea37400640 1 -- start start 2024-09-13T15:15:22.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea37400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fea30153210 0x7fea300c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:22.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea37400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea301535f0 0x7fea300c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:22.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea37400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea300c2e40 con 0x7fea300c6ff0 2024-09-13T15:15:22.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea37400640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea30159150 con 0x7fea30153210 2024-09-13T15:15:22.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea37400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea30159360 con 0x7fea301535f0 2024-09-13T15:15:22.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea35400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fea300c6ff0 0x7fea300c8850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52348/0 (socket says 172.21.15.7:52348) 2024-09-13T15:15:22.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea35400640 1 -- 172.21.15.7:0/1511564906 learned_addr learned my addr 172.21.15.7:0/1511564906 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:15:22.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea34a00640 1 --2- 172.21.15.7:0/1511564906 >> v2:172.21.15.77:3300/0 conn(0x7fea30153210 0x7fea300c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:22.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea27e00640 1 --2- 172.21.15.7:0/1511564906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea301535f0 0x7fea300c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:22.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea2fe00640 1 -- 172.21.15.7:0/1511564906 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35405635 0 0) 0x7fea280014a0 con 0x7fea300c6ff0 2024-09-13T15:15:22.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea2fe00640 1 -- 172.21.15.7:0/1511564906 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea14003530 con 0x7fea300c6ff0 2024-09-13T15:15:22.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea34a00640 1 -- 172.21.15.7:0/1511564906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea301535f0 msgr2=0x7fea300c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:22.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea34a00640 1 --2- 172.21.15.7:0/1511564906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea301535f0 0x7fea300c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:22.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea2fe00640 1 -- 172.21.15.7:0/1511564906 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2722067556 0 0) 0x7fea14003530 con 0x7fea300c6ff0 2024-09-13T15:15:22.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea34a00640 1 -- 172.21.15.7:0/1511564906 >> v1:172.21.15.7:6789/0 conn(0x7fea300c6ff0 legacy=0x7fea300c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:22.735 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.730+0000 7fea34a00640 1 -- 172.21.15.7:0/1511564906 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea30159640 con 0x7fea30153210 2024-09-13T15:15:22.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.734+0000 7fea34a00640 1 --2- 172.21.15.7:0/1511564906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea30153210 0x7fea300c99e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fea200097c0 tx=0x7fea2001ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46f4c5fcc412bfde server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:22.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.734+0000 7fea2fe00640 1 -- 172.21.15.7:0/1511564906 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28001b90 con 0x7fea30153210 2024-09-13T15:15:22.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.734+0000 7fea2fe00640 1 -- 172.21.15.7:0/1511564906 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea200a85f0 con 0x7fea30153210 2024-09-13T15:15:22.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.734+0000 7fea2fe00640 1 -- 172.21.15.7:0/1511564906 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea200a8980 con 0x7fea30153210 2024-09-13T15:15:22.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.734+0000 7fea37400640 1 -- 172.21.15.7:0/1511564906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea30153210 msgr2=0x7fea300c99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:22.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.734+0000 7fea37400640 1 --2- 172.21.15.7:0/1511564906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea30153210 0x7fea300c99e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fea200097c0 tx=0x7fea2001ebb0 comp rx=0 tx=0).stop 2024-09-13T15:15:22.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.734+0000 7fea37400640 1 -- 172.21.15.7:0/1511564906 shutdown_connections 2024-09-13T15:15:22.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.734+0000 7fea37400640 1 --2- 172.21.15.7:0/1511564906 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea301535f0 0x7fea300c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:22.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.734+0000 7fea37400640 1 --2- 172.21.15.7:0/1511564906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea30153210 0x7fea300c99e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:22.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.734+0000 7fea37400640 1 -- 172.21.15.7:0/1511564906 >> 172.21.15.7:0/1511564906 conn(0x7fea3006e1d0 msgr2=0x7fea3006e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:22.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.734+0000 7fea37400640 1 -- 172.21.15.7:0/1511564906 shutdown_connections 2024-09-13T15:15:22.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.734+0000 7fea37400640 1 -- 172.21.15.7:0/1511564906 wait complete. 2024-09-13T15:15:22.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea37400640 1 Processor -- start 2024-09-13T15:15:22.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea37400640 1 -- start start 2024-09-13T15:15:22.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea37400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea300c6ff0 0x7fea301e4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea37400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea30153210 0x7fea301e27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea37400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea301535f0 0x7fea301eea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea37400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea30155600 con 0x7fea300c6ff0 2024-09-13T15:15:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea37400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea30156140 con 0x7fea30153210 2024-09-13T15:15:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea37400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea30156e40 con 0x7fea301535f0 2024-09-13T15:15:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea34a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea300c6ff0 0x7fea301e4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea34a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea300c6ff0 0x7fea301e4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49612/0 (socket says 172.21.15.7:49612) 2024-09-13T15:15:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea34a00640 1 -- 172.21.15.7:0/1084858428 learned_addr learned my addr 172.21.15.7:0/1084858428 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea27e00640 1 --2- 172.21.15.7:0/1084858428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea30153210 0x7fea301e27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea35400640 1 --2- 172.21.15.7:0/1084858428 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea301535f0 0x7fea301eea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea34a00640 1 -- 172.21.15.7:0/1084858428 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea301535f0 msgr2=0x7fea301eea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea34a00640 1 --2- 172.21.15.7:0/1084858428 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea301535f0 0x7fea301eea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:22.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea34a00640 1 -- 172.21.15.7:0/1084858428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea30153210 msgr2=0x7fea301e27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:22.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea34a00640 1 --2- 172.21.15.7:0/1084858428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea30153210 0x7fea301e27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:22.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea34a00640 1 -- 172.21.15.7:0/1084858428 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea20009420 con 0x7fea300c6ff0 2024-09-13T15:15:22.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea34a00640 1 --2- 172.21.15.7:0/1084858428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea300c6ff0 0x7fea301e4d40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fea200097c0 tx=0x7fea2001b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:22.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea2d600640 1 -- 172.21.15.7:0/1084858428 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea200b0850 con 0x7fea300c6ff0 2024-09-13T15:15:22.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea2d600640 1 -- 172.21.15.7:0/1084858428 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea200b09d0 con 0x7fea300c6ff0 2024-09-13T15:15:22.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea2d600640 1 -- 172.21.15.7:0/1084858428 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea200b0d80 con 0x7fea300c6ff0 2024-09-13T15:15:22.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea37400640 1 -- 172.21.15.7:0/1084858428 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea30155810 con 0x7fea300c6ff0 2024-09-13T15:15:22.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.738+0000 7fea37400640 1 -- 172.21.15.7:0/1084858428 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea30155dd0 con 0x7fea300c6ff0 2024-09-13T15:15:22.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.742+0000 7fea37400640 1 -- 172.21.15.7:0/1084858428 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea300666d0 con 0x7fea300c6ff0 2024-09-13T15:15:22.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.742+0000 7fea2d600640 1 -- 172.21.15.7:0/1084858428 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fea200b7040 con 0x7fea300c6ff0 2024-09-13T15:15:22.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.742+0000 7fea2d600640 1 --2- 172.21.15.7:0/1084858428 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fea0c0666c0 0x7fea0c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:22.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.742+0000 7fea2d600640 1 -- 172.21.15.7:0/1084858428 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fea20121690 con 0x7fea300c6ff0 2024-09-13T15:15:22.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.742+0000 7fea27e00640 1 --2- 172.21.15.7:0/1084858428 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fea0c0666c0 0x7fea0c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:22.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.742+0000 7fea27e00640 1 --2- 172.21.15.7:0/1084858428 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fea0c0666c0 0x7fea0c068b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fea300c6860 tx=0x7fea18009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:22.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.746+0000 7fea2d600640 1 -- 172.21.15.7:0/1084858428 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fea200ee3f0 con 0x7fea300c6ff0 2024-09-13T15:15:22.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.962+0000 7fea37400640 1 -- 172.21.15.7:0/1084858428 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea30156280 con 0x7fea300c6ff0 2024-09-13T15:15:22.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.962+0000 7fea2d600640 1 -- 172.21.15.7:0/1084858428 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6285 (secure 0 0 0) 0x7fea20006e20 con 0x7fea300c6ff0 2024-09-13T15:15:22.965 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:22.965 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5710,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:14:13.112535+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:22.965 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 52 2024-09-13T15:15:22.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.962+0000 7fea37400640 1 -- 172.21.15.7:0/1084858428 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fea0c0666c0 msgr2=0x7fea0c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:22.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.962+0000 7fea37400640 1 --2- 172.21.15.7:0/1084858428 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fea0c0666c0 0x7fea0c068b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fea300c6860 tx=0x7fea18009190 comp rx=0 tx=0).stop 2024-09-13T15:15:22.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.962+0000 7fea37400640 1 -- 172.21.15.7:0/1084858428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea300c6ff0 msgr2=0x7fea301e4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:22.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.962+0000 7fea37400640 1 --2- 172.21.15.7:0/1084858428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea300c6ff0 0x7fea301e4d40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fea200097c0 tx=0x7fea2001b950 comp rx=0 tx=0).stop 2024-09-13T15:15:22.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.962+0000 7fea37400640 1 -- 172.21.15.7:0/1084858428 shutdown_connections 2024-09-13T15:15:22.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.962+0000 7fea37400640 1 --2- 172.21.15.7:0/1084858428 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fea0c0666c0 0x7fea0c068b80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:22.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.962+0000 7fea37400640 1 --2- 172.21.15.7:0/1084858428 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fea301535f0 0x7fea301eea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:22.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.962+0000 7fea37400640 1 --2- 172.21.15.7:0/1084858428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea30153210 0x7fea301e27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:22.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.962+0000 7fea37400640 1 --2- 172.21.15.7:0/1084858428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fea300c6ff0 0x7fea301e4d40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:22.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.962+0000 7fea37400640 1 -- 172.21.15.7:0/1084858428 >> 172.21.15.7:0/1084858428 conn(0x7fea3006e1d0 msgr2=0x7fea301579d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:22.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.962+0000 7fea37400640 1 -- 172.21.15.7:0/1084858428 shutdown_connections 2024-09-13T15:15:22.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:22.962+0000 7fea37400640 1 -- 172.21.15.7:0/1084858428 wait complete. 2024-09-13T15:15:22.986 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-09-13T15:15:24.365 DEBUG:teuthology.parallel:result is None 2024-09-13T15:15:24.365 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T15:15:24.987 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:25.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.130+0000 7fb741800640 1 Processor -- start 2024-09-13T15:15:25.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.130+0000 7fb741800640 1 -- start start 2024-09-13T15:15:25.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.130+0000 7fb741800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb73c0b0bf0 0x7fb73c150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:25.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.130+0000 7fb741800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb73c06ddb0 0x7fb73c151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:25.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.130+0000 7fb741800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb73c0c5530 con 0x7fb73c071a70 2024-09-13T15:15:25.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.130+0000 7fb741800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73c151750 con 0x7fb73c06ddb0 2024-09-13T15:15:25.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.130+0000 7fb741800640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73c1583b0 con 0x7fb73c0b0bf0 2024-09-13T15:15:25.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.130+0000 7fb73b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb73c06ddb0 0x7fb73c151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:25.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.130+0000 7fb73b400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb73c06ddb0 0x7fb73c151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49616/0 (socket says 172.21.15.7:49616) 2024-09-13T15:15:25.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.130+0000 7fb73aa00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb73c071a70 0x7fb73c1576e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:52354/0 (socket says 172.21.15.7:52354) 2024-09-13T15:15:25.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.130+0000 7fb73b400640 1 -- 172.21.15.7:0/314069036 learned_addr learned my addr 172.21.15.7:0/314069036 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:25.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.130+0000 7fb73a000640 1 --2- 172.21.15.7:0/314069036 >> v2:172.21.15.77:3300/0 conn(0x7fb73c0b0bf0 0x7fb73c150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:25.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.134+0000 7fb73b400640 1 -- 172.21.15.7:0/314069036 >> v2:172.21.15.77:3300/0 conn(0x7fb73c0b0bf0 msgr2=0x7fb73c150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:25.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.134+0000 7fb73b400640 1 --2- 172.21.15.7:0/314069036 >> v2:172.21.15.77:3300/0 conn(0x7fb73c0b0bf0 0x7fb73c150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:25.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.134+0000 7fb73b400640 1 -- 172.21.15.7:0/314069036 >> v1:172.21.15.7:6789/0 conn(0x7fb73c071a70 legacy=0x7fb73c1576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:25.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.134+0000 7fb73b400640 1 -- 172.21.15.7:0/314069036 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73c156f40 con 0x7fb73c06ddb0 2024-09-13T15:15:25.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.134+0000 7fb739600640 1 -- 172.21.15.7:0/314069036 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508366964 0 0) 0x7fb73c0c5530 con 0x7fb73c071a70 2024-09-13T15:15:25.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.134+0000 7fb73b400640 1 --2- 172.21.15.7:0/314069036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c06ddb0 0x7fb73c151210 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb73c072760 tx=0x7fb73401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba55618c0d9ba2ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:25.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.134+0000 7fb739600640 1 -- 172.21.15.7:0/314069036 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7340a5880 con 0x7fb73c06ddb0 2024-09-13T15:15:25.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.134+0000 7fb739600640 1 -- 172.21.15.7:0/314069036 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7340a59e0 con 0x7fb73c06ddb0 2024-09-13T15:15:25.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.134+0000 7fb739600640 1 -- 172.21.15.7:0/314069036 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7340a5d70 con 0x7fb73c06ddb0 2024-09-13T15:15:25.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.134+0000 7fb741800640 1 -- 172.21.15.7:0/314069036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c06ddb0 msgr2=0x7fb73c151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:25.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.134+0000 7fb741800640 1 --2- 172.21.15.7:0/314069036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c06ddb0 0x7fb73c151210 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb73c072760 tx=0x7fb73401c9c0 comp rx=0 tx=0).stop 2024-09-13T15:15:25.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.134+0000 7fb741800640 1 -- 172.21.15.7:0/314069036 shutdown_connections 2024-09-13T15:15:25.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.134+0000 7fb741800640 1 --2- 172.21.15.7:0/314069036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c06ddb0 0x7fb73c151210 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:25.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.134+0000 7fb741800640 1 --2- 172.21.15.7:0/314069036 >> v2:172.21.15.77:3300/0 conn(0x7fb73c0b0bf0 0x7fb73c150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:25.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.134+0000 7fb741800640 1 -- 172.21.15.7:0/314069036 >> 172.21.15.7:0/314069036 conn(0x7fb73c065d40 msgr2=0x7fb73c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:25.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.134+0000 7fb741800640 1 -- 172.21.15.7:0/314069036 shutdown_connections 2024-09-13T15:15:25.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb741800640 1 -- 172.21.15.7:0/314069036 wait complete. 2024-09-13T15:15:25.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb741800640 1 Processor -- start 2024-09-13T15:15:25.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb741800640 1 -- start start 2024-09-13T15:15:25.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb741800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb73c06ddb0 0x7fb73c143480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:25.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb741800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c071a70 0x7fb73c1f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:25.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb741800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb73c0b0bf0 0x7fb73c148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:25.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb741800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c070150 con 0x7fb73c071a70 2024-09-13T15:15:25.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb741800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c14ad40 con 0x7fb73c0b0bf0 2024-09-13T15:15:25.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb741800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c1514d0 con 0x7fb73c06ddb0 2024-09-13T15:15:25.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb73a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c071a70 0x7fb73c1f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:25.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb73a000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c071a70 0x7fb73c1f5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49618/0 (socket says 172.21.15.7:49618) 2024-09-13T15:15:25.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb73a000640 1 -- 172.21.15.7:0/725453464 learned_addr learned my addr 172.21.15.7:0/725453464 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:25.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb73aa00640 1 --2- 172.21.15.7:0/725453464 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb73c06ddb0 0x7fb73c143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:25.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb73b400640 1 --2- 172.21.15.7:0/725453464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb73c0b0bf0 0x7fb73c148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:25.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb73a000640 1 -- 172.21.15.7:0/725453464 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb73c06ddb0 msgr2=0x7fb73c143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:25.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb73a000640 1 --2- 172.21.15.7:0/725453464 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb73c06ddb0 0x7fb73c143480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:25.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb73a000640 1 -- 172.21.15.7:0/725453464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb73c0b0bf0 msgr2=0x7fb73c148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:25.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb73a000640 1 --2- 172.21.15.7:0/725453464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb73c0b0bf0 0x7fb73c148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:25.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb73a000640 1 -- 172.21.15.7:0/725453464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb734009b30 con 0x7fb73c071a70 2024-09-13T15:15:25.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb73a000640 1 --2- 172.21.15.7:0/725453464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c071a70 0x7fb73c1f5e50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb72800e9b0 tx=0x7fb72800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:25.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb732a00640 1 -- 172.21.15.7:0/725453464 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7280096b0 con 0x7fb73c071a70 2024-09-13T15:15:25.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.138+0000 7fb732a00640 1 -- 172.21.15.7:0/725453464 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72800c9a0 con 0x7fb73c071a70 2024-09-13T15:15:25.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.142+0000 7fb741800640 1 -- 172.21.15.7:0/725453464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73c14a780 con 0x7fb73c071a70 2024-09-13T15:15:25.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.142+0000 7fb732a00640 1 -- 172.21.15.7:0/725453464 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800cd30 con 0x7fb73c071a70 2024-09-13T15:15:25.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.142+0000 7fb741800640 1 -- 172.21.15.7:0/725453464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb73c1f5650 con 0x7fb73c071a70 2024-09-13T15:15:25.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.142+0000 7fb741800640 1 -- 172.21.15.7:0/725453464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73c067650 con 0x7fb73c071a70 2024-09-13T15:15:25.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.142+0000 7fb732a00640 1 -- 172.21.15.7:0/725453464 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb728013470 con 0x7fb73c071a70 2024-09-13T15:15:25.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.142+0000 7fb732a00640 1 --2- 172.21.15.7:0/725453464 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb71c066690 0x7fb71c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:25.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.142+0000 7fb732a00640 1 -- 172.21.15.7:0/725453464 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fb728084ae0 con 0x7fb73c071a70 2024-09-13T15:15:25.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.146+0000 7fb73aa00640 1 --2- 172.21.15.7:0/725453464 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb71c066690 0x7fb71c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:25.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.146+0000 7fb73aa00640 1 --2- 172.21.15.7:0/725453464 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb71c066690 0x7fb71c068b50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb72c000f70 tx=0x7fb72c007b60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:25.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.150+0000 7fb732a00640 1 -- 172.21.15.7:0/725453464 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb7280517b0 con 0x7fb73c071a70 2024-09-13T15:15:25.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.350+0000 7fb741800640 1 -- 172.21.15.7:0/725453464 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb73c1580a0 con 0x7fb73c071a70 2024-09-13T15:15:25.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.350+0000 7fb732a00640 1 -- 172.21.15.7:0/725453464 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6285 (secure 0 0 0) 0x7fb728017090 con 0x7fb73c071a70 2024-09-13T15:15:25.352 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:25.352 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5710,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:14:13.112535+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:25.352 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 52 2024-09-13T15:15:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.350+0000 7fb741800640 1 -- 172.21.15.7:0/725453464 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb71c066690 msgr2=0x7fb71c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.350+0000 7fb741800640 1 --2- 172.21.15.7:0/725453464 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb71c066690 0x7fb71c068b50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb72c000f70 tx=0x7fb72c007b60 comp rx=0 tx=0).stop 2024-09-13T15:15:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.350+0000 7fb741800640 1 -- 172.21.15.7:0/725453464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c071a70 msgr2=0x7fb73c1f5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.350+0000 7fb741800640 1 --2- 172.21.15.7:0/725453464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c071a70 0x7fb73c1f5e50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb72800e9b0 tx=0x7fb72800ee70 comp rx=0 tx=0).stop 2024-09-13T15:15:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.350+0000 7fb741800640 1 -- 172.21.15.7:0/725453464 shutdown_connections 2024-09-13T15:15:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.350+0000 7fb741800640 1 --2- 172.21.15.7:0/725453464 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb71c066690 0x7fb71c068b50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.350+0000 7fb741800640 1 --2- 172.21.15.7:0/725453464 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb73c0b0bf0 0x7fb73c148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.350+0000 7fb741800640 1 --2- 172.21.15.7:0/725453464 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c071a70 0x7fb73c1f5e50 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.350+0000 7fb741800640 1 --2- 172.21.15.7:0/725453464 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb73c06ddb0 0x7fb73c143480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:25.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.350+0000 7fb741800640 1 -- 172.21.15.7:0/725453464 >> 172.21.15.7:0/725453464 conn(0x7fb73c065d40 msgr2=0x7fb73c144670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:25.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.350+0000 7fb741800640 1 -- 172.21.15.7:0/725453464 shutdown_connections 2024-09-13T15:15:25.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:25.350+0000 7fb741800640 1 -- 172.21.15.7:0/725453464 wait complete. 2024-09-13T15:15:25.375 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-09-13T15:15:27.376 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:27.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.514+0000 7f860a400640 1 Processor -- start 2024-09-13T15:15:27.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f860a400640 1 -- start start 2024-09-13T15:15:27.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f860a400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8604156500 0x7f860415c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:27.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f860a400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8604159a90 0x7f86040712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:27.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f860a400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86040717f0 0x7f86040b2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:27.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f860a400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86040c92e0 con 0x7f8604156500 2024-09-13T15:15:27.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f860a400640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860415cbc0 con 0x7f8604159a90 2024-09-13T15:15:27.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f860a400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860415cea0 con 0x7f86040717f0 2024-09-13T15:15:27.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f8609000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8604156500 0x7f860415c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:27.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f8609000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f8604156500 0x7f860415c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49626/0 (socket says 172.21.15.7:49626) 2024-09-13T15:15:27.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f8609000640 1 -- 172.21.15.7:0/154495494 learned_addr learned my addr 172.21.15.7:0/154495494 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:27.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f8603e00640 1 --2- 172.21.15.7:0/154495494 >> v2:172.21.15.77:3300/0 conn(0x7f8604159a90 0x7f86040712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:27.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f8609a00640 1 --2- 172.21.15.7:0/154495494 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86040717f0 0x7f86040b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:27.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f8609000640 1 -- 172.21.15.7:0/154495494 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86040717f0 msgr2=0x7f86040b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:27.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f8609000640 1 --2- 172.21.15.7:0/154495494 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86040717f0 0x7f86040b2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:27.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f8609000640 1 -- 172.21.15.7:0/154495494 >> v2:172.21.15.77:3300/0 conn(0x7f8604159a90 msgr2=0x7f86040712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:27.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f8609000640 1 --2- 172.21.15.7:0/154495494 >> v2:172.21.15.77:3300/0 conn(0x7f8604159a90 0x7f86040712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:27.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f8609000640 1 -- 172.21.15.7:0/154495494 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860415d180 con 0x7f8604156500 2024-09-13T15:15:27.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.518+0000 7f8603e00640 1 --2- 172.21.15.7:0/154495494 >> v2:172.21.15.77:3300/0 conn(0x7f8604159a90 0x7f86040712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:15:27.523 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.522+0000 7f8609000640 1 --2- 172.21.15.7:0/154495494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8604156500 0x7f860415c580 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f86040cbb40 tx=0x7f85f801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af5568eb6384ac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:27.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.522+0000 7f8603400640 1 -- 172.21.15.7:0/154495494 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f80ab600 con 0x7f8604156500 2024-09-13T15:15:27.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.522+0000 7f8603400640 1 -- 172.21.15.7:0/154495494 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f80a7050 con 0x7f8604156500 2024-09-13T15:15:27.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.522+0000 7f8603400640 1 -- 172.21.15.7:0/154495494 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f80ab980 con 0x7f8604156500 2024-09-13T15:15:27.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.522+0000 7f860a400640 1 -- 172.21.15.7:0/154495494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8604156500 msgr2=0x7f860415c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:27.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.522+0000 7f860a400640 1 --2- 172.21.15.7:0/154495494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8604156500 0x7f860415c580 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f86040cbb40 tx=0x7f85f801c490 comp rx=0 tx=0).stop 2024-09-13T15:15:27.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.522+0000 7f860a400640 1 -- 172.21.15.7:0/154495494 shutdown_connections 2024-09-13T15:15:27.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.522+0000 7f860a400640 1 --2- 172.21.15.7:0/154495494 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f86040717f0 0x7f86040b2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:27.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.522+0000 7f860a400640 1 --2- 172.21.15.7:0/154495494 >> v2:172.21.15.77:3300/0 conn(0x7f8604159a90 0x7f86040712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:27.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.522+0000 7f860a400640 1 --2- 172.21.15.7:0/154495494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8604156500 0x7f860415c580 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:27.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.522+0000 7f860a400640 1 -- 172.21.15.7:0/154495494 >> 172.21.15.7:0/154495494 conn(0x7f86040739a0 msgr2=0x7f860406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:27.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.522+0000 7f860a400640 1 -- 172.21.15.7:0/154495494 shutdown_connections 2024-09-13T15:15:27.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.522+0000 7f860a400640 1 -- 172.21.15.7:0/154495494 wait complete. 2024-09-13T15:15:27.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.522+0000 7f860a400640 1 Processor -- start 2024-09-13T15:15:27.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.522+0000 7f860a400640 1 -- start start 2024-09-13T15:15:27.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f860a400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86040717f0 0x7f860414fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:27.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f860a400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8604156500 0x7f860414ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:27.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f860a400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8604159a90 0x7f860415a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:27.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f860a400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860415b430 con 0x7f86040717f0 2024-09-13T15:15:27.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f860a400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860415a230 con 0x7f8604156500 2024-09-13T15:15:27.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f860a400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86041f2890 con 0x7f8604159a90 2024-09-13T15:15:27.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f8609000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86040717f0 0x7f860414fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:27.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f8609000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86040717f0 0x7f860414fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49632/0 (socket says 172.21.15.7:49632) 2024-09-13T15:15:27.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f8609000640 1 -- 172.21.15.7:0/1548556745 learned_addr learned my addr 172.21.15.7:0/1548556745 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:27.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f8603e00640 1 --2- 172.21.15.7:0/1548556745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8604156500 0x7f860414ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:27.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f8609a00640 1 --2- 172.21.15.7:0/1548556745 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8604159a90 0x7f860415a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:27.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f8609000640 1 -- 172.21.15.7:0/1548556745 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8604159a90 msgr2=0x7f860415a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:27.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f8609000640 1 --2- 172.21.15.7:0/1548556745 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8604159a90 0x7f860415a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:27.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f8609000640 1 -- 172.21.15.7:0/1548556745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8604156500 msgr2=0x7f860414ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:27.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f8609000640 1 --2- 172.21.15.7:0/1548556745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8604156500 0x7f860414ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:27.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f8609000640 1 -- 172.21.15.7:0/1548556745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f80094d0 con 0x7f86040717f0 2024-09-13T15:15:27.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f8609000640 1 --2- 172.21.15.7:0/1548556745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86040717f0 0x7f860414fa40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f85f801cd30 tx=0x7f85f801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:27.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f8600c00640 1 -- 172.21.15.7:0/1548556745 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f80b6620 con 0x7f86040717f0 2024-09-13T15:15:27.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f8600c00640 1 -- 172.21.15.7:0/1548556745 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f80b6780 con 0x7f86040717f0 2024-09-13T15:15:27.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f8600c00640 1 -- 172.21.15.7:0/1548556745 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f80b6b10 con 0x7f86040717f0 2024-09-13T15:15:27.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f860a400640 1 -- 172.21.15.7:0/1548556745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8604151bf0 con 0x7f86040717f0 2024-09-13T15:15:27.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f860a400640 1 -- 172.21.15.7:0/1548556745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860415b960 con 0x7f86040717f0 2024-09-13T15:15:27.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f860a400640 1 -- 172.21.15.7:0/1548556745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86041568e0 con 0x7f86040717f0 2024-09-13T15:15:27.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.526+0000 7f8600c00640 1 -- 172.21.15.7:0/1548556745 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f85f80b2040 con 0x7f86040717f0 2024-09-13T15:15:27.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.530+0000 7f8600c00640 1 --2- 172.21.15.7:0/1548556745 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f85e4066690 0x7f85e4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:27.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.530+0000 7f8600c00640 1 -- 172.21.15.7:0/1548556745 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f85f811eb70 con 0x7f86040717f0 2024-09-13T15:15:27.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.530+0000 7f8603e00640 1 --2- 172.21.15.7:0/1548556745 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f85e4066690 0x7f85e4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:27.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.530+0000 7f8603e00640 1 --2- 172.21.15.7:0/1548556745 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f85e4066690 0x7f85e4068b50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f86040b13f0 tx=0x7f85f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:27.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.534+0000 7f8600c00640 1 -- 172.21.15.7:0/1548556745 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f85f80eba80 con 0x7f86040717f0 2024-09-13T15:15:27.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.734+0000 7f860a400640 1 -- 172.21.15.7:0/1548556745 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8604153530 con 0x7f86040717f0 2024-09-13T15:15:27.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.734+0000 7f8600c00640 1 -- 172.21.15.7:0/1548556745 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+6285 (secure 0 0 0) 0x7f85f80ef0a0 con 0x7f86040717f0 2024-09-13T15:15:27.736 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:27.736 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":52,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5710,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:14:13.112535+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":4276,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_4276":{"gid":4276,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.7:6836/2396967179","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2396967179},{"type":"v1","addr":"172.21.15.7:6836","nonce":2396967179}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:27.737 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 52 2024-09-13T15:15:27.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.734+0000 7f860a400640 1 -- 172.21.15.7:0/1548556745 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f85e4066690 msgr2=0x7f85e4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:27.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.734+0000 7f860a400640 1 --2- 172.21.15.7:0/1548556745 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f85e4066690 0x7f85e4068b50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f86040b13f0 tx=0x7f85f0008040 comp rx=0 tx=0).stop 2024-09-13T15:15:27.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.734+0000 7f860a400640 1 -- 172.21.15.7:0/1548556745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86040717f0 msgr2=0x7f860414fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:27.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.734+0000 7f860a400640 1 --2- 172.21.15.7:0/1548556745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86040717f0 0x7f860414fa40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f85f801cd30 tx=0x7f85f801acd0 comp rx=0 tx=0).stop 2024-09-13T15:15:27.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.734+0000 7f860a400640 1 -- 172.21.15.7:0/1548556745 shutdown_connections 2024-09-13T15:15:27.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.734+0000 7f860a400640 1 --2- 172.21.15.7:0/1548556745 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f85e4066690 0x7f85e4068b50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:27.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.734+0000 7f860a400640 1 --2- 172.21.15.7:0/1548556745 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8604159a90 0x7f860415a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:27.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.734+0000 7f860a400640 1 --2- 172.21.15.7:0/1548556745 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8604156500 0x7f860414ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:27.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.734+0000 7f860a400640 1 --2- 172.21.15.7:0/1548556745 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86040717f0 0x7f860414fa40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:27.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.734+0000 7f860a400640 1 -- 172.21.15.7:0/1548556745 >> 172.21.15.7:0/1548556745 conn(0x7f86040739a0 msgr2=0x7f86041521f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:27.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.734+0000 7f860a400640 1 -- 172.21.15.7:0/1548556745 shutdown_connections 2024-09-13T15:15:27.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:27.734+0000 7f860a400640 1 -- 172.21.15.7:0/1548556745 wait complete. 2024-09-13T15:15:27.766 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-09-13T15:15:29.767 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:29.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.910+0000 7f584b200640 1 Processor -- start 2024-09-13T15:15:29.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.910+0000 7f584b200640 1 -- start start 2024-09-13T15:15:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.910+0000 7f584b200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f584c156500 0x7f584c15c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.910+0000 7f584b200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f584c0b2410 0x7f584c0b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.910+0000 7f584b200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c15cbc0 con 0x7f584c159a90 2024-09-13T15:15:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.910+0000 7f584b200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584c0c92e0 con 0x7f584c0b2410 2024-09-13T15:15:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.910+0000 7f584b200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584c15cea0 con 0x7f584c156500 2024-09-13T15:15:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.910+0000 7f584a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f584c0b2410 0x7f584c0b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.910+0000 7f584a800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f584c0b2410 0x7f584c0b2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45454/0 (socket says 172.21.15.7:45454) 2024-09-13T15:15:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.910+0000 7f584a800640 1 -- 172.21.15.7:0/1199222520 learned_addr learned my addr 172.21.15.7:0/1199222520 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.910+0000 7f5849400640 1 --1- 172.21.15.7:0/1199222520 >> v1:172.21.15.7:6789/0 conn(0x7f584c159a90 0x7f584c0712b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48680/0 (socket says 172.21.15.7:48680) 2024-09-13T15:15:29.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.910+0000 7f5849e00640 1 --2- 172.21.15.7:0/1199222520 >> v2:172.21.15.77:3300/0 conn(0x7f584c156500 0x7f584c15c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:29.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.910+0000 7f584a800640 1 -- 172.21.15.7:0/1199222520 >> v2:172.21.15.77:3300/0 conn(0x7f584c156500 msgr2=0x7f584c15c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:29.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.910+0000 7f584a800640 1 --2- 172.21.15.7:0/1199222520 >> v2:172.21.15.77:3300/0 conn(0x7f584c156500 0x7f584c15c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:29.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.910+0000 7f584a800640 1 -- 172.21.15.7:0/1199222520 >> v1:172.21.15.7:6789/0 conn(0x7f584c159a90 legacy=0x7f584c0712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:29.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.910+0000 7f584a800640 1 -- 172.21.15.7:0/1199222520 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c15d180 con 0x7f584c0b2410 2024-09-13T15:15:29.914 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.910+0000 7f5848a00640 1 -- 172.21.15.7:0/1199222520 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 582885701 0 0) 0x7f584c15cbc0 con 0x7f584c159a90 2024-09-13T15:15:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.914+0000 7f584a800640 1 --2- 172.21.15.7:0/1199222520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f584c0b2410 0x7f584c0b2870 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f584c06bd80 tx=0x7f584401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4307895c3b7913f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.914+0000 7f5848a00640 1 -- 172.21.15.7:0/1199222520 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58440a5620 con 0x7f584c0b2410 2024-09-13T15:15:29.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.914+0000 7f5848a00640 1 -- 172.21.15.7:0/1199222520 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58440a5780 con 0x7f584c0b2410 2024-09-13T15:15:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.914+0000 7f5848a00640 1 -- 172.21.15.7:0/1199222520 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58440a5b10 con 0x7f584c0b2410 2024-09-13T15:15:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.914+0000 7f584b200640 1 -- 172.21.15.7:0/1199222520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f584c0b2410 msgr2=0x7f584c0b2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.914+0000 7f584b200640 1 --2- 172.21.15.7:0/1199222520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f584c0b2410 0x7f584c0b2870 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f584c06bd80 tx=0x7f584401c960 comp rx=0 tx=0).stop 2024-09-13T15:15:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.914+0000 7f584b200640 1 -- 172.21.15.7:0/1199222520 shutdown_connections 2024-09-13T15:15:29.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.914+0000 7f584b200640 1 --2- 172.21.15.7:0/1199222520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f584c0b2410 0x7f584c0b2870 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.914+0000 7f584b200640 1 --2- 172.21.15.7:0/1199222520 >> v2:172.21.15.77:3300/0 conn(0x7f584c156500 0x7f584c15c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.914+0000 7f584b200640 1 -- 172.21.15.7:0/1199222520 >> 172.21.15.7:0/1199222520 conn(0x7f584c0739a0 msgr2=0x7f584c06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.914+0000 7f584b200640 1 -- 172.21.15.7:0/1199222520 shutdown_connections 2024-09-13T15:15:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.914+0000 7f584b200640 1 -- 172.21.15.7:0/1199222520 wait complete. 2024-09-13T15:15:29.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f584b200640 1 Processor -- start 2024-09-13T15:15:29.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f584b200640 1 -- start start 2024-09-13T15:15:29.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f584b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f584c0b2410 0x7f584c152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:29.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f584b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f584c156500 0x7f584c1573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f584b200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f584c159a90 0x7f584c14fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f584b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c158850 con 0x7f584c156500 2024-09-13T15:15:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f584b200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c156c70 con 0x7f584c159a90 2024-09-13T15:15:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f584b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c1585e0 con 0x7f584c0b2410 2024-09-13T15:15:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f5849400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f584c156500 0x7f584c1573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f5849400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f584c156500 0x7f584c1573e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45460/0 (socket says 172.21.15.7:45460) 2024-09-13T15:15:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f5849400640 1 -- 172.21.15.7:0/588539037 learned_addr learned my addr 172.21.15.7:0/588539037 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f584a800640 1 --2- 172.21.15.7:0/588539037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f584c159a90 0x7f584c14fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f5849e00640 1 --2- 172.21.15.7:0/588539037 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f584c0b2410 0x7f584c152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f5849400640 1 -- 172.21.15.7:0/588539037 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f584c0b2410 msgr2=0x7f584c152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f5849400640 1 --2- 172.21.15.7:0/588539037 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f584c0b2410 0x7f584c152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f5849400640 1 -- 172.21.15.7:0/588539037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f584c159a90 msgr2=0x7f584c14fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:29.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f5849400640 1 --2- 172.21.15.7:0/588539037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f584c159a90 0x7f584c14fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:29.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f5849400640 1 -- 172.21.15.7:0/588539037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5844009b30 con 0x7f584c156500 2024-09-13T15:15:29.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f5849400640 1 --2- 172.21.15.7:0/588539037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f584c156500 0x7f584c1573e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f583800c480 tx=0x7f583800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:29.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f5842000640 1 -- 172.21.15.7:0/588539037 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838007480 con 0x7f584c156500 2024-09-13T15:15:29.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f5842000640 1 -- 172.21.15.7:0/588539037 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58380075e0 con 0x7f584c156500 2024-09-13T15:15:29.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f5842000640 1 -- 172.21.15.7:0/588539037 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58380059f0 con 0x7f584c156500 2024-09-13T15:15:29.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f584b200640 1 -- 172.21.15.7:0/588539037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584c1f1db0 con 0x7f584c156500 2024-09-13T15:15:29.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f584b200640 1 -- 172.21.15.7:0/588539037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584c156ec0 con 0x7f584c156500 2024-09-13T15:15:29.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.918+0000 7f584b200640 1 -- 172.21.15.7:0/588539037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f584c151590 con 0x7f584c156500 2024-09-13T15:15:29.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.922+0000 7f5842000640 1 -- 172.21.15.7:0/588539037 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5838005b50 con 0x7f584c156500 2024-09-13T15:15:29.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.922+0000 7f5842000640 1 --2- 172.21.15.7:0/588539037 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f582c066690 0x7f582c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:29.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.922+0000 7f5842000640 1 -- 172.21.15.7:0/588539037 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f5838083c90 con 0x7f584c156500 2024-09-13T15:15:29.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.922+0000 7f5849e00640 1 --2- 172.21.15.7:0/588539037 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f582c066690 0x7f582c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:29.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.922+0000 7f5849e00640 1 --2- 172.21.15.7:0/588539037 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f582c066690 0x7f582c068b50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f583c009af0 tx=0x7f583c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:29.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:29.926+0000 7f5842000640 1 -- 172.21.15.7:0/588539037 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5838050ae0 con 0x7f584c156500 2024-09-13T15:15:30.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.126+0000 7f584b200640 1 -- 172.21.15.7:0/588539037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f584c1568e0 con 0x7f584c156500 2024-09-13T15:15:30.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.126+0000 7f5842000640 1 -- 172.21.15.7:0/588539037 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+5532 (secure 0 0 0) 0x7f5838017020 con 0x7f584c156500 2024-09-13T15:15:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:30.128 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":53,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:15:27.858400+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":5710,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5710":{"gid":5710,"name":"f","rank":0,"incarnation":53,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:30.128 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 53 2024-09-13T15:15:30.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.126+0000 7f584b200640 1 -- 172.21.15.7:0/588539037 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f582c066690 msgr2=0x7f582c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:30.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.126+0000 7f584b200640 1 --2- 172.21.15.7:0/588539037 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f582c066690 0x7f582c068b50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f583c009af0 tx=0x7f583c008040 comp rx=0 tx=0).stop 2024-09-13T15:15:30.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.126+0000 7f584b200640 1 -- 172.21.15.7:0/588539037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f584c156500 msgr2=0x7f584c1573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:30.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.126+0000 7f584b200640 1 --2- 172.21.15.7:0/588539037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f584c156500 0x7f584c1573e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f583800c480 tx=0x7f583800c940 comp rx=0 tx=0).stop 2024-09-13T15:15:30.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.126+0000 7f584b200640 1 -- 172.21.15.7:0/588539037 shutdown_connections 2024-09-13T15:15:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.126+0000 7f584b200640 1 --2- 172.21.15.7:0/588539037 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f582c066690 0x7f582c068b50 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.126+0000 7f584b200640 1 --2- 172.21.15.7:0/588539037 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f584c159a90 0x7f584c14fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.126+0000 7f584b200640 1 --2- 172.21.15.7:0/588539037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f584c156500 0x7f584c1573e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.126+0000 7f584b200640 1 --2- 172.21.15.7:0/588539037 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f584c0b2410 0x7f584c152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.126+0000 7f584b200640 1 -- 172.21.15.7:0/588539037 >> 172.21.15.7:0/588539037 conn(0x7f584c0739a0 msgr2=0x7f584c0cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.126+0000 7f584b200640 1 -- 172.21.15.7:0/588539037 shutdown_connections 2024-09-13T15:15:30.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.126+0000 7f584b200640 1 -- 172.21.15.7:0/588539037 wait complete. 2024-09-13T15:15:30.150 INFO:tasks.mds_thrash.fs.[cephfs]:mds.c down, removed from mdsmap 2024-09-13T15:15:30.150 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for mds cluster to stabilize... 2024-09-13T15:15:30.150 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:30.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.290+0000 7f09c1c00640 1 Processor -- start 2024-09-13T15:15:30.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.290+0000 7f09c1c00640 1 -- start start 2024-09-13T15:15:30.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.290+0000 7f09c1c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09bc0c9e50 0x7f09bc0c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:30.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.290+0000 7f09c1c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09bc15cd50 con 0x7f09bc15c810 2024-09-13T15:15:30.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.290+0000 7f09c1c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09bc15d030 con 0x7f09bc0cae60 2024-09-13T15:15:30.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.290+0000 7f09c1c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc15a220 con 0x7f09bc0c9e50 2024-09-13T15:15:30.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.290+0000 7f09b3e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f09bc15c810 0x7f09bc0cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48692/0 (socket says 172.21.15.7:48692) 2024-09-13T15:15:30.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.290+0000 7f09b3e00640 1 -- 172.21.15.7:0/3194104961 learned_addr learned my addr 172.21.15.7:0/3194104961 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:15:30.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.290+0000 7f09bb400640 1 --2- 172.21.15.7:0/3194104961 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09bc0c9e50 0x7f09bc0c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:30.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.290+0000 7f09ba000640 1 -- 172.21.15.7:0/3194104961 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155689675 0 0) 0x7f09bc15cd50 con 0x7f09bc15c810 2024-09-13T15:15:30.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.290+0000 7f09ba000640 1 -- 172.21.15.7:0/3194104961 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09a0003530 con 0x7f09bc15c810 2024-09-13T15:15:30.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.290+0000 7f09ba000640 1 -- 172.21.15.7:0/3194104961 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320975675 0 0) 0x7f09bc15d030 con 0x7f09bc0cae60 2024-09-13T15:15:30.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.290+0000 7f09ba000640 1 -- 172.21.15.7:0/3194104961 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09bc15cd50 con 0x7f09bc0cae60 2024-09-13T15:15:30.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.290+0000 7f09bb400640 1 -- 172.21.15.7:0/3194104961 >> v1:172.21.15.77:6789/0 conn(0x7f09bc0cae60 legacy=0x7f09bc159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:30.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.290+0000 7f09ba000640 1 -- 172.21.15.7:0/3194104961 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 829318435 0 0) 0x7f09a0003530 con 0x7f09bc15c810 2024-09-13T15:15:30.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.290+0000 7f09bb400640 1 -- 172.21.15.7:0/3194104961 >> v1:172.21.15.7:6789/0 conn(0x7f09bc15c810 legacy=0x7f09bc0cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:30.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.290+0000 7f09bb400640 1 -- 172.21.15.7:0/3194104961 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc15d310 con 0x7f09bc0c9e50 2024-09-13T15:15:30.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.294+0000 7f09bb400640 1 --2- 172.21.15.7:0/3194104961 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09bc0c9e50 0x7f09bc0c9820 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009dc0 tx=0x7f09b401c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37527878317d3861 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:30.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.294+0000 7f09ba000640 1 -- 172.21.15.7:0/3194104961 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a4001680 con 0x7f09bc0c9e50 2024-09-13T15:15:30.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.294+0000 7f09ba000640 1 -- 172.21.15.7:0/3194104961 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b40a5630 con 0x7f09bc0c9e50 2024-09-13T15:15:30.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.294+0000 7f09ba000640 1 -- 172.21.15.7:0/3194104961 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40a59c0 con 0x7f09bc0c9e50 2024-09-13T15:15:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.294+0000 7f09c1c00640 1 -- 172.21.15.7:0/3194104961 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09bc0c9e50 msgr2=0x7f09bc0c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.294+0000 7f09c1c00640 1 --2- 172.21.15.7:0/3194104961 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09bc0c9e50 0x7f09bc0c9820 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009dc0 tx=0x7f09b401c7f0 comp rx=0 tx=0).stop 2024-09-13T15:15:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.294+0000 7f09c1c00640 1 -- 172.21.15.7:0/3194104961 shutdown_connections 2024-09-13T15:15:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.294+0000 7f09c1c00640 1 --2- 172.21.15.7:0/3194104961 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09bc0c9e50 0x7f09bc0c9820 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.294+0000 7f09c1c00640 1 -- 172.21.15.7:0/3194104961 >> 172.21.15.7:0/3194104961 conn(0x7f09bc065f10 msgr2=0x7f09bc066320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.294+0000 7f09c1c00640 1 -- 172.21.15.7:0/3194104961 shutdown_connections 2024-09-13T15:15:30.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.294+0000 7f09c1c00640 1 -- 172.21.15.7:0/3194104961 wait complete. 2024-09-13T15:15:30.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09c1c00640 1 Processor -- start 2024-09-13T15:15:30.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09c1c00640 1 -- start start 2024-09-13T15:15:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09c1c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09bc0c9e50 0x7f09bc14c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09c1c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09bc0cae60 0x7f09bc1f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09c1c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09bc15c810 0x7f09bc1f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09c1c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc14c8a0 con 0x7f09bc15c810 2024-09-13T15:15:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09c1c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc156cf0 con 0x7f09bc0cae60 2024-09-13T15:15:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09c1c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc156860 con 0x7f09bc0c9e50 2024-09-13T15:15:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09bb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09bc15c810 0x7f09bc1f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09bb400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09bc15c810 0x7f09bc1f2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45474/0 (socket says 172.21.15.7:45474) 2024-09-13T15:15:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09bb400640 1 -- 172.21.15.7:0/1915387462 learned_addr learned my addr 172.21.15.7:0/1915387462 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09b3e00640 1 --2- 172.21.15.7:0/1915387462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09bc0cae60 0x7f09bc1f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09baa00640 1 --2- 172.21.15.7:0/1915387462 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09bc0c9e50 0x7f09bc14c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09bb400640 1 -- 172.21.15.7:0/1915387462 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09bc0c9e50 msgr2=0x7f09bc14c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:30.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09bb400640 1 --2- 172.21.15.7:0/1915387462 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09bc0c9e50 0x7f09bc14c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09bb400640 1 -- 172.21.15.7:0/1915387462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09bc0cae60 msgr2=0x7f09bc1f1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09bb400640 1 --2- 172.21.15.7:0/1915387462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09bc0cae60 0x7f09bc1f1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09bb400640 1 -- 172.21.15.7:0/1915387462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b4009a70 con 0x7f09bc15c810 2024-09-13T15:15:30.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09bb400640 1 --2- 172.21.15.7:0/1915387462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09bc15c810 0x7f09bc1f2200 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f09b401ccd0 tx=0x7f09b4019590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:30.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09b2a00640 1 -- 172.21.15.7:0/1915387462 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40b9860 con 0x7f09bc15c810 2024-09-13T15:15:30.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09b2a00640 1 -- 172.21.15.7:0/1915387462 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b40b99c0 con 0x7f09bc15c810 2024-09-13T15:15:30.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09b2a00640 1 -- 172.21.15.7:0/1915387462 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40b9d50 con 0x7f09bc15c810 2024-09-13T15:15:30.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09c1c00640 1 -- 172.21.15.7:0/1915387462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09bc151780 con 0x7f09bc15c810 2024-09-13T15:15:30.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.298+0000 7f09c1c00640 1 -- 172.21.15.7:0/1915387462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09bc1519f0 con 0x7f09bc15c810 2024-09-13T15:15:30.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.302+0000 7f09c1c00640 1 -- 172.21.15.7:0/1915387462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09bc067650 con 0x7f09bc15c810 2024-09-13T15:15:30.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.302+0000 7f09b2a00640 1 -- 172.21.15.7:0/1915387462 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f09b40ad440 con 0x7f09bc15c810 2024-09-13T15:15:30.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.302+0000 7f09b2a00640 1 --2- 172.21.15.7:0/1915387462 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0998066690 0x7f0998068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:30.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.302+0000 7f09b2a00640 1 -- 172.21.15.7:0/1915387462 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f09b411f810 con 0x7f09bc15c810 2024-09-13T15:15:30.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.302+0000 7f09baa00640 1 --2- 172.21.15.7:0/1915387462 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0998066690 0x7f0998068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:30.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.306+0000 7f09baa00640 1 --2- 172.21.15.7:0/1915387462 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0998066690 0x7f0998068b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0011f0 tx=0x7f09ac009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:30.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.306+0000 7f09b2a00640 1 -- 172.21.15.7:0/1915387462 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f09b40ec5e0 con 0x7f09bc15c810 2024-09-13T15:15:30.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.506+0000 7f09c1c00640 1 -- 172.21.15.7:0/1915387462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09bc0671d0 con 0x7f09bc15c810 2024-09-13T15:15:30.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.506+0000 7f09b2a00640 1 -- 172.21.15.7:0/1915387462 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+5532 (secure 0 0 0) 0x7f09b4009450 con 0x7f09bc15c810 2024-09-13T15:15:30.510 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:30.510 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":53,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:15:27.858400+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":5710,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5710":{"gid":5710,"name":"f","rank":0,"incarnation":53,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:30.510 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 53 2024-09-13T15:15:30.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.510+0000 7f09c1c00640 1 -- 172.21.15.7:0/1915387462 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0998066690 msgr2=0x7f0998068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:30.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.510+0000 7f09c1c00640 1 --2- 172.21.15.7:0/1915387462 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0998066690 0x7f0998068b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f09ac0011f0 tx=0x7f09ac009040 comp rx=0 tx=0).stop 2024-09-13T15:15:30.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.510+0000 7f09c1c00640 1 -- 172.21.15.7:0/1915387462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09bc15c810 msgr2=0x7f09bc1f2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:30.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.510+0000 7f09c1c00640 1 --2- 172.21.15.7:0/1915387462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09bc15c810 0x7f09bc1f2200 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f09b401ccd0 tx=0x7f09b4019590 comp rx=0 tx=0).stop 2024-09-13T15:15:30.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.510+0000 7f09c1c00640 1 -- 172.21.15.7:0/1915387462 shutdown_connections 2024-09-13T15:15:30.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.510+0000 7f09c1c00640 1 --2- 172.21.15.7:0/1915387462 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0998066690 0x7f0998068b50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:30.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.510+0000 7f09c1c00640 1 --2- 172.21.15.7:0/1915387462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09bc15c810 0x7f09bc1f2200 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:30.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.510+0000 7f09c1c00640 1 --2- 172.21.15.7:0/1915387462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f09bc0cae60 0x7f09bc1f1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:30.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.510+0000 7f09c1c00640 1 --2- 172.21.15.7:0/1915387462 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f09bc0c9e50 0x7f09bc14c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:30.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.510+0000 7f09c1c00640 1 -- 172.21.15.7:0/1915387462 >> 172.21.15.7:0/1915387462 conn(0x7f09bc065f10 msgr2=0x7f09bc0cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:30.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.510+0000 7f09c1c00640 1 -- 172.21.15.7:0/1915387462 shutdown_connections 2024-09-13T15:15:30.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:30.510+0000 7f09c1c00640 1 -- 172.21.15.7:0/1915387462 wait complete. 2024-09-13T15:15:30.533 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 53, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-13T15:01:44.789559+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 53, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3 ], "info": { "gid_5069": { "addr": "172.21.15.77:6838/877425259", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6836", "nonce": 877425259, "type": "v2" }, { "addr": "172.21.15.77:6838", "nonce": 877425259, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5069, "incarnation": 31, "join_fscid": -1, "name": "b", "rank": 3, "state": "up:active", "state_seq": 43 }, "gid_5198": { "addr": "172.21.15.7:6833/1355774527", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6832", "nonce": 1355774527, "type": "v2" }, { "addr": "172.21.15.7:6833", "nonce": 1355774527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5198, "incarnation": 41, "join_fscid": -1, "name": "e", "rank": 2, "state": "up:active", "state_seq": 14 }, "gid_5569": { "addr": "172.21.15.77:6835/1536067351", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6834", "nonce": 1536067351, "type": "v2" }, { "addr": "172.21.15.77:6835", "nonce": 1536067351, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5569, "incarnation": 47, "join_fscid": -1, "name": "d", "rank": 1, "state": "up:active", "state_seq": 30 }, "gid_5710": { "addr": "172.21.15.77:6839/3948947951", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6837", "nonce": 3948947951, "type": "v2" }, { "addr": "172.21.15.77:6839", "nonce": 3948947951, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5710, "incarnation": 53, "join_fscid": -1, "name": "f", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 4, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-13T15:15:27.858400+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [ 4 ], "tableserver": 0, "up": { "mds_0": 5710, "mds_1": 5569, "mds_2": 5198, "mds_3": 5069 } } } ], "standbys": [ { "addr": "172.21.15.7:6837/3708232086", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6835", "nonce": 3708232086, "type": "v2" }, { "addr": "172.21.15.7:6837", "nonce": 3708232086, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 36, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5156, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-13T15:15:32.535 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.686+0000 7f5b1d600640 1 Processor -- start 2024-09-13T15:15:32.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.686+0000 7f5b1d600640 1 -- start start 2024-09-13T15:15:32.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.686+0000 7f5b1d600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5b18152f50 0x7f5b180ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:32.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.686+0000 7f5b1d600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5b18153330 0x7f5b180cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:32.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.686+0000 7f5b1d600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b18159210 con 0x7f5b1806f830 2024-09-13T15:15:32.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.686+0000 7f5b1d600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b181594f0 con 0x7f5b18153330 2024-09-13T15:15:32.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.686+0000 7f5b1d600640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b181597d0 con 0x7f5b18152f50 2024-09-13T15:15:32.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.686+0000 7f5b0fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5b18153330 0x7f5b180cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:32.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.686+0000 7f5b0fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5b18153330 0x7f5b180cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45484/0 (socket says 172.21.15.7:45484) 2024-09-13T15:15:32.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.686+0000 7f5b0fe00640 1 -- 172.21.15.7:0/4081332643 learned_addr learned my addr 172.21.15.7:0/4081332643 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:32.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.686+0000 7f5b16a00640 1 --2- 172.21.15.7:0/4081332643 >> v2:172.21.15.77:3300/0 conn(0x7f5b18152f50 0x7f5b180ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:32.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.690+0000 7f5b0fe00640 1 -- 172.21.15.7:0/4081332643 >> v2:172.21.15.77:3300/0 conn(0x7f5b18152f50 msgr2=0x7f5b180ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:32.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.690+0000 7f5b0fe00640 1 --2- 172.21.15.7:0/4081332643 >> v2:172.21.15.77:3300/0 conn(0x7f5b18152f50 0x7f5b180ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:32.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.690+0000 7f5b0fe00640 1 -- 172.21.15.7:0/4081332643 >> v1:172.21.15.77:6789/0 conn(0x7f5b1806f830 legacy=0x7f5b1815c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:32.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.690+0000 7f5b0fe00640 1 -- 172.21.15.7:0/4081332643 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b18159ab0 con 0x7f5b18153330 2024-09-13T15:15:32.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.690+0000 7f5b0fe00640 1 --2- 172.21.15.7:0/4081332643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b18153330 0x7f5b180cd000 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5b180ca6f0 tx=0x7f5b0001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3ef006b5077239 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:32.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.690+0000 7f5b16000640 1 -- 172.21.15.7:0/4081332643 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b000aa430 con 0x7f5b18153330 2024-09-13T15:15:32.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.690+0000 7f5b16000640 1 -- 172.21.15.7:0/4081332643 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b000aa590 con 0x7f5b18153330 2024-09-13T15:15:32.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.690+0000 7f5b16000640 1 -- 172.21.15.7:0/4081332643 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b000aa920 con 0x7f5b18153330 2024-09-13T15:15:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.690+0000 7f5b1d600640 1 -- 172.21.15.7:0/4081332643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b18153330 msgr2=0x7f5b180cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b1d600640 1 --2- 172.21.15.7:0/4081332643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b18153330 0x7f5b180cd000 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f5b180ca6f0 tx=0x7f5b0001c4b0 comp rx=0 tx=0).stop 2024-09-13T15:15:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b1d600640 1 -- 172.21.15.7:0/4081332643 shutdown_connections 2024-09-13T15:15:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b1d600640 1 --2- 172.21.15.7:0/4081332643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b18153330 0x7f5b180cd000 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:32.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b1d600640 1 --2- 172.21.15.7:0/4081332643 >> v2:172.21.15.77:3300/0 conn(0x7f5b18152f50 0x7f5b180ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:32.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b1d600640 1 -- 172.21.15.7:0/4081332643 >> 172.21.15.7:0/4081332643 conn(0x7f5b180739a0 msgr2=0x7f5b18071830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:32.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b1d600640 1 -- 172.21.15.7:0/4081332643 shutdown_connections 2024-09-13T15:15:32.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b1d600640 1 -- 172.21.15.7:0/4081332643 wait complete. 2024-09-13T15:15:32.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b1d600640 1 Processor -- start 2024-09-13T15:15:32.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b1d600640 1 -- start start 2024-09-13T15:15:32.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b1d600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b1806f830 0x7f5b18155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b1d600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b18152f50 0x7f5b1815b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b1d600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b18153330 0x7f5b180c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b1d600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b180c57e0 con 0x7f5b1806f830 2024-09-13T15:15:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b1d600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b180c51b0 con 0x7f5b18152f50 2024-09-13T15:15:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b1d600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b180c6aa0 con 0x7f5b18153330 2024-09-13T15:15:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b16a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b1806f830 0x7f5b18155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b16a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b1806f830 0x7f5b18155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45496/0 (socket says 172.21.15.7:45496) 2024-09-13T15:15:32.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b16a00640 1 -- 172.21.15.7:0/2931404720 learned_addr learned my addr 172.21.15.7:0/2931404720 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:32.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b0fe00640 1 --2- 172.21.15.7:0/2931404720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b18152f50 0x7f5b1815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:32.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b17400640 1 --2- 172.21.15.7:0/2931404720 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b18153330 0x7f5b180c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:32.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b16a00640 1 -- 172.21.15.7:0/2931404720 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b18153330 msgr2=0x7f5b180c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:32.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b16a00640 1 --2- 172.21.15.7:0/2931404720 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b18153330 0x7f5b180c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:32.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b16a00640 1 -- 172.21.15.7:0/2931404720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b18152f50 msgr2=0x7f5b1815b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:32.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b16a00640 1 --2- 172.21.15.7:0/2931404720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b18152f50 0x7f5b1815b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:32.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b16a00640 1 -- 172.21.15.7:0/2931404720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b000094d0 con 0x7f5b1806f830 2024-09-13T15:15:32.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b0fe00640 1 --2- 172.21.15.7:0/2931404720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b18152f50 0x7f5b1815b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:15:32.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b16a00640 1 --2- 172.21.15.7:0/2931404720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b1806f830 0x7f5b18155790 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800d800 tx=0x7f5b0800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:32.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.694+0000 7f5b0ea00640 1 -- 172.21.15.7:0/2931404720 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0800b6c0 con 0x7f5b1806f830 2024-09-13T15:15:32.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.698+0000 7f5b0ea00640 1 -- 172.21.15.7:0/2931404720 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0800b820 con 0x7f5b1806f830 2024-09-13T15:15:32.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.698+0000 7f5b0ea00640 1 -- 172.21.15.7:0/2931404720 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0800bb90 con 0x7f5b1806f830 2024-09-13T15:15:32.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.698+0000 7f5b1d600640 1 -- 172.21.15.7:0/2931404720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b180c6d80 con 0x7f5b1806f830 2024-09-13T15:15:32.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.698+0000 7f5b1d600640 1 -- 172.21.15.7:0/2931404720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1815c410 con 0x7f5b1806f830 2024-09-13T15:15:32.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.698+0000 7f5b1d600640 1 -- 172.21.15.7:0/2931404720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1815c9f0 con 0x7f5b1806f830 2024-09-13T15:15:32.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.698+0000 7f5b0ea00640 1 -- 172.21.15.7:0/2931404720 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5b0800bcf0 con 0x7f5b1806f830 2024-09-13T15:15:32.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.698+0000 7f5b0ea00640 1 --2- 172.21.15.7:0/2931404720 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5af40666c0 0x7f5af4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:32.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.698+0000 7f5b0ea00640 1 -- 172.21.15.7:0/2931404720 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f5b08084d60 con 0x7f5b1806f830 2024-09-13T15:15:32.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.698+0000 7f5b0fe00640 1 --2- 172.21.15.7:0/2931404720 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5af40666c0 0x7f5af4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:32.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.702+0000 7f5b0fe00640 1 --2- 172.21.15.7:0/2931404720 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5af40666c0 0x7f5af4068b80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5b000ae000 tx=0x7f5b000a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:32.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.706+0000 7f5b0ea00640 1 -- 172.21.15.7:0/2931404720 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5b08051a80 con 0x7f5b1806f830 2024-09-13T15:15:32.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.922+0000 7f5b1d600640 1 -- 172.21.15.7:0/2931404720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b180b2e40 con 0x7f5b1806f830 2024-09-13T15:15:32.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.926+0000 7f5b0ea00640 1 -- 172.21.15.7:0/2931404720 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+5532 (secure 0 0 0) 0x7f5b080550a0 con 0x7f5b1806f830 2024-09-13T15:15:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:32.927 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":53,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:15:27.858400+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":5710,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5710":{"gid":5710,"name":"f","rank":0,"incarnation":53,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:32.928 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 53 2024-09-13T15:15:32.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.926+0000 7f5b1d600640 1 -- 172.21.15.7:0/2931404720 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5af40666c0 msgr2=0x7f5af4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.926+0000 7f5b1d600640 1 --2- 172.21.15.7:0/2931404720 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5af40666c0 0x7f5af4068b80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5b000ae000 tx=0x7f5b000a7000 comp rx=0 tx=0).stop 2024-09-13T15:15:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.926+0000 7f5b1d600640 1 -- 172.21.15.7:0/2931404720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b1806f830 msgr2=0x7f5b18155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.926+0000 7f5b1d600640 1 --2- 172.21.15.7:0/2931404720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b1806f830 0x7f5b18155790 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800d800 tx=0x7f5b0800dcc0 comp rx=0 tx=0).stop 2024-09-13T15:15:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.926+0000 7f5b1d600640 1 -- 172.21.15.7:0/2931404720 shutdown_connections 2024-09-13T15:15:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.926+0000 7f5b1d600640 1 --2- 172.21.15.7:0/2931404720 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5af40666c0 0x7f5af4068b80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.926+0000 7f5b1d600640 1 --2- 172.21.15.7:0/2931404720 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b18153330 0x7f5b180c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.926+0000 7f5b1d600640 1 --2- 172.21.15.7:0/2931404720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b18152f50 0x7f5b1815b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.926+0000 7f5b1d600640 1 --2- 172.21.15.7:0/2931404720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b1806f830 0x7f5b18155790 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.926+0000 7f5b1d600640 1 -- 172.21.15.7:0/2931404720 >> 172.21.15.7:0/2931404720 conn(0x7f5b180739a0 msgr2=0x7f5b18157860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.926+0000 7f5b1d600640 1 -- 172.21.15.7:0/2931404720 shutdown_connections 2024-09-13T15:15:32.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:32.926+0000 7f5b1d600640 1 -- 172.21.15.7:0/2931404720 wait complete. 2024-09-13T15:15:32.950 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:15:34.952 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:35.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.094+0000 7f9380200640 1 Processor -- start 2024-09-13T15:15:35.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.094+0000 7f9380200640 1 -- start start 2024-09-13T15:15:35.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.094+0000 7f9380200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f93780cae60 0x7f93780c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:35.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.094+0000 7f9380200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f937815c810 0x7f9378159b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:35.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.094+0000 7f9380200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f937815cd50 con 0x7f93780c9e50 2024-09-13T15:15:35.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.094+0000 7f9380200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937815d030 con 0x7f93780cae60 2024-09-13T15:15:35.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.094+0000 7f9380200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937815d310 con 0x7f937815c810 2024-09-13T15:15:35.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.094+0000 7f937d800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f93780cae60 0x7f93780c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:35.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.094+0000 7f937e200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f93780c9e50 0x7f93780cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:48706/0 (socket says 172.21.15.7:48706) 2024-09-13T15:15:35.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.094+0000 7f937e200640 1 -- 172.21.15.7:0/3717114475 learned_addr learned my addr 172.21.15.7:0/3717114475 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:15:35.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.094+0000 7f937ce00640 1 --2- 172.21.15.7:0/3717114475 >> v2:172.21.15.77:3300/0 conn(0x7f937815c810 0x7f9378159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:35.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.094+0000 7f9377e00640 1 -- 172.21.15.7:0/3717114475 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255896829 0 0) 0x7f937815cd50 con 0x7f93780c9e50 2024-09-13T15:15:35.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.094+0000 7f9377e00640 1 -- 172.21.15.7:0/3717114475 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9360003530 con 0x7f93780c9e50 2024-09-13T15:15:35.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.094+0000 7f937d800640 1 -- 172.21.15.7:0/3717114475 >> v2:172.21.15.77:3300/0 conn(0x7f937815c810 msgr2=0x7f9378159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:35.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.094+0000 7f937d800640 1 --2- 172.21.15.7:0/3717114475 >> v2:172.21.15.77:3300/0 conn(0x7f937815c810 0x7f9378159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:35.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.094+0000 7f937d800640 1 -- 172.21.15.7:0/3717114475 >> v1:172.21.15.7:6789/0 conn(0x7f93780c9e50 legacy=0x7f93780cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:35.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.094+0000 7f937d800640 1 -- 172.21.15.7:0/3717114475 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937815d5f0 con 0x7f93780cae60 2024-09-13T15:15:35.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.098+0000 7f937d800640 1 --2- 172.21.15.7:0/3717114475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93780cae60 0x7f93780c9820 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f93780b3eb0 tx=0x7f936c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc88a942ee53067 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:35.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.098+0000 7f9377e00640 1 -- 172.21.15.7:0/3717114475 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c0ac640 con 0x7f93780cae60 2024-09-13T15:15:35.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.098+0000 7f9377e00640 1 -- 172.21.15.7:0/3717114475 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936c0ac7a0 con 0x7f93780cae60 2024-09-13T15:15:35.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.098+0000 7f9377e00640 1 -- 172.21.15.7:0/3717114475 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c0acb30 con 0x7f93780cae60 2024-09-13T15:15:35.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.098+0000 7f9380200640 1 -- 172.21.15.7:0/3717114475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93780cae60 msgr2=0x7f93780c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:35.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.098+0000 7f9380200640 1 --2- 172.21.15.7:0/3717114475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93780cae60 0x7f93780c9820 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f93780b3eb0 tx=0x7f936c01c3c0 comp rx=0 tx=0).stop 2024-09-13T15:15:35.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.098+0000 7f9380200640 1 -- 172.21.15.7:0/3717114475 shutdown_connections 2024-09-13T15:15:35.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.098+0000 7f9380200640 1 --2- 172.21.15.7:0/3717114475 >> v2:172.21.15.77:3300/0 conn(0x7f937815c810 0x7f9378159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:35.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.098+0000 7f9380200640 1 --2- 172.21.15.7:0/3717114475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93780cae60 0x7f93780c9820 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:35.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.098+0000 7f9380200640 1 -- 172.21.15.7:0/3717114475 >> 172.21.15.7:0/3717114475 conn(0x7f9378065f10 msgr2=0x7f9378066320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:35.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.098+0000 7f9380200640 1 -- 172.21.15.7:0/3717114475 shutdown_connections 2024-09-13T15:15:35.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.098+0000 7f9380200640 1 -- 172.21.15.7:0/3717114475 wait complete. 2024-09-13T15:15:35.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f9380200640 1 Processor -- start 2024-09-13T15:15:35.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f9380200640 1 -- start start 2024-09-13T15:15:35.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f9380200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93780c9e50 0x7f93781f5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:35.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f9380200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93780cae60 0x7f93780c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:35.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f9380200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f937815c810 0x7f93781f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:35.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f9380200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93780c5b10 con 0x7f937815c810 2024-09-13T15:15:35.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f9380200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93781f1be0 con 0x7f93780c9e50 2024-09-13T15:15:35.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f9380200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9378156b10 con 0x7f93780cae60 2024-09-13T15:15:35.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f937d800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93780c9e50 0x7f93781f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:35.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f937e200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f937815c810 0x7f93781f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:35.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f937ce00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93780cae60 0x7f93780c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:35.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f937d800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93780c9e50 0x7f93781f5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:60764/0 (socket says 172.21.15.7:60764) 2024-09-13T15:15:35.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f937d800640 1 -- 172.21.15.7:0/395388139 learned_addr learned my addr 172.21.15.7:0/395388139 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:35.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f937e200640 1 -- 172.21.15.7:0/395388139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93780cae60 msgr2=0x7f93780c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:35.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f937e200640 1 --2- 172.21.15.7:0/395388139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93780cae60 0x7f93780c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:35.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f937e200640 1 -- 172.21.15.7:0/395388139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93780c9e50 msgr2=0x7f93781f5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:35.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f937e200640 1 --2- 172.21.15.7:0/395388139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93780c9e50 0x7f93781f5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:35.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f937e200640 1 -- 172.21.15.7:0/395388139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f936c009420 con 0x7f937815c810 2024-09-13T15:15:35.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f937e200640 1 --2- 172.21.15.7:0/395388139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f937815c810 0x7f93781f16a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f937000caa0 tx=0x7f937000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:35.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f9375600640 1 -- 172.21.15.7:0/395388139 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937000ab40 con 0x7f937815c810 2024-09-13T15:15:35.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f9375600640 1 -- 172.21.15.7:0/395388139 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937000aca0 con 0x7f937815c810 2024-09-13T15:15:35.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f9380200640 1 -- 172.21.15.7:0/395388139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9378156550 con 0x7f937815c810 2024-09-13T15:15:35.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f9375600640 1 -- 172.21.15.7:0/395388139 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9370012600 con 0x7f937815c810 2024-09-13T15:15:35.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.102+0000 7f9380200640 1 -- 172.21.15.7:0/395388139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93781f4cb0 con 0x7f937815c810 2024-09-13T15:15:35.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.106+0000 7f9380200640 1 -- 172.21.15.7:0/395388139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9378067650 con 0x7f937815c810 2024-09-13T15:15:35.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.106+0000 7f9375600640 1 -- 172.21.15.7:0/395388139 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9370007070 con 0x7f937815c810 2024-09-13T15:15:35.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.106+0000 7f9375600640 1 --2- 172.21.15.7:0/395388139 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9358066690 0x7f9358068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:35.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.106+0000 7f9375600640 1 -- 172.21.15.7:0/395388139 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f9370084650 con 0x7f937815c810 2024-09-13T15:15:35.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.106+0000 7f937d800640 1 --2- 172.21.15.7:0/395388139 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9358066690 0x7f9358068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:35.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.106+0000 7f937d800640 1 --2- 172.21.15.7:0/395388139 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9358066690 0x7f9358068b50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f936c01c400 tx=0x7f936c0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:35.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.110+0000 7f9375600640 1 -- 172.21.15.7:0/395388139 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9370051380 con 0x7f937815c810 2024-09-13T15:15:35.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.338+0000 7f9380200640 1 -- 172.21.15.7:0/395388139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93780b3cb0 con 0x7f937815c810 2024-09-13T15:15:35.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.338+0000 7f9375600640 1 -- 172.21.15.7:0/395388139 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+5532 (secure 0 0 0) 0x7f9370017090 con 0x7f937815c810 2024-09-13T15:15:35.340 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:35.341 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":53,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:15:27.858400+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":5710,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5710":{"gid":5710,"name":"f","rank":0,"incarnation":53,"state":"up:replay","state_seq":1,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:35.341 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 53 2024-09-13T15:15:35.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.338+0000 7f9380200640 1 -- 172.21.15.7:0/395388139 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9358066690 msgr2=0x7f9358068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:35.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.338+0000 7f9380200640 1 --2- 172.21.15.7:0/395388139 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9358066690 0x7f9358068b50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f936c01c400 tx=0x7f936c0a7000 comp rx=0 tx=0).stop 2024-09-13T15:15:35.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.338+0000 7f9380200640 1 -- 172.21.15.7:0/395388139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f937815c810 msgr2=0x7f93781f16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:35.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.338+0000 7f9380200640 1 --2- 172.21.15.7:0/395388139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f937815c810 0x7f93781f16a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f937000caa0 tx=0x7f937000cf60 comp rx=0 tx=0).stop 2024-09-13T15:15:35.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.338+0000 7f9380200640 1 -- 172.21.15.7:0/395388139 shutdown_connections 2024-09-13T15:15:35.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.338+0000 7f9380200640 1 --2- 172.21.15.7:0/395388139 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9358066690 0x7f9358068b50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:35.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.338+0000 7f9380200640 1 --2- 172.21.15.7:0/395388139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f937815c810 0x7f93781f16a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:35.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.338+0000 7f9380200640 1 --2- 172.21.15.7:0/395388139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f93780cae60 0x7f93780c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:35.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.338+0000 7f9380200640 1 --2- 172.21.15.7:0/395388139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f93780c9e50 0x7f93781f5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:35.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.338+0000 7f9380200640 1 -- 172.21.15.7:0/395388139 >> 172.21.15.7:0/395388139 conn(0x7f9378065f10 msgr2=0x7f9378156f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:35.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.338+0000 7f9380200640 1 -- 172.21.15.7:0/395388139 shutdown_connections 2024-09-13T15:15:35.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:35.338+0000 7f9380200640 1 -- 172.21.15.7:0/395388139 wait complete. 2024-09-13T15:15:35.363 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:15:37.364 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:37.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.502+0000 7fee6e800640 1 Processor -- start 2024-09-13T15:15:37.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.506+0000 7fee6e800640 1 -- start start 2024-09-13T15:15:37.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.506+0000 7fee6e800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fee6815c810 0x7fee680c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:37.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.506+0000 7fee6e800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee680c9e50 0x7fee680cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:37.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.506+0000 7fee6e800640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6815cd50 con 0x7fee680cae60 2024-09-13T15:15:37.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.506+0000 7fee6e800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6815a220 con 0x7fee680c9e50 2024-09-13T15:15:37.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.506+0000 7fee6e800640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6815d030 con 0x7fee6815c810 2024-09-13T15:15:37.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.506+0000 7fee67e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee680c9e50 0x7fee680cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:37.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.506+0000 7fee67e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fee680c9e50 0x7fee680cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45518/0 (socket says 172.21.15.7:45518) 2024-09-13T15:15:37.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.506+0000 7fee67e00640 1 -- 172.21.15.7:0/32681299 learned_addr learned my addr 172.21.15.7:0/32681299 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:37.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.506+0000 7fee5fe00640 1 --2- 172.21.15.7:0/32681299 >> v2:172.21.15.77:3300/0 conn(0x7fee6815c810 0x7fee680c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:37.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.506+0000 7fee67e00640 1 -- 172.21.15.7:0/32681299 >> v2:172.21.15.77:3300/0 conn(0x7fee6815c810 msgr2=0x7fee680c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:37.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.506+0000 7fee67e00640 1 --2- 172.21.15.7:0/32681299 >> v2:172.21.15.77:3300/0 conn(0x7fee6815c810 0x7fee680c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:37.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.506+0000 7fee67e00640 1 -- 172.21.15.7:0/32681299 >> v1:172.21.15.77:6789/0 conn(0x7fee680cae60 legacy=0x7fee68159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:37.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.506+0000 7fee67e00640 1 -- 172.21.15.7:0/32681299 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6815d310 con 0x7fee680c9e50 2024-09-13T15:15:37.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.510+0000 7fee67e00640 1 --2- 172.21.15.7:0/32681299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee680c9e50 0x7fee680cefb0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fee680b3eb0 tx=0x7fee6001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71844ccb038bd05d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:37.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.510+0000 7fee66a00640 1 -- 172.21.15.7:0/32681299 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600a56c0 con 0x7fee680c9e50 2024-09-13T15:15:37.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.510+0000 7fee66a00640 1 -- 172.21.15.7:0/32681299 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee600a5820 con 0x7fee680c9e50 2024-09-13T15:15:37.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.510+0000 7fee66a00640 1 -- 172.21.15.7:0/32681299 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee600a5bb0 con 0x7fee680c9e50 2024-09-13T15:15:37.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.510+0000 7fee6e800640 1 -- 172.21.15.7:0/32681299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee680c9e50 msgr2=0x7fee680cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:37.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.510+0000 7fee6e800640 1 --2- 172.21.15.7:0/32681299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee680c9e50 0x7fee680cefb0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fee680b3eb0 tx=0x7fee6001c8f0 comp rx=0 tx=0).stop 2024-09-13T15:15:37.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.510+0000 7fee6e800640 1 -- 172.21.15.7:0/32681299 shutdown_connections 2024-09-13T15:15:37.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.510+0000 7fee6e800640 1 --2- 172.21.15.7:0/32681299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee680c9e50 0x7fee680cefb0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:37.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.510+0000 7fee6e800640 1 --2- 172.21.15.7:0/32681299 >> v2:172.21.15.77:3300/0 conn(0x7fee6815c810 0x7fee680c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:37.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.510+0000 7fee6e800640 1 -- 172.21.15.7:0/32681299 >> 172.21.15.7:0/32681299 conn(0x7fee68065f10 msgr2=0x7fee68066320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:37.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.510+0000 7fee6e800640 1 -- 172.21.15.7:0/32681299 shutdown_connections 2024-09-13T15:15:37.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.510+0000 7fee6e800640 1 -- 172.21.15.7:0/32681299 wait complete. 2024-09-13T15:15:37.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.510+0000 7fee6e800640 1 Processor -- start 2024-09-13T15:15:37.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.510+0000 7fee6e800640 1 -- start start 2024-09-13T15:15:37.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee6e800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee680c9e50 0x7fee68150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:37.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee6e800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee680cae60 0x7fee680c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:37.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee6e800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee6815c810 0x7fee681519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:37.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee6e800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee68154a70 con 0x7fee680cae60 2024-09-13T15:15:37.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee6e800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee680c8280 con 0x7fee680c9e50 2024-09-13T15:15:37.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee6e800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee681509a0 con 0x7fee6815c810 2024-09-13T15:15:37.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee5fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee680cae60 0x7fee680c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:37.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee5fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee680cae60 0x7fee680c7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45532/0 (socket says 172.21.15.7:45532) 2024-09-13T15:15:37.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee5fe00640 1 -- 172.21.15.7:0/3565250892 learned_addr learned my addr 172.21.15.7:0/3565250892 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:37.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee67400640 1 --2- 172.21.15.7:0/3565250892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee680c9e50 0x7fee68150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:37.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee67e00640 1 --2- 172.21.15.7:0/3565250892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee6815c810 0x7fee681519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:37.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee5fe00640 1 -- 172.21.15.7:0/3565250892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee6815c810 msgr2=0x7fee681519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:37.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee5fe00640 1 --2- 172.21.15.7:0/3565250892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee6815c810 0x7fee681519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:37.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee5fe00640 1 -- 172.21.15.7:0/3565250892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee680c9e50 msgr2=0x7fee68150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:37.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee5fe00640 1 --2- 172.21.15.7:0/3565250892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee680c9e50 0x7fee68150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:37.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee5fe00640 1 -- 172.21.15.7:0/3565250892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee60009b30 con 0x7fee680cae60 2024-09-13T15:15:37.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee5fe00640 1 --2- 172.21.15.7:0/3565250892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee680cae60 0x7fee680c7d40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fee5000d620 tx=0x7fee5000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:37.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee5f400640 1 -- 172.21.15.7:0/3565250892 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5000b620 con 0x7fee680cae60 2024-09-13T15:15:37.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee5f400640 1 -- 172.21.15.7:0/3565250892 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5000b780 con 0x7fee680cae60 2024-09-13T15:15:37.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee6e800640 1 -- 172.21.15.7:0/3565250892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee681542c0 con 0x7fee680cae60 2024-09-13T15:15:37.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee5f400640 1 -- 172.21.15.7:0/3565250892 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5000bb10 con 0x7fee680cae60 2024-09-13T15:15:37.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee6e800640 1 -- 172.21.15.7:0/3565250892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee681f2ef0 con 0x7fee680cae60 2024-09-13T15:15:37.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee6e800640 1 -- 172.21.15.7:0/3565250892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee68067650 con 0x7fee680cae60 2024-09-13T15:15:37.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.514+0000 7fee5f400640 1 -- 172.21.15.7:0/3565250892 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fee5000bc70 con 0x7fee680cae60 2024-09-13T15:15:37.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.518+0000 7fee5f400640 1 --2- 172.21.15.7:0/3565250892 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fee44066690 0x7fee44068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:37.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.518+0000 7fee5f400640 1 -- 172.21.15.7:0/3565250892 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7fee50084bf0 con 0x7fee680cae60 2024-09-13T15:15:37.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.518+0000 7fee67400640 1 --2- 172.21.15.7:0/3565250892 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fee44066690 0x7fee44068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:37.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.518+0000 7fee67400640 1 --2- 172.21.15.7:0/3565250892 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fee44066690 0x7fee44068b50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fee58007fd0 tx=0x7fee58007e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:37.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.522+0000 7fee5f400640 1 -- 172.21.15.7:0/3565250892 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fee50051920 con 0x7fee680cae60 2024-09-13T15:15:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.717+0000 7fee6e800640 1 -- 172.21.15.7:0/3565250892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee680c7a60 con 0x7fee680cae60 2024-09-13T15:15:37.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.717+0000 7fee5f400640 1 -- 172.21.15.7:0/3565250892 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+5534 (secure 0 0 0) 0x7fee680c7a60 con 0x7fee680cae60 2024-09-13T15:15:37.721 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:37.722 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":54,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:15:35.985237+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":5710,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5710":{"gid":5710,"name":"f","rank":0,"incarnation":53,"state":"up:resolve","state_seq":20,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:37.722 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 54 2024-09-13T15:15:37.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.721+0000 7fee6e800640 1 -- 172.21.15.7:0/3565250892 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fee44066690 msgr2=0x7fee44068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:37.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.721+0000 7fee6e800640 1 --2- 172.21.15.7:0/3565250892 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fee44066690 0x7fee44068b50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fee58007fd0 tx=0x7fee58007e40 comp rx=0 tx=0).stop 2024-09-13T15:15:37.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.721+0000 7fee6e800640 1 -- 172.21.15.7:0/3565250892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee680cae60 msgr2=0x7fee680c7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:37.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.721+0000 7fee6e800640 1 --2- 172.21.15.7:0/3565250892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee680cae60 0x7fee680c7d40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fee5000d620 tx=0x7fee5000dae0 comp rx=0 tx=0).stop 2024-09-13T15:15:37.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.721+0000 7fee6e800640 1 -- 172.21.15.7:0/3565250892 shutdown_connections 2024-09-13T15:15:37.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.721+0000 7fee6e800640 1 --2- 172.21.15.7:0/3565250892 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fee44066690 0x7fee44068b50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:37.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.721+0000 7fee6e800640 1 --2- 172.21.15.7:0/3565250892 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fee6815c810 0x7fee681519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:37.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.721+0000 7fee6e800640 1 --2- 172.21.15.7:0/3565250892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee680cae60 0x7fee680c7d40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:37.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.721+0000 7fee6e800640 1 --2- 172.21.15.7:0/3565250892 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee680c9e50 0x7fee68150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:37.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.721+0000 7fee6e800640 1 -- 172.21.15.7:0/3565250892 >> 172.21.15.7:0/3565250892 conn(0x7fee68065f10 msgr2=0x7fee6815b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:37.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.721+0000 7fee6e800640 1 -- 172.21.15.7:0/3565250892 shutdown_connections 2024-09-13T15:15:37.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:37.721+0000 7fee6e800640 1 -- 172.21.15.7:0/3565250892 wait complete. 2024-09-13T15:15:37.744 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:15:39.745 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:39.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.885+0000 7f1907200640 1 Processor -- start 2024-09-13T15:15:39.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.885+0000 7f1907200640 1 -- start start 2024-09-13T15:15:39.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.885+0000 7f1907200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f190006ddb0 0x7f1900162810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:39.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.885+0000 7f1907200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19000c5530 con 0x7f1900071a70 2024-09-13T15:15:39.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.885+0000 7f1907200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19001583b0 con 0x7f19000b0bf0 2024-09-13T15:15:39.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.885+0000 7f1907200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1900156f40 con 0x7f190006ddb0 2024-09-13T15:15:39.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.885+0000 7f1905200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f190006ddb0 0x7f1900162810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:39.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.885+0000 7f1905200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f190006ddb0 0x7f1900162810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32840/0 (socket says 172.21.15.7:32840) 2024-09-13T15:15:39.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.885+0000 7f18ffe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f1900071a70 0x7f19001576e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58348/0 (socket says 172.21.15.7:58348) 2024-09-13T15:15:39.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.885+0000 7f1905200640 1 -- 172.21.15.7:0/557977758 learned_addr learned my addr 172.21.15.7:0/557977758 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:39.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.885+0000 7f1905200640 1 -- 172.21.15.7:0/557977758 >> v1:172.21.15.77:6789/0 conn(0x7f19000b0bf0 legacy=0x7f1900150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:39.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.885+0000 7f1905200640 1 -- 172.21.15.7:0/557977758 >> v1:172.21.15.7:6789/0 conn(0x7f1900071a70 legacy=0x7f19001576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:39.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.885+0000 7f1905200640 1 -- 172.21.15.7:0/557977758 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19000b10c0 con 0x7f190006ddb0 2024-09-13T15:15:39.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.889+0000 7f1905200640 1 --2- 172.21.15.7:0/557977758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f190006ddb0 0x7f1900162810 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009e50 tx=0x7f18f801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80918e4fa61bedf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:39.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.889+0000 7f18ff400640 1 -- 172.21.15.7:0/557977758 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f80a58d0 con 0x7f190006ddb0 2024-09-13T15:15:39.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.889+0000 7f18ff400640 1 -- 172.21.15.7:0/557977758 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f80a5a30 con 0x7f190006ddb0 2024-09-13T15:15:39.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.889+0000 7f18ff400640 1 -- 172.21.15.7:0/557977758 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f80a5dc0 con 0x7f190006ddb0 2024-09-13T15:15:39.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.889+0000 7f1907200640 1 -- 172.21.15.7:0/557977758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f190006ddb0 msgr2=0x7f1900162810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:39.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.889+0000 7f1907200640 1 --2- 172.21.15.7:0/557977758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f190006ddb0 0x7f1900162810 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f18f8009e50 tx=0x7f18f801ca00 comp rx=0 tx=0).stop 2024-09-13T15:15:39.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.889+0000 7f1907200640 1 -- 172.21.15.7:0/557977758 shutdown_connections 2024-09-13T15:15:39.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.889+0000 7f1907200640 1 --2- 172.21.15.7:0/557977758 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f190006ddb0 0x7f1900162810 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:39.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.889+0000 7f1907200640 1 -- 172.21.15.7:0/557977758 >> 172.21.15.7:0/557977758 conn(0x7f1900065d40 msgr2=0x7f1900066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:39.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.889+0000 7f1907200640 1 -- 172.21.15.7:0/557977758 shutdown_connections 2024-09-13T15:15:39.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.889+0000 7f1907200640 1 -- 172.21.15.7:0/557977758 wait complete. 2024-09-13T15:15:39.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.889+0000 7f1907200640 1 Processor -- start 2024-09-13T15:15:39.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f1907200640 1 -- start start 2024-09-13T15:15:39.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f1907200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f190006ddb0 0x7f19000c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:39.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f1907200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1900071a70 0x7f19001f3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:39.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f1907200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19000b0bf0 0x7f1900144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:39.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f1907200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19001f2840 con 0x7f1900071a70 2024-09-13T15:15:39.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f1907200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19000c9c30 con 0x7f19000b0bf0 2024-09-13T15:15:39.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f1907200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19001f3790 con 0x7f190006ddb0 2024-09-13T15:15:39.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f18f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1900071a70 0x7f19001f3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:39.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f18f7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1900071a70 0x7f19001f3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32852/0 (socket says 172.21.15.7:32852) 2024-09-13T15:15:39.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f18f7e00640 1 -- 172.21.15.7:0/70389730 learned_addr learned my addr 172.21.15.7:0/70389730 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:39.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f18ffe00640 1 --2- 172.21.15.7:0/70389730 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f190006ddb0 0x7f19000c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:39.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f1905200640 1 --2- 172.21.15.7:0/70389730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19000b0bf0 0x7f1900144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f18f7e00640 1 -- 172.21.15.7:0/70389730 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f190006ddb0 msgr2=0x7f19000c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f18f7e00640 1 --2- 172.21.15.7:0/70389730 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f190006ddb0 0x7f19000c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f18f7e00640 1 -- 172.21.15.7:0/70389730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19000b0bf0 msgr2=0x7f1900144260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f18f7e00640 1 --2- 172.21.15.7:0/70389730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19000b0bf0 0x7f1900144260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f18f7e00640 1 -- 172.21.15.7:0/70389730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f8009b30 con 0x7f1900071a70 2024-09-13T15:15:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f18ffe00640 1 --2- 172.21.15.7:0/70389730 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f190006ddb0 0x7f19000c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:15:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f18f7e00640 1 --2- 172.21.15.7:0/70389730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1900071a70 0x7f19001f3250 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f18e800c3c0 tx=0x7f18e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:39.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f18fcc00640 1 -- 172.21.15.7:0/70389730 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e80052d0 con 0x7f1900071a70 2024-09-13T15:15:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f18fcc00640 1 -- 172.21.15.7:0/70389730 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e8005430 con 0x7f1900071a70 2024-09-13T15:15:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f18fcc00640 1 -- 172.21.15.7:0/70389730 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e8003840 con 0x7f1900071a70 2024-09-13T15:15:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f1907200640 1 -- 172.21.15.7:0/70389730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1900154d40 con 0x7f1900071a70 2024-09-13T15:15:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f1907200640 1 -- 172.21.15.7:0/70389730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1900155300 con 0x7f1900071a70 2024-09-13T15:15:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.893+0000 7f1907200640 1 -- 172.21.15.7:0/70389730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1900067650 con 0x7f1900071a70 2024-09-13T15:15:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.897+0000 7f18fcc00640 1 -- 172.21.15.7:0/70389730 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f18e80039a0 con 0x7f1900071a70 2024-09-13T15:15:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.897+0000 7f18fcc00640 1 --2- 172.21.15.7:0/70389730 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18dc066690 0x7f18dc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:39.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.897+0000 7f18fcc00640 1 -- 172.21.15.7:0/70389730 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f18e8083c70 con 0x7f1900071a70 2024-09-13T15:15:39.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.897+0000 7f18ffe00640 1 --2- 172.21.15.7:0/70389730 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18dc066690 0x7f18dc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:39.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.897+0000 7f18ffe00640 1 --2- 172.21.15.7:0/70389730 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18dc066690 0x7f18dc068b50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f18f0000f70 tx=0x7f18f0007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:39.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:39.901+0000 7f18fcc00640 1 -- 172.21.15.7:0/70389730 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f18e8050a30 con 0x7f1900071a70 2024-09-13T15:15:40.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:40.097+0000 7f1907200640 1 -- 172.21.15.7:0/70389730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19001f2f70 con 0x7f1900071a70 2024-09-13T15:15:40.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:40.101+0000 7f18fcc00640 1 -- 172.21.15.7:0/70389730 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+5534 (secure 0 0 0) 0x7f19001f2f70 con 0x7f1900071a70 2024-09-13T15:15:40.103 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:40.104 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":54,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:15:35.985237+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":5710,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5710":{"gid":5710,"name":"f","rank":0,"incarnation":53,"state":"up:resolve","state_seq":20,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:40.104 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 54 2024-09-13T15:15:40.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:40.101+0000 7f1907200640 1 -- 172.21.15.7:0/70389730 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18dc066690 msgr2=0x7f18dc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:40.101+0000 7f1907200640 1 --2- 172.21.15.7:0/70389730 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18dc066690 0x7f18dc068b50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f18f0000f70 tx=0x7f18f0007d50 comp rx=0 tx=0).stop 2024-09-13T15:15:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:40.101+0000 7f1907200640 1 -- 172.21.15.7:0/70389730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1900071a70 msgr2=0x7f19001f3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:40.101+0000 7f1907200640 1 --2- 172.21.15.7:0/70389730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1900071a70 0x7f19001f3250 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f18e800c3c0 tx=0x7f18e800c880 comp rx=0 tx=0).stop 2024-09-13T15:15:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:40.101+0000 7f1907200640 1 -- 172.21.15.7:0/70389730 shutdown_connections 2024-09-13T15:15:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:40.101+0000 7f1907200640 1 --2- 172.21.15.7:0/70389730 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f18dc066690 0x7f18dc068b50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:40.101+0000 7f1907200640 1 --2- 172.21.15.7:0/70389730 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19000b0bf0 0x7f1900144260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:40.101+0000 7f1907200640 1 --2- 172.21.15.7:0/70389730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1900071a70 0x7f19001f3250 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:40.101+0000 7f1907200640 1 --2- 172.21.15.7:0/70389730 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f190006ddb0 0x7f19000c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:40.101+0000 7f1907200640 1 -- 172.21.15.7:0/70389730 >> 172.21.15.7:0/70389730 conn(0x7f1900065d40 msgr2=0x7f1900150aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:40.101+0000 7f1907200640 1 -- 172.21.15.7:0/70389730 shutdown_connections 2024-09-13T15:15:40.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:40.101+0000 7f1907200640 1 -- 172.21.15.7:0/70389730 wait complete. 2024-09-13T15:15:40.126 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:15:42.128 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:42.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.265+0000 7faee8000640 1 Processor -- start 2024-09-13T15:15:42.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.265+0000 7faee8000640 1 -- start start 2024-09-13T15:15:42.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.269+0000 7faee8000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faee0151280 0x7faee015ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:42.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.269+0000 7faee8000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faee006f8b0 0x7faee0161720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:42.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.269+0000 7faee8000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee015a3b0 con 0x7faee00c7550 2024-09-13T15:15:42.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.269+0000 7faee8000640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee0151660 con 0x7faee0151280 2024-09-13T15:15:42.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.269+0000 7faee8000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee00c7a90 con 0x7faee006f8b0 2024-09-13T15:15:42.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.269+0000 7faee5600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faee0151280 0x7faee015ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:42.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.269+0000 7faee6000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faee006f8b0 0x7faee0161720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:42.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.269+0000 7faee5600640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7faee0151280 0x7faee015ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:35798/0 (socket says 172.21.15.7:35798) 2024-09-13T15:15:42.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.269+0000 7faee5600640 1 -- 172.21.15.7:0/1531398139 learned_addr learned my addr 172.21.15.7:0/1531398139 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:42.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.269+0000 7faee6000640 1 -- 172.21.15.7:0/1531398139 >> v2:172.21.15.77:3300/0 conn(0x7faee0151280 msgr2=0x7faee015ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:42.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.269+0000 7faee6000640 1 --2- 172.21.15.7:0/1531398139 >> v2:172.21.15.77:3300/0 conn(0x7faee0151280 0x7faee015ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:42.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.269+0000 7faee6000640 1 -- 172.21.15.7:0/1531398139 >> v1:172.21.15.77:6789/0 conn(0x7faee00c7550 legacy=0x7faee00ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:42.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.269+0000 7faee6000640 1 -- 172.21.15.7:0/1531398139 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee00b2b10 con 0x7faee006f8b0 2024-09-13T15:15:42.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.269+0000 7faee5600640 1 --2- 172.21.15.7:0/1531398139 >> v2:172.21.15.77:3300/0 conn(0x7faee0151280 0x7faee015ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:15:42.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.273+0000 7faee6000640 1 --2- 172.21.15.7:0/1531398139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faee006f8b0 0x7faee0161720 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faed8009dc0 tx=0x7faed801c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b9de2dda6bd4748 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:42.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.273+0000 7faedfe00640 1 -- 172.21.15.7:0/1531398139 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed80a5870 con 0x7faee006f8b0 2024-09-13T15:15:42.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.273+0000 7faedfe00640 1 -- 172.21.15.7:0/1531398139 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed80a59d0 con 0x7faee006f8b0 2024-09-13T15:15:42.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.273+0000 7faedfe00640 1 -- 172.21.15.7:0/1531398139 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed80a5d60 con 0x7faee006f8b0 2024-09-13T15:15:42.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.273+0000 7faee8000640 1 -- 172.21.15.7:0/1531398139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faee006f8b0 msgr2=0x7faee0161720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:42.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.273+0000 7faee8000640 1 --2- 172.21.15.7:0/1531398139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faee006f8b0 0x7faee0161720 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faed8009dc0 tx=0x7faed801c8c0 comp rx=0 tx=0).stop 2024-09-13T15:15:42.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.273+0000 7faee8000640 1 -- 172.21.15.7:0/1531398139 shutdown_connections 2024-09-13T15:15:42.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.273+0000 7faee8000640 1 --2- 172.21.15.7:0/1531398139 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faee006f8b0 0x7faee0161720 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:42.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.273+0000 7faee8000640 1 --2- 172.21.15.7:0/1531398139 >> v2:172.21.15.77:3300/0 conn(0x7faee0151280 0x7faee015ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:42.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.273+0000 7faee8000640 1 -- 172.21.15.7:0/1531398139 >> 172.21.15.7:0/1531398139 conn(0x7faee00717a0 msgr2=0x7faee0071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:42.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.273+0000 7faee8000640 1 -- 172.21.15.7:0/1531398139 shutdown_connections 2024-09-13T15:15:42.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.273+0000 7faee8000640 1 -- 172.21.15.7:0/1531398139 wait complete. 2024-09-13T15:15:42.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.273+0000 7faee8000640 1 Processor -- start 2024-09-13T15:15:42.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.273+0000 7faee8000640 1 -- start start 2024-09-13T15:15:42.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee8000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faee006f8b0 0x7faee01f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:42.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee8000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faee00c7550 0x7faee01566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:42.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee8000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee0151280 0x7faee00ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:42.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee8000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee0154e60 con 0x7faee0151280 2024-09-13T15:15:42.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee8000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee01f6010 con 0x7faee00c7550 2024-09-13T15:15:42.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee8000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee006b3a0 con 0x7faee006f8b0 2024-09-13T15:15:42.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee0151280 0x7faee00ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:42.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee0151280 0x7faee00ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32854/0 (socket says 172.21.15.7:32854) 2024-09-13T15:15:42.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee6000640 1 -- 172.21.15.7:0/4115245973 learned_addr learned my addr 172.21.15.7:0/4115245973 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:42.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee5600640 1 --2- 172.21.15.7:0/4115245973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faee006f8b0 0x7faee01f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:42.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee4c00640 1 --2- 172.21.15.7:0/4115245973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faee00c7550 0x7faee01566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:42.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee6000640 1 -- 172.21.15.7:0/4115245973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faee006f8b0 msgr2=0x7faee01f5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:42.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee6000640 1 --2- 172.21.15.7:0/4115245973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faee006f8b0 0x7faee01f5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:42.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee6000640 1 -- 172.21.15.7:0/4115245973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faee00c7550 msgr2=0x7faee01566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:42.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee6000640 1 --2- 172.21.15.7:0/4115245973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faee00c7550 0x7faee01566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:42.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee6000640 1 -- 172.21.15.7:0/4115245973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed40094d0 con 0x7faee0151280 2024-09-13T15:15:42.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee6000640 1 --2- 172.21.15.7:0/4115245973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee0151280 0x7faee00ccae0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faed8009dc0 tx=0x7faed8019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:42.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faedd600640 1 -- 172.21.15.7:0/4115245973 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed80b9860 con 0x7faee0151280 2024-09-13T15:15:42.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faedd600640 1 -- 172.21.15.7:0/4115245973 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed80b99c0 con 0x7faee0151280 2024-09-13T15:15:42.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faedd600640 1 -- 172.21.15.7:0/4115245973 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed80b9d30 con 0x7faee0151280 2024-09-13T15:15:42.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee8000640 1 -- 172.21.15.7:0/4115245973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed8009a70 con 0x7faee0151280 2024-09-13T15:15:42.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee8000640 1 -- 172.21.15.7:0/4115245973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee01450f0 con 0x7faee0151280 2024-09-13T15:15:42.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faee8000640 1 -- 172.21.15.7:0/4115245973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee00cd750 con 0x7faee0151280 2024-09-13T15:15:42.282 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.277+0000 7faedd600640 1 -- 172.21.15.7:0/4115245973 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faed80c4460 con 0x7faee0151280 2024-09-13T15:15:42.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.281+0000 7faedd600640 1 --2- 172.21.15.7:0/4115245973 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faec0066690 0x7faec0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:42.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.281+0000 7faedd600640 1 -- 172.21.15.7:0/4115245973 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7faed811fb40 con 0x7faee0151280 2024-09-13T15:15:42.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.281+0000 7faee5600640 1 --2- 172.21.15.7:0/4115245973 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faec0066690 0x7faec0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:42.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.281+0000 7faee5600640 1 --2- 172.21.15.7:0/4115245973 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faec0066690 0x7faec0068b50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faed4009bd0 tx=0x7faed4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:42.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.285+0000 7faedd600640 1 -- 172.21.15.7:0/4115245973 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faed80ec8e0 con 0x7faee0151280 2024-09-13T15:15:42.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.489+0000 7faee8000640 1 -- 172.21.15.7:0/4115245973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faee015ab20 con 0x7faee0151280 2024-09-13T15:15:42.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.489+0000 7faedd600640 1 -- 172.21.15.7:0/4115245973 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+5536 (secure 0 0 0) 0x7faed80b2090 con 0x7faee0151280 2024-09-13T15:15:42.492 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:42.493 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:15:42.014620+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":5710,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5710":{"gid":5710,"name":"f","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":22,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:42.493 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 55 2024-09-13T15:15:42.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.489+0000 7faee8000640 1 -- 172.21.15.7:0/4115245973 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faec0066690 msgr2=0x7faec0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:42.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.489+0000 7faee8000640 1 --2- 172.21.15.7:0/4115245973 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faec0066690 0x7faec0068b50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7faed4009bd0 tx=0x7faed4008040 comp rx=0 tx=0).stop 2024-09-13T15:15:42.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.489+0000 7faee8000640 1 -- 172.21.15.7:0/4115245973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee0151280 msgr2=0x7faee00ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:42.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.489+0000 7faee8000640 1 --2- 172.21.15.7:0/4115245973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee0151280 0x7faee00ccae0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faed8009dc0 tx=0x7faed8019660 comp rx=0 tx=0).stop 2024-09-13T15:15:42.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.489+0000 7faee8000640 1 -- 172.21.15.7:0/4115245973 shutdown_connections 2024-09-13T15:15:42.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.489+0000 7faee8000640 1 --2- 172.21.15.7:0/4115245973 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faec0066690 0x7faec0068b50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:42.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.489+0000 7faee8000640 1 --2- 172.21.15.7:0/4115245973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee0151280 0x7faee00ccae0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:42.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.489+0000 7faee8000640 1 --2- 172.21.15.7:0/4115245973 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faee00c7550 0x7faee01566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:42.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.489+0000 7faee8000640 1 --2- 172.21.15.7:0/4115245973 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7faee006f8b0 0x7faee01f5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:42.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.489+0000 7faee8000640 1 -- 172.21.15.7:0/4115245973 >> 172.21.15.7:0/4115245973 conn(0x7faee00717a0 msgr2=0x7faee00c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:42.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.489+0000 7faee8000640 1 -- 172.21.15.7:0/4115245973 shutdown_connections 2024-09-13T15:15:42.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:42.489+0000 7faee8000640 1 -- 172.21.15.7:0/4115245973 wait complete. 2024-09-13T15:15:42.515 INFO:tasks.mds_thrash.fs.[cephfs]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 55, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-09-13T15:01:44.789559+0000", "damaged": [], "data_pools": [ 3, 4 ], "enabled": true, "epoch": 55, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0, 1, 2, 3 ], "info": { "gid_5069": { "addr": "172.21.15.77:6838/877425259", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6836", "nonce": 877425259, "type": "v2" }, { "addr": "172.21.15.77:6838", "nonce": 877425259, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5069, "incarnation": 31, "join_fscid": -1, "name": "b", "rank": 3, "state": "up:active", "state_seq": 43 }, "gid_5198": { "addr": "172.21.15.7:6833/1355774527", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6832", "nonce": 1355774527, "type": "v2" }, { "addr": "172.21.15.7:6833", "nonce": 1355774527, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5198, "incarnation": 41, "join_fscid": -1, "name": "e", "rank": 2, "state": "up:active", "state_seq": 14 }, "gid_5569": { "addr": "172.21.15.77:6835/1536067351", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6834", "nonce": 1536067351, "type": "v2" }, { "addr": "172.21.15.77:6835", "nonce": 1536067351, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5569, "incarnation": 47, "join_fscid": -1, "name": "d", "rank": 1, "state": "up:active", "state_seq": 30 }, "gid_5710": { "addr": "172.21.15.77:6839/3948947951", "addrs": { "addrvec": [ { "addr": "172.21.15.77:6837", "nonce": 3948947951, "type": "v2" }, { "addr": "172.21.15.77:6839", "nonce": 3948947951, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5710, "incarnation": 53, "join_fscid": -1, "name": "f", "rank": 0, "state": "up:reconnect", "state_seq": 22 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 4, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-09-13T15:15:42.014620+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [ 4 ], "tableserver": 0, "up": { "mds_0": 5710, "mds_1": 5569, "mds_2": 5198, "mds_3": 5069 } } } ], "standbys": [ { "addr": "172.21.15.7:6837/3708232086", "addrs": { "addrvec": [ { "addr": "172.21.15.7:6835", "nonce": 3708232086, "type": "v2" }, { "addr": "172.21.15.7:6837", "nonce": 3708232086, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 36, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5156, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-09-13T15:15:44.516 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:44.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.657+0000 7fdfd0e00640 1 Processor -- start 2024-09-13T15:15:44.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.657+0000 7fdfd0e00640 1 -- start start 2024-09-13T15:15:44.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.657+0000 7fdfd0e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfcc15c580 0x7fdfcc159a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:44.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.657+0000 7fdfd0e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdfcc0b2410 0x7fdfcc0b2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:44.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.657+0000 7fdfd0e00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfcc159fd0 con 0x7fdfcc156500 2024-09-13T15:15:44.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.657+0000 7fdfd0e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfcc0c92e0 con 0x7fdfcc0b2410 2024-09-13T15:15:44.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.657+0000 7fdfd0e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc15c9a0 con 0x7fdfcc15c580 2024-09-13T15:15:44.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.657+0000 7fdfcbe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdfcc0b2410 0x7fdfcc0b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:44.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.657+0000 7fdfcbe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fdfcc0b2410 0x7fdfcc0b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32858/0 (socket says 172.21.15.7:32858) 2024-09-13T15:15:44.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.657+0000 7fdfcbe00640 1 -- 172.21.15.7:0/4090058802 learned_addr learned my addr 172.21.15.7:0/4090058802 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:44.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.657+0000 7fdfc3e00640 1 --2- 172.21.15.7:0/4090058802 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfcc15c580 0x7fdfcc159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:44.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.657+0000 7fdfcb400640 1 --1- 172.21.15.7:0/4090058802 >> v1:172.21.15.77:6789/0 conn(0x7fdfcc156500 0x7fdfcc0712b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:58914/0 (socket says 172.21.15.7:58914) 2024-09-13T15:15:44.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.657+0000 7fdfcbe00640 1 -- 172.21.15.7:0/4090058802 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfcc15c580 msgr2=0x7fdfcc159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:44.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.657+0000 7fdfcbe00640 1 --2- 172.21.15.7:0/4090058802 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfcc15c580 0x7fdfcc159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:44.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.657+0000 7fdfcbe00640 1 -- 172.21.15.7:0/4090058802 >> v1:172.21.15.77:6789/0 conn(0x7fdfcc156500 legacy=0x7fdfcc0712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:44.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.657+0000 7fdfcbe00640 1 -- 172.21.15.7:0/4090058802 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc15cbc0 con 0x7fdfcc0b2410 2024-09-13T15:15:44.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.661+0000 7fdfcbe00640 1 --2- 172.21.15.7:0/4090058802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfcc0b2410 0x7fdfcc0b2890 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009e80 tx=0x7fdfc401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa6eaf4907cb289 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:44.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.661+0000 7fdfcaa00640 1 -- 172.21.15.7:0/4090058802 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc40a5620 con 0x7fdfcc0b2410 2024-09-13T15:15:44.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.661+0000 7fdfcaa00640 1 -- 172.21.15.7:0/4090058802 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc40a5780 con 0x7fdfcc0b2410 2024-09-13T15:15:44.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.661+0000 7fdfcaa00640 1 -- 172.21.15.7:0/4090058802 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc40a5b10 con 0x7fdfcc0b2410 2024-09-13T15:15:44.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.661+0000 7fdfd0e00640 1 -- 172.21.15.7:0/4090058802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfcc0b2410 msgr2=0x7fdfcc0b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:44.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.661+0000 7fdfd0e00640 1 --2- 172.21.15.7:0/4090058802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfcc0b2410 0x7fdfcc0b2890 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdfc4009e80 tx=0x7fdfc401c980 comp rx=0 tx=0).stop 2024-09-13T15:15:44.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.661+0000 7fdfd0e00640 1 -- 172.21.15.7:0/4090058802 shutdown_connections 2024-09-13T15:15:44.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.661+0000 7fdfd0e00640 1 --2- 172.21.15.7:0/4090058802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfcc0b2410 0x7fdfcc0b2890 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:44.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.661+0000 7fdfd0e00640 1 --2- 172.21.15.7:0/4090058802 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfcc15c580 0x7fdfcc159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:44.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.661+0000 7fdfd0e00640 1 -- 172.21.15.7:0/4090058802 >> 172.21.15.7:0/4090058802 conn(0x7fdfcc0739a0 msgr2=0x7fdfcc06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:44.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.661+0000 7fdfd0e00640 1 -- 172.21.15.7:0/4090058802 shutdown_connections 2024-09-13T15:15:44.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.661+0000 7fdfd0e00640 1 -- 172.21.15.7:0/4090058802 wait complete. 2024-09-13T15:15:44.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.665+0000 7fdfd0e00640 1 Processor -- start 2024-09-13T15:15:44.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.665+0000 7fdfd0e00640 1 -- start start 2024-09-13T15:15:44.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.665+0000 7fdfd0e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfcc0b2410 0x7fdfcc14def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:44.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.665+0000 7fdfd0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfcc156500 0x7fdfcc0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.665+0000 7fdfd0e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfcc15c580 0x7fdfcc0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.665+0000 7fdfd0e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc14f1f0 con 0x7fdfcc156500 2024-09-13T15:15:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.665+0000 7fdfd0e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0cc840 con 0x7fdfcc15c580 2024-09-13T15:15:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.665+0000 7fdfd0e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc15b830 con 0x7fdfcc0b2410 2024-09-13T15:15:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfc3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfcc156500 0x7fdfcc0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfc3e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfcc156500 0x7fdfcc0cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32874/0 (socket says 172.21.15.7:32874) 2024-09-13T15:15:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfc3e00640 1 -- 172.21.15.7:0/3572977881 learned_addr learned my addr 172.21.15.7:0/3572977881 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfcb400640 1 --2- 172.21.15.7:0/3572977881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfcc0b2410 0x7fdfcc14def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfcbe00640 1 --2- 172.21.15.7:0/3572977881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfcc15c580 0x7fdfcc0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfc3e00640 1 -- 172.21.15.7:0/3572977881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfcc0b2410 msgr2=0x7fdfcc14def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfc3e00640 1 --2- 172.21.15.7:0/3572977881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfcc0b2410 0x7fdfcc14def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfc3e00640 1 -- 172.21.15.7:0/3572977881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfcc15c580 msgr2=0x7fdfcc0cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:44.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfc3e00640 1 --2- 172.21.15.7:0/3572977881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfcc15c580 0x7fdfcc0cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:44.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfc3e00640 1 -- 172.21.15.7:0/3572977881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc4009b30 con 0x7fdfcc156500 2024-09-13T15:15:44.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfcbe00640 1 --2- 172.21.15.7:0/3572977881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfcc15c580 0x7fdfcc0cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:15:44.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfc3e00640 1 --2- 172.21.15.7:0/3572977881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfcc156500 0x7fdfcc0cd570 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400e870 tx=0x7fdfb400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:44.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfc3400640 1 -- 172.21.15.7:0/3572977881 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb40095d0 con 0x7fdfcc156500 2024-09-13T15:15:44.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfc3400640 1 -- 172.21.15.7:0/3572977881 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb400c940 con 0x7fdfcc156500 2024-09-13T15:15:44.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfc3400640 1 -- 172.21.15.7:0/3572977881 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb400ccd0 con 0x7fdfcc156500 2024-09-13T15:15:44.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfd0e00640 1 -- 172.21.15.7:0/3572977881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfcc15bb10 con 0x7fdfcc156500 2024-09-13T15:15:44.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfd0e00640 1 -- 172.21.15.7:0/3572977881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfcc0ccd70 con 0x7fdfcc156500 2024-09-13T15:15:44.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfd0e00640 1 -- 172.21.15.7:0/3572977881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfcc1568e0 con 0x7fdfcc156500 2024-09-13T15:15:44.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.669+0000 7fdfc3400640 1 -- 172.21.15.7:0/3572977881 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdfb4013470 con 0x7fdfcc156500 2024-09-13T15:15:44.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.673+0000 7fdfc3400640 1 --2- 172.21.15.7:0/3572977881 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdfa8066690 0x7fdfa8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:44.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.673+0000 7fdfc3400640 1 -- 172.21.15.7:0/3572977881 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7fdfb4084b80 con 0x7fdfcc156500 2024-09-13T15:15:44.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.673+0000 7fdfcb400640 1 --2- 172.21.15.7:0/3572977881 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdfa8066690 0x7fdfa8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:44.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.673+0000 7fdfcb400640 1 --2- 172.21.15.7:0/3572977881 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdfa8066690 0x7fdfa8068b50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc000f70 tx=0x7fdfbc007e50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:44.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.677+0000 7fdfc3400640 1 -- 172.21.15.7:0/3572977881 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdfb4051aa0 con 0x7fdfcc156500 2024-09-13T15:15:44.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.873+0000 7fdfd0e00640 1 -- 172.21.15.7:0/3572977881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfcc152a90 con 0x7fdfcc156500 2024-09-13T15:15:44.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.873+0000 7fdfc3400640 1 -- 172.21.15.7:0/3572977881 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+5536 (secure 0 0 0) 0x7fdfb4017090 con 0x7fdfcc156500 2024-09-13T15:15:44.877 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:44.877 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:15:42.014620+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":5710,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5710":{"gid":5710,"name":"f","rank":0,"incarnation":53,"state":"up:reconnect","state_seq":22,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:44.877 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 55 2024-09-13T15:15:44.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.873+0000 7fdfd0e00640 1 -- 172.21.15.7:0/3572977881 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdfa8066690 msgr2=0x7fdfa8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:44.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.873+0000 7fdfd0e00640 1 --2- 172.21.15.7:0/3572977881 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdfa8066690 0x7fdfa8068b50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc000f70 tx=0x7fdfbc007e50 comp rx=0 tx=0).stop 2024-09-13T15:15:44.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.873+0000 7fdfd0e00640 1 -- 172.21.15.7:0/3572977881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfcc156500 msgr2=0x7fdfcc0cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:44.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.873+0000 7fdfd0e00640 1 --2- 172.21.15.7:0/3572977881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfcc156500 0x7fdfcc0cd570 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400e870 tx=0x7fdfb400ed30 comp rx=0 tx=0).stop 2024-09-13T15:15:44.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.873+0000 7fdfd0e00640 1 -- 172.21.15.7:0/3572977881 shutdown_connections 2024-09-13T15:15:44.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.873+0000 7fdfd0e00640 1 --2- 172.21.15.7:0/3572977881 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fdfa8066690 0x7fdfa8068b50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:44.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.873+0000 7fdfd0e00640 1 --2- 172.21.15.7:0/3572977881 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfcc15c580 0x7fdfcc0cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:44.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.873+0000 7fdfd0e00640 1 --2- 172.21.15.7:0/3572977881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfcc156500 0x7fdfcc0cd570 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:44.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.873+0000 7fdfd0e00640 1 --2- 172.21.15.7:0/3572977881 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fdfcc0b2410 0x7fdfcc14def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:44.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.873+0000 7fdfd0e00640 1 -- 172.21.15.7:0/3572977881 >> 172.21.15.7:0/3572977881 conn(0x7fdfcc0739a0 msgr2=0x7fdfcc153290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:44.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.873+0000 7fdfd0e00640 1 -- 172.21.15.7:0/3572977881 shutdown_connections 2024-09-13T15:15:44.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:44.873+0000 7fdfd0e00640 1 -- 172.21.15.7:0/3572977881 wait complete. 2024-09-13T15:15:44.898 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:15:46.899 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:47.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.037+0000 7fe805600640 1 Processor -- start 2024-09-13T15:15:47.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.037+0000 7fe805600640 1 -- start start 2024-09-13T15:15:47.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.041+0000 7fe805600640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe8001530c0 0x7fe80006b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:47.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.041+0000 7fe805600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe80015cee0 0x7fe8000c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:47.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.041+0000 7fe805600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8000cad80 con 0x7fe8001534a0 2024-09-13T15:15:47.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.041+0000 7fe805600640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80006bff0 con 0x7fe8001530c0 2024-09-13T15:15:47.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.041+0000 7fe805600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8000ca170 con 0x7fe80015cee0 2024-09-13T15:15:47.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.041+0000 7fe7fea00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe8001530c0 0x7fe80006b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:47.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.041+0000 7fe7fea00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe8001530c0 0x7fe80006b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32890/0 (socket says 172.21.15.7:32890) 2024-09-13T15:15:47.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.041+0000 7fe7fea00640 1 -- 172.21.15.7:0/2331991851 learned_addr learned my addr 172.21.15.7:0/2331991851 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:47.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.041+0000 7fe7ff400640 1 --2- 172.21.15.7:0/2331991851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe80015cee0 0x7fe8000c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:47.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.041+0000 7fe7fea00640 1 -- 172.21.15.7:0/2331991851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe80015cee0 msgr2=0x7fe8000c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:47.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.041+0000 7fe7fea00640 1 --2- 172.21.15.7:0/2331991851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe80015cee0 0x7fe8000c3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:47.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.041+0000 7fe7fea00640 1 -- 172.21.15.7:0/2331991851 >> v1:172.21.15.77:6789/0 conn(0x7fe8001534a0 legacy=0x7fe8000cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:47.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.041+0000 7fe7fea00640 1 -- 172.21.15.7:0/2331991851 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8000ca450 con 0x7fe8001530c0 2024-09-13T15:15:47.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.045+0000 7fe7fea00640 1 --2- 172.21.15.7:0/2331991851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8001530c0 0x7fe80006b960 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0009870 tx=0x7fe7f001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7622f03e070aabc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:47.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.045+0000 7fe7fe000640 1 -- 172.21.15.7:0/2331991851 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f00a8a50 con 0x7fe8001530c0 2024-09-13T15:15:47.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.045+0000 7fe7fe000640 1 -- 172.21.15.7:0/2331991851 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f00a8bb0 con 0x7fe8001530c0 2024-09-13T15:15:47.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.045+0000 7fe7fe000640 1 -- 172.21.15.7:0/2331991851 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f00b0440 con 0x7fe8001530c0 2024-09-13T15:15:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.045+0000 7fe805600640 1 -- 172.21.15.7:0/2331991851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8001530c0 msgr2=0x7fe80006b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.045+0000 7fe805600640 1 --2- 172.21.15.7:0/2331991851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8001530c0 0x7fe80006b960 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0009870 tx=0x7fe7f001ed50 comp rx=0 tx=0).stop 2024-09-13T15:15:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.045+0000 7fe805600640 1 -- 172.21.15.7:0/2331991851 shutdown_connections 2024-09-13T15:15:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.045+0000 7fe805600640 1 --2- 172.21.15.7:0/2331991851 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe80015cee0 0x7fe8000c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.045+0000 7fe805600640 1 --2- 172.21.15.7:0/2331991851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8001530c0 0x7fe80006b960 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.045+0000 7fe805600640 1 -- 172.21.15.7:0/2331991851 >> 172.21.15.7:0/2331991851 conn(0x7fe800066140 msgr2=0x7fe800066550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.045+0000 7fe805600640 1 -- 172.21.15.7:0/2331991851 shutdown_connections 2024-09-13T15:15:47.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.045+0000 7fe805600640 1 -- 172.21.15.7:0/2331991851 wait complete. 2024-09-13T15:15:47.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.045+0000 7fe805600640 1 Processor -- start 2024-09-13T15:15:47.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.045+0000 7fe805600640 1 -- start start 2024-09-13T15:15:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe805600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8001530c0 0x7fe80014c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe805600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe80015cee0 0x7fe800153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe805600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8000c8ed0 0x7fe8000cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe805600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8001e5650 con 0x7fe8000c8ed0 2024-09-13T15:15:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe805600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80014cda0 con 0x7fe80015cee0 2024-09-13T15:15:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe805600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8001f2020 con 0x7fe8001530c0 2024-09-13T15:15:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe7ff400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8000c8ed0 0x7fe8000cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe7ff400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8000c8ed0 0x7fe8000cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32906/0 (socket says 172.21.15.7:32906) 2024-09-13T15:15:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe7ff400640 1 -- 172.21.15.7:0/2904627137 learned_addr learned my addr 172.21.15.7:0/2904627137 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe7fea00640 1 --2- 172.21.15.7:0/2904627137 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8001530c0 0x7fe80014c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:47.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe7f7e00640 1 --2- 172.21.15.7:0/2904627137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe80015cee0 0x7fe800153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe7ff400640 1 -- 172.21.15.7:0/2904627137 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8001530c0 msgr2=0x7fe80014c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe7ff400640 1 --2- 172.21.15.7:0/2904627137 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8001530c0 0x7fe80014c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe7ff400640 1 -- 172.21.15.7:0/2904627137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe80015cee0 msgr2=0x7fe800153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe7ff400640 1 --2- 172.21.15.7:0/2904627137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe80015cee0 0x7fe800153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe7ff400640 1 -- 172.21.15.7:0/2904627137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f00094d0 con 0x7fe8000c8ed0 2024-09-13T15:15:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe7ff400640 1 --2- 172.21.15.7:0/2904627137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8000c8ed0 0x7fe8000cdac0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8007e40 tx=0x7fe7f800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe7f6a00640 1 -- 172.21.15.7:0/2904627137 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8014620 con 0x7fe8000c8ed0 2024-09-13T15:15:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe7f6a00640 1 -- 172.21.15.7:0/2904627137 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f800ee90 con 0x7fe8000c8ed0 2024-09-13T15:15:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe7f6a00640 1 -- 172.21.15.7:0/2904627137 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f80149e0 con 0x7fe8000c8ed0 2024-09-13T15:15:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe805600640 1 -- 172.21.15.7:0/2904627137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8001f22c0 con 0x7fe8000c8ed0 2024-09-13T15:15:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe805600640 1 -- 172.21.15.7:0/2904627137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8001f2880 con 0x7fe8000c8ed0 2024-09-13T15:15:47.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe805600640 1 -- 172.21.15.7:0/2904627137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80006b960 con 0x7fe8000c8ed0 2024-09-13T15:15:47.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.049+0000 7fe7f6a00640 1 -- 172.21.15.7:0/2904627137 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe7f8014b40 con 0x7fe8000c8ed0 2024-09-13T15:15:47.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.053+0000 7fe7f6a00640 1 --2- 172.21.15.7:0/2904627137 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe7dc0666c0 0x7fe7dc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:47.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.053+0000 7fe7f6a00640 1 -- 172.21.15.7:0/2904627137 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7fe7f8084fd0 con 0x7fe8000c8ed0 2024-09-13T15:15:47.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.053+0000 7fe7fea00640 1 --2- 172.21.15.7:0/2904627137 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe7dc0666c0 0x7fe7dc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:47.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.053+0000 7fe7fea00640 1 --2- 172.21.15.7:0/2904627137 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe7dc0666c0 0x7fe7dc068b80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00b2000 tx=0x7fe7f0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:47.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.057+0000 7fe7f6a00640 1 -- 172.21.15.7:0/2904627137 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe7f8051d90 con 0x7fe8000c8ed0 2024-09-13T15:15:47.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.253+0000 7fe805600640 1 -- 172.21.15.7:0/2904627137 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe800151c50 con 0x7fe8000c8ed0 2024-09-13T15:15:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.253+0000 7fe7f6a00640 1 -- 172.21.15.7:0/2904627137 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+5533 (secure 0 0 0) 0x7fe7f80553b0 con 0x7fe8000c8ed0 2024-09-13T15:15:47.257 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:47.257 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:15:47.041847+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":5710,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5710":{"gid":5710,"name":"f","rank":0,"incarnation":53,"state":"up:rejoin","state_seq":24,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:47.257 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 56 2024-09-13T15:15:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.257+0000 7fe805600640 1 -- 172.21.15.7:0/2904627137 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe7dc0666c0 msgr2=0x7fe7dc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.257+0000 7fe805600640 1 --2- 172.21.15.7:0/2904627137 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe7dc0666c0 0x7fe7dc068b80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00b2000 tx=0x7fe7f0009040 comp rx=0 tx=0).stop 2024-09-13T15:15:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.257+0000 7fe805600640 1 -- 172.21.15.7:0/2904627137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8000c8ed0 msgr2=0x7fe8000cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.257+0000 7fe805600640 1 --2- 172.21.15.7:0/2904627137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8000c8ed0 0x7fe8000cdac0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8007e40 tx=0x7fe7f800e4b0 comp rx=0 tx=0).stop 2024-09-13T15:15:47.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.257+0000 7fe805600640 1 -- 172.21.15.7:0/2904627137 shutdown_connections 2024-09-13T15:15:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.257+0000 7fe805600640 1 --2- 172.21.15.7:0/2904627137 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe7dc0666c0 0x7fe7dc068b80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.257+0000 7fe805600640 1 --2- 172.21.15.7:0/2904627137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8000c8ed0 0x7fe8000cdac0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.257+0000 7fe805600640 1 --2- 172.21.15.7:0/2904627137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe80015cee0 0x7fe800153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.257+0000 7fe805600640 1 --2- 172.21.15.7:0/2904627137 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe8001530c0 0x7fe80014c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.257+0000 7fe805600640 1 -- 172.21.15.7:0/2904627137 >> 172.21.15.7:0/2904627137 conn(0x7fe800066140 msgr2=0x7fe80014dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.257+0000 7fe805600640 1 -- 172.21.15.7:0/2904627137 shutdown_connections 2024-09-13T15:15:47.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:47.257+0000 7fe805600640 1 -- 172.21.15.7:0/2904627137 wait complete. 2024-09-13T15:15:47.280 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:15:49.281 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:49.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.417+0000 7f5647200640 1 Processor -- start 2024-09-13T15:15:49.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.417+0000 7f5647200640 1 -- start start 2024-09-13T15:15:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5647200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5648159a90 0x7f5648164920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5647200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564815cbc0 con 0x7f5648156500 2024-09-13T15:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5647200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564815cea0 con 0x7f564815c580 2024-09-13T15:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5647200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56480c92e0 con 0x7f5648159a90 2024-09-13T15:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5648156500 0x7f56480712b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41262/0 (socket says 172.21.15.7:41262) 2024-09-13T15:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645e00640 1 -- 172.21.15.7:0/3308423655 learned_addr learned my addr 172.21.15.7:0/3308423655 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5646800640 1 --2- 172.21.15.7:0/3308423655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5648159a90 0x7f5648164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645400640 1 -- 172.21.15.7:0/3308423655 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077765789 0 0) 0x7f564815cbc0 con 0x7f5648156500 2024-09-13T15:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645400640 1 -- 172.21.15.7:0/3308423655 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f562c003530 con 0x7f5648156500 2024-09-13T15:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645400640 1 -- 172.21.15.7:0/3308423655 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650878094 0 0) 0x7f564815cea0 con 0x7f564815c580 2024-09-13T15:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645400640 1 -- 172.21.15.7:0/3308423655 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f564815cbc0 con 0x7f564815c580 2024-09-13T15:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645400640 1 -- 172.21.15.7:0/3308423655 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3853077628 0 0) 0x7f562c003530 con 0x7f5648156500 2024-09-13T15:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645400640 1 -- 172.21.15.7:0/3308423655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5648159a90 msgr2=0x7f5648164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645400640 1 --2- 172.21.15.7:0/3308423655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5648159a90 0x7f5648164920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645400640 1 -- 172.21.15.7:0/3308423655 >> v1:172.21.15.77:6789/0 conn(0x7f564815c580 legacy=0x7f56480b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645400640 1 -- 172.21.15.7:0/3308423655 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564815d180 con 0x7f5648156500 2024-09-13T15:15:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645400640 1 -- 172.21.15.7:0/3308423655 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f5638001a00 con 0x7f5648156500 2024-09-13T15:15:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645400640 1 -- 172.21.15.7:0/3308423655 >> v1:172.21.15.7:6789/0 conn(0x7f5648156500 legacy=0x7f56480712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645400640 1 --2- 172.21.15.7:0/3308423655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5648159a90 0x7f562c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645400640 1 --2- 172.21.15.7:0/3308423655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f562c0040a0 0x7f562c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645400640 1 --2- 172.21.15.7:0/3308423655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f562c004d10 0x7f562c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645400640 1 -- 172.21.15.7:0/3308423655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c00bb20 con 0x7f562c004d10 2024-09-13T15:15:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645400640 1 -- 172.21.15.7:0/3308423655 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c00bc60 con 0x7f562c0040a0 2024-09-13T15:15:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645400640 1 -- 172.21.15.7:0/3308423655 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562c00bdf0 con 0x7f5648159a90 2024-09-13T15:15:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5645e00640 1 --2- 172.21.15.7:0/3308423655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5648159a90 0x7f562c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5646800640 1 --2- 172.21.15.7:0/3308423655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f562c004d10 0x7f562c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f563d400640 1 --2- 172.21.15.7:0/3308423655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f562c0040a0 0x7f562c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5646800640 1 -- 172.21.15.7:0/3308423655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5648159a90 msgr2=0x7f562c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5646800640 1 --2- 172.21.15.7:0/3308423655 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5648159a90 0x7f562c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:49.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5646800640 1 -- 172.21.15.7:0/3308423655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f562c0040a0 msgr2=0x7f562c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:15:49.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5646800640 1 --2- 172.21.15.7:0/3308423655 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f562c0040a0 0x7f562c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:49.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.421+0000 7f5646800640 1 -- 172.21.15.7:0/3308423655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562c003530 con 0x7f562c004d10 2024-09-13T15:15:49.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.425+0000 7f5646800640 1 --2- 172.21.15.7:0/3308423655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f562c004d10 0x7f562c005190 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5640009ae0 tx=0x7f564001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fe428b378e601a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:49.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.425+0000 7f5645400640 1 -- 172.21.15.7:0/3308423655 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56400a6490 con 0x7f562c004d10 2024-09-13T15:15:49.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.425+0000 7f5645400640 1 -- 172.21.15.7:0/3308423655 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56400a65f0 con 0x7f562c004d10 2024-09-13T15:15:49.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.425+0000 7f5645400640 1 -- 172.21.15.7:0/3308423655 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56400a69a0 con 0x7f562c004d10 2024-09-13T15:15:49.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5647200640 1 -- 172.21.15.7:0/3308423655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f562c004d10 msgr2=0x7f562c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:49.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5647200640 1 --2- 172.21.15.7:0/3308423655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f562c004d10 0x7f562c005190 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5640009ae0 tx=0x7f564001c890 comp rx=0 tx=0).stop 2024-09-13T15:15:49.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5646800640 1 -- 172.21.15.7:0/3308423655 reap_dead start 2024-09-13T15:15:49.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5647200640 1 -- 172.21.15.7:0/3308423655 shutdown_connections 2024-09-13T15:15:49.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5647200640 1 -- 172.21.15.7:0/3308423655 >> 172.21.15.7:0/3308423655 conn(0x7f56480739a0 msgr2=0x7f564806b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:49.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5647200640 1 -- 172.21.15.7:0/3308423655 shutdown_connections 2024-09-13T15:15:49.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5647200640 1 -- 172.21.15.7:0/3308423655 wait complete. 2024-09-13T15:15:49.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5647200640 1 Processor -- start 2024-09-13T15:15:49.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5647200640 1 -- start start 2024-09-13T15:15:49.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5647200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f562c004d10 0x7f5648152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:49.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5647200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56480cf510 0x7f56481f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:49.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5647200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56481f2a10 0x7f564814bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:49.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5647200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5648157b20 con 0x7f562c004d10 2024-09-13T15:15:49.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5647200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56481ee8a0 con 0x7f56480cf510 2024-09-13T15:15:49.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5647200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5648157d50 con 0x7f56481f2a10 2024-09-13T15:15:49.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5645e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f562c004d10 0x7f5648152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:49.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5645e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f562c004d10 0x7f5648152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52812/0 (socket says 172.21.15.7:52812) 2024-09-13T15:15:49.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5645e00640 1 -- 172.21.15.7:0/3756167675 learned_addr learned my addr 172.21.15.7:0/3756167675 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:49.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f563d400640 1 --2- 172.21.15.7:0/3756167675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56480cf510 0x7f56481f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:49.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5646800640 1 --2- 172.21.15.7:0/3756167675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56481f2a10 0x7f564814bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5645e00640 1 -- 172.21.15.7:0/3756167675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56481f2a10 msgr2=0x7f564814bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5645e00640 1 --2- 172.21.15.7:0/3756167675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56481f2a10 0x7f564814bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5645e00640 1 -- 172.21.15.7:0/3756167675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56480cf510 msgr2=0x7f56481f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5645e00640 1 --2- 172.21.15.7:0/3756167675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56480cf510 0x7f56481f24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5645e00640 1 -- 172.21.15.7:0/3756167675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5648158030 con 0x7f562c004d10 2024-09-13T15:15:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f563d400640 1 --2- 172.21.15.7:0/3756167675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56480cf510 0x7f56481f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:15:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.429+0000 7f5645e00640 1 --2- 172.21.15.7:0/3756167675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f562c004d10 0x7f5648152b60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5638007720 tx=0x7f5638007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:49.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.433+0000 7f563ea00640 1 -- 172.21.15.7:0/3756167675 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800ac10 con 0x7f562c004d10 2024-09-13T15:15:49.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.433+0000 7f563ea00640 1 -- 172.21.15.7:0/3756167675 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563800ad90 con 0x7f562c004d10 2024-09-13T15:15:49.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.433+0000 7f563ea00640 1 -- 172.21.15.7:0/3756167675 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638013630 con 0x7f562c004d10 2024-09-13T15:15:49.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.433+0000 7f5647200640 1 -- 172.21.15.7:0/3756167675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5648158310 con 0x7f562c004d10 2024-09-13T15:15:49.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.433+0000 7f5647200640 1 -- 172.21.15.7:0/3756167675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56481f1fb0 con 0x7f562c004d10 2024-09-13T15:15:49.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.433+0000 7f5647200640 1 -- 172.21.15.7:0/3756167675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56481f1e10 con 0x7f562c004d10 2024-09-13T15:15:49.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.433+0000 7f563ea00640 1 -- 172.21.15.7:0/3756167675 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5638013790 con 0x7f562c004d10 2024-09-13T15:15:49.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.433+0000 7f563ea00640 1 --2- 172.21.15.7:0/3756167675 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5624066690 0x7f5624068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:49.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.433+0000 7f563ea00640 1 -- 172.21.15.7:0/3756167675 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f5638085300 con 0x7f562c004d10 2024-09-13T15:15:49.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.433+0000 7f563d400640 1 --2- 172.21.15.7:0/3756167675 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5624066690 0x7f5624068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:49.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.437+0000 7f563d400640 1 --2- 172.21.15.7:0/3756167675 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5624066690 0x7f5624068b50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5630000fc0 tx=0x7f5630000f30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:49.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.437+0000 7f563ea00640 1 -- 172.21.15.7:0/3756167675 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f56481f1e10 con 0x7f562c004d10 2024-09-13T15:15:49.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.645+0000 7f5647200640 1 -- 172.21.15.7:0/3756167675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56481f1e10 con 0x7f562c004d10 2024-09-13T15:15:49.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.645+0000 7f563ea00640 1 -- 172.21.15.7:0/3756167675 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+5533 (secure 0 0 0) 0x7f56481f1e10 con 0x7f562c004d10 2024-09-13T15:15:49.648 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:49.648 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:15:47.041847+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":5710,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5710":{"gid":5710,"name":"f","rank":0,"incarnation":53,"state":"up:rejoin","state_seq":24,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:49.648 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 56 2024-09-13T15:15:49.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.645+0000 7f5647200640 1 -- 172.21.15.7:0/3756167675 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5624066690 msgr2=0x7f5624068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:49.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.645+0000 7f5647200640 1 --2- 172.21.15.7:0/3756167675 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5624066690 0x7f5624068b50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5630000fc0 tx=0x7f5630000f30 comp rx=0 tx=0).stop 2024-09-13T15:15:49.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.645+0000 7f5647200640 1 -- 172.21.15.7:0/3756167675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f562c004d10 msgr2=0x7f5648152b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:49.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.645+0000 7f5647200640 1 --2- 172.21.15.7:0/3756167675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f562c004d10 0x7f5648152b60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5638007720 tx=0x7f5638007be0 comp rx=0 tx=0).stop 2024-09-13T15:15:49.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.645+0000 7f5647200640 1 -- 172.21.15.7:0/3756167675 shutdown_connections 2024-09-13T15:15:49.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.645+0000 7f5647200640 1 --2- 172.21.15.7:0/3756167675 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5624066690 0x7f5624068b50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:49.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.645+0000 7f5647200640 1 --2- 172.21.15.7:0/3756167675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f56481f2a10 0x7f564814bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:49.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.645+0000 7f5647200640 1 --2- 172.21.15.7:0/3756167675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56480cf510 0x7f56481f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:49.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.645+0000 7f5647200640 1 --2- 172.21.15.7:0/3756167675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f562c004d10 0x7f5648152b60 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:49.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.645+0000 7f5647200640 1 -- 172.21.15.7:0/3756167675 >> 172.21.15.7:0/3756167675 conn(0x7f56480739a0 msgr2=0x7f5648151a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:49.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.645+0000 7f5647200640 1 -- 172.21.15.7:0/3756167675 shutdown_connections 2024-09-13T15:15:49.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:49.645+0000 7f5647200640 1 -- 172.21.15.7:0/3756167675 wait complete. 2024-09-13T15:15:49.670 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:15:51.671 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:51.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.809+0000 7f5b79c00640 1 Processor -- start 2024-09-13T15:15:51.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.809+0000 7f5b79c00640 1 -- start start 2024-09-13T15:15:51.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.813+0000 7f5b79c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5b74071970 0x7f5b7406d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:51.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.813+0000 7f5b79c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b740c4150 con 0x7f5b740c28a0 2024-09-13T15:15:51.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.813+0000 7f5b79c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b740c4380 con 0x7f5b74071d50 2024-09-13T15:15:51.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.813+0000 7f5b79c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b740c4f00 con 0x7f5b74071970 2024-09-13T15:15:51.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.813+0000 7f5b73e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5b74071970 0x7f5b7406d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:51.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.813+0000 7f5b73e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5b74071970 0x7f5b7406d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52824/0 (socket says 172.21.15.7:52824) 2024-09-13T15:15:51.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.813+0000 7f5b73e00640 1 -- 172.21.15.7:0/3948936738 learned_addr learned my addr 172.21.15.7:0/3948936738 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:51.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.813+0000 7f5b79200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5b740c28a0 0x7f5b741509a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41270/0 (socket says 172.21.15.7:41270) 2024-09-13T15:15:51.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.813+0000 7f5b73e00640 1 -- 172.21.15.7:0/3948936738 >> v1:172.21.15.77:6789/0 conn(0x7f5b74071d50 legacy=0x7f5b7415a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:51.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.813+0000 7f5b73e00640 1 -- 172.21.15.7:0/3948936738 >> v1:172.21.15.7:6789/0 conn(0x7f5b740c28a0 legacy=0x7f5b741509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:51.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.813+0000 7f5b73e00640 1 -- 172.21.15.7:0/3948936738 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b740c4660 con 0x7f5b74071970 2024-09-13T15:15:51.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.813+0000 7f5b73e00640 1 --2- 172.21.15.7:0/3948936738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b74071970 0x7f5b7406d4a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5b64009870 tx=0x7f5b6401ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c48da1f34b30dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:51.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b73400640 1 -- 172.21.15.7:0/3948936738 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b640a8a50 con 0x7f5b74071970 2024-09-13T15:15:51.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b73400640 1 -- 172.21.15.7:0/3948936738 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b640a8bb0 con 0x7f5b74071970 2024-09-13T15:15:51.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b73400640 1 -- 172.21.15.7:0/3948936738 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b640b0440 con 0x7f5b74071970 2024-09-13T15:15:51.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b79c00640 1 -- 172.21.15.7:0/3948936738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b74071970 msgr2=0x7f5b7406d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:51.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b79c00640 1 --2- 172.21.15.7:0/3948936738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b74071970 0x7f5b7406d4a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5b64009870 tx=0x7f5b6401ed50 comp rx=0 tx=0).stop 2024-09-13T15:15:51.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b79c00640 1 -- 172.21.15.7:0/3948936738 shutdown_connections 2024-09-13T15:15:51.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b79c00640 1 --2- 172.21.15.7:0/3948936738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b74071970 0x7f5b7406d4a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:51.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b79c00640 1 -- 172.21.15.7:0/3948936738 >> 172.21.15.7:0/3948936738 conn(0x7f5b74065d40 msgr2=0x7f5b74066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:51.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b79c00640 1 -- 172.21.15.7:0/3948936738 shutdown_connections 2024-09-13T15:15:51.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b79c00640 1 -- 172.21.15.7:0/3948936738 wait complete. 2024-09-13T15:15:51.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b79c00640 1 Processor -- start 2024-09-13T15:15:51.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b79c00640 1 -- start start 2024-09-13T15:15:51.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b79c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b74071970 0x7f5b740cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:51.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b79c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b74071d50 0x7f5b7406fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:51.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b79c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b740c28a0 0x7f5b740ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:51.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b79c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b740cb790 con 0x7f5b740c28a0 2024-09-13T15:15:51.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b79c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b740c9990 con 0x7f5b74071970 2024-09-13T15:15:51.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b79c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b74070400 con 0x7f5b74071d50 2024-09-13T15:15:51.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.817+0000 7f5b79200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b740c28a0 0x7f5b740ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:51.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b79200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b740c28a0 0x7f5b740ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52838/0 (socket says 172.21.15.7:52838) 2024-09-13T15:15:51.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b79200640 1 -- 172.21.15.7:0/3310949254 learned_addr learned my addr 172.21.15.7:0/3310949254 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:51.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b73e00640 1 --2- 172.21.15.7:0/3310949254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b74071970 0x7f5b740cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:51.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b6be00640 1 --2- 172.21.15.7:0/3310949254 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b74071d50 0x7f5b7406fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:51.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b79200640 1 -- 172.21.15.7:0/3310949254 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b74071d50 msgr2=0x7f5b7406fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:51.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b79200640 1 --2- 172.21.15.7:0/3310949254 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b74071d50 0x7f5b7406fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:51.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b79200640 1 -- 172.21.15.7:0/3310949254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b74071970 msgr2=0x7f5b740cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:51.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b79200640 1 --2- 172.21.15.7:0/3310949254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b74071970 0x7f5b740cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:51.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b79200640 1 -- 172.21.15.7:0/3310949254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b640094d0 con 0x7f5b740c28a0 2024-09-13T15:15:51.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b6be00640 1 --2- 172.21.15.7:0/3310949254 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b74071d50 0x7f5b7406fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:15:51.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b79200640 1 --2- 172.21.15.7:0/3310949254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b740c28a0 0x7f5b740ca260 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00c7a0 tx=0x7f5b6c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:51.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b70c00640 1 -- 172.21.15.7:0/3310949254 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c00a640 con 0x7f5b740c28a0 2024-09-13T15:15:51.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b70c00640 1 -- 172.21.15.7:0/3310949254 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c00a7a0 con 0x7f5b740c28a0 2024-09-13T15:15:51.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b70c00640 1 -- 172.21.15.7:0/3310949254 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c00ab10 con 0x7f5b740c28a0 2024-09-13T15:15:51.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b79c00640 1 -- 172.21.15.7:0/3310949254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b740c8790 con 0x7f5b740c28a0 2024-09-13T15:15:51.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b79c00640 1 -- 172.21.15.7:0/3310949254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b74156740 con 0x7f5b740c28a0 2024-09-13T15:15:51.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b79c00640 1 -- 172.21.15.7:0/3310949254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7415a700 con 0x7f5b740c28a0 2024-09-13T15:15:51.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b70c00640 1 -- 172.21.15.7:0/3310949254 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5b6c00ac70 con 0x7f5b740c28a0 2024-09-13T15:15:51.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b70c00640 1 --2- 172.21.15.7:0/3310949254 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5b50066690 0x7f5b50068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:51.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.821+0000 7f5b70c00640 1 -- 172.21.15.7:0/3310949254 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f5b6c083f30 con 0x7f5b740c28a0 2024-09-13T15:15:51.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.825+0000 7f5b73e00640 1 --2- 172.21.15.7:0/3310949254 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5b50066690 0x7f5b50068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:51.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.825+0000 7f5b73e00640 1 --2- 172.21.15.7:0/3310949254 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5b50066690 0x7f5b50068b50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5b640b2000 tx=0x7f5b64009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:51.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:51.825+0000 7f5b70c00640 1 -- 172.21.15.7:0/3310949254 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5b6c050cf0 con 0x7f5b740c28a0 2024-09-13T15:15:52.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:52.021+0000 7f5b79c00640 1 -- 172.21.15.7:0/3310949254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b7406d5b0 con 0x7f5b740c28a0 2024-09-13T15:15:52.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:52.021+0000 7f5b70c00640 1 -- 172.21.15.7:0/3310949254 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+5533 (secure 0 0 0) 0x7f5b6c017020 con 0x7f5b740c28a0 2024-09-13T15:15:52.026 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:52.026 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:15:47.041847+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":5710,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5710":{"gid":5710,"name":"f","rank":0,"incarnation":53,"state":"up:rejoin","state_seq":24,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:52.027 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 56 2024-09-13T15:15:52.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:52.025+0000 7f5b79c00640 1 -- 172.21.15.7:0/3310949254 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5b50066690 msgr2=0x7f5b50068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:52.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:52.025+0000 7f5b79c00640 1 --2- 172.21.15.7:0/3310949254 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5b50066690 0x7f5b50068b50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5b640b2000 tx=0x7f5b64009040 comp rx=0 tx=0).stop 2024-09-13T15:15:52.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:52.025+0000 7f5b79c00640 1 -- 172.21.15.7:0/3310949254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b740c28a0 msgr2=0x7f5b740ca260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:52.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:52.025+0000 7f5b79c00640 1 --2- 172.21.15.7:0/3310949254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b740c28a0 0x7f5b740ca260 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00c7a0 tx=0x7f5b6c00cc60 comp rx=0 tx=0).stop 2024-09-13T15:15:52.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:52.025+0000 7f5b79c00640 1 -- 172.21.15.7:0/3310949254 shutdown_connections 2024-09-13T15:15:52.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:52.025+0000 7f5b79c00640 1 --2- 172.21.15.7:0/3310949254 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5b50066690 0x7f5b50068b50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:52.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:52.025+0000 7f5b79c00640 1 --2- 172.21.15.7:0/3310949254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b740c28a0 0x7f5b740ca260 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:52.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:52.025+0000 7f5b79c00640 1 --2- 172.21.15.7:0/3310949254 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5b74071d50 0x7f5b7406fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:52.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:52.025+0000 7f5b79c00640 1 --2- 172.21.15.7:0/3310949254 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b74071970 0x7f5b740cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:52.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:52.025+0000 7f5b79c00640 1 -- 172.21.15.7:0/3310949254 >> 172.21.15.7:0/3310949254 conn(0x7f5b74065d40 msgr2=0x7f5b74157690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:52.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:52.025+0000 7f5b79c00640 1 -- 172.21.15.7:0/3310949254 shutdown_connections 2024-09-13T15:15:52.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:52.025+0000 7f5b79c00640 1 -- 172.21.15.7:0/3310949254 wait complete. 2024-09-13T15:15:52.048 INFO:tasks.mds_thrash.fs.[cephfs]:no change 2024-09-13T15:15:54.050 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:15:54.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.197+0000 7f7b71e00640 1 Processor -- start 2024-09-13T15:15:54.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.197+0000 7f7b71e00640 1 -- start start 2024-09-13T15:15:54.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.197+0000 7f7b71e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b6c0c6ea0 0x7f7b6c160f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:54.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.197+0000 7f7b71e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6c155ae0 con 0x7f7b6c0b0da0 2024-09-13T15:15:54.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.197+0000 7f7b71e00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6c0c11d0 con 0x7f7b6c06f600 2024-09-13T15:15:54.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.197+0000 7f7b71e00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b6c156680 con 0x7f7b6c0c6ea0 2024-09-13T15:15:54.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.197+0000 7f7b6aa00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f7b6c0b0da0 0x7f7b6c155f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:41278/0 (socket says 172.21.15.7:41278) 2024-09-13T15:15:54.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.197+0000 7f7b6aa00640 1 -- 172.21.15.7:0/3118822461 learned_addr learned my addr 172.21.15.7:0/3118822461 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:15:54.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.197+0000 7f7b6b400640 1 --2- 172.21.15.7:0/3118822461 >> v2:172.21.15.77:3300/0 conn(0x7f7b6c0c6ea0 0x7f7b6c160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:54.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.197+0000 7f7b6a000640 1 -- 172.21.15.7:0/3118822461 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879156514 0 0) 0x7f7b6c155ae0 con 0x7f7b6c0b0da0 2024-09-13T15:15:54.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.197+0000 7f7b6a000640 1 -- 172.21.15.7:0/3118822461 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b50003450 con 0x7f7b6c0b0da0 2024-09-13T15:15:54.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.201+0000 7f7b6b400640 1 -- 172.21.15.7:0/3118822461 >> v1:172.21.15.77:6789/0 conn(0x7f7b6c06f600 legacy=0x7f7b6c06cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:54.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.201+0000 7f7b6b400640 1 -- 172.21.15.7:0/3118822461 >> v1:172.21.15.7:6789/0 conn(0x7f7b6c0b0da0 legacy=0x7f7b6c155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:54.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.201+0000 7f7b6b400640 1 -- 172.21.15.7:0/3118822461 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c0c1470 con 0x7f7b6c0c6ea0 2024-09-13T15:15:54.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.201+0000 7f7b6b400640 1 --2- 172.21.15.7:0/3118822461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c0c6ea0 0x7f7b6c160f50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7b640097c0 tx=0x7f7b6401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a121343a917752e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:54.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.201+0000 7f7b6a000640 1 -- 172.21.15.7:0/3118822461 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b640ab600 con 0x7f7b6c0c6ea0 2024-09-13T15:15:54.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.201+0000 7f7b6a000640 1 -- 172.21.15.7:0/3118822461 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b640a7050 con 0x7f7b6c0c6ea0 2024-09-13T15:15:54.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.201+0000 7f7b6a000640 1 -- 172.21.15.7:0/3118822461 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b640ab960 con 0x7f7b6c0c6ea0 2024-09-13T15:15:54.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b71e00640 1 -- 172.21.15.7:0/3118822461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c0c6ea0 msgr2=0x7f7b6c160f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:54.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b71e00640 1 --2- 172.21.15.7:0/3118822461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c0c6ea0 0x7f7b6c160f50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7b640097c0 tx=0x7f7b6401c4a0 comp rx=0 tx=0).stop 2024-09-13T15:15:54.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b71e00640 1 -- 172.21.15.7:0/3118822461 shutdown_connections 2024-09-13T15:15:54.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b71e00640 1 --2- 172.21.15.7:0/3118822461 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c0c6ea0 0x7f7b6c160f50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:54.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b71e00640 1 -- 172.21.15.7:0/3118822461 >> 172.21.15.7:0/3118822461 conn(0x7f7b6c065d40 msgr2=0x7f7b6c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:54.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b71e00640 1 -- 172.21.15.7:0/3118822461 shutdown_connections 2024-09-13T15:15:54.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b71e00640 1 -- 172.21.15.7:0/3118822461 wait complete. 2024-09-13T15:15:54.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b71e00640 1 Processor -- start 2024-09-13T15:15:54.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b71e00640 1 -- start start 2024-09-13T15:15:54.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b71e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b6c06f600 0x7f7b6c153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:54.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b71e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b6c0b0da0 0x7f7b6c1edc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:54.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b71e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c0c6ea0 0x7f7b6c1ee1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:54.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b71e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c1ed840 con 0x7f7b6c0b0da0 2024-09-13T15:15:54.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b71e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c0c4370 con 0x7f7b6c0c6ea0 2024-09-13T15:15:54.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b71e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c14cb70 con 0x7f7b6c06f600 2024-09-13T15:15:54.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b62000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b6c0b0da0 0x7f7b6c1edc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:54.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b62000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b6c0b0da0 0x7f7b6c1edc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52844/0 (socket says 172.21.15.7:52844) 2024-09-13T15:15:54.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b62000640 1 -- 172.21.15.7:0/528700788 learned_addr learned my addr 172.21.15.7:0/528700788 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:15:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b6aa00640 1 --2- 172.21.15.7:0/528700788 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b6c06f600 0x7f7b6c153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b6b400640 1 --2- 172.21.15.7:0/528700788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c0c6ea0 0x7f7b6c1ee1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b62000640 1 -- 172.21.15.7:0/528700788 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b6c06f600 msgr2=0x7f7b6c153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b62000640 1 --2- 172.21.15.7:0/528700788 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b6c06f600 0x7f7b6c153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b62000640 1 -- 172.21.15.7:0/528700788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c0c6ea0 msgr2=0x7f7b6c1ee1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b62000640 1 --2- 172.21.15.7:0/528700788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c0c6ea0 0x7f7b6c1ee1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b62000640 1 -- 172.21.15.7:0/528700788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b64009420 con 0x7f7b6c0b0da0 2024-09-13T15:15:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b62000640 1 --2- 172.21.15.7:0/528700788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b6c0b0da0 0x7f7b6c1edc60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400c3c0 tx=0x7f7b5400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.205+0000 7f7b63e00640 1 -- 172.21.15.7:0/528700788 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b540052d0 con 0x7f7b6c0b0da0 2024-09-13T15:15:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.209+0000 7f7b63e00640 1 -- 172.21.15.7:0/528700788 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b54005430 con 0x7f7b6c0b0da0 2024-09-13T15:15:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.209+0000 7f7b63e00640 1 -- 172.21.15.7:0/528700788 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54003840 con 0x7f7b6c0b0da0 2024-09-13T15:15:54.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.209+0000 7f7b71e00640 1 -- 172.21.15.7:0/528700788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6c0c0010 con 0x7f7b6c0b0da0 2024-09-13T15:15:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.209+0000 7f7b71e00640 1 -- 172.21.15.7:0/528700788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6c14db60 con 0x7f7b6c0b0da0 2024-09-13T15:15:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.209+0000 7f7b71e00640 1 -- 172.21.15.7:0/528700788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6c067650 con 0x7f7b6c0b0da0 2024-09-13T15:15:54.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.209+0000 7f7b63e00640 1 -- 172.21.15.7:0/528700788 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7b540039a0 con 0x7f7b6c0b0da0 2024-09-13T15:15:54.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.209+0000 7f7b63e00640 1 --2- 172.21.15.7:0/528700788 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7b48066690 0x7f7b48068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:15:54.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.209+0000 7f7b63e00640 1 -- 172.21.15.7:0/528700788 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f7b54083c80 con 0x7f7b6c0b0da0 2024-09-13T15:15:54.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.209+0000 7f7b6aa00640 1 --2- 172.21.15.7:0/528700788 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7b48066690 0x7f7b48068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:15:54.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.213+0000 7f7b6aa00640 1 --2- 172.21.15.7:0/528700788 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7b48066690 0x7f7b48068b50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c001570 tx=0x7f7b5c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:15:54.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.213+0000 7f7b63e00640 1 -- 172.21.15.7:0/528700788 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7b54050a30 con 0x7f7b6c0b0da0 2024-09-13T15:15:54.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.413+0000 7f7b71e00640 1 -- 172.21.15.7:0/528700788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b6c1ed980 con 0x7f7b6c0b0da0 2024-09-13T15:15:54.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.413+0000 7f7b63e00640 1 -- 172.21.15.7:0/528700788 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+5533 (secure 0 0 0) 0x7f7b6c1ed980 con 0x7f7b6c0b0da0 2024-09-13T15:15:54.418 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:15:54.418 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:15:52.066397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":5710,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5710":{"gid":5710,"name":"f","rank":0,"incarnation":53,"state":"up:active","state_seq":26,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:15:54.418 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 57 2024-09-13T15:15:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.417+0000 7f7b71e00640 1 -- 172.21.15.7:0/528700788 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7b48066690 msgr2=0x7f7b48068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.417+0000 7f7b71e00640 1 --2- 172.21.15.7:0/528700788 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7b48066690 0x7f7b48068b50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c001570 tx=0x7f7b5c009040 comp rx=0 tx=0).stop 2024-09-13T15:15:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.417+0000 7f7b71e00640 1 -- 172.21.15.7:0/528700788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b6c0b0da0 msgr2=0x7f7b6c1edc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:15:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.417+0000 7f7b71e00640 1 --2- 172.21.15.7:0/528700788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b6c0b0da0 0x7f7b6c1edc60 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400c3c0 tx=0x7f7b5400c880 comp rx=0 tx=0).stop 2024-09-13T15:15:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.417+0000 7f7b71e00640 1 -- 172.21.15.7:0/528700788 shutdown_connections 2024-09-13T15:15:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.417+0000 7f7b71e00640 1 --2- 172.21.15.7:0/528700788 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f7b48066690 0x7f7b48068b50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.417+0000 7f7b71e00640 1 --2- 172.21.15.7:0/528700788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b6c0c6ea0 0x7f7b6c1ee1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.417+0000 7f7b71e00640 1 --2- 172.21.15.7:0/528700788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b6c0b0da0 0x7f7b6c1edc60 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.417+0000 7f7b71e00640 1 --2- 172.21.15.7:0/528700788 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f7b6c06f600 0x7f7b6c153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:15:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.417+0000 7f7b71e00640 1 -- 172.21.15.7:0/528700788 >> 172.21.15.7:0/528700788 conn(0x7f7b6c065d40 msgr2=0x7f7b6c153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:15:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.417+0000 7f7b71e00640 1 -- 172.21.15.7:0/528700788 shutdown_connections 2024-09-13T15:15:54.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:15:54.417+0000 7f7b71e00640 1 -- 172.21.15.7:0/528700788 wait complete. 2024-09-13T15:15:54.440 INFO:tasks.mds_thrash.fs.[cephfs]:mds.f has gained rank=0, replacing gid=4276 2024-09-13T15:15:54.440 INFO:tasks.mds_thrash.fs.[cephfs]:waiting for 9 secs before reviving mds.c 2024-09-13T15:15:57.121 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T15:15:57.121 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2024-09-13T15:15:57.131 INFO:tasks.mds_thrash:joining mds_thrasher 2024-09-13T15:16:02.040 INFO:tasks.ceph.mds.f.smithi077.stderr:2024-09-13T15:16:02.037+0000 7fb973ae2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T15:16:02.040 INFO:tasks.ceph.mds.f.smithi077.stderr:2024-09-13T15:16:02.037+0000 7fb973ae2640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-13T15:16:02.040 INFO:tasks.ceph.mds.f.smithi077.stderr:2024-09-13T15:16:02.037+0000 7fb973ae2640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-13T15:16:02.040 INFO:tasks.ceph.mds.f.smithi077.stderr:2024-09-13T15:16:02.037+0000 7fb973ae2640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-09-13T15:16:03.441 INFO:tasks.mds_thrash.fs.[cephfs]:reviving mds.c 2024-09-13T15:16:03.441 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T15:16:03.442 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T15:16:03.445 INFO:tasks.ceph.mds.c:Started 2024-09-13T15:16:03.445 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:16:03.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.585+0000 7fb45b200640 1 Processor -- start 2024-09-13T15:16:03.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.585+0000 7fb45b200640 1 -- start start 2024-09-13T15:16:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb45b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45c159a90 0x7fb45c164920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb45b200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c15cbc0 con 0x7fb45c156500 2024-09-13T15:16:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb45b200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c15cea0 con 0x7fb45c15c580 2024-09-13T15:16:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb45b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0c92e0 con 0x7fb45c159a90 2024-09-13T15:16:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb459e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fb45c156500 0x7fb45c0712b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58698/0 (socket says 172.21.15.7:58698) 2024-09-13T15:16:03.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb459e00640 1 -- 172.21.15.7:0/1672678296 learned_addr learned my addr 172.21.15.7:0/1672678296 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:16:03.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb45a800640 1 --2- 172.21.15.7:0/1672678296 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45c159a90 0x7fb45c164920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb458a00640 1 -- 172.21.15.7:0/1672678296 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368171194 0 0) 0x7fb45c15cbc0 con 0x7fb45c156500 2024-09-13T15:16:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb458a00640 1 -- 172.21.15.7:0/1672678296 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb440003530 con 0x7fb45c156500 2024-09-13T15:16:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb458a00640 1 -- 172.21.15.7:0/1672678296 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330020037 0 0) 0x7fb45c15cea0 con 0x7fb45c15c580 2024-09-13T15:16:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb458a00640 1 -- 172.21.15.7:0/1672678296 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb45c15cbc0 con 0x7fb45c15c580 2024-09-13T15:16:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb458a00640 1 -- 172.21.15.7:0/1672678296 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3814040236 0 0) 0x7fb440003530 con 0x7fb45c156500 2024-09-13T15:16:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb458a00640 1 -- 172.21.15.7:0/1672678296 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45c159a90 msgr2=0x7fb45c164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb458a00640 1 --2- 172.21.15.7:0/1672678296 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45c159a90 0x7fb45c164920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb458a00640 1 -- 172.21.15.7:0/1672678296 >> v1:172.21.15.77:6789/0 conn(0x7fb45c15c580 legacy=0x7fb45c0b2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:03.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb458a00640 1 -- 172.21.15.7:0/1672678296 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c15d180 con 0x7fb45c156500 2024-09-13T15:16:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb458a00640 1 -- 172.21.15.7:0/1672678296 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7fb44c001680 con 0x7fb45c156500 2024-09-13T15:16:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb458a00640 1 -- 172.21.15.7:0/1672678296 >> v1:172.21.15.7:6789/0 conn(0x7fb45c156500 legacy=0x7fb45c0712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb458a00640 1 --2- 172.21.15.7:0/1672678296 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45c159a90 0x7fb440003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb458a00640 1 --2- 172.21.15.7:0/1672678296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4400040a0 0x7fb4400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb458a00640 1 --2- 172.21.15.7:0/1672678296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb440004d10 0x7fb440005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb458a00640 1 -- 172.21.15.7:0/1672678296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44000bb20 con 0x7fb4400040a0 2024-09-13T15:16:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb458a00640 1 -- 172.21.15.7:0/1672678296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44000bc60 con 0x7fb440004d10 2024-09-13T15:16:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb458a00640 1 -- 172.21.15.7:0/1672678296 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb44000bdf0 con 0x7fb45c159a90 2024-09-13T15:16:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb459400640 1 --2- 172.21.15.7:0/1672678296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4400040a0 0x7fb4400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb45a800640 1 --2- 172.21.15.7:0/1672678296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb440004d10 0x7fb440005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb459e00640 1 --2- 172.21.15.7:0/1672678296 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45c159a90 0x7fb440003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb459400640 1 -- 172.21.15.7:0/1672678296 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45c159a90 msgr2=0x7fb440003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb459400640 1 --2- 172.21.15.7:0/1672678296 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45c159a90 0x7fb440003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:03.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb459400640 1 -- 172.21.15.7:0/1672678296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb440004d10 msgr2=0x7fb440005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb459400640 1 --2- 172.21.15.7:0/1672678296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb440004d10 0x7fb440005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:03.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.589+0000 7fb459400640 1 -- 172.21.15.7:0/1672678296 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb440003530 con 0x7fb4400040a0 2024-09-13T15:16:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.593+0000 7fb459400640 1 --2- 172.21.15.7:0/1672678296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4400040a0 0x7fb4400047d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb448001930 tx=0x7fb44801c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1feb8ae8c22bc4bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.593+0000 7fb458a00640 1 -- 172.21.15.7:0/1672678296 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4480052d0 con 0x7fb4400040a0 2024-09-13T15:16:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.593+0000 7fb458a00640 1 -- 172.21.15.7:0/1672678296 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4480a7050 con 0x7fb4400040a0 2024-09-13T15:16:03.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.593+0000 7fb458a00640 1 -- 172.21.15.7:0/1672678296 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448003650 con 0x7fb4400040a0 2024-09-13T15:16:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.593+0000 7fb45b200640 1 -- 172.21.15.7:0/1672678296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4400040a0 msgr2=0x7fb4400047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.593+0000 7fb45b200640 1 --2- 172.21.15.7:0/1672678296 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4400040a0 0x7fb4400047d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb448001930 tx=0x7fb44801c580 comp rx=0 tx=0).stop 2024-09-13T15:16:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.593+0000 7fb45a800640 1 -- 172.21.15.7:0/1672678296 reap_dead start 2024-09-13T15:16:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.593+0000 7fb45b200640 1 -- 172.21.15.7:0/1672678296 shutdown_connections 2024-09-13T15:16:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.593+0000 7fb45b200640 1 -- 172.21.15.7:0/1672678296 >> 172.21.15.7:0/1672678296 conn(0x7fb45c0739a0 msgr2=0x7fb45c06b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.593+0000 7fb45b200640 1 -- 172.21.15.7:0/1672678296 shutdown_connections 2024-09-13T15:16:03.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.593+0000 7fb45b200640 1 -- 172.21.15.7:0/1672678296 wait complete. 2024-09-13T15:16:03.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45b200640 1 Processor -- start 2024-09-13T15:16:03.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45b200640 1 -- start start 2024-09-13T15:16:03.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45b200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4400040a0 0x7fb45c0cf170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:03.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45c158a80 0x7fb45c0c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:03.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb45c0c7fc0 0x7fb45c0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:03.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0cd530 con 0x7fb45c0c7fc0 2024-09-13T15:16:03.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45b200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0cd9c0 con 0x7fb4400040a0 2024-09-13T15:16:03.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c158f10 con 0x7fb45c158a80 2024-09-13T15:16:03.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb45c0c7fc0 0x7fb45c0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:03.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45a800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb45c0c7fc0 0x7fb45c0cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42784/0 (socket says 172.21.15.7:42784) 2024-09-13T15:16:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45a800640 1 -- 172.21.15.7:0/524173339 learned_addr learned my addr 172.21.15.7:0/524173339 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb459e00640 1 --2- 172.21.15.7:0/524173339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4400040a0 0x7fb45c0cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb459400640 1 --2- 172.21.15.7:0/524173339 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45c158a80 0x7fb45c0c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45a800640 1 -- 172.21.15.7:0/524173339 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45c158a80 msgr2=0x7fb45c0c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45a800640 1 --2- 172.21.15.7:0/524173339 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45c158a80 0x7fb45c0c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45a800640 1 -- 172.21.15.7:0/524173339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4400040a0 msgr2=0x7fb45c0cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45a800640 1 --2- 172.21.15.7:0/524173339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4400040a0 0x7fb45c0cf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45a800640 1 -- 172.21.15.7:0/524173339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c158800 con 0x7fb45c0c7fc0 2024-09-13T15:16:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45a800640 1 --2- 172.21.15.7:0/524173339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb45c0c7fc0 0x7fb45c0cdd50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0c5d90 tx=0x7fb45400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb452000640 1 -- 172.21.15.7:0/524173339 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400e040 con 0x7fb45c0c7fc0 2024-09-13T15:16:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb452000640 1 -- 172.21.15.7:0/524173339 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45400f040 con 0x7fb45c0c7fc0 2024-09-13T15:16:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb452000640 1 -- 172.21.15.7:0/524173339 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb454015430 con 0x7fb45c0c7fc0 2024-09-13T15:16:03.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45b200640 1 -- 172.21.15.7:0/524173339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c0cc920 con 0x7fb45c0c7fc0 2024-09-13T15:16:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.597+0000 7fb45b200640 1 -- 172.21.15.7:0/524173339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c0ccee0 con 0x7fb45c0c7fc0 2024-09-13T15:16:03.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.601+0000 7fb45b200640 1 -- 172.21.15.7:0/524173339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45c1568e0 con 0x7fb45c0c7fc0 2024-09-13T15:16:03.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.601+0000 7fb452000640 1 -- 172.21.15.7:0/524173339 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb454015590 con 0x7fb45c0c7fc0 2024-09-13T15:16:03.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.601+0000 7fb452000640 1 --2- 172.21.15.7:0/524173339 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb43c066690 0x7fb43c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:03.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.601+0000 7fb452000640 1 -- 172.21.15.7:0/524173339 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7fb454084ba0 con 0x7fb45c0c7fc0 2024-09-13T15:16:03.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.605+0000 7fb459e00640 1 --2- 172.21.15.7:0/524173339 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb43c066690 0x7fb43c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:03.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.605+0000 7fb459e00640 1 --2- 172.21.15.7:0/524173339 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb43c066690 0x7fb43c068b50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb44c001210 tx=0x7fb44c001e10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:03.606 INFO:tasks.ceph.mds.c.smithi007.stdout:starting mds.c at 2024-09-13T15:16:03.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.609+0000 7fb452000640 1 -- 172.21.15.7:0/524173339 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb454051a90 con 0x7fb45c0c7fc0 2024-09-13T15:16:03.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.809+0000 7fb45b200640 1 -- 172.21.15.7:0/524173339 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb45c071350 con 0x7fb45c0c7fc0 2024-09-13T15:16:03.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.809+0000 7fb452000640 1 -- 172.21.15.7:0/524173339 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+5533 (secure 0 0 0) 0x7fb4540550b0 con 0x7fb45c0c7fc0 2024-09-13T15:16:03.810 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:16:03.810 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:15:52.066397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":5710,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5710":{"gid":5710,"name":"f","rank":0,"incarnation":53,"state":"up:active","state_seq":26,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:16:03.810 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 57 2024-09-13T15:16:03.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.813+0000 7fb45b200640 1 -- 172.21.15.7:0/524173339 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb43c066690 msgr2=0x7fb43c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:03.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.813+0000 7fb45b200640 1 --2- 172.21.15.7:0/524173339 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb43c066690 0x7fb43c068b50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb44c001210 tx=0x7fb44c001e10 comp rx=0 tx=0).stop 2024-09-13T15:16:03.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.813+0000 7fb45b200640 1 -- 172.21.15.7:0/524173339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb45c0c7fc0 msgr2=0x7fb45c0cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:03.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.813+0000 7fb45b200640 1 --2- 172.21.15.7:0/524173339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb45c0c7fc0 0x7fb45c0cdd50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0c5d90 tx=0x7fb45400f580 comp rx=0 tx=0).stop 2024-09-13T15:16:03.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.813+0000 7fb45b200640 1 -- 172.21.15.7:0/524173339 shutdown_connections 2024-09-13T15:16:03.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.813+0000 7fb45b200640 1 --2- 172.21.15.7:0/524173339 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb43c066690 0x7fb43c068b50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:03.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.813+0000 7fb45b200640 1 --2- 172.21.15.7:0/524173339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb45c0c7fc0 0x7fb45c0cdd50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:03.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.813+0000 7fb45b200640 1 --2- 172.21.15.7:0/524173339 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb45c158a80 0x7fb45c0c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:03.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.813+0000 7fb45b200640 1 --2- 172.21.15.7:0/524173339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb4400040a0 0x7fb45c0cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:03.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.813+0000 7fb45b200640 1 -- 172.21.15.7:0/524173339 >> 172.21.15.7:0/524173339 conn(0x7fb45c0739a0 msgr2=0x7fb45c154480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:03.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.813+0000 7fb45b200640 1 -- 172.21.15.7:0/524173339 shutdown_connections 2024-09-13T15:16:03.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:03.813+0000 7fb45b200640 1 -- 172.21.15.7:0/524173339 wait complete. 2024-09-13T15:16:03.833 INFO:tasks.mds_thrash.fs.[cephfs]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2024-09-13T15:16:05.834 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:16:06.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.025+0000 7fcc92c00640 1 Processor -- start 2024-09-13T15:16:06.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.025+0000 7fcc92c00640 1 -- start start 2024-09-13T15:16:06.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.025+0000 7fcc92c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcc8c071a70 0x7fcc8c1576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:06.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.025+0000 7fcc92c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc8c0b0bf0 0x7fcc8c150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:06.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.025+0000 7fcc92c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8c0c5530 con 0x7fcc8c06ddb0 2024-09-13T15:16:06.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.025+0000 7fcc92c00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc8c1583b0 con 0x7fcc8c071a70 2024-09-13T15:16:06.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.025+0000 7fcc92c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c156f40 con 0x7fcc8c0b0bf0 2024-09-13T15:16:06.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.025+0000 7fcc90c00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fcc8c06ddb0 0x7fcc8c15a4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58714/0 (socket says 172.21.15.7:58714) 2024-09-13T15:16:06.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.025+0000 7fcc90c00640 1 -- 172.21.15.7:0/1546640412 learned_addr learned my addr 172.21.15.7:0/1546640412 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:16:06.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.025+0000 7fcc8be00640 1 --2- 172.21.15.7:0/1546640412 >> v2:172.21.15.77:3300/0 conn(0x7fcc8c071a70 0x7fcc8c1576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:06.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.025+0000 7fcc8b400640 1 --2- 172.21.15.7:0/1546640412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc8c0b0bf0 0x7fcc8c150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:06.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.025+0000 7fcc8aa00640 1 -- 172.21.15.7:0/1546640412 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294183026 0 0) 0x7fcc8c0c5530 con 0x7fcc8c06ddb0 2024-09-13T15:16:06.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.025+0000 7fcc8aa00640 1 -- 172.21.15.7:0/1546640412 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc70003530 con 0x7fcc8c06ddb0 2024-09-13T15:16:06.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.025+0000 7fcc8be00640 1 -- 172.21.15.7:0/1546640412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc8c0b0bf0 msgr2=0x7fcc8c150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:06.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.025+0000 7fcc8be00640 1 --2- 172.21.15.7:0/1546640412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc8c0b0bf0 0x7fcc8c150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:06.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.025+0000 7fcc8be00640 1 -- 172.21.15.7:0/1546640412 >> v1:172.21.15.7:6789/0 conn(0x7fcc8c06ddb0 legacy=0x7fcc8c15a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:06.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.025+0000 7fcc8be00640 1 -- 172.21.15.7:0/1546640412 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc8c0b10c0 con 0x7fcc8c071a70 2024-09-13T15:16:06.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.029+0000 7fcc8be00640 1 --2- 172.21.15.7:0/1546640412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc8c071a70 0x7fcc8c1576e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0097c0 tx=0x7fcc7c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c3f36418309920f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:06.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.029+0000 7fcc8aa00640 1 -- 172.21.15.7:0/1546640412 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0ab670 con 0x7fcc8c071a70 2024-09-13T15:16:06.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.029+0000 7fcc8aa00640 1 -- 172.21.15.7:0/1546640412 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c0ab7d0 con 0x7fcc8c071a70 2024-09-13T15:16:06.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.029+0000 7fcc8aa00640 1 -- 172.21.15.7:0/1546640412 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0abb40 con 0x7fcc8c071a70 2024-09-13T15:16:06.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.029+0000 7fcc92c00640 1 -- 172.21.15.7:0/1546640412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc8c071a70 msgr2=0x7fcc8c1576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:06.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.029+0000 7fcc92c00640 1 --2- 172.21.15.7:0/1546640412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc8c071a70 0x7fcc8c1576e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0097c0 tx=0x7fcc7c01c470 comp rx=0 tx=0).stop 2024-09-13T15:16:06.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.033+0000 7fcc92c00640 1 -- 172.21.15.7:0/1546640412 shutdown_connections 2024-09-13T15:16:06.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.033+0000 7fcc92c00640 1 --2- 172.21.15.7:0/1546640412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc8c0b0bf0 0x7fcc8c150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:06.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.033+0000 7fcc92c00640 1 --2- 172.21.15.7:0/1546640412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc8c071a70 0x7fcc8c1576e0 secure :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0097c0 tx=0x7fcc7c01c470 comp rx=0 tx=0).stop 2024-09-13T15:16:06.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.033+0000 7fcc92c00640 1 -- 172.21.15.7:0/1546640412 >> 172.21.15.7:0/1546640412 conn(0x7fcc8c065d40 msgr2=0x7fcc8c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:06.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.037+0000 7fcc92c00640 1 -- 172.21.15.7:0/1546640412 shutdown_connections 2024-09-13T15:16:06.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.037+0000 7fcc92c00640 1 -- 172.21.15.7:0/1546640412 wait complete. 2024-09-13T15:16:06.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc92c00640 1 Processor -- start 2024-09-13T15:16:06.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc92c00640 1 -- start start 2024-09-13T15:16:06.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc92c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc8c06ddb0 0x7fcc8c1f9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:06.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc92c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc8c0b0bf0 0x7fcc8c0c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:06.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc92c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc8c070f80 0x7fcc8c145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:06.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc92c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c147110 con 0x7fcc8c06ddb0 2024-09-13T15:16:06.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc92c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c0c30a0 con 0x7fcc8c0b0bf0 2024-09-13T15:16:06.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc92c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc8c153e90 con 0x7fcc8c070f80 2024-09-13T15:16:06.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc90c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc8c070f80 0x7fcc8c145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:06.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc8be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc8c06ddb0 0x7fcc8c1f9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:06.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc90c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc8c070f80 0x7fcc8c145a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:39724/0 (socket says 172.21.15.7:39724) 2024-09-13T15:16:06.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc90c00640 1 -- 172.21.15.7:0/2685738459 learned_addr learned my addr 172.21.15.7:0/2685738459 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:06.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc8b400640 1 --2- 172.21.15.7:0/2685738459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc8c0b0bf0 0x7fcc8c0c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:06.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc8be00640 1 -- 172.21.15.7:0/2685738459 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc8c070f80 msgr2=0x7fcc8c145a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:06.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc8be00640 1 --2- 172.21.15.7:0/2685738459 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc8c070f80 0x7fcc8c145a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:06.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc8be00640 1 -- 172.21.15.7:0/2685738459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc8c0b0bf0 msgr2=0x7fcc8c0c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:06.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc8be00640 1 --2- 172.21.15.7:0/2685738459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc8c0b0bf0 0x7fcc8c0c3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:06.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc8be00640 1 -- 172.21.15.7:0/2685738459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c009420 con 0x7fcc8c06ddb0 2024-09-13T15:16:06.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc8be00640 1 --2- 172.21.15.7:0/2685738459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc8c06ddb0 0x7fcc8c1f9b70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c0c1f00 tx=0x7fcc7c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:06.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc83e00640 1 -- 172.21.15.7:0/2685738459 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0b5600 con 0x7fcc8c06ddb0 2024-09-13T15:16:06.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc83e00640 1 -- 172.21.15.7:0/2685738459 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c0b5760 con 0x7fcc8c06ddb0 2024-09-13T15:16:06.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc92c00640 1 -- 172.21.15.7:0/2685738459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc8c0c27d0 con 0x7fcc8c06ddb0 2024-09-13T15:16:06.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc83e00640 1 -- 172.21.15.7:0/2685738459 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0b5b10 con 0x7fcc8c06ddb0 2024-09-13T15:16:06.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.041+0000 7fcc92c00640 1 -- 172.21.15.7:0/2685738459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc8c0c2d30 con 0x7fcc8c06ddb0 2024-09-13T15:16:06.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.045+0000 7fcc92c00640 1 -- 172.21.15.7:0/2685738459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8c067650 con 0x7fcc8c06ddb0 2024-09-13T15:16:06.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.045+0000 7fcc83e00640 1 -- 172.21.15.7:0/2685738459 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcc7c0b5c70 con 0x7fcc8c06ddb0 2024-09-13T15:16:06.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.045+0000 7fcc83e00640 1 --2- 172.21.15.7:0/2685738459 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcc6c066690 0x7fcc6c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:06.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.045+0000 7fcc83e00640 1 -- 172.21.15.7:0/2685738459 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7fcc7c0eef90 con 0x7fcc8c06ddb0 2024-09-13T15:16:06.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.045+0000 7fcc8b400640 1 --2- 172.21.15.7:0/2685738459 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcc6c066690 0x7fcc6c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:06.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.049+0000 7fcc8b400640 1 --2- 172.21.15.7:0/2685738459 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcc6c066690 0x7fcc6c068b50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c0c4020 tx=0x7fcc78008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:06.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.053+0000 7fcc83e00640 1 -- 172.21.15.7:0/2685738459 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcc7c123060 con 0x7fcc8c06ddb0 2024-09-13T15:16:06.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.521+0000 7fcc92c00640 1 -- 172.21.15.7:0/2685738459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc8c1576e0 con 0x7fcc8c06ddb0 2024-09-13T15:16:06.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.525+0000 7fcc83e00640 1 -- 172.21.15.7:0/2685738459 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+6284 (secure 0 0 0) 0x7fcc7c123020 con 0x7fcc8c06ddb0 2024-09-13T15:16:06.524 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:16:06.524 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/118107059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":118107059},{"type":"v1","addr":"172.21.15.7:6836","nonce":118107059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:15:52.066397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":5710,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5710":{"gid":5710,"name":"f","rank":0,"incarnation":53,"state":"up:active","state_seq":26,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:16:06.524 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 58 2024-09-13T15:16:06.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.533+0000 7fcc81600640 1 -- 172.21.15.7:0/2685738459 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcc6c066690 msgr2=0x7fcc6c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:06.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.533+0000 7fcc81600640 1 --2- 172.21.15.7:0/2685738459 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcc6c066690 0x7fcc6c068b50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c0c4020 tx=0x7fcc78008040 comp rx=0 tx=0).stop 2024-09-13T15:16:06.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.533+0000 7fcc81600640 1 -- 172.21.15.7:0/2685738459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc8c06ddb0 msgr2=0x7fcc8c1f9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:06.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.533+0000 7fcc81600640 1 --2- 172.21.15.7:0/2685738459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc8c06ddb0 0x7fcc8c1f9b70 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c0c1f00 tx=0x7fcc7c01acb0 comp rx=0 tx=0).stop 2024-09-13T15:16:06.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.549+0000 7fcc81600640 1 -- 172.21.15.7:0/2685738459 shutdown_connections 2024-09-13T15:16:06.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.549+0000 7fcc81600640 1 --2- 172.21.15.7:0/2685738459 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fcc6c066690 0x7fcc6c068b50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:06.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.549+0000 7fcc81600640 1 --2- 172.21.15.7:0/2685738459 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fcc8c070f80 0x7fcc8c145a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:06.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.549+0000 7fcc81600640 1 --2- 172.21.15.7:0/2685738459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc8c0b0bf0 0x7fcc8c0c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:06.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.549+0000 7fcc81600640 1 --2- 172.21.15.7:0/2685738459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcc8c06ddb0 0x7fcc8c1f9b70 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:06.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.549+0000 7fcc81600640 1 -- 172.21.15.7:0/2685738459 >> 172.21.15.7:0/2685738459 conn(0x7fcc8c065d40 msgr2=0x7fcc8c0c9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:06.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.553+0000 7fcc81600640 1 -- 172.21.15.7:0/2685738459 shutdown_connections 2024-09-13T15:16:06.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:06.557+0000 7fcc81600640 1 -- 172.21.15.7:0/2685738459 wait complete. 2024-09-13T15:16:06.626 INFO:tasks.mds_thrash.fs.[cephfs]:mds.c reported in up:standby state 2024-09-13T15:16:06.627 INFO:tasks.mds_thrash.fs.[cephfs]:stat['max_mds'] = 1 2024-09-13T15:16:06.627 INFO:tasks.mds_thrash.fs.[cephfs]:stat['deactivate'] = 0 2024-09-13T15:16:06.627 INFO:tasks.mds_thrash.fs.[cephfs]:stat['kill'] = 6 2024-09-13T15:16:06.627 INFO:tasks.mds_thrash:done joining 2024-09-13T15:16:06.627 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T15:16:06.636 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T15:16:06.636 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:16:06.636 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:16:06.712 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-13T15:16:06.712 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T15:16:06.778 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:16:07.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.121+0000 7f6937200640 1 Processor -- start 2024-09-13T15:16:07.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.121+0000 7f6937200640 1 -- start start 2024-09-13T15:16:07.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.121+0000 7f6937200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f693806e2d0 0x7f69380c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:07.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.121+0000 7f6937200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f693814fe20 0x7f6938155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:07.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.121+0000 7f6937200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69380715c0 con 0x7f693806e6b0 2024-09-13T15:16:07.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.121+0000 7f6937200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6938071ff0 con 0x7f693814fe20 2024-09-13T15:16:07.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.121+0000 7f6937200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69380c82e0 con 0x7f693806e2d0 2024-09-13T15:16:07.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.121+0000 7f6936800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f693814fe20 0x7f6938155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:07.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.125+0000 7f6936800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f693814fe20 0x7f6938155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42802/0 (socket says 172.21.15.7:42802) 2024-09-13T15:16:07.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.125+0000 7f6936800640 1 -- 172.21.15.7:0/905846103 learned_addr learned my addr 172.21.15.7:0/905846103 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:07.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.125+0000 7f6935e00640 1 --2- 172.21.15.7:0/905846103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f693806e2d0 0x7f69380c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:07.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.125+0000 7f6936800640 1 -- 172.21.15.7:0/905846103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f693806e2d0 msgr2=0x7f69380c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:07.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.125+0000 7f6936800640 1 --2- 172.21.15.7:0/905846103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f693806e2d0 0x7f69380c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:07.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.125+0000 7f6936800640 1 -- 172.21.15.7:0/905846103 >> v1:172.21.15.7:6789/0 conn(0x7f693806e6b0 legacy=0x7f693814f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:07.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.125+0000 7f6936800640 1 -- 172.21.15.7:0/905846103 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69380c85c0 con 0x7f693814fe20 2024-09-13T15:16:07.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.125+0000 7f6935e00640 1 --2- 172.21.15.7:0/905846103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f693806e2d0 0x7f69380c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:16:07.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.137+0000 7f6936800640 1 --2- 172.21.15.7:0/905846103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f693814fe20 0x7f6938155bc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6930009e50 tx=0x7f693001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572cdddc28815742 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:07.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.141+0000 7f6934a00640 1 -- 172.21.15.7:0/905846103 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69300a58d0 con 0x7f693814fe20 2024-09-13T15:16:07.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.145+0000 7f6934a00640 1 -- 172.21.15.7:0/905846103 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69300a5a30 con 0x7f693814fe20 2024-09-13T15:16:07.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.145+0000 7f6934a00640 1 -- 172.21.15.7:0/905846103 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69300a5dc0 con 0x7f693814fe20 2024-09-13T15:16:07.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.145+0000 7f6937200640 1 -- 172.21.15.7:0/905846103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f693814fe20 msgr2=0x7f6938155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:07.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.145+0000 7f6937200640 1 --2- 172.21.15.7:0/905846103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f693814fe20 0x7f6938155bc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6930009e50 tx=0x7f693001ca00 comp rx=0 tx=0).stop 2024-09-13T15:16:07.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.145+0000 7f6937200640 1 -- 172.21.15.7:0/905846103 shutdown_connections 2024-09-13T15:16:07.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.145+0000 7f6937200640 1 --2- 172.21.15.7:0/905846103 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f693814fe20 0x7f6938155bc0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:07.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.145+0000 7f6937200640 1 --2- 172.21.15.7:0/905846103 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f693806e2d0 0x7f69380c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:07.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.145+0000 7f6937200640 1 -- 172.21.15.7:0/905846103 >> 172.21.15.7:0/905846103 conn(0x7f6938069f30 msgr2=0x7f693806a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:07.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.149+0000 7f6937200640 1 -- 172.21.15.7:0/905846103 shutdown_connections 2024-09-13T15:16:07.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.153+0000 7f6937200640 1 -- 172.21.15.7:0/905846103 wait complete. 2024-09-13T15:16:07.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.161+0000 7f6937200640 1 Processor -- start 2024-09-13T15:16:07.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.161+0000 7f6937200640 1 -- start start 2024-09-13T15:16:07.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.161+0000 7f6937200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f693806e2d0 0x7f69381f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:07.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.161+0000 7f6937200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f693806e6b0 0x7f69380afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:07.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.161+0000 7f6937200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f693814fe20 0x7f6938145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:07.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.161+0000 7f6935e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f693806e2d0 0x7f69381f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:07.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.161+0000 7f6935e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f693806e2d0 0x7f69381f5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42816/0 (socket says 172.21.15.7:42816) 2024-09-13T15:16:07.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.161+0000 7f6935400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f693806e6b0 0x7f69380afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:07.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.161+0000 7f6935400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f693806e6b0 0x7f69380afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:39746/0 (socket says 172.21.15.7:39746) 2024-09-13T15:16:07.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.161+0000 7f6937200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6938146ca0 con 0x7f693806e2d0 2024-09-13T15:16:07.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.161+0000 7f6937200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69381f6200 con 0x7f693814fe20 2024-09-13T15:16:07.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.161+0000 7f6937200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6938155740 con 0x7f693806e6b0 2024-09-13T15:16:07.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.161+0000 7f6935e00640 1 -- 172.21.15.7:0/766969433 learned_addr learned my addr 172.21.15.7:0/766969433 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:07.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.161+0000 7f6936800640 1 --2- 172.21.15.7:0/766969433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f693814fe20 0x7f6938145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:07.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.165+0000 7f6935e00640 1 -- 172.21.15.7:0/766969433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f693806e6b0 msgr2=0x7f69380afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:07.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.165+0000 7f6935e00640 1 --2- 172.21.15.7:0/766969433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f693806e6b0 0x7f69380afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:07.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.165+0000 7f6935e00640 1 -- 172.21.15.7:0/766969433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f693814fe20 msgr2=0x7f6938145220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:07.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.165+0000 7f6935e00640 1 --2- 172.21.15.7:0/766969433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f693814fe20 0x7f6938145220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:07.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.165+0000 7f6935e00640 1 -- 172.21.15.7:0/766969433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6928009420 con 0x7f693806e2d0 2024-09-13T15:16:07.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.165+0000 7f6935400640 1 --2- 172.21.15.7:0/766969433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f693806e6b0 0x7f69380afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:16:07.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.165+0000 7f6936800640 1 --2- 172.21.15.7:0/766969433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f693814fe20 0x7f6938145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:16:07.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.165+0000 7f6935e00640 1 --2- 172.21.15.7:0/766969433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f693806e2d0 0x7f69381f5cc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f692800e980 tx=0x7f692800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:07.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.165+0000 7f692e000640 1 -- 172.21.15.7:0/766969433 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692800ca00 con 0x7f693806e2d0 2024-09-13T15:16:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.165+0000 7f692e000640 1 -- 172.21.15.7:0/766969433 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692800cb60 con 0x7f693806e2d0 2024-09-13T15:16:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.165+0000 7f692e000640 1 -- 172.21.15.7:0/766969433 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6928013470 con 0x7f693806e2d0 2024-09-13T15:16:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.165+0000 7f6937200640 1 -- 172.21.15.7:0/766969433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6930009b30 con 0x7f693806e2d0 2024-09-13T15:16:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.165+0000 7f6937200640 1 -- 172.21.15.7:0/766969433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6938153ae0 con 0x7f693806e2d0 2024-09-13T15:16:07.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.165+0000 7f6937200640 1 -- 172.21.15.7:0/766969433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69381468e0 con 0x7f693806e2d0 2024-09-13T15:16:07.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.173+0000 7f692e000640 1 -- 172.21.15.7:0/766969433 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f69280135d0 con 0x7f693806e2d0 2024-09-13T15:16:07.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.173+0000 7f692e000640 1 --2- 172.21.15.7:0/766969433 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6918066790 0x7f6918068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:07.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.173+0000 7f692e000640 1 -- 172.21.15.7:0/766969433 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f69280850d0 con 0x7f693806e2d0 2024-09-13T15:16:07.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.181+0000 7f6935400640 1 --2- 172.21.15.7:0/766969433 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6918066790 0x7f6918068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:07.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.181+0000 7f6935400640 1 --2- 172.21.15.7:0/766969433 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6918066790 0x7f6918068c50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f693814a930 tx=0x7f6924009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:07.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.185+0000 7f692e000640 1 -- 172.21.15.7:0/766969433 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6928051f10 con 0x7f693806e2d0 2024-09-13T15:16:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.593+0000 7f6937200640 1 -- 172.21.15.7:0/766969433 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69381558b0 con 0x7f693806e2d0 2024-09-13T15:16:07.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.593+0000 7f692e000640 1 -- 172.21.15.7:0/766969433 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+19389 (secure 0 0 0) 0x7f6928021090 con 0x7f693806e2d0 2024-09-13T15:16:07.593 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:16:07.593 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":33,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:15:27.857916+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6836/2396967179":"2024-09-14T15:15:27.857855+0000","172.21.15.7:6834/2396967179":"2024-09-14T15:15:27.857855+0000","172.21.15.77:6839/2233000674":"2024-09-14T15:13:27.782565+0000","172.21.15.77:6837/2233000674":"2024-09-14T15:13:27.782565+0000","172.21.15.77:6835/2367107997":"2024-09-14T15:11:57.741130+0000","172.21.15.7:6837/3369648543":"2024-09-14T15:09:52.666380+0000","172.21.15.7:6835/3369648543":"2024-09-14T15:09:52.666380+0000","172.21.15.77:6838/3330080895":"2024-09-14T15:07:12.613134+0000","172.21.15.77:6836/3330080895":"2024-09-14T15:07:12.613134+0000","172.21.15.77:6834/2367107997":"2024-09-14T15:11:57.741130+0000","172.21.15.7:6833/2907495549":"2024-09-14T15:05:07.589499+0000","172.21.15.7:6832/2907495549":"2024-09-14T15:05:07.589499+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:16:07.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.593+0000 7f6937200640 1 -- 172.21.15.7:0/766969433 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6918066790 msgr2=0x7f6918068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:07.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.593+0000 7f6937200640 1 --2- 172.21.15.7:0/766969433 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6918066790 0x7f6918068c50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f693814a930 tx=0x7f6924009040 comp rx=0 tx=0).stop 2024-09-13T15:16:07.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.593+0000 7f6937200640 1 -- 172.21.15.7:0/766969433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f693806e2d0 msgr2=0x7f69381f5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:07.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.593+0000 7f6937200640 1 --2- 172.21.15.7:0/766969433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f693806e2d0 0x7f69381f5cc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f692800e980 tx=0x7f692800ee40 comp rx=0 tx=0).stop 2024-09-13T15:16:07.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.593+0000 7f6937200640 1 -- 172.21.15.7:0/766969433 shutdown_connections 2024-09-13T15:16:07.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.597+0000 7f6937200640 1 --2- 172.21.15.7:0/766969433 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6918066790 0x7f6918068c50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:07.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.597+0000 7f6937200640 1 --2- 172.21.15.7:0/766969433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f693814fe20 0x7f6938145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:07.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.597+0000 7f6937200640 1 --2- 172.21.15.7:0/766969433 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f693806e6b0 0x7f69380afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:07.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.597+0000 7f6937200640 1 --2- 172.21.15.7:0/766969433 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f693806e2d0 0x7f69381f5cc0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:07.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.597+0000 7f6937200640 1 -- 172.21.15.7:0/766969433 >> 172.21.15.7:0/766969433 conn(0x7f6938069f30 msgr2=0x7f693814ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:07.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.597+0000 7f6937200640 1 -- 172.21.15.7:0/766969433 shutdown_connections 2024-09-13T15:16:07.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.597+0000 7f6937200640 1 -- 172.21.15.7:0/766969433 wait complete. 2024-09-13T15:16:07.615 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T15:01:38.710958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T15:01:43.178724+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T15:01:43.774877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-13T15:01:46.843203+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-13T15:16:07.616 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T15:16:07.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.761+0000 7f2538a00640 1 Processor -- start 2024-09-13T15:16:07.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.761+0000 7f2538a00640 1 -- start start 2024-09-13T15:16:07.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.761+0000 7f2538a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f253406d0d0 0x7f25340c7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:07.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.761+0000 7f2538a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25340c83c0 con 0x7f253406d520 2024-09-13T15:16:07.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.761+0000 7f2538a00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253406fe40 con 0x7f253406f600 2024-09-13T15:16:07.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.761+0000 7f2538a00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2534070100 con 0x7f253406d0d0 2024-09-13T15:16:07.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.761+0000 7f2532800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f253406d520 0x7f25340711c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58730/0 (socket says 172.21.15.7:58730) 2024-09-13T15:16:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.761+0000 7f2532800640 1 -- 172.21.15.7:0/2809500491 learned_addr learned my addr 172.21.15.7:0/2809500491 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:16:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.761+0000 7f2529400640 1 --2- 172.21.15.7:0/2809500491 >> v2:172.21.15.77:3300/0 conn(0x7f253406d0d0 0x7f25340c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.765+0000 7f2531400640 1 -- 172.21.15.7:0/2809500491 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283251712 0 0) 0x7f25340c83c0 con 0x7f253406d520 2024-09-13T15:16:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.765+0000 7f2531400640 1 -- 172.21.15.7:0/2809500491 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2518003530 con 0x7f253406d520 2024-09-13T15:16:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.765+0000 7f2529400640 1 -- 172.21.15.7:0/2809500491 >> v1:172.21.15.77:6789/0 conn(0x7f253406f600 legacy=0x7f25341560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.765+0000 7f2529400640 1 -- 172.21.15.7:0/2809500491 >> v1:172.21.15.7:6789/0 conn(0x7f253406d520 legacy=0x7f25340711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.765+0000 7f2531400640 1 -- 172.21.15.7:0/2809500491 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1222447765 0 0) 0x7f2518003530 con 0x7f253406d520 2024-09-13T15:16:07.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.765+0000 7f2529400640 1 -- 172.21.15.7:0/2809500491 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25340703e0 con 0x7f253406d0d0 2024-09-13T15:16:07.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.765+0000 7f2529400640 1 --2- 172.21.15.7:0/2809500491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253406d0d0 0x7f25340c7470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f251c0097c0 tx=0x7f251c01c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa4f7467638b584e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:07.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.765+0000 7f2531400640 1 -- 172.21.15.7:0/2809500491 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c001a00 con 0x7f253406d0d0 2024-09-13T15:16:07.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.765+0000 7f2531400640 1 -- 172.21.15.7:0/2809500491 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251c0ac440 con 0x7f253406d0d0 2024-09-13T15:16:07.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.765+0000 7f2531400640 1 -- 172.21.15.7:0/2809500491 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c0ac7d0 con 0x7f253406d0d0 2024-09-13T15:16:07.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.769+0000 7f2538a00640 1 -- 172.21.15.7:0/2809500491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253406d0d0 msgr2=0x7f25340c7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.769+0000 7f2538a00640 1 --2- 172.21.15.7:0/2809500491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253406d0d0 0x7f25340c7470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f251c0097c0 tx=0x7f251c01c390 comp rx=0 tx=0).stop 2024-09-13T15:16:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.769+0000 7f2538a00640 1 -- 172.21.15.7:0/2809500491 shutdown_connections 2024-09-13T15:16:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.769+0000 7f2538a00640 1 --2- 172.21.15.7:0/2809500491 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253406d0d0 0x7f25340c7470 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.769+0000 7f2538a00640 1 -- 172.21.15.7:0/2809500491 >> 172.21.15.7:0/2809500491 conn(0x7f2534065d40 msgr2=0x7f2534066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.769+0000 7f2538a00640 1 -- 172.21.15.7:0/2809500491 shutdown_connections 2024-09-13T15:16:07.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.769+0000 7f2538a00640 1 -- 172.21.15.7:0/2809500491 wait complete. 2024-09-13T15:16:07.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.769+0000 7f2538a00640 1 Processor -- start 2024-09-13T15:16:07.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.769+0000 7f2538a00640 1 -- start start 2024-09-13T15:16:07.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2538a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f253406d0d0 0x7f25341f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:07.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2538a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f253406d520 0x7f2534155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:07.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2538a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253406f600 0x7f25341f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:07.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2538a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2534158dd0 con 0x7f253406d0d0 2024-09-13T15:16:07.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2538a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25341f5d30 con 0x7f253406f600 2024-09-13T15:16:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2538a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253414ec50 con 0x7f253406d520 2024-09-13T15:16:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2531e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f253406d0d0 0x7f25341f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2531e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f253406d0d0 0x7f25341f57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42818/0 (socket says 172.21.15.7:42818) 2024-09-13T15:16:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2531e00640 1 -- 172.21.15.7:0/2952960142 learned_addr learned my addr 172.21.15.7:0/2952960142 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2532800640 1 --2- 172.21.15.7:0/2952960142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253406f600 0x7f25341f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2529400640 1 --2- 172.21.15.7:0/2952960142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f253406d520 0x7f2534155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2531e00640 1 -- 172.21.15.7:0/2952960142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f253406d520 msgr2=0x7f2534155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2531e00640 1 --2- 172.21.15.7:0/2952960142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f253406d520 0x7f2534155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2531e00640 1 -- 172.21.15.7:0/2952960142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253406f600 msgr2=0x7f25341f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2531e00640 1 --2- 172.21.15.7:0/2952960142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253406f600 0x7f25341f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2531e00640 1 -- 172.21.15.7:0/2952960142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c009420 con 0x7f253406d0d0 2024-09-13T15:16:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2531e00640 1 --2- 172.21.15.7:0/2952960142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f253406d0d0 0x7f25341f57f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f252400c500 tx=0x7f252400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:07.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f252aa00640 1 -- 172.21.15.7:0/2952960142 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524005220 con 0x7f253406d0d0 2024-09-13T15:16:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f252aa00640 1 -- 172.21.15.7:0/2952960142 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2524005380 con 0x7f253406d0d0 2024-09-13T15:16:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f252aa00640 1 -- 172.21.15.7:0/2952960142 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524007270 con 0x7f253406d0d0 2024-09-13T15:16:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2538a00640 1 -- 172.21.15.7:0/2952960142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25341f1aa0 con 0x7f253406d0d0 2024-09-13T15:16:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2538a00640 1 -- 172.21.15.7:0/2952960142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253414f460 con 0x7f253406d0d0 2024-09-13T15:16:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.773+0000 7f2538a00640 1 -- 172.21.15.7:0/2952960142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25340c6e70 con 0x7f253406d0d0 2024-09-13T15:16:07.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.777+0000 7f252aa00640 1 -- 172.21.15.7:0/2952960142 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f25240073d0 con 0x7f253406d0d0 2024-09-13T15:16:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.777+0000 7f252aa00640 1 --2- 172.21.15.7:0/2952960142 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2510066690 0x7f2510068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.777+0000 7f252aa00640 1 -- 172.21.15.7:0/2952960142 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f2524083c80 con 0x7f253406d0d0 2024-09-13T15:16:07.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.777+0000 7f2529400640 1 --2- 172.21.15.7:0/2952960142 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2510066690 0x7f2510068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:07.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.777+0000 7f2529400640 1 --2- 172.21.15.7:0/2952960142 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2510066690 0x7f2510068b50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f251c0ae000 tx=0x7f251c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:07.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.781+0000 7f252aa00640 1 -- 172.21.15.7:0/2952960142 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2524050a50 con 0x7f253406d0d0 2024-09-13T15:16:07.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.941+0000 7f2538a00640 1 -- 172.21.15.7:0/2952960142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f25341f1870 con 0x7f253406d0d0 2024-09-13T15:16:07.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.945+0000 7f252aa00640 1 -- 172.21.15.7:0/2952960142 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2524054070 con 0x7f253406d0d0 2024-09-13T15:16:07.943 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-13T15:16:07.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.945+0000 7f2538a00640 1 -- 172.21.15.7:0/2952960142 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2510066690 msgr2=0x7f2510068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:07.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.945+0000 7f2538a00640 1 --2- 172.21.15.7:0/2952960142 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2510066690 0x7f2510068b50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f251c0ae000 tx=0x7f251c008040 comp rx=0 tx=0).stop 2024-09-13T15:16:07.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.945+0000 7f2538a00640 1 -- 172.21.15.7:0/2952960142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f253406d0d0 msgr2=0x7f25341f57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:07.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.945+0000 7f2538a00640 1 --2- 172.21.15.7:0/2952960142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f253406d0d0 0x7f25341f57f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f252400c500 tx=0x7f252400c9c0 comp rx=0 tx=0).stop 2024-09-13T15:16:07.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.945+0000 7f2538a00640 1 -- 172.21.15.7:0/2952960142 shutdown_connections 2024-09-13T15:16:07.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.945+0000 7f2538a00640 1 --2- 172.21.15.7:0/2952960142 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2510066690 0x7f2510068b50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:07.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.945+0000 7f2538a00640 1 --2- 172.21.15.7:0/2952960142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f253406f600 0x7f25341f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:07.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.945+0000 7f2538a00640 1 --2- 172.21.15.7:0/2952960142 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f253406d520 0x7f2534155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:07.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.945+0000 7f2538a00640 1 --2- 172.21.15.7:0/2952960142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f253406d0d0 0x7f25341f57f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:07.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.945+0000 7f2538a00640 1 -- 172.21.15.7:0/2952960142 >> 172.21.15.7:0/2952960142 conn(0x7f2534065d40 msgr2=0x7f25340c5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:07.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.945+0000 7f2538a00640 1 -- 172.21.15.7:0/2952960142 shutdown_connections 2024-09-13T15:16:07.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:07.945+0000 7f2538a00640 1 -- 172.21.15.7:0/2952960142 wait complete. 2024-09-13T15:16:07.966 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T15:16:08.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.149+0000 7f4ebf400640 1 Processor -- start 2024-09-13T15:16:08.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.149+0000 7f4ebf400640 1 -- start start 2024-09-13T15:16:08.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.153+0000 7f4ebf400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4eb814da10 0x7f4eb806d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:08.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.153+0000 7f4ebf400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb806e020 con 0x7f4eb806ce70 2024-09-13T15:16:08.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.153+0000 7f4ebf400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb8156fd0 con 0x7f4eb815a540 2024-09-13T15:16:08.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.153+0000 7f4ebf400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb8157270 con 0x7f4eb814da10 2024-09-13T15:16:08.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.153+0000 7f4eb7e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f4eb806ce70 0x7f4eb8071810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:58744/0 (socket says 172.21.15.7:58744) 2024-09-13T15:16:08.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.153+0000 7f4eb7e00640 1 -- 172.21.15.7:0/3196592971 learned_addr learned my addr 172.21.15.7:0/3196592971 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:16:08.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.153+0000 7f4eb7400640 1 -- 172.21.15.7:0/3196592971 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3798673086 0 0) 0x7f4eb806e020 con 0x7f4eb806ce70 2024-09-13T15:16:08.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.153+0000 7f4eb7400640 1 -- 172.21.15.7:0/3196592971 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e9c003530 con 0x7f4eb806ce70 2024-09-13T15:16:08.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.153+0000 7f4ebca00640 1 --2- 172.21.15.7:0/3196592971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4eb814da10 0x7f4eb806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:08.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.157+0000 7f4eb7400640 1 -- 172.21.15.7:0/3196592971 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 118808084 0 0) 0x7f4e9c003530 con 0x7f4eb806ce70 2024-09-13T15:16:08.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.157+0000 7f4eb7400640 1 -- 172.21.15.7:0/3196592971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4eb814da10 msgr2=0x7f4eb806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:08.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.157+0000 7f4eb7400640 1 --2- 172.21.15.7:0/3196592971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4eb814da10 0x7f4eb806d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:08.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.157+0000 7f4eb7400640 1 -- 172.21.15.7:0/3196592971 >> v1:172.21.15.77:6789/0 conn(0x7f4eb815a540 legacy=0x7f4eb815a980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:16:08.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.157+0000 7f4eb7400640 1 -- 172.21.15.7:0/3196592971 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb8157550 con 0x7f4eb806ce70 2024-09-13T15:16:08.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.157+0000 7f4eb7400640 1 -- 172.21.15.7:0/3196592971 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f4ea4001680 con 0x7f4eb806ce70 2024-09-13T15:16:08.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.157+0000 7f4eb7400640 1 -- 172.21.15.7:0/3196592971 >> v1:172.21.15.7:6789/0 conn(0x7f4eb806ce70 legacy=0x7f4eb8071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:08.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.157+0000 7f4eb7400640 1 --2- 172.21.15.7:0/3196592971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e9c0039b0 0x7f4e9c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:08.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.157+0000 7f4eb7400640 1 --2- 172.21.15.7:0/3196592971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9c0047d0 0x7f4e9c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:08.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.157+0000 7f4eb7400640 1 --2- 172.21.15.7:0/3196592971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e9c005190 0x7f4e9c00fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:08.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.157+0000 7f4eb7400640 1 -- 172.21.15.7:0/3196592971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb8157270 con 0x7f4e9c0047d0 2024-09-13T15:16:08.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.157+0000 7f4eb7400640 1 -- 172.21.15.7:0/3196592971 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c010480 con 0x7f4e9c005190 2024-09-13T15:16:08.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.157+0000 7f4eb7400640 1 -- 172.21.15.7:0/3196592971 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9c009980 con 0x7f4e9c0039b0 2024-09-13T15:16:08.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.157+0000 7f4eb7e00640 1 --2- 172.21.15.7:0/3196592971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9c0047d0 0x7f4e9c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.161+0000 7f4eb7e00640 1 -- 172.21.15.7:0/3196592971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e9c0039b0 msgr2=0x7f4e9c003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:16:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.161+0000 7f4eb7e00640 1 --2- 172.21.15.7:0/3196592971 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e9c0039b0 0x7f4e9c003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.161+0000 7f4eb7e00640 1 -- 172.21.15.7:0/3196592971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e9c005190 msgr2=0x7f4e9c00fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.161+0000 7f4eb7e00640 1 --2- 172.21.15.7:0/3196592971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e9c005190 0x7f4e9c00fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:08.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.161+0000 7f4eb7e00640 1 -- 172.21.15.7:0/3196592971 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c003530 con 0x7f4e9c0047d0 2024-09-13T15:16:08.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.165+0000 7f4eb7e00640 1 --2- 172.21.15.7:0/3196592971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9c0047d0 0x7f4e9c004c50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400c110 tx=0x7f4ea401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5638a979ec736c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:08.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.165+0000 7f4eb7400640 1 -- 172.21.15.7:0/3196592971 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4005ae0 con 0x7f4e9c0047d0 2024-09-13T15:16:08.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.165+0000 7f4eb7400640 1 -- 172.21.15.7:0/3196592971 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea4005c40 con 0x7f4e9c0047d0 2024-09-13T15:16:08.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.165+0000 7f4eb7400640 1 -- 172.21.15.7:0/3196592971 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea40a5880 con 0x7f4e9c0047d0 2024-09-13T15:16:08.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.165+0000 7f4ebf400640 1 -- 172.21.15.7:0/3196592971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9c0047d0 msgr2=0x7f4e9c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.165+0000 7f4ebf400640 1 --2- 172.21.15.7:0/3196592971 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e9c0047d0 0x7f4e9c004c50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400c110 tx=0x7f4ea401cbc0 comp rx=0 tx=0).stop 2024-09-13T15:16:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.165+0000 7f4ebd400640 1 -- 172.21.15.7:0/3196592971 reap_dead start 2024-09-13T15:16:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.165+0000 7f4ebf400640 1 -- 172.21.15.7:0/3196592971 shutdown_connections 2024-09-13T15:16:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.165+0000 7f4ebf400640 1 -- 172.21.15.7:0/3196592971 >> 172.21.15.7:0/3196592971 conn(0x7f4eb8065d40 msgr2=0x7f4eb8066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.165+0000 7f4ebf400640 1 -- 172.21.15.7:0/3196592971 shutdown_connections 2024-09-13T15:16:08.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.165+0000 7f4ebf400640 1 -- 172.21.15.7:0/3196592971 wait complete. 2024-09-13T15:16:08.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.169+0000 7f4ebf400640 1 Processor -- start 2024-09-13T15:16:08.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.169+0000 7f4ebf400640 1 -- start start 2024-09-13T15:16:08.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.169+0000 7f4ebf400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e9c0047d0 0x7f4eb8154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:08.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.169+0000 7f4ebf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb81eb500 0x7f4eb8151740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:08.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.169+0000 7f4ebf400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eb81488c0 0x7f4eb8152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:08.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.169+0000 7f4ebf400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb81ea810 con 0x7f4eb81eb500 2024-09-13T15:16:08.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.169+0000 7f4ebf400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb81532b0 con 0x7f4eb81488c0 2024-09-13T15:16:08.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.169+0000 7f4ebf400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb8148d40 con 0x7f4e9c0047d0 2024-09-13T15:16:08.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.173+0000 7f4ebca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e9c0047d0 0x7f4eb8154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:08.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.173+0000 7f4ebca00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e9c0047d0 0x7f4eb8154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:39792/0 (socket says 172.21.15.7:39792) 2024-09-13T15:16:08.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.173+0000 7f4ebca00640 1 -- 172.21.15.7:0/1051399946 learned_addr learned my addr 172.21.15.7:0/1051399946 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:08.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.173+0000 7f4ebd400640 1 --2- 172.21.15.7:0/1051399946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eb81488c0 0x7f4eb8152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:08.171 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.173+0000 7f4eb7e00640 1 --2- 172.21.15.7:0/1051399946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb81eb500 0x7f4eb8151740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:08.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.173+0000 7f4ebca00640 1 -- 172.21.15.7:0/1051399946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eb81488c0 msgr2=0x7f4eb8152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:08.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.173+0000 7f4ebca00640 1 --2- 172.21.15.7:0/1051399946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eb81488c0 0x7f4eb8152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:08.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.173+0000 7f4ebca00640 1 -- 172.21.15.7:0/1051399946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb81eb500 msgr2=0x7f4eb8151740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:08.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.173+0000 7f4ebca00640 1 --2- 172.21.15.7:0/1051399946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb81eb500 0x7f4eb8151740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:08.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.173+0000 7f4ebca00640 1 -- 172.21.15.7:0/1051399946 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb8151dd0 con 0x7f4e9c0047d0 2024-09-13T15:16:08.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.173+0000 7f4eb7e00640 1 --2- 172.21.15.7:0/1051399946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb81eb500 0x7f4eb8151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:16:08.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.173+0000 7f4ebca00640 1 --2- 172.21.15.7:0/1051399946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e9c0047d0 0x7f4eb8154360 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0007d90 tx=0x7f4eb000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:08.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.177+0000 7f4eb4c00640 1 -- 172.21.15.7:0/1051399946 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0014420 con 0x7f4e9c0047d0 2024-09-13T15:16:08.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.177+0000 7f4eb4c00640 1 -- 172.21.15.7:0/1051399946 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb00145a0 con 0x7f4e9c0047d0 2024-09-13T15:16:08.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.177+0000 7f4eb4c00640 1 -- 172.21.15.7:0/1051399946 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0014950 con 0x7f4e9c0047d0 2024-09-13T15:16:08.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.177+0000 7f4ebf400640 1 -- 172.21.15.7:0/1051399946 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb81520b0 con 0x7f4e9c0047d0 2024-09-13T15:16:08.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.177+0000 7f4ebf400640 1 -- 172.21.15.7:0/1051399946 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb81eaa20 con 0x7f4e9c0047d0 2024-09-13T15:16:08.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.181+0000 7f4eae000640 1 -- 172.21.15.7:0/1051399946 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8c005260 con 0x7f4e9c0047d0 2024-09-13T15:16:08.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.185+0000 7f4eb4c00640 1 -- 172.21.15.7:0/1051399946 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4eb0014ab0 con 0x7f4e9c0047d0 2024-09-13T15:16:08.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.193+0000 7f4eb4c00640 1 --2- 172.21.15.7:0/1051399946 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4e980666c0 0x7f4e98068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:08.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.193+0000 7f4eb4c00640 1 -- 172.21.15.7:0/1051399946 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f4eb0085040 con 0x7f4e9c0047d0 2024-09-13T15:16:08.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.193+0000 7f4eb7e00640 1 --2- 172.21.15.7:0/1051399946 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4e980666c0 0x7f4e98068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:08.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.197+0000 7f4eb4c00640 1 -- 172.21.15.7:0/1051399946 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4eb00b6db0 con 0x7f4e9c0047d0 2024-09-13T15:16:08.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.197+0000 7f4eb7e00640 1 --2- 172.21.15.7:0/1051399946 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4e980666c0 0x7f4e98068b80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40ab000 tx=0x7f4ea40a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.605+0000 7f4eae000640 1 -- 172.21.15.7:0/1051399946 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e8c005a90 con 0x7f4e9c0047d0 2024-09-13T15:16:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.605+0000 7f4eb4c00640 1 -- 172.21.15.7:0/1051399946 <== mon.2 v2:172.21.15.77:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4eb0051cc0 con 0x7f4e9c0047d0 2024-09-13T15:16:08.608 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T15:16:08.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.613+0000 7f4eae000640 1 -- 172.21.15.7:0/1051399946 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4e980666c0 msgr2=0x7f4e98068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:08.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.613+0000 7f4eae000640 1 --2- 172.21.15.7:0/1051399946 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4e980666c0 0x7f4e98068b80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4ea40ab000 tx=0x7f4ea40a7070 comp rx=0 tx=0).stop 2024-09-13T15:16:08.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.613+0000 7f4eae000640 1 -- 172.21.15.7:0/1051399946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e9c0047d0 msgr2=0x7f4eb8154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:08.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.613+0000 7f4eae000640 1 --2- 172.21.15.7:0/1051399946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e9c0047d0 0x7f4eb8154360 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0007d90 tx=0x7f4eb000e4b0 comp rx=0 tx=0).stop 2024-09-13T15:16:08.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.617+0000 7f4eae000640 1 -- 172.21.15.7:0/1051399946 shutdown_connections 2024-09-13T15:16:08.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.617+0000 7f4eae000640 1 --2- 172.21.15.7:0/1051399946 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4e980666c0 0x7f4e98068b80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:08.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.617+0000 7f4eae000640 1 --2- 172.21.15.7:0/1051399946 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4eb81488c0 0x7f4eb8152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:08.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.617+0000 7f4eae000640 1 --2- 172.21.15.7:0/1051399946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4eb81eb500 0x7f4eb8151740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:08.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.617+0000 7f4eae000640 1 --2- 172.21.15.7:0/1051399946 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4e9c0047d0 0x7f4eb8154360 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:08.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.617+0000 7f4eae000640 1 -- 172.21.15.7:0/1051399946 >> 172.21.15.7:0/1051399946 conn(0x7f4eb8065d40 msgr2=0x7f4eb8149190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:08.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.617+0000 7f4eae000640 1 -- 172.21.15.7:0/1051399946 shutdown_connections 2024-09-13T15:16:08.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:08.617+0000 7f4eae000640 1 -- 172.21.15.7:0/1051399946 wait complete. 2024-09-13T15:16:08.695 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T15:16:09.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.173+0000 7f5ee7e00640 1 Processor -- start 2024-09-13T15:16:09.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.173+0000 7f5ee7e00640 1 -- start start 2024-09-13T15:16:09.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.173+0000 7f5ee7e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5ee8152ec0 0x7f5ee8159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:09.174 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.173+0000 7f5ee7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ee81532a0 0x7f5ee8071320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.173+0000 7f5ee7e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee8159d60 con 0x7f5ee80cbe90 2024-09-13T15:16:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.173+0000 7f5ee7e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee815c390 con 0x7f5ee8152ec0 2024-09-13T15:16:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.173+0000 7f5ee7e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80c38f0 con 0x7f5ee81532a0 2024-09-13T15:16:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.173+0000 7f5ee7400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5ee80cbe90 0x7f5ee80c3d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44730/0 (socket says 172.21.15.7:44730) 2024-09-13T15:16:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.173+0000 7f5ee7400640 1 -- 172.21.15.7:0/604188876 learned_addr learned my addr 172.21.15.7:0/604188876 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:16:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.173+0000 7f5ee6000640 1 --2- 172.21.15.7:0/604188876 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ee81532a0 0x7f5ee8071320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:09.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.177+0000 7f5ee6000640 1 -- 172.21.15.7:0/604188876 >> v2:172.21.15.7:3300/0 conn(0x7f5ee8152ec0 msgr2=0x7f5ee8159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:09.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.177+0000 7f5ee6000640 1 --2- 172.21.15.7:0/604188876 >> v2:172.21.15.7:3300/0 conn(0x7f5ee8152ec0 0x7f5ee8159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.177+0000 7f5ee6000640 1 -- 172.21.15.7:0/604188876 >> v1:172.21.15.7:6789/0 conn(0x7f5ee80cbe90 legacy=0x7f5ee80c3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:09.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.177+0000 7f5ee6000640 1 -- 172.21.15.7:0/604188876 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee815c5e0 con 0x7f5ee81532a0 2024-09-13T15:16:09.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.181+0000 7f5ee6000640 1 --2- 172.21.15.7:0/604188876 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ee81532a0 0x7f5ee8071320 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40097c0 tx=0x7f5ed401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50dc01d07487914f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:09.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.181+0000 7f5ee5600640 1 -- 172.21.15.7:0/604188876 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed40a8990 con 0x7f5ee81532a0 2024-09-13T15:16:09.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.181+0000 7f5ee5600640 1 -- 172.21.15.7:0/604188876 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed40a8af0 con 0x7f5ee81532a0 2024-09-13T15:16:09.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.181+0000 7f5ee5600640 1 -- 172.21.15.7:0/604188876 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed40a8e80 con 0x7f5ee81532a0 2024-09-13T15:16:09.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.181+0000 7f5ee7e00640 1 -- 172.21.15.7:0/604188876 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ee81532a0 msgr2=0x7f5ee8071320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:09.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.181+0000 7f5ee7e00640 1 --2- 172.21.15.7:0/604188876 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ee81532a0 0x7f5ee8071320 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40097c0 tx=0x7f5ed401ec90 comp rx=0 tx=0).stop 2024-09-13T15:16:09.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.181+0000 7f5ee7e00640 1 -- 172.21.15.7:0/604188876 shutdown_connections 2024-09-13T15:16:09.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.181+0000 7f5ee7e00640 1 --2- 172.21.15.7:0/604188876 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ee81532a0 0x7f5ee8071320 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.181+0000 7f5ee7e00640 1 --2- 172.21.15.7:0/604188876 >> v2:172.21.15.7:3300/0 conn(0x7f5ee8152ec0 0x7f5ee8159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.181+0000 7f5ee7e00640 1 -- 172.21.15.7:0/604188876 >> 172.21.15.7:0/604188876 conn(0x7f5ee806b1b0 msgr2=0x7f5ee806b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:09.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.181+0000 7f5ee7e00640 1 -- 172.21.15.7:0/604188876 shutdown_connections 2024-09-13T15:16:09.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.181+0000 7f5ee7e00640 1 -- 172.21.15.7:0/604188876 wait complete. 2024-09-13T15:16:09.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee7e00640 1 Processor -- start 2024-09-13T15:16:09.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee7e00640 1 -- start start 2024-09-13T15:16:09.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee7e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ee80cbe90 0x7f5ee81f33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:09.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ee8152ec0 0x7f5ee81e46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:09.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee7e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ee81532a0 0x7f5ee81e4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:09.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee7e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee81e3fe0 con 0x7f5ee8152ec0 2024-09-13T15:16:09.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee7e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee80cc7f0 con 0x7f5ee80cbe90 2024-09-13T15:16:09.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee7e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee81e2280 con 0x7f5ee81532a0 2024-09-13T15:16:09.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ee8152ec0 0x7f5ee81e46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:09.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee6000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ee8152ec0 0x7f5ee81e46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45780/0 (socket says 172.21.15.7:45780) 2024-09-13T15:16:09.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee6000640 1 -- 172.21.15.7:0/1204802022 learned_addr learned my addr 172.21.15.7:0/1204802022 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:09.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee6a00640 1 --2- 172.21.15.7:0/1204802022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ee80cbe90 0x7f5ee81f33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:09.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee7400640 1 --2- 172.21.15.7:0/1204802022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ee81532a0 0x7f5ee81e4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:09.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee6000640 1 -- 172.21.15.7:0/1204802022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ee81532a0 msgr2=0x7f5ee81e4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee6000640 1 --2- 172.21.15.7:0/1204802022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ee81532a0 0x7f5ee81e4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee6000640 1 -- 172.21.15.7:0/1204802022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ee80cbe90 msgr2=0x7f5ee81f33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee6000640 1 --2- 172.21.15.7:0/1204802022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ee80cbe90 0x7f5ee81f33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee6000640 1 -- 172.21.15.7:0/1204802022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed4009420 con 0x7f5ee8152ec0 2024-09-13T15:16:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee6000640 1 --2- 172.21.15.7:0/1204802022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ee8152ec0 0x7f5ee81e46c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5ed401c8c0 tx=0x7f5ed401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5edea00640 1 -- 172.21.15.7:0/1204802022 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed40bb640 con 0x7f5ee8152ec0 2024-09-13T15:16:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5edea00640 1 -- 172.21.15.7:0/1204802022 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed40bb7c0 con 0x7f5ee8152ec0 2024-09-13T15:16:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee7e00640 1 -- 172.21.15.7:0/1204802022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee80cca40 con 0x7f5ee8152ec0 2024-09-13T15:16:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5edea00640 1 -- 172.21.15.7:0/1204802022 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed40bbb70 con 0x7f5ee8152ec0 2024-09-13T15:16:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.185+0000 7f5ee7e00640 1 -- 172.21.15.7:0/1204802022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee80cd000 con 0x7f5ee8152ec0 2024-09-13T15:16:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.189+0000 7f5ee7e00640 1 -- 172.21.15.7:0/1204802022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee8067650 con 0x7f5ee8152ec0 2024-09-13T15:16:09.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.189+0000 7f5edea00640 1 -- 172.21.15.7:0/1204802022 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5ed40b7040 con 0x7f5ee8152ec0 2024-09-13T15:16:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.189+0000 7f5edea00640 1 --2- 172.21.15.7:0/1204802022 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5ec8066690 0x7f5ec8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.189+0000 7f5edea00640 1 -- 172.21.15.7:0/1204802022 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f5ed4122a90 con 0x7f5ee8152ec0 2024-09-13T15:16:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.189+0000 7f5ee6a00640 1 --2- 172.21.15.7:0/1204802022 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5ec8066690 0x7f5ec8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:09.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.189+0000 7f5ee6a00640 1 --2- 172.21.15.7:0/1204802022 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5ec8066690 0x7f5ec8068b50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009990 tx=0x7f5ed8009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:09.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.193+0000 7f5edea00640 1 -- 172.21.15.7:0/1204802022 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5ed40ef870 con 0x7f5ee8152ec0 2024-09-13T15:16:09.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.357+0000 7f5ee7e00640 1 -- 172.21.15.7:0/1204802022 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5ee80c9400 con 0x7f5ee8152ec0 2024-09-13T15:16:09.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.357+0000 7f5edea00640 1 -- 172.21.15.7:0/1204802022 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5ed40f2e90 con 0x7f5ee8152ec0 2024-09-13T15:16:09.359 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-13T15:16:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.361+0000 7f5ee7e00640 1 -- 172.21.15.7:0/1204802022 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5ec8066690 msgr2=0x7f5ec8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.361+0000 7f5ee7e00640 1 --2- 172.21.15.7:0/1204802022 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5ec8066690 0x7f5ec8068b50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5ed8009990 tx=0x7f5ed8009110 comp rx=0 tx=0).stop 2024-09-13T15:16:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.361+0000 7f5ee7e00640 1 -- 172.21.15.7:0/1204802022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ee8152ec0 msgr2=0x7f5ee81e46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.361+0000 7f5ee7e00640 1 --2- 172.21.15.7:0/1204802022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ee8152ec0 0x7f5ee81e46c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5ed401c8c0 tx=0x7f5ed401ba30 comp rx=0 tx=0).stop 2024-09-13T15:16:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.361+0000 7f5ee7e00640 1 -- 172.21.15.7:0/1204802022 shutdown_connections 2024-09-13T15:16:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.361+0000 7f5ee7e00640 1 --2- 172.21.15.7:0/1204802022 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5ec8066690 0x7f5ec8068b50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.361+0000 7f5ee7e00640 1 --2- 172.21.15.7:0/1204802022 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5ee81532a0 0x7f5ee81e4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.361+0000 7f5ee7e00640 1 --2- 172.21.15.7:0/1204802022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ee8152ec0 0x7f5ee81e46c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.361+0000 7f5ee7e00640 1 --2- 172.21.15.7:0/1204802022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5ee80cbe90 0x7f5ee81f33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.361+0000 7f5ee7e00640 1 -- 172.21.15.7:0/1204802022 >> 172.21.15.7:0/1204802022 conn(0x7f5ee806b1b0 msgr2=0x7f5ee80ca460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.361+0000 7f5ee7e00640 1 -- 172.21.15.7:0/1204802022 shutdown_connections 2024-09-13T15:16:09.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.361+0000 7f5ee7e00640 1 -- 172.21.15.7:0/1204802022 wait complete. 2024-09-13T15:16:09.382 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-13T15:16:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.709+0000 7f74eb200640 1 Processor -- start 2024-09-13T15:16:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.709+0000 7f74eb200640 1 -- start start 2024-09-13T15:16:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.713+0000 7f74eb200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f74ec06f490 0x7f74ec155980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.713+0000 7f74eb200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74ec06cc50 0x7f74ec14f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.713+0000 7f74eb200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74ec14f690 con 0x7f74ec0c6da0 2024-09-13T15:16:09.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.713+0000 7f74eb200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74ec0c1b30 con 0x7f74ec06f490 2024-09-13T15:16:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.713+0000 7f74eb200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec06dd10 con 0x7f74ec06cc50 2024-09-13T15:16:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.713+0000 7f74e9e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f74ec06f490 0x7f74ec155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.713+0000 7f74e9e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f74ec06f490 0x7f74ec155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:38564/0 (socket says 172.21.15.7:38564) 2024-09-13T15:16:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.713+0000 7f74e9e00640 1 -- 172.21.15.7:0/2412097876 learned_addr learned my addr 172.21.15.7:0/2412097876 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.713+0000 7f74e9400640 1 --2- 172.21.15.7:0/2412097876 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74ec06cc50 0x7f74ec14f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.713+0000 7f74e9e00640 1 -- 172.21.15.7:0/2412097876 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74ec06cc50 msgr2=0x7f74ec14f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.713+0000 7f74e9e00640 1 --2- 172.21.15.7:0/2412097876 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74ec06cc50 0x7f74ec14f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.713+0000 7f74e9e00640 1 -- 172.21.15.7:0/2412097876 >> v1:172.21.15.77:6789/0 conn(0x7f74ec0c6da0 legacy=0x7f74ec0c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:09.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.713+0000 7f74e9e00640 1 -- 172.21.15.7:0/2412097876 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec06d190 con 0x7f74ec06f490 2024-09-13T15:16:09.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.721+0000 7f74e9e00640 1 --2- 172.21.15.7:0/2412097876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec06f490 0x7f74ec155980 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009870 tx=0x7f74d801ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=426cf443f47e70be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:09.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.721+0000 7f74e8a00640 1 -- 172.21.15.7:0/2412097876 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d80a89d0 con 0x7f74ec06f490 2024-09-13T15:16:09.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.721+0000 7f74e8a00640 1 -- 172.21.15.7:0/2412097876 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d80a8b30 con 0x7f74ec06f490 2024-09-13T15:16:09.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.721+0000 7f74e8a00640 1 -- 172.21.15.7:0/2412097876 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d80b0440 con 0x7f74ec06f490 2024-09-13T15:16:09.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.721+0000 7f74eb200640 1 -- 172.21.15.7:0/2412097876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec06f490 msgr2=0x7f74ec155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:09.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.721+0000 7f74eb200640 1 --2- 172.21.15.7:0/2412097876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec06f490 0x7f74ec155980 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009870 tx=0x7f74d801ed10 comp rx=0 tx=0).stop 2024-09-13T15:16:09.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.721+0000 7f74eb200640 1 -- 172.21.15.7:0/2412097876 shutdown_connections 2024-09-13T15:16:09.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.721+0000 7f74eb200640 1 --2- 172.21.15.7:0/2412097876 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74ec06cc50 0x7f74ec14f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.721+0000 7f74eb200640 1 --2- 172.21.15.7:0/2412097876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec06f490 0x7f74ec155980 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.721+0000 7f74eb200640 1 -- 172.21.15.7:0/2412097876 >> 172.21.15.7:0/2412097876 conn(0x7f74ec065d40 msgr2=0x7f74ec066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:09.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.725+0000 7f74eb200640 1 -- 172.21.15.7:0/2412097876 shutdown_connections 2024-09-13T15:16:09.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.725+0000 7f74eb200640 1 -- 172.21.15.7:0/2412097876 wait complete. 2024-09-13T15:16:09.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.725+0000 7f74eb200640 1 Processor -- start 2024-09-13T15:16:09.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.725+0000 7f74eb200640 1 -- start start 2024-09-13T15:16:09.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74eb200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74ec06cc50 0x7f74ec0c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:09.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74eb200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec06f490 0x7f74ec155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:09.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74eb200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec0c6da0 0x7f74ec155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:09.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74eb200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec14ff40 con 0x7f74ec0c6da0 2024-09-13T15:16:09.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74eb200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec1f3820 con 0x7f74ec06f490 2024-09-13T15:16:09.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74eb200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74ec14c000 con 0x7f74ec06cc50 2024-09-13T15:16:09.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74ea800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec0c6da0 0x7f74ec155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:09.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74ea800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec0c6da0 0x7f74ec155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45796/0 (socket says 172.21.15.7:45796) 2024-09-13T15:16:09.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74ea800640 1 -- 172.21.15.7:0/937610130 learned_addr learned my addr 172.21.15.7:0/937610130 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:09.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74e9e00640 1 --2- 172.21.15.7:0/937610130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74ec06cc50 0x7f74ec0c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:09.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74e9400640 1 --2- 172.21.15.7:0/937610130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec06f490 0x7f74ec155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:09.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74ea800640 1 -- 172.21.15.7:0/937610130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74ec06cc50 msgr2=0x7f74ec0c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:09.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74ea800640 1 --2- 172.21.15.7:0/937610130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74ec06cc50 0x7f74ec0c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74ea800640 1 -- 172.21.15.7:0/937610130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec06f490 msgr2=0x7f74ec155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:09.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74ea800640 1 --2- 172.21.15.7:0/937610130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec06f490 0x7f74ec155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74ea800640 1 -- 172.21.15.7:0/937610130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d80094d0 con 0x7f74ec0c6da0 2024-09-13T15:16:09.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74ea800640 1 --2- 172.21.15.7:0/937610130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec0c6da0 0x7f74ec155990 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f74e400b970 tx=0x7f74e400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:09.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74e2000640 1 -- 172.21.15.7:0/937610130 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e400cb40 con 0x7f74ec0c6da0 2024-09-13T15:16:09.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74e2000640 1 -- 172.21.15.7:0/937610130 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e400cca0 con 0x7f74ec0c6da0 2024-09-13T15:16:09.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74eb200640 1 -- 172.21.15.7:0/937610130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ec14c2a0 con 0x7f74ec0c6da0 2024-09-13T15:16:09.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74e2000640 1 -- 172.21.15.7:0/937610130 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4014680 con 0x7f74ec0c6da0 2024-09-13T15:16:09.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74eb200640 1 -- 172.21.15.7:0/937610130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74ec14c860 con 0x7f74ec0c6da0 2024-09-13T15:16:09.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74eb200640 1 -- 172.21.15.7:0/937610130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74ec14f150 con 0x7f74ec0c6da0 2024-09-13T15:16:09.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.729+0000 7f74e2000640 1 -- 172.21.15.7:0/937610130 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f74e401d3b0 con 0x7f74ec0c6da0 2024-09-13T15:16:09.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.733+0000 7f74e2000640 1 --2- 172.21.15.7:0/937610130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f74cc066690 0x7f74cc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:09.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.733+0000 7f74e2000640 1 -- 172.21.15.7:0/937610130 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f74e4084690 con 0x7f74ec0c6da0 2024-09-13T15:16:09.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.733+0000 7f74e9e00640 1 --2- 172.21.15.7:0/937610130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f74cc066690 0x7f74cc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:09.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.733+0000 7f74e9e00640 1 --2- 172.21.15.7:0/937610130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f74cc066690 0x7f74cc068b50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f74d80b2000 tx=0x7f74d8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:09.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.737+0000 7f74e2000640 1 -- 172.21.15.7:0/937610130 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f74e4051340 con 0x7f74ec0c6da0 2024-09-13T15:16:09.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.901+0000 7f74eb200640 1 -- 172.21.15.7:0/937610130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f74ec0c9480 con 0x7f74ec0c6da0 2024-09-13T15:16:09.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.901+0000 7f74e2000640 1 -- 172.21.15.7:0/937610130 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v33) v1 ==== 103+0+11 (secure 0 0 0) 0x7f74e4054960 con 0x7f74ec0c6da0 2024-09-13T15:16:09.901 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-13T15:16:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.905+0000 7f74eb200640 1 -- 172.21.15.7:0/937610130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f74cc066690 msgr2=0x7f74cc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.905+0000 7f74eb200640 1 --2- 172.21.15.7:0/937610130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f74cc066690 0x7f74cc068b50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f74d80b2000 tx=0x7f74d8009040 comp rx=0 tx=0).stop 2024-09-13T15:16:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.905+0000 7f74eb200640 1 -- 172.21.15.7:0/937610130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec0c6da0 msgr2=0x7f74ec155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.905+0000 7f74eb200640 1 --2- 172.21.15.7:0/937610130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec0c6da0 0x7f74ec155990 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f74e400b970 tx=0x7f74e400be30 comp rx=0 tx=0).stop 2024-09-13T15:16:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.905+0000 7f74eb200640 1 -- 172.21.15.7:0/937610130 shutdown_connections 2024-09-13T15:16:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.905+0000 7f74eb200640 1 --2- 172.21.15.7:0/937610130 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f74cc066690 0x7f74cc068b50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.905+0000 7f74eb200640 1 --2- 172.21.15.7:0/937610130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74ec0c6da0 0x7f74ec155990 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.905+0000 7f74eb200640 1 --2- 172.21.15.7:0/937610130 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec06f490 0x7f74ec155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.905+0000 7f74eb200640 1 --2- 172.21.15.7:0/937610130 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f74ec06cc50 0x7f74ec0c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.905+0000 7f74eb200640 1 -- 172.21.15.7:0/937610130 >> 172.21.15.7:0/937610130 conn(0x7f74ec065d40 msgr2=0x7f74ec0c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.905+0000 7f74eb200640 1 -- 172.21.15.7:0/937610130 shutdown_connections 2024-09-13T15:16:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:09.905+0000 7f74eb200640 1 -- 172.21.15.7:0/937610130 wait complete. 2024-09-13T15:16:09.925 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T15:16:10.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.069+0000 7efc54a00640 1 Processor -- start 2024-09-13T15:16:10.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.069+0000 7efc54a00640 1 -- start start 2024-09-13T15:16:10.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.069+0000 7efc54a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efc500b0110 0x7efc50158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:10.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.069+0000 7efc54a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc500c7660 0x7efc50163720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:10.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.069+0000 7efc54a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc500c71d0 con 0x7efc500c6600 2024-09-13T15:16:10.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.069+0000 7efc54a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc50153630 con 0x7efc500b0110 2024-09-13T15:16:10.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.069+0000 7efc54a00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc500c80b0 con 0x7efc500c7660 2024-09-13T15:16:10.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.069+0000 7efc4f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efc500b0110 0x7efc50158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:10.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.073+0000 7efc4f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7efc500b0110 0x7efc50158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45812/0 (socket says 172.21.15.7:45812) 2024-09-13T15:16:10.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.073+0000 7efc4f400640 1 -- 172.21.15.7:0/103063822 learned_addr learned my addr 172.21.15.7:0/103063822 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:10.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.073+0000 7efc4fe00640 1 --2- 172.21.15.7:0/103063822 >> v2:172.21.15.77:3300/0 conn(0x7efc500c7660 0x7efc50163720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:10.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.073+0000 7efc4f400640 1 -- 172.21.15.7:0/103063822 >> v2:172.21.15.77:3300/0 conn(0x7efc500c7660 msgr2=0x7efc50163720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:10.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.073+0000 7efc4f400640 1 --2- 172.21.15.7:0/103063822 >> v2:172.21.15.77:3300/0 conn(0x7efc500c7660 0x7efc50163720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:10.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.073+0000 7efc4f400640 1 -- 172.21.15.7:0/103063822 >> v1:172.21.15.7:6789/0 conn(0x7efc500c6600 legacy=0x7efc500c0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:10.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.073+0000 7efc4f400640 1 -- 172.21.15.7:0/103063822 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc50159360 con 0x7efc500b0110 2024-09-13T15:16:10.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.073+0000 7efc4f400640 1 --2- 172.21.15.7:0/103063822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc500b0110 0x7efc50158e20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7efc5006d230 tx=0x7efc4001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03a3d9f1e60de81 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.073+0000 7efc4ea00640 1 -- 172.21.15.7:0/103063822 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc400a8a10 con 0x7efc500b0110 2024-09-13T15:16:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.073+0000 7efc4ea00640 1 -- 172.21.15.7:0/103063822 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc400a8b70 con 0x7efc500b0110 2024-09-13T15:16:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.073+0000 7efc4ea00640 1 -- 172.21.15.7:0/103063822 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc400b0440 con 0x7efc500b0110 2024-09-13T15:16:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc54a00640 1 -- 172.21.15.7:0/103063822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc500b0110 msgr2=0x7efc50158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc54a00640 1 --2- 172.21.15.7:0/103063822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc500b0110 0x7efc50158e20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7efc5006d230 tx=0x7efc4001ed10 comp rx=0 tx=0).stop 2024-09-13T15:16:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc54a00640 1 -- 172.21.15.7:0/103063822 shutdown_connections 2024-09-13T15:16:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc54a00640 1 --2- 172.21.15.7:0/103063822 >> v2:172.21.15.77:3300/0 conn(0x7efc500c7660 0x7efc50163720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc54a00640 1 --2- 172.21.15.7:0/103063822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc500b0110 0x7efc50158e20 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc54a00640 1 -- 172.21.15.7:0/103063822 >> 172.21.15.7:0/103063822 conn(0x7efc5006dad0 msgr2=0x7efc5006dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc54a00640 1 -- 172.21.15.7:0/103063822 shutdown_connections 2024-09-13T15:16:10.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc54a00640 1 -- 172.21.15.7:0/103063822 wait complete. 2024-09-13T15:16:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc54a00640 1 Processor -- start 2024-09-13T15:16:10.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc54a00640 1 -- start start 2024-09-13T15:16:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc54a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc500b0110 0x7efc50156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc54a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc500c6600 0x7efc50157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc54a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc500c7660 0x7efc501efbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc54a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc50070ee0 con 0x7efc500b0110 2024-09-13T15:16:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc54a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc500717f0 con 0x7efc500c7660 2024-09-13T15:16:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc54a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc50071a90 con 0x7efc500c6600 2024-09-13T15:16:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc4f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc500b0110 0x7efc50156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:10.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc4f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc500b0110 0x7efc50156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45816/0 (socket says 172.21.15.7:45816) 2024-09-13T15:16:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc4f400640 1 -- 172.21.15.7:0/4118338720 learned_addr learned my addr 172.21.15.7:0/4118338720 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc4fe00640 1 --2- 172.21.15.7:0/4118338720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc500c7660 0x7efc501efbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc47e00640 1 --2- 172.21.15.7:0/4118338720 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc500c6600 0x7efc50157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc4f400640 1 -- 172.21.15.7:0/4118338720 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc500c6600 msgr2=0x7efc50157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc4f400640 1 --2- 172.21.15.7:0/4118338720 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc500c6600 0x7efc50157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc4f400640 1 -- 172.21.15.7:0/4118338720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc500c7660 msgr2=0x7efc501efbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc4f400640 1 --2- 172.21.15.7:0/4118338720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc500c7660 0x7efc501efbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc4f400640 1 -- 172.21.15.7:0/4118338720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc400094d0 con 0x7efc500b0110 2024-09-13T15:16:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc47e00640 1 --2- 172.21.15.7:0/4118338720 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc500c6600 0x7efc50157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:16:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.077+0000 7efc4f400640 1 --2- 172.21.15.7:0/4118338720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc500b0110 0x7efc50156270 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7efc4001b920 tx=0x7efc4001bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.081+0000 7efc47400640 1 -- 172.21.15.7:0/4118338720 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc400ba600 con 0x7efc500b0110 2024-09-13T15:16:10.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.081+0000 7efc47400640 1 -- 172.21.15.7:0/4118338720 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc400ba760 con 0x7efc500b0110 2024-09-13T15:16:10.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.081+0000 7efc47400640 1 -- 172.21.15.7:0/4118338720 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc400bab10 con 0x7efc500b0110 2024-09-13T15:16:10.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.081+0000 7efc54a00640 1 -- 172.21.15.7:0/4118338720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc50070540 con 0x7efc500b0110 2024-09-13T15:16:10.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.081+0000 7efc54a00640 1 -- 172.21.15.7:0/4118338720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc50070b00 con 0x7efc500b0110 2024-09-13T15:16:10.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.081+0000 7efc54a00640 1 -- 172.21.15.7:0/4118338720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc500c6120 con 0x7efc500b0110 2024-09-13T15:16:10.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.081+0000 7efc47400640 1 -- 172.21.15.7:0/4118338720 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efc400bac70 con 0x7efc500b0110 2024-09-13T15:16:10.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.081+0000 7efc47400640 1 --2- 172.21.15.7:0/4118338720 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efc2c066690 0x7efc2c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:10.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.081+0000 7efc47400640 1 -- 172.21.15.7:0/4118338720 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7efc40122e00 con 0x7efc500b0110 2024-09-13T15:16:10.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.081+0000 7efc47e00640 1 --2- 172.21.15.7:0/4118338720 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efc2c066690 0x7efc2c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:10.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.085+0000 7efc47e00640 1 --2- 172.21.15.7:0/4118338720 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efc2c066690 0x7efc2c068b50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efc5006c070 tx=0x7efc38009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:10.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.089+0000 7efc47400640 1 -- 172.21.15.7:0/4118338720 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7efc400efba0 con 0x7efc500b0110 2024-09-13T15:16:10.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.409+0000 7efc54a00640 1 -- 172.21.15.7:0/4118338720 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efc500c6120 con 0x7efc500b0110 2024-09-13T15:16:10.417 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6836/2396967179 2024-09-14T15:15:27.857855+0000 2024-09-13T15:16:10.417 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6834/2396967179 2024-09-14T15:15:27.857855+0000 2024-09-13T15:16:10.417 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.77:6839/2233000674 2024-09-14T15:13:27.782565+0000 2024-09-13T15:16:10.417 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.77:6837/2233000674 2024-09-14T15:13:27.782565+0000 2024-09-13T15:16:10.417 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.77:6835/2367107997 2024-09-14T15:11:57.741130+0000 2024-09-13T15:16:10.417 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6837/3369648543 2024-09-14T15:09:52.666380+0000 2024-09-13T15:16:10.417 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6835/3369648543 2024-09-14T15:09:52.666380+0000 2024-09-13T15:16:10.417 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.77:6838/3330080895 2024-09-14T15:07:12.613134+0000 2024-09-13T15:16:10.418 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.77:6836/3330080895 2024-09-14T15:07:12.613134+0000 2024-09-13T15:16:10.418 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.77:6834/2367107997 2024-09-14T15:11:57.741130+0000 2024-09-13T15:16:10.418 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6833/2907495549 2024-09-14T15:05:07.589499+0000 2024-09-13T15:16:10.418 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6832/2907495549 2024-09-14T15:05:07.589499+0000 2024-09-13T15:16:10.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.417+0000 7efc47400640 1 -- 172.21.15.7:0/4118338720 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 12 entries v33) v1 ==== 81+0+726 (secure 0 0 0) 0x7efc400b5070 con 0x7efc500b0110 2024-09-13T15:16:10.418 INFO:teuthology.orchestra.run.smithi007.stderr:listed 12 entries 2024-09-13T15:16:10.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.421+0000 7efc54a00640 1 -- 172.21.15.7:0/4118338720 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efc2c066690 msgr2=0x7efc2c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:10.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.421+0000 7efc54a00640 1 --2- 172.21.15.7:0/4118338720 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efc2c066690 0x7efc2c068b50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efc5006c070 tx=0x7efc38009040 comp rx=0 tx=0).stop 2024-09-13T15:16:10.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.421+0000 7efc54a00640 1 -- 172.21.15.7:0/4118338720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc500b0110 msgr2=0x7efc50156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:10.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.421+0000 7efc54a00640 1 --2- 172.21.15.7:0/4118338720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc500b0110 0x7efc50156270 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7efc4001b920 tx=0x7efc4001bab0 comp rx=0 tx=0).stop 2024-09-13T15:16:10.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.421+0000 7efc54a00640 1 -- 172.21.15.7:0/4118338720 shutdown_connections 2024-09-13T15:16:10.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.421+0000 7efc54a00640 1 --2- 172.21.15.7:0/4118338720 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7efc2c066690 0x7efc2c068b50 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efc5006c070 tx=0x7efc38009040 comp rx=0 tx=0).stop 2024-09-13T15:16:10.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.421+0000 7efc54a00640 1 --2- 172.21.15.7:0/4118338720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc500c7660 0x7efc501efbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:10.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.421+0000 7efc54a00640 1 --2- 172.21.15.7:0/4118338720 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7efc500c6600 0x7efc50157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:10.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.421+0000 7efc54a00640 1 --2- 172.21.15.7:0/4118338720 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efc500b0110 0x7efc50156270 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:10.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.421+0000 7efc54a00640 1 -- 172.21.15.7:0/4118338720 >> 172.21.15.7:0/4118338720 conn(0x7efc5006dad0 msgr2=0x7efc500c9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:10.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.421+0000 7efc54a00640 1 -- 172.21.15.7:0/4118338720 shutdown_connections 2024-09-13T15:16:10.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:10.421+0000 7efc54a00640 1 -- 172.21.15.7:0/4118338720 wait complete. 2024-09-13T15:16:10.482 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T15:16:10.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:16:10.482 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T15:16:10.684 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T15:16:10.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:16:10.684 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T15:16:10.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:16:10.783 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-13T15:16:10.992 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T15:16:10.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:16:10.993 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T15:16:11.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T15:16:11.021 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-09-13T15:16:11.721 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T15:16:11.731 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T15:16:11.731 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:16:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.873+0000 7f0504c00640 1 Processor -- start 2024-09-13T15:16:11.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.873+0000 7f0504c00640 1 -- start start 2024-09-13T15:16:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.873+0000 7f0504c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f0500150f40 0x7f05001579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.873+0000 7f0504c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f050015f900 0x7f0500161cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.873+0000 7f0504c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05000c5d30 con 0x7f0500158480 2024-09-13T15:16:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.873+0000 7f0504c00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0500156f90 con 0x7f050015f900 2024-09-13T15:16:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.873+0000 7f0504c00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0500157510 con 0x7f0500150f40 2024-09-13T15:16:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.873+0000 7f04fe800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f050015f900 0x7f0500161cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.877+0000 7f04fe800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f050015f900 0x7f0500161cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45832/0 (socket says 172.21.15.7:45832) 2024-09-13T15:16:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.877+0000 7f04fe800640 1 -- 172.21.15.7:0/1778360105 learned_addr learned my addr 172.21.15.7:0/1778360105 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:11.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.877+0000 7f04fde00640 1 --2- 172.21.15.7:0/1778360105 >> v2:172.21.15.77:3300/0 conn(0x7f0500150f40 0x7f05001579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.877+0000 7f04fe800640 1 -- 172.21.15.7:0/1778360105 >> v2:172.21.15.77:3300/0 conn(0x7f0500150f40 msgr2=0x7f05001579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.877+0000 7f04fe800640 1 --2- 172.21.15.7:0/1778360105 >> v2:172.21.15.77:3300/0 conn(0x7f0500150f40 0x7f05001579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.877+0000 7f04fe800640 1 -- 172.21.15.7:0/1778360105 >> v1:172.21.15.77:6789/0 conn(0x7f0500158480 legacy=0x7f0500066180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:11.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.877+0000 7f04fe800640 1 -- 172.21.15.7:0/1778360105 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05000c5490 con 0x7f050015f900 2024-09-13T15:16:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.881+0000 7f04fe800640 1 --2- 172.21.15.7:0/1778360105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050015f900 0x7f0500161cf0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f05000c9720 tx=0x7f04f801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47026d76c50c73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.881+0000 7f04fd400640 1 -- 172.21.15.7:0/1778360105 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80a5880 con 0x7f050015f900 2024-09-13T15:16:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.881+0000 7f04fd400640 1 -- 172.21.15.7:0/1778360105 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f80a59e0 con 0x7f050015f900 2024-09-13T15:16:11.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.881+0000 7f04fd400640 1 -- 172.21.15.7:0/1778360105 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80a5d70 con 0x7f050015f900 2024-09-13T15:16:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.881+0000 7f0504c00640 1 -- 172.21.15.7:0/1778360105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050015f900 msgr2=0x7f0500161cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:11.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.881+0000 7f0504c00640 1 --2- 172.21.15.7:0/1778360105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050015f900 0x7f0500161cf0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f05000c9720 tx=0x7f04f801c9c0 comp rx=0 tx=0).stop 2024-09-13T15:16:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.881+0000 7f0504c00640 1 -- 172.21.15.7:0/1778360105 shutdown_connections 2024-09-13T15:16:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.881+0000 7f0504c00640 1 --2- 172.21.15.7:0/1778360105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f050015f900 0x7f0500161cf0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.881+0000 7f0504c00640 1 --2- 172.21.15.7:0/1778360105 >> v2:172.21.15.77:3300/0 conn(0x7f0500150f40 0x7f05001579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.881+0000 7f0504c00640 1 -- 172.21.15.7:0/1778360105 >> 172.21.15.7:0/1778360105 conn(0x7f050006e110 msgr2=0x7f050006e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.881+0000 7f0504c00640 1 -- 172.21.15.7:0/1778360105 shutdown_connections 2024-09-13T15:16:11.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.881+0000 7f0504c00640 1 -- 172.21.15.7:0/1778360105 wait complete. 2024-09-13T15:16:11.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f0504c00640 1 Processor -- start 2024-09-13T15:16:11.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f0504c00640 1 -- start start 2024-09-13T15:16:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f0504c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0500150f40 0x7f050014c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f0504c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0500158480 0x7f05001500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f0504c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050015f900 0x7f050014e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f0504c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050013fdd0 con 0x7f0500158480 2024-09-13T15:16:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f0504c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050014b870 con 0x7f050015f900 2024-09-13T15:16:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f0504c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050014b1f0 con 0x7f0500150f40 2024-09-13T15:16:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f04f5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0500158480 0x7f05001500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f04f5400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0500158480 0x7f05001500c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45840/0 (socket says 172.21.15.7:45840) 2024-09-13T15:16:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f04f5400640 1 -- 172.21.15.7:0/3400940199 learned_addr learned my addr 172.21.15.7:0/3400940199 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f04fde00640 1 --2- 172.21.15.7:0/3400940199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0500150f40 0x7f050014c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f04fe800640 1 --2- 172.21.15.7:0/3400940199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050015f900 0x7f050014e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:11.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f04f5400640 1 -- 172.21.15.7:0/3400940199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0500150f40 msgr2=0x7f050014c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:11.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f04f5400640 1 --2- 172.21.15.7:0/3400940199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0500150f40 0x7f050014c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:11.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f04f5400640 1 -- 172.21.15.7:0/3400940199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050015f900 msgr2=0x7f050014e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:11.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f04f5400640 1 --2- 172.21.15.7:0/3400940199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050015f900 0x7f050014e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:11.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f04f5400640 1 -- 172.21.15.7:0/3400940199 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f8009b30 con 0x7f0500158480 2024-09-13T15:16:11.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f04fe800640 1 --2- 172.21.15.7:0/3400940199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050015f900 0x7f050014e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:16:11.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f04fde00640 1 --2- 172.21.15.7:0/3400940199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0500150f40 0x7f050014c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:16:11.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f04f5400640 1 --2- 172.21.15.7:0/3400940199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0500158480 0x7f05001500c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f04e800c500 tx=0x7f04e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:11.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f04f6a00640 1 -- 172.21.15.7:0/3400940199 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8005220 con 0x7f0500158480 2024-09-13T15:16:11.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f04f6a00640 1 -- 172.21.15.7:0/3400940199 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e8005380 con 0x7f0500158480 2024-09-13T15:16:11.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f04f6a00640 1 -- 172.21.15.7:0/3400940199 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8007270 con 0x7f0500158480 2024-09-13T15:16:11.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f0504c00640 1 -- 172.21.15.7:0/3400940199 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0500149a30 con 0x7f0500158480 2024-09-13T15:16:11.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.885+0000 7f0504c00640 1 -- 172.21.15.7:0/3400940199 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0500145300 con 0x7f0500158480 2024-09-13T15:16:11.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.889+0000 7f0504c00640 1 -- 172.21.15.7:0/3400940199 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f050014e770 con 0x7f0500158480 2024-09-13T15:16:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.889+0000 7f04f6a00640 1 -- 172.21.15.7:0/3400940199 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f04e80073d0 con 0x7f0500158480 2024-09-13T15:16:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.889+0000 7f04f6a00640 1 --2- 172.21.15.7:0/3400940199 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f04dc066690 0x7f04dc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.889+0000 7f04f6a00640 1 -- 172.21.15.7:0/3400940199 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f04e8083f20 con 0x7f0500158480 2024-09-13T15:16:11.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.889+0000 7f04fde00640 1 --2- 172.21.15.7:0/3400940199 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f04dc066690 0x7f04dc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:11.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.889+0000 7f04fde00640 1 --2- 172.21.15.7:0/3400940199 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f04dc066690 0x7f04dc068b50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009b10 tx=0x7f04f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:11.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:11.893+0000 7f04f6a00640 1 -- 172.21.15.7:0/3400940199 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f04e8050c40 con 0x7f0500158480 2024-09-13T15:16:12.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.053+0000 7f0504c00640 1 -- 172.21.15.7:0/3400940199 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0500157ee0 con 0x7f04dc066690 2024-09-13T15:16:12.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.085+0000 7f04f6a00640 1 -- 172.21.15.7:0/3400940199 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370419 (secure 0 0 0) 0x7f04f00119d0 con 0x7f04dc066690 2024-09-13T15:16:12.088 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:16:12.091 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T15:16:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.089+0000 7f0504c00640 1 -- 172.21.15.7:0/3400940199 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f04dc066690 msgr2=0x7f04dc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:12.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.089+0000 7f0504c00640 1 --2- 172.21.15.7:0/3400940199 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f04dc066690 0x7f04dc068b50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f04f0009b10 tx=0x7f04f0008040 comp rx=0 tx=0).stop 2024-09-13T15:16:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.089+0000 7f0504c00640 1 -- 172.21.15.7:0/3400940199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0500158480 msgr2=0x7f05001500c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.089+0000 7f0504c00640 1 --2- 172.21.15.7:0/3400940199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0500158480 0x7f05001500c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f04e800c500 tx=0x7f04e800c9c0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.089+0000 7f0504c00640 1 -- 172.21.15.7:0/3400940199 shutdown_connections 2024-09-13T15:16:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.089+0000 7f0504c00640 1 --2- 172.21.15.7:0/3400940199 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f04dc066690 0x7f04dc068b50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.089+0000 7f0504c00640 1 --2- 172.21.15.7:0/3400940199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f050015f900 0x7f050014e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.089+0000 7f0504c00640 1 --2- 172.21.15.7:0/3400940199 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0500158480 0x7f05001500c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.089+0000 7f0504c00640 1 --2- 172.21.15.7:0/3400940199 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f0500150f40 0x7f050014c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.089+0000 7f0504c00640 1 -- 172.21.15.7:0/3400940199 >> 172.21.15.7:0/3400940199 conn(0x7f050006e110 msgr2=0x7f0500149ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.089+0000 7f0504c00640 1 -- 172.21.15.7:0/3400940199 shutdown_connections 2024-09-13T15:16:12.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.089+0000 7f0504c00640 1 -- 172.21.15.7:0/3400940199 wait complete. 2024-09-13T15:16:12.111 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":462,"stamp":"2024-09-13T15:16:10.948073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6092974517,"num_objects":1747,"num_object_clones":0,"num_object_copies":6718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1747,"num_whiteouts":0,"num_read":617,"num_read_kb":111053,"num_write":2172927,"num_write_kb":31188650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":74,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151332,"ondisk_log_size":151332,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":20759152,"kb_used_data":12222768,"kb_used_omap":12,"kb_used_meta":8519923,"kb_avail":734215568,"statfs":{"total":773094113280,"available":751836741632,"internally_reserved":0,"allocated":12516114432,"data_stored":12514263668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":8724401720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,2,4,1,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":69,"apply_latency_ms":69,"commit_latency_ns":69000000,"apply_latency_ns":69000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1946130063,"num_objects":-464,"num_object_clones":0,"num_object_copies":-1856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-464,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":491,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004787"},"pg_stats":[{"pgid":"2.1f","version":"31'35","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:32.892911+0000","last_change":"2024-09-13T15:01:44.418856+0000","last_active":"2024-09-13T15:15:32.892911+0000","last_peered":"2024-09-13T15:15:32.892911+0000","last_clean":"2024-09-13T15:15:32.892911+0000","last_became_active":"2024-09-13T15:01:44.418641+0000","last_became_peered":"2024-09-13T15:01:44.418641+0000","last_unstale":"2024-09-13T15:15:32.892911+0000","last_undegraded":"2024-09-13T15:15:32.892911+0000","last_fullsized":"2024-09-13T15:15:32.892911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:40.178824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":25,"num_read_kb":4120,"num_write":35,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.390297+0000","last_change":"2024-09-13T15:01:44.809371+0000","last_active":"2024-09-13T15:15:28.390297+0000","last_peered":"2024-09-13T15:15:28.390297+0000","last_clean":"2024-09-13T15:15:28.390297+0000","last_became_active":"2024-09-13T15:01:44.809091+0000","last_became_peered":"2024-09-13T15:01:44.809091+0000","last_unstale":"2024-09-13T15:15:28.390297+0000","last_undegraded":"2024-09-13T15:15:28.390297+0000","last_fullsized":"2024-09-13T15:15:28.390297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:22.412025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'4441","reported_seq":4466,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:09.585365+0000","last_change":"2024-09-13T15:01:48.910757+0000","last_active":"2024-09-13T15:16:09.585365+0000","last_peered":"2024-09-13T15:16:09.585365+0000","last_clean":"2024-09-13T15:16:09.585365+0000","last_became_active":"2024-09-13T15:01:48.910262+0000","last_became_peered":"2024-09-13T15:01:48.910262+0000","last_unstale":"2024-09-13T15:16:09.585365+0000","last_undegraded":"2024-09-13T15:16:09.585365+0000","last_fullsized":"2024-09-13T15:16:09.585365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4441,"log_dups_size":0,"ondisk_log_size":4441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:39.290557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159414246,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65333,"num_write_kb":904330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'21","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:32.891601+0000","last_change":"2024-09-13T15:01:44.404818+0000","last_active":"2024-09-13T15:15:32.891601+0000","last_peered":"2024-09-13T15:15:32.891601+0000","last_clean":"2024-09-13T15:15:32.891601+0000","last_became_active":"2024-09-13T15:01:44.401666+0000","last_became_peered":"2024-09-13T15:01:44.401666+0000","last_unstale":"2024-09-13T15:15:32.891601+0000","last_undegraded":"2024-09-13T15:15:32.891601+0000","last_fullsized":"2024-09-13T15:15:32.891601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:31.818163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":18,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:12.529773+0000","last_change":"2024-09-13T15:01:44.850292+0000","last_active":"2024-09-13T15:14:12.529773+0000","last_peered":"2024-09-13T15:14:12.529773+0000","last_clean":"2024-09-13T15:14:12.529773+0000","last_became_active":"2024-09-13T15:01:44.849825+0000","last_became_peered":"2024-09-13T15:01:44.849825+0000","last_unstale":"2024-09-13T15:14:12.529773+0000","last_undegraded":"2024-09-13T15:14:12.529773+0000","last_fullsized":"2024-09-13T15:14:12.529773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:22.582742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"33'4893","reported_seq":4918,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.587471+0000","last_change":"2024-09-13T15:01:48.850426+0000","last_active":"2024-09-13T15:16:08.587471+0000","last_peered":"2024-09-13T15:16:08.587471+0000","last_clean":"2024-09-13T15:16:08.587471+0000","last_became_active":"2024-09-13T15:01:48.848750+0000","last_became_peered":"2024-09-13T15:01:48.848750+0000","last_unstale":"2024-09-13T15:16:08.587471+0000","last_undegraded":"2024-09-13T15:16:08.587471+0000","last_fullsized":"2024-09-13T15:16:08.587471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4893,"log_dups_size":0,"ondisk_log_size":4893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:55.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188835155,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71627,"num_write_kb":1026932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"33'61","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.125487+0000","last_change":"2024-09-13T15:01:44.437850+0000","last_active":"2024-09-13T15:15:57.125487+0000","last_peered":"2024-09-13T15:15:57.125487+0000","last_clean":"2024-09-13T15:15:57.125487+0000","last_became_active":"2024-09-13T15:01:44.437168+0000","last_became_peered":"2024-09-13T15:01:44.437168+0000","last_unstale":"2024-09-13T15:15:57.125487+0000","last_undegraded":"2024-09-13T15:15:57.125487+0000","last_fullsized":"2024-09-13T15:15:57.125487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:23.540408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":50,"num_read_kb":12337,"num_write":58,"num_write_kb":12312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.869728+0000","last_change":"2024-09-13T15:01:44.845989+0000","last_active":"2024-09-13T15:15:27.869728+0000","last_peered":"2024-09-13T15:15:27.869728+0000","last_clean":"2024-09-13T15:15:27.869728+0000","last_became_active":"2024-09-13T15:01:44.845395+0000","last_became_peered":"2024-09-13T15:01:44.845395+0000","last_unstale":"2024-09-13T15:15:27.869728+0000","last_undegraded":"2024-09-13T15:15:27.869728+0000","last_fullsized":"2024-09-13T15:15:27.869728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:52.267507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4398","reported_seq":4423,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.284312+0000","last_change":"2024-09-13T15:01:48.865388+0000","last_active":"2024-09-13T15:16:07.284312+0000","last_peered":"2024-09-13T15:16:07.284312+0000","last_clean":"2024-09-13T15:16:07.284312+0000","last_became_active":"2024-09-13T15:01:48.864314+0000","last_became_peered":"2024-09-13T15:01:48.864314+0000","last_unstale":"2024-09-13T15:16:07.284312+0000","last_undegraded":"2024-09-13T15:16:07.284312+0000","last_fullsized":"2024-09-13T15:16:07.284312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4398,"log_dups_size":0,"ondisk_log_size":4398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:18.637430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184554492,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64505,"num_write_kb":920306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"30'15","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.086111+0000","last_change":"2024-09-13T15:01:44.424080+0000","last_active":"2024-09-13T15:15:57.086111+0000","last_peered":"2024-09-13T15:15:57.086111+0000","last_clean":"2024-09-13T15:15:57.086111+0000","last_became_active":"2024-09-13T15:01:44.423381+0000","last_became_peered":"2024-09-13T15:01:44.423381+0000","last_unstale":"2024-09-13T15:15:57.086111+0000","last_undegraded":"2024-09-13T15:15:57.086111+0000","last_fullsized":"2024-09-13T15:15:57.086111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:38:20.455380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":4116,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"33'15","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:03.389792+0000","last_change":"2024-09-13T15:01:44.849670+0000","last_active":"2024-09-13T15:16:03.389792+0000","last_peered":"2024-09-13T15:16:03.389792+0000","last_clean":"2024-09-13T15:16:03.389792+0000","last_became_active":"2024-09-13T15:01:44.849038+0000","last_became_peered":"2024-09-13T15:01:44.849038+0000","last_unstale":"2024-09-13T15:16:03.389792+0000","last_undegraded":"2024-09-13T15:16:03.389792+0000","last_fullsized":"2024-09-13T15:16:03.389792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:45.570774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4137","reported_seq":4162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.438214+0000","last_change":"2024-09-13T15:01:48.854953+0000","last_active":"2024-09-13T15:16:07.438214+0000","last_peered":"2024-09-13T15:16:07.438214+0000","last_clean":"2024-09-13T15:16:07.438214+0000","last_became_active":"2024-09-13T15:01:48.853858+0000","last_became_peered":"2024-09-13T15:01:48.853858+0000","last_unstale":"2024-09-13T15:16:07.438214+0000","last_undegraded":"2024-09-13T15:16:07.438214+0000","last_fullsized":"2024-09-13T15:16:07.438214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4137,"log_dups_size":0,"ondisk_log_size":4137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:07.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239130476,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61252,"num_write_kb":864366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.599588+0000","last_change":"2024-09-13T15:01:44.824391+0000","last_active":"2024-09-13T15:15:28.599588+0000","last_peered":"2024-09-13T15:15:28.599588+0000","last_clean":"2024-09-13T15:15:28.599588+0000","last_became_active":"2024-09-13T15:01:44.823690+0000","last_became_peered":"2024-09-13T15:01:44.823690+0000","last_unstale":"2024-09-13T15:15:28.599588+0000","last_undegraded":"2024-09-13T15:15:28.599588+0000","last_fullsized":"2024-09-13T15:15:28.599588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'133","reported_seq":166,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:34.462327+0000","last_change":"2024-09-13T15:01:44.421523+0000","last_active":"2024-09-13T15:15:34.462327+0000","last_peered":"2024-09-13T15:15:34.462327+0000","last_clean":"2024-09-13T15:15:34.462327+0000","last_became_active":"2024-09-13T15:01:44.419965+0000","last_became_peered":"2024-09-13T15:01:44.419965+0000","last_unstale":"2024-09-13T15:15:34.462327+0000","last_undegraded":"2024-09-13T15:15:34.462327+0000","last_fullsized":"2024-09-13T15:15:34.462327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:34.918774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":8200,"num_write":130,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"33'4455","reported_seq":4481,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.390886+0000","last_change":"2024-09-13T15:01:48.850895+0000","last_active":"2024-09-13T15:16:08.390886+0000","last_peered":"2024-09-13T15:16:08.390886+0000","last_clean":"2024-09-13T15:16:08.390886+0000","last_became_active":"2024-09-13T15:01:48.849856+0000","last_became_peered":"2024-09-13T15:01:48.849856+0000","last_unstale":"2024-09-13T15:16:08.390886+0000","last_undegraded":"2024-09-13T15:16:08.390886+0000","last_fullsized":"2024-09-13T15:16:08.390886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4455,"log_dups_size":0,"ondisk_log_size":4455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:59.616442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188825920,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65529,"num_write_kb":929153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389629+0000","last_change":"2024-09-13T15:01:44.806026+0000","last_active":"2024-09-13T15:15:28.389629+0000","last_peered":"2024-09-13T15:15:28.389629+0000","last_clean":"2024-09-13T15:15:28.389629+0000","last_became_active":"2024-09-13T15:01:44.805767+0000","last_became_peered":"2024-09-13T15:01:44.805767+0000","last_unstale":"2024-09-13T15:15:28.389629+0000","last_undegraded":"2024-09-13T15:15:28.389629+0000","last_fullsized":"2024-09-13T15:15:28.389629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:50.696113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'19","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.712356+0000","last_change":"2024-09-13T15:01:44.401897+0000","last_active":"2024-09-13T15:15:28.712356+0000","last_peered":"2024-09-13T15:15:28.712356+0000","last_clean":"2024-09-13T15:15:28.712356+0000","last_became_active":"2024-09-13T15:01:44.401559+0000","last_became_peered":"2024-09-13T15:01:44.401559+0000","last_unstale":"2024-09-13T15:15:28.712356+0000","last_undegraded":"2024-09-13T15:15:28.712356+0000","last_fullsized":"2024-09-13T15:15:28.712356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:58.535567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"33'4692","reported_seq":4718,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.456314+0000","last_change":"2024-09-13T15:01:48.858808+0000","last_active":"2024-09-13T15:16:08.456314+0000","last_peered":"2024-09-13T15:16:08.456314+0000","last_clean":"2024-09-13T15:16:08.456314+0000","last_became_active":"2024-09-13T15:01:48.857802+0000","last_became_peered":"2024-09-13T15:01:48.857802+0000","last_unstale":"2024-09-13T15:16:08.456314+0000","last_undegraded":"2024-09-13T15:16:08.456314+0000","last_fullsized":"2024-09-13T15:16:08.456314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4692,"log_dups_size":0,"ondisk_log_size":4692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:41.628058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209721158,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68966,"num_write_kb":974815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.390542+0000","last_change":"2024-09-13T15:01:44.808674+0000","last_active":"2024-09-13T15:15:28.390542+0000","last_peered":"2024-09-13T15:15:28.390542+0000","last_clean":"2024-09-13T15:15:28.390542+0000","last_became_active":"2024-09-13T15:01:44.808420+0000","last_became_peered":"2024-09-13T15:01:44.808420+0000","last_unstale":"2024-09-13T15:15:28.390542+0000","last_undegraded":"2024-09-13T15:15:28.390542+0000","last_fullsized":"2024-09-13T15:15:28.390542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:33.447973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:15:01.212922+0000","last_change":"2024-09-13T15:01:44.406717+0000","last_active":"2024-09-13T15:15:01.212922+0000","last_peered":"2024-09-13T15:15:01.212922+0000","last_clean":"2024-09-13T15:15:01.212922+0000","last_became_active":"2024-09-13T15:01:44.406354+0000","last_became_peered":"2024-09-13T15:01:44.406354+0000","last_unstale":"2024-09-13T15:15:01.212922+0000","last_undegraded":"2024-09-13T15:15:01.212922+0000","last_fullsized":"2024-09-13T15:15:01.212922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:49.413632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"33'4743","reported_seq":4769,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.845662+0000","last_change":"2024-09-13T15:01:48.909879+0000","last_active":"2024-09-13T15:16:10.845662+0000","last_peered":"2024-09-13T15:16:10.845662+0000","last_clean":"2024-09-13T15:16:10.845662+0000","last_became_active":"2024-09-13T15:01:48.909494+0000","last_became_peered":"2024-09-13T15:01:48.909494+0000","last_unstale":"2024-09-13T15:16:10.845662+0000","last_undegraded":"2024-09-13T15:16:10.845662+0000","last_fullsized":"2024-09-13T15:16:10.845662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4743,"log_dups_size":0,"ondisk_log_size":4743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:54.415920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184554680,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69911,"num_write_kb":1001010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:53.670234+0000","last_change":"2024-09-13T15:01:44.825065+0000","last_active":"2024-09-13T15:14:53.670234+0000","last_peered":"2024-09-13T15:14:53.670234+0000","last_clean":"2024-09-13T15:14:53.670234+0000","last_became_active":"2024-09-13T15:01:44.824392+0000","last_became_peered":"2024-09-13T15:01:44.824392+0000","last_unstale":"2024-09-13T15:14:53.670234+0000","last_undegraded":"2024-09-13T15:14:53.670234+0000","last_fullsized":"2024-09-13T15:14:53.670234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:49.717211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"30'15","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.866614+0000","last_change":"2024-09-13T15:01:44.421119+0000","last_active":"2024-09-13T15:15:27.866614+0000","last_peered":"2024-09-13T15:15:27.866614+0000","last_clean":"2024-09-13T15:15:27.866614+0000","last_became_active":"2024-09-13T15:01:44.419082+0000","last_became_peered":"2024-09-13T15:01:44.419082+0000","last_unstale":"2024-09-13T15:15:27.866614+0000","last_undegraded":"2024-09-13T15:15:27.866614+0000","last_fullsized":"2024-09-13T15:15:27.866614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.011350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"33'4646","reported_seq":4672,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.104593+0000","last_change":"2024-09-13T15:01:48.856387+0000","last_active":"2024-09-13T15:16:08.104593+0000","last_peered":"2024-09-13T15:16:08.104593+0000","last_clean":"2024-09-13T15:16:08.104593+0000","last_became_active":"2024-09-13T15:01:48.855433+0000","last_became_peered":"2024-09-13T15:01:48.855433+0000","last_unstale":"2024-09-13T15:16:08.104593+0000","last_undegraded":"2024-09-13T15:16:08.104593+0000","last_fullsized":"2024-09-13T15:16:08.104593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4646,"log_dups_size":0,"ondisk_log_size":4646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:58.309929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201344225,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68020,"num_write_kb":991498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:38.017666+0000","last_change":"2024-09-13T15:01:44.807909+0000","last_active":"2024-09-13T15:14:38.017666+0000","last_peered":"2024-09-13T15:14:38.017666+0000","last_clean":"2024-09-13T15:14:38.017666+0000","last_became_active":"2024-09-13T15:01:44.807643+0000","last_became_peered":"2024-09-13T15:01:44.807643+0000","last_unstale":"2024-09-13T15:14:38.017666+0000","last_undegraded":"2024-09-13T15:14:38.017666+0000","last_fullsized":"2024-09-13T15:14:38.017666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:30.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"30'9","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.087518+0000","last_change":"2024-09-13T15:01:44.430200+0000","last_active":"2024-09-13T15:15:57.087518+0000","last_peered":"2024-09-13T15:15:57.087518+0000","last_clean":"2024-09-13T15:15:57.087518+0000","last_became_active":"2024-09-13T15:01:44.429510+0000","last_became_peered":"2024-09-13T15:01:44.429510+0000","last_unstale":"2024-09-13T15:15:57.087518+0000","last_undegraded":"2024-09-13T15:15:57.087518+0000","last_fullsized":"2024-09-13T15:15:57.087518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:52.921485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":13,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'4785","reported_seq":4811,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.305666+0000","last_change":"2024-09-13T15:01:48.912116+0000","last_active":"2024-09-13T15:16:08.305666+0000","last_peered":"2024-09-13T15:16:08.305666+0000","last_clean":"2024-09-13T15:16:08.305666+0000","last_became_active":"2024-09-13T15:01:48.911578+0000","last_became_peered":"2024-09-13T15:01:48.911578+0000","last_unstale":"2024-09-13T15:16:08.305666+0000","last_undegraded":"2024-09-13T15:16:08.305666+0000","last_fullsized":"2024-09-13T15:16:08.305666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4785,"log_dups_size":0,"ondisk_log_size":4785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:50.826715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234905672,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70443,"num_write_kb":1030585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:00.228712+0000","last_change":"2024-09-13T15:01:44.838344+0000","last_active":"2024-09-13T15:16:00.228712+0000","last_peered":"2024-09-13T15:16:00.228712+0000","last_clean":"2024-09-13T15:16:00.228712+0000","last_became_active":"2024-09-13T15:01:44.838128+0000","last_became_peered":"2024-09-13T15:01:44.838128+0000","last_unstale":"2024-09-13T15:16:00.228712+0000","last_undegraded":"2024-09-13T15:16:00.228712+0000","last_fullsized":"2024-09-13T15:16:00.228712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:09:50.373976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'114","reported_seq":150,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.935801+0000","last_change":"2024-09-13T15:01:44.430749+0000","last_active":"2024-09-13T15:15:57.935801+0000","last_peered":"2024-09-13T15:15:57.935801+0000","last_clean":"2024-09-13T15:15:57.935801+0000","last_became_active":"2024-09-13T15:01:44.430548+0000","last_became_peered":"2024-09-13T15:01:44.430548+0000","last_unstale":"2024-09-13T15:15:57.935801+0000","last_undegraded":"2024-09-13T15:15:57.935801+0000","last_fullsized":"2024-09-13T15:15:57.935801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:30.312447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":249,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"33'4798","reported_seq":4825,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:09.661955+0000","last_change":"2024-09-13T15:01:48.911224+0000","last_active":"2024-09-13T15:16:09.661955+0000","last_peered":"2024-09-13T15:16:09.661955+0000","last_clean":"2024-09-13T15:16:09.661955+0000","last_became_active":"2024-09-13T15:01:48.910150+0000","last_became_peered":"2024-09-13T15:01:48.910150+0000","last_unstale":"2024-09-13T15:16:09.661955+0000","last_undegraded":"2024-09-13T15:16:09.661955+0000","last_fullsized":"2024-09-13T15:16:09.661955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4798,"log_dups_size":0,"ondisk_log_size":4798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:41.244267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180447030,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70396,"num_write_kb":999196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"33'9","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.712426+0000","last_change":"2024-09-13T15:01:44.812200+0000","last_active":"2024-09-13T15:15:28.712426+0000","last_peered":"2024-09-13T15:15:28.712426+0000","last_clean":"2024-09-13T15:15:28.712426+0000","last_became_active":"2024-09-13T15:01:44.811915+0000","last_became_peered":"2024-09-13T15:01:44.811915+0000","last_unstale":"2024-09-13T15:15:28.712426+0000","last_undegraded":"2024-09-13T15:15:28.712426+0000","last_fullsized":"2024-09-13T15:15:28.712426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:07.944520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'7","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.870726+0000","last_change":"2024-09-13T15:01:44.423119+0000","last_active":"2024-09-13T15:15:27.870726+0000","last_peered":"2024-09-13T15:15:27.870726+0000","last_clean":"2024-09-13T15:15:27.870726+0000","last_became_active":"2024-09-13T15:01:44.422297+0000","last_became_peered":"2024-09-13T15:01:44.422297+0000","last_unstale":"2024-09-13T15:15:27.870726+0000","last_undegraded":"2024-09-13T15:15:27.870726+0000","last_fullsized":"2024-09-13T15:15:27.870726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:09.798196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"33'4744","reported_seq":4770,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.093176+0000","last_change":"2024-09-13T15:01:48.908569+0000","last_active":"2024-09-13T15:16:08.093176+0000","last_peered":"2024-09-13T15:16:08.093176+0000","last_clean":"2024-09-13T15:16:08.093176+0000","last_became_active":"2024-09-13T15:01:48.908118+0000","last_became_peered":"2024-09-13T15:01:48.908118+0000","last_unstale":"2024-09-13T15:16:08.093176+0000","last_undegraded":"2024-09-13T15:16:08.093176+0000","last_fullsized":"2024-09-13T15:16:08.093176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4744,"log_dups_size":0,"ondisk_log_size":4744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:06.459855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205574157,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69506,"num_write_kb":1001647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:20.816504+0000","last_change":"2024-09-13T15:01:44.850837+0000","last_active":"2024-09-13T15:14:20.816504+0000","last_peered":"2024-09-13T15:14:20.816504+0000","last_clean":"2024-09-13T15:14:20.816504+0000","last_became_active":"2024-09-13T15:01:44.850263+0000","last_became_peered":"2024-09-13T15:01:44.850263+0000","last_unstale":"2024-09-13T15:14:20.816504+0000","last_undegraded":"2024-09-13T15:14:20.816504+0000","last_fullsized":"2024-09-13T15:14:20.816504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:16.956369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"30'3","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:18.534907+0000","last_change":"2024-09-13T15:01:44.399163+0000","last_active":"2024-09-13T15:14:18.534907+0000","last_peered":"2024-09-13T15:14:18.534907+0000","last_clean":"2024-09-13T15:14:18.534907+0000","last_became_active":"2024-09-13T15:01:44.398881+0000","last_became_peered":"2024-09-13T15:01:44.398881+0000","last_unstale":"2024-09-13T15:14:18.534907+0000","last_undegraded":"2024-09-13T15:14:18.534907+0000","last_fullsized":"2024-09-13T15:14:18.534907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:49.622676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4013","reported_seq":4039,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.188512+0000","last_change":"2024-09-13T15:01:48.852798+0000","last_active":"2024-09-13T15:16:10.188512+0000","last_peered":"2024-09-13T15:16:10.188512+0000","last_clean":"2024-09-13T15:16:10.188512+0000","last_became_active":"2024-09-13T15:01:48.851948+0000","last_became_peered":"2024-09-13T15:01:48.851948+0000","last_unstale":"2024-09-13T15:16:10.188512+0000","last_undegraded":"2024-09-13T15:16:10.188512+0000","last_fullsized":"2024-09-13T15:16:10.188512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4013,"log_dups_size":0,"ondisk_log_size":4013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:20.061043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163694610,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58879,"num_write_kb":861513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:23.142917+0000","last_change":"2024-09-13T15:01:44.824074+0000","last_active":"2024-09-13T15:14:23.142917+0000","last_peered":"2024-09-13T15:14:23.142917+0000","last_clean":"2024-09-13T15:14:23.142917+0000","last_became_active":"2024-09-13T15:01:44.821475+0000","last_became_peered":"2024-09-13T15:01:44.821475+0000","last_unstale":"2024-09-13T15:14:23.142917+0000","last_undegraded":"2024-09-13T15:14:23.142917+0000","last_fullsized":"2024-09-13T15:14:23.142917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:21.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'34","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:32.918126+0000","last_change":"2024-09-13T15:01:44.433502+0000","last_active":"2024-09-13T15:15:32.918126+0000","last_peered":"2024-09-13T15:15:32.918126+0000","last_clean":"2024-09-13T15:15:32.918126+0000","last_became_active":"2024-09-13T15:01:44.432902+0000","last_became_peered":"2024-09-13T15:01:44.432902+0000","last_unstale":"2024-09-13T15:15:32.918126+0000","last_undegraded":"2024-09-13T15:15:32.918126+0000","last_fullsized":"2024-09-13T15:15:32.918126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:59.189559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389688,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":8206,"num_write":28,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"33'4494","reported_seq":4520,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.751737+0000","last_change":"2024-09-13T15:01:48.846695+0000","last_active":"2024-09-13T15:16:10.751737+0000","last_peered":"2024-09-13T15:16:10.751737+0000","last_clean":"2024-09-13T15:16:10.751737+0000","last_became_active":"2024-09-13T15:01:48.846301+0000","last_became_peered":"2024-09-13T15:01:48.846301+0000","last_unstale":"2024-09-13T15:16:10.751737+0000","last_undegraded":"2024-09-13T15:16:10.751737+0000","last_fullsized":"2024-09-13T15:16:10.751737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4494,"log_dups_size":0,"ondisk_log_size":4494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:17.532499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167794395,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66100,"num_write_kb":975469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"33'7","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:00.870032+0000","last_change":"2024-09-13T15:01:44.814483+0000","last_active":"2024-09-13T15:16:00.870032+0000","last_peered":"2024-09-13T15:16:00.870032+0000","last_clean":"2024-09-13T15:16:00.870032+0000","last_became_active":"2024-09-13T15:01:44.814192+0000","last_became_peered":"2024-09-13T15:01:44.814192+0000","last_unstale":"2024-09-13T15:16:00.870032+0000","last_undegraded":"2024-09-13T15:16:00.870032+0000","last_fullsized":"2024-09-13T15:16:00.870032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:32:30.303635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'30","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.442690+0000","last_change":"2024-09-13T15:01:44.399314+0000","last_active":"2024-09-13T15:15:58.442690+0000","last_peered":"2024-09-13T15:15:58.442690+0000","last_clean":"2024-09-13T15:15:58.442690+0000","last_became_active":"2024-09-13T15:01:44.398904+0000","last_became_peered":"2024-09-13T15:01:44.398904+0000","last_unstale":"2024-09-13T15:15:58.442690+0000","last_undegraded":"2024-09-13T15:15:58.442690+0000","last_fullsized":"2024-09-13T15:15:58.442690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.645179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70412,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":156,"num_write":28,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'5176","reported_seq":5202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.887549+0000","last_change":"2024-09-13T15:01:48.859142+0000","last_active":"2024-09-13T15:16:10.887549+0000","last_peered":"2024-09-13T15:16:10.887549+0000","last_clean":"2024-09-13T15:16:10.887549+0000","last_became_active":"2024-09-13T15:01:48.858649+0000","last_became_peered":"2024-09-13T15:01:48.858649+0000","last_unstale":"2024-09-13T15:16:10.887549+0000","last_undegraded":"2024-09-13T15:16:10.887549+0000","last_fullsized":"2024-09-13T15:16:10.887549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5176,"log_dups_size":0,"ondisk_log_size":5176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:27.314012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180429918,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76277,"num_write_kb":1087992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:12.475953+0000","last_change":"2024-09-13T15:01:44.826501+0000","last_active":"2024-09-13T15:14:12.475953+0000","last_peered":"2024-09-13T15:14:12.475953+0000","last_clean":"2024-09-13T15:14:12.475953+0000","last_became_active":"2024-09-13T15:01:44.826222+0000","last_became_peered":"2024-09-13T15:01:44.826222+0000","last_unstale":"2024-09-13T15:14:12.475953+0000","last_undegraded":"2024-09-13T15:14:12.475953+0000","last_fullsized":"2024-09-13T15:14:12.475953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:00.543916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'26","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:33.062368+0000","last_change":"2024-09-13T15:01:44.421891+0000","last_active":"2024-09-13T15:15:33.062368+0000","last_peered":"2024-09-13T15:15:33.062368+0000","last_clean":"2024-09-13T15:15:33.062368+0000","last_became_active":"2024-09-13T15:01:44.419660+0000","last_became_peered":"2024-09-13T15:01:44.419660+0000","last_unstale":"2024-09-13T15:15:33.062368+0000","last_undegraded":"2024-09-13T15:15:33.062368+0000","last_fullsized":"2024-09-13T15:15:33.062368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:27.554128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":20,"num_write_kb":8201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'4164","reported_seq":4200,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.102576+0000","last_change":"2024-09-13T15:02:34.119111+0000","last_active":"2024-09-13T15:16:08.102576+0000","last_peered":"2024-09-13T15:16:08.102576+0000","last_clean":"2024-09-13T15:16:08.102576+0000","last_became_active":"2024-09-13T15:02:34.118461+0000","last_became_peered":"2024-09-13T15:02:34.118461+0000","last_unstale":"2024-09-13T15:16:08.102576+0000","last_undegraded":"2024-09-13T15:16:08.102576+0000","last_fullsized":"2024-09-13T15:16:08.102576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4164,"log_dups_size":0,"ondisk_log_size":4164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:35.096846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155522677,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60732,"num_write_kb":878332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:18.081359+0000","last_change":"2024-09-13T15:01:44.850498+0000","last_active":"2024-09-13T15:14:18.081359+0000","last_peered":"2024-09-13T15:14:18.081359+0000","last_clean":"2024-09-13T15:14:18.081359+0000","last_became_active":"2024-09-13T15:01:44.850234+0000","last_became_peered":"2024-09-13T15:01:44.850234+0000","last_unstale":"2024-09-13T15:14:18.081359+0000","last_undegraded":"2024-09-13T15:14:18.081359+0000","last_fullsized":"2024-09-13T15:14:18.081359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:37.202494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:18.146398+0000","last_change":"2024-09-13T15:01:44.411997+0000","last_active":"2024-09-13T15:14:18.146398+0000","last_peered":"2024-09-13T15:14:18.146398+0000","last_clean":"2024-09-13T15:14:18.146398+0000","last_became_active":"2024-09-13T15:01:44.410675+0000","last_became_peered":"2024-09-13T15:01:44.410675+0000","last_unstale":"2024-09-13T15:14:18.146398+0000","last_undegraded":"2024-09-13T15:14:18.146398+0000","last_fullsized":"2024-09-13T15:14:18.146398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:50:55.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":18,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.866875+0000","last_change":"2024-09-13T15:01:40.834440+0000","last_active":"2024-09-13T15:15:27.866875+0000","last_peered":"2024-09-13T15:15:27.866875+0000","last_clean":"2024-09-13T15:15:27.866875+0000","last_became_active":"2024-09-13T15:01:40.832279+0000","last_became_peered":"2024-09-13T15:01:40.832279+0000","last_unstale":"2024-09-13T15:15:27.866875+0000","last_undegraded":"2024-09-13T15:15:27.866875+0000","last_fullsized":"2024-09-13T15:15:27.866875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_clean_scrub_stamp":"2024-09-13T15:01:39.264455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:11.875506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"33'5083","reported_seq":5109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.431985+0000","last_change":"2024-09-13T15:01:48.919580+0000","last_active":"2024-09-13T15:16:10.431985+0000","last_peered":"2024-09-13T15:16:10.431985+0000","last_clean":"2024-09-13T15:16:10.431985+0000","last_became_active":"2024-09-13T15:01:48.918678+0000","last_became_peered":"2024-09-13T15:01:48.918678+0000","last_unstale":"2024-09-13T15:16:10.431985+0000","last_undegraded":"2024-09-13T15:16:10.431985+0000","last_fullsized":"2024-09-13T15:16:10.431985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5083,"log_dups_size":0,"ondisk_log_size":5083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:02.840528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209718630,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74794,"num_write_kb":1044614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.222286+0000","last_change":"2024-09-13T15:01:44.849975+0000","last_active":"2024-09-13T15:16:02.222286+0000","last_peered":"2024-09-13T15:16:02.222286+0000","last_clean":"2024-09-13T15:16:02.222286+0000","last_became_active":"2024-09-13T15:01:44.849457+0000","last_became_peered":"2024-09-13T15:01:44.849457+0000","last_unstale":"2024-09-13T15:16:02.222286+0000","last_undegraded":"2024-09-13T15:16:02.222286+0000","last_fullsized":"2024-09-13T15:16:02.222286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:51.139153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"30'9","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:15:17.898494+0000","last_change":"2024-09-13T15:01:44.420906+0000","last_active":"2024-09-13T15:15:17.898494+0000","last_peered":"2024-09-13T15:15:17.898494+0000","last_clean":"2024-09-13T15:15:17.898494+0000","last_became_active":"2024-09-13T15:01:44.420601+0000","last_became_peered":"2024-09-13T15:01:44.420601+0000","last_unstale":"2024-09-13T15:15:17.898494+0000","last_undegraded":"2024-09-13T15:15:17.898494+0000","last_fullsized":"2024-09-13T15:15:17.898494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:33.245745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1497,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"33'4476","reported_seq":4502,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.800260+0000","last_change":"2024-09-13T15:01:48.911047+0000","last_active":"2024-09-13T15:16:08.800260+0000","last_peered":"2024-09-13T15:16:08.800260+0000","last_clean":"2024-09-13T15:16:08.800260+0000","last_became_active":"2024-09-13T15:01:48.910479+0000","last_became_peered":"2024-09-13T15:01:48.910479+0000","last_unstale":"2024-09-13T15:16:08.800260+0000","last_undegraded":"2024-09-13T15:16:08.800260+0000","last_fullsized":"2024-09-13T15:16:08.800260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4476,"log_dups_size":0,"ondisk_log_size":4476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:06.558889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160849,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65864,"num_write_kb":920675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.870055+0000","last_change":"2024-09-13T15:01:44.838098+0000","last_active":"2024-09-13T15:15:27.870055+0000","last_peered":"2024-09-13T15:15:27.870055+0000","last_clean":"2024-09-13T15:15:27.870055+0000","last_became_active":"2024-09-13T15:01:44.837429+0000","last_became_peered":"2024-09-13T15:01:44.837429+0000","last_unstale":"2024-09-13T15:15:27.870055+0000","last_undegraded":"2024-09-13T15:15:27.870055+0000","last_fullsized":"2024-09-13T15:15:27.870055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:37.795841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"30'15","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:32.877991+0000","last_change":"2024-09-13T15:01:44.406999+0000","last_active":"2024-09-13T15:15:32.877991+0000","last_peered":"2024-09-13T15:15:32.877991+0000","last_clean":"2024-09-13T15:15:32.877991+0000","last_became_active":"2024-09-13T15:01:44.406719+0000","last_became_peered":"2024-09-13T15:01:44.406719+0000","last_unstale":"2024-09-13T15:15:32.877991+0000","last_undegraded":"2024-09-13T15:15:32.877991+0000","last_fullsized":"2024-09-13T15:15:32.877991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:33.397091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":9,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"33'5071","reported_seq":5097,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.549784+0000","last_change":"2024-09-13T15:01:48.857931+0000","last_active":"2024-09-13T15:16:07.549784+0000","last_peered":"2024-09-13T15:16:07.549784+0000","last_clean":"2024-09-13T15:16:07.549784+0000","last_became_active":"2024-09-13T15:01:48.857542+0000","last_became_peered":"2024-09-13T15:01:48.857542+0000","last_unstale":"2024-09-13T15:16:07.549784+0000","last_undegraded":"2024-09-13T15:16:07.549784+0000","last_fullsized":"2024-09-13T15:16:07.549784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5071,"log_dups_size":0,"ondisk_log_size":5071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:32.805405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197777785,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74191,"num_write_kb":1079868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:05.311578+0000","last_change":"2024-09-13T15:01:44.835470+0000","last_active":"2024-09-13T15:16:05.311578+0000","last_peered":"2024-09-13T15:16:05.311578+0000","last_clean":"2024-09-13T15:16:05.311578+0000","last_became_active":"2024-09-13T15:01:44.831166+0000","last_became_peered":"2024-09-13T15:01:44.831166+0000","last_unstale":"2024-09-13T15:16:05.311578+0000","last_undegraded":"2024-09-13T15:16:05.311578+0000","last_fullsized":"2024-09-13T15:16:05.311578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:05.887592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"30'19","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.085247+0000","last_change":"2024-09-13T15:01:44.403111+0000","last_active":"2024-09-13T15:15:57.085247+0000","last_peered":"2024-09-13T15:15:57.085247+0000","last_clean":"2024-09-13T15:15:57.085247+0000","last_became_active":"2024-09-13T15:01:44.401799+0000","last_became_peered":"2024-09-13T15:01:44.401799+0000","last_unstale":"2024-09-13T15:15:57.085247+0000","last_undegraded":"2024-09-13T15:15:57.085247+0000","last_fullsized":"2024-09-13T15:15:57.085247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:54.589470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":4114,"num_write":17,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"33'4728","reported_seq":4754,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.461987+0000","last_change":"2024-09-13T15:01:48.912490+0000","last_active":"2024-09-13T15:16:10.461987+0000","last_peered":"2024-09-13T15:16:10.461987+0000","last_clean":"2024-09-13T15:16:10.461987+0000","last_became_active":"2024-09-13T15:01:48.911474+0000","last_became_peered":"2024-09-13T15:01:48.911474+0000","last_unstale":"2024-09-13T15:16:10.461987+0000","last_undegraded":"2024-09-13T15:16:10.461987+0000","last_fullsized":"2024-09-13T15:16:10.461987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4728,"log_dups_size":0,"ondisk_log_size":4728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:54.295921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134285803,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69008,"num_write_kb":987747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.871262+0000","last_change":"2024-09-13T15:01:44.818472+0000","last_active":"2024-09-13T15:15:27.871262+0000","last_peered":"2024-09-13T15:15:27.871262+0000","last_clean":"2024-09-13T15:15:27.871262+0000","last_became_active":"2024-09-13T15:01:44.817718+0000","last_became_peered":"2024-09-13T15:01:44.817718+0000","last_unstale":"2024-09-13T15:15:27.871262+0000","last_undegraded":"2024-09-13T15:15:27.871262+0000","last_fullsized":"2024-09-13T15:15:27.871262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:21.310696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'15","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:32.879744+0000","last_change":"2024-09-13T15:01:44.410376+0000","last_active":"2024-09-13T15:15:32.879744+0000","last_peered":"2024-09-13T15:15:32.879744+0000","last_clean":"2024-09-13T15:15:32.879744+0000","last_became_active":"2024-09-13T15:01:44.409585+0000","last_became_peered":"2024-09-13T15:01:44.409585+0000","last_unstale":"2024-09-13T15:15:32.879744+0000","last_undegraded":"2024-09-13T15:15:32.879744+0000","last_fullsized":"2024-09-13T15:15:32.879744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:45.845804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"33'5260","reported_seq":5286,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.524170+0000","last_change":"2024-09-13T15:01:48.861130+0000","last_active":"2024-09-13T15:16:08.524170+0000","last_peered":"2024-09-13T15:16:08.524170+0000","last_clean":"2024-09-13T15:16:08.524170+0000","last_became_active":"2024-09-13T15:01:48.860317+0000","last_became_peered":"2024-09-13T15:01:48.860317+0000","last_unstale":"2024-09-13T15:16:08.524170+0000","last_undegraded":"2024-09-13T15:16:08.524170+0000","last_fullsized":"2024-09-13T15:16:08.524170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5260,"log_dups_size":0,"ondisk_log_size":5260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:45.317747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230705862,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77504,"num_write_kb":1107255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.867788+0000","last_change":"2024-09-13T15:01:44.835494+0000","last_active":"2024-09-13T15:15:27.867788+0000","last_peered":"2024-09-13T15:15:27.867788+0000","last_clean":"2024-09-13T15:15:27.867788+0000","last_became_active":"2024-09-13T15:01:44.831150+0000","last_became_peered":"2024-09-13T15:01:44.831150+0000","last_unstale":"2024-09-13T15:15:27.867788+0000","last_undegraded":"2024-09-13T15:15:27.867788+0000","last_fullsized":"2024-09-13T15:15:27.867788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:29.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'22","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.115656+0000","last_change":"2024-09-13T15:01:44.390278+0000","last_active":"2024-09-13T15:15:57.115656+0000","last_peered":"2024-09-13T15:15:57.115656+0000","last_clean":"2024-09-13T15:15:57.115656+0000","last_became_active":"2024-09-13T15:01:44.389946+0000","last_became_peered":"2024-09-13T15:01:44.389946+0000","last_unstale":"2024-09-13T15:15:57.115656+0000","last_undegraded":"2024-09-13T15:15:57.115656+0000","last_fullsized":"2024-09-13T15:15:57.115656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:53.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"33'4067","reported_seq":4092,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.482133+0000","last_change":"2024-09-13T15:01:48.848009+0000","last_active":"2024-09-13T15:16:07.482133+0000","last_peered":"2024-09-13T15:16:07.482133+0000","last_clean":"2024-09-13T15:16:07.482133+0000","last_became_active":"2024-09-13T15:01:48.847605+0000","last_became_peered":"2024-09-13T15:01:48.847605+0000","last_unstale":"2024-09-13T15:16:07.482133+0000","last_undegraded":"2024-09-13T15:16:07.482133+0000","last_fullsized":"2024-09-13T15:16:07.482133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:32.053010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205605377,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59518,"num_write_kb":873580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.599764+0000","last_change":"2024-09-13T15:01:44.808572+0000","last_active":"2024-09-13T15:15:28.599764+0000","last_peered":"2024-09-13T15:15:28.599764+0000","last_clean":"2024-09-13T15:15:28.599764+0000","last_became_active":"2024-09-13T15:01:44.808140+0000","last_became_peered":"2024-09-13T15:01:44.808140+0000","last_unstale":"2024-09-13T15:15:28.599764+0000","last_undegraded":"2024-09-13T15:15:28.599764+0000","last_fullsized":"2024-09-13T15:15:28.599764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:15.497720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"33'9","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:45.745857+0000","last_change":"2024-09-13T15:01:44.428794+0000","last_active":"2024-09-13T15:15:45.745857+0000","last_peered":"2024-09-13T15:15:45.745857+0000","last_clean":"2024-09-13T15:15:45.745857+0000","last_became_active":"2024-09-13T15:01:44.428271+0000","last_became_peered":"2024-09-13T15:01:44.428271+0000","last_unstale":"2024-09-13T15:15:45.745857+0000","last_undegraded":"2024-09-13T15:15:45.745857+0000","last_fullsized":"2024-09-13T15:15:45.745857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:53.225826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"33'4906","reported_seq":4931,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.927201+0000","last_change":"2024-09-13T15:01:48.916354+0000","last_active":"2024-09-13T15:16:08.927201+0000","last_peered":"2024-09-13T15:16:08.927201+0000","last_clean":"2024-09-13T15:16:08.927201+0000","last_became_active":"2024-09-13T15:01:48.916008+0000","last_became_peered":"2024-09-13T15:01:48.916008+0000","last_unstale":"2024-09-13T15:16:08.927201+0000","last_undegraded":"2024-09-13T15:16:08.927201+0000","last_fullsized":"2024-09-13T15:16:08.927201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4906,"log_dups_size":0,"ondisk_log_size":4906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:58.115410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197156098,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72323,"num_write_kb":1020409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'15","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.217211+0000","last_change":"2024-09-13T15:01:44.826700+0000","last_active":"2024-09-13T15:16:08.217211+0000","last_peered":"2024-09-13T15:16:08.217211+0000","last_clean":"2024-09-13T15:16:08.217211+0000","last_became_active":"2024-09-13T15:01:44.825996+0000","last_became_peered":"2024-09-13T15:01:44.825996+0000","last_unstale":"2024-09-13T15:16:08.217211+0000","last_undegraded":"2024-09-13T15:16:08.217211+0000","last_fullsized":"2024-09-13T15:16:08.217211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:11.963837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'6","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.869444+0000","last_change":"2024-09-13T15:01:44.409339+0000","last_active":"2024-09-13T15:15:27.869444+0000","last_peered":"2024-09-13T15:15:27.869444+0000","last_clean":"2024-09-13T15:15:27.869444+0000","last_became_active":"2024-09-13T15:01:44.408644+0000","last_became_peered":"2024-09-13T15:01:44.408644+0000","last_unstale":"2024-09-13T15:15:27.869444+0000","last_undegraded":"2024-09-13T15:15:27.869444+0000","last_fullsized":"2024-09-13T15:15:27.869444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:29.297950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'4683","reported_seq":4709,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:09.628413+0000","last_change":"2024-09-13T15:01:48.916478+0000","last_active":"2024-09-13T15:16:09.628413+0000","last_peered":"2024-09-13T15:16:09.628413+0000","last_clean":"2024-09-13T15:16:09.628413+0000","last_became_active":"2024-09-13T15:01:48.916198+0000","last_became_peered":"2024-09-13T15:01:48.916198+0000","last_unstale":"2024-09-13T15:16:09.628413+0000","last_undegraded":"2024-09-13T15:16:09.628413+0000","last_fullsized":"2024-09-13T15:16:09.628413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4683,"log_dups_size":0,"ondisk_log_size":4683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:26.311460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188820535,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68918,"num_write_kb":974417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.196456+0000","last_change":"2024-09-13T15:01:44.831833+0000","last_active":"2024-09-13T15:15:58.196456+0000","last_peered":"2024-09-13T15:15:58.196456+0000","last_clean":"2024-09-13T15:15:58.196456+0000","last_became_active":"2024-09-13T15:01:44.831583+0000","last_became_peered":"2024-09-13T15:01:44.831583+0000","last_unstale":"2024-09-13T15:15:58.196456+0000","last_undegraded":"2024-09-13T15:15:58.196456+0000","last_fullsized":"2024-09-13T15:15:58.196456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.715951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"30'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:53.196045+0000","last_change":"2024-09-13T15:01:44.408752+0000","last_active":"2024-09-13T15:15:53.196045+0000","last_peered":"2024-09-13T15:15:53.196045+0000","last_clean":"2024-09-13T15:15:53.196045+0000","last_became_active":"2024-09-13T15:01:44.408453+0000","last_became_peered":"2024-09-13T15:01:44.408453+0000","last_unstale":"2024-09-13T15:15:53.196045+0000","last_undegraded":"2024-09-13T15:15:53.196045+0000","last_fullsized":"2024-09-13T15:15:53.196045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:31.587404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":8225,"num_write":32,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'5090","reported_seq":5115,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.745513+0000","last_change":"2024-09-13T15:01:48.916681+0000","last_active":"2024-09-13T15:16:10.745513+0000","last_peered":"2024-09-13T15:16:10.745513+0000","last_clean":"2024-09-13T15:16:10.745513+0000","last_became_active":"2024-09-13T15:01:48.916185+0000","last_became_peered":"2024-09-13T15:01:48.916185+0000","last_unstale":"2024-09-13T15:16:10.745513+0000","last_undegraded":"2024-09-13T15:16:10.745513+0000","last_fullsized":"2024-09-13T15:16:10.745513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5090,"log_dups_size":0,"ondisk_log_size":5090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:33.862835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155327682,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74423,"num_write_kb":1089564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.869822+0000","last_change":"2024-09-13T15:01:44.817007+0000","last_active":"2024-09-13T15:15:27.869822+0000","last_peered":"2024-09-13T15:15:27.869822+0000","last_clean":"2024-09-13T15:15:27.869822+0000","last_became_active":"2024-09-13T15:01:44.815435+0000","last_became_peered":"2024-09-13T15:01:44.815435+0000","last_unstale":"2024-09-13T15:15:27.869822+0000","last_undegraded":"2024-09-13T15:15:27.869822+0000","last_fullsized":"2024-09-13T15:15:27.869822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:25.887993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'576","reported_seq":617,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.679087+0000","last_change":"2024-09-13T15:01:44.435688+0000","last_active":"2024-09-13T15:16:10.679087+0000","last_peered":"2024-09-13T15:16:10.679087+0000","last_clean":"2024-09-13T15:16:10.679087+0000","last_became_active":"2024-09-13T15:01:44.435222+0000","last_became_peered":"2024-09-13T15:01:44.435222+0000","last_unstale":"2024-09-13T15:16:10.679087+0000","last_undegraded":"2024-09-13T15:16:10.679087+0000","last_fullsized":"2024-09-13T15:16:10.679087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:24.705633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8159583,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":7965,"num_write":571,"num_write_kb":8183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"33'4408","reported_seq":4434,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.395947+0000","last_change":"2024-09-13T15:01:48.847694+0000","last_active":"2024-09-13T15:16:10.395947+0000","last_peered":"2024-09-13T15:16:10.395947+0000","last_clean":"2024-09-13T15:16:10.395947+0000","last_became_active":"2024-09-13T15:01:48.846835+0000","last_became_peered":"2024-09-13T15:01:48.846835+0000","last_unstale":"2024-09-13T15:16:10.395947+0000","last_undegraded":"2024-09-13T15:16:10.395947+0000","last_fullsized":"2024-09-13T15:16:10.395947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4408,"log_dups_size":0,"ondisk_log_size":4408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:49.763472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201352826,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64958,"num_write_kb":924599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.484365+0000","last_change":"2024-09-13T15:01:44.835315+0000","last_active":"2024-09-13T15:15:28.484365+0000","last_peered":"2024-09-13T15:15:28.484365+0000","last_clean":"2024-09-13T15:15:28.484365+0000","last_became_active":"2024-09-13T15:01:44.834643+0000","last_became_peered":"2024-09-13T15:01:44.834643+0000","last_unstale":"2024-09-13T15:15:28.484365+0000","last_undegraded":"2024-09-13T15:15:28.484365+0000","last_fullsized":"2024-09-13T15:15:28.484365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:15.535195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'14","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.935173+0000","last_change":"2024-09-13T15:01:44.424966+0000","last_active":"2024-09-13T15:15:57.935173+0000","last_peered":"2024-09-13T15:15:57.935173+0000","last_clean":"2024-09-13T15:15:57.935173+0000","last_became_active":"2024-09-13T15:01:44.424714+0000","last_became_peered":"2024-09-13T15:01:44.424714+0000","last_unstale":"2024-09-13T15:15:57.935173+0000","last_undegraded":"2024-09-13T15:15:57.935173+0000","last_fullsized":"2024-09-13T15:15:57.935173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:46.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":15,"num_write":16,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'4758","reported_seq":4794,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.652318+0000","last_change":"2024-09-13T15:02:33.753482+0000","last_active":"2024-09-13T15:16:08.652318+0000","last_peered":"2024-09-13T15:16:08.652318+0000","last_clean":"2024-09-13T15:16:08.652318+0000","last_became_active":"2024-09-13T15:02:33.752505+0000","last_became_peered":"2024-09-13T15:02:33.752505+0000","last_unstale":"2024-09-13T15:16:08.652318+0000","last_undegraded":"2024-09-13T15:16:08.652318+0000","last_fullsized":"2024-09-13T15:16:08.652318+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4758,"log_dups_size":0,"ondisk_log_size":4758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:59.041586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176191855,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69693,"num_write_kb":999376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"33'8","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.864245+0000","last_change":"2024-09-13T15:01:44.837032+0000","last_active":"2024-09-13T15:15:27.864245+0000","last_peered":"2024-09-13T15:15:27.864245+0000","last_clean":"2024-09-13T15:15:27.864245+0000","last_became_active":"2024-09-13T15:01:44.836750+0000","last_became_peered":"2024-09-13T15:01:44.836750+0000","last_unstale":"2024-09-13T15:15:27.864245+0000","last_undegraded":"2024-09-13T15:15:27.864245+0000","last_fullsized":"2024-09-13T15:15:27.864245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:04.491426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"33'9","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.872036+0000","last_change":"2024-09-13T15:01:44.437854+0000","last_active":"2024-09-13T15:15:27.872036+0000","last_peered":"2024-09-13T15:15:27.872036+0000","last_clean":"2024-09-13T15:15:27.872036+0000","last_became_active":"2024-09-13T15:01:44.437433+0000","last_became_peered":"2024-09-13T15:01:44.437433+0000","last_unstale":"2024-09-13T15:15:27.872036+0000","last_undegraded":"2024-09-13T15:15:27.872036+0000","last_fullsized":"2024-09-13T15:15:27.872036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:47.302388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":18,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'4852","reported_seq":4878,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.954746+0000","last_change":"2024-09-13T15:01:48.841829+0000","last_active":"2024-09-13T15:16:08.954746+0000","last_peered":"2024-09-13T15:16:08.954746+0000","last_clean":"2024-09-13T15:16:08.954746+0000","last_became_active":"2024-09-13T15:01:48.841267+0000","last_became_peered":"2024-09-13T15:01:48.841267+0000","last_unstale":"2024-09-13T15:16:08.954746+0000","last_undegraded":"2024-09-13T15:16:08.954746+0000","last_fullsized":"2024-09-13T15:16:08.954746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4852,"log_dups_size":0,"ondisk_log_size":4852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:25.029615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184577144,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71199,"num_write_kb":1004130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:13:55.797181+0000","last_change":"2024-09-13T15:01:44.844701+0000","last_active":"2024-09-13T15:13:55.797181+0000","last_peered":"2024-09-13T15:13:55.797181+0000","last_clean":"2024-09-13T15:13:55.797181+0000","last_became_active":"2024-09-13T15:01:44.843982+0000","last_became_peered":"2024-09-13T15:01:44.843982+0000","last_unstale":"2024-09-13T15:13:55.797181+0000","last_undegraded":"2024-09-13T15:13:55.797181+0000","last_fullsized":"2024-09-13T15:13:55.797181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"33'14","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.659715+0000","last_change":"2024-09-13T15:01:44.436081+0000","last_active":"2024-09-13T15:16:10.659715+0000","last_peered":"2024-09-13T15:16:10.659715+0000","last_clean":"2024-09-13T15:16:10.659715+0000","last_became_active":"2024-09-13T15:01:44.435367+0000","last_became_peered":"2024-09-13T15:01:44.435367+0000","last_unstale":"2024-09-13T15:16:10.659715+0000","last_undegraded":"2024-09-13T15:16:10.659715+0000","last_fullsized":"2024-09-13T15:16:10.659715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:57:57.065719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"33'3894","reported_seq":3920,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.734027+0000","last_change":"2024-09-13T15:01:48.910562+0000","last_active":"2024-09-13T15:16:08.734027+0000","last_peered":"2024-09-13T15:16:08.734027+0000","last_clean":"2024-09-13T15:16:08.734027+0000","last_became_active":"2024-09-13T15:01:48.909681+0000","last_became_peered":"2024-09-13T15:01:48.909681+0000","last_unstale":"2024-09-13T15:16:08.734027+0000","last_undegraded":"2024-09-13T15:16:08.734027+0000","last_fullsized":"2024-09-13T15:16:08.734027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":3894,"log_dups_size":0,"ondisk_log_size":3894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:35.989769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171990195,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57348,"num_write_kb":843085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'3639","reported_seq":3676,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.200570+0000","last_change":"2024-09-13T15:02:34.118951+0000","last_active":"2024-09-13T15:16:07.200570+0000","last_peered":"2024-09-13T15:16:07.200570+0000","last_clean":"2024-09-13T15:16:07.200570+0000","last_became_active":"2024-09-13T15:02:34.118477+0000","last_became_peered":"2024-09-13T15:02:34.118477+0000","last_unstale":"2024-09-13T15:16:07.200570+0000","last_undegraded":"2024-09-13T15:16:07.200570+0000","last_fullsized":"2024-09-13T15:16:07.200570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":3639,"log_dups_size":0,"ondisk_log_size":3639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:13.697114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142701044,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53400,"num_write_kb":757724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:05.388722+0000","last_change":"2024-09-13T15:01:44.808417+0000","last_active":"2024-09-13T15:16:05.388722+0000","last_peered":"2024-09-13T15:16:05.388722+0000","last_clean":"2024-09-13T15:16:05.388722+0000","last_became_active":"2024-09-13T15:01:44.807641+0000","last_became_peered":"2024-09-13T15:01:44.807641+0000","last_unstale":"2024-09-13T15:16:05.388722+0000","last_undegraded":"2024-09-13T15:16:05.388722+0000","last_fullsized":"2024-09-13T15:16:05.388722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:58.296966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'34","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:33.277729+0000","last_change":"2024-09-13T15:01:44.433582+0000","last_active":"2024-09-13T15:15:33.277729+0000","last_peered":"2024-09-13T15:15:33.277729+0000","last_clean":"2024-09-13T15:15:33.277729+0000","last_became_active":"2024-09-13T15:01:44.433124+0000","last_became_peered":"2024-09-13T15:01:44.433124+0000","last_unstale":"2024-09-13T15:15:33.277729+0000","last_undegraded":"2024-09-13T15:15:33.277729+0000","last_fullsized":"2024-09-13T15:15:33.277729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:04.476996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":8193,"num_write":27,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4877","reported_seq":4903,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.210978+0000","last_change":"2024-09-13T15:01:48.855090+0000","last_active":"2024-09-13T15:16:10.210978+0000","last_peered":"2024-09-13T15:16:10.210978+0000","last_clean":"2024-09-13T15:16:10.210978+0000","last_became_active":"2024-09-13T15:01:48.852925+0000","last_became_peered":"2024-09-13T15:01:48.852925+0000","last_unstale":"2024-09-13T15:16:10.210978+0000","last_undegraded":"2024-09-13T15:16:10.210978+0000","last_fullsized":"2024-09-13T15:16:10.210978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4877,"log_dups_size":0,"ondisk_log_size":4877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.176480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192967854,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71595,"num_write_kb":1060070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"33'9","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.732294+0000","last_change":"2024-09-13T15:02:33.746356+0000","last_active":"2024-09-13T15:15:58.732294+0000","last_peered":"2024-09-13T15:15:58.732294+0000","last_clean":"2024-09-13T15:15:58.732294+0000","last_became_active":"2024-09-13T15:02:33.746005+0000","last_became_peered":"2024-09-13T15:02:33.746005+0000","last_unstale":"2024-09-13T15:15:58.732294+0000","last_undegraded":"2024-09-13T15:15:58.732294+0000","last_fullsized":"2024-09-13T15:15:58.732294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:41.159781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"33'6","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389847+0000","last_change":"2024-09-13T15:01:44.436900+0000","last_active":"2024-09-13T15:15:28.389847+0000","last_peered":"2024-09-13T15:15:28.389847+0000","last_clean":"2024-09-13T15:15:28.389847+0000","last_became_active":"2024-09-13T15:01:44.436646+0000","last_became_peered":"2024-09-13T15:01:44.436646+0000","last_unstale":"2024-09-13T15:15:28.389847+0000","last_undegraded":"2024-09-13T15:15:28.389847+0000","last_fullsized":"2024-09-13T15:15:28.389847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:52.505856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":27,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"33'47","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:34.359088+0000","last_change":"2024-09-13T15:01:44.430115+0000","last_active":"2024-09-13T15:15:34.359088+0000","last_peered":"2024-09-13T15:15:34.359088+0000","last_clean":"2024-09-13T15:15:34.359088+0000","last_became_active":"2024-09-13T15:01:44.429339+0000","last_became_peered":"2024-09-13T15:01:44.429339+0000","last_unstale":"2024-09-13T15:15:34.359088+0000","last_undegraded":"2024-09-13T15:15:34.359088+0000","last_fullsized":"2024-09-13T15:15:34.359088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:47.224125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":8210,"num_write":46,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.864483+0000","last_change":"2024-09-13T15:01:44.822034+0000","last_active":"2024-09-13T15:15:27.864483+0000","last_peered":"2024-09-13T15:15:27.864483+0000","last_clean":"2024-09-13T15:15:27.864483+0000","last_became_active":"2024-09-13T15:01:44.821734+0000","last_became_peered":"2024-09-13T15:01:44.821734+0000","last_unstale":"2024-09-13T15:15:27.864483+0000","last_undegraded":"2024-09-13T15:15:27.864483+0000","last_fullsized":"2024-09-13T15:15:27.864483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:57:44.629046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"33'4661","reported_seq":4686,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.260927+0000","last_change":"2024-09-13T15:01:48.858033+0000","last_active":"2024-09-13T15:16:07.260927+0000","last_peered":"2024-09-13T15:16:07.260927+0000","last_clean":"2024-09-13T15:16:07.260927+0000","last_became_active":"2024-09-13T15:01:48.857584+0000","last_became_peered":"2024-09-13T15:01:48.857584+0000","last_unstale":"2024-09-13T15:16:07.260927+0000","last_undegraded":"2024-09-13T15:16:07.260927+0000","last_fullsized":"2024-09-13T15:16:07.260927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4661,"log_dups_size":0,"ondisk_log_size":4661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:04.797167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192971375,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68630,"num_write_kb":960930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'1778","reported_seq":1809,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389774+0000","last_change":"2024-09-13T15:01:44.422582+0000","last_active":"2024-09-13T15:15:28.389774+0000","last_peered":"2024-09-13T15:15:28.389774+0000","last_clean":"2024-09-13T15:15:28.389774+0000","last_became_active":"2024-09-13T15:01:44.422367+0000","last_became_peered":"2024-09-13T15:01:44.422367+0000","last_unstale":"2024-09-13T15:15:28.389774+0000","last_undegraded":"2024-09-13T15:15:28.389774+0000","last_fullsized":"2024-09-13T15:15:28.389774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1778,"log_dups_size":0,"ondisk_log_size":1778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.902724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195253,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4098,"num_write":1774,"num_write_kb":4250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:12.752509+0000","last_change":"2024-09-13T15:01:44.820841+0000","last_active":"2024-09-13T15:14:12.752509+0000","last_peered":"2024-09-13T15:14:12.752509+0000","last_clean":"2024-09-13T15:14:12.752509+0000","last_became_active":"2024-09-13T15:01:44.816584+0000","last_became_peered":"2024-09-13T15:01:44.816584+0000","last_unstale":"2024-09-13T15:14:12.752509+0000","last_undegraded":"2024-09-13T15:14:12.752509+0000","last_fullsized":"2024-09-13T15:14:12.752509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:26.763818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4675","reported_seq":4700,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:09.586090+0000","last_change":"2024-09-13T15:01:48.840771+0000","last_active":"2024-09-13T15:16:09.586090+0000","last_peered":"2024-09-13T15:16:09.586090+0000","last_clean":"2024-09-13T15:16:09.586090+0000","last_became_active":"2024-09-13T15:01:48.840397+0000","last_became_peered":"2024-09-13T15:01:48.840397+0000","last_unstale":"2024-09-13T15:16:09.586090+0000","last_undegraded":"2024-09-13T15:16:09.586090+0000","last_fullsized":"2024-09-13T15:16:09.586090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4675,"log_dups_size":0,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:59.700088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180423209,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68695,"num_write_kb":983871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"33'10","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:05.934297+0000","last_change":"2024-09-13T15:01:44.809497+0000","last_active":"2024-09-13T15:16:05.934297+0000","last_peered":"2024-09-13T15:16:05.934297+0000","last_clean":"2024-09-13T15:16:05.934297+0000","last_became_active":"2024-09-13T15:01:44.808669+0000","last_became_peered":"2024-09-13T15:01:44.808669+0000","last_unstale":"2024-09-13T15:16:05.934297+0000","last_undegraded":"2024-09-13T15:16:05.934297+0000","last_fullsized":"2024-09-13T15:16:05.934297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:45.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"33'8","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.091461+0000","last_change":"2024-09-13T15:01:44.836353+0000","last_active":"2024-09-13T15:16:02.091461+0000","last_peered":"2024-09-13T15:16:02.091461+0000","last_clean":"2024-09-13T15:16:02.091461+0000","last_became_active":"2024-09-13T15:01:44.836102+0000","last_became_peered":"2024-09-13T15:01:44.836102+0000","last_unstale":"2024-09-13T15:16:02.091461+0000","last_undegraded":"2024-09-13T15:16:02.091461+0000","last_fullsized":"2024-09-13T15:16:02.091461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:14.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:20.816437+0000","last_change":"2024-09-13T15:01:44.849091+0000","last_active":"2024-09-13T15:14:20.816437+0000","last_peered":"2024-09-13T15:14:20.816437+0000","last_clean":"2024-09-13T15:14:20.816437+0000","last_became_active":"2024-09-13T15:01:44.846506+0000","last_became_peered":"2024-09-13T15:01:44.846506+0000","last_unstale":"2024-09-13T15:14:20.816437+0000","last_undegraded":"2024-09-13T15:14:20.816437+0000","last_fullsized":"2024-09-13T15:14:20.816437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:38.026998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.447468+0000","last_change":"2024-09-13T15:01:44.809873+0000","last_active":"2024-09-13T15:15:58.447468+0000","last_peered":"2024-09-13T15:15:58.447468+0000","last_clean":"2024-09-13T15:15:58.447468+0000","last_became_active":"2024-09-13T15:01:44.809585+0000","last_became_peered":"2024-09-13T15:01:44.809585+0000","last_unstale":"2024-09-13T15:15:58.447468+0000","last_undegraded":"2024-09-13T15:15:58.447468+0000","last_fullsized":"2024-09-13T15:15:58.447468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:20.272320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'1","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:44.316932+0000","last_change":"2024-09-13T15:01:44.816761+0000","last_active":"2024-09-13T15:14:44.316932+0000","last_peered":"2024-09-13T15:14:44.316932+0000","last_clean":"2024-09-13T15:14:44.316932+0000","last_became_active":"2024-09-13T15:01:44.816480+0000","last_became_peered":"2024-09-13T15:01:44.816480+0000","last_unstale":"2024-09-13T15:14:44.316932+0000","last_undegraded":"2024-09-13T15:14:44.316932+0000","last_fullsized":"2024-09-13T15:14:44.316932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:46.000440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.712144+0000","last_change":"2024-09-13T15:01:44.808373+0000","last_active":"2024-09-13T15:15:28.712144+0000","last_peered":"2024-09-13T15:15:28.712144+0000","last_clean":"2024-09-13T15:15:28.712144+0000","last_became_active":"2024-09-13T15:01:44.807622+0000","last_became_peered":"2024-09-13T15:01:44.807622+0000","last_unstale":"2024-09-13T15:15:28.712144+0000","last_undegraded":"2024-09-13T15:15:28.712144+0000","last_fullsized":"2024-09-13T15:15:28.712144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:38.584426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"33'8","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.601200+0000","last_change":"2024-09-13T15:01:44.832521+0000","last_active":"2024-09-13T15:15:28.601200+0000","last_peered":"2024-09-13T15:15:28.601200+0000","last_clean":"2024-09-13T15:15:28.601200+0000","last_became_active":"2024-09-13T15:01:44.831889+0000","last_became_peered":"2024-09-13T15:01:44.831889+0000","last_unstale":"2024-09-13T15:15:28.601200+0000","last_undegraded":"2024-09-13T15:15:28.601200+0000","last_fullsized":"2024-09-13T15:15:28.601200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:07.563684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:59.619580+0000","last_change":"2024-09-13T15:01:44.817583+0000","last_active":"2024-09-13T15:14:59.619580+0000","last_peered":"2024-09-13T15:14:59.619580+0000","last_clean":"2024-09-13T15:14:59.619580+0000","last_became_active":"2024-09-13T15:01:44.817350+0000","last_became_peered":"2024-09-13T15:01:44.817350+0000","last_unstale":"2024-09-13T15:14:59.619580+0000","last_undegraded":"2024-09-13T15:14:59.619580+0000","last_fullsized":"2024-09-13T15:14:59.619580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:10.913776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.295235+0000","last_change":"2024-09-13T15:01:44.838372+0000","last_active":"2024-09-13T15:16:02.295235+0000","last_peered":"2024-09-13T15:16:02.295235+0000","last_clean":"2024-09-13T15:16:02.295235+0000","last_became_active":"2024-09-13T15:01:44.837588+0000","last_became_peered":"2024-09-13T15:01:44.837588+0000","last_unstale":"2024-09-13T15:16:02.295235+0000","last_undegraded":"2024-09-13T15:16:02.295235+0000","last_fullsized":"2024-09-13T15:16:02.295235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:05:12.877936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389769+0000","last_change":"2024-09-13T15:01:44.828159+0000","last_active":"2024-09-13T15:15:28.389769+0000","last_peered":"2024-09-13T15:15:28.389769+0000","last_clean":"2024-09-13T15:15:28.389769+0000","last_became_active":"2024-09-13T15:01:44.827910+0000","last_became_peered":"2024-09-13T15:01:44.827910+0000","last_unstale":"2024-09-13T15:15:28.389769+0000","last_undegraded":"2024-09-13T15:15:28.389769+0000","last_fullsized":"2024-09-13T15:15:28.389769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:07:32.776119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"33'7","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.902776+0000","last_change":"2024-09-13T15:02:34.119204+0000","last_active":"2024-09-13T15:16:02.902776+0000","last_peered":"2024-09-13T15:16:02.902776+0000","last_clean":"2024-09-13T15:16:02.902776+0000","last_became_active":"2024-09-13T15:02:34.118621+0000","last_became_peered":"2024-09-13T15:02:34.118621+0000","last_unstale":"2024-09-13T15:16:02.902776+0000","last_undegraded":"2024-09-13T15:16:02.902776+0000","last_fullsized":"2024-09-13T15:16:02.902776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:33.356064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"33'8","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.193423+0000","last_change":"2024-09-13T15:01:44.831717+0000","last_active":"2024-09-13T15:15:28.193423+0000","last_peered":"2024-09-13T15:15:28.193423+0000","last_clean":"2024-09-13T15:15:28.193423+0000","last_became_active":"2024-09-13T15:01:44.831495+0000","last_became_peered":"2024-09-13T15:01:44.831495+0000","last_unstale":"2024-09-13T15:15:28.193423+0000","last_undegraded":"2024-09-13T15:15:28.193423+0000","last_fullsized":"2024-09-13T15:15:28.193423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:48.753543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:04.386790+0000","last_change":"2024-09-13T15:01:44.829698+0000","last_active":"2024-09-13T15:16:04.386790+0000","last_peered":"2024-09-13T15:16:04.386790+0000","last_clean":"2024-09-13T15:16:04.386790+0000","last_became_active":"2024-09-13T15:01:44.828999+0000","last_became_peered":"2024-09-13T15:01:44.828999+0000","last_unstale":"2024-09-13T15:16:04.386790+0000","last_undegraded":"2024-09-13T15:16:04.386790+0000","last_fullsized":"2024-09-13T15:16:04.386790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:30.591718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:15:19.592318+0000","last_change":"2024-09-13T15:01:44.817554+0000","last_active":"2024-09-13T15:15:19.592318+0000","last_peered":"2024-09-13T15:15:19.592318+0000","last_clean":"2024-09-13T15:15:19.592318+0000","last_became_active":"2024-09-13T15:01:44.816258+0000","last_became_peered":"2024-09-13T15:01:44.816258+0000","last_unstale":"2024-09-13T15:15:19.592318+0000","last_undegraded":"2024-09-13T15:15:19.592318+0000","last_fullsized":"2024-09-13T15:15:19.592318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:07.927802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"33'14","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:01.892531+0000","last_change":"2024-09-13T15:01:44.809979+0000","last_active":"2024-09-13T15:16:01.892531+0000","last_peered":"2024-09-13T15:16:01.892531+0000","last_clean":"2024-09-13T15:16:01.892531+0000","last_became_active":"2024-09-13T15:01:44.809687+0000","last_became_peered":"2024-09-13T15:01:44.809687+0000","last_unstale":"2024-09-13T15:16:01.892531+0000","last_undegraded":"2024-09-13T15:16:01.892531+0000","last_fullsized":"2024-09-13T15:16:01.892531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:45.583840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"33'9","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.497597+0000","last_change":"2024-09-13T15:02:34.119233+0000","last_active":"2024-09-13T15:15:58.497597+0000","last_peered":"2024-09-13T15:15:58.497597+0000","last_clean":"2024-09-13T15:15:58.497597+0000","last_became_active":"2024-09-13T15:02:34.118798+0000","last_became_peered":"2024-09-13T15:02:34.118798+0000","last_unstale":"2024-09-13T15:15:58.497597+0000","last_undegraded":"2024-09-13T15:15:58.497597+0000","last_fullsized":"2024-09-13T15:15:58.497597+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:12.367569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:50.837989+0000","last_change":"2024-09-13T15:01:44.848904+0000","last_active":"2024-09-13T15:15:50.837989+0000","last_peered":"2024-09-13T15:15:50.837989+0000","last_clean":"2024-09-13T15:15:50.837989+0000","last_became_active":"2024-09-13T15:01:44.846074+0000","last_became_peered":"2024-09-13T15:01:44.846074+0000","last_unstale":"2024-09-13T15:15:50.837989+0000","last_undegraded":"2024-09-13T15:15:50.837989+0000","last_fullsized":"2024-09-13T15:15:50.837989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:37.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.757358+0000","last_change":"2024-09-13T15:01:44.828243+0000","last_active":"2024-09-13T15:15:58.757358+0000","last_peered":"2024-09-13T15:15:58.757358+0000","last_clean":"2024-09-13T15:15:58.757358+0000","last_became_active":"2024-09-13T15:01:44.828024+0000","last_became_peered":"2024-09-13T15:01:44.828024+0000","last_unstale":"2024-09-13T15:15:58.757358+0000","last_undegraded":"2024-09-13T15:15:58.757358+0000","last_fullsized":"2024-09-13T15:15:58.757358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:28:47.388087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.095134+0000","last_change":"2024-09-13T15:01:44.808879+0000","last_active":"2024-09-13T15:15:57.095134+0000","last_peered":"2024-09-13T15:15:57.095134+0000","last_clean":"2024-09-13T15:15:57.095134+0000","last_became_active":"2024-09-13T15:01:44.808609+0000","last_became_peered":"2024-09-13T15:01:44.808609+0000","last_unstale":"2024-09-13T15:15:57.095134+0000","last_undegraded":"2024-09-13T15:15:57.095134+0000","last_fullsized":"2024-09-13T15:15:57.095134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:59.817452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"33'7","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389496+0000","last_change":"2024-09-13T15:01:44.811171+0000","last_active":"2024-09-13T15:15:28.389496+0000","last_peered":"2024-09-13T15:15:28.389496+0000","last_clean":"2024-09-13T15:15:28.389496+0000","last_became_active":"2024-09-13T15:01:44.809918+0000","last_became_peered":"2024-09-13T15:01:44.809918+0000","last_unstale":"2024-09-13T15:15:28.389496+0000","last_undegraded":"2024-09-13T15:15:28.389496+0000","last_fullsized":"2024-09-13T15:15:28.389496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:48.359429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.484061+0000","last_change":"2024-09-13T15:01:44.833663+0000","last_active":"2024-09-13T15:15:28.484061+0000","last_peered":"2024-09-13T15:15:28.484061+0000","last_clean":"2024-09-13T15:15:28.484061+0000","last_became_active":"2024-09-13T15:01:44.828737+0000","last_became_peered":"2024-09-13T15:01:44.828737+0000","last_unstale":"2024-09-13T15:15:28.484061+0000","last_undegraded":"2024-09-13T15:15:28.484061+0000","last_fullsized":"2024-09-13T15:15:28.484061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:08.579890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.696714+0000","last_change":"2024-09-13T15:01:44.851143+0000","last_active":"2024-09-13T15:15:58.696714+0000","last_peered":"2024-09-13T15:15:58.696714+0000","last_clean":"2024-09-13T15:15:58.696714+0000","last_became_active":"2024-09-13T15:01:44.850410+0000","last_became_peered":"2024-09-13T15:01:44.850410+0000","last_unstale":"2024-09-13T15:15:58.696714+0000","last_undegraded":"2024-09-13T15:15:58.696714+0000","last_fullsized":"2024-09-13T15:15:58.696714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:11.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'10","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:13:55.683421+0000","last_change":"2024-09-13T15:01:44.840082+0000","last_active":"2024-09-13T15:13:55.683421+0000","last_peered":"2024-09-13T15:13:55.683421+0000","last_clean":"2024-09-13T15:13:55.683421+0000","last_became_active":"2024-09-13T15:01:44.839371+0000","last_became_peered":"2024-09-13T15:01:44.839371+0000","last_unstale":"2024-09-13T15:13:55.683421+0000","last_undegraded":"2024-09-13T15:13:55.683421+0000","last_fullsized":"2024-09-13T15:13:55.683421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:13.433036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"33'9","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.952810+0000","last_change":"2024-09-13T15:01:44.850416+0000","last_active":"2024-09-13T15:15:57.952810+0000","last_peered":"2024-09-13T15:15:57.952810+0000","last_clean":"2024-09-13T15:15:57.952810+0000","last_became_active":"2024-09-13T15:01:44.849766+0000","last_became_peered":"2024-09-13T15:01:44.849766+0000","last_unstale":"2024-09-13T15:15:57.952810+0000","last_undegraded":"2024-09-13T15:15:57.952810+0000","last_fullsized":"2024-09-13T15:15:57.952810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:11.985610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389960+0000","last_change":"2024-09-13T15:01:44.837060+0000","last_active":"2024-09-13T15:15:28.389960+0000","last_peered":"2024-09-13T15:15:28.389960+0000","last_clean":"2024-09-13T15:15:28.389960+0000","last_became_active":"2024-09-13T15:01:44.836770+0000","last_became_peered":"2024-09-13T15:01:44.836770+0000","last_unstale":"2024-09-13T15:15:28.389960+0000","last_undegraded":"2024-09-13T15:15:28.389960+0000","last_fullsized":"2024-09-13T15:15:28.389960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:45.915852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'5","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:19.453771+0000","last_change":"2024-09-13T15:01:44.815867+0000","last_active":"2024-09-13T15:14:19.453771+0000","last_peered":"2024-09-13T15:14:19.453771+0000","last_clean":"2024-09-13T15:14:19.453771+0000","last_became_active":"2024-09-13T15:01:44.815116+0000","last_became_peered":"2024-09-13T15:01:44.815116+0000","last_unstale":"2024-09-13T15:14:19.453771+0000","last_undegraded":"2024-09-13T15:14:19.453771+0000","last_fullsized":"2024-09-13T15:14:19.453771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:02.814724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:20.816422+0000","last_change":"2024-09-13T15:01:44.850022+0000","last_active":"2024-09-13T15:14:20.816422+0000","last_peered":"2024-09-13T15:14:20.816422+0000","last_clean":"2024-09-13T15:14:20.816422+0000","last_became_active":"2024-09-13T15:01:44.849533+0000","last_became_peered":"2024-09-13T15:01:44.849533+0000","last_unstale":"2024-09-13T15:14:20.816422+0000","last_undegraded":"2024-09-13T15:14:20.816422+0000","last_fullsized":"2024-09-13T15:14:20.816422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:09.837692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:19.453803+0000","last_change":"2024-09-13T15:01:44.817139+0000","last_active":"2024-09-13T15:14:19.453803+0000","last_peered":"2024-09-13T15:14:19.453803+0000","last_clean":"2024-09-13T15:14:19.453803+0000","last_became_active":"2024-09-13T15:01:44.816416+0000","last_became_peered":"2024-09-13T15:01:44.816416+0000","last_unstale":"2024-09-13T15:14:19.453803+0000","last_undegraded":"2024-09-13T15:14:19.453803+0000","last_fullsized":"2024-09-13T15:14:19.453803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:38.382210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:37.845022+0000","last_change":"2024-09-13T15:02:33.747735+0000","last_active":"2024-09-13T15:14:37.845022+0000","last_peered":"2024-09-13T15:14:37.845022+0000","last_clean":"2024-09-13T15:14:37.845022+0000","last_became_active":"2024-09-13T15:02:33.747405+0000","last_became_peered":"2024-09-13T15:02:33.747405+0000","last_unstale":"2024-09-13T15:14:37.845022+0000","last_undegraded":"2024-09-13T15:14:37.845022+0000","last_fullsized":"2024-09-13T15:14:37.845022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:20.616184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.992814+0000","last_change":"2024-09-13T15:01:44.808264+0000","last_active":"2024-09-13T15:15:57.992814+0000","last_peered":"2024-09-13T15:15:57.992814+0000","last_clean":"2024-09-13T15:15:57.992814+0000","last_became_active":"2024-09-13T15:01:44.807776+0000","last_became_peered":"2024-09-13T15:01:44.807776+0000","last_unstale":"2024-09-13T15:15:57.992814+0000","last_undegraded":"2024-09-13T15:15:57.992814+0000","last_fullsized":"2024-09-13T15:15:57.992814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:17.637800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:18.534958+0000","last_change":"2024-09-13T15:01:44.804985+0000","last_active":"2024-09-13T15:14:18.534958+0000","last_peered":"2024-09-13T15:14:18.534958+0000","last_clean":"2024-09-13T15:14:18.534958+0000","last_became_active":"2024-09-13T15:01:44.803977+0000","last_became_peered":"2024-09-13T15:01:44.803977+0000","last_unstale":"2024-09-13T15:14:18.534958+0000","last_undegraded":"2024-09-13T15:14:18.534958+0000","last_fullsized":"2024-09-13T15:14:18.534958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:12.999738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:06.045422+0000","last_change":"2024-09-13T15:01:44.824666+0000","last_active":"2024-09-13T15:16:06.045422+0000","last_peered":"2024-09-13T15:16:06.045422+0000","last_clean":"2024-09-13T15:16:06.045422+0000","last_became_active":"2024-09-13T15:01:44.815381+0000","last_became_peered":"2024-09-13T15:01:44.815381+0000","last_unstale":"2024-09-13T15:16:06.045422+0000","last_undegraded":"2024-09-13T15:16:06.045422+0000","last_fullsized":"2024-09-13T15:16:06.045422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:12:17.680247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":5983482934,"num_objects":1612,"num_object_clones":0,"num_object_copies":6448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1612,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2169537,"num_write_kb":31079058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11786485760,"data_stored":11786485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147707,"ondisk_log_size":147707,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":368,"ondisk_log_size":368,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":108901215,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":501,"num_read_kb":110953,"num_write":3231,"num_write_kb":107176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":74,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":218046464,"data_stored":217802241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3140,"ondisk_log_size":3140,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542321,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2252656,"kb_used_data":1359464,"kb_used_omap":1,"kb_used_meta":891134,"kb_avail":92119184,"statfs":{"total":96636764160,"available":94330044416,"internally_reserved":0,"allocated":1392091136,"data_stored":1391853235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":912521675},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":4.9580000000000002,"5min":7.657,"15min":4.8689999999999998},"min":{"1min":0.497,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":108.818,"5min":254.13499999999999,"15min":254.13499999999999},"last":108.818},{"interface":"front","average":{"1min":5.016,"5min":7.7190000000000003,"15min":4.883},"min":{"1min":0.46100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":108.85299999999999,"5min":254.119,"15min":254.119},"last":108.85299999999999}]},{"osd":1,"last update":"Fri Sep 13 15:16:00 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":14.494999999999999,"15min":8.6910000000000007},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.29999999999999999},"max":{"1min":4.3449999999999998,"5min":281.399,"15min":281.399},"last":116.92400000000001},{"interface":"front","average":{"1min":1.1379999999999999,"5min":12.275,"15min":9.9440000000000008},"min":{"1min":0.41099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.3120000000000003,"5min":265.74299999999999,"15min":557.92399999999998},"last":116.828}]},{"osd":2,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":5.1769999999999996,"5min":9.6869999999999994,"15min":5.5309999999999997},"min":{"1min":0.47099999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":119.023,"5min":280.29700000000003,"15min":280.29700000000003},"last":119.023},{"interface":"front","average":{"1min":5.2130000000000001,"5min":9.0009999999999994,"15min":5.2590000000000003},"min":{"1min":0.48299999999999998,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":115.961,"5min":274.03500000000003,"15min":274.03500000000003},"last":115.961}]},{"osd":3,"last update":"Fri Sep 13 15:16:03 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":10.202999999999999,"15min":6.407},"min":{"1min":0.377,"5min":0.377,"15min":0.32300000000000001},"max":{"1min":5.0300000000000002,"5min":261.36000000000001,"15min":261.36000000000001},"last":111.05500000000001},{"interface":"front","average":{"1min":0.94399999999999995,"5min":7.5250000000000004,"15min":5.0149999999999997},"min":{"1min":0.502,"5min":0.37,"15min":0.29599999999999999},"max":{"1min":5.2889999999999997,"5min":252.90000000000001,"15min":252.90000000000001},"last":111.715}]},{"osd":4,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":2.141,"15min":1.3029999999999999},"min":{"1min":0.60199999999999998,"5min":0.248,"15min":0.23699999999999999},"max":{"1min":2.0089999999999999,"5min":20.928999999999998,"15min":20.928999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.2250000000000001,"5min":2.2869999999999999,"15min":1.379},"min":{"1min":0.61199999999999999,"5min":0.254,"15min":0.24199999999999999},"max":{"1min":6.4589999999999996,"5min":20.893000000000001,"15min":20.893000000000001},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.123,"15min":1.093},"min":{"1min":0.30299999999999999,"5min":0.248,"15min":0.248},"max":{"1min":1.2869999999999999,"5min":11.800000000000001,"15min":11.800000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":1.02,"5min":1.0649999999999999,"15min":1.014},"min":{"1min":0.34100000000000003,"5min":0.252,"15min":0.252},"max":{"1min":2.625,"5min":8.593,"15min":8.593},"last":0.41899999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.988,"15min":1.377},"min":{"1min":0.42899999999999999,"5min":0.29699999999999999,"15min":0.27700000000000002},"max":{"1min":2.677,"5min":20.835000000000001,"15min":20.835000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.177,"5min":1.716,"15min":1.244},"min":{"1min":0.53900000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":4.9550000000000001,"5min":21.518000000000001,"15min":21.518000000000001},"last":0.57499999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542322,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2625884,"kb_used_data":1483412,"kb_used_omap":1,"kb_used_meta":1140414,"kb_avail":91745956,"statfs":{"total":96636764160,"available":93947858944,"internally_reserved":0,"allocated":1519013888,"data_stored":1518791009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1167784391},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":9.2059999999999995,"5min":13.884,"15min":5.5709999999999997},"min":{"1min":0.32300000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":113.221,"5min":343.02800000000002,"15min":343.02800000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":8.6219999999999999,"5min":13.922000000000001,"15min":5.3899999999999997},"min":{"1min":0.32000000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":114.724,"5min":370.00099999999998,"15min":370.00099999999998},"last":0.45900000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":8.6010000000000009,"5min":15.124000000000001,"15min":6.077},"min":{"1min":0.52800000000000002,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":114.68000000000001,"5min":236.12100000000001,"15min":236.12100000000001},"last":2.0409999999999999},{"interface":"front","average":{"1min":9.0470000000000006,"5min":16.638999999999999,"15min":7.2080000000000002},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.32300000000000001},"max":{"1min":114.613,"5min":274.46800000000002,"15min":274.46800000000002},"last":4.9909999999999997}]},{"osd":2,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":8.4060000000000006,"5min":8.4359999999999999,"15min":3.5990000000000002},"min":{"1min":0.36499999999999999,"5min":0.311,"15min":0.311},"max":{"1min":111.875,"5min":249.75700000000001,"15min":249.75700000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":9.7959999999999994,"5min":9.5779999999999994,"15min":4.0010000000000003},"min":{"1min":0.36899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":111.07899999999999,"5min":283.36700000000002,"15min":283.36700000000002},"last":0.752}]},{"osd":3,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":9.407,"5min":9.8840000000000003,"15min":4.423},"min":{"1min":0.40100000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":113.355,"5min":239.05099999999999,"15min":239.05099999999999},"last":6.6459999999999999},{"interface":"front","average":{"1min":9.0540000000000003,"5min":15.593,"15min":6.3259999999999996},"min":{"1min":0.39000000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":111.92100000000001,"5min":352.03800000000001,"15min":352.03800000000001},"last":0.95699999999999996}]},{"osd":4,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":3.8969999999999998,"15min":2.1880000000000002},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.23300000000000001},"max":{"1min":9.3379999999999992,"5min":37.261000000000003,"15min":91.054000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":3.9700000000000002,"15min":2.238},"min":{"1min":0.35299999999999998,"5min":0.254,"15min":0.254},"max":{"1min":8.9009999999999998,"5min":52.167000000000002,"15min":99.084000000000003},"last":0.42099999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":1.306,"15min":1.036},"min":{"1min":0.28699999999999998,"5min":0.253,"15min":0.253},"max":{"1min":2.5169999999999999,"5min":15.196,"15min":15.196},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.748,"5min":1.6359999999999999,"15min":1.1910000000000001},"min":{"1min":0.36299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.4510000000000001,"5min":25.192,"15min":25.192},"last":0.49199999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":1.982,"15min":1.3149999999999999},"min":{"1min":0.33600000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":2.5990000000000002,"5min":37.219999999999999,"15min":37.219999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.749,"5min":1.337,"15min":1.133},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.5710000000000002,"5min":14.654,"15min":14.654},"last":0.59899999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542321,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1901684,"kb_used_data":1105260,"kb_used_omap":1,"kb_used_meta":792318,"kb_avail":92470156,"statfs":{"total":96636764160,"available":94689439744,"internally_reserved":0,"allocated":1131786240,"data_stored":1131541927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":811334086},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":3.613,"15min":2.6589999999999998},"min":{"1min":0.27600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0109999999999999,"5min":70.611000000000004,"15min":94.078999999999994},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":3.3210000000000002,"15min":2.0489999999999999},"min":{"1min":0.60099999999999998,"5min":0.27800000000000002,"15min":0.27000000000000002},"max":{"1min":1.681,"5min":76.866,"15min":76.866},"last":0.93300000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":5.2690000000000001,"15min":4.3250000000000002},"min":{"1min":0.66500000000000004,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.708,"5min":214.21199999999999,"15min":214.21199999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":4.6760000000000002,"15min":6.625},"min":{"1min":0.57999999999999996,"5min":0.317,"15min":0.317},"max":{"1min":1.6559999999999999,"5min":206.20699999999999,"15min":559.69500000000005},"last":0.76400000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":3.3490000000000002,"15min":2.3210000000000002},"min":{"1min":0.64200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.375,"5min":67.366,"15min":67.366},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.0209999999999999,"5min":2.8820000000000001,"15min":2.0659999999999998},"min":{"1min":0.67100000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.462,"5min":65.522000000000006,"15min":65.522000000000006},"last":0.84199999999999997}]},{"osd":3,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":5.0529999999999999,"15min":3.1219999999999999},"min":{"1min":0.59799999999999998,"5min":0.40300000000000002,"15min":0.37},"max":{"1min":1.4350000000000001,"5min":169.30600000000001,"15min":169.30600000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.091,"5min":6.7750000000000004,"15min":4.1289999999999996},"min":{"1min":0.70199999999999996,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.736,"5min":169.33799999999999,"15min":169.33799999999999},"last":1.0049999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":2.4340000000000002,"15min":1.4059999999999999},"min":{"1min":0.34899999999999998,"5min":0.26100000000000001,"15min":0.223},"max":{"1min":1.6200000000000001,"5min":36.151000000000003,"15min":36.151000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.125,"5min":2.581,"15min":1.482},"min":{"1min":0.44900000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":1.6539999999999999,"5min":36.219000000000001,"15min":36.219000000000001},"last":0.89700000000000002}]},{"osd":6,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.7310000000000001,"15min":1.2170000000000001},"min":{"1min":0.39900000000000002,"5min":0.27300000000000002,"15min":0.25600000000000001},"max":{"1min":1.8500000000000001,"5min":25.734000000000002,"15min":25.734000000000002},"last":0.878},{"interface":"front","average":{"1min":1.236,"5min":1.5489999999999999,"15min":1.169},"min":{"1min":0.54600000000000004,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.6140000000000001,"5min":29.106999999999999,"15min":29.106999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.014,"15min":0.98199999999999998},"min":{"1min":0.497,"5min":0.314,"15min":0.314},"max":{"1min":1.6359999999999999,"5min":10.798,"15min":10.798},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.1559999999999999,"15min":1.0589999999999999},"min":{"1min":0.51900000000000002,"5min":0.314,"15min":0.29699999999999999},"max":{"1min":1.718,"5min":12.874000000000001,"15min":12.874000000000001},"last":0.97399999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542320,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2824368,"kb_used_data":1744104,"kb_used_omap":1,"kb_used_meta":1080254,"kb_avail":91547472,"statfs":{"total":96636764160,"available":93744611328,"internally_reserved":0,"allocated":1785962496,"data_stored":1785739665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1106180550},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":2.6800000000000002,"15min":1.6659999999999999},"min":{"1min":0.47099999999999997,"5min":0.28299999999999997,"15min":0.27100000000000002},"max":{"1min":1,"5min":18.741,"15min":18.741},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":3.1909999999999998,"15min":1.964},"min":{"1min":0.316,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":4.2850000000000001,"5min":27.876999999999999,"15min":27.876999999999999},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":15.648999999999999,"15min":6.7729999999999997},"min":{"1min":0.47299999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0089999999999999,"5min":1296.6300000000001,"15min":1296.6300000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.75,"5min":3.3599999999999999,"15min":2.6190000000000002},"min":{"1min":0.45400000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.109,"5min":25.800999999999998,"15min":47.923999999999999},"last":0.85999999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":2.8319999999999999,"15min":1.8480000000000001},"min":{"1min":0.55300000000000005,"5min":0.309,"15min":0.29999999999999999},"max":{"1min":4.8799999999999999,"5min":23.760999999999999,"15min":23.760999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.94299999999999995,"5min":2.746,"15min":1.899},"min":{"1min":0.40000000000000002,"5min":0.34000000000000002,"15min":0.32500000000000001},"max":{"1min":3.2839999999999998,"5min":23.709,"15min":30.510000000000002},"last":0.755}]},{"osd":3,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":4.9370000000000003,"15min":2.9359999999999999},"min":{"1min":0.48099999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.6360000000000001,"5min":94.281000000000006,"15min":94.281000000000006},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.232,"5min":4.9859999999999998,"15min":3.2210000000000001},"min":{"1min":0.72699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.6699999999999999,"5min":94.319999999999993,"15min":94.319999999999993},"last":0.97599999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.5249999999999999,"15min":1.1599999999999999},"min":{"1min":0.86699999999999999,"5min":0.245,"15min":0.245},"max":{"1min":2.9249999999999998,"5min":18.623999999999999,"15min":18.623999999999999},"last":1.133},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.4630000000000001,"15min":1.1319999999999999},"min":{"1min":0.72099999999999997,"5min":0.246,"15min":0.246},"max":{"1min":4.2469999999999999,"5min":16.155999999999999,"15min":16.155999999999999},"last":0.91500000000000004}]},{"osd":6,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":2.2090000000000001,"15min":1.462},"min":{"1min":0.42999999999999999,"5min":0.27000000000000002,"15min":0.24099999999999999},"max":{"1min":1.226,"5min":27.984000000000002,"15min":27.984000000000002},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.052,"5min":2.1019999999999999,"15min":1.367},"min":{"1min":0.33700000000000002,"5min":0.247,"15min":0.23799999999999999},"max":{"1min":3.21,"5min":28.077000000000002,"15min":28.077000000000002},"last":1}]},{"osd":7,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.9830000000000001,"15min":1.375},"min":{"1min":0.38300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.948,"5min":25.266999999999999,"15min":25.266999999999999},"last":1.028},{"interface":"front","average":{"1min":1.1519999999999999,"5min":2.0800000000000001,"15min":1.4770000000000001},"min":{"1min":0.41399999999999998,"5min":0.34300000000000003,"15min":0.32600000000000001},"max":{"1min":2.0289999999999999,"5min":25.309999999999999,"15min":25.309999999999999},"last":1.0780000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542314,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3457596,"kb_used_data":1975284,"kb_used_omap":1,"kb_used_meta":1482302,"kb_avail":90914244,"statfs":{"total":96636764160,"available":93096185856,"internally_reserved":0,"allocated":2022690816,"data_stored":2022460117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1517877704},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:15:13 2024","interfaces":[{"interface":"back","average":{"1min":5.1440000000000001,"5min":10.525,"15min":6.4550000000000001},"min":{"1min":0.28999999999999998,"5min":0.28000000000000003,"15min":0.253},"max":{"1min":21.207000000000001,"5min":108.956,"15min":170.35599999999999},"last":2.6190000000000002},{"interface":"front","average":{"1min":3.6619999999999999,"5min":6.6130000000000004,"15min":4.5049999999999999},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":19.838999999999999,"5min":63.624000000000002,"15min":168.80699999999999},"last":2.6659999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:15:12 2024","interfaces":[{"interface":"back","average":{"1min":5.5529999999999999,"5min":10.266999999999999,"15min":4.6299999999999999},"min":{"1min":0.33400000000000002,"5min":0.32500000000000001,"15min":0.28499999999999998},"max":{"1min":24.631,"5min":92.722999999999999,"15min":92.722999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":7.992,"5min":12.541,"15min":6.2530000000000001},"min":{"1min":0.308,"5min":0.29899999999999999,"15min":0.26600000000000001},"max":{"1min":26.803999999999998,"5min":89.245000000000005,"15min":104.51300000000001},"last":0.94999999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:15:12 2024","interfaces":[{"interface":"back","average":{"1min":5.6040000000000001,"5min":7.1589999999999998,"15min":3.887},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":25.036000000000001,"5min":74.825000000000003,"15min":74.825000000000003},"last":1.675},{"interface":"front","average":{"1min":5.6719999999999997,"5min":7.6130000000000004,"15min":3.863},"min":{"1min":0.439,"5min":0.439,"15min":0.36499999999999999},"max":{"1min":25.062999999999999,"5min":74.870999999999995,"15min":74.870999999999995},"last":1.7050000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:15:12 2024","interfaces":[{"interface":"back","average":{"1min":7.335,"5min":6.2000000000000002,"15min":3.0510000000000002},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":40.064999999999998,"5min":85.710999999999999,"15min":85.710999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":7.4740000000000002,"5min":8.1600000000000001,"15min":3.9399999999999999},"min":{"1min":0.68000000000000005,"5min":0.443,"15min":0.377},"max":{"1min":39.972000000000001,"5min":105.875,"15min":105.875},"last":1.601}]},{"osd":5,"last update":"Fri Sep 13 15:15:12 2024","interfaces":[{"interface":"back","average":{"1min":7.5570000000000004,"5min":6.4960000000000004,"15min":3.3500000000000001},"min":{"1min":0.66300000000000003,"5min":0.46700000000000003,"15min":0.40400000000000003},"max":{"1min":39.557000000000002,"5min":95.748999999999995,"15min":95.748999999999995},"last":1.6419999999999999},{"interface":"front","average":{"1min":4.1479999999999997,"5min":8.6259999999999994,"15min":4.3239999999999998},"min":{"1min":0.51900000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":36.648000000000003,"5min":100.325,"15min":100.325},"last":0.35599999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:15:12 2024","interfaces":[{"interface":"back","average":{"1min":3.7109999999999999,"5min":5.2140000000000004,"15min":2.742},"min":{"1min":0.59299999999999997,"5min":0.432,"15min":0.432},"max":{"1min":36.561999999999998,"5min":85.492999999999995,"15min":85.492999999999995},"last":0.433},{"interface":"front","average":{"1min":3.77,"5min":6.4459999999999997,"15min":3.2200000000000002},"min":{"1min":0.626,"5min":0.54300000000000004,"15min":0.501},"max":{"1min":36.604999999999997,"5min":100.376,"15min":100.376},"last":0.54100000000000004}]},{"osd":7,"last update":"Fri Sep 13 15:15:13 2024","interfaces":[{"interface":"back","average":{"1min":6.2169999999999996,"5min":6.0270000000000001,"15min":3.0830000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":43.624000000000002,"5min":97.268000000000001,"15min":97.268000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":4.7009999999999996,"5min":6.4909999999999997,"15min":3.5579999999999998},"min":{"1min":0.66200000000000003,"5min":0.50800000000000001,"15min":0.48599999999999999},"max":{"1min":36.68,"5min":100.583,"15min":100.583},"last":0.51000000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542320,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2064900,"kb_used_data":1260668,"kb_used_omap":1,"kb_used_meta":804222,"kb_avail":92306940,"statfs":{"total":96636764160,"available":94522306560,"internally_reserved":0,"allocated":1290924032,"data_stored":1290689713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":823523782},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:15:09 2024","interfaces":[{"interface":"back","average":{"1min":8.2430000000000003,"5min":7.5419999999999998,"15min":3.7440000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.249},"max":{"1min":108.04600000000001,"5min":170.77199999999999,"15min":170.77199999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":8.8529999999999998,"5min":12.016,"15min":5.383},"min":{"1min":0.47499999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":108.004,"5min":237.53800000000001,"15min":237.53800000000001},"last":0.316}]},{"osd":1,"last update":"Fri Sep 13 15:15:09 2024","interfaces":[{"interface":"back","average":{"1min":8.1140000000000008,"5min":6.6299999999999999,"15min":3.798},"min":{"1min":0.312,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":109.104,"5min":109.104,"15min":109.104},"last":0.39600000000000002},{"interface":"front","average":{"1min":10.433999999999999,"5min":12.935,"15min":5.8600000000000003},"min":{"1min":0.45800000000000002,"5min":0.36199999999999999,"15min":0.30499999999999999},"max":{"1min":108.095,"5min":295.73500000000001,"15min":295.73500000000001},"last":0.37}]},{"osd":3,"last update":"Fri Sep 13 15:15:09 2024","interfaces":[{"interface":"back","average":{"1min":9.2859999999999996,"5min":5.9820000000000002,"15min":3.7090000000000001},"min":{"1min":0.49099999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":109.152,"5min":109.152,"15min":109.152},"last":0.45100000000000001},{"interface":"front","average":{"1min":11.000999999999999,"5min":9.1010000000000009,"15min":4.8369999999999997},"min":{"1min":0.497,"5min":0.371,"15min":0.371},"max":{"1min":110.03700000000001,"5min":264.87599999999998,"15min":264.87599999999998},"last":0.42299999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:15:09 2024","interfaces":[{"interface":"back","average":{"1min":5.5919999999999996,"5min":7.5590000000000002,"15min":3.9009999999999998},"min":{"1min":0.54000000000000004,"5min":0.41599999999999998,"15min":0.38100000000000001},"max":{"1min":28.959,"5min":251.97300000000001,"15min":251.97300000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":3.6030000000000002,"5min":4.7190000000000003,"15min":2.5739999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.34899999999999998},"max":{"1min":19.145,"5min":42.012,"15min":42.012},"last":0.80100000000000005}]},{"osd":5,"last update":"Fri Sep 13 15:15:09 2024","interfaces":[{"interface":"back","average":{"1min":2.5760000000000001,"5min":3.9489999999999998,"15min":2.512},"min":{"1min":0.54100000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":11.787000000000001,"5min":41.942999999999998,"15min":41.942999999999998},"last":0.84599999999999997},{"interface":"front","average":{"1min":2.637,"5min":7.0819999999999999,"15min":3.5},"min":{"1min":0.57499999999999996,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":11.807,"5min":237.58799999999999,"15min":237.58799999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Fri Sep 13 15:15:09 2024","interfaces":[{"interface":"back","average":{"1min":2.8690000000000002,"5min":3.8460000000000001,"15min":2.4510000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":11.686999999999999,"5min":41.981999999999999,"15min":41.981999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":2.9470000000000001,"5min":4.0830000000000002,"15min":2.5619999999999998},"min":{"1min":0.502,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":11.721,"5min":41.890999999999998,"15min":41.890999999999998},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Sep 13 15:15:09 2024","interfaces":[{"interface":"back","average":{"1min":3.5960000000000001,"5min":6.306,"15min":3.4180000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":16.239000000000001,"5min":237.626,"15min":237.626},"last":0.751},{"interface":"front","average":{"1min":3.5289999999999999,"5min":6.7649999999999997,"15min":3.2719999999999998},"min":{"1min":0.499,"5min":0.432,"15min":0.39200000000000002},"max":{"1min":12.775,"5min":252.005,"15min":252.005},"last":0.627}]}]},{"osd":1,"up_from":14,"seq":60129542315,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3279756,"kb_used_data":1869188,"kb_used_omap":1,"kb_used_meta":1406462,"kb_avail":91092084,"statfs":{"total":96636764160,"available":93278294016,"internally_reserved":0,"allocated":1914048512,"data_stored":1913821952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1440217542},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,2,3,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":3.512,"5min":6.5830000000000002,"15min":4.0949999999999998},"min":{"1min":0.26400000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":17.056000000000001,"5min":104.246,"15min":104.246},"last":4.843},{"interface":"front","average":{"1min":2.6389999999999998,"5min":8.3230000000000004,"15min":4.0309999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28599999999999998},"max":{"1min":10.380000000000001,"5min":103.157,"15min":103.157},"last":1.651}]},{"osd":2,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":5.3090000000000002,"5min":8.0289999999999999,"15min":5.0979999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.32200000000000001},"max":{"1min":25.789000000000001,"5min":113.79600000000001,"15min":191.00899999999999},"last":1.385},{"interface":"front","average":{"1min":2.23,"5min":6.1150000000000002,"15min":3.3319999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.318},"max":{"1min":10.678000000000001,"5min":47.537999999999997,"15min":47.537999999999997},"last":1.6930000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":5.2389999999999999,"5min":8.3290000000000006,"15min":3.9630000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.377},"max":{"1min":18.701000000000001,"5min":52.975000000000001,"15min":52.975000000000001},"last":3.1480000000000001},{"interface":"front","average":{"1min":3.3359999999999999,"5min":7.806,"15min":3.9159999999999999},"min":{"1min":0.50800000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":11.565,"5min":104.319,"15min":104.319},"last":3.831}]},{"osd":4,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":4.5019999999999998,"5min":7.1369999999999996,"15min":3.9420000000000002},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.38700000000000001},"max":{"1min":18.713000000000001,"5min":125.44799999999999,"15min":125.44799999999999},"last":1.738},{"interface":"front","average":{"1min":4.4630000000000001,"5min":9.0830000000000002,"15min":4.1500000000000004},"min":{"1min":0.53800000000000003,"5min":0.47399999999999998,"15min":0.38800000000000001},"max":{"1min":17.100000000000001,"5min":117.842,"15min":117.842},"last":1.7829999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":2.0870000000000002,"5min":7.9459999999999997,"15min":3.9449999999999998},"min":{"1min":0.53100000000000003,"5min":0.436,"15min":0.40000000000000002},"max":{"1min":10.519,"5min":154.875,"15min":154.875},"last":1.8029999999999999},{"interface":"front","average":{"1min":4.6150000000000002,"5min":7.3570000000000002,"15min":4.0620000000000003},"min":{"1min":0.65000000000000002,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":25.745000000000001,"5min":126.485,"15min":126.485},"last":1.3480000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":1.978,"5min":6.5679999999999996,"15min":3.6200000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":7.476,"5min":103.191,"15min":103.191},"last":1.825},{"interface":"front","average":{"1min":2.133,"5min":5.7320000000000002,"15min":3.1829999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.42399999999999999},"max":{"1min":10.598000000000001,"5min":104.28400000000001,"15min":104.28400000000001},"last":1.774}]},{"osd":7,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":4.7050000000000001,"5min":6.9290000000000003,"15min":3.5339999999999998},"min":{"1min":0.81599999999999995,"5min":0.53700000000000003,"15min":0.438},"max":{"1min":25.879000000000001,"5min":77.366,"15min":77.366},"last":1.419},{"interface":"front","average":{"1min":2.1589999999999998,"5min":7.8719999999999999,"15min":3.855},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":7.5119999999999996,"5min":112.69499999999999,"15min":112.69499999999999},"last":1.857}]}]},{"osd":0,"up_from":14,"seq":60129542319,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2352308,"kb_used_data":1425388,"kb_used_omap":1,"kb_used_meta":922814,"kb_avail":92019532,"statfs":{"total":96636764160,"available":94228000768,"internally_reserved":0,"allocated":1459597312,"data_stored":1459366050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":944961990},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:15:07 2024","interfaces":[{"interface":"back","average":{"1min":2.7480000000000002,"5min":7.5750000000000002,"15min":4.3109999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.22900000000000001},"max":{"1min":13.257999999999999,"5min":279.90600000000001,"15min":279.90600000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":3.0649999999999999,"5min":8.4199999999999999,"15min":6.2359999999999998},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.28100000000000003},"max":{"1min":9.952,"5min":279.70299999999997,"15min":510.15699999999998},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:15:07 2024","interfaces":[{"interface":"back","average":{"1min":2.948,"5min":7.1040000000000001,"15min":3.3170000000000002},"min":{"1min":0.31,"5min":0.29699999999999999,"15min":0.26000000000000001},"max":{"1min":11.173999999999999,"5min":101.73399999999999,"15min":101.73399999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":3.2879999999999998,"5min":5.1360000000000001,"15min":2.738},"min":{"1min":0.39400000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":9.8900000000000006,"5min":35.527999999999999,"15min":35.527999999999999},"last":0.40999999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:15:07 2024","interfaces":[{"interface":"back","average":{"1min":4.6529999999999996,"5min":8.7230000000000008,"15min":4.6470000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.28699999999999998},"max":{"1min":12.111000000000001,"5min":101.76300000000001,"15min":101.76300000000001},"last":0.439},{"interface":"front","average":{"1min":4.4770000000000003,"5min":7.7690000000000001,"15min":4.3810000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38700000000000001},"max":{"1min":11.948,"5min":75.828000000000003,"15min":75.828000000000003},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Sep 13 15:15:13 2024","interfaces":[{"interface":"back","average":{"1min":6.1100000000000003,"5min":4.9359999999999999,"15min":2.722},"min":{"1min":0.58299999999999996,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":29.494,"5min":30.207999999999998,"15min":30.207999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":4.4210000000000003,"5min":4.1189999999999998,"15min":2.5249999999999999},"min":{"1min":0.66000000000000003,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":27.282,"5min":30.135000000000002,"15min":30.135000000000002},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:15:13 2024","interfaces":[{"interface":"back","average":{"1min":5.2359999999999998,"5min":5.569,"15min":2.8580000000000001},"min":{"1min":0.46899999999999997,"5min":0.377,"15min":0.377},"max":{"1min":47.112000000000002,"5min":101.702,"15min":101.702},"last":0.81200000000000006},{"interface":"front","average":{"1min":5.8280000000000003,"5min":3.8690000000000002,"15min":2.2930000000000001},"min":{"1min":0.56000000000000005,"5min":0.434,"15min":0.379},"max":{"1min":43.249000000000002,"5min":43.249000000000002,"15min":43.249000000000002},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:15:07 2024","interfaces":[{"interface":"back","average":{"1min":6.1420000000000003,"5min":4.7770000000000001,"15min":2.6469999999999998},"min":{"1min":0.628,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":45.140000000000001,"5min":45.140000000000001,"15min":45.140000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":5.6829999999999998,"5min":4.9000000000000004,"15min":2.7429999999999999},"min":{"1min":0.52500000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":44.737000000000002,"5min":44.737000000000002,"15min":44.737000000000002},"last":0.77800000000000002}]},{"osd":7,"last update":"Fri Sep 13 15:15:07 2024","interfaces":[{"interface":"back","average":{"1min":5.5529999999999999,"5min":5.8419999999999996,"15min":2.9950000000000001},"min":{"1min":0.49299999999999999,"5min":0.42999999999999999,"15min":0.42499999999999999},"max":{"1min":49.326000000000001,"5min":101.655,"15min":101.655},"last":0.64500000000000002},{"interface":"front","average":{"1min":5.6719999999999997,"5min":4.4320000000000004,"15min":2.6110000000000002},"min":{"1min":0.56000000000000005,"5min":0.51500000000000001,"15min":0.434},"max":{"1min":46.649000000000001,"5min":46.649000000000001,"15min":46.649000000000001},"last":0.79100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25194496,"data_stored":25166698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25194496,"data_stored":25167848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4300800,"data_stored":4266393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25038848,"data_stored":25008061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41967616,"data_stored":41944697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21020672,"data_stored":20976412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29155328,"data_stored":29132361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":46174208,"data_stored":46139771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1422962688,"data_stored":1422962688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1762664448,"data_stored":1762664448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1221251072,"data_stored":1221251072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1967931392,"data_stored":1967931392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1611513856,"data_stored":1611513856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1055879168,"data_stored":1055879168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1487400960,"data_stored":1487400960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1256882176,"data_stored":1256882176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:16:12.118 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:16:12.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.297+0000 7f9005000640 1 Processor -- start 2024-09-13T15:16:12.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.297+0000 7f9005000640 1 -- start start 2024-09-13T15:16:12.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.297+0000 7f9005000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9000150fe0 0x7f90000c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:12.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.297+0000 7f9005000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f90000c8780 0x7f900006f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:12.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.297+0000 7f9005000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90000c20e0 con 0x7f90001513c0 2024-09-13T15:16:12.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.297+0000 7f9005000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f900015af50 con 0x7f90000c8780 2024-09-13T15:16:12.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.297+0000 7f9005000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900015b230 con 0x7f9000150fe0 2024-09-13T15:16:12.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.301+0000 7f8ffe800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f90000c8780 0x7f900006f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:12.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.301+0000 7f8ffe800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f90000c8780 0x7f900006f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45852/0 (socket says 172.21.15.7:45852) 2024-09-13T15:16:12.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.301+0000 7f8ffe800640 1 -- 172.21.15.7:0/3373531181 learned_addr learned my addr 172.21.15.7:0/3373531181 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:12.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.301+0000 7f8ffde00640 1 --2- 172.21.15.7:0/3373531181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9000150fe0 0x7f90000c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:12.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.301+0000 7f8ffe800640 1 -- 172.21.15.7:0/3373531181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9000150fe0 msgr2=0x7f90000c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:12.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.301+0000 7f8ffe800640 1 --2- 172.21.15.7:0/3373531181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9000150fe0 0x7f90000c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.301+0000 7f8ffe800640 1 -- 172.21.15.7:0/3373531181 >> v1:172.21.15.77:6789/0 conn(0x7f90001513c0 legacy=0x7f900006ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:12.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.301+0000 7f8ffe800640 1 -- 172.21.15.7:0/3373531181 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90000c3b70 con 0x7f90000c8780 2024-09-13T15:16:12.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.305+0000 7f8ffe800640 1 --2- 172.21.15.7:0/3373531181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90000c8780 0x7f900006f620 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009e50 tx=0x7f8ff801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47aeb5419f42398f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:12.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.305+0000 7f8ffd400640 1 -- 172.21.15.7:0/3373531181 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80a5770 con 0x7f90000c8780 2024-09-13T15:16:12.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.305+0000 7f8ffd400640 1 -- 172.21.15.7:0/3373531181 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff80a58d0 con 0x7f90000c8780 2024-09-13T15:16:12.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.305+0000 7f8ffd400640 1 -- 172.21.15.7:0/3373531181 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80a5c60 con 0x7f90000c8780 2024-09-13T15:16:12.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.305+0000 7f9005000640 1 -- 172.21.15.7:0/3373531181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90000c8780 msgr2=0x7f900006f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:12.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.305+0000 7f9005000640 1 --2- 172.21.15.7:0/3373531181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90000c8780 0x7f900006f620 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009e50 tx=0x7f8ff801c9a0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.305+0000 7f9005000640 1 -- 172.21.15.7:0/3373531181 shutdown_connections 2024-09-13T15:16:12.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.305+0000 7f9005000640 1 --2- 172.21.15.7:0/3373531181 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90000c8780 0x7f900006f620 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.305+0000 7f9005000640 1 --2- 172.21.15.7:0/3373531181 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9000150fe0 0x7f90000c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.305+0000 7f9005000640 1 -- 172.21.15.7:0/3373531181 >> 172.21.15.7:0/3373531181 conn(0x7f9000071730 msgr2=0x7f9000071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:12.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.305+0000 7f9005000640 1 -- 172.21.15.7:0/3373531181 shutdown_connections 2024-09-13T15:16:12.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.305+0000 7f9005000640 1 -- 172.21.15.7:0/3373531181 wait complete. 2024-09-13T15:16:12.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.305+0000 7f9005000640 1 Processor -- start 2024-09-13T15:16:12.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.305+0000 7f9005000640 1 -- start start 2024-09-13T15:16:12.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f9005000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90000c8780 0x7f9000069f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:12.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f9005000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9000150fe0 0x7f90000c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:12.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f9005000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90001513c0 0x7f90000c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:12.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f9005000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90000c29d0 con 0x7f90001513c0 2024-09-13T15:16:12.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f9005000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900006b560 con 0x7f9000150fe0 2024-09-13T15:16:12.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f9005000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90000cad60 con 0x7f90000c8780 2024-09-13T15:16:12.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f8ffe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90001513c0 0x7f90000c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:12.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f8ffe800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90001513c0 0x7f90000c41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45862/0 (socket says 172.21.15.7:45862) 2024-09-13T15:16:12.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f8ffe800640 1 -- 172.21.15.7:0/3051282267 learned_addr learned my addr 172.21.15.7:0/3051282267 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:12.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f8ffde00640 1 --2- 172.21.15.7:0/3051282267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90000c8780 0x7f9000069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:12.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f8ff7e00640 1 --2- 172.21.15.7:0/3051282267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9000150fe0 0x7f90000c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:12.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f8ffe800640 1 -- 172.21.15.7:0/3051282267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90000c8780 msgr2=0x7f9000069f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:12.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f8ffe800640 1 --2- 172.21.15.7:0/3051282267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90000c8780 0x7f9000069f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f8ffe800640 1 -- 172.21.15.7:0/3051282267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9000150fe0 msgr2=0x7f90000c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:12.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f8ffe800640 1 --2- 172.21.15.7:0/3051282267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9000150fe0 0x7f90000c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f8ffe800640 1 -- 172.21.15.7:0/3051282267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8009b30 con 0x7f90001513c0 2024-09-13T15:16:12.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f8ffe800640 1 --2- 172.21.15.7:0/3051282267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90001513c0 0x7f90000c41d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8ff801a5d0 tx=0x7f8ff8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:12.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f8ff6000640 1 -- 172.21.15.7:0/3051282267 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80b8670 con 0x7f90001513c0 2024-09-13T15:16:12.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f8ff6000640 1 -- 172.21.15.7:0/3051282267 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff80b87d0 con 0x7f90001513c0 2024-09-13T15:16:12.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f8ff6000640 1 -- 172.21.15.7:0/3051282267 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff80b8b60 con 0x7f90001513c0 2024-09-13T15:16:12.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f9005000640 1 -- 172.21.15.7:0/3051282267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90000cb820 con 0x7f90001513c0 2024-09-13T15:16:12.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f9005000640 1 -- 172.21.15.7:0/3051282267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900006bb00 con 0x7f90001513c0 2024-09-13T15:16:12.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.309+0000 7f9005000640 1 -- 172.21.15.7:0/3051282267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9000067650 con 0x7f90001513c0 2024-09-13T15:16:12.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.313+0000 7f8ff6000640 1 -- 172.21.15.7:0/3051282267 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8ff80b8cc0 con 0x7f90001513c0 2024-09-13T15:16:12.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.313+0000 7f8ff6000640 1 --2- 172.21.15.7:0/3051282267 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8fdc066690 0x7f8fdc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:12.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.313+0000 7f8ff6000640 1 -- 172.21.15.7:0/3051282267 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f8ff811f970 con 0x7f90001513c0 2024-09-13T15:16:12.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.313+0000 7f8ffde00640 1 --2- 172.21.15.7:0/3051282267 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8fdc066690 0x7f8fdc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:12.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.313+0000 7f8ffde00640 1 --2- 172.21.15.7:0/3051282267 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8fdc066690 0x7f8fdc068b50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009b60 tx=0x7f8ff0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:12.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.317+0000 7f8ff6000640 1 -- 172.21.15.7:0/3051282267 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8ff80ec7c0 con 0x7f90001513c0 2024-09-13T15:16:12.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.501+0000 7f9005000640 1 -- 172.21.15.7:0/3051282267 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f900006fd70 con 0x7f8fdc066690 2024-09-13T15:16:12.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.533+0000 7f8ff6000640 1 -- 172.21.15.7:0/3051282267 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370419 (secure 0 0 0) 0x7f8ff0011ac0 con 0x7f8fdc066690 2024-09-13T15:16:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:16:12.543 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T15:16:12.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.557+0000 7f9005000640 1 -- 172.21.15.7:0/3051282267 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8fdc066690 msgr2=0x7f8fdc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:12.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.557+0000 7f9005000640 1 --2- 172.21.15.7:0/3051282267 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8fdc066690 0x7f8fdc068b50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0009b60 tx=0x7f8ff0009190 comp rx=0 tx=0).stop 2024-09-13T15:16:12.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.557+0000 7f9005000640 1 -- 172.21.15.7:0/3051282267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90001513c0 msgr2=0x7f90000c41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:12.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.557+0000 7f9005000640 1 --2- 172.21.15.7:0/3051282267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90001513c0 0x7f90000c41d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8ff801a5d0 tx=0x7f8ff8019740 comp rx=0 tx=0).stop 2024-09-13T15:16:12.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.561+0000 7f9005000640 1 -- 172.21.15.7:0/3051282267 shutdown_connections 2024-09-13T15:16:12.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.561+0000 7f9005000640 1 --2- 172.21.15.7:0/3051282267 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8fdc066690 0x7f8fdc068b50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.561+0000 7f9005000640 1 --2- 172.21.15.7:0/3051282267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f90001513c0 0x7f90000c41d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.561+0000 7f9005000640 1 --2- 172.21.15.7:0/3051282267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9000150fe0 0x7f90000c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.561+0000 7f9005000640 1 --2- 172.21.15.7:0/3051282267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f90000c8780 0x7f9000069f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.561+0000 7f9005000640 1 -- 172.21.15.7:0/3051282267 >> 172.21.15.7:0/3051282267 conn(0x7f9000071730 msgr2=0x7f900015fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:12.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.561+0000 7f9005000640 1 -- 172.21.15.7:0/3051282267 shutdown_connections 2024-09-13T15:16:12.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.561+0000 7f9005000640 1 -- 172.21.15.7:0/3051282267 wait complete. 2024-09-13T15:16:12.622 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":462,"stamp":"2024-09-13T15:16:10.948073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6092974517,"num_objects":1747,"num_object_clones":0,"num_object_copies":6718,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1747,"num_whiteouts":0,"num_read":617,"num_read_kb":111053,"num_write":2172927,"num_write_kb":31188650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":74,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151332,"ondisk_log_size":151332,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":20759152,"kb_used_data":12222768,"kb_used_omap":12,"kb_used_meta":8519923,"kb_avail":734215568,"statfs":{"total":773094113280,"available":751836741632,"internally_reserved":0,"allocated":12516114432,"data_stored":12514263668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":8724401720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,2,4,1,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":69,"apply_latency_ms":69,"commit_latency_ns":69000000,"apply_latency_ns":69000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1946130063,"num_objects":-464,"num_object_clones":0,"num_object_copies":-1856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-464,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":491,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004787"},"pg_stats":[{"pgid":"2.1f","version":"31'35","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:32.892911+0000","last_change":"2024-09-13T15:01:44.418856+0000","last_active":"2024-09-13T15:15:32.892911+0000","last_peered":"2024-09-13T15:15:32.892911+0000","last_clean":"2024-09-13T15:15:32.892911+0000","last_became_active":"2024-09-13T15:01:44.418641+0000","last_became_peered":"2024-09-13T15:01:44.418641+0000","last_unstale":"2024-09-13T15:15:32.892911+0000","last_undegraded":"2024-09-13T15:15:32.892911+0000","last_fullsized":"2024-09-13T15:15:32.892911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:40.178824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":25,"num_read_kb":4120,"num_write":35,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.390297+0000","last_change":"2024-09-13T15:01:44.809371+0000","last_active":"2024-09-13T15:15:28.390297+0000","last_peered":"2024-09-13T15:15:28.390297+0000","last_clean":"2024-09-13T15:15:28.390297+0000","last_became_active":"2024-09-13T15:01:44.809091+0000","last_became_peered":"2024-09-13T15:01:44.809091+0000","last_unstale":"2024-09-13T15:15:28.390297+0000","last_undegraded":"2024-09-13T15:15:28.390297+0000","last_fullsized":"2024-09-13T15:15:28.390297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:22.412025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'4441","reported_seq":4466,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:09.585365+0000","last_change":"2024-09-13T15:01:48.910757+0000","last_active":"2024-09-13T15:16:09.585365+0000","last_peered":"2024-09-13T15:16:09.585365+0000","last_clean":"2024-09-13T15:16:09.585365+0000","last_became_active":"2024-09-13T15:01:48.910262+0000","last_became_peered":"2024-09-13T15:01:48.910262+0000","last_unstale":"2024-09-13T15:16:09.585365+0000","last_undegraded":"2024-09-13T15:16:09.585365+0000","last_fullsized":"2024-09-13T15:16:09.585365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4441,"log_dups_size":0,"ondisk_log_size":4441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:39.290557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159414246,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65333,"num_write_kb":904330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'21","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:32.891601+0000","last_change":"2024-09-13T15:01:44.404818+0000","last_active":"2024-09-13T15:15:32.891601+0000","last_peered":"2024-09-13T15:15:32.891601+0000","last_clean":"2024-09-13T15:15:32.891601+0000","last_became_active":"2024-09-13T15:01:44.401666+0000","last_became_peered":"2024-09-13T15:01:44.401666+0000","last_unstale":"2024-09-13T15:15:32.891601+0000","last_undegraded":"2024-09-13T15:15:32.891601+0000","last_fullsized":"2024-09-13T15:15:32.891601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:31.818163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":18,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:12.529773+0000","last_change":"2024-09-13T15:01:44.850292+0000","last_active":"2024-09-13T15:14:12.529773+0000","last_peered":"2024-09-13T15:14:12.529773+0000","last_clean":"2024-09-13T15:14:12.529773+0000","last_became_active":"2024-09-13T15:01:44.849825+0000","last_became_peered":"2024-09-13T15:01:44.849825+0000","last_unstale":"2024-09-13T15:14:12.529773+0000","last_undegraded":"2024-09-13T15:14:12.529773+0000","last_fullsized":"2024-09-13T15:14:12.529773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:22.582742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"33'4893","reported_seq":4918,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.587471+0000","last_change":"2024-09-13T15:01:48.850426+0000","last_active":"2024-09-13T15:16:08.587471+0000","last_peered":"2024-09-13T15:16:08.587471+0000","last_clean":"2024-09-13T15:16:08.587471+0000","last_became_active":"2024-09-13T15:01:48.848750+0000","last_became_peered":"2024-09-13T15:01:48.848750+0000","last_unstale":"2024-09-13T15:16:08.587471+0000","last_undegraded":"2024-09-13T15:16:08.587471+0000","last_fullsized":"2024-09-13T15:16:08.587471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4893,"log_dups_size":0,"ondisk_log_size":4893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:55.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188835155,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71627,"num_write_kb":1026932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"33'61","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.125487+0000","last_change":"2024-09-13T15:01:44.437850+0000","last_active":"2024-09-13T15:15:57.125487+0000","last_peered":"2024-09-13T15:15:57.125487+0000","last_clean":"2024-09-13T15:15:57.125487+0000","last_became_active":"2024-09-13T15:01:44.437168+0000","last_became_peered":"2024-09-13T15:01:44.437168+0000","last_unstale":"2024-09-13T15:15:57.125487+0000","last_undegraded":"2024-09-13T15:15:57.125487+0000","last_fullsized":"2024-09-13T15:15:57.125487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:23.540408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":50,"num_read_kb":12337,"num_write":58,"num_write_kb":12312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.869728+0000","last_change":"2024-09-13T15:01:44.845989+0000","last_active":"2024-09-13T15:15:27.869728+0000","last_peered":"2024-09-13T15:15:27.869728+0000","last_clean":"2024-09-13T15:15:27.869728+0000","last_became_active":"2024-09-13T15:01:44.845395+0000","last_became_peered":"2024-09-13T15:01:44.845395+0000","last_unstale":"2024-09-13T15:15:27.869728+0000","last_undegraded":"2024-09-13T15:15:27.869728+0000","last_fullsized":"2024-09-13T15:15:27.869728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:52.267507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4398","reported_seq":4423,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.284312+0000","last_change":"2024-09-13T15:01:48.865388+0000","last_active":"2024-09-13T15:16:07.284312+0000","last_peered":"2024-09-13T15:16:07.284312+0000","last_clean":"2024-09-13T15:16:07.284312+0000","last_became_active":"2024-09-13T15:01:48.864314+0000","last_became_peered":"2024-09-13T15:01:48.864314+0000","last_unstale":"2024-09-13T15:16:07.284312+0000","last_undegraded":"2024-09-13T15:16:07.284312+0000","last_fullsized":"2024-09-13T15:16:07.284312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4398,"log_dups_size":0,"ondisk_log_size":4398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:18.637430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184554492,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64505,"num_write_kb":920306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"30'15","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.086111+0000","last_change":"2024-09-13T15:01:44.424080+0000","last_active":"2024-09-13T15:15:57.086111+0000","last_peered":"2024-09-13T15:15:57.086111+0000","last_clean":"2024-09-13T15:15:57.086111+0000","last_became_active":"2024-09-13T15:01:44.423381+0000","last_became_peered":"2024-09-13T15:01:44.423381+0000","last_unstale":"2024-09-13T15:15:57.086111+0000","last_undegraded":"2024-09-13T15:15:57.086111+0000","last_fullsized":"2024-09-13T15:15:57.086111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:38:20.455380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":4116,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"33'15","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:03.389792+0000","last_change":"2024-09-13T15:01:44.849670+0000","last_active":"2024-09-13T15:16:03.389792+0000","last_peered":"2024-09-13T15:16:03.389792+0000","last_clean":"2024-09-13T15:16:03.389792+0000","last_became_active":"2024-09-13T15:01:44.849038+0000","last_became_peered":"2024-09-13T15:01:44.849038+0000","last_unstale":"2024-09-13T15:16:03.389792+0000","last_undegraded":"2024-09-13T15:16:03.389792+0000","last_fullsized":"2024-09-13T15:16:03.389792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:45.570774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4137","reported_seq":4162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.438214+0000","last_change":"2024-09-13T15:01:48.854953+0000","last_active":"2024-09-13T15:16:07.438214+0000","last_peered":"2024-09-13T15:16:07.438214+0000","last_clean":"2024-09-13T15:16:07.438214+0000","last_became_active":"2024-09-13T15:01:48.853858+0000","last_became_peered":"2024-09-13T15:01:48.853858+0000","last_unstale":"2024-09-13T15:16:07.438214+0000","last_undegraded":"2024-09-13T15:16:07.438214+0000","last_fullsized":"2024-09-13T15:16:07.438214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4137,"log_dups_size":0,"ondisk_log_size":4137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:07.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239130476,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61252,"num_write_kb":864366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.599588+0000","last_change":"2024-09-13T15:01:44.824391+0000","last_active":"2024-09-13T15:15:28.599588+0000","last_peered":"2024-09-13T15:15:28.599588+0000","last_clean":"2024-09-13T15:15:28.599588+0000","last_became_active":"2024-09-13T15:01:44.823690+0000","last_became_peered":"2024-09-13T15:01:44.823690+0000","last_unstale":"2024-09-13T15:15:28.599588+0000","last_undegraded":"2024-09-13T15:15:28.599588+0000","last_fullsized":"2024-09-13T15:15:28.599588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'133","reported_seq":166,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:34.462327+0000","last_change":"2024-09-13T15:01:44.421523+0000","last_active":"2024-09-13T15:15:34.462327+0000","last_peered":"2024-09-13T15:15:34.462327+0000","last_clean":"2024-09-13T15:15:34.462327+0000","last_became_active":"2024-09-13T15:01:44.419965+0000","last_became_peered":"2024-09-13T15:01:44.419965+0000","last_unstale":"2024-09-13T15:15:34.462327+0000","last_undegraded":"2024-09-13T15:15:34.462327+0000","last_fullsized":"2024-09-13T15:15:34.462327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:34.918774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":8200,"num_write":130,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"33'4455","reported_seq":4481,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.390886+0000","last_change":"2024-09-13T15:01:48.850895+0000","last_active":"2024-09-13T15:16:08.390886+0000","last_peered":"2024-09-13T15:16:08.390886+0000","last_clean":"2024-09-13T15:16:08.390886+0000","last_became_active":"2024-09-13T15:01:48.849856+0000","last_became_peered":"2024-09-13T15:01:48.849856+0000","last_unstale":"2024-09-13T15:16:08.390886+0000","last_undegraded":"2024-09-13T15:16:08.390886+0000","last_fullsized":"2024-09-13T15:16:08.390886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4455,"log_dups_size":0,"ondisk_log_size":4455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:59.616442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188825920,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65529,"num_write_kb":929153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389629+0000","last_change":"2024-09-13T15:01:44.806026+0000","last_active":"2024-09-13T15:15:28.389629+0000","last_peered":"2024-09-13T15:15:28.389629+0000","last_clean":"2024-09-13T15:15:28.389629+0000","last_became_active":"2024-09-13T15:01:44.805767+0000","last_became_peered":"2024-09-13T15:01:44.805767+0000","last_unstale":"2024-09-13T15:15:28.389629+0000","last_undegraded":"2024-09-13T15:15:28.389629+0000","last_fullsized":"2024-09-13T15:15:28.389629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:50.696113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'19","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.712356+0000","last_change":"2024-09-13T15:01:44.401897+0000","last_active":"2024-09-13T15:15:28.712356+0000","last_peered":"2024-09-13T15:15:28.712356+0000","last_clean":"2024-09-13T15:15:28.712356+0000","last_became_active":"2024-09-13T15:01:44.401559+0000","last_became_peered":"2024-09-13T15:01:44.401559+0000","last_unstale":"2024-09-13T15:15:28.712356+0000","last_undegraded":"2024-09-13T15:15:28.712356+0000","last_fullsized":"2024-09-13T15:15:28.712356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:58.535567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"33'4692","reported_seq":4718,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.456314+0000","last_change":"2024-09-13T15:01:48.858808+0000","last_active":"2024-09-13T15:16:08.456314+0000","last_peered":"2024-09-13T15:16:08.456314+0000","last_clean":"2024-09-13T15:16:08.456314+0000","last_became_active":"2024-09-13T15:01:48.857802+0000","last_became_peered":"2024-09-13T15:01:48.857802+0000","last_unstale":"2024-09-13T15:16:08.456314+0000","last_undegraded":"2024-09-13T15:16:08.456314+0000","last_fullsized":"2024-09-13T15:16:08.456314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4692,"log_dups_size":0,"ondisk_log_size":4692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:41.628058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209721158,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68966,"num_write_kb":974815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.390542+0000","last_change":"2024-09-13T15:01:44.808674+0000","last_active":"2024-09-13T15:15:28.390542+0000","last_peered":"2024-09-13T15:15:28.390542+0000","last_clean":"2024-09-13T15:15:28.390542+0000","last_became_active":"2024-09-13T15:01:44.808420+0000","last_became_peered":"2024-09-13T15:01:44.808420+0000","last_unstale":"2024-09-13T15:15:28.390542+0000","last_undegraded":"2024-09-13T15:15:28.390542+0000","last_fullsized":"2024-09-13T15:15:28.390542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:33.447973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:15:01.212922+0000","last_change":"2024-09-13T15:01:44.406717+0000","last_active":"2024-09-13T15:15:01.212922+0000","last_peered":"2024-09-13T15:15:01.212922+0000","last_clean":"2024-09-13T15:15:01.212922+0000","last_became_active":"2024-09-13T15:01:44.406354+0000","last_became_peered":"2024-09-13T15:01:44.406354+0000","last_unstale":"2024-09-13T15:15:01.212922+0000","last_undegraded":"2024-09-13T15:15:01.212922+0000","last_fullsized":"2024-09-13T15:15:01.212922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:49.413632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"33'4743","reported_seq":4769,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.845662+0000","last_change":"2024-09-13T15:01:48.909879+0000","last_active":"2024-09-13T15:16:10.845662+0000","last_peered":"2024-09-13T15:16:10.845662+0000","last_clean":"2024-09-13T15:16:10.845662+0000","last_became_active":"2024-09-13T15:01:48.909494+0000","last_became_peered":"2024-09-13T15:01:48.909494+0000","last_unstale":"2024-09-13T15:16:10.845662+0000","last_undegraded":"2024-09-13T15:16:10.845662+0000","last_fullsized":"2024-09-13T15:16:10.845662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4743,"log_dups_size":0,"ondisk_log_size":4743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:54.415920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184554680,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69911,"num_write_kb":1001010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:53.670234+0000","last_change":"2024-09-13T15:01:44.825065+0000","last_active":"2024-09-13T15:14:53.670234+0000","last_peered":"2024-09-13T15:14:53.670234+0000","last_clean":"2024-09-13T15:14:53.670234+0000","last_became_active":"2024-09-13T15:01:44.824392+0000","last_became_peered":"2024-09-13T15:01:44.824392+0000","last_unstale":"2024-09-13T15:14:53.670234+0000","last_undegraded":"2024-09-13T15:14:53.670234+0000","last_fullsized":"2024-09-13T15:14:53.670234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:49.717211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"30'15","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.866614+0000","last_change":"2024-09-13T15:01:44.421119+0000","last_active":"2024-09-13T15:15:27.866614+0000","last_peered":"2024-09-13T15:15:27.866614+0000","last_clean":"2024-09-13T15:15:27.866614+0000","last_became_active":"2024-09-13T15:01:44.419082+0000","last_became_peered":"2024-09-13T15:01:44.419082+0000","last_unstale":"2024-09-13T15:15:27.866614+0000","last_undegraded":"2024-09-13T15:15:27.866614+0000","last_fullsized":"2024-09-13T15:15:27.866614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.011350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"33'4646","reported_seq":4672,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.104593+0000","last_change":"2024-09-13T15:01:48.856387+0000","last_active":"2024-09-13T15:16:08.104593+0000","last_peered":"2024-09-13T15:16:08.104593+0000","last_clean":"2024-09-13T15:16:08.104593+0000","last_became_active":"2024-09-13T15:01:48.855433+0000","last_became_peered":"2024-09-13T15:01:48.855433+0000","last_unstale":"2024-09-13T15:16:08.104593+0000","last_undegraded":"2024-09-13T15:16:08.104593+0000","last_fullsized":"2024-09-13T15:16:08.104593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4646,"log_dups_size":0,"ondisk_log_size":4646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:58.309929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201344225,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68020,"num_write_kb":991498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:38.017666+0000","last_change":"2024-09-13T15:01:44.807909+0000","last_active":"2024-09-13T15:14:38.017666+0000","last_peered":"2024-09-13T15:14:38.017666+0000","last_clean":"2024-09-13T15:14:38.017666+0000","last_became_active":"2024-09-13T15:01:44.807643+0000","last_became_peered":"2024-09-13T15:01:44.807643+0000","last_unstale":"2024-09-13T15:14:38.017666+0000","last_undegraded":"2024-09-13T15:14:38.017666+0000","last_fullsized":"2024-09-13T15:14:38.017666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:30.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"30'9","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.087518+0000","last_change":"2024-09-13T15:01:44.430200+0000","last_active":"2024-09-13T15:15:57.087518+0000","last_peered":"2024-09-13T15:15:57.087518+0000","last_clean":"2024-09-13T15:15:57.087518+0000","last_became_active":"2024-09-13T15:01:44.429510+0000","last_became_peered":"2024-09-13T15:01:44.429510+0000","last_unstale":"2024-09-13T15:15:57.087518+0000","last_undegraded":"2024-09-13T15:15:57.087518+0000","last_fullsized":"2024-09-13T15:15:57.087518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:52.921485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":13,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'4785","reported_seq":4811,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.305666+0000","last_change":"2024-09-13T15:01:48.912116+0000","last_active":"2024-09-13T15:16:08.305666+0000","last_peered":"2024-09-13T15:16:08.305666+0000","last_clean":"2024-09-13T15:16:08.305666+0000","last_became_active":"2024-09-13T15:01:48.911578+0000","last_became_peered":"2024-09-13T15:01:48.911578+0000","last_unstale":"2024-09-13T15:16:08.305666+0000","last_undegraded":"2024-09-13T15:16:08.305666+0000","last_fullsized":"2024-09-13T15:16:08.305666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4785,"log_dups_size":0,"ondisk_log_size":4785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:50.826715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234905672,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70443,"num_write_kb":1030585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:00.228712+0000","last_change":"2024-09-13T15:01:44.838344+0000","last_active":"2024-09-13T15:16:00.228712+0000","last_peered":"2024-09-13T15:16:00.228712+0000","last_clean":"2024-09-13T15:16:00.228712+0000","last_became_active":"2024-09-13T15:01:44.838128+0000","last_became_peered":"2024-09-13T15:01:44.838128+0000","last_unstale":"2024-09-13T15:16:00.228712+0000","last_undegraded":"2024-09-13T15:16:00.228712+0000","last_fullsized":"2024-09-13T15:16:00.228712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:09:50.373976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'114","reported_seq":150,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.935801+0000","last_change":"2024-09-13T15:01:44.430749+0000","last_active":"2024-09-13T15:15:57.935801+0000","last_peered":"2024-09-13T15:15:57.935801+0000","last_clean":"2024-09-13T15:15:57.935801+0000","last_became_active":"2024-09-13T15:01:44.430548+0000","last_became_peered":"2024-09-13T15:01:44.430548+0000","last_unstale":"2024-09-13T15:15:57.935801+0000","last_undegraded":"2024-09-13T15:15:57.935801+0000","last_fullsized":"2024-09-13T15:15:57.935801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:30.312447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":249,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"33'4798","reported_seq":4825,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:09.661955+0000","last_change":"2024-09-13T15:01:48.911224+0000","last_active":"2024-09-13T15:16:09.661955+0000","last_peered":"2024-09-13T15:16:09.661955+0000","last_clean":"2024-09-13T15:16:09.661955+0000","last_became_active":"2024-09-13T15:01:48.910150+0000","last_became_peered":"2024-09-13T15:01:48.910150+0000","last_unstale":"2024-09-13T15:16:09.661955+0000","last_undegraded":"2024-09-13T15:16:09.661955+0000","last_fullsized":"2024-09-13T15:16:09.661955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4798,"log_dups_size":0,"ondisk_log_size":4798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:41.244267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180447030,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70396,"num_write_kb":999196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"33'9","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.712426+0000","last_change":"2024-09-13T15:01:44.812200+0000","last_active":"2024-09-13T15:15:28.712426+0000","last_peered":"2024-09-13T15:15:28.712426+0000","last_clean":"2024-09-13T15:15:28.712426+0000","last_became_active":"2024-09-13T15:01:44.811915+0000","last_became_peered":"2024-09-13T15:01:44.811915+0000","last_unstale":"2024-09-13T15:15:28.712426+0000","last_undegraded":"2024-09-13T15:15:28.712426+0000","last_fullsized":"2024-09-13T15:15:28.712426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:07.944520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'7","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.870726+0000","last_change":"2024-09-13T15:01:44.423119+0000","last_active":"2024-09-13T15:15:27.870726+0000","last_peered":"2024-09-13T15:15:27.870726+0000","last_clean":"2024-09-13T15:15:27.870726+0000","last_became_active":"2024-09-13T15:01:44.422297+0000","last_became_peered":"2024-09-13T15:01:44.422297+0000","last_unstale":"2024-09-13T15:15:27.870726+0000","last_undegraded":"2024-09-13T15:15:27.870726+0000","last_fullsized":"2024-09-13T15:15:27.870726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:09.798196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"33'4744","reported_seq":4770,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.093176+0000","last_change":"2024-09-13T15:01:48.908569+0000","last_active":"2024-09-13T15:16:08.093176+0000","last_peered":"2024-09-13T15:16:08.093176+0000","last_clean":"2024-09-13T15:16:08.093176+0000","last_became_active":"2024-09-13T15:01:48.908118+0000","last_became_peered":"2024-09-13T15:01:48.908118+0000","last_unstale":"2024-09-13T15:16:08.093176+0000","last_undegraded":"2024-09-13T15:16:08.093176+0000","last_fullsized":"2024-09-13T15:16:08.093176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4744,"log_dups_size":0,"ondisk_log_size":4744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:06.459855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205574157,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69506,"num_write_kb":1001647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:20.816504+0000","last_change":"2024-09-13T15:01:44.850837+0000","last_active":"2024-09-13T15:14:20.816504+0000","last_peered":"2024-09-13T15:14:20.816504+0000","last_clean":"2024-09-13T15:14:20.816504+0000","last_became_active":"2024-09-13T15:01:44.850263+0000","last_became_peered":"2024-09-13T15:01:44.850263+0000","last_unstale":"2024-09-13T15:14:20.816504+0000","last_undegraded":"2024-09-13T15:14:20.816504+0000","last_fullsized":"2024-09-13T15:14:20.816504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:16.956369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"30'3","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:18.534907+0000","last_change":"2024-09-13T15:01:44.399163+0000","last_active":"2024-09-13T15:14:18.534907+0000","last_peered":"2024-09-13T15:14:18.534907+0000","last_clean":"2024-09-13T15:14:18.534907+0000","last_became_active":"2024-09-13T15:01:44.398881+0000","last_became_peered":"2024-09-13T15:01:44.398881+0000","last_unstale":"2024-09-13T15:14:18.534907+0000","last_undegraded":"2024-09-13T15:14:18.534907+0000","last_fullsized":"2024-09-13T15:14:18.534907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:49.622676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4013","reported_seq":4039,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.188512+0000","last_change":"2024-09-13T15:01:48.852798+0000","last_active":"2024-09-13T15:16:10.188512+0000","last_peered":"2024-09-13T15:16:10.188512+0000","last_clean":"2024-09-13T15:16:10.188512+0000","last_became_active":"2024-09-13T15:01:48.851948+0000","last_became_peered":"2024-09-13T15:01:48.851948+0000","last_unstale":"2024-09-13T15:16:10.188512+0000","last_undegraded":"2024-09-13T15:16:10.188512+0000","last_fullsized":"2024-09-13T15:16:10.188512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4013,"log_dups_size":0,"ondisk_log_size":4013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:20.061043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163694610,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58879,"num_write_kb":861513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:23.142917+0000","last_change":"2024-09-13T15:01:44.824074+0000","last_active":"2024-09-13T15:14:23.142917+0000","last_peered":"2024-09-13T15:14:23.142917+0000","last_clean":"2024-09-13T15:14:23.142917+0000","last_became_active":"2024-09-13T15:01:44.821475+0000","last_became_peered":"2024-09-13T15:01:44.821475+0000","last_unstale":"2024-09-13T15:14:23.142917+0000","last_undegraded":"2024-09-13T15:14:23.142917+0000","last_fullsized":"2024-09-13T15:14:23.142917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:21.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'34","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:32.918126+0000","last_change":"2024-09-13T15:01:44.433502+0000","last_active":"2024-09-13T15:15:32.918126+0000","last_peered":"2024-09-13T15:15:32.918126+0000","last_clean":"2024-09-13T15:15:32.918126+0000","last_became_active":"2024-09-13T15:01:44.432902+0000","last_became_peered":"2024-09-13T15:01:44.432902+0000","last_unstale":"2024-09-13T15:15:32.918126+0000","last_undegraded":"2024-09-13T15:15:32.918126+0000","last_fullsized":"2024-09-13T15:15:32.918126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:59.189559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389688,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":8206,"num_write":28,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"33'4494","reported_seq":4520,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.751737+0000","last_change":"2024-09-13T15:01:48.846695+0000","last_active":"2024-09-13T15:16:10.751737+0000","last_peered":"2024-09-13T15:16:10.751737+0000","last_clean":"2024-09-13T15:16:10.751737+0000","last_became_active":"2024-09-13T15:01:48.846301+0000","last_became_peered":"2024-09-13T15:01:48.846301+0000","last_unstale":"2024-09-13T15:16:10.751737+0000","last_undegraded":"2024-09-13T15:16:10.751737+0000","last_fullsized":"2024-09-13T15:16:10.751737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4494,"log_dups_size":0,"ondisk_log_size":4494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:17.532499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167794395,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66100,"num_write_kb":975469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"33'7","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:00.870032+0000","last_change":"2024-09-13T15:01:44.814483+0000","last_active":"2024-09-13T15:16:00.870032+0000","last_peered":"2024-09-13T15:16:00.870032+0000","last_clean":"2024-09-13T15:16:00.870032+0000","last_became_active":"2024-09-13T15:01:44.814192+0000","last_became_peered":"2024-09-13T15:01:44.814192+0000","last_unstale":"2024-09-13T15:16:00.870032+0000","last_undegraded":"2024-09-13T15:16:00.870032+0000","last_fullsized":"2024-09-13T15:16:00.870032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:32:30.303635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'30","reported_seq":86,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.442690+0000","last_change":"2024-09-13T15:01:44.399314+0000","last_active":"2024-09-13T15:15:58.442690+0000","last_peered":"2024-09-13T15:15:58.442690+0000","last_clean":"2024-09-13T15:15:58.442690+0000","last_became_active":"2024-09-13T15:01:44.398904+0000","last_became_peered":"2024-09-13T15:01:44.398904+0000","last_unstale":"2024-09-13T15:15:58.442690+0000","last_undegraded":"2024-09-13T15:15:58.442690+0000","last_fullsized":"2024-09-13T15:15:58.442690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.645179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70412,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":156,"num_write":28,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'5176","reported_seq":5202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.887549+0000","last_change":"2024-09-13T15:01:48.859142+0000","last_active":"2024-09-13T15:16:10.887549+0000","last_peered":"2024-09-13T15:16:10.887549+0000","last_clean":"2024-09-13T15:16:10.887549+0000","last_became_active":"2024-09-13T15:01:48.858649+0000","last_became_peered":"2024-09-13T15:01:48.858649+0000","last_unstale":"2024-09-13T15:16:10.887549+0000","last_undegraded":"2024-09-13T15:16:10.887549+0000","last_fullsized":"2024-09-13T15:16:10.887549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5176,"log_dups_size":0,"ondisk_log_size":5176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:27.314012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180429918,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76277,"num_write_kb":1087992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:12.475953+0000","last_change":"2024-09-13T15:01:44.826501+0000","last_active":"2024-09-13T15:14:12.475953+0000","last_peered":"2024-09-13T15:14:12.475953+0000","last_clean":"2024-09-13T15:14:12.475953+0000","last_became_active":"2024-09-13T15:01:44.826222+0000","last_became_peered":"2024-09-13T15:01:44.826222+0000","last_unstale":"2024-09-13T15:14:12.475953+0000","last_undegraded":"2024-09-13T15:14:12.475953+0000","last_fullsized":"2024-09-13T15:14:12.475953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:00.543916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'26","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:33.062368+0000","last_change":"2024-09-13T15:01:44.421891+0000","last_active":"2024-09-13T15:15:33.062368+0000","last_peered":"2024-09-13T15:15:33.062368+0000","last_clean":"2024-09-13T15:15:33.062368+0000","last_became_active":"2024-09-13T15:01:44.419660+0000","last_became_peered":"2024-09-13T15:01:44.419660+0000","last_unstale":"2024-09-13T15:15:33.062368+0000","last_undegraded":"2024-09-13T15:15:33.062368+0000","last_fullsized":"2024-09-13T15:15:33.062368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:27.554128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":20,"num_write_kb":8201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'4164","reported_seq":4200,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.102576+0000","last_change":"2024-09-13T15:02:34.119111+0000","last_active":"2024-09-13T15:16:08.102576+0000","last_peered":"2024-09-13T15:16:08.102576+0000","last_clean":"2024-09-13T15:16:08.102576+0000","last_became_active":"2024-09-13T15:02:34.118461+0000","last_became_peered":"2024-09-13T15:02:34.118461+0000","last_unstale":"2024-09-13T15:16:08.102576+0000","last_undegraded":"2024-09-13T15:16:08.102576+0000","last_fullsized":"2024-09-13T15:16:08.102576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4164,"log_dups_size":0,"ondisk_log_size":4164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:35.096846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155522677,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60732,"num_write_kb":878332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:18.081359+0000","last_change":"2024-09-13T15:01:44.850498+0000","last_active":"2024-09-13T15:14:18.081359+0000","last_peered":"2024-09-13T15:14:18.081359+0000","last_clean":"2024-09-13T15:14:18.081359+0000","last_became_active":"2024-09-13T15:01:44.850234+0000","last_became_peered":"2024-09-13T15:01:44.850234+0000","last_unstale":"2024-09-13T15:14:18.081359+0000","last_undegraded":"2024-09-13T15:14:18.081359+0000","last_fullsized":"2024-09-13T15:14:18.081359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:37.202494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:18.146398+0000","last_change":"2024-09-13T15:01:44.411997+0000","last_active":"2024-09-13T15:14:18.146398+0000","last_peered":"2024-09-13T15:14:18.146398+0000","last_clean":"2024-09-13T15:14:18.146398+0000","last_became_active":"2024-09-13T15:01:44.410675+0000","last_became_peered":"2024-09-13T15:01:44.410675+0000","last_unstale":"2024-09-13T15:14:18.146398+0000","last_undegraded":"2024-09-13T15:14:18.146398+0000","last_fullsized":"2024-09-13T15:14:18.146398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:50:55.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":18,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.866875+0000","last_change":"2024-09-13T15:01:40.834440+0000","last_active":"2024-09-13T15:15:27.866875+0000","last_peered":"2024-09-13T15:15:27.866875+0000","last_clean":"2024-09-13T15:15:27.866875+0000","last_became_active":"2024-09-13T15:01:40.832279+0000","last_became_peered":"2024-09-13T15:01:40.832279+0000","last_unstale":"2024-09-13T15:15:27.866875+0000","last_undegraded":"2024-09-13T15:15:27.866875+0000","last_fullsized":"2024-09-13T15:15:27.866875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_clean_scrub_stamp":"2024-09-13T15:01:39.264455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:11.875506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"33'5083","reported_seq":5109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.431985+0000","last_change":"2024-09-13T15:01:48.919580+0000","last_active":"2024-09-13T15:16:10.431985+0000","last_peered":"2024-09-13T15:16:10.431985+0000","last_clean":"2024-09-13T15:16:10.431985+0000","last_became_active":"2024-09-13T15:01:48.918678+0000","last_became_peered":"2024-09-13T15:01:48.918678+0000","last_unstale":"2024-09-13T15:16:10.431985+0000","last_undegraded":"2024-09-13T15:16:10.431985+0000","last_fullsized":"2024-09-13T15:16:10.431985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5083,"log_dups_size":0,"ondisk_log_size":5083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:02.840528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209718630,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74794,"num_write_kb":1044614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.222286+0000","last_change":"2024-09-13T15:01:44.849975+0000","last_active":"2024-09-13T15:16:02.222286+0000","last_peered":"2024-09-13T15:16:02.222286+0000","last_clean":"2024-09-13T15:16:02.222286+0000","last_became_active":"2024-09-13T15:01:44.849457+0000","last_became_peered":"2024-09-13T15:01:44.849457+0000","last_unstale":"2024-09-13T15:16:02.222286+0000","last_undegraded":"2024-09-13T15:16:02.222286+0000","last_fullsized":"2024-09-13T15:16:02.222286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:51.139153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"30'9","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:15:17.898494+0000","last_change":"2024-09-13T15:01:44.420906+0000","last_active":"2024-09-13T15:15:17.898494+0000","last_peered":"2024-09-13T15:15:17.898494+0000","last_clean":"2024-09-13T15:15:17.898494+0000","last_became_active":"2024-09-13T15:01:44.420601+0000","last_became_peered":"2024-09-13T15:01:44.420601+0000","last_unstale":"2024-09-13T15:15:17.898494+0000","last_undegraded":"2024-09-13T15:15:17.898494+0000","last_fullsized":"2024-09-13T15:15:17.898494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:33.245745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1497,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"33'4476","reported_seq":4502,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.800260+0000","last_change":"2024-09-13T15:01:48.911047+0000","last_active":"2024-09-13T15:16:08.800260+0000","last_peered":"2024-09-13T15:16:08.800260+0000","last_clean":"2024-09-13T15:16:08.800260+0000","last_became_active":"2024-09-13T15:01:48.910479+0000","last_became_peered":"2024-09-13T15:01:48.910479+0000","last_unstale":"2024-09-13T15:16:08.800260+0000","last_undegraded":"2024-09-13T15:16:08.800260+0000","last_fullsized":"2024-09-13T15:16:08.800260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4476,"log_dups_size":0,"ondisk_log_size":4476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:06.558889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160849,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65864,"num_write_kb":920675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.870055+0000","last_change":"2024-09-13T15:01:44.838098+0000","last_active":"2024-09-13T15:15:27.870055+0000","last_peered":"2024-09-13T15:15:27.870055+0000","last_clean":"2024-09-13T15:15:27.870055+0000","last_became_active":"2024-09-13T15:01:44.837429+0000","last_became_peered":"2024-09-13T15:01:44.837429+0000","last_unstale":"2024-09-13T15:15:27.870055+0000","last_undegraded":"2024-09-13T15:15:27.870055+0000","last_fullsized":"2024-09-13T15:15:27.870055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:37.795841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"30'15","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:32.877991+0000","last_change":"2024-09-13T15:01:44.406999+0000","last_active":"2024-09-13T15:15:32.877991+0000","last_peered":"2024-09-13T15:15:32.877991+0000","last_clean":"2024-09-13T15:15:32.877991+0000","last_became_active":"2024-09-13T15:01:44.406719+0000","last_became_peered":"2024-09-13T15:01:44.406719+0000","last_unstale":"2024-09-13T15:15:32.877991+0000","last_undegraded":"2024-09-13T15:15:32.877991+0000","last_fullsized":"2024-09-13T15:15:32.877991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:33.397091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":9,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"33'5071","reported_seq":5097,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.549784+0000","last_change":"2024-09-13T15:01:48.857931+0000","last_active":"2024-09-13T15:16:07.549784+0000","last_peered":"2024-09-13T15:16:07.549784+0000","last_clean":"2024-09-13T15:16:07.549784+0000","last_became_active":"2024-09-13T15:01:48.857542+0000","last_became_peered":"2024-09-13T15:01:48.857542+0000","last_unstale":"2024-09-13T15:16:07.549784+0000","last_undegraded":"2024-09-13T15:16:07.549784+0000","last_fullsized":"2024-09-13T15:16:07.549784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5071,"log_dups_size":0,"ondisk_log_size":5071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:32.805405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197777785,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74191,"num_write_kb":1079868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:05.311578+0000","last_change":"2024-09-13T15:01:44.835470+0000","last_active":"2024-09-13T15:16:05.311578+0000","last_peered":"2024-09-13T15:16:05.311578+0000","last_clean":"2024-09-13T15:16:05.311578+0000","last_became_active":"2024-09-13T15:01:44.831166+0000","last_became_peered":"2024-09-13T15:01:44.831166+0000","last_unstale":"2024-09-13T15:16:05.311578+0000","last_undegraded":"2024-09-13T15:16:05.311578+0000","last_fullsized":"2024-09-13T15:16:05.311578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:05.887592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"30'19","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.085247+0000","last_change":"2024-09-13T15:01:44.403111+0000","last_active":"2024-09-13T15:15:57.085247+0000","last_peered":"2024-09-13T15:15:57.085247+0000","last_clean":"2024-09-13T15:15:57.085247+0000","last_became_active":"2024-09-13T15:01:44.401799+0000","last_became_peered":"2024-09-13T15:01:44.401799+0000","last_unstale":"2024-09-13T15:15:57.085247+0000","last_undegraded":"2024-09-13T15:15:57.085247+0000","last_fullsized":"2024-09-13T15:15:57.085247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:54.589470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":4114,"num_write":17,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"33'4728","reported_seq":4754,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.461987+0000","last_change":"2024-09-13T15:01:48.912490+0000","last_active":"2024-09-13T15:16:10.461987+0000","last_peered":"2024-09-13T15:16:10.461987+0000","last_clean":"2024-09-13T15:16:10.461987+0000","last_became_active":"2024-09-13T15:01:48.911474+0000","last_became_peered":"2024-09-13T15:01:48.911474+0000","last_unstale":"2024-09-13T15:16:10.461987+0000","last_undegraded":"2024-09-13T15:16:10.461987+0000","last_fullsized":"2024-09-13T15:16:10.461987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4728,"log_dups_size":0,"ondisk_log_size":4728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:54.295921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134285803,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69008,"num_write_kb":987747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.871262+0000","last_change":"2024-09-13T15:01:44.818472+0000","last_active":"2024-09-13T15:15:27.871262+0000","last_peered":"2024-09-13T15:15:27.871262+0000","last_clean":"2024-09-13T15:15:27.871262+0000","last_became_active":"2024-09-13T15:01:44.817718+0000","last_became_peered":"2024-09-13T15:01:44.817718+0000","last_unstale":"2024-09-13T15:15:27.871262+0000","last_undegraded":"2024-09-13T15:15:27.871262+0000","last_fullsized":"2024-09-13T15:15:27.871262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:21.310696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'15","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:32.879744+0000","last_change":"2024-09-13T15:01:44.410376+0000","last_active":"2024-09-13T15:15:32.879744+0000","last_peered":"2024-09-13T15:15:32.879744+0000","last_clean":"2024-09-13T15:15:32.879744+0000","last_became_active":"2024-09-13T15:01:44.409585+0000","last_became_peered":"2024-09-13T15:01:44.409585+0000","last_unstale":"2024-09-13T15:15:32.879744+0000","last_undegraded":"2024-09-13T15:15:32.879744+0000","last_fullsized":"2024-09-13T15:15:32.879744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:45.845804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"33'5260","reported_seq":5286,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.524170+0000","last_change":"2024-09-13T15:01:48.861130+0000","last_active":"2024-09-13T15:16:08.524170+0000","last_peered":"2024-09-13T15:16:08.524170+0000","last_clean":"2024-09-13T15:16:08.524170+0000","last_became_active":"2024-09-13T15:01:48.860317+0000","last_became_peered":"2024-09-13T15:01:48.860317+0000","last_unstale":"2024-09-13T15:16:08.524170+0000","last_undegraded":"2024-09-13T15:16:08.524170+0000","last_fullsized":"2024-09-13T15:16:08.524170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5260,"log_dups_size":0,"ondisk_log_size":5260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:45.317747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230705862,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77504,"num_write_kb":1107255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.867788+0000","last_change":"2024-09-13T15:01:44.835494+0000","last_active":"2024-09-13T15:15:27.867788+0000","last_peered":"2024-09-13T15:15:27.867788+0000","last_clean":"2024-09-13T15:15:27.867788+0000","last_became_active":"2024-09-13T15:01:44.831150+0000","last_became_peered":"2024-09-13T15:01:44.831150+0000","last_unstale":"2024-09-13T15:15:27.867788+0000","last_undegraded":"2024-09-13T15:15:27.867788+0000","last_fullsized":"2024-09-13T15:15:27.867788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:29.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'22","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.115656+0000","last_change":"2024-09-13T15:01:44.390278+0000","last_active":"2024-09-13T15:15:57.115656+0000","last_peered":"2024-09-13T15:15:57.115656+0000","last_clean":"2024-09-13T15:15:57.115656+0000","last_became_active":"2024-09-13T15:01:44.389946+0000","last_became_peered":"2024-09-13T15:01:44.389946+0000","last_unstale":"2024-09-13T15:15:57.115656+0000","last_undegraded":"2024-09-13T15:15:57.115656+0000","last_fullsized":"2024-09-13T15:15:57.115656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:53.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"33'4067","reported_seq":4092,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.482133+0000","last_change":"2024-09-13T15:01:48.848009+0000","last_active":"2024-09-13T15:16:07.482133+0000","last_peered":"2024-09-13T15:16:07.482133+0000","last_clean":"2024-09-13T15:16:07.482133+0000","last_became_active":"2024-09-13T15:01:48.847605+0000","last_became_peered":"2024-09-13T15:01:48.847605+0000","last_unstale":"2024-09-13T15:16:07.482133+0000","last_undegraded":"2024-09-13T15:16:07.482133+0000","last_fullsized":"2024-09-13T15:16:07.482133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:32.053010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205605377,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59518,"num_write_kb":873580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.599764+0000","last_change":"2024-09-13T15:01:44.808572+0000","last_active":"2024-09-13T15:15:28.599764+0000","last_peered":"2024-09-13T15:15:28.599764+0000","last_clean":"2024-09-13T15:15:28.599764+0000","last_became_active":"2024-09-13T15:01:44.808140+0000","last_became_peered":"2024-09-13T15:01:44.808140+0000","last_unstale":"2024-09-13T15:15:28.599764+0000","last_undegraded":"2024-09-13T15:15:28.599764+0000","last_fullsized":"2024-09-13T15:15:28.599764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:15.497720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"33'9","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:45.745857+0000","last_change":"2024-09-13T15:01:44.428794+0000","last_active":"2024-09-13T15:15:45.745857+0000","last_peered":"2024-09-13T15:15:45.745857+0000","last_clean":"2024-09-13T15:15:45.745857+0000","last_became_active":"2024-09-13T15:01:44.428271+0000","last_became_peered":"2024-09-13T15:01:44.428271+0000","last_unstale":"2024-09-13T15:15:45.745857+0000","last_undegraded":"2024-09-13T15:15:45.745857+0000","last_fullsized":"2024-09-13T15:15:45.745857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:53.225826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"33'4906","reported_seq":4931,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.927201+0000","last_change":"2024-09-13T15:01:48.916354+0000","last_active":"2024-09-13T15:16:08.927201+0000","last_peered":"2024-09-13T15:16:08.927201+0000","last_clean":"2024-09-13T15:16:08.927201+0000","last_became_active":"2024-09-13T15:01:48.916008+0000","last_became_peered":"2024-09-13T15:01:48.916008+0000","last_unstale":"2024-09-13T15:16:08.927201+0000","last_undegraded":"2024-09-13T15:16:08.927201+0000","last_fullsized":"2024-09-13T15:16:08.927201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4906,"log_dups_size":0,"ondisk_log_size":4906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:58.115410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197156098,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72323,"num_write_kb":1020409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'15","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.217211+0000","last_change":"2024-09-13T15:01:44.826700+0000","last_active":"2024-09-13T15:16:08.217211+0000","last_peered":"2024-09-13T15:16:08.217211+0000","last_clean":"2024-09-13T15:16:08.217211+0000","last_became_active":"2024-09-13T15:01:44.825996+0000","last_became_peered":"2024-09-13T15:01:44.825996+0000","last_unstale":"2024-09-13T15:16:08.217211+0000","last_undegraded":"2024-09-13T15:16:08.217211+0000","last_fullsized":"2024-09-13T15:16:08.217211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:11.963837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'6","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.869444+0000","last_change":"2024-09-13T15:01:44.409339+0000","last_active":"2024-09-13T15:15:27.869444+0000","last_peered":"2024-09-13T15:15:27.869444+0000","last_clean":"2024-09-13T15:15:27.869444+0000","last_became_active":"2024-09-13T15:01:44.408644+0000","last_became_peered":"2024-09-13T15:01:44.408644+0000","last_unstale":"2024-09-13T15:15:27.869444+0000","last_undegraded":"2024-09-13T15:15:27.869444+0000","last_fullsized":"2024-09-13T15:15:27.869444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:29.297950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'4683","reported_seq":4709,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:09.628413+0000","last_change":"2024-09-13T15:01:48.916478+0000","last_active":"2024-09-13T15:16:09.628413+0000","last_peered":"2024-09-13T15:16:09.628413+0000","last_clean":"2024-09-13T15:16:09.628413+0000","last_became_active":"2024-09-13T15:01:48.916198+0000","last_became_peered":"2024-09-13T15:01:48.916198+0000","last_unstale":"2024-09-13T15:16:09.628413+0000","last_undegraded":"2024-09-13T15:16:09.628413+0000","last_fullsized":"2024-09-13T15:16:09.628413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4683,"log_dups_size":0,"ondisk_log_size":4683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:26.311460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188820535,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68918,"num_write_kb":974417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.196456+0000","last_change":"2024-09-13T15:01:44.831833+0000","last_active":"2024-09-13T15:15:58.196456+0000","last_peered":"2024-09-13T15:15:58.196456+0000","last_clean":"2024-09-13T15:15:58.196456+0000","last_became_active":"2024-09-13T15:01:44.831583+0000","last_became_peered":"2024-09-13T15:01:44.831583+0000","last_unstale":"2024-09-13T15:15:58.196456+0000","last_undegraded":"2024-09-13T15:15:58.196456+0000","last_fullsized":"2024-09-13T15:15:58.196456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.715951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"30'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:53.196045+0000","last_change":"2024-09-13T15:01:44.408752+0000","last_active":"2024-09-13T15:15:53.196045+0000","last_peered":"2024-09-13T15:15:53.196045+0000","last_clean":"2024-09-13T15:15:53.196045+0000","last_became_active":"2024-09-13T15:01:44.408453+0000","last_became_peered":"2024-09-13T15:01:44.408453+0000","last_unstale":"2024-09-13T15:15:53.196045+0000","last_undegraded":"2024-09-13T15:15:53.196045+0000","last_fullsized":"2024-09-13T15:15:53.196045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:31.587404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":8225,"num_write":32,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'5090","reported_seq":5115,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.745513+0000","last_change":"2024-09-13T15:01:48.916681+0000","last_active":"2024-09-13T15:16:10.745513+0000","last_peered":"2024-09-13T15:16:10.745513+0000","last_clean":"2024-09-13T15:16:10.745513+0000","last_became_active":"2024-09-13T15:01:48.916185+0000","last_became_peered":"2024-09-13T15:01:48.916185+0000","last_unstale":"2024-09-13T15:16:10.745513+0000","last_undegraded":"2024-09-13T15:16:10.745513+0000","last_fullsized":"2024-09-13T15:16:10.745513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5090,"log_dups_size":0,"ondisk_log_size":5090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:33.862835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155327682,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74423,"num_write_kb":1089564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.869822+0000","last_change":"2024-09-13T15:01:44.817007+0000","last_active":"2024-09-13T15:15:27.869822+0000","last_peered":"2024-09-13T15:15:27.869822+0000","last_clean":"2024-09-13T15:15:27.869822+0000","last_became_active":"2024-09-13T15:01:44.815435+0000","last_became_peered":"2024-09-13T15:01:44.815435+0000","last_unstale":"2024-09-13T15:15:27.869822+0000","last_undegraded":"2024-09-13T15:15:27.869822+0000","last_fullsized":"2024-09-13T15:15:27.869822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:25.887993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'576","reported_seq":617,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.679087+0000","last_change":"2024-09-13T15:01:44.435688+0000","last_active":"2024-09-13T15:16:10.679087+0000","last_peered":"2024-09-13T15:16:10.679087+0000","last_clean":"2024-09-13T15:16:10.679087+0000","last_became_active":"2024-09-13T15:01:44.435222+0000","last_became_peered":"2024-09-13T15:01:44.435222+0000","last_unstale":"2024-09-13T15:16:10.679087+0000","last_undegraded":"2024-09-13T15:16:10.679087+0000","last_fullsized":"2024-09-13T15:16:10.679087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:24.705633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8159583,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":7965,"num_write":571,"num_write_kb":8183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"33'4408","reported_seq":4434,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.395947+0000","last_change":"2024-09-13T15:01:48.847694+0000","last_active":"2024-09-13T15:16:10.395947+0000","last_peered":"2024-09-13T15:16:10.395947+0000","last_clean":"2024-09-13T15:16:10.395947+0000","last_became_active":"2024-09-13T15:01:48.846835+0000","last_became_peered":"2024-09-13T15:01:48.846835+0000","last_unstale":"2024-09-13T15:16:10.395947+0000","last_undegraded":"2024-09-13T15:16:10.395947+0000","last_fullsized":"2024-09-13T15:16:10.395947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4408,"log_dups_size":0,"ondisk_log_size":4408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:49.763472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201352826,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64958,"num_write_kb":924599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.484365+0000","last_change":"2024-09-13T15:01:44.835315+0000","last_active":"2024-09-13T15:15:28.484365+0000","last_peered":"2024-09-13T15:15:28.484365+0000","last_clean":"2024-09-13T15:15:28.484365+0000","last_became_active":"2024-09-13T15:01:44.834643+0000","last_became_peered":"2024-09-13T15:01:44.834643+0000","last_unstale":"2024-09-13T15:15:28.484365+0000","last_undegraded":"2024-09-13T15:15:28.484365+0000","last_fullsized":"2024-09-13T15:15:28.484365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:15.535195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'14","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.935173+0000","last_change":"2024-09-13T15:01:44.424966+0000","last_active":"2024-09-13T15:15:57.935173+0000","last_peered":"2024-09-13T15:15:57.935173+0000","last_clean":"2024-09-13T15:15:57.935173+0000","last_became_active":"2024-09-13T15:01:44.424714+0000","last_became_peered":"2024-09-13T15:01:44.424714+0000","last_unstale":"2024-09-13T15:15:57.935173+0000","last_undegraded":"2024-09-13T15:15:57.935173+0000","last_fullsized":"2024-09-13T15:15:57.935173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:46.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":15,"num_write":16,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'4758","reported_seq":4794,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.652318+0000","last_change":"2024-09-13T15:02:33.753482+0000","last_active":"2024-09-13T15:16:08.652318+0000","last_peered":"2024-09-13T15:16:08.652318+0000","last_clean":"2024-09-13T15:16:08.652318+0000","last_became_active":"2024-09-13T15:02:33.752505+0000","last_became_peered":"2024-09-13T15:02:33.752505+0000","last_unstale":"2024-09-13T15:16:08.652318+0000","last_undegraded":"2024-09-13T15:16:08.652318+0000","last_fullsized":"2024-09-13T15:16:08.652318+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4758,"log_dups_size":0,"ondisk_log_size":4758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:59.041586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176191855,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69693,"num_write_kb":999376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"33'8","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.864245+0000","last_change":"2024-09-13T15:01:44.837032+0000","last_active":"2024-09-13T15:15:27.864245+0000","last_peered":"2024-09-13T15:15:27.864245+0000","last_clean":"2024-09-13T15:15:27.864245+0000","last_became_active":"2024-09-13T15:01:44.836750+0000","last_became_peered":"2024-09-13T15:01:44.836750+0000","last_unstale":"2024-09-13T15:15:27.864245+0000","last_undegraded":"2024-09-13T15:15:27.864245+0000","last_fullsized":"2024-09-13T15:15:27.864245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:04.491426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"33'9","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.872036+0000","last_change":"2024-09-13T15:01:44.437854+0000","last_active":"2024-09-13T15:15:27.872036+0000","last_peered":"2024-09-13T15:15:27.872036+0000","last_clean":"2024-09-13T15:15:27.872036+0000","last_became_active":"2024-09-13T15:01:44.437433+0000","last_became_peered":"2024-09-13T15:01:44.437433+0000","last_unstale":"2024-09-13T15:15:27.872036+0000","last_undegraded":"2024-09-13T15:15:27.872036+0000","last_fullsized":"2024-09-13T15:15:27.872036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:47.302388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":18,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'4852","reported_seq":4878,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.954746+0000","last_change":"2024-09-13T15:01:48.841829+0000","last_active":"2024-09-13T15:16:08.954746+0000","last_peered":"2024-09-13T15:16:08.954746+0000","last_clean":"2024-09-13T15:16:08.954746+0000","last_became_active":"2024-09-13T15:01:48.841267+0000","last_became_peered":"2024-09-13T15:01:48.841267+0000","last_unstale":"2024-09-13T15:16:08.954746+0000","last_undegraded":"2024-09-13T15:16:08.954746+0000","last_fullsized":"2024-09-13T15:16:08.954746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4852,"log_dups_size":0,"ondisk_log_size":4852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:25.029615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184577144,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71199,"num_write_kb":1004130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:13:55.797181+0000","last_change":"2024-09-13T15:01:44.844701+0000","last_active":"2024-09-13T15:13:55.797181+0000","last_peered":"2024-09-13T15:13:55.797181+0000","last_clean":"2024-09-13T15:13:55.797181+0000","last_became_active":"2024-09-13T15:01:44.843982+0000","last_became_peered":"2024-09-13T15:01:44.843982+0000","last_unstale":"2024-09-13T15:13:55.797181+0000","last_undegraded":"2024-09-13T15:13:55.797181+0000","last_fullsized":"2024-09-13T15:13:55.797181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"33'14","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.659715+0000","last_change":"2024-09-13T15:01:44.436081+0000","last_active":"2024-09-13T15:16:10.659715+0000","last_peered":"2024-09-13T15:16:10.659715+0000","last_clean":"2024-09-13T15:16:10.659715+0000","last_became_active":"2024-09-13T15:01:44.435367+0000","last_became_peered":"2024-09-13T15:01:44.435367+0000","last_unstale":"2024-09-13T15:16:10.659715+0000","last_undegraded":"2024-09-13T15:16:10.659715+0000","last_fullsized":"2024-09-13T15:16:10.659715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:57:57.065719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"33'3894","reported_seq":3920,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.734027+0000","last_change":"2024-09-13T15:01:48.910562+0000","last_active":"2024-09-13T15:16:08.734027+0000","last_peered":"2024-09-13T15:16:08.734027+0000","last_clean":"2024-09-13T15:16:08.734027+0000","last_became_active":"2024-09-13T15:01:48.909681+0000","last_became_peered":"2024-09-13T15:01:48.909681+0000","last_unstale":"2024-09-13T15:16:08.734027+0000","last_undegraded":"2024-09-13T15:16:08.734027+0000","last_fullsized":"2024-09-13T15:16:08.734027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":3894,"log_dups_size":0,"ondisk_log_size":3894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:35.989769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171990195,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57348,"num_write_kb":843085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'3639","reported_seq":3676,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.200570+0000","last_change":"2024-09-13T15:02:34.118951+0000","last_active":"2024-09-13T15:16:07.200570+0000","last_peered":"2024-09-13T15:16:07.200570+0000","last_clean":"2024-09-13T15:16:07.200570+0000","last_became_active":"2024-09-13T15:02:34.118477+0000","last_became_peered":"2024-09-13T15:02:34.118477+0000","last_unstale":"2024-09-13T15:16:07.200570+0000","last_undegraded":"2024-09-13T15:16:07.200570+0000","last_fullsized":"2024-09-13T15:16:07.200570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":3639,"log_dups_size":0,"ondisk_log_size":3639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:13.697114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142701044,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53400,"num_write_kb":757724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:05.388722+0000","last_change":"2024-09-13T15:01:44.808417+0000","last_active":"2024-09-13T15:16:05.388722+0000","last_peered":"2024-09-13T15:16:05.388722+0000","last_clean":"2024-09-13T15:16:05.388722+0000","last_became_active":"2024-09-13T15:01:44.807641+0000","last_became_peered":"2024-09-13T15:01:44.807641+0000","last_unstale":"2024-09-13T15:16:05.388722+0000","last_undegraded":"2024-09-13T15:16:05.388722+0000","last_fullsized":"2024-09-13T15:16:05.388722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:58.296966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'34","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:33.277729+0000","last_change":"2024-09-13T15:01:44.433582+0000","last_active":"2024-09-13T15:15:33.277729+0000","last_peered":"2024-09-13T15:15:33.277729+0000","last_clean":"2024-09-13T15:15:33.277729+0000","last_became_active":"2024-09-13T15:01:44.433124+0000","last_became_peered":"2024-09-13T15:01:44.433124+0000","last_unstale":"2024-09-13T15:15:33.277729+0000","last_undegraded":"2024-09-13T15:15:33.277729+0000","last_fullsized":"2024-09-13T15:15:33.277729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:04.476996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":8193,"num_write":27,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4877","reported_seq":4903,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.210978+0000","last_change":"2024-09-13T15:01:48.855090+0000","last_active":"2024-09-13T15:16:10.210978+0000","last_peered":"2024-09-13T15:16:10.210978+0000","last_clean":"2024-09-13T15:16:10.210978+0000","last_became_active":"2024-09-13T15:01:48.852925+0000","last_became_peered":"2024-09-13T15:01:48.852925+0000","last_unstale":"2024-09-13T15:16:10.210978+0000","last_undegraded":"2024-09-13T15:16:10.210978+0000","last_fullsized":"2024-09-13T15:16:10.210978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4877,"log_dups_size":0,"ondisk_log_size":4877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.176480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192967854,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71595,"num_write_kb":1060070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"33'9","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.732294+0000","last_change":"2024-09-13T15:02:33.746356+0000","last_active":"2024-09-13T15:15:58.732294+0000","last_peered":"2024-09-13T15:15:58.732294+0000","last_clean":"2024-09-13T15:15:58.732294+0000","last_became_active":"2024-09-13T15:02:33.746005+0000","last_became_peered":"2024-09-13T15:02:33.746005+0000","last_unstale":"2024-09-13T15:15:58.732294+0000","last_undegraded":"2024-09-13T15:15:58.732294+0000","last_fullsized":"2024-09-13T15:15:58.732294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:41.159781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"33'6","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389847+0000","last_change":"2024-09-13T15:01:44.436900+0000","last_active":"2024-09-13T15:15:28.389847+0000","last_peered":"2024-09-13T15:15:28.389847+0000","last_clean":"2024-09-13T15:15:28.389847+0000","last_became_active":"2024-09-13T15:01:44.436646+0000","last_became_peered":"2024-09-13T15:01:44.436646+0000","last_unstale":"2024-09-13T15:15:28.389847+0000","last_undegraded":"2024-09-13T15:15:28.389847+0000","last_fullsized":"2024-09-13T15:15:28.389847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:52.505856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":27,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"33'47","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:34.359088+0000","last_change":"2024-09-13T15:01:44.430115+0000","last_active":"2024-09-13T15:15:34.359088+0000","last_peered":"2024-09-13T15:15:34.359088+0000","last_clean":"2024-09-13T15:15:34.359088+0000","last_became_active":"2024-09-13T15:01:44.429339+0000","last_became_peered":"2024-09-13T15:01:44.429339+0000","last_unstale":"2024-09-13T15:15:34.359088+0000","last_undegraded":"2024-09-13T15:15:34.359088+0000","last_fullsized":"2024-09-13T15:15:34.359088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:47.224125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":8210,"num_write":46,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.864483+0000","last_change":"2024-09-13T15:01:44.822034+0000","last_active":"2024-09-13T15:15:27.864483+0000","last_peered":"2024-09-13T15:15:27.864483+0000","last_clean":"2024-09-13T15:15:27.864483+0000","last_became_active":"2024-09-13T15:01:44.821734+0000","last_became_peered":"2024-09-13T15:01:44.821734+0000","last_unstale":"2024-09-13T15:15:27.864483+0000","last_undegraded":"2024-09-13T15:15:27.864483+0000","last_fullsized":"2024-09-13T15:15:27.864483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:57:44.629046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"33'4661","reported_seq":4686,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.260927+0000","last_change":"2024-09-13T15:01:48.858033+0000","last_active":"2024-09-13T15:16:07.260927+0000","last_peered":"2024-09-13T15:16:07.260927+0000","last_clean":"2024-09-13T15:16:07.260927+0000","last_became_active":"2024-09-13T15:01:48.857584+0000","last_became_peered":"2024-09-13T15:01:48.857584+0000","last_unstale":"2024-09-13T15:16:07.260927+0000","last_undegraded":"2024-09-13T15:16:07.260927+0000","last_fullsized":"2024-09-13T15:16:07.260927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4661,"log_dups_size":0,"ondisk_log_size":4661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:04.797167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192971375,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68630,"num_write_kb":960930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'1778","reported_seq":1809,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389774+0000","last_change":"2024-09-13T15:01:44.422582+0000","last_active":"2024-09-13T15:15:28.389774+0000","last_peered":"2024-09-13T15:15:28.389774+0000","last_clean":"2024-09-13T15:15:28.389774+0000","last_became_active":"2024-09-13T15:01:44.422367+0000","last_became_peered":"2024-09-13T15:01:44.422367+0000","last_unstale":"2024-09-13T15:15:28.389774+0000","last_undegraded":"2024-09-13T15:15:28.389774+0000","last_fullsized":"2024-09-13T15:15:28.389774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1778,"log_dups_size":0,"ondisk_log_size":1778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.902724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195253,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4098,"num_write":1774,"num_write_kb":4250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:12.752509+0000","last_change":"2024-09-13T15:01:44.820841+0000","last_active":"2024-09-13T15:14:12.752509+0000","last_peered":"2024-09-13T15:14:12.752509+0000","last_clean":"2024-09-13T15:14:12.752509+0000","last_became_active":"2024-09-13T15:01:44.816584+0000","last_became_peered":"2024-09-13T15:01:44.816584+0000","last_unstale":"2024-09-13T15:14:12.752509+0000","last_undegraded":"2024-09-13T15:14:12.752509+0000","last_fullsized":"2024-09-13T15:14:12.752509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:26.763818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4675","reported_seq":4700,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:09.586090+0000","last_change":"2024-09-13T15:01:48.840771+0000","last_active":"2024-09-13T15:16:09.586090+0000","last_peered":"2024-09-13T15:16:09.586090+0000","last_clean":"2024-09-13T15:16:09.586090+0000","last_became_active":"2024-09-13T15:01:48.840397+0000","last_became_peered":"2024-09-13T15:01:48.840397+0000","last_unstale":"2024-09-13T15:16:09.586090+0000","last_undegraded":"2024-09-13T15:16:09.586090+0000","last_fullsized":"2024-09-13T15:16:09.586090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4675,"log_dups_size":0,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:59.700088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180423209,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68695,"num_write_kb":983871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"33'10","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:05.934297+0000","last_change":"2024-09-13T15:01:44.809497+0000","last_active":"2024-09-13T15:16:05.934297+0000","last_peered":"2024-09-13T15:16:05.934297+0000","last_clean":"2024-09-13T15:16:05.934297+0000","last_became_active":"2024-09-13T15:01:44.808669+0000","last_became_peered":"2024-09-13T15:01:44.808669+0000","last_unstale":"2024-09-13T15:16:05.934297+0000","last_undegraded":"2024-09-13T15:16:05.934297+0000","last_fullsized":"2024-09-13T15:16:05.934297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:45.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"33'8","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.091461+0000","last_change":"2024-09-13T15:01:44.836353+0000","last_active":"2024-09-13T15:16:02.091461+0000","last_peered":"2024-09-13T15:16:02.091461+0000","last_clean":"2024-09-13T15:16:02.091461+0000","last_became_active":"2024-09-13T15:01:44.836102+0000","last_became_peered":"2024-09-13T15:01:44.836102+0000","last_unstale":"2024-09-13T15:16:02.091461+0000","last_undegraded":"2024-09-13T15:16:02.091461+0000","last_fullsized":"2024-09-13T15:16:02.091461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:14.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:20.816437+0000","last_change":"2024-09-13T15:01:44.849091+0000","last_active":"2024-09-13T15:14:20.816437+0000","last_peered":"2024-09-13T15:14:20.816437+0000","last_clean":"2024-09-13T15:14:20.816437+0000","last_became_active":"2024-09-13T15:01:44.846506+0000","last_became_peered":"2024-09-13T15:01:44.846506+0000","last_unstale":"2024-09-13T15:14:20.816437+0000","last_undegraded":"2024-09-13T15:14:20.816437+0000","last_fullsized":"2024-09-13T15:14:20.816437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:38.026998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.447468+0000","last_change":"2024-09-13T15:01:44.809873+0000","last_active":"2024-09-13T15:15:58.447468+0000","last_peered":"2024-09-13T15:15:58.447468+0000","last_clean":"2024-09-13T15:15:58.447468+0000","last_became_active":"2024-09-13T15:01:44.809585+0000","last_became_peered":"2024-09-13T15:01:44.809585+0000","last_unstale":"2024-09-13T15:15:58.447468+0000","last_undegraded":"2024-09-13T15:15:58.447468+0000","last_fullsized":"2024-09-13T15:15:58.447468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:20.272320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'1","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:44.316932+0000","last_change":"2024-09-13T15:01:44.816761+0000","last_active":"2024-09-13T15:14:44.316932+0000","last_peered":"2024-09-13T15:14:44.316932+0000","last_clean":"2024-09-13T15:14:44.316932+0000","last_became_active":"2024-09-13T15:01:44.816480+0000","last_became_peered":"2024-09-13T15:01:44.816480+0000","last_unstale":"2024-09-13T15:14:44.316932+0000","last_undegraded":"2024-09-13T15:14:44.316932+0000","last_fullsized":"2024-09-13T15:14:44.316932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:46.000440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.712144+0000","last_change":"2024-09-13T15:01:44.808373+0000","last_active":"2024-09-13T15:15:28.712144+0000","last_peered":"2024-09-13T15:15:28.712144+0000","last_clean":"2024-09-13T15:15:28.712144+0000","last_became_active":"2024-09-13T15:01:44.807622+0000","last_became_peered":"2024-09-13T15:01:44.807622+0000","last_unstale":"2024-09-13T15:15:28.712144+0000","last_undegraded":"2024-09-13T15:15:28.712144+0000","last_fullsized":"2024-09-13T15:15:28.712144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:38.584426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"33'8","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.601200+0000","last_change":"2024-09-13T15:01:44.832521+0000","last_active":"2024-09-13T15:15:28.601200+0000","last_peered":"2024-09-13T15:15:28.601200+0000","last_clean":"2024-09-13T15:15:28.601200+0000","last_became_active":"2024-09-13T15:01:44.831889+0000","last_became_peered":"2024-09-13T15:01:44.831889+0000","last_unstale":"2024-09-13T15:15:28.601200+0000","last_undegraded":"2024-09-13T15:15:28.601200+0000","last_fullsized":"2024-09-13T15:15:28.601200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:07.563684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:59.619580+0000","last_change":"2024-09-13T15:01:44.817583+0000","last_active":"2024-09-13T15:14:59.619580+0000","last_peered":"2024-09-13T15:14:59.619580+0000","last_clean":"2024-09-13T15:14:59.619580+0000","last_became_active":"2024-09-13T15:01:44.817350+0000","last_became_peered":"2024-09-13T15:01:44.817350+0000","last_unstale":"2024-09-13T15:14:59.619580+0000","last_undegraded":"2024-09-13T15:14:59.619580+0000","last_fullsized":"2024-09-13T15:14:59.619580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:10.913776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.295235+0000","last_change":"2024-09-13T15:01:44.838372+0000","last_active":"2024-09-13T15:16:02.295235+0000","last_peered":"2024-09-13T15:16:02.295235+0000","last_clean":"2024-09-13T15:16:02.295235+0000","last_became_active":"2024-09-13T15:01:44.837588+0000","last_became_peered":"2024-09-13T15:01:44.837588+0000","last_unstale":"2024-09-13T15:16:02.295235+0000","last_undegraded":"2024-09-13T15:16:02.295235+0000","last_fullsized":"2024-09-13T15:16:02.295235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:05:12.877936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389769+0000","last_change":"2024-09-13T15:01:44.828159+0000","last_active":"2024-09-13T15:15:28.389769+0000","last_peered":"2024-09-13T15:15:28.389769+0000","last_clean":"2024-09-13T15:15:28.389769+0000","last_became_active":"2024-09-13T15:01:44.827910+0000","last_became_peered":"2024-09-13T15:01:44.827910+0000","last_unstale":"2024-09-13T15:15:28.389769+0000","last_undegraded":"2024-09-13T15:15:28.389769+0000","last_fullsized":"2024-09-13T15:15:28.389769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:07:32.776119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"33'7","reported_seq":29,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.902776+0000","last_change":"2024-09-13T15:02:34.119204+0000","last_active":"2024-09-13T15:16:02.902776+0000","last_peered":"2024-09-13T15:16:02.902776+0000","last_clean":"2024-09-13T15:16:02.902776+0000","last_became_active":"2024-09-13T15:02:34.118621+0000","last_became_peered":"2024-09-13T15:02:34.118621+0000","last_unstale":"2024-09-13T15:16:02.902776+0000","last_undegraded":"2024-09-13T15:16:02.902776+0000","last_fullsized":"2024-09-13T15:16:02.902776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:33.356064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"33'8","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.193423+0000","last_change":"2024-09-13T15:01:44.831717+0000","last_active":"2024-09-13T15:15:28.193423+0000","last_peered":"2024-09-13T15:15:28.193423+0000","last_clean":"2024-09-13T15:15:28.193423+0000","last_became_active":"2024-09-13T15:01:44.831495+0000","last_became_peered":"2024-09-13T15:01:44.831495+0000","last_unstale":"2024-09-13T15:15:28.193423+0000","last_undegraded":"2024-09-13T15:15:28.193423+0000","last_fullsized":"2024-09-13T15:15:28.193423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:48.753543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:04.386790+0000","last_change":"2024-09-13T15:01:44.829698+0000","last_active":"2024-09-13T15:16:04.386790+0000","last_peered":"2024-09-13T15:16:04.386790+0000","last_clean":"2024-09-13T15:16:04.386790+0000","last_became_active":"2024-09-13T15:01:44.828999+0000","last_became_peered":"2024-09-13T15:01:44.828999+0000","last_unstale":"2024-09-13T15:16:04.386790+0000","last_undegraded":"2024-09-13T15:16:04.386790+0000","last_fullsized":"2024-09-13T15:16:04.386790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:30.591718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:15:19.592318+0000","last_change":"2024-09-13T15:01:44.817554+0000","last_active":"2024-09-13T15:15:19.592318+0000","last_peered":"2024-09-13T15:15:19.592318+0000","last_clean":"2024-09-13T15:15:19.592318+0000","last_became_active":"2024-09-13T15:01:44.816258+0000","last_became_peered":"2024-09-13T15:01:44.816258+0000","last_unstale":"2024-09-13T15:15:19.592318+0000","last_undegraded":"2024-09-13T15:15:19.592318+0000","last_fullsized":"2024-09-13T15:15:19.592318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:07.927802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"33'14","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:01.892531+0000","last_change":"2024-09-13T15:01:44.809979+0000","last_active":"2024-09-13T15:16:01.892531+0000","last_peered":"2024-09-13T15:16:01.892531+0000","last_clean":"2024-09-13T15:16:01.892531+0000","last_became_active":"2024-09-13T15:01:44.809687+0000","last_became_peered":"2024-09-13T15:01:44.809687+0000","last_unstale":"2024-09-13T15:16:01.892531+0000","last_undegraded":"2024-09-13T15:16:01.892531+0000","last_fullsized":"2024-09-13T15:16:01.892531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:45.583840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"33'9","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.497597+0000","last_change":"2024-09-13T15:02:34.119233+0000","last_active":"2024-09-13T15:15:58.497597+0000","last_peered":"2024-09-13T15:15:58.497597+0000","last_clean":"2024-09-13T15:15:58.497597+0000","last_became_active":"2024-09-13T15:02:34.118798+0000","last_became_peered":"2024-09-13T15:02:34.118798+0000","last_unstale":"2024-09-13T15:15:58.497597+0000","last_undegraded":"2024-09-13T15:15:58.497597+0000","last_fullsized":"2024-09-13T15:15:58.497597+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:12.367569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:50.837989+0000","last_change":"2024-09-13T15:01:44.848904+0000","last_active":"2024-09-13T15:15:50.837989+0000","last_peered":"2024-09-13T15:15:50.837989+0000","last_clean":"2024-09-13T15:15:50.837989+0000","last_became_active":"2024-09-13T15:01:44.846074+0000","last_became_peered":"2024-09-13T15:01:44.846074+0000","last_unstale":"2024-09-13T15:15:50.837989+0000","last_undegraded":"2024-09-13T15:15:50.837989+0000","last_fullsized":"2024-09-13T15:15:50.837989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:37.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.757358+0000","last_change":"2024-09-13T15:01:44.828243+0000","last_active":"2024-09-13T15:15:58.757358+0000","last_peered":"2024-09-13T15:15:58.757358+0000","last_clean":"2024-09-13T15:15:58.757358+0000","last_became_active":"2024-09-13T15:01:44.828024+0000","last_became_peered":"2024-09-13T15:01:44.828024+0000","last_unstale":"2024-09-13T15:15:58.757358+0000","last_undegraded":"2024-09-13T15:15:58.757358+0000","last_fullsized":"2024-09-13T15:15:58.757358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:28:47.388087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.095134+0000","last_change":"2024-09-13T15:01:44.808879+0000","last_active":"2024-09-13T15:15:57.095134+0000","last_peered":"2024-09-13T15:15:57.095134+0000","last_clean":"2024-09-13T15:15:57.095134+0000","last_became_active":"2024-09-13T15:01:44.808609+0000","last_became_peered":"2024-09-13T15:01:44.808609+0000","last_unstale":"2024-09-13T15:15:57.095134+0000","last_undegraded":"2024-09-13T15:15:57.095134+0000","last_fullsized":"2024-09-13T15:15:57.095134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:59.817452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"33'7","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389496+0000","last_change":"2024-09-13T15:01:44.811171+0000","last_active":"2024-09-13T15:15:28.389496+0000","last_peered":"2024-09-13T15:15:28.389496+0000","last_clean":"2024-09-13T15:15:28.389496+0000","last_became_active":"2024-09-13T15:01:44.809918+0000","last_became_peered":"2024-09-13T15:01:44.809918+0000","last_unstale":"2024-09-13T15:15:28.389496+0000","last_undegraded":"2024-09-13T15:15:28.389496+0000","last_fullsized":"2024-09-13T15:15:28.389496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:48.359429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.484061+0000","last_change":"2024-09-13T15:01:44.833663+0000","last_active":"2024-09-13T15:15:28.484061+0000","last_peered":"2024-09-13T15:15:28.484061+0000","last_clean":"2024-09-13T15:15:28.484061+0000","last_became_active":"2024-09-13T15:01:44.828737+0000","last_became_peered":"2024-09-13T15:01:44.828737+0000","last_unstale":"2024-09-13T15:15:28.484061+0000","last_undegraded":"2024-09-13T15:15:28.484061+0000","last_fullsized":"2024-09-13T15:15:28.484061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:08.579890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.696714+0000","last_change":"2024-09-13T15:01:44.851143+0000","last_active":"2024-09-13T15:15:58.696714+0000","last_peered":"2024-09-13T15:15:58.696714+0000","last_clean":"2024-09-13T15:15:58.696714+0000","last_became_active":"2024-09-13T15:01:44.850410+0000","last_became_peered":"2024-09-13T15:01:44.850410+0000","last_unstale":"2024-09-13T15:15:58.696714+0000","last_undegraded":"2024-09-13T15:15:58.696714+0000","last_fullsized":"2024-09-13T15:15:58.696714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:11.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'10","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:13:55.683421+0000","last_change":"2024-09-13T15:01:44.840082+0000","last_active":"2024-09-13T15:13:55.683421+0000","last_peered":"2024-09-13T15:13:55.683421+0000","last_clean":"2024-09-13T15:13:55.683421+0000","last_became_active":"2024-09-13T15:01:44.839371+0000","last_became_peered":"2024-09-13T15:01:44.839371+0000","last_unstale":"2024-09-13T15:13:55.683421+0000","last_undegraded":"2024-09-13T15:13:55.683421+0000","last_fullsized":"2024-09-13T15:13:55.683421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:13.433036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"33'9","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.952810+0000","last_change":"2024-09-13T15:01:44.850416+0000","last_active":"2024-09-13T15:15:57.952810+0000","last_peered":"2024-09-13T15:15:57.952810+0000","last_clean":"2024-09-13T15:15:57.952810+0000","last_became_active":"2024-09-13T15:01:44.849766+0000","last_became_peered":"2024-09-13T15:01:44.849766+0000","last_unstale":"2024-09-13T15:15:57.952810+0000","last_undegraded":"2024-09-13T15:15:57.952810+0000","last_fullsized":"2024-09-13T15:15:57.952810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:11.985610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389960+0000","last_change":"2024-09-13T15:01:44.837060+0000","last_active":"2024-09-13T15:15:28.389960+0000","last_peered":"2024-09-13T15:15:28.389960+0000","last_clean":"2024-09-13T15:15:28.389960+0000","last_became_active":"2024-09-13T15:01:44.836770+0000","last_became_peered":"2024-09-13T15:01:44.836770+0000","last_unstale":"2024-09-13T15:15:28.389960+0000","last_undegraded":"2024-09-13T15:15:28.389960+0000","last_fullsized":"2024-09-13T15:15:28.389960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:45.915852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'5","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:19.453771+0000","last_change":"2024-09-13T15:01:44.815867+0000","last_active":"2024-09-13T15:14:19.453771+0000","last_peered":"2024-09-13T15:14:19.453771+0000","last_clean":"2024-09-13T15:14:19.453771+0000","last_became_active":"2024-09-13T15:01:44.815116+0000","last_became_peered":"2024-09-13T15:01:44.815116+0000","last_unstale":"2024-09-13T15:14:19.453771+0000","last_undegraded":"2024-09-13T15:14:19.453771+0000","last_fullsized":"2024-09-13T15:14:19.453771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:02.814724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:20.816422+0000","last_change":"2024-09-13T15:01:44.850022+0000","last_active":"2024-09-13T15:14:20.816422+0000","last_peered":"2024-09-13T15:14:20.816422+0000","last_clean":"2024-09-13T15:14:20.816422+0000","last_became_active":"2024-09-13T15:01:44.849533+0000","last_became_peered":"2024-09-13T15:01:44.849533+0000","last_unstale":"2024-09-13T15:14:20.816422+0000","last_undegraded":"2024-09-13T15:14:20.816422+0000","last_fullsized":"2024-09-13T15:14:20.816422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:09.837692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:19.453803+0000","last_change":"2024-09-13T15:01:44.817139+0000","last_active":"2024-09-13T15:14:19.453803+0000","last_peered":"2024-09-13T15:14:19.453803+0000","last_clean":"2024-09-13T15:14:19.453803+0000","last_became_active":"2024-09-13T15:01:44.816416+0000","last_became_peered":"2024-09-13T15:01:44.816416+0000","last_unstale":"2024-09-13T15:14:19.453803+0000","last_undegraded":"2024-09-13T15:14:19.453803+0000","last_fullsized":"2024-09-13T15:14:19.453803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:38.382210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:37.845022+0000","last_change":"2024-09-13T15:02:33.747735+0000","last_active":"2024-09-13T15:14:37.845022+0000","last_peered":"2024-09-13T15:14:37.845022+0000","last_clean":"2024-09-13T15:14:37.845022+0000","last_became_active":"2024-09-13T15:02:33.747405+0000","last_became_peered":"2024-09-13T15:02:33.747405+0000","last_unstale":"2024-09-13T15:14:37.845022+0000","last_undegraded":"2024-09-13T15:14:37.845022+0000","last_fullsized":"2024-09-13T15:14:37.845022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:20.616184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.992814+0000","last_change":"2024-09-13T15:01:44.808264+0000","last_active":"2024-09-13T15:15:57.992814+0000","last_peered":"2024-09-13T15:15:57.992814+0000","last_clean":"2024-09-13T15:15:57.992814+0000","last_became_active":"2024-09-13T15:01:44.807776+0000","last_became_peered":"2024-09-13T15:01:44.807776+0000","last_unstale":"2024-09-13T15:15:57.992814+0000","last_undegraded":"2024-09-13T15:15:57.992814+0000","last_fullsized":"2024-09-13T15:15:57.992814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:17.637800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:18.534958+0000","last_change":"2024-09-13T15:01:44.804985+0000","last_active":"2024-09-13T15:14:18.534958+0000","last_peered":"2024-09-13T15:14:18.534958+0000","last_clean":"2024-09-13T15:14:18.534958+0000","last_became_active":"2024-09-13T15:01:44.803977+0000","last_became_peered":"2024-09-13T15:01:44.803977+0000","last_unstale":"2024-09-13T15:14:18.534958+0000","last_undegraded":"2024-09-13T15:14:18.534958+0000","last_fullsized":"2024-09-13T15:14:18.534958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:12.999738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:06.045422+0000","last_change":"2024-09-13T15:01:44.824666+0000","last_active":"2024-09-13T15:16:06.045422+0000","last_peered":"2024-09-13T15:16:06.045422+0000","last_clean":"2024-09-13T15:16:06.045422+0000","last_became_active":"2024-09-13T15:01:44.815381+0000","last_became_peered":"2024-09-13T15:01:44.815381+0000","last_unstale":"2024-09-13T15:16:06.045422+0000","last_undegraded":"2024-09-13T15:16:06.045422+0000","last_fullsized":"2024-09-13T15:16:06.045422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:12:17.680247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":5983482934,"num_objects":1612,"num_object_clones":0,"num_object_copies":6448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1612,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2169537,"num_write_kb":31079058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11786485760,"data_stored":11786485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147707,"ondisk_log_size":147707,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":368,"ondisk_log_size":368,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":108901215,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":501,"num_read_kb":110953,"num_write":3231,"num_write_kb":107176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":74,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":218046464,"data_stored":217802241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3140,"ondisk_log_size":3140,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542321,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2252656,"kb_used_data":1359464,"kb_used_omap":1,"kb_used_meta":891134,"kb_avail":92119184,"statfs":{"total":96636764160,"available":94330044416,"internally_reserved":0,"allocated":1392091136,"data_stored":1391853235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":912521675},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":4.9580000000000002,"5min":7.657,"15min":4.8689999999999998},"min":{"1min":0.497,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":108.818,"5min":254.13499999999999,"15min":254.13499999999999},"last":108.818},{"interface":"front","average":{"1min":5.016,"5min":7.7190000000000003,"15min":4.883},"min":{"1min":0.46100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":108.85299999999999,"5min":254.119,"15min":254.119},"last":108.85299999999999}]},{"osd":1,"last update":"Fri Sep 13 15:16:00 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":14.494999999999999,"15min":8.6910000000000007},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.29999999999999999},"max":{"1min":4.3449999999999998,"5min":281.399,"15min":281.399},"last":116.92400000000001},{"interface":"front","average":{"1min":1.1379999999999999,"5min":12.275,"15min":9.9440000000000008},"min":{"1min":0.41099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.3120000000000003,"5min":265.74299999999999,"15min":557.92399999999998},"last":116.828}]},{"osd":2,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":5.1769999999999996,"5min":9.6869999999999994,"15min":5.5309999999999997},"min":{"1min":0.47099999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":119.023,"5min":280.29700000000003,"15min":280.29700000000003},"last":119.023},{"interface":"front","average":{"1min":5.2130000000000001,"5min":9.0009999999999994,"15min":5.2590000000000003},"min":{"1min":0.48299999999999998,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":115.961,"5min":274.03500000000003,"15min":274.03500000000003},"last":115.961}]},{"osd":3,"last update":"Fri Sep 13 15:16:03 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":10.202999999999999,"15min":6.407},"min":{"1min":0.377,"5min":0.377,"15min":0.32300000000000001},"max":{"1min":5.0300000000000002,"5min":261.36000000000001,"15min":261.36000000000001},"last":111.05500000000001},{"interface":"front","average":{"1min":0.94399999999999995,"5min":7.5250000000000004,"15min":5.0149999999999997},"min":{"1min":0.502,"5min":0.37,"15min":0.29599999999999999},"max":{"1min":5.2889999999999997,"5min":252.90000000000001,"15min":252.90000000000001},"last":111.715}]},{"osd":4,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":2.141,"15min":1.3029999999999999},"min":{"1min":0.60199999999999998,"5min":0.248,"15min":0.23699999999999999},"max":{"1min":2.0089999999999999,"5min":20.928999999999998,"15min":20.928999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.2250000000000001,"5min":2.2869999999999999,"15min":1.379},"min":{"1min":0.61199999999999999,"5min":0.254,"15min":0.24199999999999999},"max":{"1min":6.4589999999999996,"5min":20.893000000000001,"15min":20.893000000000001},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.123,"15min":1.093},"min":{"1min":0.30299999999999999,"5min":0.248,"15min":0.248},"max":{"1min":1.2869999999999999,"5min":11.800000000000001,"15min":11.800000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":1.02,"5min":1.0649999999999999,"15min":1.014},"min":{"1min":0.34100000000000003,"5min":0.252,"15min":0.252},"max":{"1min":2.625,"5min":8.593,"15min":8.593},"last":0.41899999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.988,"15min":1.377},"min":{"1min":0.42899999999999999,"5min":0.29699999999999999,"15min":0.27700000000000002},"max":{"1min":2.677,"5min":20.835000000000001,"15min":20.835000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.177,"5min":1.716,"15min":1.244},"min":{"1min":0.53900000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":4.9550000000000001,"5min":21.518000000000001,"15min":21.518000000000001},"last":0.57499999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542322,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2625884,"kb_used_data":1483412,"kb_used_omap":1,"kb_used_meta":1140414,"kb_avail":91745956,"statfs":{"total":96636764160,"available":93947858944,"internally_reserved":0,"allocated":1519013888,"data_stored":1518791009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1167784391},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":9.2059999999999995,"5min":13.884,"15min":5.5709999999999997},"min":{"1min":0.32300000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":113.221,"5min":343.02800000000002,"15min":343.02800000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":8.6219999999999999,"5min":13.922000000000001,"15min":5.3899999999999997},"min":{"1min":0.32000000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":114.724,"5min":370.00099999999998,"15min":370.00099999999998},"last":0.45900000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":8.6010000000000009,"5min":15.124000000000001,"15min":6.077},"min":{"1min":0.52800000000000002,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":114.68000000000001,"5min":236.12100000000001,"15min":236.12100000000001},"last":2.0409999999999999},{"interface":"front","average":{"1min":9.0470000000000006,"5min":16.638999999999999,"15min":7.2080000000000002},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.32300000000000001},"max":{"1min":114.613,"5min":274.46800000000002,"15min":274.46800000000002},"last":4.9909999999999997}]},{"osd":2,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":8.4060000000000006,"5min":8.4359999999999999,"15min":3.5990000000000002},"min":{"1min":0.36499999999999999,"5min":0.311,"15min":0.311},"max":{"1min":111.875,"5min":249.75700000000001,"15min":249.75700000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":9.7959999999999994,"5min":9.5779999999999994,"15min":4.0010000000000003},"min":{"1min":0.36899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":111.07899999999999,"5min":283.36700000000002,"15min":283.36700000000002},"last":0.752}]},{"osd":3,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":9.407,"5min":9.8840000000000003,"15min":4.423},"min":{"1min":0.40100000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":113.355,"5min":239.05099999999999,"15min":239.05099999999999},"last":6.6459999999999999},{"interface":"front","average":{"1min":9.0540000000000003,"5min":15.593,"15min":6.3259999999999996},"min":{"1min":0.39000000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":111.92100000000001,"5min":352.03800000000001,"15min":352.03800000000001},"last":0.95699999999999996}]},{"osd":4,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":3.8969999999999998,"15min":2.1880000000000002},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.23300000000000001},"max":{"1min":9.3379999999999992,"5min":37.261000000000003,"15min":91.054000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":3.9700000000000002,"15min":2.238},"min":{"1min":0.35299999999999998,"5min":0.254,"15min":0.254},"max":{"1min":8.9009999999999998,"5min":52.167000000000002,"15min":99.084000000000003},"last":0.42099999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":1.306,"15min":1.036},"min":{"1min":0.28699999999999998,"5min":0.253,"15min":0.253},"max":{"1min":2.5169999999999999,"5min":15.196,"15min":15.196},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.748,"5min":1.6359999999999999,"15min":1.1910000000000001},"min":{"1min":0.36299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.4510000000000001,"5min":25.192,"15min":25.192},"last":0.49199999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":1.982,"15min":1.3149999999999999},"min":{"1min":0.33600000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":2.5990000000000002,"5min":37.219999999999999,"15min":37.219999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.749,"5min":1.337,"15min":1.133},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.5710000000000002,"5min":14.654,"15min":14.654},"last":0.59899999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542321,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1901684,"kb_used_data":1105260,"kb_used_omap":1,"kb_used_meta":792318,"kb_avail":92470156,"statfs":{"total":96636764160,"available":94689439744,"internally_reserved":0,"allocated":1131786240,"data_stored":1131541927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":811334086},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":3.613,"15min":2.6589999999999998},"min":{"1min":0.27600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0109999999999999,"5min":70.611000000000004,"15min":94.078999999999994},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":3.3210000000000002,"15min":2.0489999999999999},"min":{"1min":0.60099999999999998,"5min":0.27800000000000002,"15min":0.27000000000000002},"max":{"1min":1.681,"5min":76.866,"15min":76.866},"last":0.93300000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":5.2690000000000001,"15min":4.3250000000000002},"min":{"1min":0.66500000000000004,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.708,"5min":214.21199999999999,"15min":214.21199999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":4.6760000000000002,"15min":6.625},"min":{"1min":0.57999999999999996,"5min":0.317,"15min":0.317},"max":{"1min":1.6559999999999999,"5min":206.20699999999999,"15min":559.69500000000005},"last":0.76400000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":3.3490000000000002,"15min":2.3210000000000002},"min":{"1min":0.64200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.375,"5min":67.366,"15min":67.366},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.0209999999999999,"5min":2.8820000000000001,"15min":2.0659999999999998},"min":{"1min":0.67100000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.462,"5min":65.522000000000006,"15min":65.522000000000006},"last":0.84199999999999997}]},{"osd":3,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":5.0529999999999999,"15min":3.1219999999999999},"min":{"1min":0.59799999999999998,"5min":0.40300000000000002,"15min":0.37},"max":{"1min":1.4350000000000001,"5min":169.30600000000001,"15min":169.30600000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.091,"5min":6.7750000000000004,"15min":4.1289999999999996},"min":{"1min":0.70199999999999996,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.736,"5min":169.33799999999999,"15min":169.33799999999999},"last":1.0049999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":2.4340000000000002,"15min":1.4059999999999999},"min":{"1min":0.34899999999999998,"5min":0.26100000000000001,"15min":0.223},"max":{"1min":1.6200000000000001,"5min":36.151000000000003,"15min":36.151000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.125,"5min":2.581,"15min":1.482},"min":{"1min":0.44900000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":1.6539999999999999,"5min":36.219000000000001,"15min":36.219000000000001},"last":0.89700000000000002}]},{"osd":6,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.7310000000000001,"15min":1.2170000000000001},"min":{"1min":0.39900000000000002,"5min":0.27300000000000002,"15min":0.25600000000000001},"max":{"1min":1.8500000000000001,"5min":25.734000000000002,"15min":25.734000000000002},"last":0.878},{"interface":"front","average":{"1min":1.236,"5min":1.5489999999999999,"15min":1.169},"min":{"1min":0.54600000000000004,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.6140000000000001,"5min":29.106999999999999,"15min":29.106999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.014,"15min":0.98199999999999998},"min":{"1min":0.497,"5min":0.314,"15min":0.314},"max":{"1min":1.6359999999999999,"5min":10.798,"15min":10.798},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.1559999999999999,"15min":1.0589999999999999},"min":{"1min":0.51900000000000002,"5min":0.314,"15min":0.29699999999999999},"max":{"1min":1.718,"5min":12.874000000000001,"15min":12.874000000000001},"last":0.97399999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542320,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2824368,"kb_used_data":1744104,"kb_used_omap":1,"kb_used_meta":1080254,"kb_avail":91547472,"statfs":{"total":96636764160,"available":93744611328,"internally_reserved":0,"allocated":1785962496,"data_stored":1785739665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1106180550},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":2.6800000000000002,"15min":1.6659999999999999},"min":{"1min":0.47099999999999997,"5min":0.28299999999999997,"15min":0.27100000000000002},"max":{"1min":1,"5min":18.741,"15min":18.741},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":3.1909999999999998,"15min":1.964},"min":{"1min":0.316,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":4.2850000000000001,"5min":27.876999999999999,"15min":27.876999999999999},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":15.648999999999999,"15min":6.7729999999999997},"min":{"1min":0.47299999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0089999999999999,"5min":1296.6300000000001,"15min":1296.6300000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.75,"5min":3.3599999999999999,"15min":2.6190000000000002},"min":{"1min":0.45400000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.109,"5min":25.800999999999998,"15min":47.923999999999999},"last":0.85999999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":2.8319999999999999,"15min":1.8480000000000001},"min":{"1min":0.55300000000000005,"5min":0.309,"15min":0.29999999999999999},"max":{"1min":4.8799999999999999,"5min":23.760999999999999,"15min":23.760999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.94299999999999995,"5min":2.746,"15min":1.899},"min":{"1min":0.40000000000000002,"5min":0.34000000000000002,"15min":0.32500000000000001},"max":{"1min":3.2839999999999998,"5min":23.709,"15min":30.510000000000002},"last":0.755}]},{"osd":3,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":4.9370000000000003,"15min":2.9359999999999999},"min":{"1min":0.48099999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.6360000000000001,"5min":94.281000000000006,"15min":94.281000000000006},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.232,"5min":4.9859999999999998,"15min":3.2210000000000001},"min":{"1min":0.72699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.6699999999999999,"5min":94.319999999999993,"15min":94.319999999999993},"last":0.97599999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.5249999999999999,"15min":1.1599999999999999},"min":{"1min":0.86699999999999999,"5min":0.245,"15min":0.245},"max":{"1min":2.9249999999999998,"5min":18.623999999999999,"15min":18.623999999999999},"last":1.133},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.4630000000000001,"15min":1.1319999999999999},"min":{"1min":0.72099999999999997,"5min":0.246,"15min":0.246},"max":{"1min":4.2469999999999999,"5min":16.155999999999999,"15min":16.155999999999999},"last":0.91500000000000004}]},{"osd":6,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":2.2090000000000001,"15min":1.462},"min":{"1min":0.42999999999999999,"5min":0.27000000000000002,"15min":0.24099999999999999},"max":{"1min":1.226,"5min":27.984000000000002,"15min":27.984000000000002},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.052,"5min":2.1019999999999999,"15min":1.367},"min":{"1min":0.33700000000000002,"5min":0.247,"15min":0.23799999999999999},"max":{"1min":3.21,"5min":28.077000000000002,"15min":28.077000000000002},"last":1}]},{"osd":7,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.9830000000000001,"15min":1.375},"min":{"1min":0.38300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.948,"5min":25.266999999999999,"15min":25.266999999999999},"last":1.028},{"interface":"front","average":{"1min":1.1519999999999999,"5min":2.0800000000000001,"15min":1.4770000000000001},"min":{"1min":0.41399999999999998,"5min":0.34300000000000003,"15min":0.32600000000000001},"max":{"1min":2.0289999999999999,"5min":25.309999999999999,"15min":25.309999999999999},"last":1.0780000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542314,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3457596,"kb_used_data":1975284,"kb_used_omap":1,"kb_used_meta":1482302,"kb_avail":90914244,"statfs":{"total":96636764160,"available":93096185856,"internally_reserved":0,"allocated":2022690816,"data_stored":2022460117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1517877704},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:15:13 2024","interfaces":[{"interface":"back","average":{"1min":5.1440000000000001,"5min":10.525,"15min":6.4550000000000001},"min":{"1min":0.28999999999999998,"5min":0.28000000000000003,"15min":0.253},"max":{"1min":21.207000000000001,"5min":108.956,"15min":170.35599999999999},"last":2.6190000000000002},{"interface":"front","average":{"1min":3.6619999999999999,"5min":6.6130000000000004,"15min":4.5049999999999999},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":19.838999999999999,"5min":63.624000000000002,"15min":168.80699999999999},"last":2.6659999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:15:12 2024","interfaces":[{"interface":"back","average":{"1min":5.5529999999999999,"5min":10.266999999999999,"15min":4.6299999999999999},"min":{"1min":0.33400000000000002,"5min":0.32500000000000001,"15min":0.28499999999999998},"max":{"1min":24.631,"5min":92.722999999999999,"15min":92.722999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":7.992,"5min":12.541,"15min":6.2530000000000001},"min":{"1min":0.308,"5min":0.29899999999999999,"15min":0.26600000000000001},"max":{"1min":26.803999999999998,"5min":89.245000000000005,"15min":104.51300000000001},"last":0.94999999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:15:12 2024","interfaces":[{"interface":"back","average":{"1min":5.6040000000000001,"5min":7.1589999999999998,"15min":3.887},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":25.036000000000001,"5min":74.825000000000003,"15min":74.825000000000003},"last":1.675},{"interface":"front","average":{"1min":5.6719999999999997,"5min":7.6130000000000004,"15min":3.863},"min":{"1min":0.439,"5min":0.439,"15min":0.36499999999999999},"max":{"1min":25.062999999999999,"5min":74.870999999999995,"15min":74.870999999999995},"last":1.7050000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:15:12 2024","interfaces":[{"interface":"back","average":{"1min":7.335,"5min":6.2000000000000002,"15min":3.0510000000000002},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":40.064999999999998,"5min":85.710999999999999,"15min":85.710999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":7.4740000000000002,"5min":8.1600000000000001,"15min":3.9399999999999999},"min":{"1min":0.68000000000000005,"5min":0.443,"15min":0.377},"max":{"1min":39.972000000000001,"5min":105.875,"15min":105.875},"last":1.601}]},{"osd":5,"last update":"Fri Sep 13 15:15:12 2024","interfaces":[{"interface":"back","average":{"1min":7.5570000000000004,"5min":6.4960000000000004,"15min":3.3500000000000001},"min":{"1min":0.66300000000000003,"5min":0.46700000000000003,"15min":0.40400000000000003},"max":{"1min":39.557000000000002,"5min":95.748999999999995,"15min":95.748999999999995},"last":1.6419999999999999},{"interface":"front","average":{"1min":4.1479999999999997,"5min":8.6259999999999994,"15min":4.3239999999999998},"min":{"1min":0.51900000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":36.648000000000003,"5min":100.325,"15min":100.325},"last":0.35599999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:15:12 2024","interfaces":[{"interface":"back","average":{"1min":3.7109999999999999,"5min":5.2140000000000004,"15min":2.742},"min":{"1min":0.59299999999999997,"5min":0.432,"15min":0.432},"max":{"1min":36.561999999999998,"5min":85.492999999999995,"15min":85.492999999999995},"last":0.433},{"interface":"front","average":{"1min":3.77,"5min":6.4459999999999997,"15min":3.2200000000000002},"min":{"1min":0.626,"5min":0.54300000000000004,"15min":0.501},"max":{"1min":36.604999999999997,"5min":100.376,"15min":100.376},"last":0.54100000000000004}]},{"osd":7,"last update":"Fri Sep 13 15:15:13 2024","interfaces":[{"interface":"back","average":{"1min":6.2169999999999996,"5min":6.0270000000000001,"15min":3.0830000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":43.624000000000002,"5min":97.268000000000001,"15min":97.268000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":4.7009999999999996,"5min":6.4909999999999997,"15min":3.5579999999999998},"min":{"1min":0.66200000000000003,"5min":0.50800000000000001,"15min":0.48599999999999999},"max":{"1min":36.68,"5min":100.583,"15min":100.583},"last":0.51000000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542320,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2064900,"kb_used_data":1260668,"kb_used_omap":1,"kb_used_meta":804222,"kb_avail":92306940,"statfs":{"total":96636764160,"available":94522306560,"internally_reserved":0,"allocated":1290924032,"data_stored":1290689713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":823523782},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:15:09 2024","interfaces":[{"interface":"back","average":{"1min":8.2430000000000003,"5min":7.5419999999999998,"15min":3.7440000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.249},"max":{"1min":108.04600000000001,"5min":170.77199999999999,"15min":170.77199999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":8.8529999999999998,"5min":12.016,"15min":5.383},"min":{"1min":0.47499999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":108.004,"5min":237.53800000000001,"15min":237.53800000000001},"last":0.316}]},{"osd":1,"last update":"Fri Sep 13 15:15:09 2024","interfaces":[{"interface":"back","average":{"1min":8.1140000000000008,"5min":6.6299999999999999,"15min":3.798},"min":{"1min":0.312,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":109.104,"5min":109.104,"15min":109.104},"last":0.39600000000000002},{"interface":"front","average":{"1min":10.433999999999999,"5min":12.935,"15min":5.8600000000000003},"min":{"1min":0.45800000000000002,"5min":0.36199999999999999,"15min":0.30499999999999999},"max":{"1min":108.095,"5min":295.73500000000001,"15min":295.73500000000001},"last":0.37}]},{"osd":3,"last update":"Fri Sep 13 15:15:09 2024","interfaces":[{"interface":"back","average":{"1min":9.2859999999999996,"5min":5.9820000000000002,"15min":3.7090000000000001},"min":{"1min":0.49099999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":109.152,"5min":109.152,"15min":109.152},"last":0.45100000000000001},{"interface":"front","average":{"1min":11.000999999999999,"5min":9.1010000000000009,"15min":4.8369999999999997},"min":{"1min":0.497,"5min":0.371,"15min":0.371},"max":{"1min":110.03700000000001,"5min":264.87599999999998,"15min":264.87599999999998},"last":0.42299999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:15:09 2024","interfaces":[{"interface":"back","average":{"1min":5.5919999999999996,"5min":7.5590000000000002,"15min":3.9009999999999998},"min":{"1min":0.54000000000000004,"5min":0.41599999999999998,"15min":0.38100000000000001},"max":{"1min":28.959,"5min":251.97300000000001,"15min":251.97300000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":3.6030000000000002,"5min":4.7190000000000003,"15min":2.5739999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.34899999999999998},"max":{"1min":19.145,"5min":42.012,"15min":42.012},"last":0.80100000000000005}]},{"osd":5,"last update":"Fri Sep 13 15:15:09 2024","interfaces":[{"interface":"back","average":{"1min":2.5760000000000001,"5min":3.9489999999999998,"15min":2.512},"min":{"1min":0.54100000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":11.787000000000001,"5min":41.942999999999998,"15min":41.942999999999998},"last":0.84599999999999997},{"interface":"front","average":{"1min":2.637,"5min":7.0819999999999999,"15min":3.5},"min":{"1min":0.57499999999999996,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":11.807,"5min":237.58799999999999,"15min":237.58799999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Fri Sep 13 15:15:09 2024","interfaces":[{"interface":"back","average":{"1min":2.8690000000000002,"5min":3.8460000000000001,"15min":2.4510000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":11.686999999999999,"5min":41.981999999999999,"15min":41.981999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":2.9470000000000001,"5min":4.0830000000000002,"15min":2.5619999999999998},"min":{"1min":0.502,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":11.721,"5min":41.890999999999998,"15min":41.890999999999998},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Sep 13 15:15:09 2024","interfaces":[{"interface":"back","average":{"1min":3.5960000000000001,"5min":6.306,"15min":3.4180000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":16.239000000000001,"5min":237.626,"15min":237.626},"last":0.751},{"interface":"front","average":{"1min":3.5289999999999999,"5min":6.7649999999999997,"15min":3.2719999999999998},"min":{"1min":0.499,"5min":0.432,"15min":0.39200000000000002},"max":{"1min":12.775,"5min":252.005,"15min":252.005},"last":0.627}]}]},{"osd":1,"up_from":14,"seq":60129542315,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3279756,"kb_used_data":1869188,"kb_used_omap":1,"kb_used_meta":1406462,"kb_avail":91092084,"statfs":{"total":96636764160,"available":93278294016,"internally_reserved":0,"allocated":1914048512,"data_stored":1913821952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1440217542},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,2,3,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":3.512,"5min":6.5830000000000002,"15min":4.0949999999999998},"min":{"1min":0.26400000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":17.056000000000001,"5min":104.246,"15min":104.246},"last":4.843},{"interface":"front","average":{"1min":2.6389999999999998,"5min":8.3230000000000004,"15min":4.0309999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28599999999999998},"max":{"1min":10.380000000000001,"5min":103.157,"15min":103.157},"last":1.651}]},{"osd":2,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":5.3090000000000002,"5min":8.0289999999999999,"15min":5.0979999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.32200000000000001},"max":{"1min":25.789000000000001,"5min":113.79600000000001,"15min":191.00899999999999},"last":1.385},{"interface":"front","average":{"1min":2.23,"5min":6.1150000000000002,"15min":3.3319999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.318},"max":{"1min":10.678000000000001,"5min":47.537999999999997,"15min":47.537999999999997},"last":1.6930000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":5.2389999999999999,"5min":8.3290000000000006,"15min":3.9630000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.377},"max":{"1min":18.701000000000001,"5min":52.975000000000001,"15min":52.975000000000001},"last":3.1480000000000001},{"interface":"front","average":{"1min":3.3359999999999999,"5min":7.806,"15min":3.9159999999999999},"min":{"1min":0.50800000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":11.565,"5min":104.319,"15min":104.319},"last":3.831}]},{"osd":4,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":4.5019999999999998,"5min":7.1369999999999996,"15min":3.9420000000000002},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.38700000000000001},"max":{"1min":18.713000000000001,"5min":125.44799999999999,"15min":125.44799999999999},"last":1.738},{"interface":"front","average":{"1min":4.4630000000000001,"5min":9.0830000000000002,"15min":4.1500000000000004},"min":{"1min":0.53800000000000003,"5min":0.47399999999999998,"15min":0.38800000000000001},"max":{"1min":17.100000000000001,"5min":117.842,"15min":117.842},"last":1.7829999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":2.0870000000000002,"5min":7.9459999999999997,"15min":3.9449999999999998},"min":{"1min":0.53100000000000003,"5min":0.436,"15min":0.40000000000000002},"max":{"1min":10.519,"5min":154.875,"15min":154.875},"last":1.8029999999999999},{"interface":"front","average":{"1min":4.6150000000000002,"5min":7.3570000000000002,"15min":4.0620000000000003},"min":{"1min":0.65000000000000002,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":25.745000000000001,"5min":126.485,"15min":126.485},"last":1.3480000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":1.978,"5min":6.5679999999999996,"15min":3.6200000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":7.476,"5min":103.191,"15min":103.191},"last":1.825},{"interface":"front","average":{"1min":2.133,"5min":5.7320000000000002,"15min":3.1829999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.42399999999999999},"max":{"1min":10.598000000000001,"5min":104.28400000000001,"15min":104.28400000000001},"last":1.774}]},{"osd":7,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":4.7050000000000001,"5min":6.9290000000000003,"15min":3.5339999999999998},"min":{"1min":0.81599999999999995,"5min":0.53700000000000003,"15min":0.438},"max":{"1min":25.879000000000001,"5min":77.366,"15min":77.366},"last":1.419},{"interface":"front","average":{"1min":2.1589999999999998,"5min":7.8719999999999999,"15min":3.855},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":7.5119999999999996,"5min":112.69499999999999,"15min":112.69499999999999},"last":1.857}]}]},{"osd":0,"up_from":14,"seq":60129542319,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2352308,"kb_used_data":1425388,"kb_used_omap":1,"kb_used_meta":922814,"kb_avail":92019532,"statfs":{"total":96636764160,"available":94228000768,"internally_reserved":0,"allocated":1459597312,"data_stored":1459366050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":944961990},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:15:07 2024","interfaces":[{"interface":"back","average":{"1min":2.7480000000000002,"5min":7.5750000000000002,"15min":4.3109999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.22900000000000001},"max":{"1min":13.257999999999999,"5min":279.90600000000001,"15min":279.90600000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":3.0649999999999999,"5min":8.4199999999999999,"15min":6.2359999999999998},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.28100000000000003},"max":{"1min":9.952,"5min":279.70299999999997,"15min":510.15699999999998},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:15:07 2024","interfaces":[{"interface":"back","average":{"1min":2.948,"5min":7.1040000000000001,"15min":3.3170000000000002},"min":{"1min":0.31,"5min":0.29699999999999999,"15min":0.26000000000000001},"max":{"1min":11.173999999999999,"5min":101.73399999999999,"15min":101.73399999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":3.2879999999999998,"5min":5.1360000000000001,"15min":2.738},"min":{"1min":0.39400000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":9.8900000000000006,"5min":35.527999999999999,"15min":35.527999999999999},"last":0.40999999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:15:07 2024","interfaces":[{"interface":"back","average":{"1min":4.6529999999999996,"5min":8.7230000000000008,"15min":4.6470000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.28699999999999998},"max":{"1min":12.111000000000001,"5min":101.76300000000001,"15min":101.76300000000001},"last":0.439},{"interface":"front","average":{"1min":4.4770000000000003,"5min":7.7690000000000001,"15min":4.3810000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38700000000000001},"max":{"1min":11.948,"5min":75.828000000000003,"15min":75.828000000000003},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Sep 13 15:15:13 2024","interfaces":[{"interface":"back","average":{"1min":6.1100000000000003,"5min":4.9359999999999999,"15min":2.722},"min":{"1min":0.58299999999999996,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":29.494,"5min":30.207999999999998,"15min":30.207999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":4.4210000000000003,"5min":4.1189999999999998,"15min":2.5249999999999999},"min":{"1min":0.66000000000000003,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":27.282,"5min":30.135000000000002,"15min":30.135000000000002},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:15:13 2024","interfaces":[{"interface":"back","average":{"1min":5.2359999999999998,"5min":5.569,"15min":2.8580000000000001},"min":{"1min":0.46899999999999997,"5min":0.377,"15min":0.377},"max":{"1min":47.112000000000002,"5min":101.702,"15min":101.702},"last":0.81200000000000006},{"interface":"front","average":{"1min":5.8280000000000003,"5min":3.8690000000000002,"15min":2.2930000000000001},"min":{"1min":0.56000000000000005,"5min":0.434,"15min":0.379},"max":{"1min":43.249000000000002,"5min":43.249000000000002,"15min":43.249000000000002},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:15:07 2024","interfaces":[{"interface":"back","average":{"1min":6.1420000000000003,"5min":4.7770000000000001,"15min":2.6469999999999998},"min":{"1min":0.628,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":45.140000000000001,"5min":45.140000000000001,"15min":45.140000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":5.6829999999999998,"5min":4.9000000000000004,"15min":2.7429999999999999},"min":{"1min":0.52500000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":44.737000000000002,"5min":44.737000000000002,"15min":44.737000000000002},"last":0.77800000000000002}]},{"osd":7,"last update":"Fri Sep 13 15:15:07 2024","interfaces":[{"interface":"back","average":{"1min":5.5529999999999999,"5min":5.8419999999999996,"15min":2.9950000000000001},"min":{"1min":0.49299999999999999,"5min":0.42999999999999999,"15min":0.42499999999999999},"max":{"1min":49.326000000000001,"5min":101.655,"15min":101.655},"last":0.64500000000000002},{"interface":"front","average":{"1min":5.6719999999999997,"5min":4.4320000000000004,"15min":2.6110000000000002},"min":{"1min":0.56000000000000005,"5min":0.51500000000000001,"15min":0.434},"max":{"1min":46.649000000000001,"5min":46.649000000000001,"15min":46.649000000000001},"last":0.79100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25194496,"data_stored":25166698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25194496,"data_stored":25167848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4300800,"data_stored":4266393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25038848,"data_stored":25008061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41967616,"data_stored":41944697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21020672,"data_stored":20976412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29155328,"data_stored":29132361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":46174208,"data_stored":46139771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1422962688,"data_stored":1422962688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1762664448,"data_stored":1762664448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1221251072,"data_stored":1221251072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1967931392,"data_stored":1967931392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1611513856,"data_stored":1611513856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1055879168,"data_stored":1055879168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1487400960,"data_stored":1487400960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1256882176,"data_stored":1256882176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:16:12.628 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T15:16:12.628 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:16:12.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.893+0000 7f5269a00640 1 Processor -- start 2024-09-13T15:16:12.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.893+0000 7f5269a00640 1 -- start start 2024-09-13T15:16:12.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.893+0000 7f5269a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f52640c3b30 0x7f52640c9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:12.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.893+0000 7f5269a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526406fec0 con 0x7f52641534b0 2024-09-13T15:16:12.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.893+0000 7f5269a00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526406a570 con 0x7f526406d800 2024-09-13T15:16:12.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.893+0000 7f5269a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526406ba90 con 0x7f52640c3b30 2024-09-13T15:16:12.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.893+0000 7f5262000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f52640c3b30 0x7f52640c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:12.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.893+0000 7f5262000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f52640c3b30 0x7f52640c9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45872/0 (socket says 172.21.15.7:45872) 2024-09-13T15:16:12.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.893+0000 7f5262000640 1 -- 172.21.15.7:0/3735914500 learned_addr learned my addr 172.21.15.7:0/3735914500 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:12.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.893+0000 7f5262000640 1 -- 172.21.15.7:0/3735914500 >> v1:172.21.15.77:6789/0 conn(0x7f526406d800 legacy=0x7f5264163a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:12.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.893+0000 7f5262000640 1 -- 172.21.15.7:0/3735914500 >> v1:172.21.15.7:6789/0 conn(0x7f52641534b0 legacy=0x7f526415cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:12.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.893+0000 7f5262000640 1 -- 172.21.15.7:0/3735914500 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5264153890 con 0x7f52640c3b30 2024-09-13T15:16:12.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.897+0000 7f5262000640 1 --2- 172.21.15.7:0/3735914500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52640c3b30 0x7f52640c9890 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5250009870 tx=0x7f525001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27900a142503b91 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:12.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.897+0000 7f5261600640 1 -- 172.21.15.7:0/3735914500 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52500ab670 con 0x7f52640c3b30 2024-09-13T15:16:12.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.897+0000 7f5261600640 1 -- 172.21.15.7:0/3735914500 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52500ab7d0 con 0x7f52640c3b30 2024-09-13T15:16:12.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.897+0000 7f5261600640 1 -- 172.21.15.7:0/3735914500 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52500abb60 con 0x7f52640c3b30 2024-09-13T15:16:12.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.897+0000 7f5269a00640 1 -- 172.21.15.7:0/3735914500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52640c3b30 msgr2=0x7f52640c9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:12.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.897+0000 7f5269a00640 1 --2- 172.21.15.7:0/3735914500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52640c3b30 0x7f52640c9890 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f5250009870 tx=0x7f525001c560 comp rx=0 tx=0).stop 2024-09-13T15:16:12.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.897+0000 7f5269a00640 1 -- 172.21.15.7:0/3735914500 shutdown_connections 2024-09-13T15:16:12.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.897+0000 7f5269a00640 1 --2- 172.21.15.7:0/3735914500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52640c3b30 0x7f52640c9890 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.897+0000 7f5269a00640 1 -- 172.21.15.7:0/3735914500 >> 172.21.15.7:0/3735914500 conn(0x7f5264071730 msgr2=0x7f5264071b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:12.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.897+0000 7f5269a00640 1 -- 172.21.15.7:0/3735914500 shutdown_connections 2024-09-13T15:16:12.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.897+0000 7f5269a00640 1 -- 172.21.15.7:0/3735914500 wait complete. 2024-09-13T15:16:12.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.897+0000 7f5269a00640 1 Processor -- start 2024-09-13T15:16:12.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.897+0000 7f5269a00640 1 -- start start 2024-09-13T15:16:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5269a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f526406d800 0x7f526414c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5269a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52640c3b30 0x7f52640c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5269a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52641534b0 0x7f526414d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5269a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52640c5aa0 con 0x7f52641534b0 2024-09-13T15:16:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5269a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52640c6b20 con 0x7f52640c3b30 2024-09-13T15:16:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5269a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5264152a10 con 0x7f526406d800 2024-09-13T15:16:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5263400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52641534b0 0x7f526414d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5263400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52641534b0 0x7f526414d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45884/0 (socket says 172.21.15.7:45884) 2024-09-13T15:16:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5263400640 1 -- 172.21.15.7:0/2049527937 learned_addr learned my addr 172.21.15.7:0/2049527937 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5262a00640 1 --2- 172.21.15.7:0/2049527937 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f526406d800 0x7f526414c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:12.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5262000640 1 --2- 172.21.15.7:0/2049527937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52640c3b30 0x7f52640c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:12.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5263400640 1 -- 172.21.15.7:0/2049527937 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f526406d800 msgr2=0x7f526414c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:12.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5263400640 1 --2- 172.21.15.7:0/2049527937 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f526406d800 0x7f526414c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5263400640 1 -- 172.21.15.7:0/2049527937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52640c3b30 msgr2=0x7f52640c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5263400640 1 --2- 172.21.15.7:0/2049527937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52640c3b30 0x7f52640c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5263400640 1 -- 172.21.15.7:0/2049527937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52500094d0 con 0x7f52641534b0 2024-09-13T15:16:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5263400640 1 --2- 172.21.15.7:0/2049527937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52641534b0 0x7f526414d610 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f525c00c760 tx=0x7f525c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f525aa00640 1 -- 172.21.15.7:0/2049527937 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c003b80 con 0x7f52641534b0 2024-09-13T15:16:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f525aa00640 1 -- 172.21.15.7:0/2049527937 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525c003ce0 con 0x7f52641534b0 2024-09-13T15:16:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f525aa00640 1 -- 172.21.15.7:0/2049527937 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c00aa30 con 0x7f52641534b0 2024-09-13T15:16:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5269a00640 1 -- 172.21.15.7:0/2049527937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5264152cb0 con 0x7f52641534b0 2024-09-13T15:16:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5269a00640 1 -- 172.21.15.7:0/2049527937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52640c44c0 con 0x7f52641534b0 2024-09-13T15:16:12.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.901+0000 7f5269a00640 1 -- 172.21.15.7:0/2049527937 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5264067650 con 0x7f52641534b0 2024-09-13T15:16:12.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.905+0000 7f525aa00640 1 -- 172.21.15.7:0/2049527937 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f525c00ab90 con 0x7f52641534b0 2024-09-13T15:16:12.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.905+0000 7f525aa00640 1 --2- 172.21.15.7:0/2049527937 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f52440666e0 0x7f5244068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:12.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.905+0000 7f525aa00640 1 -- 172.21.15.7:0/2049527937 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f525c0842a0 con 0x7f52641534b0 2024-09-13T15:16:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.905+0000 7f5262a00640 1 --2- 172.21.15.7:0/2049527937 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f52440666e0 0x7f5244068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:12.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.905+0000 7f5262a00640 1 --2- 172.21.15.7:0/2049527937 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f52440666e0 0x7f5244068ba0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5254007fd0 tx=0x7f5254009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:12.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:12.909+0000 7f525aa00640 1 -- 172.21.15.7:0/2049527937 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f525c051270 con 0x7f52641534b0 2024-09-13T15:16:13.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.073+0000 7f5269a00640 1 -- 172.21.15.7:0/2049527937 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f526415c6c0 con 0x7f52440666e0 2024-09-13T15:16:13.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.101+0000 7f525aa00640 1 -- 172.21.15.7:0/2049527937 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+370530 (secure 0 0 0) 0x7f52540014f0 con 0x7f52440666e0 2024-09-13T15:16:13.103 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:16:13.105 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T15:16:13.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.105+0000 7f5269a00640 1 -- 172.21.15.7:0/2049527937 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f52440666e0 msgr2=0x7f5244068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:13.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.105+0000 7f5269a00640 1 --2- 172.21.15.7:0/2049527937 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f52440666e0 0x7f5244068ba0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5254007fd0 tx=0x7f5254009040 comp rx=0 tx=0).stop 2024-09-13T15:16:13.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.105+0000 7f5269a00640 1 -- 172.21.15.7:0/2049527937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52641534b0 msgr2=0x7f526414d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:13.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.105+0000 7f5269a00640 1 --2- 172.21.15.7:0/2049527937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52641534b0 0x7f526414d610 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f525c00c760 tx=0x7f525c00cc20 comp rx=0 tx=0).stop 2024-09-13T15:16:13.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.105+0000 7f5269a00640 1 -- 172.21.15.7:0/2049527937 shutdown_connections 2024-09-13T15:16:13.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.105+0000 7f5269a00640 1 --2- 172.21.15.7:0/2049527937 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f52440666e0 0x7f5244068ba0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:13.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.105+0000 7f5269a00640 1 --2- 172.21.15.7:0/2049527937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f52641534b0 0x7f526414d610 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:13.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.105+0000 7f5269a00640 1 --2- 172.21.15.7:0/2049527937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52640c3b30 0x7f52640c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:13.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.105+0000 7f5269a00640 1 --2- 172.21.15.7:0/2049527937 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f526406d800 0x7f526414c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:13.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.105+0000 7f5269a00640 1 -- 172.21.15.7:0/2049527937 >> 172.21.15.7:0/2049527937 conn(0x7f5264071730 msgr2=0x7f52640c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:13.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.105+0000 7f5269a00640 1 -- 172.21.15.7:0/2049527937 shutdown_connections 2024-09-13T15:16:13.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.105+0000 7f5269a00640 1 -- 172.21.15.7:0/2049527937 wait complete. 2024-09-13T15:16:13.351 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":463,"stamp":"2024-09-13T15:16:12.949045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6017477186,"num_objects":1729,"num_object_clones":0,"num_object_copies":6646,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1729,"num_whiteouts":0,"num_read":617,"num_read_kb":111053,"num_write":2172947,"num_write_kb":31188652,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":74,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151355,"ondisk_log_size":151355,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":20290160,"kb_used_data":11753776,"kb_used_omap":12,"kb_used_meta":8519923,"kb_avail":734684560,"statfs":{"total":773094113280,"available":752316989440,"internally_reserved":0,"allocated":12035866624,"data_stored":12034016001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":8724401720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,3,2,4,3,5,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":74,"apply_latency_ms":74,"commit_latency_ns":74000000,"apply_latency_ns":74000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2021651957,"num_objects":-482,"num_object_clones":0,"num_object_copies":-1928,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-482,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":495,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004867"},"pg_stats":[{"pgid":"2.1f","version":"31'35","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:32.892911+0000","last_change":"2024-09-13T15:01:44.418856+0000","last_active":"2024-09-13T15:15:32.892911+0000","last_peered":"2024-09-13T15:15:32.892911+0000","last_clean":"2024-09-13T15:15:32.892911+0000","last_became_active":"2024-09-13T15:01:44.418641+0000","last_became_peered":"2024-09-13T15:01:44.418641+0000","last_unstale":"2024-09-13T15:15:32.892911+0000","last_undegraded":"2024-09-13T15:15:32.892911+0000","last_fullsized":"2024-09-13T15:15:32.892911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:42:40.178824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":25,"num_read_kb":4120,"num_write":35,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.390297+0000","last_change":"2024-09-13T15:01:44.809371+0000","last_active":"2024-09-13T15:15:28.390297+0000","last_peered":"2024-09-13T15:15:28.390297+0000","last_clean":"2024-09-13T15:15:28.390297+0000","last_became_active":"2024-09-13T15:01:44.809091+0000","last_became_peered":"2024-09-13T15:01:44.809091+0000","last_unstale":"2024-09-13T15:15:28.390297+0000","last_undegraded":"2024-09-13T15:15:28.390297+0000","last_fullsized":"2024-09-13T15:15:28.390297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:22.412025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'4441","reported_seq":4466,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:09.585365+0000","last_change":"2024-09-13T15:01:48.910757+0000","last_active":"2024-09-13T15:16:09.585365+0000","last_peered":"2024-09-13T15:16:09.585365+0000","last_clean":"2024-09-13T15:16:09.585365+0000","last_became_active":"2024-09-13T15:01:48.910262+0000","last_became_peered":"2024-09-13T15:01:48.910262+0000","last_unstale":"2024-09-13T15:16:09.585365+0000","last_undegraded":"2024-09-13T15:16:09.585365+0000","last_fullsized":"2024-09-13T15:16:09.585365+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4441,"log_dups_size":0,"ondisk_log_size":4441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:39.290557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159414246,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65333,"num_write_kb":904330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'21","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:32.891601+0000","last_change":"2024-09-13T15:01:44.404818+0000","last_active":"2024-09-13T15:15:32.891601+0000","last_peered":"2024-09-13T15:15:32.891601+0000","last_clean":"2024-09-13T15:15:32.891601+0000","last_became_active":"2024-09-13T15:01:44.401666+0000","last_became_peered":"2024-09-13T15:01:44.401666+0000","last_unstale":"2024-09-13T15:15:32.891601+0000","last_undegraded":"2024-09-13T15:15:32.891601+0000","last_fullsized":"2024-09-13T15:15:32.891601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:31.818163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":18,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:12.529773+0000","last_change":"2024-09-13T15:01:44.850292+0000","last_active":"2024-09-13T15:14:12.529773+0000","last_peered":"2024-09-13T15:14:12.529773+0000","last_clean":"2024-09-13T15:14:12.529773+0000","last_became_active":"2024-09-13T15:01:44.849825+0000","last_became_peered":"2024-09-13T15:01:44.849825+0000","last_unstale":"2024-09-13T15:14:12.529773+0000","last_undegraded":"2024-09-13T15:14:12.529773+0000","last_fullsized":"2024-09-13T15:14:12.529773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:22.582742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"33'4893","reported_seq":4918,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.587471+0000","last_change":"2024-09-13T15:01:48.850426+0000","last_active":"2024-09-13T15:16:08.587471+0000","last_peered":"2024-09-13T15:16:08.587471+0000","last_clean":"2024-09-13T15:16:08.587471+0000","last_became_active":"2024-09-13T15:01:48.848750+0000","last_became_peered":"2024-09-13T15:01:48.848750+0000","last_unstale":"2024-09-13T15:16:08.587471+0000","last_undegraded":"2024-09-13T15:16:08.587471+0000","last_fullsized":"2024-09-13T15:16:08.587471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4893,"log_dups_size":0,"ondisk_log_size":4893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:55.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188835155,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71627,"num_write_kb":1026932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"33'61","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.125487+0000","last_change":"2024-09-13T15:01:44.437850+0000","last_active":"2024-09-13T15:15:57.125487+0000","last_peered":"2024-09-13T15:15:57.125487+0000","last_clean":"2024-09-13T15:15:57.125487+0000","last_became_active":"2024-09-13T15:01:44.437168+0000","last_became_peered":"2024-09-13T15:01:44.437168+0000","last_unstale":"2024-09-13T15:15:57.125487+0000","last_undegraded":"2024-09-13T15:15:57.125487+0000","last_fullsized":"2024-09-13T15:15:57.125487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:23.540408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":50,"num_read_kb":12337,"num_write":58,"num_write_kb":12312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.869728+0000","last_change":"2024-09-13T15:01:44.845989+0000","last_active":"2024-09-13T15:15:27.869728+0000","last_peered":"2024-09-13T15:15:27.869728+0000","last_clean":"2024-09-13T15:15:27.869728+0000","last_became_active":"2024-09-13T15:01:44.845395+0000","last_became_peered":"2024-09-13T15:01:44.845395+0000","last_unstale":"2024-09-13T15:15:27.869728+0000","last_undegraded":"2024-09-13T15:15:27.869728+0000","last_fullsized":"2024-09-13T15:15:27.869728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:52.267507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4398","reported_seq":4423,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.284312+0000","last_change":"2024-09-13T15:01:48.865388+0000","last_active":"2024-09-13T15:16:07.284312+0000","last_peered":"2024-09-13T15:16:07.284312+0000","last_clean":"2024-09-13T15:16:07.284312+0000","last_became_active":"2024-09-13T15:01:48.864314+0000","last_became_peered":"2024-09-13T15:01:48.864314+0000","last_unstale":"2024-09-13T15:16:07.284312+0000","last_undegraded":"2024-09-13T15:16:07.284312+0000","last_fullsized":"2024-09-13T15:16:07.284312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4398,"log_dups_size":0,"ondisk_log_size":4398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:18.637430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184554492,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64505,"num_write_kb":920306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"30'15","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.086111+0000","last_change":"2024-09-13T15:01:44.424080+0000","last_active":"2024-09-13T15:15:57.086111+0000","last_peered":"2024-09-13T15:15:57.086111+0000","last_clean":"2024-09-13T15:15:57.086111+0000","last_became_active":"2024-09-13T15:01:44.423381+0000","last_became_peered":"2024-09-13T15:01:44.423381+0000","last_unstale":"2024-09-13T15:15:57.086111+0000","last_undegraded":"2024-09-13T15:15:57.086111+0000","last_fullsized":"2024-09-13T15:15:57.086111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:38:20.455380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":4116,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"33'15","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:03.389792+0000","last_change":"2024-09-13T15:01:44.849670+0000","last_active":"2024-09-13T15:16:03.389792+0000","last_peered":"2024-09-13T15:16:03.389792+0000","last_clean":"2024-09-13T15:16:03.389792+0000","last_became_active":"2024-09-13T15:01:44.849038+0000","last_became_peered":"2024-09-13T15:01:44.849038+0000","last_unstale":"2024-09-13T15:16:03.389792+0000","last_undegraded":"2024-09-13T15:16:03.389792+0000","last_fullsized":"2024-09-13T15:16:03.389792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:15:45.570774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4137","reported_seq":4162,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.438214+0000","last_change":"2024-09-13T15:01:48.854953+0000","last_active":"2024-09-13T15:16:07.438214+0000","last_peered":"2024-09-13T15:16:07.438214+0000","last_clean":"2024-09-13T15:16:07.438214+0000","last_became_active":"2024-09-13T15:01:48.853858+0000","last_became_peered":"2024-09-13T15:01:48.853858+0000","last_unstale":"2024-09-13T15:16:07.438214+0000","last_undegraded":"2024-09-13T15:16:07.438214+0000","last_fullsized":"2024-09-13T15:16:07.438214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4137,"log_dups_size":0,"ondisk_log_size":4137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:07.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239130476,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61252,"num_write_kb":864366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.599588+0000","last_change":"2024-09-13T15:01:44.824391+0000","last_active":"2024-09-13T15:15:28.599588+0000","last_peered":"2024-09-13T15:15:28.599588+0000","last_clean":"2024-09-13T15:15:28.599588+0000","last_became_active":"2024-09-13T15:01:44.823690+0000","last_became_peered":"2024-09-13T15:01:44.823690+0000","last_unstale":"2024-09-13T15:15:28.599588+0000","last_undegraded":"2024-09-13T15:15:28.599588+0000","last_fullsized":"2024-09-13T15:15:28.599588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'133","reported_seq":166,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:34.462327+0000","last_change":"2024-09-13T15:01:44.421523+0000","last_active":"2024-09-13T15:15:34.462327+0000","last_peered":"2024-09-13T15:15:34.462327+0000","last_clean":"2024-09-13T15:15:34.462327+0000","last_became_active":"2024-09-13T15:01:44.419965+0000","last_became_peered":"2024-09-13T15:01:44.419965+0000","last_unstale":"2024-09-13T15:15:34.462327+0000","last_undegraded":"2024-09-13T15:15:34.462327+0000","last_fullsized":"2024-09-13T15:15:34.462327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:34.918774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":8200,"num_write":130,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"33'4455","reported_seq":4481,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.390886+0000","last_change":"2024-09-13T15:01:48.850895+0000","last_active":"2024-09-13T15:16:08.390886+0000","last_peered":"2024-09-13T15:16:08.390886+0000","last_clean":"2024-09-13T15:16:08.390886+0000","last_became_active":"2024-09-13T15:01:48.849856+0000","last_became_peered":"2024-09-13T15:01:48.849856+0000","last_unstale":"2024-09-13T15:16:08.390886+0000","last_undegraded":"2024-09-13T15:16:08.390886+0000","last_fullsized":"2024-09-13T15:16:08.390886+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4455,"log_dups_size":0,"ondisk_log_size":4455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:59.616442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188825920,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65529,"num_write_kb":929153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389629+0000","last_change":"2024-09-13T15:01:44.806026+0000","last_active":"2024-09-13T15:15:28.389629+0000","last_peered":"2024-09-13T15:15:28.389629+0000","last_clean":"2024-09-13T15:15:28.389629+0000","last_became_active":"2024-09-13T15:01:44.805767+0000","last_became_peered":"2024-09-13T15:01:44.805767+0000","last_unstale":"2024-09-13T15:15:28.389629+0000","last_undegraded":"2024-09-13T15:15:28.389629+0000","last_fullsized":"2024-09-13T15:15:28.389629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:44:50.696113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'19","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.712356+0000","last_change":"2024-09-13T15:01:44.401897+0000","last_active":"2024-09-13T15:15:28.712356+0000","last_peered":"2024-09-13T15:15:28.712356+0000","last_clean":"2024-09-13T15:15:28.712356+0000","last_became_active":"2024-09-13T15:01:44.401559+0000","last_became_peered":"2024-09-13T15:01:44.401559+0000","last_unstale":"2024-09-13T15:15:28.712356+0000","last_undegraded":"2024-09-13T15:15:28.712356+0000","last_fullsized":"2024-09-13T15:15:28.712356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:58.535567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"33'4692","reported_seq":4718,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.456314+0000","last_change":"2024-09-13T15:01:48.858808+0000","last_active":"2024-09-13T15:16:08.456314+0000","last_peered":"2024-09-13T15:16:08.456314+0000","last_clean":"2024-09-13T15:16:08.456314+0000","last_became_active":"2024-09-13T15:01:48.857802+0000","last_became_peered":"2024-09-13T15:01:48.857802+0000","last_unstale":"2024-09-13T15:16:08.456314+0000","last_undegraded":"2024-09-13T15:16:08.456314+0000","last_fullsized":"2024-09-13T15:16:08.456314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4692,"log_dups_size":0,"ondisk_log_size":4692,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:41.628058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209721158,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68966,"num_write_kb":974815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.390542+0000","last_change":"2024-09-13T15:01:44.808674+0000","last_active":"2024-09-13T15:15:28.390542+0000","last_peered":"2024-09-13T15:15:28.390542+0000","last_clean":"2024-09-13T15:15:28.390542+0000","last_became_active":"2024-09-13T15:01:44.808420+0000","last_became_peered":"2024-09-13T15:01:44.808420+0000","last_unstale":"2024-09-13T15:15:28.390542+0000","last_undegraded":"2024-09-13T15:15:28.390542+0000","last_fullsized":"2024-09-13T15:15:28.390542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:33.447973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:15:01.212922+0000","last_change":"2024-09-13T15:01:44.406717+0000","last_active":"2024-09-13T15:15:01.212922+0000","last_peered":"2024-09-13T15:15:01.212922+0000","last_clean":"2024-09-13T15:15:01.212922+0000","last_became_active":"2024-09-13T15:01:44.406354+0000","last_became_peered":"2024-09-13T15:01:44.406354+0000","last_unstale":"2024-09-13T15:15:01.212922+0000","last_undegraded":"2024-09-13T15:15:01.212922+0000","last_fullsized":"2024-09-13T15:15:01.212922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:49.413632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"33'4743","reported_seq":4769,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.845662+0000","last_change":"2024-09-13T15:01:48.909879+0000","last_active":"2024-09-13T15:16:10.845662+0000","last_peered":"2024-09-13T15:16:10.845662+0000","last_clean":"2024-09-13T15:16:10.845662+0000","last_became_active":"2024-09-13T15:01:48.909494+0000","last_became_peered":"2024-09-13T15:01:48.909494+0000","last_unstale":"2024-09-13T15:16:10.845662+0000","last_undegraded":"2024-09-13T15:16:10.845662+0000","last_fullsized":"2024-09-13T15:16:10.845662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4743,"log_dups_size":0,"ondisk_log_size":4743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:54.415920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184554680,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69911,"num_write_kb":1001010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:53.670234+0000","last_change":"2024-09-13T15:01:44.825065+0000","last_active":"2024-09-13T15:14:53.670234+0000","last_peered":"2024-09-13T15:14:53.670234+0000","last_clean":"2024-09-13T15:14:53.670234+0000","last_became_active":"2024-09-13T15:01:44.824392+0000","last_became_peered":"2024-09-13T15:01:44.824392+0000","last_unstale":"2024-09-13T15:14:53.670234+0000","last_undegraded":"2024-09-13T15:14:53.670234+0000","last_fullsized":"2024-09-13T15:14:53.670234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:49.717211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"30'15","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.866614+0000","last_change":"2024-09-13T15:01:44.421119+0000","last_active":"2024-09-13T15:15:27.866614+0000","last_peered":"2024-09-13T15:15:27.866614+0000","last_clean":"2024-09-13T15:15:27.866614+0000","last_became_active":"2024-09-13T15:01:44.419082+0000","last_became_peered":"2024-09-13T15:01:44.419082+0000","last_unstale":"2024-09-13T15:15:27.866614+0000","last_undegraded":"2024-09-13T15:15:27.866614+0000","last_fullsized":"2024-09-13T15:15:27.866614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.011350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"33'4646","reported_seq":4672,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.104593+0000","last_change":"2024-09-13T15:01:48.856387+0000","last_active":"2024-09-13T15:16:08.104593+0000","last_peered":"2024-09-13T15:16:08.104593+0000","last_clean":"2024-09-13T15:16:08.104593+0000","last_became_active":"2024-09-13T15:01:48.855433+0000","last_became_peered":"2024-09-13T15:01:48.855433+0000","last_unstale":"2024-09-13T15:16:08.104593+0000","last_undegraded":"2024-09-13T15:16:08.104593+0000","last_fullsized":"2024-09-13T15:16:08.104593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4646,"log_dups_size":0,"ondisk_log_size":4646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:58.309929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201344225,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68020,"num_write_kb":991498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:38.017666+0000","last_change":"2024-09-13T15:01:44.807909+0000","last_active":"2024-09-13T15:14:38.017666+0000","last_peered":"2024-09-13T15:14:38.017666+0000","last_clean":"2024-09-13T15:14:38.017666+0000","last_became_active":"2024-09-13T15:01:44.807643+0000","last_became_peered":"2024-09-13T15:01:44.807643+0000","last_unstale":"2024-09-13T15:14:38.017666+0000","last_undegraded":"2024-09-13T15:14:38.017666+0000","last_fullsized":"2024-09-13T15:14:38.017666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:30.436685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"30'9","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.087518+0000","last_change":"2024-09-13T15:01:44.430200+0000","last_active":"2024-09-13T15:15:57.087518+0000","last_peered":"2024-09-13T15:15:57.087518+0000","last_clean":"2024-09-13T15:15:57.087518+0000","last_became_active":"2024-09-13T15:01:44.429510+0000","last_became_peered":"2024-09-13T15:01:44.429510+0000","last_unstale":"2024-09-13T15:15:57.087518+0000","last_undegraded":"2024-09-13T15:15:57.087518+0000","last_fullsized":"2024-09-13T15:15:57.087518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:52.921485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":13,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'4785","reported_seq":4811,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.305666+0000","last_change":"2024-09-13T15:01:48.912116+0000","last_active":"2024-09-13T15:16:08.305666+0000","last_peered":"2024-09-13T15:16:08.305666+0000","last_clean":"2024-09-13T15:16:08.305666+0000","last_became_active":"2024-09-13T15:01:48.911578+0000","last_became_peered":"2024-09-13T15:01:48.911578+0000","last_unstale":"2024-09-13T15:16:08.305666+0000","last_undegraded":"2024-09-13T15:16:08.305666+0000","last_fullsized":"2024-09-13T15:16:08.305666+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4785,"log_dups_size":0,"ondisk_log_size":4785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:50.826715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":234905672,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70443,"num_write_kb":1030585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:00.228712+0000","last_change":"2024-09-13T15:01:44.838344+0000","last_active":"2024-09-13T15:16:00.228712+0000","last_peered":"2024-09-13T15:16:00.228712+0000","last_clean":"2024-09-13T15:16:00.228712+0000","last_became_active":"2024-09-13T15:01:44.838128+0000","last_became_peered":"2024-09-13T15:01:44.838128+0000","last_unstale":"2024-09-13T15:16:00.228712+0000","last_undegraded":"2024-09-13T15:16:00.228712+0000","last_fullsized":"2024-09-13T15:16:00.228712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:09:50.373976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'114","reported_seq":150,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.935801+0000","last_change":"2024-09-13T15:01:44.430749+0000","last_active":"2024-09-13T15:15:57.935801+0000","last_peered":"2024-09-13T15:15:57.935801+0000","last_clean":"2024-09-13T15:15:57.935801+0000","last_became_active":"2024-09-13T15:01:44.430548+0000","last_became_peered":"2024-09-13T15:01:44.430548+0000","last_unstale":"2024-09-13T15:15:57.935801+0000","last_undegraded":"2024-09-13T15:15:57.935801+0000","last_fullsized":"2024-09-13T15:15:57.935801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:30.312447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":249,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"33'4798","reported_seq":4825,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:09.661955+0000","last_change":"2024-09-13T15:01:48.911224+0000","last_active":"2024-09-13T15:16:09.661955+0000","last_peered":"2024-09-13T15:16:09.661955+0000","last_clean":"2024-09-13T15:16:09.661955+0000","last_became_active":"2024-09-13T15:01:48.910150+0000","last_became_peered":"2024-09-13T15:01:48.910150+0000","last_unstale":"2024-09-13T15:16:09.661955+0000","last_undegraded":"2024-09-13T15:16:09.661955+0000","last_fullsized":"2024-09-13T15:16:09.661955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4798,"log_dups_size":0,"ondisk_log_size":4798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:41.244267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180447030,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70396,"num_write_kb":999196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"33'9","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.712426+0000","last_change":"2024-09-13T15:01:44.812200+0000","last_active":"2024-09-13T15:15:28.712426+0000","last_peered":"2024-09-13T15:15:28.712426+0000","last_clean":"2024-09-13T15:15:28.712426+0000","last_became_active":"2024-09-13T15:01:44.811915+0000","last_became_peered":"2024-09-13T15:01:44.811915+0000","last_unstale":"2024-09-13T15:15:28.712426+0000","last_undegraded":"2024-09-13T15:15:28.712426+0000","last_fullsized":"2024-09-13T15:15:28.712426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:07.944520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'7","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.870726+0000","last_change":"2024-09-13T15:01:44.423119+0000","last_active":"2024-09-13T15:15:27.870726+0000","last_peered":"2024-09-13T15:15:27.870726+0000","last_clean":"2024-09-13T15:15:27.870726+0000","last_became_active":"2024-09-13T15:01:44.422297+0000","last_became_peered":"2024-09-13T15:01:44.422297+0000","last_unstale":"2024-09-13T15:15:27.870726+0000","last_undegraded":"2024-09-13T15:15:27.870726+0000","last_fullsized":"2024-09-13T15:15:27.870726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:09.798196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"33'4744","reported_seq":4770,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.093176+0000","last_change":"2024-09-13T15:01:48.908569+0000","last_active":"2024-09-13T15:16:08.093176+0000","last_peered":"2024-09-13T15:16:08.093176+0000","last_clean":"2024-09-13T15:16:08.093176+0000","last_became_active":"2024-09-13T15:01:48.908118+0000","last_became_peered":"2024-09-13T15:01:48.908118+0000","last_unstale":"2024-09-13T15:16:08.093176+0000","last_undegraded":"2024-09-13T15:16:08.093176+0000","last_fullsized":"2024-09-13T15:16:08.093176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4744,"log_dups_size":0,"ondisk_log_size":4744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:06.459855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205574157,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69506,"num_write_kb":1001647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:20.816504+0000","last_change":"2024-09-13T15:01:44.850837+0000","last_active":"2024-09-13T15:14:20.816504+0000","last_peered":"2024-09-13T15:14:20.816504+0000","last_clean":"2024-09-13T15:14:20.816504+0000","last_became_active":"2024-09-13T15:01:44.850263+0000","last_became_peered":"2024-09-13T15:01:44.850263+0000","last_unstale":"2024-09-13T15:14:20.816504+0000","last_undegraded":"2024-09-13T15:14:20.816504+0000","last_fullsized":"2024-09-13T15:14:20.816504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:47:16.956369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"30'3","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:18.534907+0000","last_change":"2024-09-13T15:01:44.399163+0000","last_active":"2024-09-13T15:14:18.534907+0000","last_peered":"2024-09-13T15:14:18.534907+0000","last_clean":"2024-09-13T15:14:18.534907+0000","last_became_active":"2024-09-13T15:01:44.398881+0000","last_became_peered":"2024-09-13T15:01:44.398881+0000","last_unstale":"2024-09-13T15:14:18.534907+0000","last_undegraded":"2024-09-13T15:14:18.534907+0000","last_fullsized":"2024-09-13T15:14:18.534907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:49.622676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4013","reported_seq":4039,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.188512+0000","last_change":"2024-09-13T15:01:48.852798+0000","last_active":"2024-09-13T15:16:10.188512+0000","last_peered":"2024-09-13T15:16:10.188512+0000","last_clean":"2024-09-13T15:16:10.188512+0000","last_became_active":"2024-09-13T15:01:48.851948+0000","last_became_peered":"2024-09-13T15:01:48.851948+0000","last_unstale":"2024-09-13T15:16:10.188512+0000","last_undegraded":"2024-09-13T15:16:10.188512+0000","last_fullsized":"2024-09-13T15:16:10.188512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4013,"log_dups_size":0,"ondisk_log_size":4013,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:20.061043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163694610,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58879,"num_write_kb":861513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"28'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:23.142917+0000","last_change":"2024-09-13T15:01:44.824074+0000","last_active":"2024-09-13T15:14:23.142917+0000","last_peered":"2024-09-13T15:14:23.142917+0000","last_clean":"2024-09-13T15:14:23.142917+0000","last_became_active":"2024-09-13T15:01:44.821475+0000","last_became_peered":"2024-09-13T15:01:44.821475+0000","last_unstale":"2024-09-13T15:14:23.142917+0000","last_undegraded":"2024-09-13T15:14:23.142917+0000","last_fullsized":"2024-09-13T15:14:23.142917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:21.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'34","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:32.918126+0000","last_change":"2024-09-13T15:01:44.433502+0000","last_active":"2024-09-13T15:15:32.918126+0000","last_peered":"2024-09-13T15:15:32.918126+0000","last_clean":"2024-09-13T15:15:32.918126+0000","last_became_active":"2024-09-13T15:01:44.432902+0000","last_became_peered":"2024-09-13T15:01:44.432902+0000","last_unstale":"2024-09-13T15:15:32.918126+0000","last_undegraded":"2024-09-13T15:15:32.918126+0000","last_fullsized":"2024-09-13T15:15:32.918126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:06:59.189559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389688,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":8206,"num_write":28,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"33'4494","reported_seq":4520,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.751737+0000","last_change":"2024-09-13T15:01:48.846695+0000","last_active":"2024-09-13T15:16:10.751737+0000","last_peered":"2024-09-13T15:16:10.751737+0000","last_clean":"2024-09-13T15:16:10.751737+0000","last_became_active":"2024-09-13T15:01:48.846301+0000","last_became_peered":"2024-09-13T15:01:48.846301+0000","last_unstale":"2024-09-13T15:16:10.751737+0000","last_undegraded":"2024-09-13T15:16:10.751737+0000","last_fullsized":"2024-09-13T15:16:10.751737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4494,"log_dups_size":0,"ondisk_log_size":4494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:17.532499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167794395,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66100,"num_write_kb":975469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"33'7","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:00.870032+0000","last_change":"2024-09-13T15:01:44.814483+0000","last_active":"2024-09-13T15:16:00.870032+0000","last_peered":"2024-09-13T15:16:00.870032+0000","last_clean":"2024-09-13T15:16:00.870032+0000","last_became_active":"2024-09-13T15:01:44.814192+0000","last_became_peered":"2024-09-13T15:01:44.814192+0000","last_unstale":"2024-09-13T15:16:00.870032+0000","last_undegraded":"2024-09-13T15:16:00.870032+0000","last_fullsized":"2024-09-13T15:16:00.870032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:32:30.303635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'31","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.677968+0000","last_change":"2024-09-13T15:01:44.399314+0000","last_active":"2024-09-13T15:16:10.677968+0000","last_peered":"2024-09-13T15:16:10.677968+0000","last_clean":"2024-09-13T15:16:10.677968+0000","last_became_active":"2024-09-13T15:01:44.398904+0000","last_became_peered":"2024-09-13T15:01:44.398904+0000","last_unstale":"2024-09-13T15:16:10.677968+0000","last_undegraded":"2024-09-13T15:16:10.677968+0000","last_fullsized":"2024-09-13T15:16:10.677968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.645179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70412,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":156,"num_write":29,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'5176","reported_seq":5202,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.887549+0000","last_change":"2024-09-13T15:01:48.859142+0000","last_active":"2024-09-13T15:16:10.887549+0000","last_peered":"2024-09-13T15:16:10.887549+0000","last_clean":"2024-09-13T15:16:10.887549+0000","last_became_active":"2024-09-13T15:01:48.858649+0000","last_became_peered":"2024-09-13T15:01:48.858649+0000","last_unstale":"2024-09-13T15:16:10.887549+0000","last_undegraded":"2024-09-13T15:16:10.887549+0000","last_fullsized":"2024-09-13T15:16:10.887549+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5176,"log_dups_size":0,"ondisk_log_size":5176,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:27.314012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180429918,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76277,"num_write_kb":1087992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:12.475953+0000","last_change":"2024-09-13T15:01:44.826501+0000","last_active":"2024-09-13T15:14:12.475953+0000","last_peered":"2024-09-13T15:14:12.475953+0000","last_clean":"2024-09-13T15:14:12.475953+0000","last_became_active":"2024-09-13T15:01:44.826222+0000","last_became_peered":"2024-09-13T15:01:44.826222+0000","last_unstale":"2024-09-13T15:14:12.475953+0000","last_undegraded":"2024-09-13T15:14:12.475953+0000","last_fullsized":"2024-09-13T15:14:12.475953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:00.543916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'26","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:33.062368+0000","last_change":"2024-09-13T15:01:44.421891+0000","last_active":"2024-09-13T15:15:33.062368+0000","last_peered":"2024-09-13T15:15:33.062368+0000","last_clean":"2024-09-13T15:15:33.062368+0000","last_became_active":"2024-09-13T15:01:44.419660+0000","last_became_peered":"2024-09-13T15:01:44.419660+0000","last_unstale":"2024-09-13T15:15:33.062368+0000","last_undegraded":"2024-09-13T15:15:33.062368+0000","last_fullsized":"2024-09-13T15:15:33.062368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:27.554128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":20,"num_write_kb":8201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'4164","reported_seq":4200,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.102576+0000","last_change":"2024-09-13T15:02:34.119111+0000","last_active":"2024-09-13T15:16:08.102576+0000","last_peered":"2024-09-13T15:16:08.102576+0000","last_clean":"2024-09-13T15:16:08.102576+0000","last_became_active":"2024-09-13T15:02:34.118461+0000","last_became_peered":"2024-09-13T15:02:34.118461+0000","last_unstale":"2024-09-13T15:16:08.102576+0000","last_undegraded":"2024-09-13T15:16:08.102576+0000","last_fullsized":"2024-09-13T15:16:08.102576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4164,"log_dups_size":0,"ondisk_log_size":4164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:35.096846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155522677,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60732,"num_write_kb":878332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"28'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:18.081359+0000","last_change":"2024-09-13T15:01:44.850498+0000","last_active":"2024-09-13T15:14:18.081359+0000","last_peered":"2024-09-13T15:14:18.081359+0000","last_clean":"2024-09-13T15:14:18.081359+0000","last_became_active":"2024-09-13T15:01:44.850234+0000","last_became_peered":"2024-09-13T15:01:44.850234+0000","last_unstale":"2024-09-13T15:14:18.081359+0000","last_undegraded":"2024-09-13T15:14:18.081359+0000","last_fullsized":"2024-09-13T15:14:18.081359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:46:37.202494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:18.146398+0000","last_change":"2024-09-13T15:01:44.411997+0000","last_active":"2024-09-13T15:14:18.146398+0000","last_peered":"2024-09-13T15:14:18.146398+0000","last_clean":"2024-09-13T15:14:18.146398+0000","last_became_active":"2024-09-13T15:01:44.410675+0000","last_became_peered":"2024-09-13T15:01:44.410675+0000","last_unstale":"2024-09-13T15:14:18.146398+0000","last_undegraded":"2024-09-13T15:14:18.146398+0000","last_fullsized":"2024-09-13T15:14:18.146398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:50:55.841872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":18,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.866875+0000","last_change":"2024-09-13T15:01:40.834440+0000","last_active":"2024-09-13T15:15:27.866875+0000","last_peered":"2024-09-13T15:15:27.866875+0000","last_clean":"2024-09-13T15:15:27.866875+0000","last_became_active":"2024-09-13T15:01:40.832279+0000","last_became_peered":"2024-09-13T15:01:40.832279+0000","last_unstale":"2024-09-13T15:15:27.866875+0000","last_undegraded":"2024-09-13T15:15:27.866875+0000","last_fullsized":"2024-09-13T15:15:27.866875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_clean_scrub_stamp":"2024-09-13T15:01:39.264455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:11.875506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"33'5083","reported_seq":5109,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.431985+0000","last_change":"2024-09-13T15:01:48.919580+0000","last_active":"2024-09-13T15:16:10.431985+0000","last_peered":"2024-09-13T15:16:10.431985+0000","last_clean":"2024-09-13T15:16:10.431985+0000","last_became_active":"2024-09-13T15:01:48.918678+0000","last_became_peered":"2024-09-13T15:01:48.918678+0000","last_unstale":"2024-09-13T15:16:10.431985+0000","last_undegraded":"2024-09-13T15:16:10.431985+0000","last_fullsized":"2024-09-13T15:16:10.431985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5083,"log_dups_size":0,"ondisk_log_size":5083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:02.840528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209718630,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74794,"num_write_kb":1044614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.222286+0000","last_change":"2024-09-13T15:01:44.849975+0000","last_active":"2024-09-13T15:16:02.222286+0000","last_peered":"2024-09-13T15:16:02.222286+0000","last_clean":"2024-09-13T15:16:02.222286+0000","last_became_active":"2024-09-13T15:01:44.849457+0000","last_became_peered":"2024-09-13T15:01:44.849457+0000","last_unstale":"2024-09-13T15:16:02.222286+0000","last_undegraded":"2024-09-13T15:16:02.222286+0000","last_fullsized":"2024-09-13T15:16:02.222286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:51.139153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"33'10","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:29.143262+0000","last_change":"2024-09-13T15:01:44.420906+0000","last_active":"2024-09-13T15:15:29.143262+0000","last_peered":"2024-09-13T15:15:29.143262+0000","last_clean":"2024-09-13T15:15:29.143262+0000","last_became_active":"2024-09-13T15:01:44.420601+0000","last_became_peered":"2024-09-13T15:01:44.420601+0000","last_unstale":"2024-09-13T15:15:29.143262+0000","last_undegraded":"2024-09-13T15:15:29.143262+0000","last_fullsized":"2024-09-13T15:15:29.143262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:33.245745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"33'4476","reported_seq":4502,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.800260+0000","last_change":"2024-09-13T15:01:48.911047+0000","last_active":"2024-09-13T15:16:08.800260+0000","last_peered":"2024-09-13T15:16:08.800260+0000","last_clean":"2024-09-13T15:16:08.800260+0000","last_became_active":"2024-09-13T15:01:48.910479+0000","last_became_peered":"2024-09-13T15:01:48.910479+0000","last_unstale":"2024-09-13T15:16:08.800260+0000","last_undegraded":"2024-09-13T15:16:08.800260+0000","last_fullsized":"2024-09-13T15:16:08.800260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4476,"log_dups_size":0,"ondisk_log_size":4476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:06.558889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176160849,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65864,"num_write_kb":920675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.870055+0000","last_change":"2024-09-13T15:01:44.838098+0000","last_active":"2024-09-13T15:15:27.870055+0000","last_peered":"2024-09-13T15:15:27.870055+0000","last_clean":"2024-09-13T15:15:27.870055+0000","last_became_active":"2024-09-13T15:01:44.837429+0000","last_became_peered":"2024-09-13T15:01:44.837429+0000","last_unstale":"2024-09-13T15:15:27.870055+0000","last_undegraded":"2024-09-13T15:15:27.870055+0000","last_fullsized":"2024-09-13T15:15:27.870055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:37.795841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"30'15","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:32.877991+0000","last_change":"2024-09-13T15:01:44.406999+0000","last_active":"2024-09-13T15:15:32.877991+0000","last_peered":"2024-09-13T15:15:32.877991+0000","last_clean":"2024-09-13T15:15:32.877991+0000","last_became_active":"2024-09-13T15:01:44.406719+0000","last_became_peered":"2024-09-13T15:01:44.406719+0000","last_unstale":"2024-09-13T15:15:32.877991+0000","last_undegraded":"2024-09-13T15:15:32.877991+0000","last_fullsized":"2024-09-13T15:15:32.877991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:33.397091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":9,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"33'5071","reported_seq":5097,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.549784+0000","last_change":"2024-09-13T15:01:48.857931+0000","last_active":"2024-09-13T15:16:07.549784+0000","last_peered":"2024-09-13T15:16:07.549784+0000","last_clean":"2024-09-13T15:16:07.549784+0000","last_became_active":"2024-09-13T15:01:48.857542+0000","last_became_peered":"2024-09-13T15:01:48.857542+0000","last_unstale":"2024-09-13T15:16:07.549784+0000","last_undegraded":"2024-09-13T15:16:07.549784+0000","last_fullsized":"2024-09-13T15:16:07.549784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5071,"log_dups_size":0,"ondisk_log_size":5071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:21:32.805405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197777785,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74191,"num_write_kb":1079868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:05.311578+0000","last_change":"2024-09-13T15:01:44.835470+0000","last_active":"2024-09-13T15:16:05.311578+0000","last_peered":"2024-09-13T15:16:05.311578+0000","last_clean":"2024-09-13T15:16:05.311578+0000","last_became_active":"2024-09-13T15:01:44.831166+0000","last_became_peered":"2024-09-13T15:01:44.831166+0000","last_unstale":"2024-09-13T15:16:05.311578+0000","last_undegraded":"2024-09-13T15:16:05.311578+0000","last_fullsized":"2024-09-13T15:16:05.311578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:05.887592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"30'19","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.085247+0000","last_change":"2024-09-13T15:01:44.403111+0000","last_active":"2024-09-13T15:15:57.085247+0000","last_peered":"2024-09-13T15:15:57.085247+0000","last_clean":"2024-09-13T15:15:57.085247+0000","last_became_active":"2024-09-13T15:01:44.401799+0000","last_became_peered":"2024-09-13T15:01:44.401799+0000","last_unstale":"2024-09-13T15:15:57.085247+0000","last_undegraded":"2024-09-13T15:15:57.085247+0000","last_fullsized":"2024-09-13T15:15:57.085247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:54.589470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":4114,"num_write":17,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"33'4728","reported_seq":4754,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.461987+0000","last_change":"2024-09-13T15:01:48.912490+0000","last_active":"2024-09-13T15:16:10.461987+0000","last_peered":"2024-09-13T15:16:10.461987+0000","last_clean":"2024-09-13T15:16:10.461987+0000","last_became_active":"2024-09-13T15:01:48.911474+0000","last_became_peered":"2024-09-13T15:01:48.911474+0000","last_unstale":"2024-09-13T15:16:10.461987+0000","last_undegraded":"2024-09-13T15:16:10.461987+0000","last_fullsized":"2024-09-13T15:16:10.461987+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4728,"log_dups_size":0,"ondisk_log_size":4728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:54.295921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":134285803,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69008,"num_write_kb":987747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.871262+0000","last_change":"2024-09-13T15:01:44.818472+0000","last_active":"2024-09-13T15:15:27.871262+0000","last_peered":"2024-09-13T15:15:27.871262+0000","last_clean":"2024-09-13T15:15:27.871262+0000","last_became_active":"2024-09-13T15:01:44.817718+0000","last_became_peered":"2024-09-13T15:01:44.817718+0000","last_unstale":"2024-09-13T15:15:27.871262+0000","last_undegraded":"2024-09-13T15:15:27.871262+0000","last_fullsized":"2024-09-13T15:15:27.871262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:21.310696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'15","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:32.879744+0000","last_change":"2024-09-13T15:01:44.410376+0000","last_active":"2024-09-13T15:15:32.879744+0000","last_peered":"2024-09-13T15:15:32.879744+0000","last_clean":"2024-09-13T15:15:32.879744+0000","last_became_active":"2024-09-13T15:01:44.409585+0000","last_became_peered":"2024-09-13T15:01:44.409585+0000","last_unstale":"2024-09-13T15:15:32.879744+0000","last_undegraded":"2024-09-13T15:15:32.879744+0000","last_fullsized":"2024-09-13T15:15:32.879744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:45.845804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"33'5260","reported_seq":5286,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.524170+0000","last_change":"2024-09-13T15:01:48.861130+0000","last_active":"2024-09-13T15:16:08.524170+0000","last_peered":"2024-09-13T15:16:08.524170+0000","last_clean":"2024-09-13T15:16:08.524170+0000","last_became_active":"2024-09-13T15:01:48.860317+0000","last_became_peered":"2024-09-13T15:01:48.860317+0000","last_unstale":"2024-09-13T15:16:08.524170+0000","last_undegraded":"2024-09-13T15:16:08.524170+0000","last_fullsized":"2024-09-13T15:16:08.524170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5260,"log_dups_size":0,"ondisk_log_size":5260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:45.317747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":230705862,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77504,"num_write_kb":1107255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"28'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.867788+0000","last_change":"2024-09-13T15:01:44.835494+0000","last_active":"2024-09-13T15:15:27.867788+0000","last_peered":"2024-09-13T15:15:27.867788+0000","last_clean":"2024-09-13T15:15:27.867788+0000","last_became_active":"2024-09-13T15:01:44.831150+0000","last_became_peered":"2024-09-13T15:01:44.831150+0000","last_unstale":"2024-09-13T15:15:27.867788+0000","last_undegraded":"2024-09-13T15:15:27.867788+0000","last_fullsized":"2024-09-13T15:15:27.867788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:29.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'22","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.115656+0000","last_change":"2024-09-13T15:01:44.390278+0000","last_active":"2024-09-13T15:15:57.115656+0000","last_peered":"2024-09-13T15:15:57.115656+0000","last_clean":"2024-09-13T15:15:57.115656+0000","last_became_active":"2024-09-13T15:01:44.389946+0000","last_became_peered":"2024-09-13T15:01:44.389946+0000","last_unstale":"2024-09-13T15:15:57.115656+0000","last_undegraded":"2024-09-13T15:15:57.115656+0000","last_fullsized":"2024-09-13T15:15:57.115656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:53.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"33'4067","reported_seq":4092,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.482133+0000","last_change":"2024-09-13T15:01:48.848009+0000","last_active":"2024-09-13T15:16:07.482133+0000","last_peered":"2024-09-13T15:16:07.482133+0000","last_clean":"2024-09-13T15:16:07.482133+0000","last_became_active":"2024-09-13T15:01:48.847605+0000","last_became_peered":"2024-09-13T15:01:48.847605+0000","last_unstale":"2024-09-13T15:16:07.482133+0000","last_undegraded":"2024-09-13T15:16:07.482133+0000","last_fullsized":"2024-09-13T15:16:07.482133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4067,"log_dups_size":0,"ondisk_log_size":4067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:31:32.053010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205605377,"num_objects":59,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59518,"num_write_kb":873580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.599764+0000","last_change":"2024-09-13T15:01:44.808572+0000","last_active":"2024-09-13T15:15:28.599764+0000","last_peered":"2024-09-13T15:15:28.599764+0000","last_clean":"2024-09-13T15:15:28.599764+0000","last_became_active":"2024-09-13T15:01:44.808140+0000","last_became_peered":"2024-09-13T15:01:44.808140+0000","last_unstale":"2024-09-13T15:15:28.599764+0000","last_undegraded":"2024-09-13T15:15:28.599764+0000","last_fullsized":"2024-09-13T15:15:28.599764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:15.497720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"33'9","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:45.745857+0000","last_change":"2024-09-13T15:01:44.428794+0000","last_active":"2024-09-13T15:15:45.745857+0000","last_peered":"2024-09-13T15:15:45.745857+0000","last_clean":"2024-09-13T15:15:45.745857+0000","last_became_active":"2024-09-13T15:01:44.428271+0000","last_became_peered":"2024-09-13T15:01:44.428271+0000","last_unstale":"2024-09-13T15:15:45.745857+0000","last_undegraded":"2024-09-13T15:15:45.745857+0000","last_fullsized":"2024-09-13T15:15:45.745857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:53.225826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"33'4906","reported_seq":4931,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.927201+0000","last_change":"2024-09-13T15:01:48.916354+0000","last_active":"2024-09-13T15:16:08.927201+0000","last_peered":"2024-09-13T15:16:08.927201+0000","last_clean":"2024-09-13T15:16:08.927201+0000","last_became_active":"2024-09-13T15:01:48.916008+0000","last_became_peered":"2024-09-13T15:01:48.916008+0000","last_unstale":"2024-09-13T15:16:08.927201+0000","last_undegraded":"2024-09-13T15:16:08.927201+0000","last_fullsized":"2024-09-13T15:16:08.927201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4906,"log_dups_size":0,"ondisk_log_size":4906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:58.115410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197156098,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72323,"num_write_kb":1020409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'15","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.217211+0000","last_change":"2024-09-13T15:01:44.826700+0000","last_active":"2024-09-13T15:16:08.217211+0000","last_peered":"2024-09-13T15:16:08.217211+0000","last_clean":"2024-09-13T15:16:08.217211+0000","last_became_active":"2024-09-13T15:01:44.825996+0000","last_became_peered":"2024-09-13T15:01:44.825996+0000","last_unstale":"2024-09-13T15:16:08.217211+0000","last_undegraded":"2024-09-13T15:16:08.217211+0000","last_fullsized":"2024-09-13T15:16:08.217211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:11.963837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'6","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.869444+0000","last_change":"2024-09-13T15:01:44.409339+0000","last_active":"2024-09-13T15:15:27.869444+0000","last_peered":"2024-09-13T15:15:27.869444+0000","last_clean":"2024-09-13T15:15:27.869444+0000","last_became_active":"2024-09-13T15:01:44.408644+0000","last_became_peered":"2024-09-13T15:01:44.408644+0000","last_unstale":"2024-09-13T15:15:27.869444+0000","last_undegraded":"2024-09-13T15:15:27.869444+0000","last_fullsized":"2024-09-13T15:15:27.869444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:29.297950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'4683","reported_seq":4709,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:09.628413+0000","last_change":"2024-09-13T15:01:48.916478+0000","last_active":"2024-09-13T15:16:09.628413+0000","last_peered":"2024-09-13T15:16:09.628413+0000","last_clean":"2024-09-13T15:16:09.628413+0000","last_became_active":"2024-09-13T15:01:48.916198+0000","last_became_peered":"2024-09-13T15:01:48.916198+0000","last_unstale":"2024-09-13T15:16:09.628413+0000","last_undegraded":"2024-09-13T15:16:09.628413+0000","last_fullsized":"2024-09-13T15:16:09.628413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4683,"log_dups_size":0,"ondisk_log_size":4683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:03:26.311460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":188820535,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68918,"num_write_kb":974417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.196456+0000","last_change":"2024-09-13T15:01:44.831833+0000","last_active":"2024-09-13T15:15:58.196456+0000","last_peered":"2024-09-13T15:15:58.196456+0000","last_clean":"2024-09-13T15:15:58.196456+0000","last_became_active":"2024-09-13T15:01:44.831583+0000","last_became_peered":"2024-09-13T15:01:44.831583+0000","last_unstale":"2024-09-13T15:15:58.196456+0000","last_undegraded":"2024-09-13T15:15:58.196456+0000","last_fullsized":"2024-09-13T15:15:58.196456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:37.715951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"30'30","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:53.196045+0000","last_change":"2024-09-13T15:01:44.408752+0000","last_active":"2024-09-13T15:15:53.196045+0000","last_peered":"2024-09-13T15:15:53.196045+0000","last_clean":"2024-09-13T15:15:53.196045+0000","last_became_active":"2024-09-13T15:01:44.408453+0000","last_became_peered":"2024-09-13T15:01:44.408453+0000","last_unstale":"2024-09-13T15:15:53.196045+0000","last_undegraded":"2024-09-13T15:15:53.196045+0000","last_fullsized":"2024-09-13T15:15:53.196045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:31.587404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":8225,"num_write":32,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'5090","reported_seq":5115,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.745513+0000","last_change":"2024-09-13T15:01:48.916681+0000","last_active":"2024-09-13T15:16:10.745513+0000","last_peered":"2024-09-13T15:16:10.745513+0000","last_clean":"2024-09-13T15:16:10.745513+0000","last_became_active":"2024-09-13T15:01:48.916185+0000","last_became_peered":"2024-09-13T15:01:48.916185+0000","last_unstale":"2024-09-13T15:16:10.745513+0000","last_undegraded":"2024-09-13T15:16:10.745513+0000","last_fullsized":"2024-09-13T15:16:10.745513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5090,"log_dups_size":0,"ondisk_log_size":5090,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:33.862835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":155327682,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74423,"num_write_kb":1089564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"33'4","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.869822+0000","last_change":"2024-09-13T15:01:44.817007+0000","last_active":"2024-09-13T15:15:27.869822+0000","last_peered":"2024-09-13T15:15:27.869822+0000","last_clean":"2024-09-13T15:15:27.869822+0000","last_became_active":"2024-09-13T15:01:44.815435+0000","last_became_peered":"2024-09-13T15:01:44.815435+0000","last_unstale":"2024-09-13T15:15:27.869822+0000","last_undegraded":"2024-09-13T15:15:27.869822+0000","last_fullsized":"2024-09-13T15:15:27.869822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:25.887993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'576","reported_seq":617,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.679087+0000","last_change":"2024-09-13T15:01:44.435688+0000","last_active":"2024-09-13T15:16:10.679087+0000","last_peered":"2024-09-13T15:16:10.679087+0000","last_clean":"2024-09-13T15:16:10.679087+0000","last_became_active":"2024-09-13T15:01:44.435222+0000","last_became_peered":"2024-09-13T15:01:44.435222+0000","last_unstale":"2024-09-13T15:16:10.679087+0000","last_undegraded":"2024-09-13T15:16:10.679087+0000","last_fullsized":"2024-09-13T15:16:10.679087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:24.705633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8159583,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":7965,"num_write":571,"num_write_kb":8183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"33'4408","reported_seq":4434,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.395947+0000","last_change":"2024-09-13T15:01:48.847694+0000","last_active":"2024-09-13T15:16:10.395947+0000","last_peered":"2024-09-13T15:16:10.395947+0000","last_clean":"2024-09-13T15:16:10.395947+0000","last_became_active":"2024-09-13T15:01:48.846835+0000","last_became_peered":"2024-09-13T15:01:48.846835+0000","last_unstale":"2024-09-13T15:16:10.395947+0000","last_undegraded":"2024-09-13T15:16:10.395947+0000","last_fullsized":"2024-09-13T15:16:10.395947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4408,"log_dups_size":0,"ondisk_log_size":4408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:49.763472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":201352826,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64958,"num_write_kb":924599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.484365+0000","last_change":"2024-09-13T15:01:44.835315+0000","last_active":"2024-09-13T15:15:28.484365+0000","last_peered":"2024-09-13T15:15:28.484365+0000","last_clean":"2024-09-13T15:15:28.484365+0000","last_became_active":"2024-09-13T15:01:44.834643+0000","last_became_peered":"2024-09-13T15:01:44.834643+0000","last_unstale":"2024-09-13T15:15:28.484365+0000","last_undegraded":"2024-09-13T15:15:28.484365+0000","last_fullsized":"2024-09-13T15:15:28.484365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:15.535195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'14","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.935173+0000","last_change":"2024-09-13T15:01:44.424966+0000","last_active":"2024-09-13T15:15:57.935173+0000","last_peered":"2024-09-13T15:15:57.935173+0000","last_clean":"2024-09-13T15:15:57.935173+0000","last_became_active":"2024-09-13T15:01:44.424714+0000","last_became_peered":"2024-09-13T15:01:44.424714+0000","last_unstale":"2024-09-13T15:15:57.935173+0000","last_undegraded":"2024-09-13T15:15:57.935173+0000","last_fullsized":"2024-09-13T15:15:57.935173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:46.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":15,"num_write":16,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'4758","reported_seq":4794,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.652318+0000","last_change":"2024-09-13T15:02:33.753482+0000","last_active":"2024-09-13T15:16:08.652318+0000","last_peered":"2024-09-13T15:16:08.652318+0000","last_clean":"2024-09-13T15:16:08.652318+0000","last_became_active":"2024-09-13T15:02:33.752505+0000","last_became_peered":"2024-09-13T15:02:33.752505+0000","last_unstale":"2024-09-13T15:16:08.652318+0000","last_undegraded":"2024-09-13T15:16:08.652318+0000","last_fullsized":"2024-09-13T15:16:08.652318+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4758,"log_dups_size":0,"ondisk_log_size":4758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:59.041586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176191855,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69693,"num_write_kb":999376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"33'8","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.864245+0000","last_change":"2024-09-13T15:01:44.837032+0000","last_active":"2024-09-13T15:15:27.864245+0000","last_peered":"2024-09-13T15:15:27.864245+0000","last_clean":"2024-09-13T15:15:27.864245+0000","last_became_active":"2024-09-13T15:01:44.836750+0000","last_became_peered":"2024-09-13T15:01:44.836750+0000","last_unstale":"2024-09-13T15:15:27.864245+0000","last_undegraded":"2024-09-13T15:15:27.864245+0000","last_fullsized":"2024-09-13T15:15:27.864245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:04.491426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"33'9","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.872036+0000","last_change":"2024-09-13T15:01:44.437854+0000","last_active":"2024-09-13T15:15:27.872036+0000","last_peered":"2024-09-13T15:15:27.872036+0000","last_clean":"2024-09-13T15:15:27.872036+0000","last_became_active":"2024-09-13T15:01:44.437433+0000","last_became_peered":"2024-09-13T15:01:44.437433+0000","last_unstale":"2024-09-13T15:15:27.872036+0000","last_undegraded":"2024-09-13T15:15:27.872036+0000","last_fullsized":"2024-09-13T15:15:27.872036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:24:47.302388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":18,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'4852","reported_seq":4878,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.954746+0000","last_change":"2024-09-13T15:01:48.841829+0000","last_active":"2024-09-13T15:16:08.954746+0000","last_peered":"2024-09-13T15:16:08.954746+0000","last_clean":"2024-09-13T15:16:08.954746+0000","last_became_active":"2024-09-13T15:01:48.841267+0000","last_became_peered":"2024-09-13T15:01:48.841267+0000","last_unstale":"2024-09-13T15:16:08.954746+0000","last_undegraded":"2024-09-13T15:16:08.954746+0000","last_fullsized":"2024-09-13T15:16:08.954746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4852,"log_dups_size":0,"ondisk_log_size":4852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:25.029615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":184577144,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71199,"num_write_kb":1004130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"28'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:13:55.797181+0000","last_change":"2024-09-13T15:01:44.844701+0000","last_active":"2024-09-13T15:13:55.797181+0000","last_peered":"2024-09-13T15:13:55.797181+0000","last_clean":"2024-09-13T15:13:55.797181+0000","last_became_active":"2024-09-13T15:01:44.843982+0000","last_became_peered":"2024-09-13T15:01:44.843982+0000","last_unstale":"2024-09-13T15:13:55.797181+0000","last_undegraded":"2024-09-13T15:13:55.797181+0000","last_fullsized":"2024-09-13T15:13:55.797181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"33'14","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.659715+0000","last_change":"2024-09-13T15:01:44.436081+0000","last_active":"2024-09-13T15:16:10.659715+0000","last_peered":"2024-09-13T15:16:10.659715+0000","last_clean":"2024-09-13T15:16:10.659715+0000","last_became_active":"2024-09-13T15:01:44.435367+0000","last_became_peered":"2024-09-13T15:01:44.435367+0000","last_unstale":"2024-09-13T15:16:10.659715+0000","last_undegraded":"2024-09-13T15:16:10.659715+0000","last_fullsized":"2024-09-13T15:16:10.659715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:57:57.065719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"33'3894","reported_seq":3920,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.734027+0000","last_change":"2024-09-13T15:01:48.910562+0000","last_active":"2024-09-13T15:16:08.734027+0000","last_peered":"2024-09-13T15:16:08.734027+0000","last_clean":"2024-09-13T15:16:08.734027+0000","last_became_active":"2024-09-13T15:01:48.909681+0000","last_became_peered":"2024-09-13T15:01:48.909681+0000","last_unstale":"2024-09-13T15:16:08.734027+0000","last_undegraded":"2024-09-13T15:16:08.734027+0000","last_fullsized":"2024-09-13T15:16:08.734027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":3894,"log_dups_size":0,"ondisk_log_size":3894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:28:35.989769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171990195,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57348,"num_write_kb":843085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'3639","reported_seq":3676,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.200570+0000","last_change":"2024-09-13T15:02:34.118951+0000","last_active":"2024-09-13T15:16:07.200570+0000","last_peered":"2024-09-13T15:16:07.200570+0000","last_clean":"2024-09-13T15:16:07.200570+0000","last_became_active":"2024-09-13T15:02:34.118477+0000","last_became_peered":"2024-09-13T15:02:34.118477+0000","last_unstale":"2024-09-13T15:16:07.200570+0000","last_undegraded":"2024-09-13T15:16:07.200570+0000","last_fullsized":"2024-09-13T15:16:07.200570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":3639,"log_dups_size":0,"ondisk_log_size":3639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:13.697114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142701044,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53400,"num_write_kb":757724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:05.388722+0000","last_change":"2024-09-13T15:01:44.808417+0000","last_active":"2024-09-13T15:16:05.388722+0000","last_peered":"2024-09-13T15:16:05.388722+0000","last_clean":"2024-09-13T15:16:05.388722+0000","last_became_active":"2024-09-13T15:01:44.807641+0000","last_became_peered":"2024-09-13T15:01:44.807641+0000","last_unstale":"2024-09-13T15:16:05.388722+0000","last_undegraded":"2024-09-13T15:16:05.388722+0000","last_fullsized":"2024-09-13T15:16:05.388722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:58.296966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'34","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:33.277729+0000","last_change":"2024-09-13T15:01:44.433582+0000","last_active":"2024-09-13T15:15:33.277729+0000","last_peered":"2024-09-13T15:15:33.277729+0000","last_clean":"2024-09-13T15:15:33.277729+0000","last_became_active":"2024-09-13T15:01:44.433124+0000","last_became_peered":"2024-09-13T15:01:44.433124+0000","last_unstale":"2024-09-13T15:15:33.277729+0000","last_undegraded":"2024-09-13T15:15:33.277729+0000","last_fullsized":"2024-09-13T15:15:33.277729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:04.476996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":8193,"num_write":27,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4877","reported_seq":4903,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.210978+0000","last_change":"2024-09-13T15:01:48.855090+0000","last_active":"2024-09-13T15:16:10.210978+0000","last_peered":"2024-09-13T15:16:10.210978+0000","last_clean":"2024-09-13T15:16:10.210978+0000","last_became_active":"2024-09-13T15:01:48.852925+0000","last_became_peered":"2024-09-13T15:01:48.852925+0000","last_unstale":"2024-09-13T15:16:10.210978+0000","last_undegraded":"2024-09-13T15:16:10.210978+0000","last_fullsized":"2024-09-13T15:16:10.210978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4877,"log_dups_size":0,"ondisk_log_size":4877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.176480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192967854,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71595,"num_write_kb":1060070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"33'9","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.732294+0000","last_change":"2024-09-13T15:02:33.746356+0000","last_active":"2024-09-13T15:15:58.732294+0000","last_peered":"2024-09-13T15:15:58.732294+0000","last_clean":"2024-09-13T15:15:58.732294+0000","last_became_active":"2024-09-13T15:02:33.746005+0000","last_became_peered":"2024-09-13T15:02:33.746005+0000","last_unstale":"2024-09-13T15:15:58.732294+0000","last_undegraded":"2024-09-13T15:15:58.732294+0000","last_fullsized":"2024-09-13T15:15:58.732294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:41.159781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"33'6","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389847+0000","last_change":"2024-09-13T15:01:44.436900+0000","last_active":"2024-09-13T15:15:28.389847+0000","last_peered":"2024-09-13T15:15:28.389847+0000","last_clean":"2024-09-13T15:15:28.389847+0000","last_became_active":"2024-09-13T15:01:44.436646+0000","last_became_peered":"2024-09-13T15:01:44.436646+0000","last_unstale":"2024-09-13T15:15:28.389847+0000","last_undegraded":"2024-09-13T15:15:28.389847+0000","last_fullsized":"2024-09-13T15:15:28.389847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:02:52.505856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":27,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"33'47","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:34.359088+0000","last_change":"2024-09-13T15:01:44.430115+0000","last_active":"2024-09-13T15:15:34.359088+0000","last_peered":"2024-09-13T15:15:34.359088+0000","last_clean":"2024-09-13T15:15:34.359088+0000","last_became_active":"2024-09-13T15:01:44.429339+0000","last_became_peered":"2024-09-13T15:01:44.429339+0000","last_unstale":"2024-09-13T15:15:34.359088+0000","last_undegraded":"2024-09-13T15:15:34.359088+0000","last_fullsized":"2024-09-13T15:15:34.359088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:47.224125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":8210,"num_write":46,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.864483+0000","last_change":"2024-09-13T15:01:44.822034+0000","last_active":"2024-09-13T15:15:27.864483+0000","last_peered":"2024-09-13T15:15:27.864483+0000","last_clean":"2024-09-13T15:15:27.864483+0000","last_became_active":"2024-09-13T15:01:44.821734+0000","last_became_peered":"2024-09-13T15:01:44.821734+0000","last_unstale":"2024-09-13T15:15:27.864483+0000","last_undegraded":"2024-09-13T15:15:27.864483+0000","last_fullsized":"2024-09-13T15:15:27.864483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:57:44.629046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"33'4679","reported_seq":4704,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:12.498909+0000","last_change":"2024-09-13T15:01:48.858033+0000","last_active":"2024-09-13T15:16:12.498909+0000","last_peered":"2024-09-13T15:16:12.498909+0000","last_clean":"2024-09-13T15:16:12.498909+0000","last_became_active":"2024-09-13T15:01:48.857584+0000","last_became_peered":"2024-09-13T15:01:48.857584+0000","last_unstale":"2024-09-13T15:16:12.498909+0000","last_undegraded":"2024-09-13T15:16:12.498909+0000","last_fullsized":"2024-09-13T15:16:12.498909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4679,"log_dups_size":0,"ondisk_log_size":4679,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:04.797167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117473903,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68648,"num_write_kb":960930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"32'1778","reported_seq":1809,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389774+0000","last_change":"2024-09-13T15:01:44.422582+0000","last_active":"2024-09-13T15:15:28.389774+0000","last_peered":"2024-09-13T15:15:28.389774+0000","last_clean":"2024-09-13T15:15:28.389774+0000","last_became_active":"2024-09-13T15:01:44.422367+0000","last_became_peered":"2024-09-13T15:01:44.422367+0000","last_unstale":"2024-09-13T15:15:28.389774+0000","last_undegraded":"2024-09-13T15:15:28.389774+0000","last_fullsized":"2024-09-13T15:15:28.389774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1778,"log_dups_size":0,"ondisk_log_size":1778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:57.902724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195253,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4098,"num_write":1774,"num_write_kb":4250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:12.752509+0000","last_change":"2024-09-13T15:01:44.820841+0000","last_active":"2024-09-13T15:14:12.752509+0000","last_peered":"2024-09-13T15:14:12.752509+0000","last_clean":"2024-09-13T15:14:12.752509+0000","last_became_active":"2024-09-13T15:01:44.816584+0000","last_became_peered":"2024-09-13T15:01:44.816584+0000","last_unstale":"2024-09-13T15:14:12.752509+0000","last_undegraded":"2024-09-13T15:14:12.752509+0000","last_fullsized":"2024-09-13T15:14:12.752509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:26.763818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4675","reported_seq":4700,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:09.586090+0000","last_change":"2024-09-13T15:01:48.840771+0000","last_active":"2024-09-13T15:16:09.586090+0000","last_peered":"2024-09-13T15:16:09.586090+0000","last_clean":"2024-09-13T15:16:09.586090+0000","last_became_active":"2024-09-13T15:01:48.840397+0000","last_became_peered":"2024-09-13T15:01:48.840397+0000","last_unstale":"2024-09-13T15:16:09.586090+0000","last_undegraded":"2024-09-13T15:16:09.586090+0000","last_fullsized":"2024-09-13T15:16:09.586090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4675,"log_dups_size":0,"ondisk_log_size":4675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:59.700088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180423209,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68695,"num_write_kb":983871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"33'10","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:05.934297+0000","last_change":"2024-09-13T15:01:44.809497+0000","last_active":"2024-09-13T15:16:05.934297+0000","last_peered":"2024-09-13T15:16:05.934297+0000","last_clean":"2024-09-13T15:16:05.934297+0000","last_became_active":"2024-09-13T15:01:44.808669+0000","last_became_peered":"2024-09-13T15:01:44.808669+0000","last_unstale":"2024-09-13T15:16:05.934297+0000","last_undegraded":"2024-09-13T15:16:05.934297+0000","last_fullsized":"2024-09-13T15:16:05.934297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:45.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"33'8","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.091461+0000","last_change":"2024-09-13T15:01:44.836353+0000","last_active":"2024-09-13T15:16:02.091461+0000","last_peered":"2024-09-13T15:16:02.091461+0000","last_clean":"2024-09-13T15:16:02.091461+0000","last_became_active":"2024-09-13T15:01:44.836102+0000","last_became_peered":"2024-09-13T15:01:44.836102+0000","last_unstale":"2024-09-13T15:16:02.091461+0000","last_undegraded":"2024-09-13T15:16:02.091461+0000","last_fullsized":"2024-09-13T15:16:02.091461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:14.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'6","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:20.816437+0000","last_change":"2024-09-13T15:01:44.849091+0000","last_active":"2024-09-13T15:14:20.816437+0000","last_peered":"2024-09-13T15:14:20.816437+0000","last_clean":"2024-09-13T15:14:20.816437+0000","last_became_active":"2024-09-13T15:01:44.846506+0000","last_became_peered":"2024-09-13T15:01:44.846506+0000","last_unstale":"2024-09-13T15:14:20.816437+0000","last_undegraded":"2024-09-13T15:14:20.816437+0000","last_fullsized":"2024-09-13T15:14:20.816437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:38.026998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.447468+0000","last_change":"2024-09-13T15:01:44.809873+0000","last_active":"2024-09-13T15:15:58.447468+0000","last_peered":"2024-09-13T15:15:58.447468+0000","last_clean":"2024-09-13T15:15:58.447468+0000","last_became_active":"2024-09-13T15:01:44.809585+0000","last_became_peered":"2024-09-13T15:01:44.809585+0000","last_unstale":"2024-09-13T15:15:58.447468+0000","last_undegraded":"2024-09-13T15:15:58.447468+0000","last_fullsized":"2024-09-13T15:15:58.447468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:20.272320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'1","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:44.316932+0000","last_change":"2024-09-13T15:01:44.816761+0000","last_active":"2024-09-13T15:14:44.316932+0000","last_peered":"2024-09-13T15:14:44.316932+0000","last_clean":"2024-09-13T15:14:44.316932+0000","last_became_active":"2024-09-13T15:01:44.816480+0000","last_became_peered":"2024-09-13T15:01:44.816480+0000","last_unstale":"2024-09-13T15:14:44.316932+0000","last_undegraded":"2024-09-13T15:14:44.316932+0000","last_fullsized":"2024-09-13T15:14:44.316932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:46.000440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.712144+0000","last_change":"2024-09-13T15:01:44.808373+0000","last_active":"2024-09-13T15:15:28.712144+0000","last_peered":"2024-09-13T15:15:28.712144+0000","last_clean":"2024-09-13T15:15:28.712144+0000","last_became_active":"2024-09-13T15:01:44.807622+0000","last_became_peered":"2024-09-13T15:01:44.807622+0000","last_unstale":"2024-09-13T15:15:28.712144+0000","last_undegraded":"2024-09-13T15:15:28.712144+0000","last_fullsized":"2024-09-13T15:15:28.712144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:38.584426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"33'8","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.601200+0000","last_change":"2024-09-13T15:01:44.832521+0000","last_active":"2024-09-13T15:15:28.601200+0000","last_peered":"2024-09-13T15:15:28.601200+0000","last_clean":"2024-09-13T15:15:28.601200+0000","last_became_active":"2024-09-13T15:01:44.831889+0000","last_became_peered":"2024-09-13T15:01:44.831889+0000","last_unstale":"2024-09-13T15:15:28.601200+0000","last_undegraded":"2024-09-13T15:15:28.601200+0000","last_fullsized":"2024-09-13T15:15:28.601200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:07.563684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:59.619580+0000","last_change":"2024-09-13T15:01:44.817583+0000","last_active":"2024-09-13T15:14:59.619580+0000","last_peered":"2024-09-13T15:14:59.619580+0000","last_clean":"2024-09-13T15:14:59.619580+0000","last_became_active":"2024-09-13T15:01:44.817350+0000","last_became_peered":"2024-09-13T15:01:44.817350+0000","last_unstale":"2024-09-13T15:14:59.619580+0000","last_undegraded":"2024-09-13T15:14:59.619580+0000","last_fullsized":"2024-09-13T15:14:59.619580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:10.913776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.295235+0000","last_change":"2024-09-13T15:01:44.838372+0000","last_active":"2024-09-13T15:16:02.295235+0000","last_peered":"2024-09-13T15:16:02.295235+0000","last_clean":"2024-09-13T15:16:02.295235+0000","last_became_active":"2024-09-13T15:01:44.837588+0000","last_became_peered":"2024-09-13T15:01:44.837588+0000","last_unstale":"2024-09-13T15:16:02.295235+0000","last_undegraded":"2024-09-13T15:16:02.295235+0000","last_fullsized":"2024-09-13T15:16:02.295235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:05:12.877936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"33'4","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389769+0000","last_change":"2024-09-13T15:01:44.828159+0000","last_active":"2024-09-13T15:15:28.389769+0000","last_peered":"2024-09-13T15:15:28.389769+0000","last_clean":"2024-09-13T15:15:28.389769+0000","last_became_active":"2024-09-13T15:01:44.827910+0000","last_became_peered":"2024-09-13T15:01:44.827910+0000","last_unstale":"2024-09-13T15:15:28.389769+0000","last_undegraded":"2024-09-13T15:15:28.389769+0000","last_fullsized":"2024-09-13T15:15:28.389769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:07:32.776119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"33'8","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:06.655643+0000","last_change":"2024-09-13T15:02:34.119204+0000","last_active":"2024-09-13T15:16:06.655643+0000","last_peered":"2024-09-13T15:16:06.655643+0000","last_clean":"2024-09-13T15:16:06.655643+0000","last_became_active":"2024-09-13T15:02:34.118621+0000","last_became_peered":"2024-09-13T15:02:34.118621+0000","last_unstale":"2024-09-13T15:16:06.655643+0000","last_undegraded":"2024-09-13T15:16:06.655643+0000","last_fullsized":"2024-09-13T15:16:06.655643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:33.356064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"33'8","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.193423+0000","last_change":"2024-09-13T15:01:44.831717+0000","last_active":"2024-09-13T15:15:28.193423+0000","last_peered":"2024-09-13T15:15:28.193423+0000","last_clean":"2024-09-13T15:15:28.193423+0000","last_became_active":"2024-09-13T15:01:44.831495+0000","last_became_peered":"2024-09-13T15:01:44.831495+0000","last_unstale":"2024-09-13T15:15:28.193423+0000","last_undegraded":"2024-09-13T15:15:28.193423+0000","last_fullsized":"2024-09-13T15:15:28.193423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:10:48.753543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:04.386790+0000","last_change":"2024-09-13T15:01:44.829698+0000","last_active":"2024-09-13T15:16:04.386790+0000","last_peered":"2024-09-13T15:16:04.386790+0000","last_clean":"2024-09-13T15:16:04.386790+0000","last_became_active":"2024-09-13T15:01:44.828999+0000","last_became_peered":"2024-09-13T15:01:44.828999+0000","last_unstale":"2024-09-13T15:16:04.386790+0000","last_undegraded":"2024-09-13T15:16:04.386790+0000","last_fullsized":"2024-09-13T15:16:04.386790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:30.591718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"28'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:15:19.592318+0000","last_change":"2024-09-13T15:01:44.817554+0000","last_active":"2024-09-13T15:15:19.592318+0000","last_peered":"2024-09-13T15:15:19.592318+0000","last_clean":"2024-09-13T15:15:19.592318+0000","last_became_active":"2024-09-13T15:01:44.816258+0000","last_became_peered":"2024-09-13T15:01:44.816258+0000","last_unstale":"2024-09-13T15:15:19.592318+0000","last_undegraded":"2024-09-13T15:15:19.592318+0000","last_fullsized":"2024-09-13T15:15:19.592318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:07.927802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"33'15","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.185393+0000","last_change":"2024-09-13T15:01:44.809979+0000","last_active":"2024-09-13T15:16:02.185393+0000","last_peered":"2024-09-13T15:16:02.185393+0000","last_clean":"2024-09-13T15:16:02.185393+0000","last_became_active":"2024-09-13T15:01:44.809687+0000","last_became_peered":"2024-09-13T15:01:44.809687+0000","last_unstale":"2024-09-13T15:16:02.185393+0000","last_undegraded":"2024-09-13T15:16:02.185393+0000","last_fullsized":"2024-09-13T15:16:02.185393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:45.583840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"33'10","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:05.355494+0000","last_change":"2024-09-13T15:02:34.119233+0000","last_active":"2024-09-13T15:16:05.355494+0000","last_peered":"2024-09-13T15:16:05.355494+0000","last_clean":"2024-09-13T15:16:05.355494+0000","last_became_active":"2024-09-13T15:02:34.118798+0000","last_became_peered":"2024-09-13T15:02:34.118798+0000","last_unstale":"2024-09-13T15:16:05.355494+0000","last_undegraded":"2024-09-13T15:16:05.355494+0000","last_fullsized":"2024-09-13T15:16:05.355494+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:12.367569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:50.837989+0000","last_change":"2024-09-13T15:01:44.848904+0000","last_active":"2024-09-13T15:15:50.837989+0000","last_peered":"2024-09-13T15:15:50.837989+0000","last_clean":"2024-09-13T15:15:50.837989+0000","last_became_active":"2024-09-13T15:01:44.846074+0000","last_became_peered":"2024-09-13T15:01:44.846074+0000","last_unstale":"2024-09-13T15:15:50.837989+0000","last_undegraded":"2024-09-13T15:15:50.837989+0000","last_fullsized":"2024-09-13T15:15:50.837989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:37.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.757358+0000","last_change":"2024-09-13T15:01:44.828243+0000","last_active":"2024-09-13T15:15:58.757358+0000","last_peered":"2024-09-13T15:15:58.757358+0000","last_clean":"2024-09-13T15:15:58.757358+0000","last_became_active":"2024-09-13T15:01:44.828024+0000","last_became_peered":"2024-09-13T15:01:44.828024+0000","last_unstale":"2024-09-13T15:15:58.757358+0000","last_undegraded":"2024-09-13T15:15:58.757358+0000","last_fullsized":"2024-09-13T15:15:58.757358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:28:47.388087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.095134+0000","last_change":"2024-09-13T15:01:44.808879+0000","last_active":"2024-09-13T15:15:57.095134+0000","last_peered":"2024-09-13T15:15:57.095134+0000","last_clean":"2024-09-13T15:15:57.095134+0000","last_became_active":"2024-09-13T15:01:44.808609+0000","last_became_peered":"2024-09-13T15:01:44.808609+0000","last_unstale":"2024-09-13T15:15:57.095134+0000","last_undegraded":"2024-09-13T15:15:57.095134+0000","last_fullsized":"2024-09-13T15:15:57.095134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:59.817452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"33'7","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389496+0000","last_change":"2024-09-13T15:01:44.811171+0000","last_active":"2024-09-13T15:15:28.389496+0000","last_peered":"2024-09-13T15:15:28.389496+0000","last_clean":"2024-09-13T15:15:28.389496+0000","last_became_active":"2024-09-13T15:01:44.809918+0000","last_became_peered":"2024-09-13T15:01:44.809918+0000","last_unstale":"2024-09-13T15:15:28.389496+0000","last_undegraded":"2024-09-13T15:15:28.389496+0000","last_fullsized":"2024-09-13T15:15:28.389496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:48.359429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.484061+0000","last_change":"2024-09-13T15:01:44.833663+0000","last_active":"2024-09-13T15:15:28.484061+0000","last_peered":"2024-09-13T15:15:28.484061+0000","last_clean":"2024-09-13T15:15:28.484061+0000","last_became_active":"2024-09-13T15:01:44.828737+0000","last_became_peered":"2024-09-13T15:01:44.828737+0000","last_unstale":"2024-09-13T15:15:28.484061+0000","last_undegraded":"2024-09-13T15:15:28.484061+0000","last_fullsized":"2024-09-13T15:15:28.484061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:08.579890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.696714+0000","last_change":"2024-09-13T15:01:44.851143+0000","last_active":"2024-09-13T15:15:58.696714+0000","last_peered":"2024-09-13T15:15:58.696714+0000","last_clean":"2024-09-13T15:15:58.696714+0000","last_became_active":"2024-09-13T15:01:44.850410+0000","last_became_peered":"2024-09-13T15:01:44.850410+0000","last_unstale":"2024-09-13T15:15:58.696714+0000","last_undegraded":"2024-09-13T15:15:58.696714+0000","last_fullsized":"2024-09-13T15:15:58.696714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:11.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"28'10","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:13:55.683421+0000","last_change":"2024-09-13T15:01:44.840082+0000","last_active":"2024-09-13T15:13:55.683421+0000","last_peered":"2024-09-13T15:13:55.683421+0000","last_clean":"2024-09-13T15:13:55.683421+0000","last_became_active":"2024-09-13T15:01:44.839371+0000","last_became_peered":"2024-09-13T15:01:44.839371+0000","last_unstale":"2024-09-13T15:13:55.683421+0000","last_undegraded":"2024-09-13T15:13:55.683421+0000","last_fullsized":"2024-09-13T15:13:55.683421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:13.433036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"33'9","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.952810+0000","last_change":"2024-09-13T15:01:44.850416+0000","last_active":"2024-09-13T15:15:57.952810+0000","last_peered":"2024-09-13T15:15:57.952810+0000","last_clean":"2024-09-13T15:15:57.952810+0000","last_became_active":"2024-09-13T15:01:44.849766+0000","last_became_peered":"2024-09-13T15:01:44.849766+0000","last_unstale":"2024-09-13T15:15:57.952810+0000","last_undegraded":"2024-09-13T15:15:57.952810+0000","last_fullsized":"2024-09-13T15:15:57.952810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:11.985610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.389960+0000","last_change":"2024-09-13T15:01:44.837060+0000","last_active":"2024-09-13T15:15:28.389960+0000","last_peered":"2024-09-13T15:15:28.389960+0000","last_clean":"2024-09-13T15:15:28.389960+0000","last_became_active":"2024-09-13T15:01:44.836770+0000","last_became_peered":"2024-09-13T15:01:44.836770+0000","last_unstale":"2024-09-13T15:15:28.389960+0000","last_undegraded":"2024-09-13T15:15:28.389960+0000","last_fullsized":"2024-09-13T15:15:28.389960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:45.915852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"28'5","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:19.453771+0000","last_change":"2024-09-13T15:01:44.815867+0000","last_active":"2024-09-13T15:14:19.453771+0000","last_peered":"2024-09-13T15:14:19.453771+0000","last_clean":"2024-09-13T15:14:19.453771+0000","last_became_active":"2024-09-13T15:01:44.815116+0000","last_became_peered":"2024-09-13T15:01:44.815116+0000","last_unstale":"2024-09-13T15:14:19.453771+0000","last_undegraded":"2024-09-13T15:14:19.453771+0000","last_fullsized":"2024-09-13T15:14:19.453771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:02.814724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:20.816422+0000","last_change":"2024-09-13T15:01:44.850022+0000","last_active":"2024-09-13T15:14:20.816422+0000","last_peered":"2024-09-13T15:14:20.816422+0000","last_clean":"2024-09-13T15:14:20.816422+0000","last_became_active":"2024-09-13T15:01:44.849533+0000","last_became_peered":"2024-09-13T15:01:44.849533+0000","last_unstale":"2024-09-13T15:14:20.816422+0000","last_undegraded":"2024-09-13T15:14:20.816422+0000","last_fullsized":"2024-09-13T15:14:20.816422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:22:09.837692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:19.453803+0000","last_change":"2024-09-13T15:01:44.817139+0000","last_active":"2024-09-13T15:14:19.453803+0000","last_peered":"2024-09-13T15:14:19.453803+0000","last_clean":"2024-09-13T15:14:19.453803+0000","last_became_active":"2024-09-13T15:01:44.816416+0000","last_became_peered":"2024-09-13T15:01:44.816416+0000","last_unstale":"2024-09-13T15:14:19.453803+0000","last_undegraded":"2024-09-13T15:14:19.453803+0000","last_fullsized":"2024-09-13T15:14:19.453803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:38.382210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"28'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:37.845022+0000","last_change":"2024-09-13T15:02:33.747735+0000","last_active":"2024-09-13T15:14:37.845022+0000","last_peered":"2024-09-13T15:14:37.845022+0000","last_clean":"2024-09-13T15:14:37.845022+0000","last_became_active":"2024-09-13T15:02:33.747405+0000","last_became_peered":"2024-09-13T15:02:33.747405+0000","last_unstale":"2024-09-13T15:14:37.845022+0000","last_undegraded":"2024-09-13T15:14:37.845022+0000","last_fullsized":"2024-09-13T15:14:37.845022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:20.616184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.992814+0000","last_change":"2024-09-13T15:01:44.808264+0000","last_active":"2024-09-13T15:15:57.992814+0000","last_peered":"2024-09-13T15:15:57.992814+0000","last_clean":"2024-09-13T15:15:57.992814+0000","last_became_active":"2024-09-13T15:01:44.807776+0000","last_became_peered":"2024-09-13T15:01:44.807776+0000","last_unstale":"2024-09-13T15:15:57.992814+0000","last_undegraded":"2024-09-13T15:15:57.992814+0000","last_fullsized":"2024-09-13T15:15:57.992814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:17.637800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:18.534958+0000","last_change":"2024-09-13T15:01:44.804985+0000","last_active":"2024-09-13T15:14:18.534958+0000","last_peered":"2024-09-13T15:14:18.534958+0000","last_clean":"2024-09-13T15:14:18.534958+0000","last_became_active":"2024-09-13T15:01:44.803977+0000","last_became_peered":"2024-09-13T15:01:44.803977+0000","last_unstale":"2024-09-13T15:14:18.534958+0000","last_undegraded":"2024-09-13T15:14:18.534958+0000","last_fullsized":"2024-09-13T15:14:18.534958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:12.999738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:06.045422+0000","last_change":"2024-09-13T15:01:44.824666+0000","last_active":"2024-09-13T15:16:06.045422+0000","last_peered":"2024-09-13T15:16:06.045422+0000","last_clean":"2024-09-13T15:16:06.045422+0000","last_became_active":"2024-09-13T15:01:44.815381+0000","last_became_peered":"2024-09-13T15:01:44.815381+0000","last_unstale":"2024-09-13T15:16:06.045422+0000","last_undegraded":"2024-09-13T15:16:06.045422+0000","last_fullsized":"2024-09-13T15:16:06.045422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:12:17.680247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":5907985462,"num_objects":1594,"num_object_clones":0,"num_object_copies":6376,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1594,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2169555,"num_write_kb":31079058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11327209472,"data_stored":11327209472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147725,"ondisk_log_size":147725,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":371,"ondisk_log_size":371,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":108901356,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":501,"num_read_kb":110953,"num_write":3233,"num_write_kb":107178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":74,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":218046464,"data_stored":217802382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3142,"ondisk_log_size":3142,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542321,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2252656,"kb_used_data":1359464,"kb_used_omap":1,"kb_used_meta":891134,"kb_avail":92119184,"statfs":{"total":96636764160,"available":94330044416,"internally_reserved":0,"allocated":1392091136,"data_stored":1391853235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":912521675},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":4.9580000000000002,"5min":7.657,"15min":4.8689999999999998},"min":{"1min":0.497,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":108.818,"5min":254.13499999999999,"15min":254.13499999999999},"last":108.818},{"interface":"front","average":{"1min":5.016,"5min":7.7190000000000003,"15min":4.883},"min":{"1min":0.46100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":108.85299999999999,"5min":254.119,"15min":254.119},"last":108.85299999999999}]},{"osd":1,"last update":"Fri Sep 13 15:16:00 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":14.494999999999999,"15min":8.6910000000000007},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.29999999999999999},"max":{"1min":4.3449999999999998,"5min":281.399,"15min":281.399},"last":116.92400000000001},{"interface":"front","average":{"1min":1.1379999999999999,"5min":12.275,"15min":9.9440000000000008},"min":{"1min":0.41099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.3120000000000003,"5min":265.74299999999999,"15min":557.92399999999998},"last":116.828}]},{"osd":2,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":5.1769999999999996,"5min":9.6869999999999994,"15min":5.5309999999999997},"min":{"1min":0.47099999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":119.023,"5min":280.29700000000003,"15min":280.29700000000003},"last":119.023},{"interface":"front","average":{"1min":5.2130000000000001,"5min":9.0009999999999994,"15min":5.2590000000000003},"min":{"1min":0.48299999999999998,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":115.961,"5min":274.03500000000003,"15min":274.03500000000003},"last":115.961}]},{"osd":3,"last update":"Fri Sep 13 15:16:03 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":10.202999999999999,"15min":6.407},"min":{"1min":0.377,"5min":0.377,"15min":0.32300000000000001},"max":{"1min":5.0300000000000002,"5min":261.36000000000001,"15min":261.36000000000001},"last":111.05500000000001},{"interface":"front","average":{"1min":0.94399999999999995,"5min":7.5250000000000004,"15min":5.0149999999999997},"min":{"1min":0.502,"5min":0.37,"15min":0.29599999999999999},"max":{"1min":5.2889999999999997,"5min":252.90000000000001,"15min":252.90000000000001},"last":111.715}]},{"osd":4,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":2.141,"15min":1.3029999999999999},"min":{"1min":0.60199999999999998,"5min":0.248,"15min":0.23699999999999999},"max":{"1min":2.0089999999999999,"5min":20.928999999999998,"15min":20.928999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.2250000000000001,"5min":2.2869999999999999,"15min":1.379},"min":{"1min":0.61199999999999999,"5min":0.254,"15min":0.24199999999999999},"max":{"1min":6.4589999999999996,"5min":20.893000000000001,"15min":20.893000000000001},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.123,"15min":1.093},"min":{"1min":0.30299999999999999,"5min":0.248,"15min":0.248},"max":{"1min":1.2869999999999999,"5min":11.800000000000001,"15min":11.800000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":1.02,"5min":1.0649999999999999,"15min":1.014},"min":{"1min":0.34100000000000003,"5min":0.252,"15min":0.252},"max":{"1min":2.625,"5min":8.593,"15min":8.593},"last":0.41899999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.988,"15min":1.377},"min":{"1min":0.42899999999999999,"5min":0.29699999999999999,"15min":0.27700000000000002},"max":{"1min":2.677,"5min":20.835000000000001,"15min":20.835000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.177,"5min":1.716,"15min":1.244},"min":{"1min":0.53900000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":4.9550000000000001,"5min":21.518000000000001,"15min":21.518000000000001},"last":0.57499999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542322,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2625884,"kb_used_data":1483412,"kb_used_omap":1,"kb_used_meta":1140414,"kb_avail":91745956,"statfs":{"total":96636764160,"available":93947858944,"internally_reserved":0,"allocated":1519013888,"data_stored":1518791009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1167784391},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":9.2059999999999995,"5min":13.884,"15min":5.5709999999999997},"min":{"1min":0.32300000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":113.221,"5min":343.02800000000002,"15min":343.02800000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":8.6219999999999999,"5min":13.922000000000001,"15min":5.3899999999999997},"min":{"1min":0.32000000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":114.724,"5min":370.00099999999998,"15min":370.00099999999998},"last":0.45900000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":8.6010000000000009,"5min":15.124000000000001,"15min":6.077},"min":{"1min":0.52800000000000002,"5min":0.313,"15min":0.26900000000000002},"max":{"1min":114.68000000000001,"5min":236.12100000000001,"15min":236.12100000000001},"last":2.0409999999999999},{"interface":"front","average":{"1min":9.0470000000000006,"5min":16.638999999999999,"15min":7.2080000000000002},"min":{"1min":0.38500000000000001,"5min":0.34000000000000002,"15min":0.32300000000000001},"max":{"1min":114.613,"5min":274.46800000000002,"15min":274.46800000000002},"last":4.9909999999999997}]},{"osd":2,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":8.4060000000000006,"5min":8.4359999999999999,"15min":3.5990000000000002},"min":{"1min":0.36499999999999999,"5min":0.311,"15min":0.311},"max":{"1min":111.875,"5min":249.75700000000001,"15min":249.75700000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":9.7959999999999994,"5min":9.5779999999999994,"15min":4.0010000000000003},"min":{"1min":0.36899999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":111.07899999999999,"5min":283.36700000000002,"15min":283.36700000000002},"last":0.752}]},{"osd":3,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":9.407,"5min":9.8840000000000003,"15min":4.423},"min":{"1min":0.40100000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":113.355,"5min":239.05099999999999,"15min":239.05099999999999},"last":6.6459999999999999},{"interface":"front","average":{"1min":9.0540000000000003,"5min":15.593,"15min":6.3259999999999996},"min":{"1min":0.39000000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":111.92100000000001,"5min":352.03800000000001,"15min":352.03800000000001},"last":0.95699999999999996}]},{"osd":4,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":1.478,"5min":3.8969999999999998,"15min":2.1880000000000002},"min":{"1min":0.28499999999999998,"5min":0.25700000000000001,"15min":0.23300000000000001},"max":{"1min":9.3379999999999992,"5min":37.261000000000003,"15min":91.054000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":3.9700000000000002,"15min":2.238},"min":{"1min":0.35299999999999998,"5min":0.254,"15min":0.254},"max":{"1min":8.9009999999999998,"5min":52.167000000000002,"15min":99.084000000000003},"last":0.42099999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":1.306,"15min":1.036},"min":{"1min":0.28699999999999998,"5min":0.253,"15min":0.253},"max":{"1min":2.5169999999999999,"5min":15.196,"15min":15.196},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.748,"5min":1.6359999999999999,"15min":1.1910000000000001},"min":{"1min":0.36299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.4510000000000001,"5min":25.192,"15min":25.192},"last":0.49199999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:15:08 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":1.982,"15min":1.3149999999999999},"min":{"1min":0.33600000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":2.5990000000000002,"5min":37.219999999999999,"15min":37.219999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.749,"5min":1.337,"15min":1.133},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.5710000000000002,"5min":14.654,"15min":14.654},"last":0.59899999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542321,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1901684,"kb_used_data":1105260,"kb_used_omap":1,"kb_used_meta":792318,"kb_avail":92470156,"statfs":{"total":96636764160,"available":94689439744,"internally_reserved":0,"allocated":1131786240,"data_stored":1131541927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":811334086},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":3.613,"15min":2.6589999999999998},"min":{"1min":0.27600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0109999999999999,"5min":70.611000000000004,"15min":94.078999999999994},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":3.3210000000000002,"15min":2.0489999999999999},"min":{"1min":0.60099999999999998,"5min":0.27800000000000002,"15min":0.27000000000000002},"max":{"1min":1.681,"5min":76.866,"15min":76.866},"last":0.93300000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":5.2690000000000001,"15min":4.3250000000000002},"min":{"1min":0.66500000000000004,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.708,"5min":214.21199999999999,"15min":214.21199999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":4.6760000000000002,"15min":6.625},"min":{"1min":0.57999999999999996,"5min":0.317,"15min":0.317},"max":{"1min":1.6559999999999999,"5min":206.20699999999999,"15min":559.69500000000005},"last":0.76400000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":3.3490000000000002,"15min":2.3210000000000002},"min":{"1min":0.64200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.375,"5min":67.366,"15min":67.366},"last":0.54900000000000004},{"interface":"front","average":{"1min":1.0209999999999999,"5min":2.8820000000000001,"15min":2.0659999999999998},"min":{"1min":0.67100000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.462,"5min":65.522000000000006,"15min":65.522000000000006},"last":0.84199999999999997}]},{"osd":3,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":5.0529999999999999,"15min":3.1219999999999999},"min":{"1min":0.59799999999999998,"5min":0.40300000000000002,"15min":0.37},"max":{"1min":1.4350000000000001,"5min":169.30600000000001,"15min":169.30600000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.091,"5min":6.7750000000000004,"15min":4.1289999999999996},"min":{"1min":0.70199999999999996,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.736,"5min":169.33799999999999,"15min":169.33799999999999},"last":1.0049999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":2.4340000000000002,"15min":1.4059999999999999},"min":{"1min":0.34899999999999998,"5min":0.26100000000000001,"15min":0.223},"max":{"1min":1.6200000000000001,"5min":36.151000000000003,"15min":36.151000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.125,"5min":2.581,"15min":1.482},"min":{"1min":0.44900000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":1.6539999999999999,"5min":36.219000000000001,"15min":36.219000000000001},"last":0.89700000000000002}]},{"osd":6,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.7310000000000001,"15min":1.2170000000000001},"min":{"1min":0.39900000000000002,"5min":0.27300000000000002,"15min":0.25600000000000001},"max":{"1min":1.8500000000000001,"5min":25.734000000000002,"15min":25.734000000000002},"last":0.878},{"interface":"front","average":{"1min":1.236,"5min":1.5489999999999999,"15min":1.169},"min":{"1min":0.54600000000000004,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.6140000000000001,"5min":29.106999999999999,"15min":29.106999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.014,"15min":0.98199999999999998},"min":{"1min":0.497,"5min":0.314,"15min":0.314},"max":{"1min":1.6359999999999999,"5min":10.798,"15min":10.798},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.1559999999999999,"15min":1.0589999999999999},"min":{"1min":0.51900000000000002,"5min":0.314,"15min":0.29699999999999999},"max":{"1min":1.718,"5min":12.874000000000001,"15min":12.874000000000001},"last":0.97399999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542320,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2824368,"kb_used_data":1744104,"kb_used_omap":1,"kb_used_meta":1080254,"kb_avail":91547472,"statfs":{"total":96636764160,"available":93744611328,"internally_reserved":0,"allocated":1785962496,"data_stored":1785739665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1106180550},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":2.6800000000000002,"15min":1.6659999999999999},"min":{"1min":0.47099999999999997,"5min":0.28299999999999997,"15min":0.27100000000000002},"max":{"1min":1,"5min":18.741,"15min":18.741},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.86699999999999999,"5min":3.1909999999999998,"15min":1.964},"min":{"1min":0.316,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":4.2850000000000001,"5min":27.876999999999999,"15min":27.876999999999999},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":15.648999999999999,"15min":6.7729999999999997},"min":{"1min":0.47299999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0089999999999999,"5min":1296.6300000000001,"15min":1296.6300000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.75,"5min":3.3599999999999999,"15min":2.6190000000000002},"min":{"1min":0.45400000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.109,"5min":25.800999999999998,"15min":47.923999999999999},"last":0.85999999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":2.8319999999999999,"15min":1.8480000000000001},"min":{"1min":0.55300000000000005,"5min":0.309,"15min":0.29999999999999999},"max":{"1min":4.8799999999999999,"5min":23.760999999999999,"15min":23.760999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.94299999999999995,"5min":2.746,"15min":1.899},"min":{"1min":0.40000000000000002,"5min":0.34000000000000002,"15min":0.32500000000000001},"max":{"1min":3.2839999999999998,"5min":23.709,"15min":30.510000000000002},"last":0.755}]},{"osd":3,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":4.9370000000000003,"15min":2.9359999999999999},"min":{"1min":0.48099999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.6360000000000001,"5min":94.281000000000006,"15min":94.281000000000006},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.232,"5min":4.9859999999999998,"15min":3.2210000000000001},"min":{"1min":0.72699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.6699999999999999,"5min":94.319999999999993,"15min":94.319999999999993},"last":0.97599999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.5249999999999999,"15min":1.1599999999999999},"min":{"1min":0.86699999999999999,"5min":0.245,"15min":0.245},"max":{"1min":2.9249999999999998,"5min":18.623999999999999,"15min":18.623999999999999},"last":1.133},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.4630000000000001,"15min":1.1319999999999999},"min":{"1min":0.72099999999999997,"5min":0.246,"15min":0.246},"max":{"1min":4.2469999999999999,"5min":16.155999999999999,"15min":16.155999999999999},"last":0.91500000000000004}]},{"osd":6,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":2.2090000000000001,"15min":1.462},"min":{"1min":0.42999999999999999,"5min":0.27000000000000002,"15min":0.24099999999999999},"max":{"1min":1.226,"5min":27.984000000000002,"15min":27.984000000000002},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.052,"5min":2.1019999999999999,"15min":1.367},"min":{"1min":0.33700000000000002,"5min":0.247,"15min":0.23799999999999999},"max":{"1min":3.21,"5min":28.077000000000002,"15min":28.077000000000002},"last":1}]},{"osd":7,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.9830000000000001,"15min":1.375},"min":{"1min":0.38300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.948,"5min":25.266999999999999,"15min":25.266999999999999},"last":1.028},{"interface":"front","average":{"1min":1.1519999999999999,"5min":2.0800000000000001,"15min":1.4770000000000001},"min":{"1min":0.41399999999999998,"5min":0.34300000000000003,"15min":0.32600000000000001},"max":{"1min":2.0289999999999999,"5min":25.309999999999999,"15min":25.309999999999999},"last":1.0780000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542314,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3457596,"kb_used_data":1975284,"kb_used_omap":1,"kb_used_meta":1482302,"kb_avail":90914244,"statfs":{"total":96636764160,"available":93096185856,"internally_reserved":0,"allocated":2022690816,"data_stored":2022460117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1517877704},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:15:13 2024","interfaces":[{"interface":"back","average":{"1min":5.1440000000000001,"5min":10.525,"15min":6.4550000000000001},"min":{"1min":0.28999999999999998,"5min":0.28000000000000003,"15min":0.253},"max":{"1min":21.207000000000001,"5min":108.956,"15min":170.35599999999999},"last":2.6190000000000002},{"interface":"front","average":{"1min":3.6619999999999999,"5min":6.6130000000000004,"15min":4.5049999999999999},"min":{"1min":0.29999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":19.838999999999999,"5min":63.624000000000002,"15min":168.80699999999999},"last":2.6659999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:15:12 2024","interfaces":[{"interface":"back","average":{"1min":5.5529999999999999,"5min":10.266999999999999,"15min":4.6299999999999999},"min":{"1min":0.33400000000000002,"5min":0.32500000000000001,"15min":0.28499999999999998},"max":{"1min":24.631,"5min":92.722999999999999,"15min":92.722999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":7.992,"5min":12.541,"15min":6.2530000000000001},"min":{"1min":0.308,"5min":0.29899999999999999,"15min":0.26600000000000001},"max":{"1min":26.803999999999998,"5min":89.245000000000005,"15min":104.51300000000001},"last":0.94999999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:15:12 2024","interfaces":[{"interface":"back","average":{"1min":5.6040000000000001,"5min":7.1589999999999998,"15min":3.887},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34499999999999997},"max":{"1min":25.036000000000001,"5min":74.825000000000003,"15min":74.825000000000003},"last":1.675},{"interface":"front","average":{"1min":5.6719999999999997,"5min":7.6130000000000004,"15min":3.863},"min":{"1min":0.439,"5min":0.439,"15min":0.36499999999999999},"max":{"1min":25.062999999999999,"5min":74.870999999999995,"15min":74.870999999999995},"last":1.7050000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:15:12 2024","interfaces":[{"interface":"back","average":{"1min":7.335,"5min":6.2000000000000002,"15min":3.0510000000000002},"min":{"1min":0.44700000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":40.064999999999998,"5min":85.710999999999999,"15min":85.710999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":7.4740000000000002,"5min":8.1600000000000001,"15min":3.9399999999999999},"min":{"1min":0.68000000000000005,"5min":0.443,"15min":0.377},"max":{"1min":39.972000000000001,"5min":105.875,"15min":105.875},"last":1.601}]},{"osd":5,"last update":"Fri Sep 13 15:15:12 2024","interfaces":[{"interface":"back","average":{"1min":7.5570000000000004,"5min":6.4960000000000004,"15min":3.3500000000000001},"min":{"1min":0.66300000000000003,"5min":0.46700000000000003,"15min":0.40400000000000003},"max":{"1min":39.557000000000002,"5min":95.748999999999995,"15min":95.748999999999995},"last":1.6419999999999999},{"interface":"front","average":{"1min":4.1479999999999997,"5min":8.6259999999999994,"15min":4.3239999999999998},"min":{"1min":0.51900000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":36.648000000000003,"5min":100.325,"15min":100.325},"last":0.35599999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:15:12 2024","interfaces":[{"interface":"back","average":{"1min":3.7109999999999999,"5min":5.2140000000000004,"15min":2.742},"min":{"1min":0.59299999999999997,"5min":0.432,"15min":0.432},"max":{"1min":36.561999999999998,"5min":85.492999999999995,"15min":85.492999999999995},"last":0.433},{"interface":"front","average":{"1min":3.77,"5min":6.4459999999999997,"15min":3.2200000000000002},"min":{"1min":0.626,"5min":0.54300000000000004,"15min":0.501},"max":{"1min":36.604999999999997,"5min":100.376,"15min":100.376},"last":0.54100000000000004}]},{"osd":7,"last update":"Fri Sep 13 15:15:13 2024","interfaces":[{"interface":"back","average":{"1min":6.2169999999999996,"5min":6.0270000000000001,"15min":3.0830000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":43.624000000000002,"5min":97.268000000000001,"15min":97.268000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":4.7009999999999996,"5min":6.4909999999999997,"15min":3.5579999999999998},"min":{"1min":0.66200000000000003,"5min":0.50800000000000001,"15min":0.48599999999999999},"max":{"1min":36.68,"5min":100.583,"15min":100.583},"last":0.51000000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542321,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1595908,"kb_used_data":791676,"kb_used_omap":1,"kb_used_meta":804222,"kb_avail":92775932,"statfs":{"total":96636764160,"available":95002554368,"internally_reserved":0,"allocated":810676224,"data_stored":810442046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":823523782},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,2,3,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":7.1529999999999996,"15min":3.738},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.249},"max":{"1min":0.68899999999999995,"5min":170.77199999999999,"15min":170.77199999999999},"last":1.4870000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":11.09,"15min":5.3769999999999998},"min":{"1min":0.316,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78100000000000003,"5min":237.53800000000001,"15min":237.53800000000001},"last":1.1890000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":5.7750000000000004,"15min":3.7890000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28899999999999998},"max":{"1min":0.67400000000000004,"5min":109.104,"15min":109.104},"last":2.0990000000000002},{"interface":"front","average":{"1min":0.502,"5min":12.032,"15min":5.8540000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.30499999999999999},"max":{"1min":0.72499999999999998,"5min":295.73500000000001,"15min":295.73500000000001},"last":1.7949999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":5.1139999999999999,"15min":3.7080000000000002},"min":{"1min":0.35999999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73299999999999998,"5min":109.152,"15min":109.152},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":7.391,"15min":4.8259999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66600000000000004,"5min":264.87599999999998,"15min":264.87599999999998},"last":0.379}]},{"osd":4,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":6.5869999999999997,"15min":3.8879999999999999},"min":{"1min":0.56699999999999995,"5min":0.41599999999999998,"15min":0.38100000000000001},"max":{"1min":0.97499999999999998,"5min":251.97300000000001,"15min":251.97300000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":4.2599999999999998,"15min":2.5590000000000002},"min":{"1min":0.59199999999999997,"5min":0.42099999999999999,"15min":0.34899999999999998},"max":{"1min":1.081,"5min":42.012,"15min":42.012},"last":0.51600000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":3.3980000000000001,"15min":2.508},"min":{"1min":0.67100000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.163,"5min":41.942999999999998,"15min":41.942999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.878,"5min":6.3769999999999998,"15min":3.4990000000000001},"min":{"1min":0.71999999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.135,"5min":237.58799999999999,"15min":237.58799999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":3.419,"15min":2.4430000000000001},"min":{"1min":0.64300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.127,"5min":41.981999999999999,"15min":41.981999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":3.6709999999999998,"15min":2.556},"min":{"1min":0.66100000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.177,"5min":41.890999999999998,"15min":41.890999999999998},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":5.8559999999999999,"15min":3.403},"min":{"1min":0.627,"5min":0.44,"15min":0.44},"max":{"1min":0.98899999999999999,"5min":237.626,"15min":237.626},"last":1.155},{"interface":"front","average":{"1min":0.755,"5min":6.157,"15min":3.2559999999999998},"min":{"1min":0.52900000000000003,"5min":0.432,"15min":0.39200000000000002},"max":{"1min":1.0640000000000001,"5min":252.005,"15min":252.005},"last":0.45600000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542315,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3279756,"kb_used_data":1869188,"kb_used_omap":1,"kb_used_meta":1406462,"kb_avail":91092084,"statfs":{"total":96636764160,"available":93278294016,"internally_reserved":0,"allocated":1914048512,"data_stored":1913821952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1440217542},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,2,2,3,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":3.512,"5min":6.5830000000000002,"15min":4.0949999999999998},"min":{"1min":0.26400000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":17.056000000000001,"5min":104.246,"15min":104.246},"last":4.843},{"interface":"front","average":{"1min":2.6389999999999998,"5min":8.3230000000000004,"15min":4.0309999999999997},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.28599999999999998},"max":{"1min":10.380000000000001,"5min":103.157,"15min":103.157},"last":1.651}]},{"osd":2,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":5.3090000000000002,"5min":8.0289999999999999,"15min":5.0979999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.32200000000000001},"max":{"1min":25.789000000000001,"5min":113.79600000000001,"15min":191.00899999999999},"last":1.385},{"interface":"front","average":{"1min":2.23,"5min":6.1150000000000002,"15min":3.3319999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.318},"max":{"1min":10.678000000000001,"5min":47.537999999999997,"15min":47.537999999999997},"last":1.6930000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":5.2389999999999999,"5min":8.3290000000000006,"15min":3.9630000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.377},"max":{"1min":18.701000000000001,"5min":52.975000000000001,"15min":52.975000000000001},"last":3.1480000000000001},{"interface":"front","average":{"1min":3.3359999999999999,"5min":7.806,"15min":3.9159999999999999},"min":{"1min":0.50800000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":11.565,"5min":104.319,"15min":104.319},"last":3.831}]},{"osd":4,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":4.5019999999999998,"5min":7.1369999999999996,"15min":3.9420000000000002},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.38700000000000001},"max":{"1min":18.713000000000001,"5min":125.44799999999999,"15min":125.44799999999999},"last":1.738},{"interface":"front","average":{"1min":4.4630000000000001,"5min":9.0830000000000002,"15min":4.1500000000000004},"min":{"1min":0.53800000000000003,"5min":0.47399999999999998,"15min":0.38800000000000001},"max":{"1min":17.100000000000001,"5min":117.842,"15min":117.842},"last":1.7829999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":2.0870000000000002,"5min":7.9459999999999997,"15min":3.9449999999999998},"min":{"1min":0.53100000000000003,"5min":0.436,"15min":0.40000000000000002},"max":{"1min":10.519,"5min":154.875,"15min":154.875},"last":1.8029999999999999},{"interface":"front","average":{"1min":4.6150000000000002,"5min":7.3570000000000002,"15min":4.0620000000000003},"min":{"1min":0.65000000000000002,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":25.745000000000001,"5min":126.485,"15min":126.485},"last":1.3480000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":1.978,"5min":6.5679999999999996,"15min":3.6200000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":7.476,"5min":103.191,"15min":103.191},"last":1.825},{"interface":"front","average":{"1min":2.133,"5min":5.7320000000000002,"15min":3.1829999999999998},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.42399999999999999},"max":{"1min":10.598000000000001,"5min":104.28400000000001,"15min":104.28400000000001},"last":1.774}]},{"osd":7,"last update":"Fri Sep 13 15:15:10 2024","interfaces":[{"interface":"back","average":{"1min":4.7050000000000001,"5min":6.9290000000000003,"15min":3.5339999999999998},"min":{"1min":0.81599999999999995,"5min":0.53700000000000003,"15min":0.438},"max":{"1min":25.879000000000001,"5min":77.366,"15min":77.366},"last":1.419},{"interface":"front","average":{"1min":2.1589999999999998,"5min":7.8719999999999999,"15min":3.855},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":7.5119999999999996,"5min":112.69499999999999,"15min":112.69499999999999},"last":1.857}]}]},{"osd":0,"up_from":14,"seq":60129542319,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2352308,"kb_used_data":1425388,"kb_used_omap":1,"kb_used_meta":922814,"kb_avail":92019532,"statfs":{"total":96636764160,"available":94228000768,"internally_reserved":0,"allocated":1459597312,"data_stored":1459366050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":944961990},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:15:07 2024","interfaces":[{"interface":"back","average":{"1min":2.7480000000000002,"5min":7.5750000000000002,"15min":4.3109999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.22900000000000001},"max":{"1min":13.257999999999999,"5min":279.90600000000001,"15min":279.90600000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":3.0649999999999999,"5min":8.4199999999999999,"15min":6.2359999999999998},"min":{"1min":0.39700000000000002,"5min":0.35899999999999999,"15min":0.28100000000000003},"max":{"1min":9.952,"5min":279.70299999999997,"15min":510.15699999999998},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:15:07 2024","interfaces":[{"interface":"back","average":{"1min":2.948,"5min":7.1040000000000001,"15min":3.3170000000000002},"min":{"1min":0.31,"5min":0.29699999999999999,"15min":0.26000000000000001},"max":{"1min":11.173999999999999,"5min":101.73399999999999,"15min":101.73399999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":3.2879999999999998,"5min":5.1360000000000001,"15min":2.738},"min":{"1min":0.39400000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":9.8900000000000006,"5min":35.527999999999999,"15min":35.527999999999999},"last":0.40999999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:15:07 2024","interfaces":[{"interface":"back","average":{"1min":4.6529999999999996,"5min":8.7230000000000008,"15min":4.6470000000000002},"min":{"1min":0.371,"5min":0.371,"15min":0.28699999999999998},"max":{"1min":12.111000000000001,"5min":101.76300000000001,"15min":101.76300000000001},"last":0.439},{"interface":"front","average":{"1min":4.4770000000000003,"5min":7.7690000000000001,"15min":4.3810000000000002},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.38700000000000001},"max":{"1min":11.948,"5min":75.828000000000003,"15min":75.828000000000003},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Sep 13 15:15:13 2024","interfaces":[{"interface":"back","average":{"1min":6.1100000000000003,"5min":4.9359999999999999,"15min":2.722},"min":{"1min":0.58299999999999996,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":29.494,"5min":30.207999999999998,"15min":30.207999999999998},"last":0.66600000000000004},{"interface":"front","average":{"1min":4.4210000000000003,"5min":4.1189999999999998,"15min":2.5249999999999999},"min":{"1min":0.66000000000000003,"5min":0.40300000000000002,"15min":0.38500000000000001},"max":{"1min":27.282,"5min":30.135000000000002,"15min":30.135000000000002},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:15:13 2024","interfaces":[{"interface":"back","average":{"1min":5.2359999999999998,"5min":5.569,"15min":2.8580000000000001},"min":{"1min":0.46899999999999997,"5min":0.377,"15min":0.377},"max":{"1min":47.112000000000002,"5min":101.702,"15min":101.702},"last":0.81200000000000006},{"interface":"front","average":{"1min":5.8280000000000003,"5min":3.8690000000000002,"15min":2.2930000000000001},"min":{"1min":0.56000000000000005,"5min":0.434,"15min":0.379},"max":{"1min":43.249000000000002,"5min":43.249000000000002,"15min":43.249000000000002},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:15:07 2024","interfaces":[{"interface":"back","average":{"1min":6.1420000000000003,"5min":4.7770000000000001,"15min":2.6469999999999998},"min":{"1min":0.628,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":45.140000000000001,"5min":45.140000000000001,"15min":45.140000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":5.6829999999999998,"5min":4.9000000000000004,"15min":2.7429999999999999},"min":{"1min":0.52500000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":44.737000000000002,"5min":44.737000000000002,"15min":44.737000000000002},"last":0.77800000000000002}]},{"osd":7,"last update":"Fri Sep 13 15:15:07 2024","interfaces":[{"interface":"back","average":{"1min":5.5529999999999999,"5min":5.8419999999999996,"15min":2.9950000000000001},"min":{"1min":0.49299999999999999,"5min":0.42999999999999999,"15min":0.42499999999999999},"max":{"1min":49.326000000000001,"5min":101.655,"15min":101.655},"last":0.64500000000000002},{"interface":"front","average":{"1min":5.6719999999999997,"5min":4.4320000000000004,"15min":2.6110000000000002},"min":{"1min":0.56000000000000005,"5min":0.51500000000000001,"15min":0.434},"max":{"1min":46.649000000000001,"5min":46.649000000000001,"15min":46.649000000000001},"last":0.79100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25194496,"data_stored":25166698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25194496,"data_stored":25167848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4300800,"data_stored":4266534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25038848,"data_stored":25008061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41967616,"data_stored":41944697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21020672,"data_stored":20976412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29155328,"data_stored":29132361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":46174208,"data_stored":46139771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1422962688,"data_stored":1422962688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1762664448,"data_stored":1762664448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":761974784,"data_stored":761974784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1967931392,"data_stored":1967931392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1611513856,"data_stored":1611513856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1055879168,"data_stored":1055879168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1487400960,"data_stored":1487400960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1256882176,"data_stored":1256882176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:16:13.358 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:16:13.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.501+0000 7fe74b200640 1 Processor -- start 2024-09-13T15:16:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.501+0000 7fe74b200640 1 -- start start 2024-09-13T15:16:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.505+0000 7fe74b200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe7440b0bf0 0x7fe744150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.505+0000 7fe74b200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7440c5530 con 0x7fe74406ddb0 2024-09-13T15:16:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.505+0000 7fe74b200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7441583b0 con 0x7fe744071a70 2024-09-13T15:16:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.505+0000 7fe74b200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe744156f40 con 0x7fe7440b0bf0 2024-09-13T15:16:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.505+0000 7fe749200640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fe74406ddb0 0x7fe744161800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44746/0 (socket says 172.21.15.7:44746) 2024-09-13T15:16:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.505+0000 7fe749200640 1 -- 172.21.15.7:0/3119615913 learned_addr learned my addr 172.21.15.7:0/3119615913 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:16:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.505+0000 7fe73be00640 1 --2- 172.21.15.7:0/3119615913 >> v2:172.21.15.77:3300/0 conn(0x7fe7440b0bf0 0x7fe744150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:13.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.505+0000 7fe743400640 1 -- 172.21.15.7:0/3119615913 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085362321 0 0) 0x7fe7440c5530 con 0x7fe74406ddb0 2024-09-13T15:16:13.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.505+0000 7fe743400640 1 -- 172.21.15.7:0/3119615913 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe728003530 con 0x7fe74406ddb0 2024-09-13T15:16:13.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.505+0000 7fe743400640 1 -- 172.21.15.7:0/3119615913 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 522591901 0 0) 0x7fe728003530 con 0x7fe74406ddb0 2024-09-13T15:16:13.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.505+0000 7fe73be00640 1 -- 172.21.15.7:0/3119615913 >> v1:172.21.15.77:6789/0 conn(0x7fe744071a70 legacy=0x7fe7441576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:13.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.505+0000 7fe73be00640 1 -- 172.21.15.7:0/3119615913 >> v1:172.21.15.7:6789/0 conn(0x7fe74406ddb0 legacy=0x7fe744161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:13.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.505+0000 7fe73be00640 1 -- 172.21.15.7:0/3119615913 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7440b10c0 con 0x7fe7440b0bf0 2024-09-13T15:16:13.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.509+0000 7fe73be00640 1 --2- 172.21.15.7:0/3119615913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7440b0bf0 0x7fe744150cd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0097c0 tx=0x7fe72c01c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9db287dff125540d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:13.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.509+0000 7fe743400640 1 -- 172.21.15.7:0/3119615913 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c001a00 con 0x7fe7440b0bf0 2024-09-13T15:16:13.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.509+0000 7fe743400640 1 -- 172.21.15.7:0/3119615913 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c0ac440 con 0x7fe7440b0bf0 2024-09-13T15:16:13.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.509+0000 7fe743400640 1 -- 172.21.15.7:0/3119615913 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0ac7d0 con 0x7fe7440b0bf0 2024-09-13T15:16:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.509+0000 7fe74b200640 1 -- 172.21.15.7:0/3119615913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7440b0bf0 msgr2=0x7fe744150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.509+0000 7fe74b200640 1 --2- 172.21.15.7:0/3119615913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7440b0bf0 0x7fe744150cd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0097c0 tx=0x7fe72c01c390 comp rx=0 tx=0).stop 2024-09-13T15:16:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.509+0000 7fe74b200640 1 -- 172.21.15.7:0/3119615913 shutdown_connections 2024-09-13T15:16:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.509+0000 7fe74b200640 1 --2- 172.21.15.7:0/3119615913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe7440b0bf0 0x7fe744150cd0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.509+0000 7fe74b200640 1 -- 172.21.15.7:0/3119615913 >> 172.21.15.7:0/3119615913 conn(0x7fe744065d40 msgr2=0x7fe744066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:13.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.509+0000 7fe74b200640 1 -- 172.21.15.7:0/3119615913 shutdown_connections 2024-09-13T15:16:13.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.509+0000 7fe74b200640 1 -- 172.21.15.7:0/3119615913 wait complete. 2024-09-13T15:16:13.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.509+0000 7fe74b200640 1 Processor -- start 2024-09-13T15:16:13.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.509+0000 7fe74b200640 1 -- start start 2024-09-13T15:16:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe74b200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe74406ddb0 0x7fe744159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe74b200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe744071a70 0x7fe7440c2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe74b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7440b0bf0 0x7fe74413d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe74b200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440c80b0 con 0x7fe7440b0bf0 2024-09-13T15:16:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe74b200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7441f65d0 con 0x7fe744071a70 2024-09-13T15:16:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe74b200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440c4230 con 0x7fe74406ddb0 2024-09-13T15:16:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe749200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7440b0bf0 0x7fe74413d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe749200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7440b0bf0 0x7fe74413d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45892/0 (socket says 172.21.15.7:45892) 2024-09-13T15:16:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe749200640 1 -- 172.21.15.7:0/2195319216 learned_addr learned my addr 172.21.15.7:0/2195319216 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe743e00640 1 --2- 172.21.15.7:0/2195319216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe74406ddb0 0x7fe744159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:13.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe73be00640 1 --2- 172.21.15.7:0/2195319216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe744071a70 0x7fe7440c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe749200640 1 -- 172.21.15.7:0/2195319216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe74406ddb0 msgr2=0x7fe744159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe749200640 1 --2- 172.21.15.7:0/2195319216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe74406ddb0 0x7fe744159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe749200640 1 -- 172.21.15.7:0/2195319216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe744071a70 msgr2=0x7fe7440c2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe749200640 1 --2- 172.21.15.7:0/2195319216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe744071a70 0x7fe7440c2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe749200640 1 -- 172.21.15.7:0/2195319216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c009420 con 0x7fe7440b0bf0 2024-09-13T15:16:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe749200640 1 --2- 172.21.15.7:0/2195319216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7440b0bf0 0x7fe74413d6c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00cc90 tx=0x7fe73c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe740c00640 1 -- 172.21.15.7:0/2195319216 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c00cea0 con 0x7fe7440b0bf0 2024-09-13T15:16:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe740c00640 1 -- 172.21.15.7:0/2195319216 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c012400 con 0x7fe7440b0bf0 2024-09-13T15:16:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe74b200640 1 -- 172.21.15.7:0/2195319216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe744143010 con 0x7fe7440b0bf0 2024-09-13T15:16:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe740c00640 1 -- 172.21.15.7:0/2195319216 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c0127b0 con 0x7fe7440b0bf0 2024-09-13T15:16:13.514 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe74b200640 1 -- 172.21.15.7:0/2195319216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7441f5810 con 0x7fe7440b0bf0 2024-09-13T15:16:13.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe74b200640 1 -- 172.21.15.7:0/2195319216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe744067650 con 0x7fe7440b0bf0 2024-09-13T15:16:13.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.513+0000 7fe740c00640 1 -- 172.21.15.7:0/2195319216 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe73c007070 con 0x7fe7440b0bf0 2024-09-13T15:16:13.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.517+0000 7fe740c00640 1 --2- 172.21.15.7:0/2195319216 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe7200666e0 0x7fe720068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:13.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.517+0000 7fe740c00640 1 -- 172.21.15.7:0/2195319216 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7fe73c084920 con 0x7fe7440b0bf0 2024-09-13T15:16:13.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.517+0000 7fe743e00640 1 --2- 172.21.15.7:0/2195319216 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe7200666e0 0x7fe720068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:13.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.517+0000 7fe743e00640 1 --2- 172.21.15.7:0/2195319216 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe7200666e0 0x7fe720068ba0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe734000f70 tx=0x7fe734009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:13.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.521+0000 7fe740c00640 1 -- 172.21.15.7:0/2195319216 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe73c0516d0 con 0x7fe7440b0bf0 2024-09-13T15:16:13.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.685+0000 7fe74b200640 1 -- 172.21.15.7:0/2195319216 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7441515d0 con 0x7fe7440b0bf0 2024-09-13T15:16:13.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.685+0000 7fe740c00640 1 -- 172.21.15.7:0/2195319216 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+19389 (secure 0 0 0) 0x7fe73c017090 con 0x7fe7440b0bf0 2024-09-13T15:16:13.691 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:16:13.691 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":33,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:15:27.857916+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6836/2396967179":"2024-09-14T15:15:27.857855+0000","172.21.15.7:6834/2396967179":"2024-09-14T15:15:27.857855+0000","172.21.15.77:6839/2233000674":"2024-09-14T15:13:27.782565+0000","172.21.15.77:6837/2233000674":"2024-09-14T15:13:27.782565+0000","172.21.15.77:6835/2367107997":"2024-09-14T15:11:57.741130+0000","172.21.15.7:6837/3369648543":"2024-09-14T15:09:52.666380+0000","172.21.15.7:6835/3369648543":"2024-09-14T15:09:52.666380+0000","172.21.15.77:6838/3330080895":"2024-09-14T15:07:12.613134+0000","172.21.15.77:6836/3330080895":"2024-09-14T15:07:12.613134+0000","172.21.15.77:6834/2367107997":"2024-09-14T15:11:57.741130+0000","172.21.15.7:6833/2907495549":"2024-09-14T15:05:07.589499+0000","172.21.15.7:6832/2907495549":"2024-09-14T15:05:07.589499+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:16:13.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.701+0000 7fe74b200640 1 -- 172.21.15.7:0/2195319216 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe7200666e0 msgr2=0x7fe720068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:13.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.701+0000 7fe74b200640 1 --2- 172.21.15.7:0/2195319216 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe7200666e0 0x7fe720068ba0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe734000f70 tx=0x7fe734009040 comp rx=0 tx=0).stop 2024-09-13T15:16:13.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.701+0000 7fe74b200640 1 -- 172.21.15.7:0/2195319216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7440b0bf0 msgr2=0x7fe74413d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:13.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.701+0000 7fe74b200640 1 --2- 172.21.15.7:0/2195319216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7440b0bf0 0x7fe74413d6c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00cc90 tx=0x7fe73c00a430 comp rx=0 tx=0).stop 2024-09-13T15:16:13.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.701+0000 7fe74b200640 1 -- 172.21.15.7:0/2195319216 shutdown_connections 2024-09-13T15:16:13.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.701+0000 7fe74b200640 1 --2- 172.21.15.7:0/2195319216 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe7200666e0 0x7fe720068ba0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:13.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.701+0000 7fe74b200640 1 --2- 172.21.15.7:0/2195319216 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe7440b0bf0 0x7fe74413d6c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:13.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.701+0000 7fe74b200640 1 --2- 172.21.15.7:0/2195319216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe744071a70 0x7fe7440c2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:13.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.701+0000 7fe74b200640 1 --2- 172.21.15.7:0/2195319216 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe74406ddb0 0x7fe744159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:13.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.701+0000 7fe74b200640 1 -- 172.21.15.7:0/2195319216 >> 172.21.15.7:0/2195319216 conn(0x7fe744065d40 msgr2=0x7fe744068040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:13.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.705+0000 7fe74b200640 1 -- 172.21.15.7:0/2195319216 shutdown_connections 2024-09-13T15:16:13.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:13.705+0000 7fe74b200640 1 -- 172.21.15.7:0/2195319216 wait complete. 2024-09-13T15:16:14.749 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T15:16:14.750 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:16:14.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.001+0000 7fad11a00640 1 Processor -- start 2024-09-13T15:16:15.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.001+0000 7fad11a00640 1 -- start start 2024-09-13T15:16:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.005+0000 7fad11a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0c14f260 0x7fad0c0bfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.005+0000 7fad11a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0c155fe0 con 0x7fad0c0c6ab0 2024-09-13T15:16:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.005+0000 7fad11a00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0c155110 con 0x7fad0c14f640 2024-09-13T15:16:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.005+0000 7fad11a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c06f830 con 0x7fad0c14f260 2024-09-13T15:16:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.005+0000 7fad0b400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fad0c0c6ab0 0x7fad0c0c7450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44754/0 (socket says 172.21.15.7:44754) 2024-09-13T15:16:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.005+0000 7fad0b400640 1 -- 172.21.15.7:0/640232832 learned_addr learned my addr 172.21.15.7:0/640232832 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:16:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.005+0000 7fad0aa00640 1 --2- 172.21.15.7:0/640232832 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0c14f260 0x7fad0c0bfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.005+0000 7fad0aa00640 1 -- 172.21.15.7:0/640232832 >> v1:172.21.15.77:6789/0 conn(0x7fad0c14f640 legacy=0x7fad0c0cab60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:16:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.005+0000 7fad0aa00640 1 -- 172.21.15.7:0/640232832 >> v1:172.21.15.7:6789/0 conn(0x7fad0c0c6ab0 legacy=0x7fad0c0c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.005+0000 7fad0aa00640 1 -- 172.21.15.7:0/640232832 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c1553d0 con 0x7fad0c14f260 2024-09-13T15:16:15.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.009+0000 7fad0aa00640 1 --2- 172.21.15.7:0/640232832 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0c14f260 0x7fad0c0bfb30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7facfc009dc0 tx=0x7facfc01f160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe434bc66f3e51d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:15.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.013+0000 7fad0a000640 1 -- 172.21.15.7:0/640232832 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc0af600 con 0x7fad0c14f260 2024-09-13T15:16:15.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.013+0000 7fad0a000640 1 -- 172.21.15.7:0/640232832 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc0ab050 con 0x7fad0c14f260 2024-09-13T15:16:15.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.013+0000 7fad0a000640 1 -- 172.21.15.7:0/640232832 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc0af980 con 0x7fad0c14f260 2024-09-13T15:16:15.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.013+0000 7fad11a00640 1 -- 172.21.15.7:0/640232832 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0c14f260 msgr2=0x7fad0c0bfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:15.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.013+0000 7fad11a00640 1 --2- 172.21.15.7:0/640232832 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0c14f260 0x7fad0c0bfb30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7facfc009dc0 tx=0x7facfc01f160 comp rx=0 tx=0).stop 2024-09-13T15:16:15.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.017+0000 7fad11a00640 1 -- 172.21.15.7:0/640232832 shutdown_connections 2024-09-13T15:16:15.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.017+0000 7fad11a00640 1 --2- 172.21.15.7:0/640232832 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0c14f260 0x7fad0c0bfb30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:15.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.017+0000 7fad11a00640 1 -- 172.21.15.7:0/640232832 >> 172.21.15.7:0/640232832 conn(0x7fad0c065d40 msgr2=0x7fad0c066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:15.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.017+0000 7fad11a00640 1 -- 172.21.15.7:0/640232832 shutdown_connections 2024-09-13T15:16:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.021+0000 7fad11a00640 1 -- 172.21.15.7:0/640232832 wait complete. 2024-09-13T15:16:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.021+0000 7fad11a00640 1 Processor -- start 2024-09-13T15:16:15.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.025+0000 7fad11a00640 1 -- start start 2024-09-13T15:16:15.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.025+0000 7fad11a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad0c0c6ab0 0x7fad0c14e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:15.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.025+0000 7fad11a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c14f260 0x7fad0c1f1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:15.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad11a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0c14f640 0x7fad0c1f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:15.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad11a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c1dd910 con 0x7fad0c0c6ab0 2024-09-13T15:16:15.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad11a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c0ca140 con 0x7fad0c14f260 2024-09-13T15:16:15.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad11a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c1dba30 con 0x7fad0c14f640 2024-09-13T15:16:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad02000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c14f260 0x7fad0c1f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad02000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c14f260 0x7fad0c1f1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:38664/0 (socket says 172.21.15.7:38664) 2024-09-13T15:16:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad02000640 1 -- 172.21.15.7:0/3848264794 learned_addr learned my addr 172.21.15.7:0/3848264794 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad0b400640 1 --2- 172.21.15.7:0/3848264794 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0c14f640 0x7fad0c1f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad0aa00640 1 --2- 172.21.15.7:0/3848264794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad0c0c6ab0 0x7fad0c14e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad02000640 1 -- 172.21.15.7:0/3848264794 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0c14f640 msgr2=0x7fad0c1f1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad02000640 1 --2- 172.21.15.7:0/3848264794 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fad0c14f640 0x7fad0c1f1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad02000640 1 -- 172.21.15.7:0/3848264794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad0c0c6ab0 msgr2=0x7fad0c14e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad02000640 1 --2- 172.21.15.7:0/3848264794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad0c0c6ab0 0x7fad0c14e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad02000640 1 -- 172.21.15.7:0/3848264794 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc009a70 con 0x7fad0c14f260 2024-09-13T15:16:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad0aa00640 1 --2- 172.21.15.7:0/3848264794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad0c0c6ab0 0x7fad0c14e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:16:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad02000640 1 --2- 172.21.15.7:0/3848264794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c14f260 0x7fad0c1f1050 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7facf400b3e0 tx=0x7facf400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad03400640 1 -- 172.21.15.7:0/3848264794 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4033640 con 0x7fad0c14f260 2024-09-13T15:16:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad11a00640 1 -- 172.21.15.7:0/3848264794 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0c14ed80 con 0x7fad0c14f260 2024-09-13T15:16:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad03400640 1 -- 172.21.15.7:0/3848264794 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf40337a0 con 0x7fad0c14f260 2024-09-13T15:16:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad03400640 1 -- 172.21.15.7:0/3848264794 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf4033b70 con 0x7fad0c14f260 2024-09-13T15:16:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.029+0000 7fad11a00640 1 -- 172.21.15.7:0/3848264794 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0c0ca370 con 0x7fad0c14f260 2024-09-13T15:16:15.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.033+0000 7fad03400640 1 -- 172.21.15.7:0/3848264794 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7facf4033cd0 con 0x7fad0c14f260 2024-09-13T15:16:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.037+0000 7fad03400640 1 --2- 172.21.15.7:0/3848264794 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7face8066690 0x7face8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.037+0000 7fad03400640 1 -- 172.21.15.7:0/3848264794 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7facf40a6690 con 0x7fad0c14f260 2024-09-13T15:16:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.037+0000 7fad0aa00640 1 --2- 172.21.15.7:0/3848264794 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7face8066690 0x7face8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:15.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.037+0000 7fad0aa00640 1 --2- 172.21.15.7:0/3848264794 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7face8066690 0x7face8068b50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7facfc0b1000 tx=0x7facfc0aa000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.869+0000 7fad11a00640 1 --2- 172.21.15.7:0/3848264794 >> [v2:172.21.15.7:6800/834888081,v1:172.21.15.7:6801/834888081] conn(0x7fad0c0ca680 0x7fad0c0703d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.869+0000 7fad11a00640 1 -- 172.21.15.7:0/3848264794 --> [v2:172.21.15.7:6800/834888081,v1:172.21.15.7:6801/834888081] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad0c155990 con 0x7fad0c0ca680 2024-09-13T15:16:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.869+0000 7fad0b400640 1 --2- 172.21.15.7:0/3848264794 >> [v2:172.21.15.7:6800/834888081,v1:172.21.15.7:6801/834888081] conn(0x7fad0c0ca680 0x7fad0c0703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:15.873+0000 7fad0b400640 1 --2- 172.21.15.7:0/3848264794 >> [v2:172.21.15.7:6800/834888081,v1:172.21.15.7:6801/834888081] conn(0x7fad0c0ca680 0x7fad0c0703d0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.041+0000 7fad03400640 1 -- 172.21.15.7:0/3848264794 <== osd.0 v2:172.21.15.7:6800/834888081 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fad04001490 con 0x7fad0c0ca680 2024-09-13T15:16:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.053+0000 7fad11a00640 1 -- 172.21.15.7:0/3848264794 --> [v2:172.21.15.7:6800/834888081,v1:172.21.15.7:6801/834888081] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fad0c0c6610 con 0x7fad0c0ca680 2024-09-13T15:16:16.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.053+0000 7fad03400640 1 -- 172.21.15.7:0/3848264794 <== osd.0 v2:172.21.15.7:6800/834888081 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fad04001920 con 0x7fad0c0ca680 2024-09-13T15:16:16.052 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T15:16:16.053 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:16:16.053 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T15:16:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.053+0000 7fad11a00640 1 -- 172.21.15.7:0/3848264794 >> [v2:172.21.15.7:6800/834888081,v1:172.21.15.7:6801/834888081] conn(0x7fad0c0ca680 msgr2=0x7fad0c0703d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.053+0000 7fad11a00640 1 --2- 172.21.15.7:0/3848264794 >> [v2:172.21.15.7:6800/834888081,v1:172.21.15.7:6801/834888081] conn(0x7fad0c0ca680 0x7fad0c0703d0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.053+0000 7fad11a00640 1 -- 172.21.15.7:0/3848264794 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7face8066690 msgr2=0x7face8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.053+0000 7fad11a00640 1 --2- 172.21.15.7:0/3848264794 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7face8066690 0x7face8068b50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7facfc0b1000 tx=0x7facfc0aa000 comp rx=0 tx=0).stop 2024-09-13T15:16:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.053+0000 7fad11a00640 1 -- 172.21.15.7:0/3848264794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c14f260 msgr2=0x7fad0c1f1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.053+0000 7fad11a00640 1 --2- 172.21.15.7:0/3848264794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c14f260 0x7fad0c1f1050 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7facf400b3e0 tx=0x7facf400b8a0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.053+0000 7fad0b400640 1 -- 172.21.15.7:0/3848264794 reap_dead start 2024-09-13T15:16:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.053+0000 7fad11a00640 1 -- 172.21.15.7:0/3848264794 shutdown_connections 2024-09-13T15:16:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.053+0000 7fad11a00640 1 -- 172.21.15.7:0/3848264794 >> 172.21.15.7:0/3848264794 conn(0x7fad0c065d40 msgr2=0x7fad0c152f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.053+0000 7fad11a00640 1 -- 172.21.15.7:0/3848264794 shutdown_connections 2024-09-13T15:16:16.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.053+0000 7fad11a00640 1 -- 172.21.15.7:0/3848264794 wait complete. 2024-09-13T15:16:16.072 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T15:16:16.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.281+0000 7f2b90a00640 1 Processor -- start 2024-09-13T15:16:16.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.281+0000 7f2b90a00640 1 -- start start 2024-09-13T15:16:16.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.285+0000 7f2b90a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2b8c0c37a0 0x7f2b8c157020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:16.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.285+0000 7f2b90a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8c06ac90 con 0x7f2b8c0c7510 2024-09-13T15:16:16.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.285+0000 7f2b90a00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b8c160a80 con 0x7f2b8c0c78f0 2024-09-13T15:16:16.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.285+0000 7f2b90a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b8c160d40 con 0x7f2b8c0c37a0 2024-09-13T15:16:16.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.285+0000 7f2b89e00640 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2b8c0c78f0 0x7f2b8c15d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.7:33080/0 (socket says 172.21.15.7:33080) 2024-09-13T15:16:16.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.285+0000 7f2b89e00640 1 -- 172.21.15.7:0/2237370848 learned_addr learned my addr 172.21.15.7:0/2237370848 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:16:16.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.285+0000 7f2b8b200640 1 --2- 172.21.15.7:0/2237370848 >> v2:172.21.15.7:3300/0 conn(0x7f2b8c0c37a0 0x7f2b8c157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:16.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.285+0000 7f2b89400640 1 -- 172.21.15.7:0/2237370848 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049784563 0 0) 0x7f2b8c160a80 con 0x7f2b8c0c78f0 2024-09-13T15:16:16.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.289+0000 7f2b89400640 1 -- 172.21.15.7:0/2237370848 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b70003530 con 0x7f2b8c0c78f0 2024-09-13T15:16:16.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.289+0000 7f2b8b200640 1 -- 172.21.15.7:0/2237370848 >> v1:172.21.15.77:6789/0 conn(0x7f2b8c0c78f0 legacy=0x7f2b8c15d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.289+0000 7f2b8b200640 1 -- 172.21.15.7:0/2237370848 >> v1:172.21.15.7:6789/0 conn(0x7f2b8c0c7510 legacy=0x7f2b8c06f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.289+0000 7f2b8b200640 1 -- 172.21.15.7:0/2237370848 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c161020 con 0x7f2b8c0c37a0 2024-09-13T15:16:16.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.293+0000 7f2b8b200640 1 --2- 172.21.15.7:0/2237370848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c0c37a0 0x7f2b8c157020 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009d90 tx=0x7f2b8401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b9cda633f3c501 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:16.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.297+0000 7f2b89400640 1 -- 172.21.15.7:0/2237370848 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b840a5a30 con 0x7f2b8c0c37a0 2024-09-13T15:16:16.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.297+0000 7f2b89400640 1 -- 172.21.15.7:0/2237370848 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b840a5b90 con 0x7f2b8c0c37a0 2024-09-13T15:16:16.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.297+0000 7f2b89400640 1 -- 172.21.15.7:0/2237370848 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b840ad440 con 0x7f2b8c0c37a0 2024-09-13T15:16:16.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.297+0000 7f2b90a00640 1 -- 172.21.15.7:0/2237370848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c0c37a0 msgr2=0x7f2b8c157020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.297+0000 7f2b90a00640 1 --2- 172.21.15.7:0/2237370848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c0c37a0 0x7f2b8c157020 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009d90 tx=0x7f2b8401c970 comp rx=0 tx=0).stop 2024-09-13T15:16:16.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.297+0000 7f2b90a00640 1 -- 172.21.15.7:0/2237370848 shutdown_connections 2024-09-13T15:16:16.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.297+0000 7f2b90a00640 1 --2- 172.21.15.7:0/2237370848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c0c37a0 0x7f2b8c157020 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.297+0000 7f2b90a00640 1 -- 172.21.15.7:0/2237370848 >> 172.21.15.7:0/2237370848 conn(0x7f2b8c0739a0 msgr2=0x7f2b8c065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:16.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.297+0000 7f2b90a00640 1 -- 172.21.15.7:0/2237370848 shutdown_connections 2024-09-13T15:16:16.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.297+0000 7f2b90a00640 1 -- 172.21.15.7:0/2237370848 wait complete. 2024-09-13T15:16:16.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.301+0000 7f2b90a00640 1 Processor -- start 2024-09-13T15:16:16.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.301+0000 7f2b90a00640 1 -- start start 2024-09-13T15:16:16.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.301+0000 7f2b90a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b8c0c37a0 0x7f2b8c1469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:16.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.301+0000 7f2b90a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b8c0c7510 0x7f2b8c0cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:16.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.301+0000 7f2b90a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c0c78f0 0x7f2b8c1474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:16.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.301+0000 7f2b90a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c14de30 con 0x7f2b8c0c78f0 2024-09-13T15:16:16.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.301+0000 7f2b90a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c147130 con 0x7f2b8c0c7510 2024-09-13T15:16:16.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.301+0000 7f2b90a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8c0ccbf0 con 0x7f2b8c0c37a0 2024-09-13T15:16:16.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.305+0000 7f2b8b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c0c78f0 0x7f2b8c1474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:16.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.305+0000 7f2b89e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b8c0c7510 0x7f2b8c0cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:16.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.305+0000 7f2b8b200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c0c78f0 0x7f2b8c1474e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45900/0 (socket says 172.21.15.7:45900) 2024-09-13T15:16:16.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.305+0000 7f2b8b200640 1 -- 172.21.15.7:0/2541713249 learned_addr learned my addr 172.21.15.7:0/2541713249 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:16.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.305+0000 7f2b8b200640 1 -- 172.21.15.7:0/2541713249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b8c0c37a0 msgr2=0x7f2b8c1469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.305+0000 7f2b8b200640 1 --2- 172.21.15.7:0/2541713249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b8c0c37a0 0x7f2b8c1469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.305+0000 7f2b8b200640 1 -- 172.21.15.7:0/2541713249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b8c0c7510 msgr2=0x7f2b8c0cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.305+0000 7f2b8b200640 1 --2- 172.21.15.7:0/2541713249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b8c0c7510 0x7f2b8c0cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.305+0000 7f2b8b200640 1 -- 172.21.15.7:0/2541713249 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b84009a70 con 0x7f2b8c0c78f0 2024-09-13T15:16:16.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.305+0000 7f2b89e00640 1 --2- 172.21.15.7:0/2541713249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b8c0c7510 0x7f2b8c0cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T15:16:16.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.305+0000 7f2b8b200640 1 --2- 172.21.15.7:0/2541713249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c0c78f0 0x7f2b8c1474e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009d90 tx=0x7f2b84019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:16.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.305+0000 7f2b82a00640 1 -- 172.21.15.7:0/2541713249 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b840aec60 con 0x7f2b8c0c78f0 2024-09-13T15:16:16.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.305+0000 7f2b82a00640 1 -- 172.21.15.7:0/2541713249 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b840aedc0 con 0x7f2b8c0c78f0 2024-09-13T15:16:16.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.305+0000 7f2b82a00640 1 -- 172.21.15.7:0/2541713249 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b840aec60 con 0x7f2b8c0c78f0 2024-09-13T15:16:16.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.309+0000 7f2b90a00640 1 -- 172.21.15.7:0/2541713249 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b8c14cca0 con 0x7f2b8c0c78f0 2024-09-13T15:16:16.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.309+0000 7f2b90a00640 1 -- 172.21.15.7:0/2541713249 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b8c14d220 con 0x7f2b8c0c78f0 2024-09-13T15:16:16.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.313+0000 7f2b82a00640 1 -- 172.21.15.7:0/2541713249 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2b840b4050 con 0x7f2b8c0c78f0 2024-09-13T15:16:16.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.313+0000 7f2b90a00640 1 -- 172.21.15.7:0/2541713249 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8c04e220 con 0x7f2b8c0c78f0 2024-09-13T15:16:16.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.313+0000 7f2b82a00640 1 --2- 172.21.15.7:0/2541713249 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b6c066720 0x7f2b6c068be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:16.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.313+0000 7f2b82a00640 1 -- 172.21.15.7:0/2541713249 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f2b8411f1e0 con 0x7f2b8c0c78f0 2024-09-13T15:16:16.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.317+0000 7f2b8a800640 1 --2- 172.21.15.7:0/2541713249 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b6c066720 0x7f2b6c068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:16.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.317+0000 7f2b8a800640 1 --2- 172.21.15.7:0/2541713249 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b6c066720 0x7f2b6c068be0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c000f70 tx=0x7f2b7c0079c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:16.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.325+0000 7f2b82a00640 1 -- 172.21.15.7:0/2541713249 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2b840ebf80 con 0x7f2b8c0c78f0 2024-09-13T15:16:16.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.637+0000 7f2b90a00640 1 -- 172.21.15.7:0/2541713249 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b8c16b530 con 0x7f2b6c066720 2024-09-13T15:16:16.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.637+0000 7f2b82a00640 1 -- 172.21.15.7:0/2541713249 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2b7c005080 con 0x7f2b6c066720 2024-09-13T15:16:16.638 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T15:16:16.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.641+0000 7f2b90a00640 1 -- 172.21.15.7:0/2541713249 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b6c066720 msgr2=0x7f2b6c068be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.641+0000 7f2b90a00640 1 --2- 172.21.15.7:0/2541713249 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b6c066720 0x7f2b6c068be0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c000f70 tx=0x7f2b7c0079c0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.641+0000 7f2b90a00640 1 -- 172.21.15.7:0/2541713249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c0c78f0 msgr2=0x7f2b8c1474e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.641+0000 7f2b90a00640 1 --2- 172.21.15.7:0/2541713249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c0c78f0 0x7f2b8c1474e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009d90 tx=0x7f2b84019710 comp rx=0 tx=0).stop 2024-09-13T15:16:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.641+0000 7f2b90a00640 1 -- 172.21.15.7:0/2541713249 shutdown_connections 2024-09-13T15:16:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.641+0000 7f2b90a00640 1 --2- 172.21.15.7:0/2541713249 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b6c066720 0x7f2b6c068be0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.641+0000 7f2b90a00640 1 --2- 172.21.15.7:0/2541713249 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b8c0c78f0 0x7f2b8c1474e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.641+0000 7f2b90a00640 1 --2- 172.21.15.7:0/2541713249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2b8c0c7510 0x7f2b8c0cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.641+0000 7f2b90a00640 1 --2- 172.21.15.7:0/2541713249 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2b8c0c37a0 0x7f2b8c1469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.641+0000 7f2b90a00640 1 -- 172.21.15.7:0/2541713249 >> 172.21.15.7:0/2541713249 conn(0x7f2b8c0739a0 msgr2=0x7f2b8c14b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.645+0000 7f2b90a00640 1 -- 172.21.15.7:0/2541713249 shutdown_connections 2024-09-13T15:16:16.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.645+0000 7f2b90a00640 1 -- 172.21.15.7:0/2541713249 wait complete. 2024-09-13T15:16:16.682 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T15:16:16.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:16:16.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.829+0000 7f9824c00640 1 Processor -- start 2024-09-13T15:16:16.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.829+0000 7f9824c00640 1 -- start start 2024-09-13T15:16:16.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.829+0000 7f9824c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f982006f5f0 0x7f98200c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:16.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.829+0000 7f9824c00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98200c7d40 con 0x7f982015c780 2024-09-13T15:16:16.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.829+0000 7f9824c00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9820159190 con 0x7f982006f9d0 2024-09-13T15:16:16.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.829+0000 7f9824c00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982015cce0 con 0x7f982006f5f0 2024-09-13T15:16:16.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.829+0000 7f981e800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f982015c780 0x7f9820152fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44774/0 (socket says 172.21.15.7:44774) 2024-09-13T15:16:16.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.829+0000 7f981e800640 1 -- 172.21.15.7:0/2461772984 learned_addr learned my addr 172.21.15.7:0/2461772984 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:16:16.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.829+0000 7f981de00640 1 --2- 172.21.15.7:0/2461772984 >> v2:172.21.15.77:3300/0 conn(0x7f982006f5f0 0x7f98200c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:16.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.829+0000 7f981ca00640 1 -- 172.21.15.7:0/2461772984 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3875512115 0 0) 0x7f98200c7d40 con 0x7f982015c780 2024-09-13T15:16:16.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.829+0000 7f981ca00640 1 -- 172.21.15.7:0/2461772984 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9804003530 con 0x7f982015c780 2024-09-13T15:16:16.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981ca00640 1 -- 172.21.15.7:0/2461772984 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 327283621 0 0) 0x7f9804003530 con 0x7f982015c780 2024-09-13T15:16:16.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981ca00640 1 -- 172.21.15.7:0/2461772984 >> v2:172.21.15.77:3300/0 conn(0x7f982006f5f0 msgr2=0x7f98200c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:16.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981ca00640 1 --2- 172.21.15.7:0/2461772984 >> v2:172.21.15.77:3300/0 conn(0x7f982006f5f0 0x7f98200c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981ca00640 1 -- 172.21.15.7:0/2461772984 >> v1:172.21.15.77:6789/0 conn(0x7f982006f9d0 legacy=0x7f9820159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981ca00640 1 -- 172.21.15.7:0/2461772984 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982015cfc0 con 0x7f982015c780 2024-09-13T15:16:16.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981ca00640 1 -- 172.21.15.7:0/2461772984 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f9818001a00 con 0x7f982015c780 2024-09-13T15:16:16.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981ca00640 1 -- 172.21.15.7:0/2461772984 >> v1:172.21.15.7:6789/0 conn(0x7f982015c780 legacy=0x7f9820152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981ca00640 1 --2- 172.21.15.7:0/2461772984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9804003980 0x7f9804003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:16.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981ca00640 1 --2- 172.21.15.7:0/2461772984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98040047d0 0x7f9804004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:16.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981ca00640 1 --2- 172.21.15.7:0/2461772984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9804005190 0x7f980400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:16.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981ca00640 1 -- 172.21.15.7:0/2461772984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982015cce0 con 0x7f9804005190 2024-09-13T15:16:16.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981ca00640 1 -- 172.21.15.7:0/2461772984 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980400c030 con 0x7f98040047d0 2024-09-13T15:16:16.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981ca00640 1 -- 172.21.15.7:0/2461772984 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980400c1f0 con 0x7f9804003980 2024-09-13T15:16:16.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981e800640 1 --2- 172.21.15.7:0/2461772984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9804005190 0x7f980400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:16.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981de00640 1 --2- 172.21.15.7:0/2461772984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9804003980 0x7f9804003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:16.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981d400640 1 --2- 172.21.15.7:0/2461772984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98040047d0 0x7f9804004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:16.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981e800640 1 -- 172.21.15.7:0/2461772984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9804003980 msgr2=0x7f9804003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:16.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981e800640 1 --2- 172.21.15.7:0/2461772984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9804003980 0x7f9804003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981e800640 1 -- 172.21.15.7:0/2461772984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98040047d0 msgr2=0x7f9804004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:16.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981e800640 1 --2- 172.21.15.7:0/2461772984 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98040047d0 0x7f9804004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981e800640 1 -- 172.21.15.7:0/2461772984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9804003530 con 0x7f9804005190 2024-09-13T15:16:16.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981de00640 1 --2- 172.21.15.7:0/2461772984 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9804003980 0x7f9804003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:16:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981e800640 1 -- 172.21.15.7:0/2461772984 reap_dead start 2024-09-13T15:16:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.833+0000 7f981e800640 1 --2- 172.21.15.7:0/2461772984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9804005190 0x7f980400b990 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f981800a830 tx=0x7f981801d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d9c4686876a910 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f981ca00640 1 -- 172.21.15.7:0/2461772984 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98180072d0 con 0x7f9804005190 2024-09-13T15:16:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f981ca00640 1 -- 172.21.15.7:0/2461772984 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98180a8070 con 0x7f9804005190 2024-09-13T15:16:16.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f981ca00640 1 -- 172.21.15.7:0/2461772984 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98180076b0 con 0x7f9804005190 2024-09-13T15:16:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f9824c00640 1 -- 172.21.15.7:0/2461772984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9804005190 msgr2=0x7f980400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f9824c00640 1 --2- 172.21.15.7:0/2461772984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9804005190 0x7f980400b990 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f981800a830 tx=0x7f981801d360 comp rx=0 tx=0).stop 2024-09-13T15:16:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f9824c00640 1 -- 172.21.15.7:0/2461772984 shutdown_connections 2024-09-13T15:16:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f9824c00640 1 --2- 172.21.15.7:0/2461772984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9804005190 0x7f980400b990 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f9824c00640 1 -- 172.21.15.7:0/2461772984 >> 172.21.15.7:0/2461772984 conn(0x7f982006cf60 msgr2=0x7f98200717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:16.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f9824c00640 1 -- 172.21.15.7:0/2461772984 shutdown_connections 2024-09-13T15:16:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f9824c00640 1 -- 172.21.15.7:0/2461772984 wait complete. 2024-09-13T15:16:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f9824c00640 1 Processor -- start 2024-09-13T15:16:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f9824c00640 1 -- start start 2024-09-13T15:16:16.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f9824c00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9804005190 0x7f98201f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f9824c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98200c4e20 0x7f98201efbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f9824c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98200cd3c0 0x7f9820152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f9824c00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98200c4a00 con 0x7f98200c4e20 2024-09-13T15:16:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f9824c00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9820157600 con 0x7f98200cd3c0 2024-09-13T15:16:16.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f9824c00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98201f2c20 con 0x7f9804005190 2024-09-13T15:16:16.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f981d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98200c4e20 0x7f98201efbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:16.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f981d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98200c4e20 0x7f98201efbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45926/0 (socket says 172.21.15.7:45926) 2024-09-13T15:16:16.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f981d400640 1 -- 172.21.15.7:0/2652438098 learned_addr learned my addr 172.21.15.7:0/2652438098 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:16.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f981e800640 1 --2- 172.21.15.7:0/2652438098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98200cd3c0 0x7f9820152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:16.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.837+0000 7f981de00640 1 --2- 172.21.15.7:0/2652438098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9804005190 0x7f98201f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:16.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f981d400640 1 -- 172.21.15.7:0/2652438098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9804005190 msgr2=0x7f98201f26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f981d400640 1 --2- 172.21.15.7:0/2652438098 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9804005190 0x7f98201f26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f981d400640 1 -- 172.21.15.7:0/2652438098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98200cd3c0 msgr2=0x7f9820152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f981d400640 1 --2- 172.21.15.7:0/2652438098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98200cd3c0 0x7f9820152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f981d400640 1 -- 172.21.15.7:0/2652438098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98201f0110 con 0x7f98200c4e20 2024-09-13T15:16:16.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f981e800640 1 --2- 172.21.15.7:0/2652438098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f98200cd3c0 0x7f9820152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:16:16.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f981d400640 1 --2- 172.21.15.7:0/2652438098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98200c4e20 0x7f98201efbd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f980c00f510 tx=0x7f980c00f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:16.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f9816000640 1 -- 172.21.15.7:0/2652438098 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c0052e0 con 0x7f98200c4e20 2024-09-13T15:16:16.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f9816000640 1 -- 172.21.15.7:0/2652438098 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c005440 con 0x7f98200c4e20 2024-09-13T15:16:16.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f9816000640 1 -- 172.21.15.7:0/2652438098 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c003800 con 0x7f98200c4e20 2024-09-13T15:16:16.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f9824c00640 1 -- 172.21.15.7:0/2652438098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9820157320 con 0x7f98200c4e20 2024-09-13T15:16:16.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f9824c00640 1 -- 172.21.15.7:0/2652438098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98200c4340 con 0x7f98200c4e20 2024-09-13T15:16:16.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f9824c00640 1 -- 172.21.15.7:0/2652438098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f982015d580 con 0x7f98200c4e20 2024-09-13T15:16:16.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f9816000640 1 -- 172.21.15.7:0/2652438098 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f980c003960 con 0x7f98200c4e20 2024-09-13T15:16:16.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f9816000640 1 --2- 172.21.15.7:0/2652438098 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9800066690 0x7f9800068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:16.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f9816000640 1 -- 172.21.15.7:0/2652438098 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f980c084610 con 0x7f98200c4e20 2024-09-13T15:16:16.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f9816000640 1 --2- 172.21.15.7:0/2652438098 >> [v2:172.21.15.7:6808/436262321,v1:172.21.15.7:6809/436262321] conn(0x7f98000703a0 0x7f9800072840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:16.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f9816000640 1 -- 172.21.15.7:0/2652438098 --> [v2:172.21.15.7:6808/436262321,v1:172.21.15.7:6809/436262321] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9800072f10 con 0x7f98000703a0 2024-09-13T15:16:16.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f9816000640 1 -- 172.21.15.7:0/2652438098 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f980c086bf0 con 0x7f98200c4e20 2024-09-13T15:16:16.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.841+0000 7f981de00640 1 --2- 172.21.15.7:0/2652438098 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9800066690 0x7f9800068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:16.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.845+0000 7f981e800640 1 --2- 172.21.15.7:0/2652438098 >> [v2:172.21.15.7:6808/436262321,v1:172.21.15.7:6809/436262321] conn(0x7f98000703a0 0x7f9800072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:16.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.845+0000 7f981e800640 1 --2- 172.21.15.7:0/2652438098 >> [v2:172.21.15.7:6808/436262321,v1:172.21.15.7:6809/436262321] conn(0x7f98000703a0 0x7f9800072840 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:16.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.845+0000 7f981de00640 1 --2- 172.21.15.7:0/2652438098 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9800066690 0x7f9800068b50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f98100099b0 tx=0x7f9810008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:16.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.845+0000 7f9816000640 1 -- 172.21.15.7:0/2652438098 <== osd.1 v2:172.21.15.7:6808/436262321 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9800072f10 con 0x7f98000703a0 2024-09-13T15:16:16.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.857+0000 7f9824c00640 1 -- 172.21.15.7:0/2652438098 --> [v2:172.21.15.7:6808/436262321,v1:172.21.15.7:6809/436262321] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f982015ce20 con 0x7f98000703a0 2024-09-13T15:16:16.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.857+0000 7f9816000640 1 -- 172.21.15.7:0/2652438098 <== osd.1 v2:172.21.15.7:6808/436262321 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9818004b70 con 0x7f98000703a0 2024-09-13T15:16:16.858 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T15:16:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:16:16.858 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T15:16:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.857+0000 7f9824c00640 1 -- 172.21.15.7:0/2652438098 >> [v2:172.21.15.7:6808/436262321,v1:172.21.15.7:6809/436262321] conn(0x7f98000703a0 msgr2=0x7f9800072840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.857+0000 7f9824c00640 1 --2- 172.21.15.7:0/2652438098 >> [v2:172.21.15.7:6808/436262321,v1:172.21.15.7:6809/436262321] conn(0x7f98000703a0 0x7f9800072840 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.857+0000 7f9824c00640 1 -- 172.21.15.7:0/2652438098 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9800066690 msgr2=0x7f9800068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.857+0000 7f9824c00640 1 --2- 172.21.15.7:0/2652438098 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9800066690 0x7f9800068b50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f98100099b0 tx=0x7f9810008040 comp rx=0 tx=0).stop 2024-09-13T15:16:16.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.857+0000 7f9824c00640 1 -- 172.21.15.7:0/2652438098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98200c4e20 msgr2=0x7f98201efbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:16.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.857+0000 7f9824c00640 1 --2- 172.21.15.7:0/2652438098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98200c4e20 0x7f98201efbd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f980c00f510 tx=0x7f980c00f9d0 comp rx=0 tx=0).stop 2024-09-13T15:16:16.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.857+0000 7f981e800640 1 -- 172.21.15.7:0/2652438098 reap_dead start 2024-09-13T15:16:16.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.857+0000 7f9824c00640 1 -- 172.21.15.7:0/2652438098 shutdown_connections 2024-09-13T15:16:16.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.857+0000 7f9824c00640 1 -- 172.21.15.7:0/2652438098 >> 172.21.15.7:0/2652438098 conn(0x7f982006cf60 msgr2=0x7f9820151710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:16.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.857+0000 7f9824c00640 1 -- 172.21.15.7:0/2652438098 shutdown_connections 2024-09-13T15:16:16.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:16.857+0000 7f9824c00640 1 -- 172.21.15.7:0/2652438098 wait complete. 2024-09-13T15:16:16.878 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T15:16:17.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.101+0000 7f335ea00640 1 Processor -- start 2024-09-13T15:16:17.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.105+0000 7f335ea00640 1 -- start start 2024-09-13T15:16:17.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.105+0000 7f335ea00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3358151590 0x7f3358157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:17.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.105+0000 7f335ea00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f33580c6130 0x7f33580717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:17.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.105+0000 7f335ea00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3358151970 con 0x7f33580c7ea0 2024-09-13T15:16:17.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.105+0000 7f335ea00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f335815b030 con 0x7f33580c6130 2024-09-13T15:16:17.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.105+0000 7f335ea00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f335815b310 con 0x7f3358151590 2024-09-13T15:16:17.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.109+0000 7f3357e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3358151590 0x7f3358157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:17.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.109+0000 7f3357e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3358151590 0x7f3358157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.7:38726/0 (socket says 172.21.15.7:38726) 2024-09-13T15:16:17.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.109+0000 7f3357e00640 1 -- 172.21.15.7:0/3589981399 learned_addr learned my addr 172.21.15.7:0/3589981399 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:17.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.109+0000 7f335ca00640 1 --2- 172.21.15.7:0/3589981399 >> v2:172.21.15.7:3300/0 conn(0x7f33580c6130 0x7f33580717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:17.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.109+0000 7f3357e00640 1 -- 172.21.15.7:0/3589981399 >> v2:172.21.15.7:3300/0 conn(0x7f33580c6130 msgr2=0x7f33580717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:17.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.109+0000 7f3357e00640 1 --2- 172.21.15.7:0/3589981399 >> v2:172.21.15.7:3300/0 conn(0x7f33580c6130 0x7f33580717a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.109+0000 7f3357e00640 1 -- 172.21.15.7:0/3589981399 >> v1:172.21.15.7:6789/0 conn(0x7f33580c7ea0 legacy=0x7f335815a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:17.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.109+0000 7f3357e00640 1 -- 172.21.15.7:0/3589981399 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3358157340 con 0x7f3358151590 2024-09-13T15:16:17.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.117+0000 7f3357e00640 1 --2- 172.21.15.7:0/3589981399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3358151590 0x7f3358157e20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f335806c150 tx=0x7f334801c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87429511ab8961d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:17.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.117+0000 7f3356a00640 1 -- 172.21.15.7:0/3589981399 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33480ac420 con 0x7f3358151590 2024-09-13T15:16:17.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.121+0000 7f3356a00640 1 -- 172.21.15.7:0/3589981399 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33480ac580 con 0x7f3358151590 2024-09-13T15:16:17.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.121+0000 7f3356a00640 1 -- 172.21.15.7:0/3589981399 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33480ac910 con 0x7f3358151590 2024-09-13T15:16:17.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.121+0000 7f335ea00640 1 -- 172.21.15.7:0/3589981399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3358151590 msgr2=0x7f3358157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:17.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.121+0000 7f335ea00640 1 --2- 172.21.15.7:0/3589981399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3358151590 0x7f3358157e20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f335806c150 tx=0x7f334801c4d0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.125+0000 7f335ea00640 1 -- 172.21.15.7:0/3589981399 shutdown_connections 2024-09-13T15:16:17.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.125+0000 7f335ea00640 1 --2- 172.21.15.7:0/3589981399 >> v2:172.21.15.7:3300/0 conn(0x7f33580c6130 0x7f33580717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.125+0000 7f335ea00640 1 --2- 172.21.15.7:0/3589981399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3358151590 0x7f3358157e20 secure :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f335806c150 tx=0x7f334801c4d0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.125+0000 7f335ea00640 1 -- 172.21.15.7:0/3589981399 >> 172.21.15.7:0/3589981399 conn(0x7f33580c7380 msgr2=0x7f33580c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:17.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.125+0000 7f335ea00640 1 -- 172.21.15.7:0/3589981399 shutdown_connections 2024-09-13T15:16:17.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.125+0000 7f335ea00640 1 -- 172.21.15.7:0/3589981399 wait complete. 2024-09-13T15:16:17.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.125+0000 7f335ea00640 1 Processor -- start 2024-09-13T15:16:17.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.129+0000 7f335ea00640 1 -- start start 2024-09-13T15:16:17.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.129+0000 7f335ea00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33580c6130 0x7f335815b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:17.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.129+0000 7f3357e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33580c6130 0x7f335815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:17.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.129+0000 7f3357e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33580c6130 0x7f335815b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45940/0 (socket says 172.21.15.7:45940) 2024-09-13T15:16:17.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.133+0000 7f3357e00640 1 -- 172.21.15.7:0/856320207 learned_addr learned my addr 172.21.15.7:0/856320207 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:17.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.133+0000 7f335ea00640 1 --2- 172.21.15.7:0/856320207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33580c7ea0 0x7f335815a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:17.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.133+0000 7f335ea00640 1 --2- 172.21.15.7:0/856320207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33580c9a70 0x7f33581532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:17.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.133+0000 7f3357400640 1 --2- 172.21.15.7:0/856320207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33580c7ea0 0x7f335815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:17.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.133+0000 7f335ea00640 1 -- 172.21.15.7:0/856320207 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335815c2b0 con 0x7f33580c6130 2024-09-13T15:16:17.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.133+0000 7f335ca00640 1 --2- 172.21.15.7:0/856320207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33580c9a70 0x7f33581532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:17.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.133+0000 7f335ea00640 1 -- 172.21.15.7:0/856320207 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3358165ca0 con 0x7f33580c7ea0 2024-09-13T15:16:17.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.133+0000 7f335ea00640 1 -- 172.21.15.7:0/856320207 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3358151cd0 con 0x7f33580c9a70 2024-09-13T15:16:17.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.137+0000 7f335ca00640 1 -- 172.21.15.7:0/856320207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33580c7ea0 msgr2=0x7f335815a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:17.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.137+0000 7f335ca00640 1 --2- 172.21.15.7:0/856320207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33580c7ea0 0x7f335815a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.137+0000 7f335ca00640 1 -- 172.21.15.7:0/856320207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33580c6130 msgr2=0x7f335815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:17.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.137+0000 7f335ca00640 1 --2- 172.21.15.7:0/856320207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33580c6130 0x7f335815b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.137+0000 7f335ca00640 1 -- 172.21.15.7:0/856320207 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33480094d0 con 0x7f33580c9a70 2024-09-13T15:16:17.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.141+0000 7f335ca00640 1 --2- 172.21.15.7:0/856320207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33580c9a70 0x7f33581532e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f335000ebd0 tx=0x7f335000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:17.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.141+0000 7f334fe00640 1 -- 172.21.15.7:0/856320207 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335000cd20 con 0x7f33580c9a70 2024-09-13T15:16:17.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.141+0000 7f334fe00640 1 -- 172.21.15.7:0/856320207 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335000f040 con 0x7f33580c9a70 2024-09-13T15:16:17.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.141+0000 7f334fe00640 1 -- 172.21.15.7:0/856320207 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33500146c0 con 0x7f33580c9a70 2024-09-13T15:16:17.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.141+0000 7f335ea00640 1 -- 172.21.15.7:0/856320207 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3358151fb0 con 0x7f33580c9a70 2024-09-13T15:16:17.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.141+0000 7f335ea00640 1 -- 172.21.15.7:0/856320207 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3358152570 con 0x7f33580c9a70 2024-09-13T15:16:17.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.141+0000 7f335ea00640 1 -- 172.21.15.7:0/856320207 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3330005260 con 0x7f33580c9a70 2024-09-13T15:16:17.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.145+0000 7f334fe00640 1 -- 172.21.15.7:0/856320207 <== mon.2 v2:172.21.15.77:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3350014820 con 0x7f33580c9a70 2024-09-13T15:16:17.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.145+0000 7f334fe00640 1 --2- 172.21.15.7:0/856320207 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3338066760 0x7f3338068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:17.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.145+0000 7f334fe00640 1 -- 172.21.15.7:0/856320207 <== mon.2 v2:172.21.15.77:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f3350085610 con 0x7f33580c9a70 2024-09-13T15:16:17.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.153+0000 7f3357e00640 1 --2- 172.21.15.7:0/856320207 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3338066760 0x7f3338068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:17.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.153+0000 7f3357e00640 1 --2- 172.21.15.7:0/856320207 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3338066760 0x7f3338068c20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f334801c510 tx=0x7f3348008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:17.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.153+0000 7f334fe00640 1 -- 172.21.15.7:0/856320207 <== mon.2 v2:172.21.15.77:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3350052430 con 0x7f33580c9a70 2024-09-13T15:16:17.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.481+0000 7f335ea00640 1 -- 172.21.15.7:0/856320207 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3330000bd0 con 0x7f3338066760 2024-09-13T15:16:17.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.485+0000 7f334fe00640 1 -- 172.21.15.7:0/856320207 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3330000bd0 con 0x7f3338066760 2024-09-13T15:16:17.485 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T15:16:17.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.489+0000 7f335ea00640 1 -- 172.21.15.7:0/856320207 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3338066760 msgr2=0x7f3338068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:17.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.489+0000 7f335ea00640 1 --2- 172.21.15.7:0/856320207 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3338066760 0x7f3338068c20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f334801c510 tx=0x7f3348008040 comp rx=0 tx=0).stop 2024-09-13T15:16:17.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.489+0000 7f335ea00640 1 -- 172.21.15.7:0/856320207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33580c9a70 msgr2=0x7f33581532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:17.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.489+0000 7f335ea00640 1 --2- 172.21.15.7:0/856320207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33580c9a70 0x7f33581532e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f335000ebd0 tx=0x7f335000c490 comp rx=0 tx=0).stop 2024-09-13T15:16:17.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.489+0000 7f335ea00640 1 -- 172.21.15.7:0/856320207 shutdown_connections 2024-09-13T15:16:17.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.489+0000 7f335ea00640 1 --2- 172.21.15.7:0/856320207 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f3338066760 0x7f3338068c20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.489+0000 7f335ea00640 1 --2- 172.21.15.7:0/856320207 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f33580c9a70 0x7f33581532e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.489+0000 7f335ea00640 1 --2- 172.21.15.7:0/856320207 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33580c7ea0 0x7f335815a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.489+0000 7f335ea00640 1 --2- 172.21.15.7:0/856320207 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f33580c6130 0x7f335815b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.489+0000 7f335ea00640 1 -- 172.21.15.7:0/856320207 >> 172.21.15.7:0/856320207 conn(0x7f33580c7380 msgr2=0x7f335806d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:17.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.489+0000 7f335ea00640 1 -- 172.21.15.7:0/856320207 shutdown_connections 2024-09-13T15:16:17.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.489+0000 7f335ea00640 1 -- 172.21.15.7:0/856320207 wait complete. 2024-09-13T15:16:17.558 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T15:16:17.558 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:16:17.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.789+0000 7f2483200640 1 Processor -- start 2024-09-13T15:16:17.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2483200640 1 -- start start 2024-09-13T15:16:17.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2483200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2484150ea0 0x7f2484156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:17.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2483200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2484157220 0x7f2484071680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:17.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2483200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f24840c4ab0 0x7f2484071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:17.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2483200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24840c3d10 con 0x7f24840c4ab0 2024-09-13T15:16:17.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2483200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24840c2500 con 0x7f2484157220 2024-09-13T15:16:17.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2483200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24840c57c0 con 0x7f2484150ea0 2024-09-13T15:16:17.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2482800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f24840c4ab0 0x7f2484071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:17.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2479400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2484157220 0x7f2484071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:17.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2482800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f24840c4ab0 0x7f2484071bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45952/0 (socket says 172.21.15.7:45952) 2024-09-13T15:16:17.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2482800640 1 -- 172.21.15.7:0/515122694 learned_addr learned my addr 172.21.15.7:0/515122694 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:17.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2481e00640 1 --2- 172.21.15.7:0/515122694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2484150ea0 0x7f2484156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:17.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2482800640 1 -- 172.21.15.7:0/515122694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2484150ea0 msgr2=0x7f2484156ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:17.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2482800640 1 --2- 172.21.15.7:0/515122694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2484150ea0 0x7f2484156ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2482800640 1 -- 172.21.15.7:0/515122694 >> v2:172.21.15.77:3300/0 conn(0x7f2484157220 msgr2=0x7f2484071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:17.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2482800640 1 --2- 172.21.15.7:0/515122694 >> v2:172.21.15.77:3300/0 conn(0x7f2484157220 0x7f2484071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2482800640 1 -- 172.21.15.7:0/515122694 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24840c5d60 con 0x7f24840c4ab0 2024-09-13T15:16:17.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.793+0000 7f2481e00640 1 --2- 172.21.15.7:0/515122694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2484150ea0 0x7f2484156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:16:17.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.797+0000 7f2482800640 1 --2- 172.21.15.7:0/515122694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24840c4ab0 0x7f2484071bc0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2484074240 tx=0x7f247c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5e193ab01cea31 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:17.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.797+0000 7f2481400640 1 -- 172.21.15.7:0/515122694 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c0aa610 con 0x7f24840c4ab0 2024-09-13T15:16:17.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.797+0000 7f2481400640 1 -- 172.21.15.7:0/515122694 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247c0a6040 con 0x7f24840c4ab0 2024-09-13T15:16:17.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.797+0000 7f2481400640 1 -- 172.21.15.7:0/515122694 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c0aa990 con 0x7f24840c4ab0 2024-09-13T15:16:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.797+0000 7f2483200640 1 -- 172.21.15.7:0/515122694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24840c4ab0 msgr2=0x7f2484071bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.797+0000 7f2483200640 1 --2- 172.21.15.7:0/515122694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24840c4ab0 0x7f2484071bc0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f2484074240 tx=0x7f247c01c4f0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.797+0000 7f2483200640 1 -- 172.21.15.7:0/515122694 shutdown_connections 2024-09-13T15:16:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.797+0000 7f2483200640 1 --2- 172.21.15.7:0/515122694 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f24840c4ab0 0x7f2484071bc0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.797+0000 7f2483200640 1 --2- 172.21.15.7:0/515122694 >> v2:172.21.15.77:3300/0 conn(0x7f2484157220 0x7f2484071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.797+0000 7f2483200640 1 --2- 172.21.15.7:0/515122694 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2484150ea0 0x7f2484156ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.797+0000 7f2483200640 1 -- 172.21.15.7:0/515122694 >> 172.21.15.7:0/515122694 conn(0x7f24840c7380 msgr2=0x7f24840c7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.797+0000 7f2483200640 1 -- 172.21.15.7:0/515122694 shutdown_connections 2024-09-13T15:16:17.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.797+0000 7f2483200640 1 -- 172.21.15.7:0/515122694 wait complete. 2024-09-13T15:16:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.797+0000 7f2483200640 1 Processor -- start 2024-09-13T15:16:17.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.797+0000 7f2483200640 1 -- start start 2024-09-13T15:16:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2483200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24840c4ab0 0x7f248414cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2483200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2484150ea0 0x7f248414baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2483200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2484157220 0x7f24841585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2483200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2484159fb0 con 0x7f2484157220 2024-09-13T15:16:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2483200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24840ca400 con 0x7f2484150ea0 2024-09-13T15:16:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2483200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248414c620 con 0x7f24840c4ab0 2024-09-13T15:16:17.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2482800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2484157220 0x7f24841585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2482800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2484157220 0x7f24841585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45956/0 (socket says 172.21.15.7:45956) 2024-09-13T15:16:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2482800640 1 -- 172.21.15.7:0/326316325 learned_addr learned my addr 172.21.15.7:0/326316325 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2481e00640 1 --2- 172.21.15.7:0/326316325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24840c4ab0 0x7f248414cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2479400640 1 --2- 172.21.15.7:0/326316325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2484150ea0 0x7f248414baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2482800640 1 -- 172.21.15.7:0/326316325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24840c4ab0 msgr2=0x7f248414cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2482800640 1 --2- 172.21.15.7:0/326316325 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f24840c4ab0 0x7f248414cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2482800640 1 -- 172.21.15.7:0/326316325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2484150ea0 msgr2=0x7f248414baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2482800640 1 --2- 172.21.15.7:0/326316325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2484150ea0 0x7f248414baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2482800640 1 -- 172.21.15.7:0/326316325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c0094d0 con 0x7f2484157220 2024-09-13T15:16:17.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2482800640 1 --2- 172.21.15.7:0/326316325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2484157220 0x7f24841585b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f247c0ac040 tx=0x7f247c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:17.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f247aa00640 1 -- 172.21.15.7:0/326316325 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c0bd5f0 con 0x7f2484157220 2024-09-13T15:16:17.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f247aa00640 1 -- 172.21.15.7:0/326316325 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247c0bd770 con 0x7f2484157220 2024-09-13T15:16:17.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f247aa00640 1 -- 172.21.15.7:0/326316325 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c0bdb20 con 0x7f2484157220 2024-09-13T15:16:17.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2483200640 1 -- 172.21.15.7:0/326316325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24840c95a0 con 0x7f2484157220 2024-09-13T15:16:17.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2483200640 1 -- 172.21.15.7:0/326316325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24840c9b60 con 0x7f2484157220 2024-09-13T15:16:17.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f2483200640 1 -- 172.21.15.7:0/326316325 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24840c2970 con 0x7f2484157220 2024-09-13T15:16:17.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.801+0000 7f247aa00640 1 -- 172.21.15.7:0/326316325 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f247c0b33f0 con 0x7f2484157220 2024-09-13T15:16:17.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.805+0000 7f247aa00640 1 --2- 172.21.15.7:0/326316325 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2460066690 0x7f2460068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:17.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.805+0000 7f247aa00640 1 -- 172.21.15.7:0/326316325 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f247c11ec40 con 0x7f2484157220 2024-09-13T15:16:17.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.805+0000 7f247aa00640 1 --2- 172.21.15.7:0/326316325 >> [v2:172.21.15.7:6816/1539771714,v1:172.21.15.7:6817/1539771714] conn(0x7f24600703a0 0x7f2460072840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:17.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.805+0000 7f247aa00640 1 -- 172.21.15.7:0/326316325 --> [v2:172.21.15.7:6816/1539771714,v1:172.21.15.7:6817/1539771714] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2460072f10 con 0x7f24600703a0 2024-09-13T15:16:17.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.805+0000 7f247aa00640 1 -- 172.21.15.7:0/326316325 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f247c123240 con 0x7f2484157220 2024-09-13T15:16:17.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.805+0000 7f2481e00640 1 --2- 172.21.15.7:0/326316325 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2460066690 0x7f2460068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:17.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.805+0000 7f2479400640 1 --2- 172.21.15.7:0/326316325 >> [v2:172.21.15.7:6816/1539771714,v1:172.21.15.7:6817/1539771714] conn(0x7f24600703a0 0x7f2460072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:17.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.805+0000 7f2481e00640 1 --2- 172.21.15.7:0/326316325 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2460066690 0x7f2460068b50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f24740098d0 tx=0x7f2474008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:17.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.805+0000 7f2479400640 1 --2- 172.21.15.7:0/326316325 >> [v2:172.21.15.7:6816/1539771714,v1:172.21.15.7:6817/1539771714] conn(0x7f24600703a0 0x7f2460072840 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:17.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.805+0000 7f247aa00640 1 -- 172.21.15.7:0/326316325 <== osd.2 v2:172.21.15.7:6816/1539771714 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2460072f10 con 0x7f24600703a0 2024-09-13T15:16:17.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.817+0000 7f2483200640 1 -- 172.21.15.7:0/326316325 --> [v2:172.21.15.7:6816/1539771714,v1:172.21.15.7:6817/1539771714] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f24840c19f0 con 0x7f24600703a0 2024-09-13T15:16:17.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.817+0000 7f247aa00640 1 -- 172.21.15.7:0/326316325 <== osd.2 v2:172.21.15.7:6816/1539771714 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f246c00f040 con 0x7f24600703a0 2024-09-13T15:16:17.819 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T15:16:17.819 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:16:17.819 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T15:16:17.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.821+0000 7f2483200640 1 -- 172.21.15.7:0/326316325 >> [v2:172.21.15.7:6816/1539771714,v1:172.21.15.7:6817/1539771714] conn(0x7f24600703a0 msgr2=0x7f2460072840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:17.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.821+0000 7f2483200640 1 --2- 172.21.15.7:0/326316325 >> [v2:172.21.15.7:6816/1539771714,v1:172.21.15.7:6817/1539771714] conn(0x7f24600703a0 0x7f2460072840 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:17.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.821+0000 7f2483200640 1 -- 172.21.15.7:0/326316325 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2460066690 msgr2=0x7f2460068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:17.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.821+0000 7f2483200640 1 --2- 172.21.15.7:0/326316325 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2460066690 0x7f2460068b50 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f24740098d0 tx=0x7f2474008040 comp rx=0 tx=0).stop 2024-09-13T15:16:17.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.821+0000 7f2483200640 1 -- 172.21.15.7:0/326316325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2484157220 msgr2=0x7f24841585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:17.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.821+0000 7f2483200640 1 --2- 172.21.15.7:0/326316325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2484157220 0x7f24841585b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f247c0ac040 tx=0x7f247c01ad30 comp rx=0 tx=0).stop 2024-09-13T15:16:17.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.821+0000 7f2482800640 1 -- 172.21.15.7:0/326316325 reap_dead start 2024-09-13T15:16:17.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.821+0000 7f2483200640 1 -- 172.21.15.7:0/326316325 shutdown_connections 2024-09-13T15:16:17.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.821+0000 7f2483200640 1 -- 172.21.15.7:0/326316325 >> 172.21.15.7:0/326316325 conn(0x7f24840c7380 msgr2=0x7f2484155db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:17.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.821+0000 7f2483200640 1 -- 172.21.15.7:0/326316325 shutdown_connections 2024-09-13T15:16:17.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:17.821+0000 7f2483200640 1 -- 172.21.15.7:0/326316325 wait complete. 2024-09-13T15:16:17.839 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T15:16:18.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.085+0000 7f4a03000640 1 Processor -- start 2024-09-13T15:16:18.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.085+0000 7f4a03000640 1 -- start start 2024-09-13T15:16:18.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f4a03000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49fc06dc20 0x7f49fc0c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f4a03000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49fc06d080 con 0x7f49fc1576f0 2024-09-13T15:16:18.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f4a03000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49fc0c5b90 con 0x7f49fc06f6b0 2024-09-13T15:16:18.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f4a03000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc15e560 con 0x7f49fc06dc20 2024-09-13T15:16:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f49fbe00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f49fc1576f0 0x7f49fc06d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44794/0 (socket says 172.21.15.7:44794) 2024-09-13T15:16:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f49fbe00640 1 -- 172.21.15.7:0/3077202492 learned_addr learned my addr 172.21.15.7:0/3077202492 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:16:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f49faa00640 1 -- 172.21.15.7:0/3077202492 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227772026 0 0) 0x7f49fc06d080 con 0x7f49fc1576f0 2024-09-13T15:16:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f49faa00640 1 -- 172.21.15.7:0/3077202492 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49e0003530 con 0x7f49fc1576f0 2024-09-13T15:16:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f49faa00640 1 -- 172.21.15.7:0/3077202492 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2330287994 0 0) 0x7f49e0003530 con 0x7f49fc1576f0 2024-09-13T15:16:18.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f49faa00640 1 -- 172.21.15.7:0/3077202492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49fc06dc20 msgr2=0x7f49fc0c6e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:16:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f49faa00640 1 --2- 172.21.15.7:0/3077202492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49fc06dc20 0x7f49fc0c6e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f49faa00640 1 -- 172.21.15.7:0/3077202492 >> v1:172.21.15.77:6789/0 conn(0x7f49fc06f6b0 legacy=0x7f49fc15d700 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:16:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f49faa00640 1 -- 172.21.15.7:0/3077202492 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc0c5e50 con 0x7f49fc1576f0 2024-09-13T15:16:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f49faa00640 1 -- 172.21.15.7:0/3077202492 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f49ec001680 con 0x7f49fc1576f0 2024-09-13T15:16:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f49faa00640 1 -- 172.21.15.7:0/3077202492 >> v1:172.21.15.7:6789/0 conn(0x7f49fc1576f0 legacy=0x7f49fc06d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f49faa00640 1 --2- 172.21.15.7:0/3077202492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49e00039b0 0x7f49e0003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f49faa00640 1 --2- 172.21.15.7:0/3077202492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49e00047d0 0x7f49e0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f49faa00640 1 --2- 172.21.15.7:0/3077202492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49e00051e0 0x7f49e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f49faa00640 1 -- 172.21.15.7:0/3077202492 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc15e560 con 0x7f49e00051e0 2024-09-13T15:16:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f49faa00640 1 -- 172.21.15.7:0/3077202492 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e000c0f0 con 0x7f49e00039b0 2024-09-13T15:16:18.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.089+0000 7f49faa00640 1 -- 172.21.15.7:0/3077202492 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e000c2b0 con 0x7f49e00047d0 2024-09-13T15:16:18.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.093+0000 7f49fb400640 1 --2- 172.21.15.7:0/3077202492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49e00047d0 0x7f49e0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.093+0000 7f49fb400640 1 -- 172.21.15.7:0/3077202492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49e00039b0 msgr2=0x7f49e0003db0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:16:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.093+0000 7f49fb400640 1 --2- 172.21.15.7:0/3077202492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49e00039b0 0x7f49e0003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.093+0000 7f49fb400640 1 -- 172.21.15.7:0/3077202492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49e00051e0 msgr2=0x7f49e000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.093+0000 7f49fb400640 1 --2- 172.21.15.7:0/3077202492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49e00051e0 0x7f49e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.093+0000 7f49fb400640 1 -- 172.21.15.7:0/3077202492 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e0003530 con 0x7f49e00047d0 2024-09-13T15:16:18.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.105+0000 7f49fb400640 1 --2- 172.21.15.7:0/3077202492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49e00047d0 0x7f49e0004c50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f49fc06fbb0 tx=0x7f49f401cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcdcd00c564dfc27 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:18.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.109+0000 7f49faa00640 1 -- 172.21.15.7:0/3077202492 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f40a5d60 con 0x7f49e00047d0 2024-09-13T15:16:18.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.109+0000 7f49faa00640 1 -- 172.21.15.7:0/3077202492 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f40ad440 con 0x7f49e00047d0 2024-09-13T15:16:18.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.109+0000 7f49faa00640 1 -- 172.21.15.7:0/3077202492 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f40ad870 con 0x7f49e00047d0 2024-09-13T15:16:18.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.109+0000 7f4a03000640 1 -- 172.21.15.7:0/3077202492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49e00047d0 msgr2=0x7f49e0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:18.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.109+0000 7f4a03000640 1 --2- 172.21.15.7:0/3077202492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49e00047d0 0x7f49e0004c50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f49fc06fbb0 tx=0x7f49f401cd50 comp rx=0 tx=0).stop 2024-09-13T15:16:18.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.109+0000 7f4a01000640 1 -- 172.21.15.7:0/3077202492 reap_dead start 2024-09-13T15:16:18.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.109+0000 7f4a03000640 1 -- 172.21.15.7:0/3077202492 shutdown_connections 2024-09-13T15:16:18.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.109+0000 7f4a03000640 1 -- 172.21.15.7:0/3077202492 >> 172.21.15.7:0/3077202492 conn(0x7f49fc0c7380 msgr2=0x7f49fc0c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:18.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.109+0000 7f4a03000640 1 -- 172.21.15.7:0/3077202492 shutdown_connections 2024-09-13T15:16:18.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.109+0000 7f4a03000640 1 -- 172.21.15.7:0/3077202492 wait complete. 2024-09-13T15:16:18.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.113+0000 7f4a03000640 1 Processor -- start 2024-09-13T15:16:18.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.117+0000 7f4a03000640 1 -- start start 2024-09-13T15:16:18.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.117+0000 7f4a03000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49e00047d0 0x7f49fc15b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.117+0000 7f49fbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49e00047d0 0x7f49fc15b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.117+0000 7f49fbe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49e00047d0 0x7f49fc15b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45984/0 (socket says 172.21.15.7:45984) 2024-09-13T15:16:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.117+0000 7f49fbe00640 1 -- 172.21.15.7:0/2491517393 learned_addr learned my addr 172.21.15.7:0/2491517393 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.121+0000 7f4a03000640 1 --2- 172.21.15.7:0/2491517393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49fc158380 0x7f49fc159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.121+0000 7f4a03000640 1 --2- 172.21.15.7:0/2491517393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49fc070840 0x7f49fc141320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.121+0000 7f4a03000640 1 -- 172.21.15.7:0/2491517393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc0bf2d0 con 0x7f49e00047d0 2024-09-13T15:16:18.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.121+0000 7f4a03000640 1 -- 172.21.15.7:0/2491517393 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc158960 con 0x7f49fc158380 2024-09-13T15:16:18.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.121+0000 7f4a03000640 1 -- 172.21.15.7:0/2491517393 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49fc0be8a0 con 0x7f49fc070840 2024-09-13T15:16:18.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.121+0000 7f49fbe00640 1 -- 172.21.15.7:0/2491517393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49fc070840 msgr2=0x7f49fc141320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:18.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.121+0000 7f49fbe00640 1 --2- 172.21.15.7:0/2491517393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49fc070840 0x7f49fc141320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.121+0000 7f49fbe00640 1 -- 172.21.15.7:0/2491517393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49fc158380 msgr2=0x7f49fc159d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T15:16:18.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.121+0000 7f49fbe00640 1 --2- 172.21.15.7:0/2491517393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49fc158380 0x7f49fc159d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.121+0000 7f49fbe00640 1 -- 172.21.15.7:0/2491517393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc0be5a0 con 0x7f49e00047d0 2024-09-13T15:16:18.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.121+0000 7f49fbe00640 1 --2- 172.21.15.7:0/2491517393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49e00047d0 0x7f49fc15b130 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f49ec00c770 tx=0x7f49ec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:18.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.121+0000 7f49f3e00640 1 -- 172.21.15.7:0/2491517393 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec0074e0 con 0x7f49e00047d0 2024-09-13T15:16:18.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.121+0000 7f49f3e00640 1 -- 172.21.15.7:0/2491517393 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ec007640 con 0x7f49e00047d0 2024-09-13T15:16:18.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.121+0000 7f49f3e00640 1 -- 172.21.15.7:0/2491517393 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49ec0049f0 con 0x7f49e00047d0 2024-09-13T15:16:18.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.125+0000 7f4a03000640 1 -- 172.21.15.7:0/2491517393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49fc1420f0 con 0x7f49e00047d0 2024-09-13T15:16:18.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.125+0000 7f4a03000640 1 -- 172.21.15.7:0/2491517393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49fc158e90 con 0x7f49e00047d0 2024-09-13T15:16:18.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.125+0000 7f4a03000640 1 -- 172.21.15.7:0/2491517393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49fc067610 con 0x7f49e00047d0 2024-09-13T15:16:18.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.129+0000 7f49f3e00640 1 -- 172.21.15.7:0/2491517393 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f49ec004b50 con 0x7f49e00047d0 2024-09-13T15:16:18.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.129+0000 7f49f3e00640 1 --2- 172.21.15.7:0/2491517393 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f49d8066760 0x7f49d8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.129+0000 7f49f3e00640 1 -- 172.21.15.7:0/2491517393 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f49ec084010 con 0x7f49e00047d0 2024-09-13T15:16:18.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.129+0000 7f49fb400640 1 --2- 172.21.15.7:0/2491517393 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f49d8066760 0x7f49d8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:18.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.133+0000 7f49fb400640 1 --2- 172.21.15.7:0/2491517393 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f49d8066760 0x7f49d8068c20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f49f40af000 tx=0x7f49f4004b00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.145+0000 7f49f3e00640 1 -- 172.21.15.7:0/2491517393 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f49ec0b5db0 con 0x7f49e00047d0 2024-09-13T15:16:18.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.417+0000 7f4a03000640 1 -- 172.21.15.7:0/2491517393 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f49fc06cd10 con 0x7f49d8066760 2024-09-13T15:16:18.419 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T15:16:18.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.417+0000 7f49f3e00640 1 -- 172.21.15.7:0/2491517393 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f49f40a5c40 con 0x7f49d8066760 2024-09-13T15:16:18.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.421+0000 7f4a03000640 1 -- 172.21.15.7:0/2491517393 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f49d8066760 msgr2=0x7f49d8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:18.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.421+0000 7f4a03000640 1 --2- 172.21.15.7:0/2491517393 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f49d8066760 0x7f49d8068c20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f49f40af000 tx=0x7f49f4004b00 comp rx=0 tx=0).stop 2024-09-13T15:16:18.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.421+0000 7f4a03000640 1 -- 172.21.15.7:0/2491517393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49e00047d0 msgr2=0x7f49fc15b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:18.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.421+0000 7f4a03000640 1 --2- 172.21.15.7:0/2491517393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49e00047d0 0x7f49fc15b130 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f49ec00c770 tx=0x7f49ec00cc30 comp rx=0 tx=0).stop 2024-09-13T15:16:18.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.421+0000 7f4a03000640 1 -- 172.21.15.7:0/2491517393 shutdown_connections 2024-09-13T15:16:18.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.421+0000 7f4a03000640 1 --2- 172.21.15.7:0/2491517393 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f49d8066760 0x7f49d8068c20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.421+0000 7f4a03000640 1 --2- 172.21.15.7:0/2491517393 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f49fc070840 0x7f49fc141320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.421+0000 7f4a03000640 1 --2- 172.21.15.7:0/2491517393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49fc158380 0x7f49fc159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.421+0000 7f4a03000640 1 --2- 172.21.15.7:0/2491517393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49e00047d0 0x7f49fc15b130 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.421+0000 7f4a03000640 1 -- 172.21.15.7:0/2491517393 >> 172.21.15.7:0/2491517393 conn(0x7f49fc0c7380 msgr2=0x7f49fc0c4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:18.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.421+0000 7f4a03000640 1 -- 172.21.15.7:0/2491517393 shutdown_connections 2024-09-13T15:16:18.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.421+0000 7f4a03000640 1 -- 172.21.15.7:0/2491517393 wait complete. 2024-09-13T15:16:18.530 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T15:16:18.531 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:16:18.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.677+0000 7ffad8000640 1 Processor -- start 2024-09-13T15:16:18.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.677+0000 7ffad8000640 1 -- start start 2024-09-13T15:16:18.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.681+0000 7ffad8000640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffad0151400 0x7ffad0157450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.681+0000 7ffad8000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffad00c5b50 0x7ffad0157990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.681+0000 7ffad8000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad00c4d80 con 0x7ffad0151020 2024-09-13T15:16:18.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.681+0000 7ffad8000640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad0072260 con 0x7ffad0151400 2024-09-13T15:16:18.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.681+0000 7ffad8000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad0156f50 con 0x7ffad00c5b50 2024-09-13T15:16:18.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.681+0000 7ffad4c00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffad0151400 0x7ffad0157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:18.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.681+0000 7ffad6000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffad00c5b50 0x7ffad0157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:18.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.681+0000 7ffad6000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffad00c5b50 0x7ffad0157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:32886/0 (socket says 172.21.15.7:32886) 2024-09-13T15:16:18.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.681+0000 7ffad6000640 1 -- 172.21.15.7:0/2498285645 learned_addr learned my addr 172.21.15.7:0/2498285645 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:18.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.681+0000 7ffad6000640 1 -- 172.21.15.7:0/2498285645 >> v2:172.21.15.77:3300/0 conn(0x7ffad0151400 msgr2=0x7ffad0157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:18.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.681+0000 7ffad6000640 1 --2- 172.21.15.7:0/2498285645 >> v2:172.21.15.77:3300/0 conn(0x7ffad0151400 0x7ffad0157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.681+0000 7ffad6000640 1 -- 172.21.15.7:0/2498285645 >> v1:172.21.15.77:6789/0 conn(0x7ffad0151020 legacy=0x7ffad00cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:18.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.681+0000 7ffad6000640 1 -- 172.21.15.7:0/2498285645 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad0072500 con 0x7ffad00c5b50 2024-09-13T15:16:18.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.681+0000 7ffad4c00640 1 --2- 172.21.15.7:0/2498285645 >> v2:172.21.15.77:3300/0 conn(0x7ffad0151400 0x7ffad0157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T15:16:18.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.685+0000 7ffad6000640 1 --2- 172.21.15.7:0/2498285645 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffad00c5b50 0x7ffad0157990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffac8009e50 tx=0x7ffac801f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ccd8da262e77472 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:18.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.685+0000 7ffacfe00640 1 -- 172.21.15.7:0/2498285645 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac80af400 con 0x7ffad00c5b50 2024-09-13T15:16:18.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.685+0000 7ffacfe00640 1 -- 172.21.15.7:0/2498285645 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac80ab050 con 0x7ffad00c5b50 2024-09-13T15:16:18.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.685+0000 7ffacfe00640 1 -- 172.21.15.7:0/2498285645 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac80af780 con 0x7ffad00c5b50 2024-09-13T15:16:18.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.685+0000 7ffad8000640 1 -- 172.21.15.7:0/2498285645 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffad00c5b50 msgr2=0x7ffad0157990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:18.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.685+0000 7ffad8000640 1 --2- 172.21.15.7:0/2498285645 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffad00c5b50 0x7ffad0157990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffac8009e50 tx=0x7ffac801f210 comp rx=0 tx=0).stop 2024-09-13T15:16:18.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.685+0000 7ffad8000640 1 -- 172.21.15.7:0/2498285645 shutdown_connections 2024-09-13T15:16:18.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.685+0000 7ffad8000640 1 --2- 172.21.15.7:0/2498285645 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffad00c5b50 0x7ffad0157990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.685+0000 7ffad8000640 1 --2- 172.21.15.7:0/2498285645 >> v2:172.21.15.77:3300/0 conn(0x7ffad0151400 0x7ffad0157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.685+0000 7ffad8000640 1 -- 172.21.15.7:0/2498285645 >> 172.21.15.7:0/2498285645 conn(0x7ffad0065d40 msgr2=0x7ffad0066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:18.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.685+0000 7ffad8000640 1 -- 172.21.15.7:0/2498285645 shutdown_connections 2024-09-13T15:16:18.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.685+0000 7ffad8000640 1 -- 172.21.15.7:0/2498285645 wait complete. 2024-09-13T15:16:18.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.685+0000 7ffad8000640 1 Processor -- start 2024-09-13T15:16:18.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.685+0000 7ffad8000640 1 -- start start 2024-09-13T15:16:18.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad8000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffad00c5b50 0x7ffad01477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad8000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffad0151020 0x7ffad00c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad8000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffad0151400 0x7ffad00ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad8000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad00ade30 con 0x7ffad00c5b50 2024-09-13T15:16:18.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad8000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad014d560 con 0x7ffad0151400 2024-09-13T15:16:18.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad8000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad01ee7f0 con 0x7ffad0151020 2024-09-13T15:16:18.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad5600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffad00c5b50 0x7ffad01477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:18.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad5600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffad00c5b50 0x7ffad01477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60228/0 (socket says 172.21.15.7:60228) 2024-09-13T15:16:18.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad5600640 1 -- 172.21.15.7:0/984912107 learned_addr learned my addr 172.21.15.7:0/984912107 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:18.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad4c00640 1 --2- 172.21.15.7:0/984912107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffad0151020 0x7ffad00c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:18.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad6000640 1 --2- 172.21.15.7:0/984912107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffad0151400 0x7ffad00ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:18.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad5600640 1 -- 172.21.15.7:0/984912107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffad0151020 msgr2=0x7ffad00c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:18.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad5600640 1 --2- 172.21.15.7:0/984912107 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffad0151020 0x7ffad00c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad5600640 1 -- 172.21.15.7:0/984912107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffad0151400 msgr2=0x7ffad00ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:18.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad5600640 1 --2- 172.21.15.7:0/984912107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffad0151400 0x7ffad00ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad5600640 1 -- 172.21.15.7:0/984912107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc009420 con 0x7ffad00c5b50 2024-09-13T15:16:18.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad5600640 1 --2- 172.21.15.7:0/984912107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffad00c5b50 0x7ffad01477d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ffac400c420 tx=0x7ffac400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:18.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffacd600640 1 -- 172.21.15.7:0/984912107 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac40052d0 con 0x7ffad00c5b50 2024-09-13T15:16:18.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffacd600640 1 -- 172.21.15.7:0/984912107 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac4005430 con 0x7ffad00c5b50 2024-09-13T15:16:18.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad8000640 1 -- 172.21.15.7:0/984912107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac8009b30 con 0x7ffad00c5b50 2024-09-13T15:16:18.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffacd600640 1 -- 172.21.15.7:0/984912107 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4007260 con 0x7ffad00c5b50 2024-09-13T15:16:18.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad8000640 1 -- 172.21.15.7:0/984912107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad01eedb0 con 0x7ffad00c5b50 2024-09-13T15:16:18.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffad8000640 1 -- 172.21.15.7:0/984912107 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffad00c66a0 con 0x7ffad00c5b50 2024-09-13T15:16:18.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.689+0000 7ffacd600640 1 -- 172.21.15.7:0/984912107 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffac40073c0 con 0x7ffad00c5b50 2024-09-13T15:16:18.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.693+0000 7ffacd600640 1 --2- 172.21.15.7:0/984912107 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffab0066690 0x7ffab0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.693+0000 7ffacd600640 1 -- 172.21.15.7:0/984912107 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7ffac4083b70 con 0x7ffad00c5b50 2024-09-13T15:16:18.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.693+0000 7ffacd600640 1 --2- 172.21.15.7:0/984912107 >> [v2:172.21.15.7:6824/3381512335,v1:172.21.15.7:6825/3381512335] conn(0x7ffab00703a0 0x7ffab0072840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.693+0000 7ffacd600640 1 -- 172.21.15.7:0/984912107 --> [v2:172.21.15.7:6824/3381512335,v1:172.21.15.7:6825/3381512335] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffab0072f10 con 0x7ffab00703a0 2024-09-13T15:16:18.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.693+0000 7ffacd600640 1 -- 172.21.15.7:0/984912107 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffac40882a0 con 0x7ffad00c5b50 2024-09-13T15:16:18.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.693+0000 7ffad4c00640 1 --2- 172.21.15.7:0/984912107 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffab0066690 0x7ffab0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:18.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.693+0000 7ffad6000640 1 --2- 172.21.15.7:0/984912107 >> [v2:172.21.15.7:6824/3381512335,v1:172.21.15.7:6825/3381512335] conn(0x7ffab00703a0 0x7ffab0072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:18.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.693+0000 7ffad6000640 1 --2- 172.21.15.7:0/984912107 >> [v2:172.21.15.7:6824/3381512335,v1:172.21.15.7:6825/3381512335] conn(0x7ffab00703a0 0x7ffab0072840 crc :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:18.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.693+0000 7ffad4c00640 1 --2- 172.21.15.7:0/984912107 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffab0066690 0x7ffab0068b50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ffad00c74e0 tx=0x7ffabc009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:18.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.693+0000 7ffacd600640 1 -- 172.21.15.7:0/984912107 <== osd.3 v2:172.21.15.7:6824/3381512335 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ffab0072f10 con 0x7ffab00703a0 2024-09-13T15:16:18.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.705+0000 7ffad8000640 1 -- 172.21.15.7:0/984912107 --> [v2:172.21.15.7:6824/3381512335,v1:172.21.15.7:6825/3381512335] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffad00707d0 con 0x7ffab00703a0 2024-09-13T15:16:18.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.705+0000 7ffacd600640 1 -- 172.21.15.7:0/984912107 <== osd.3 v2:172.21.15.7:6824/3381512335 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffad00707d0 con 0x7ffab00703a0 2024-09-13T15:16:18.707 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T15:16:18.707 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:16:18.707 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T15:16:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.705+0000 7ffad8000640 1 -- 172.21.15.7:0/984912107 >> [v2:172.21.15.7:6824/3381512335,v1:172.21.15.7:6825/3381512335] conn(0x7ffab00703a0 msgr2=0x7ffab0072840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.705+0000 7ffad8000640 1 --2- 172.21.15.7:0/984912107 >> [v2:172.21.15.7:6824/3381512335,v1:172.21.15.7:6825/3381512335] conn(0x7ffab00703a0 0x7ffab0072840 crc :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.709+0000 7ffad8000640 1 -- 172.21.15.7:0/984912107 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffab0066690 msgr2=0x7ffab0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.709+0000 7ffad8000640 1 --2- 172.21.15.7:0/984912107 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffab0066690 0x7ffab0068b50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ffad00c74e0 tx=0x7ffabc009190 comp rx=0 tx=0).stop 2024-09-13T15:16:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.709+0000 7ffad8000640 1 -- 172.21.15.7:0/984912107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffad00c5b50 msgr2=0x7ffad01477d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.709+0000 7ffad8000640 1 --2- 172.21.15.7:0/984912107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffad00c5b50 0x7ffad01477d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ffac400c420 tx=0x7ffac400c8e0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.709+0000 7ffad6000640 1 -- 172.21.15.7:0/984912107 reap_dead start 2024-09-13T15:16:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.709+0000 7ffad8000640 1 -- 172.21.15.7:0/984912107 shutdown_connections 2024-09-13T15:16:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.709+0000 7ffad8000640 1 -- 172.21.15.7:0/984912107 >> 172.21.15.7:0/984912107 conn(0x7ffad0065d40 msgr2=0x7ffad0155730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.709+0000 7ffad8000640 1 -- 172.21.15.7:0/984912107 shutdown_connections 2024-09-13T15:16:18.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.709+0000 7ffad8000640 1 -- 172.21.15.7:0/984912107 wait complete. 2024-09-13T15:16:18.726 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T15:16:18.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.869+0000 7fa4ae200640 1 Processor -- start 2024-09-13T15:16:18.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.869+0000 7fa4ae200640 1 -- start start 2024-09-13T15:16:18.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.869+0000 7fa4ae200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa4a8152fd0 0x7fa4a80c9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.869+0000 7fa4ae200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a815c600 con 0x7fa4a806faf0 2024-09-13T15:16:18.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.869+0000 7fa4ae200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4a815c8e0 con 0x7fa4a806aa60 2024-09-13T15:16:18.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.869+0000 7fa4ae200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a815c410 con 0x7fa4a8152fd0 2024-09-13T15:16:18.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.869+0000 7fa4ace00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fa4a8152fd0 0x7fa4a80c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:18.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.869+0000 7fa4ad800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fa4a806faf0 0x7fa4a81592c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40764/0 (socket says 172.21.15.7:40764) 2024-09-13T15:16:18.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.869+0000 7fa4ad800640 1 -- 172.21.15.7:0/493172782 learned_addr learned my addr 172.21.15.7:0/493172782 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:16:18.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.869+0000 7fa4ace00640 1 -- 172.21.15.7:0/493172782 >> v1:172.21.15.77:6789/0 conn(0x7fa4a806aa60 legacy=0x7fa4a806f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:18.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.869+0000 7fa4ace00640 1 -- 172.21.15.7:0/493172782 >> v1:172.21.15.7:6789/0 conn(0x7fa4a806faf0 legacy=0x7fa4a81592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:18.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.869+0000 7fa4ace00640 1 -- 172.21.15.7:0/493172782 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a815cbc0 con 0x7fa4a8152fd0 2024-09-13T15:16:18.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.869+0000 7fa4a7400640 1 -- 172.21.15.7:0/493172782 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104831696 0 0) 0x7fa4a815c600 con 0x7fa4a806faf0 2024-09-13T15:16:18.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.873+0000 7fa4ace00640 1 --2- 172.21.15.7:0/493172782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a8152fd0 0x7fa4a80c9330 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0097c0 tx=0x7fa49c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15be641ab67ccbb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:18.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.873+0000 7fa4a7400640 1 -- 172.21.15.7:0/493172782 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0a8050 con 0x7fa4a8152fd0 2024-09-13T15:16:18.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.873+0000 7fa4a7400640 1 -- 172.21.15.7:0/493172782 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c0ac5f0 con 0x7fa4a8152fd0 2024-09-13T15:16:18.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.873+0000 7fa4a7400640 1 -- 172.21.15.7:0/493172782 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0ac980 con 0x7fa4a8152fd0 2024-09-13T15:16:18.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.873+0000 7fa4ae200640 1 -- 172.21.15.7:0/493172782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a8152fd0 msgr2=0x7fa4a80c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:18.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.873+0000 7fa4ae200640 1 --2- 172.21.15.7:0/493172782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a8152fd0 0x7fa4a80c9330 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0097c0 tx=0x7fa49c01c4a0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.873+0000 7fa4ae200640 1 -- 172.21.15.7:0/493172782 shutdown_connections 2024-09-13T15:16:18.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.873+0000 7fa4ae200640 1 --2- 172.21.15.7:0/493172782 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a8152fd0 0x7fa4a80c9330 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.873+0000 7fa4ae200640 1 -- 172.21.15.7:0/493172782 >> 172.21.15.7:0/493172782 conn(0x7fa4a8065d40 msgr2=0x7fa4a8066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:18.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.873+0000 7fa4ae200640 1 -- 172.21.15.7:0/493172782 shutdown_connections 2024-09-13T15:16:18.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.873+0000 7fa4ae200640 1 -- 172.21.15.7:0/493172782 wait complete. 2024-09-13T15:16:18.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4ae200640 1 Processor -- start 2024-09-13T15:16:18.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4ae200640 1 -- start start 2024-09-13T15:16:18.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4ae200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4a806aa60 0x7fa4a80c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4ae200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a806faf0 0x7fa4a8150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4ae200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4a8152fd0 0x7fa4a8151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4ae200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80cbec0 con 0x7fa4a806faf0 2024-09-13T15:16:18.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4ae200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a815ad00 con 0x7fa4a8152fd0 2024-09-13T15:16:18.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4ae200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a813e840 con 0x7fa4a806aa60 2024-09-13T15:16:18.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4a7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a806faf0 0x7fa4a8150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:18.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4a7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a806faf0 0x7fa4a8150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60248/0 (socket says 172.21.15.7:60248) 2024-09-13T15:16:18.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4a7e00640 1 -- 172.21.15.7:0/659919476 learned_addr learned my addr 172.21.15.7:0/659919476 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:18.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4ace00640 1 --2- 172.21.15.7:0/659919476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4a806aa60 0x7fa4a80c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:18.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4ad800640 1 --2- 172.21.15.7:0/659919476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4a8152fd0 0x7fa4a8151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:18.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4a7e00640 1 -- 172.21.15.7:0/659919476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4a806aa60 msgr2=0x7fa4a80c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:18.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4a7e00640 1 --2- 172.21.15.7:0/659919476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4a806aa60 0x7fa4a80c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4a7e00640 1 -- 172.21.15.7:0/659919476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4a8152fd0 msgr2=0x7fa4a8151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:18.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4a7e00640 1 --2- 172.21.15.7:0/659919476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4a8152fd0 0x7fa4a8151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:18.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4a7e00640 1 -- 172.21.15.7:0/659919476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c009420 con 0x7fa4a806faf0 2024-09-13T15:16:18.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4ace00640 1 --2- 172.21.15.7:0/659919476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4a806aa60 0x7fa4a80c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:16:18.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4a7e00640 1 --2- 172.21.15.7:0/659919476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a806faf0 0x7fa4a8150be0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa49400c500 tx=0x7fa49400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:18.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4a4c00640 1 -- 172.21.15.7:0/659919476 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494005220 con 0x7fa4a806faf0 2024-09-13T15:16:18.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4a4c00640 1 -- 172.21.15.7:0/659919476 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa494005380 con 0x7fa4a806faf0 2024-09-13T15:16:18.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4ae200640 1 -- 172.21.15.7:0/659919476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a815af50 con 0x7fa4a806faf0 2024-09-13T15:16:18.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4a4c00640 1 -- 172.21.15.7:0/659919476 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494007270 con 0x7fa4a806faf0 2024-09-13T15:16:18.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4ae200640 1 -- 172.21.15.7:0/659919476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a815b510 con 0x7fa4a806faf0 2024-09-13T15:16:18.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.877+0000 7fa4ae200640 1 -- 172.21.15.7:0/659919476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a80c9330 con 0x7fa4a806faf0 2024-09-13T15:16:18.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.881+0000 7fa4a4c00640 1 -- 172.21.15.7:0/659919476 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa4940073d0 con 0x7fa4a806faf0 2024-09-13T15:16:18.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.881+0000 7fa4a4c00640 1 --2- 172.21.15.7:0/659919476 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa488066690 0x7fa488068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:18.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.881+0000 7fa4a4c00640 1 -- 172.21.15.7:0/659919476 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7fa494084130 con 0x7fa4a806faf0 2024-09-13T15:16:18.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.881+0000 7fa4ace00640 1 --2- 172.21.15.7:0/659919476 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa488066690 0x7fa488068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:18.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.881+0000 7fa4ace00640 1 --2- 172.21.15.7:0/659919476 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa488066690 0x7fa488068b50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0ae000 tx=0x7fa49c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:18.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:18.885+0000 7fa4a4c00640 1 -- 172.21.15.7:0/659919476 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa494050e50 con 0x7fa4a806faf0 2024-09-13T15:16:19.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.221+0000 7fa4ae200640 1 -- 172.21.15.7:0/659919476 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4a8157ad0 con 0x7fa488066690 2024-09-13T15:16:19.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.225+0000 7fa4a4c00640 1 -- 172.21.15.7:0/659919476 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa4a8157ad0 con 0x7fa488066690 2024-09-13T15:16:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T15:16:19.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.233+0000 7fa4ae200640 1 -- 172.21.15.7:0/659919476 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa488066690 msgr2=0x7fa488068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:19.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.233+0000 7fa4ae200640 1 --2- 172.21.15.7:0/659919476 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa488066690 0x7fa488068b50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0ae000 tx=0x7fa49c008040 comp rx=0 tx=0).stop 2024-09-13T15:16:19.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.237+0000 7fa4ae200640 1 -- 172.21.15.7:0/659919476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a806faf0 msgr2=0x7fa4a8150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:19.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.237+0000 7fa4ae200640 1 --2- 172.21.15.7:0/659919476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a806faf0 0x7fa4a8150be0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa49400c500 tx=0x7fa49400c9c0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.237+0000 7fa4ae200640 1 -- 172.21.15.7:0/659919476 shutdown_connections 2024-09-13T15:16:19.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.237+0000 7fa4ae200640 1 --2- 172.21.15.7:0/659919476 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fa488066690 0x7fa488068b50 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.237+0000 7fa4ae200640 1 --2- 172.21.15.7:0/659919476 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4a8152fd0 0x7fa4a8151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.237+0000 7fa4ae200640 1 --2- 172.21.15.7:0/659919476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a806faf0 0x7fa4a8150be0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.237+0000 7fa4ae200640 1 --2- 172.21.15.7:0/659919476 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fa4a806aa60 0x7fa4a80c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.237+0000 7fa4ae200640 1 -- 172.21.15.7:0/659919476 >> 172.21.15.7:0/659919476 conn(0x7fa4a8065d40 msgr2=0x7fa4a80c8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:19.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.241+0000 7fa4ae200640 1 -- 172.21.15.7:0/659919476 shutdown_connections 2024-09-13T15:16:19.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.241+0000 7fa4ae200640 1 -- 172.21.15.7:0/659919476 wait complete. 2024-09-13T15:16:19.283 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T15:16:19.283 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:16:19.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.453+0000 7ffb29200640 1 Processor -- start 2024-09-13T15:16:19.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.453+0000 7ffb29200640 1 -- start start 2024-09-13T15:16:19.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.453+0000 7ffb29200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb24151020 0x7ffb240cab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:19.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.453+0000 7ffb29200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffb24157b60 0x7ffb240cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:19.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.453+0000 7ffb29200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb240c4d80 con 0x7ffb24151400 2024-09-13T15:16:19.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.453+0000 7ffb29200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb24072260 con 0x7ffb24157b60 2024-09-13T15:16:19.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.453+0000 7ffb29200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb24156f50 con 0x7ffb24151020 2024-09-13T15:16:19.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.453+0000 7ffb22800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffb24157b60 0x7ffb240cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:19.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.453+0000 7ffb22800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7ffb24157b60 0x7ffb240cb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60262/0 (socket says 172.21.15.7:60262) 2024-09-13T15:16:19.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.453+0000 7ffb22800640 1 -- 172.21.15.7:0/2600647198 learned_addr learned my addr 172.21.15.7:0/2600647198 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:19.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.453+0000 7ffb21e00640 1 --2- 172.21.15.7:0/2600647198 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb24151020 0x7ffb240cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:19.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.453+0000 7ffb22800640 1 -- 172.21.15.7:0/2600647198 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb24151020 msgr2=0x7ffb240cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:19.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.453+0000 7ffb22800640 1 --2- 172.21.15.7:0/2600647198 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb24151020 0x7ffb240cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.453+0000 7ffb22800640 1 -- 172.21.15.7:0/2600647198 >> v1:172.21.15.77:6789/0 conn(0x7ffb24151400 legacy=0x7ffb24157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:19.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.453+0000 7ffb22800640 1 -- 172.21.15.7:0/2600647198 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb24072500 con 0x7ffb24157b60 2024-09-13T15:16:19.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.457+0000 7ffb22800640 1 --2- 172.21.15.7:0/2600647198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb24157b60 0x7ffb240cb0a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009e80 tx=0x7ffb1c01f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2480e4ad024749c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:19.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.457+0000 7ffb21400640 1 -- 172.21.15.7:0/2600647198 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0af400 con 0x7ffb24157b60 2024-09-13T15:16:19.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.457+0000 7ffb21400640 1 -- 172.21.15.7:0/2600647198 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c0ab050 con 0x7ffb24157b60 2024-09-13T15:16:19.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.457+0000 7ffb21400640 1 -- 172.21.15.7:0/2600647198 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c0af780 con 0x7ffb24157b60 2024-09-13T15:16:19.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.457+0000 7ffb29200640 1 -- 172.21.15.7:0/2600647198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb24157b60 msgr2=0x7ffb240cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:19.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.457+0000 7ffb29200640 1 --2- 172.21.15.7:0/2600647198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb24157b60 0x7ffb240cb0a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009e80 tx=0x7ffb1c01f200 comp rx=0 tx=0).stop 2024-09-13T15:16:19.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.457+0000 7ffb29200640 1 -- 172.21.15.7:0/2600647198 shutdown_connections 2024-09-13T15:16:19.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.457+0000 7ffb29200640 1 --2- 172.21.15.7:0/2600647198 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb24157b60 0x7ffb240cb0a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.457+0000 7ffb29200640 1 --2- 172.21.15.7:0/2600647198 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb24151020 0x7ffb240cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.457+0000 7ffb29200640 1 -- 172.21.15.7:0/2600647198 >> 172.21.15.7:0/2600647198 conn(0x7ffb24065d40 msgr2=0x7ffb24066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:19.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.457+0000 7ffb29200640 1 -- 172.21.15.7:0/2600647198 shutdown_connections 2024-09-13T15:16:19.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.457+0000 7ffb29200640 1 -- 172.21.15.7:0/2600647198 wait complete. 2024-09-13T15:16:19.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb29200640 1 Processor -- start 2024-09-13T15:16:19.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb29200640 1 -- start start 2024-09-13T15:16:19.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb29200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb24151020 0x7ffb2414ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:19.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb29200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb24151400 0x7ffb241eeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:19.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb29200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb24157b60 0x7ffb240c1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:19.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb29200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb241eea90 con 0x7ffb24151400 2024-09-13T15:16:19.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb29200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb240c89d0 con 0x7ffb24157b60 2024-09-13T15:16:19.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb29200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb240c94c0 con 0x7ffb24151020 2024-09-13T15:16:19.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb19400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb24151400 0x7ffb241eeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:19.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb21e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb24151020 0x7ffb2414ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:19.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb19400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb24151400 0x7ffb241eeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60264/0 (socket says 172.21.15.7:60264) 2024-09-13T15:16:19.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb19400640 1 -- 172.21.15.7:0/3015812546 learned_addr learned my addr 172.21.15.7:0/3015812546 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:19.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb22800640 1 --2- 172.21.15.7:0/3015812546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb24157b60 0x7ffb240c1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:19.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb19400640 1 -- 172.21.15.7:0/3015812546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb24151020 msgr2=0x7ffb2414ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:19.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb19400640 1 --2- 172.21.15.7:0/3015812546 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7ffb24151020 0x7ffb2414ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb19400640 1 -- 172.21.15.7:0/3015812546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb24157b60 msgr2=0x7ffb240c1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:19.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb19400640 1 --2- 172.21.15.7:0/3015812546 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb24157b60 0x7ffb240c1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb19400640 1 -- 172.21.15.7:0/3015812546 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c009b30 con 0x7ffb24151400 2024-09-13T15:16:19.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb19400640 1 --2- 172.21.15.7:0/3015812546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb24151400 0x7ffb241eeeb0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00c500 tx=0x7ffb0c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:19.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb1aa00640 1 -- 172.21.15.7:0/3015812546 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c0052d0 con 0x7ffb24151400 2024-09-13T15:16:19.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb1aa00640 1 -- 172.21.15.7:0/3015812546 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0c005430 con 0x7ffb24151400 2024-09-13T15:16:19.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb29200640 1 -- 172.21.15.7:0/3015812546 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2415afe0 con 0x7ffb24151400 2024-09-13T15:16:19.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb1aa00640 1 -- 172.21.15.7:0/3015812546 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0c012830 con 0x7ffb24151400 2024-09-13T15:16:19.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb29200640 1 -- 172.21.15.7:0/3015812546 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb240c8f00 con 0x7ffb24151400 2024-09-13T15:16:19.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.461+0000 7ffb29200640 1 -- 172.21.15.7:0/3015812546 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffb240c66a0 con 0x7ffb24151400 2024-09-13T15:16:19.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.465+0000 7ffb1aa00640 1 -- 172.21.15.7:0/3015812546 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffb0c012990 con 0x7ffb24151400 2024-09-13T15:16:19.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.465+0000 7ffb1aa00640 1 --2- 172.21.15.7:0/3015812546 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffb00066690 0x7ffb00068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:19.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.465+0000 7ffb1aa00640 1 -- 172.21.15.7:0/3015812546 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7ffb0c084b90 con 0x7ffb24151400 2024-09-13T15:16:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.465+0000 7ffb1aa00640 1 --2- 172.21.15.7:0/3015812546 >> [v2:172.21.15.77:6800/2910694434,v1:172.21.15.77:6801/2910694434] conn(0x7ffb000703a0 0x7ffb00072840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.465+0000 7ffb1aa00640 1 -- 172.21.15.7:0/3015812546 --> [v2:172.21.15.77:6800/2910694434,v1:172.21.15.77:6801/2910694434] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffb00072f10 con 0x7ffb000703a0 2024-09-13T15:16:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.465+0000 7ffb1aa00640 1 -- 172.21.15.7:0/3015812546 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb0c084f00 con 0x7ffb24151400 2024-09-13T15:16:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.465+0000 7ffb21e00640 1 --2- 172.21.15.7:0/3015812546 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffb00066690 0x7ffb00068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.465+0000 7ffb22800640 1 --2- 172.21.15.7:0/3015812546 >> [v2:172.21.15.77:6800/2910694434,v1:172.21.15.77:6801/2910694434] conn(0x7ffb000703a0 0x7ffb00072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.465+0000 7ffb21e00640 1 --2- 172.21.15.7:0/3015812546 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffb00066690 0x7ffb00068b50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffb14007a60 tx=0x7ffb14008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.465+0000 7ffb22800640 1 --2- 172.21.15.7:0/3015812546 >> [v2:172.21.15.77:6800/2910694434,v1:172.21.15.77:6801/2910694434] conn(0x7ffb000703a0 0x7ffb00072840 crc :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:19.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.469+0000 7ffb1aa00640 1 -- 172.21.15.7:0/3015812546 <== osd.4 v2:172.21.15.77:6800/2910694434 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ffb00072f10 con 0x7ffb000703a0 2024-09-13T15:16:19.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.481+0000 7ffb29200640 1 -- 172.21.15.7:0/3015812546 --> [v2:172.21.15.77:6800/2910694434,v1:172.21.15.77:6801/2910694434] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffb240707d0 con 0x7ffb000703a0 2024-09-13T15:16:19.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.481+0000 7ffb1aa00640 1 -- 172.21.15.7:0/3015812546 <== osd.4 v2:172.21.15.77:6800/2910694434 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffb240707d0 con 0x7ffb000703a0 2024-09-13T15:16:19.482 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T15:16:19.482 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:16:19.482 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T15:16:19.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.481+0000 7ffb29200640 1 -- 172.21.15.7:0/3015812546 >> [v2:172.21.15.77:6800/2910694434,v1:172.21.15.77:6801/2910694434] conn(0x7ffb000703a0 msgr2=0x7ffb00072840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:19.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.481+0000 7ffb29200640 1 --2- 172.21.15.7:0/3015812546 >> [v2:172.21.15.77:6800/2910694434,v1:172.21.15.77:6801/2910694434] conn(0x7ffb000703a0 0x7ffb00072840 crc :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.481+0000 7ffb29200640 1 -- 172.21.15.7:0/3015812546 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffb00066690 msgr2=0x7ffb00068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:19.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.481+0000 7ffb29200640 1 --2- 172.21.15.7:0/3015812546 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7ffb00066690 0x7ffb00068b50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffb14007a60 tx=0x7ffb14008040 comp rx=0 tx=0).stop 2024-09-13T15:16:19.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.481+0000 7ffb29200640 1 -- 172.21.15.7:0/3015812546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb24151400 msgr2=0x7ffb241eeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:19.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.481+0000 7ffb29200640 1 --2- 172.21.15.7:0/3015812546 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb24151400 0x7ffb241eeeb0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c00c500 tx=0x7ffb0c00c9c0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.481+0000 7ffb22800640 1 -- 172.21.15.7:0/3015812546 reap_dead start 2024-09-13T15:16:19.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.481+0000 7ffb29200640 1 -- 172.21.15.7:0/3015812546 shutdown_connections 2024-09-13T15:16:19.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.481+0000 7ffb29200640 1 -- 172.21.15.7:0/3015812546 >> 172.21.15.7:0/3015812546 conn(0x7ffb24065d40 msgr2=0x7ffb2406f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:19.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.481+0000 7ffb29200640 1 -- 172.21.15.7:0/3015812546 shutdown_connections 2024-09-13T15:16:19.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.481+0000 7ffb29200640 1 -- 172.21.15.7:0/3015812546 wait complete. 2024-09-13T15:16:19.501 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T15:16:19.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.645+0000 7fb5b4000640 1 Processor -- start 2024-09-13T15:16:19.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.645+0000 7fb5b4000640 1 -- start start 2024-09-13T15:16:19.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.649+0000 7fb5b4000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5ac0c7ea0 0x7fb5ac157e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:19.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.649+0000 7fb5b4000640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ac151970 con 0x7fb5ac151590 2024-09-13T15:16:19.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.649+0000 7fb5b4000640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ac15b030 con 0x7fb5ac0c6130 2024-09-13T15:16:19.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.649+0000 7fb5b4000640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ac15b310 con 0x7fb5ac0c7ea0 2024-09-13T15:16:19.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.649+0000 7fb5b0c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5ac0c7ea0 0x7fb5ac157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:19.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.649+0000 7fb5b0c00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb5ac0c7ea0 0x7fb5ac157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60272/0 (socket says 172.21.15.7:60272) 2024-09-13T15:16:19.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.649+0000 7fb5b0c00640 1 -- 172.21.15.7:0/1762116845 learned_addr learned my addr 172.21.15.7:0/1762116845 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:19.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.649+0000 7fb5b0c00640 1 -- 172.21.15.7:0/1762116845 >> v1:172.21.15.77:6789/0 conn(0x7fb5ac0c6130 legacy=0x7fb5ac0717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:19.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.649+0000 7fb5b0c00640 1 -- 172.21.15.7:0/1762116845 >> v1:172.21.15.7:6789/0 conn(0x7fb5ac151590 legacy=0x7fb5ac15a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:19.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.649+0000 7fb5b0c00640 1 -- 172.21.15.7:0/1762116845 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac157340 con 0x7fb5ac0c7ea0 2024-09-13T15:16:19.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.649+0000 7fb5b0c00640 1 --2- 172.21.15.7:0/1762116845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ac0c7ea0 0x7fb5ac157e20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb598009870 tx=0x7fb59801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db35a15d4f16eedf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:19.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5abe00640 1 -- 172.21.15.7:0/1762116845 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5980aa650 con 0x7fb5ac0c7ea0 2024-09-13T15:16:19.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5abe00640 1 -- 172.21.15.7:0/1762116845 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5980aa7b0 con 0x7fb5ac0c7ea0 2024-09-13T15:16:19.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5abe00640 1 -- 172.21.15.7:0/1762116845 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5980aab40 con 0x7fb5ac0c7ea0 2024-09-13T15:16:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5b4000640 1 -- 172.21.15.7:0/1762116845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ac0c7ea0 msgr2=0x7fb5ac157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5b4000640 1 --2- 172.21.15.7:0/1762116845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ac0c7ea0 0x7fb5ac157e20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fb598009870 tx=0x7fb59801c4f0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5b4000640 1 -- 172.21.15.7:0/1762116845 shutdown_connections 2024-09-13T15:16:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5b4000640 1 --2- 172.21.15.7:0/1762116845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ac0c7ea0 0x7fb5ac157e20 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5b4000640 1 -- 172.21.15.7:0/1762116845 >> 172.21.15.7:0/1762116845 conn(0x7fb5ac0c7380 msgr2=0x7fb5ac0c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5b4000640 1 -- 172.21.15.7:0/1762116845 shutdown_connections 2024-09-13T15:16:19.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5b4000640 1 -- 172.21.15.7:0/1762116845 wait complete. 2024-09-13T15:16:19.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5b4000640 1 Processor -- start 2024-09-13T15:16:19.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5b4000640 1 -- start start 2024-09-13T15:16:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5b4000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5ac0c6130 0x7fb5ac160f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:19.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5b4000640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ac0c7ea0 0x7fb5ac152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:19.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5b4000640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5ac151590 0x7fb5ac1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:19.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5b4000640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac154ab0 con 0x7fb5ac0c7ea0 2024-09-13T15:16:19.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5b4000640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac159df0 con 0x7fb5ac151590 2024-09-13T15:16:19.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.653+0000 7fb5b4000640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac0c22e0 con 0x7fb5ac0c6130 2024-09-13T15:16:19.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5b0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ac0c7ea0 0x7fb5ac152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:19.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5b0c00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ac0c7ea0 0x7fb5ac152490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60274/0 (socket says 172.21.15.7:60274) 2024-09-13T15:16:19.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5b0c00640 1 -- 172.21.15.7:0/3819787002 learned_addr learned my addr 172.21.15.7:0/3819787002 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:19.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5b1600640 1 --2- 172.21.15.7:0/3819787002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5ac0c6130 0x7fb5ac160f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:19.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5b2000640 1 --2- 172.21.15.7:0/3819787002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5ac151590 0x7fb5ac1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:19.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5b0c00640 1 -- 172.21.15.7:0/3819787002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5ac0c6130 msgr2=0x7fb5ac160f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:19.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5b0c00640 1 --2- 172.21.15.7:0/3819787002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5ac0c6130 0x7fb5ac160f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5b0c00640 1 -- 172.21.15.7:0/3819787002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5ac151590 msgr2=0x7fb5ac1529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:19.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5b0c00640 1 --2- 172.21.15.7:0/3819787002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5ac151590 0x7fb5ac1529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5b0c00640 1 -- 172.21.15.7:0/3819787002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5980094d0 con 0x7fb5ac0c7ea0 2024-09-13T15:16:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5b0c00640 1 --2- 172.21.15.7:0/3819787002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ac0c7ea0 0x7fb5ac152490 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb598019100 tx=0x7fb59801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5a9600640 1 -- 172.21.15.7:0/3819787002 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5980b3800 con 0x7fb5ac0c7ea0 2024-09-13T15:16:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5a9600640 1 -- 172.21.15.7:0/3819787002 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5980b3980 con 0x7fb5ac0c7ea0 2024-09-13T15:16:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5a9600640 1 -- 172.21.15.7:0/3819787002 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5980b3d30 con 0x7fb5ac0c7ea0 2024-09-13T15:16:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5b4000640 1 -- 172.21.15.7:0/3819787002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ac15a020 con 0x7fb5ac0c7ea0 2024-09-13T15:16:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5b4000640 1 -- 172.21.15.7:0/3819787002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ac0c2000 con 0x7fb5ac0c7ea0 2024-09-13T15:16:19.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5b4000640 1 -- 172.21.15.7:0/3819787002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ac067610 con 0x7fb5ac0c7ea0 2024-09-13T15:16:19.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.657+0000 7fb5a9600640 1 -- 172.21.15.7:0/3819787002 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb5980c73a0 con 0x7fb5ac0c7ea0 2024-09-13T15:16:19.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.661+0000 7fb5a9600640 1 --2- 172.21.15.7:0/3819787002 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb58c066690 0x7fb58c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:19.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.661+0000 7fb5a9600640 1 -- 172.21.15.7:0/3819787002 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7fb59811f260 con 0x7fb5ac0c7ea0 2024-09-13T15:16:19.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.661+0000 7fb5b1600640 1 --2- 172.21.15.7:0/3819787002 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb58c066690 0x7fb58c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:19.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.661+0000 7fb5b1600640 1 --2- 172.21.15.7:0/3819787002 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb58c066690 0x7fb58c068b50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0007fd0 tx=0x7fb5a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:19.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.665+0000 7fb5a9600640 1 -- 172.21.15.7:0/3819787002 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb5980ec020 con 0x7fb5ac0c7ea0 2024-09-13T15:16:19.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.825+0000 7fb5b4000640 1 -- 172.21.15.7:0/3819787002 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5ac15b5f0 con 0x7fb58c066690 2024-09-13T15:16:19.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.829+0000 7fb5a9600640 1 -- 172.21.15.7:0/3819787002 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb5a00014f0 con 0x7fb58c066690 2024-09-13T15:16:19.828 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T15:16:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.829+0000 7fb5b4000640 1 -- 172.21.15.7:0/3819787002 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb58c066690 msgr2=0x7fb58c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.829+0000 7fb5b4000640 1 --2- 172.21.15.7:0/3819787002 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb58c066690 0x7fb58c068b50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0007fd0 tx=0x7fb5a0009040 comp rx=0 tx=0).stop 2024-09-13T15:16:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.829+0000 7fb5b4000640 1 -- 172.21.15.7:0/3819787002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ac0c7ea0 msgr2=0x7fb5ac152490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.829+0000 7fb5b4000640 1 --2- 172.21.15.7:0/3819787002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ac0c7ea0 0x7fb5ac152490 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fb598019100 tx=0x7fb59801ad30 comp rx=0 tx=0).stop 2024-09-13T15:16:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.829+0000 7fb5b4000640 1 -- 172.21.15.7:0/3819787002 shutdown_connections 2024-09-13T15:16:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.829+0000 7fb5b4000640 1 --2- 172.21.15.7:0/3819787002 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fb58c066690 0x7fb58c068b50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.829+0000 7fb5b4000640 1 --2- 172.21.15.7:0/3819787002 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5ac151590 0x7fb5ac1529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.829+0000 7fb5b4000640 1 --2- 172.21.15.7:0/3819787002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5ac0c7ea0 0x7fb5ac152490 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.829+0000 7fb5b4000640 1 --2- 172.21.15.7:0/3819787002 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb5ac0c6130 0x7fb5ac160f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.829+0000 7fb5b4000640 1 -- 172.21.15.7:0/3819787002 >> 172.21.15.7:0/3819787002 conn(0x7fb5ac0c7380 msgr2=0x7fb5ac162320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:19.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.829+0000 7fb5b4000640 1 -- 172.21.15.7:0/3819787002 shutdown_connections 2024-09-13T15:16:19.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.829+0000 7fb5b4000640 1 -- 172.21.15.7:0/3819787002 wait complete. 2024-09-13T15:16:19.850 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T15:16:19.850 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:16:19.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.997+0000 7fc2bde00640 1 Processor -- start 2024-09-13T15:16:19.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.997+0000 7fc2bde00640 1 -- start start 2024-09-13T15:16:19.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.997+0000 7fc2bde00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2b806a190 0x7fc2b815c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.997+0000 7fc2bde00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2b806a570 0x7fc2b815cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.997+0000 7fc2bde00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2b8159200 con 0x7fc2b80c7de0 2024-09-13T15:16:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.997+0000 7fc2bde00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2b80c95b0 con 0x7fc2b806a190 2024-09-13T15:16:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.997+0000 7fc2bde00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b81594c0 con 0x7fc2b806a570 2024-09-13T15:16:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.997+0000 7fc2b6a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2b806a190 0x7fc2b815c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.997+0000 7fc2b6a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fc2b806a190 0x7fc2b815c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60280/0 (socket says 172.21.15.7:60280) 2024-09-13T15:16:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.997+0000 7fc2b6a00640 1 -- 172.21.15.7:0/3792892339 learned_addr learned my addr 172.21.15.7:0/3792892339 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.997+0000 7fc2ae000640 1 --2- 172.21.15.7:0/3792892339 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2b806a570 0x7fc2b815cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.997+0000 7fc2b6a00640 1 -- 172.21.15.7:0/3792892339 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2b806a570 msgr2=0x7fc2b815cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.997+0000 7fc2b6a00640 1 --2- 172.21.15.7:0/3792892339 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2b806a570 0x7fc2b815cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.997+0000 7fc2b6a00640 1 -- 172.21.15.7:0/3792892339 >> v1:172.21.15.7:6789/0 conn(0x7fc2b80c7de0 legacy=0x7fc2b8152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:19.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:19.997+0000 7fc2b6a00640 1 -- 172.21.15.7:0/3792892339 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b81597a0 con 0x7fc2b806a190 2024-09-13T15:16:20.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.001+0000 7fc2b6a00640 1 --2- 172.21.15.7:0/3792892339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b806a190 0x7fc2b815c7d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009870 tx=0x7fc2a801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d64bd164d691 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:20.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.001+0000 7fc2b6000640 1 -- 172.21.15.7:0/3792892339 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a80a9620 con 0x7fc2b806a190 2024-09-13T15:16:20.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.001+0000 7fc2b6000640 1 -- 172.21.15.7:0/3792892339 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a80a9780 con 0x7fc2b806a190 2024-09-13T15:16:20.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.001+0000 7fc2b6000640 1 -- 172.21.15.7:0/3792892339 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a80a9b10 con 0x7fc2b806a190 2024-09-13T15:16:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.001+0000 7fc2bde00640 1 -- 172.21.15.7:0/3792892339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b806a190 msgr2=0x7fc2b815c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.001+0000 7fc2bde00640 1 --2- 172.21.15.7:0/3792892339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b806a190 0x7fc2b815c7d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009870 tx=0x7fc2a801c560 comp rx=0 tx=0).stop 2024-09-13T15:16:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.001+0000 7fc2bde00640 1 -- 172.21.15.7:0/3792892339 shutdown_connections 2024-09-13T15:16:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.001+0000 7fc2bde00640 1 --2- 172.21.15.7:0/3792892339 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2b806a570 0x7fc2b815cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.001+0000 7fc2bde00640 1 --2- 172.21.15.7:0/3792892339 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b806a190 0x7fc2b815c7d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.001+0000 7fc2bde00640 1 -- 172.21.15.7:0/3792892339 >> 172.21.15.7:0/3792892339 conn(0x7fc2b80cce00 msgr2=0x7fc2b80cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.001+0000 7fc2bde00640 1 -- 172.21.15.7:0/3792892339 shutdown_connections 2024-09-13T15:16:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.001+0000 7fc2bde00640 1 -- 172.21.15.7:0/3792892339 wait complete. 2024-09-13T15:16:20.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2bde00640 1 Processor -- start 2024-09-13T15:16:20.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2bde00640 1 -- start start 2024-09-13T15:16:20.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2bde00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b806a190 0x7fc2b8144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:20.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2bde00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2b806a570 0x7fc2b81f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:20.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2bde00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2b80c7de0 0x7fc2b81f6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:20.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2bde00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b8150d90 con 0x7fc2b806a190 2024-09-13T15:16:20.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2bde00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b8147500 con 0x7fc2b806a570 2024-09-13T15:16:20.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2bde00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b81468d0 con 0x7fc2b80c7de0 2024-09-13T15:16:20.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2b6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b806a190 0x7fc2b8144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:20.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2b6a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b806a190 0x7fc2b8144010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60282/0 (socket says 172.21.15.7:60282) 2024-09-13T15:16:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2b6a00640 1 -- 172.21.15.7:0/1180062991 learned_addr learned my addr 172.21.15.7:0/1180062991 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2ae000640 1 --2- 172.21.15.7:0/1180062991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2b806a570 0x7fc2b81f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2b7400640 1 --2- 172.21.15.7:0/1180062991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2b80c7de0 0x7fc2b81f6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2b6a00640 1 -- 172.21.15.7:0/1180062991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2b80c7de0 msgr2=0x7fc2b81f6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2b6a00640 1 --2- 172.21.15.7:0/1180062991 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc2b80c7de0 0x7fc2b81f6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2b6a00640 1 -- 172.21.15.7:0/1180062991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2b806a570 msgr2=0x7fc2b81f5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2b6a00640 1 --2- 172.21.15.7:0/1180062991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2b806a570 0x7fc2b81f5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2b6a00640 1 -- 172.21.15.7:0/1180062991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a80094d0 con 0x7fc2b806a190 2024-09-13T15:16:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2b6a00640 1 --2- 172.21.15.7:0/1180062991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b806a190 0x7fc2b8144010 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc2a801a190 tx=0x7fc2a801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2afe00640 1 -- 172.21.15.7:0/1180062991 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a80a9e80 con 0x7fc2b806a190 2024-09-13T15:16:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2afe00640 1 -- 172.21.15.7:0/1180062991 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a80bc450 con 0x7fc2b806a190 2024-09-13T15:16:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2bde00640 1 -- 172.21.15.7:0/1180062991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b814ce80 con 0x7fc2b806a190 2024-09-13T15:16:20.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2afe00640 1 -- 172.21.15.7:0/1180062991 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a80bc800 con 0x7fc2b806a190 2024-09-13T15:16:20.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.005+0000 7fc2bde00640 1 -- 172.21.15.7:0/1180062991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b81f5860 con 0x7fc2b806a190 2024-09-13T15:16:20.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.009+0000 7fc2bde00640 1 -- 172.21.15.7:0/1180062991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc2b8166380 con 0x7fc2b806a190 2024-09-13T15:16:20.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.009+0000 7fc2afe00640 1 -- 172.21.15.7:0/1180062991 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc2a80c53f0 con 0x7fc2b806a190 2024-09-13T15:16:20.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.009+0000 7fc2afe00640 1 --2- 172.21.15.7:0/1180062991 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc294066690 0x7fc294068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:20.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.009+0000 7fc2afe00640 1 -- 172.21.15.7:0/1180062991 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7fc2a811ef50 con 0x7fc2b806a190 2024-09-13T15:16:20.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.009+0000 7fc2afe00640 1 --2- 172.21.15.7:0/1180062991 >> [v2:172.21.15.77:6816/2210594384,v1:172.21.15.77:6817/2210594384] conn(0x7fc2940703a0 0x7fc294072840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:20.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.009+0000 7fc2afe00640 1 -- 172.21.15.7:0/1180062991 --> [v2:172.21.15.77:6816/2210594384,v1:172.21.15.77:6817/2210594384] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc294072f10 con 0x7fc2940703a0 2024-09-13T15:16:20.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.009+0000 7fc2afe00640 1 -- 172.21.15.7:0/1180062991 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2a8121610 con 0x7fc2b806a190 2024-09-13T15:16:20.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.009+0000 7fc2ae000640 1 --2- 172.21.15.7:0/1180062991 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc294066690 0x7fc294068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:20.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.009+0000 7fc2b7400640 1 --2- 172.21.15.7:0/1180062991 >> [v2:172.21.15.77:6816/2210594384,v1:172.21.15.77:6817/2210594384] conn(0x7fc2940703a0 0x7fc294072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:20.011 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.013+0000 7fc2ae000640 1 --2- 172.21.15.7:0/1180062991 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc294066690 0x7fc294068b50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc2b814d590 tx=0x7fc2a0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:20.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.013+0000 7fc2b7400640 1 --2- 172.21.15.7:0/1180062991 >> [v2:172.21.15.77:6816/2210594384,v1:172.21.15.77:6817/2210594384] conn(0x7fc2940703a0 0x7fc294072840 crc :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:20.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.013+0000 7fc2afe00640 1 -- 172.21.15.7:0/1180062991 <== osd.5 v2:172.21.15.77:6816/2210594384 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc294072f10 con 0x7fc2940703a0 2024-09-13T15:16:20.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.025+0000 7fc2bde00640 1 -- 172.21.15.7:0/1180062991 --> [v2:172.21.15.77:6816/2210594384,v1:172.21.15.77:6817/2210594384] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc2b8152ea0 con 0x7fc2940703a0 2024-09-13T15:16:20.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.025+0000 7fc2afe00640 1 -- 172.21.15.7:0/1180062991 <== osd.5 v2:172.21.15.77:6816/2210594384 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc2b8152ea0 con 0x7fc2940703a0 2024-09-13T15:16:20.026 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T15:16:20.027 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:16:20.027 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T15:16:20.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.025+0000 7fc2bde00640 1 -- 172.21.15.7:0/1180062991 >> [v2:172.21.15.77:6816/2210594384,v1:172.21.15.77:6817/2210594384] conn(0x7fc2940703a0 msgr2=0x7fc294072840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.025+0000 7fc2bde00640 1 --2- 172.21.15.7:0/1180062991 >> [v2:172.21.15.77:6816/2210594384,v1:172.21.15.77:6817/2210594384] conn(0x7fc2940703a0 0x7fc294072840 crc :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.029+0000 7fc2bde00640 1 -- 172.21.15.7:0/1180062991 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc294066690 msgr2=0x7fc294068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.029+0000 7fc2bde00640 1 --2- 172.21.15.7:0/1180062991 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc294066690 0x7fc294068b50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc2b814d590 tx=0x7fc2a0008040 comp rx=0 tx=0).stop 2024-09-13T15:16:20.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.029+0000 7fc2bde00640 1 -- 172.21.15.7:0/1180062991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b806a190 msgr2=0x7fc2b8144010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.029+0000 7fc2bde00640 1 --2- 172.21.15.7:0/1180062991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc2b806a190 0x7fc2b8144010 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc2a801a190 tx=0x7fc2a801ada0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.029+0000 7fc2b7400640 1 -- 172.21.15.7:0/1180062991 reap_dead start 2024-09-13T15:16:20.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.029+0000 7fc2bde00640 1 -- 172.21.15.7:0/1180062991 shutdown_connections 2024-09-13T15:16:20.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.029+0000 7fc2bde00640 1 -- 172.21.15.7:0/1180062991 >> 172.21.15.7:0/1180062991 conn(0x7fc2b80cce00 msgr2=0x7fc2b80c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:20.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.029+0000 7fc2bde00640 1 -- 172.21.15.7:0/1180062991 shutdown_connections 2024-09-13T15:16:20.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.029+0000 7fc2bde00640 1 -- 172.21.15.7:0/1180062991 wait complete. 2024-09-13T15:16:20.059 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T15:16:20.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.341+0000 7f347a600640 1 Processor -- start 2024-09-13T15:16:20.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.341+0000 7f347a600640 1 -- start start 2024-09-13T15:16:20.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.341+0000 7f347a600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3474157690 0x7f347415def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:20.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.341+0000 7f347a600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f347415e430 con 0x7f347415e950 2024-09-13T15:16:20.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.341+0000 7f347a600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34740c2ab0 con 0x7f3474157a70 2024-09-13T15:16:20.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.341+0000 7f347a600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347415d4e0 con 0x7f3474157690 2024-09-13T15:16:20.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.341+0000 7f3473400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3474157690 0x7f347415def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:20.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.341+0000 7f3473400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3474157690 0x7f347415def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:32940/0 (socket says 172.21.15.7:32940) 2024-09-13T15:16:20.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.341+0000 7f3473400640 1 -- 172.21.15.7:0/2172336899 learned_addr learned my addr 172.21.15.7:0/2172336899 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:20.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.345+0000 7f3473400640 1 -- 172.21.15.7:0/2172336899 >> v1:172.21.15.77:6789/0 conn(0x7f3474157a70 legacy=0x7f34740b29e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T15:16:20.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.345+0000 7f3473400640 1 -- 172.21.15.7:0/2172336899 >> v1:172.21.15.7:6789/0 conn(0x7f347415e950 legacy=0x7f34740cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:20.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.345+0000 7f3473400640 1 -- 172.21.15.7:0/2172336899 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34740c2210 con 0x7f3474157690 2024-09-13T15:16:20.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.361+0000 7f3473400640 1 --2- 172.21.15.7:0/2172336899 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3474157690 0x7f347415def0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f346c009e80 tx=0x7f346c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25905434b6cfde81 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.365+0000 7f3472000640 1 -- 172.21.15.7:0/2172336899 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c0a56b0 con 0x7f3474157690 2024-09-13T15:16:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.365+0000 7f3472000640 1 -- 172.21.15.7:0/2172336899 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346c0a5810 con 0x7f3474157690 2024-09-13T15:16:20.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.365+0000 7f3472000640 1 -- 172.21.15.7:0/2172336899 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346c0a5ba0 con 0x7f3474157690 2024-09-13T15:16:20.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.369+0000 7f347a600640 1 -- 172.21.15.7:0/2172336899 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3474157690 msgr2=0x7f347415def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.369+0000 7f347a600640 1 --2- 172.21.15.7:0/2172336899 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3474157690 0x7f347415def0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f346c009e80 tx=0x7f346c01c940 comp rx=0 tx=0).stop 2024-09-13T15:16:20.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.369+0000 7f347a600640 1 -- 172.21.15.7:0/2172336899 shutdown_connections 2024-09-13T15:16:20.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.369+0000 7f347a600640 1 --2- 172.21.15.7:0/2172336899 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3474157690 0x7f347415def0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.369+0000 7f347a600640 1 -- 172.21.15.7:0/2172336899 >> 172.21.15.7:0/2172336899 conn(0x7f3474065d40 msgr2=0x7f3474066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:20.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.373+0000 7f347a600640 1 -- 172.21.15.7:0/2172336899 shutdown_connections 2024-09-13T15:16:20.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.373+0000 7f347a600640 1 -- 172.21.15.7:0/2172336899 wait complete. 2024-09-13T15:16:20.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.377+0000 7f347a600640 1 Processor -- start 2024-09-13T15:16:20.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.377+0000 7f347a600640 1 -- start start 2024-09-13T15:16:20.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.381+0000 7f347a600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3474157a70 0x7f3474202810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:20.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.381+0000 7f347a600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f347415e950 0x7f34741fe740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:20.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.381+0000 7f347a600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34740c5e80 0x7f3474153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:20.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.381+0000 7f347a600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34741fec80 con 0x7f34740c5e80 2024-09-13T15:16:20.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.381+0000 7f3473400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3474157a70 0x7f3474202810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.381+0000 7f3473400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3474157a70 0x7f3474202810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:32944/0 (socket says 172.21.15.7:32944) 2024-09-13T15:16:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.381+0000 7f3473400640 1 -- 172.21.15.7:0/468663373 learned_addr learned my addr 172.21.15.7:0/468663373 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.381+0000 7f3472a00640 1 --2- 172.21.15.7:0/468663373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f347415e950 0x7f34741fe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.381+0000 7f3473e00640 1 --2- 172.21.15.7:0/468663373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34740c5e80 0x7f3474153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.381+0000 7f347a600640 1 -- 172.21.15.7:0/468663373 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34740c9340 con 0x7f347415e950 2024-09-13T15:16:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.381+0000 7f347a600640 1 -- 172.21.15.7:0/468663373 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34740c6cc0 con 0x7f3474157a70 2024-09-13T15:16:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.385+0000 7f3473e00640 1 -- 172.21.15.7:0/468663373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3474157a70 msgr2=0x7f3474202810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.385+0000 7f3473e00640 1 --2- 172.21.15.7:0/468663373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3474157a70 0x7f3474202810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.385+0000 7f3473e00640 1 -- 172.21.15.7:0/468663373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f347415e950 msgr2=0x7f34741fe740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.385+0000 7f3473e00640 1 --2- 172.21.15.7:0/468663373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f347415e950 0x7f34741fe740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.385+0000 7f3473e00640 1 -- 172.21.15.7:0/468663373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c009b30 con 0x7f34740c5e80 2024-09-13T15:16:20.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.385+0000 7f3473e00640 1 --2- 172.21.15.7:0/468663373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34740c5e80 0x7f3474153230 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f346000b3e0 tx=0x7f346000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:20.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.385+0000 7f346b400640 1 -- 172.21.15.7:0/468663373 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460011830 con 0x7f34740c5e80 2024-09-13T15:16:20.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.385+0000 7f346b400640 1 -- 172.21.15.7:0/468663373 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3460011990 con 0x7f34740c5e80 2024-09-13T15:16:20.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.385+0000 7f346b400640 1 -- 172.21.15.7:0/468663373 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460011d40 con 0x7f34740c5e80 2024-09-13T15:16:20.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.385+0000 7f347a600640 1 -- 172.21.15.7:0/468663373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34740c9060 con 0x7f34740c5e80 2024-09-13T15:16:20.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.385+0000 7f347a600640 1 -- 172.21.15.7:0/468663373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3474202010 con 0x7f34740c5e80 2024-09-13T15:16:20.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.393+0000 7f347a600640 1 -- 172.21.15.7:0/468663373 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f347415e200 con 0x7f34740c5e80 2024-09-13T15:16:20.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.397+0000 7f346b400640 1 -- 172.21.15.7:0/468663373 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f346001a400 con 0x7f34740c5e80 2024-09-13T15:16:20.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.401+0000 7f346b400640 1 --2- 172.21.15.7:0/468663373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f34540666c0 0x7f3454068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:20.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.401+0000 7f346b400640 1 -- 172.21.15.7:0/468663373 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f3460084b30 con 0x7f34740c5e80 2024-09-13T15:16:20.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.405+0000 7f3473400640 1 --2- 172.21.15.7:0/468663373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f34540666c0 0x7f3454068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:20.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.409+0000 7f346b400640 1 -- 172.21.15.7:0/468663373 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3460051a20 con 0x7f34740c5e80 2024-09-13T15:16:20.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.413+0000 7f3473400640 1 --2- 172.21.15.7:0/468663373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f34540666c0 0x7f3454068b80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f346c01a570 tx=0x7f346c0a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:20.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.689+0000 7f347a600640 1 -- 172.21.15.7:0/468663373 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f34740c1eb0 con 0x7f34540666c0 2024-09-13T15:16:20.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.689+0000 7f346b400640 1 -- 172.21.15.7:0/468663373 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f346c0a5980 con 0x7f34540666c0 2024-09-13T15:16:20.688 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T15:16:20.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.689+0000 7f347a600640 1 -- 172.21.15.7:0/468663373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f34540666c0 msgr2=0x7f3454068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.689+0000 7f347a600640 1 --2- 172.21.15.7:0/468663373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f34540666c0 0x7f3454068b80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f346c01a570 tx=0x7f346c0a7070 comp rx=0 tx=0).stop 2024-09-13T15:16:20.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.689+0000 7f347a600640 1 -- 172.21.15.7:0/468663373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34740c5e80 msgr2=0x7f3474153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.689+0000 7f347a600640 1 --2- 172.21.15.7:0/468663373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34740c5e80 0x7f3474153230 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f346000b3e0 tx=0x7f346000b8a0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.689+0000 7f347a600640 1 -- 172.21.15.7:0/468663373 shutdown_connections 2024-09-13T15:16:20.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.689+0000 7f347a600640 1 --2- 172.21.15.7:0/468663373 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f34540666c0 0x7f3454068b80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.689+0000 7f347a600640 1 --2- 172.21.15.7:0/468663373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34740c5e80 0x7f3474153230 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.689+0000 7f347a600640 1 --2- 172.21.15.7:0/468663373 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f347415e950 0x7f34741fe740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.689+0000 7f347a600640 1 --2- 172.21.15.7:0/468663373 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f3474157a70 0x7f3474202810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.689+0000 7f347a600640 1 -- 172.21.15.7:0/468663373 >> 172.21.15.7:0/468663373 conn(0x7f3474065d40 msgr2=0x7f347415ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:20.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.689+0000 7f347a600640 1 -- 172.21.15.7:0/468663373 shutdown_connections 2024-09-13T15:16:20.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.689+0000 7f347a600640 1 -- 172.21.15.7:0/468663373 wait complete. 2024-09-13T15:16:20.711 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T15:16:20.712 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:16:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.857+0000 7f643c800640 1 Processor -- start 2024-09-13T15:16:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.857+0000 7f643c800640 1 -- start start 2024-09-13T15:16:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.857+0000 7f643c800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f64340c3ac0 0x7f6434153030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.857+0000 7f643c800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6434159220 con 0x7f64340c4c00 2024-09-13T15:16:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.857+0000 7f643c800640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64340b1ce0 con 0x7f64340cb1c0 2024-09-13T15:16:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.857+0000 7f643c800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643406b080 con 0x7f64340c3ac0 2024-09-13T15:16:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.857+0000 7f6439e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f64340c4c00 0x7f64340c4fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:40800/0 (socket says 172.21.15.7:40800) 2024-09-13T15:16:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.857+0000 7f6439e00640 1 -- 172.21.15.7:0/2586637779 learned_addr learned my addr 172.21.15.7:0/2586637779 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:16:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.857+0000 7f6439400640 1 --2- 172.21.15.7:0/2586637779 >> v2:172.21.15.7:3300/0 conn(0x7f64340c3ac0 0x7f6434153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.861+0000 7f6439400640 1 -- 172.21.15.7:0/2586637779 >> v1:172.21.15.77:6789/0 conn(0x7f64340cb1c0 legacy=0x7f643406b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.861+0000 7f6439400640 1 -- 172.21.15.7:0/2586637779 >> v1:172.21.15.7:6789/0 conn(0x7f64340c4c00 legacy=0x7f64340c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.861+0000 7f6439400640 1 -- 172.21.15.7:0/2586637779 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64341594e0 con 0x7f64340c3ac0 2024-09-13T15:16:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.861+0000 7f6439400640 1 --2- 172.21.15.7:0/2586637779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64340c3ac0 0x7f6434153030 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f643406b1c0 tx=0x7f642401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc1532f7b74b2a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.861+0000 7f6438a00640 1 -- 172.21.15.7:0/2586637779 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64240a8990 con 0x7f64340c3ac0 2024-09-13T15:16:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.861+0000 7f6438a00640 1 -- 172.21.15.7:0/2586637779 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64240a8af0 con 0x7f64340c3ac0 2024-09-13T15:16:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.861+0000 7f6438a00640 1 -- 172.21.15.7:0/2586637779 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64240a8e80 con 0x7f64340c3ac0 2024-09-13T15:16:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.861+0000 7f643c800640 1 -- 172.21.15.7:0/2586637779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64340c3ac0 msgr2=0x7f6434153030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.861+0000 7f643c800640 1 --2- 172.21.15.7:0/2586637779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64340c3ac0 0x7f6434153030 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f643406b1c0 tx=0x7f642401ec90 comp rx=0 tx=0).stop 2024-09-13T15:16:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f643c800640 1 -- 172.21.15.7:0/2586637779 shutdown_connections 2024-09-13T15:16:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f643c800640 1 --2- 172.21.15.7:0/2586637779 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64340c3ac0 0x7f6434153030 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f643c800640 1 -- 172.21.15.7:0/2586637779 >> 172.21.15.7:0/2586637779 conn(0x7f64340cefc0 msgr2=0x7f64340cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f643c800640 1 -- 172.21.15.7:0/2586637779 shutdown_connections 2024-09-13T15:16:20.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f643c800640 1 -- 172.21.15.7:0/2586637779 wait complete. 2024-09-13T15:16:20.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f643c800640 1 Processor -- start 2024-09-13T15:16:20.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f643c800640 1 -- start start 2024-09-13T15:16:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f643c800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64340c4c00 0x7f643415a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f643c800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64340cb1c0 0x7f643414f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f643c800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f643415a880 0x7f643414fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f643c800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64341561b0 con 0x7f64340c4c00 2024-09-13T15:16:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f643c800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64341542d0 con 0x7f64340cb1c0 2024-09-13T15:16:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f643c800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6434154980 con 0x7f643415a880 2024-09-13T15:16:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f6439e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64340c4c00 0x7f643415a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f6439e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64340c4c00 0x7f643415a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60318/0 (socket says 172.21.15.7:60318) 2024-09-13T15:16:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f6439e00640 1 -- 172.21.15.7:0/2673698267 learned_addr learned my addr 172.21.15.7:0/2673698267 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f6439400640 1 --2- 172.21.15.7:0/2673698267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64340cb1c0 0x7f643414f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f643a800640 1 --2- 172.21.15.7:0/2673698267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f643415a880 0x7f643414fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f6439e00640 1 -- 172.21.15.7:0/2673698267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f643415a880 msgr2=0x7f643414fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f6439e00640 1 --2- 172.21.15.7:0/2673698267 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f643415a880 0x7f643414fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f6439e00640 1 -- 172.21.15.7:0/2673698267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64340cb1c0 msgr2=0x7f643414f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f6439e00640 1 --2- 172.21.15.7:0/2673698267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64340cb1c0 0x7f643414f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f6439e00640 1 -- 172.21.15.7:0/2673698267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6424009420 con 0x7f64340c4c00 2024-09-13T15:16:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.865+0000 7f6439e00640 1 --2- 172.21.15.7:0/2673698267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64340c4c00 0x7f643415a340 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f642800c530 tx=0x7f642800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.869+0000 7f642e000640 1 -- 172.21.15.7:0/2673698267 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428005cf0 con 0x7f64340c4c00 2024-09-13T15:16:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.869+0000 7f642e000640 1 -- 172.21.15.7:0/2673698267 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6428005e50 con 0x7f64340c4c00 2024-09-13T15:16:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.869+0000 7f642e000640 1 -- 172.21.15.7:0/2673698267 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6428007270 con 0x7f64340c4c00 2024-09-13T15:16:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.869+0000 7f643c800640 1 -- 172.21.15.7:0/2673698267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64341546e0 con 0x7f64340c4c00 2024-09-13T15:16:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.869+0000 7f643c800640 1 -- 172.21.15.7:0/2673698267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6434153db0 con 0x7f64340c4c00 2024-09-13T15:16:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.869+0000 7f643c800640 1 -- 172.21.15.7:0/2673698267 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6434067bc0 con 0x7f64340c4c00 2024-09-13T15:16:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.869+0000 7f642e000640 1 -- 172.21.15.7:0/2673698267 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f64280073d0 con 0x7f64340c4c00 2024-09-13T15:16:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.869+0000 7f642e000640 1 --2- 172.21.15.7:0/2673698267 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6418066690 0x7f6418068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.869+0000 7f642e000640 1 -- 172.21.15.7:0/2673698267 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f6428084400 con 0x7f64340c4c00 2024-09-13T15:16:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.869+0000 7f642e000640 1 --2- 172.21.15.7:0/2673698267 >> [v2:172.21.15.77:6807/1578568057,v1:172.21.15.77:6809/1578568057] conn(0x7f64180703a0 0x7f6418072840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.869+0000 7f642e000640 1 -- 172.21.15.7:0/2673698267 --> [v2:172.21.15.77:6807/1578568057,v1:172.21.15.77:6809/1578568057] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6418072f10 con 0x7f64180703a0 2024-09-13T15:16:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.869+0000 7f642e000640 1 -- 172.21.15.7:0/2673698267 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6428084770 con 0x7f64340c4c00 2024-09-13T15:16:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.869+0000 7f6439400640 1 --2- 172.21.15.7:0/2673698267 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6418066690 0x7f6418068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.869+0000 7f643a800640 1 --2- 172.21.15.7:0/2673698267 >> [v2:172.21.15.77:6807/1578568057,v1:172.21.15.77:6809/1578568057] conn(0x7f64180703a0 0x7f6418072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.873+0000 7f6439400640 1 --2- 172.21.15.7:0/2673698267 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6418066690 0x7f6418068b50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f64240b2000 tx=0x7f6424008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.873+0000 7f643a800640 1 --2- 172.21.15.7:0/2673698267 >> [v2:172.21.15.77:6807/1578568057,v1:172.21.15.77:6809/1578568057] conn(0x7f64180703a0 0x7f6418072840 crc :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:20.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.873+0000 7f642e000640 1 -- 172.21.15.7:0/2673698267 <== osd.6 v2:172.21.15.77:6807/1578568057 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6418072f10 con 0x7f64180703a0 2024-09-13T15:16:20.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.885+0000 7f643c800640 1 -- 172.21.15.7:0/2673698267 --> [v2:172.21.15.77:6807/1578568057,v1:172.21.15.77:6809/1578568057] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f6434159d80 con 0x7f64180703a0 2024-09-13T15:16:20.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.889+0000 7f642e000640 1 -- 172.21.15.7:0/2673698267 <== osd.6 v2:172.21.15.77:6807/1578568057 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f6430001de0 con 0x7f64180703a0 2024-09-13T15:16:20.887 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T15:16:20.887 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:16:20.887 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T15:16:20.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.889+0000 7f643c800640 1 -- 172.21.15.7:0/2673698267 >> [v2:172.21.15.77:6807/1578568057,v1:172.21.15.77:6809/1578568057] conn(0x7f64180703a0 msgr2=0x7f6418072840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.889+0000 7f643c800640 1 --2- 172.21.15.7:0/2673698267 >> [v2:172.21.15.77:6807/1578568057,v1:172.21.15.77:6809/1578568057] conn(0x7f64180703a0 0x7f6418072840 crc :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.889+0000 7f643c800640 1 -- 172.21.15.7:0/2673698267 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6418066690 msgr2=0x7f6418068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.889+0000 7f643c800640 1 --2- 172.21.15.7:0/2673698267 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f6418066690 0x7f6418068b50 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f64240b2000 tx=0x7f6424008040 comp rx=0 tx=0).stop 2024-09-13T15:16:20.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.889+0000 7f643c800640 1 -- 172.21.15.7:0/2673698267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64340c4c00 msgr2=0x7f643415a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:20.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.889+0000 7f643c800640 1 --2- 172.21.15.7:0/2673698267 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64340c4c00 0x7f643415a340 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f642800c530 tx=0x7f642800c9f0 comp rx=0 tx=0).stop 2024-09-13T15:16:20.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.889+0000 7f643a800640 1 -- 172.21.15.7:0/2673698267 reap_dead start 2024-09-13T15:16:20.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.889+0000 7f643c800640 1 -- 172.21.15.7:0/2673698267 shutdown_connections 2024-09-13T15:16:20.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.889+0000 7f643c800640 1 -- 172.21.15.7:0/2673698267 >> 172.21.15.7:0/2673698267 conn(0x7f64340cefc0 msgr2=0x7f64340c3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:20.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.889+0000 7f643c800640 1 -- 172.21.15.7:0/2673698267 shutdown_connections 2024-09-13T15:16:20.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:20.889+0000 7f643c800640 1 -- 172.21.15.7:0/2673698267 wait complete. 2024-09-13T15:16:20.905 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T15:16:21.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.181+0000 7fd73be00640 1 Processor -- start 2024-09-13T15:16:21.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.185+0000 7fd73be00640 1 -- start start 2024-09-13T15:16:21.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.189+0000 7fd73be00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd73c14f0f0 0x7fd73c06f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:21.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.189+0000 7fd73be00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73c154ed0 0x7fd73c0c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.189+0000 7fd73be00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73c155410 con 0x7fd73c066450 2024-09-13T15:16:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.189+0000 7fd73be00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73c155f30 con 0x7fd73c14f0f0 2024-09-13T15:16:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.189+0000 7fd73be00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c0c6370 con 0x7fd73c154ed0 2024-09-13T15:16:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.189+0000 7fd73aa00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd73c14f0f0 0x7fd73c06f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:21.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.189+0000 7fd73a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73c154ed0 0x7fd73c0c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:21.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.189+0000 7fd73a000640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73c154ed0 0x7fd73c0c70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:32958/0 (socket says 172.21.15.7:32958) 2024-09-13T15:16:21.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.189+0000 7fd73a000640 1 -- 172.21.15.7:0/3782401430 learned_addr learned my addr 172.21.15.7:0/3782401430 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:21.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.189+0000 7fd73a000640 1 -- 172.21.15.7:0/3782401430 >> v2:172.21.15.77:3300/0 conn(0x7fd73c14f0f0 msgr2=0x7fd73c06f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:21.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.189+0000 7fd73a000640 1 --2- 172.21.15.7:0/3782401430 >> v2:172.21.15.77:3300/0 conn(0x7fd73c14f0f0 0x7fd73c06f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:21.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.189+0000 7fd73a000640 1 -- 172.21.15.7:0/3782401430 >> v1:172.21.15.77:6789/0 conn(0x7fd73c066450 legacy=0x7fd73c1584c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T15:16:21.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.189+0000 7fd73a000640 1 -- 172.21.15.7:0/3782401430 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73c1556b0 con 0x7fd73c154ed0 2024-09-13T15:16:21.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.197+0000 7fd73a000640 1 --2- 172.21.15.7:0/3782401430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73c154ed0 0x7fd73c0c70a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009870 tx=0x7fd72c01ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6203d09848d9c0b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:21.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.197+0000 7fd739600640 1 -- 172.21.15.7:0/3782401430 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c0a89d0 con 0x7fd73c154ed0 2024-09-13T15:16:21.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.197+0000 7fd739600640 1 -- 172.21.15.7:0/3782401430 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72c0a8b30 con 0x7fd73c154ed0 2024-09-13T15:16:21.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.197+0000 7fd739600640 1 -- 172.21.15.7:0/3782401430 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c0b0440 con 0x7fd73c154ed0 2024-09-13T15:16:21.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.201+0000 7fd73be00640 1 -- 172.21.15.7:0/3782401430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73c154ed0 msgr2=0x7fd73c0c70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:21.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.201+0000 7fd73be00640 1 --2- 172.21.15.7:0/3782401430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73c154ed0 0x7fd73c0c70a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009870 tx=0x7fd72c01ed30 comp rx=0 tx=0).stop 2024-09-13T15:16:21.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.205+0000 7fd73be00640 1 -- 172.21.15.7:0/3782401430 shutdown_connections 2024-09-13T15:16:21.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.205+0000 7fd73be00640 1 --2- 172.21.15.7:0/3782401430 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73c154ed0 0x7fd73c0c70a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:21.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.205+0000 7fd73be00640 1 --2- 172.21.15.7:0/3782401430 >> v2:172.21.15.77:3300/0 conn(0x7fd73c14f0f0 0x7fd73c06f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:21.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.205+0000 7fd73be00640 1 -- 172.21.15.7:0/3782401430 >> 172.21.15.7:0/3782401430 conn(0x7fd73c06b7d0 msgr2=0x7fd73c065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:21.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.205+0000 7fd73be00640 1 -- 172.21.15.7:0/3782401430 shutdown_connections 2024-09-13T15:16:21.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.205+0000 7fd73be00640 1 -- 172.21.15.7:0/3782401430 wait complete. 2024-09-13T15:16:21.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.209+0000 7fd73be00640 1 Processor -- start 2024-09-13T15:16:21.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.209+0000 7fd73be00640 1 -- start start 2024-09-13T15:16:21.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.213+0000 7fd73be00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73c066450 0x7fd73c14c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:21.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.213+0000 7fd73be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd73c14f0f0 0x7fd73c151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:21.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.213+0000 7fd73be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd73c154ed0 0x7fd73c1492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:21.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.213+0000 7fd73be00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c157440 con 0x7fd73c154ed0 2024-09-13T15:16:21.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.213+0000 7fd73be00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c156aa0 con 0x7fd73c14f0f0 2024-09-13T15:16:21.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.213+0000 7fd73be00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73c156cd0 con 0x7fd73c066450 2024-09-13T15:16:21.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.213+0000 7fd73aa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73c066450 0x7fd73c14c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:21.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.213+0000 7fd73aa00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73c066450 0x7fd73c14c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:32962/0 (socket says 172.21.15.7:32962) 2024-09-13T15:16:21.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.213+0000 7fd73aa00640 1 -- 172.21.15.7:0/303357492 learned_addr learned my addr 172.21.15.7:0/303357492 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:21.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.213+0000 7fd73a000640 1 --2- 172.21.15.7:0/303357492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd73c14f0f0 0x7fd73c151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:21.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.217+0000 7fd73a000640 1 -- 172.21.15.7:0/303357492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73c066450 msgr2=0x7fd73c14c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:21.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.217+0000 7fd73a000640 1 --2- 172.21.15.7:0/303357492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73c066450 0x7fd73c14c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:21.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.217+0000 7fd73a000640 1 -- 172.21.15.7:0/303357492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd73c154ed0 msgr2=0x7fd73c1492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:21.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.217+0000 7fd73a000640 1 --2- 172.21.15.7:0/303357492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd73c154ed0 0x7fd73c1492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:21.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.217+0000 7fd73a000640 1 -- 172.21.15.7:0/303357492 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c0094d0 con 0x7fd73c14f0f0 2024-09-13T15:16:21.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.217+0000 7fd73a000640 1 --2- 172.21.15.7:0/303357492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd73c14f0f0 0x7fd73c151250 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0af000 tx=0x7fd72c01bad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:21.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.217+0000 7fd732a00640 1 -- 172.21.15.7:0/303357492 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c0bf070 con 0x7fd73c14f0f0 2024-09-13T15:16:21.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.217+0000 7fd73be00640 1 -- 172.21.15.7:0/303357492 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd73c1586e0 con 0x7fd73c14f0f0 2024-09-13T15:16:21.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.217+0000 7fd73be00640 1 -- 172.21.15.7:0/303357492 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73c158ca0 con 0x7fd73c14f0f0 2024-09-13T15:16:21.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.217+0000 7fd732a00640 1 -- 172.21.15.7:0/303357492 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72c0b1b90 con 0x7fd73c14f0f0 2024-09-13T15:16:21.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.217+0000 7fd732a00640 1 -- 172.21.15.7:0/303357492 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c0bf070 con 0x7fd73c14f0f0 2024-09-13T15:16:21.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.225+0000 7fd732a00640 1 -- 172.21.15.7:0/303357492 <== mon.1 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd72c0b7070 con 0x7fd73c14f0f0 2024-09-13T15:16:21.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.225+0000 7fd73be00640 1 -- 172.21.15.7:0/303357492 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd714005260 con 0x7fd73c14f0f0 2024-09-13T15:16:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.225+0000 7fd732a00640 1 --2- 172.21.15.7:0/303357492 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd71c066750 0x7fd71c068c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:21.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.225+0000 7fd732a00640 1 -- 172.21.15.7:0/303357492 <== mon.1 v2:172.21.15.77:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7fd72c121bd0 con 0x7fd73c14f0f0 2024-09-13T15:16:21.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.233+0000 7fd732a00640 1 -- 172.21.15.7:0/303357492 <== mon.1 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd72c0ee910 con 0x7fd73c14f0f0 2024-09-13T15:16:21.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.237+0000 7fd73aa00640 1 --2- 172.21.15.7:0/303357492 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd71c066750 0x7fd71c068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:21.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.245+0000 7fd73aa00640 1 --2- 172.21.15.7:0/303357492 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd71c066750 0x7fd71c068c10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd72800ab90 tx=0x7fd728008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:21.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.733+0000 7fd73be00640 1 -- 172.21.15.7:0/303357492 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fd714000bd0 con 0x7fd71c066750 2024-09-13T15:16:21.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.733+0000 7fd732a00640 1 -- 172.21.15.7:0/303357492 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd714000bd0 con 0x7fd71c066750 2024-09-13T15:16:21.732 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T15:16:21.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.737+0000 7fd73be00640 1 -- 172.21.15.7:0/303357492 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd71c066750 msgr2=0x7fd71c068c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:21.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.737+0000 7fd73be00640 1 --2- 172.21.15.7:0/303357492 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd71c066750 0x7fd71c068c10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd72800ab90 tx=0x7fd728008040 comp rx=0 tx=0).stop 2024-09-13T15:16:21.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.741+0000 7fd73be00640 1 -- 172.21.15.7:0/303357492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd73c14f0f0 msgr2=0x7fd73c151250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:21.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.741+0000 7fd73be00640 1 --2- 172.21.15.7:0/303357492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd73c14f0f0 0x7fd73c151250 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd72c0af000 tx=0x7fd72c01bad0 comp rx=0 tx=0).stop 2024-09-13T15:16:21.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.741+0000 7fd73be00640 1 -- 172.21.15.7:0/303357492 shutdown_connections 2024-09-13T15:16:21.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.741+0000 7fd73be00640 1 --2- 172.21.15.7:0/303357492 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fd71c066750 0x7fd71c068c10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:21.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.741+0000 7fd73be00640 1 --2- 172.21.15.7:0/303357492 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd73c154ed0 0x7fd73c1492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:21.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.741+0000 7fd73be00640 1 --2- 172.21.15.7:0/303357492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd73c14f0f0 0x7fd73c151250 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:21.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.741+0000 7fd73be00640 1 --2- 172.21.15.7:0/303357492 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fd73c066450 0x7fd73c14c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:21.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.741+0000 7fd73be00640 1 -- 172.21.15.7:0/303357492 >> 172.21.15.7:0/303357492 conn(0x7fd73c06b7d0 msgr2=0x7fd73c0ca660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:21.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.741+0000 7fd73be00640 1 -- 172.21.15.7:0/303357492 shutdown_connections 2024-09-13T15:16:21.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:21.741+0000 7fd73be00640 1 -- 172.21.15.7:0/303357492 wait complete. 2024-09-13T15:16:21.810 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T15:16:21.810 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T15:16:22.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.057+0000 7f2d20a00640 1 Processor -- start 2024-09-13T15:16:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.057+0000 7f2d20a00640 1 -- start start 2024-09-13T15:16:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.057+0000 7f2d20a00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2d1c071760 0x7f2d1c06a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.057+0000 7f2d20a00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d1c06d9c0 0x7f2d1c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.057+0000 7f2d20a00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1c06e120 con 0x7f2d1c071b40 2024-09-13T15:16:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.057+0000 7f2d20a00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1c158fd0 con 0x7f2d1c06d9c0 2024-09-13T15:16:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.057+0000 7f2d20a00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d1c1592b0 con 0x7f2d1c071760 2024-09-13T15:16:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.057+0000 7f2d1be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d1c06d9c0 0x7f2d1c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.057+0000 7f2d1be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f2d1c06d9c0 0x7f2d1c06ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60324/0 (socket says 172.21.15.7:60324) 2024-09-13T15:16:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.057+0000 7f2d1b400640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2d1c071760 0x7f2d1c06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.057+0000 7f2d1be00640 1 -- 172.21.15.7:0/649401760 learned_addr learned my addr 172.21.15.7:0/649401760 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.057+0000 7f2d1be00640 1 -- 172.21.15.7:0/649401760 >> v2:172.21.15.77:3300/0 conn(0x7f2d1c071760 msgr2=0x7f2d1c06a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.057+0000 7f2d1be00640 1 --2- 172.21.15.7:0/649401760 >> v2:172.21.15.77:3300/0 conn(0x7f2d1c071760 0x7f2d1c06a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.057+0000 7f2d1be00640 1 -- 172.21.15.7:0/649401760 >> v1:172.21.15.7:6789/0 conn(0x7f2d1c071b40 legacy=0x7f2d1c152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.057+0000 7f2d1be00640 1 -- 172.21.15.7:0/649401760 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c159590 con 0x7f2d1c06d9c0 2024-09-13T15:16:22.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.061+0000 7f2d1be00640 1 --2- 172.21.15.7:0/649401760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c06d9c0 0x7f2d1c06ee00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0ca570 tx=0x7f2d1401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59927067d3de2c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:22.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d1aa00640 1 -- 172.21.15.7:0/649401760 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d140af400 con 0x7f2d1c06d9c0 2024-09-13T15:16:22.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d1aa00640 1 -- 172.21.15.7:0/649401760 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d140ab050 con 0x7f2d1c06d9c0 2024-09-13T15:16:22.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d1aa00640 1 -- 172.21.15.7:0/649401760 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d140af780 con 0x7f2d1c06d9c0 2024-09-13T15:16:22.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d20a00640 1 -- 172.21.15.7:0/649401760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c06d9c0 msgr2=0x7f2d1c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d20a00640 1 --2- 172.21.15.7:0/649401760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c06d9c0 0x7f2d1c06ee00 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0ca570 tx=0x7f2d1401f1e0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d20a00640 1 -- 172.21.15.7:0/649401760 shutdown_connections 2024-09-13T15:16:22.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d20a00640 1 --2- 172.21.15.7:0/649401760 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c06d9c0 0x7f2d1c06ee00 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d20a00640 1 --2- 172.21.15.7:0/649401760 >> v2:172.21.15.77:3300/0 conn(0x7f2d1c071760 0x7f2d1c06a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d20a00640 1 -- 172.21.15.7:0/649401760 >> 172.21.15.7:0/649401760 conn(0x7f2d1c0cc9b0 msgr2=0x7f2d1c0ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:22.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d20a00640 1 -- 172.21.15.7:0/649401760 shutdown_connections 2024-09-13T15:16:22.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d20a00640 1 -- 172.21.15.7:0/649401760 wait complete. 2024-09-13T15:16:22.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d20a00640 1 Processor -- start 2024-09-13T15:16:22.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d20a00640 1 -- start start 2024-09-13T15:16:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d20a00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d1c06d9c0 0x7f2d1c1e0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d20a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c071760 0x7f2d1c0ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d20a00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d1c071b40 0x7f2d1c1475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d20a00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c1e1140 con 0x7f2d1c071760 2024-09-13T15:16:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d20a00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c1e0060 con 0x7f2d1c071b40 2024-09-13T15:16:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d20a00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c0cc690 con 0x7f2d1c06d9c0 2024-09-13T15:16:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d13e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c071760 0x7f2d1c0ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d13e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c071760 0x7f2d1c0ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60330/0 (socket says 172.21.15.7:60330) 2024-09-13T15:16:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d13e00640 1 -- 172.21.15.7:0/3313069953 learned_addr learned my addr 172.21.15.7:0/3313069953 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.065+0000 7f2d1be00640 1 --2- 172.21.15.7:0/3313069953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d1c071b40 0x7f2d1c1475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.069+0000 7f2d1b400640 1 --2- 172.21.15.7:0/3313069953 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d1c06d9c0 0x7f2d1c1e0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.069+0000 7f2d13e00640 1 -- 172.21.15.7:0/3313069953 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d1c06d9c0 msgr2=0x7f2d1c1e0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.069+0000 7f2d13e00640 1 --2- 172.21.15.7:0/3313069953 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d1c06d9c0 0x7f2d1c1e0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.069+0000 7f2d13e00640 1 -- 172.21.15.7:0/3313069953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d1c071b40 msgr2=0x7f2d1c1475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.069+0000 7f2d13e00640 1 --2- 172.21.15.7:0/3313069953 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d1c071b40 0x7f2d1c1475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.069+0000 7f2d13e00640 1 -- 172.21.15.7:0/3313069953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d14009b30 con 0x7f2d1c071760 2024-09-13T15:16:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.069+0000 7f2d1b400640 1 --2- 172.21.15.7:0/3313069953 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2d1c06d9c0 0x7f2d1c1e0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:16:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.069+0000 7f2d13e00640 1 --2- 172.21.15.7:0/3313069953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c071760 0x7f2d1c0ca7b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400c3c0 tx=0x7f2d0400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.069+0000 7f2d13400640 1 -- 172.21.15.7:0/3313069953 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d040052d0 con 0x7f2d1c071760 2024-09-13T15:16:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.069+0000 7f2d13400640 1 -- 172.21.15.7:0/3313069953 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d04005430 con 0x7f2d1c071760 2024-09-13T15:16:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.069+0000 7f2d20a00640 1 -- 172.21.15.7:0/3313069953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1c0cbbf0 con 0x7f2d1c071760 2024-09-13T15:16:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.069+0000 7f2d13400640 1 -- 172.21.15.7:0/3313069953 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d04003840 con 0x7f2d1c071760 2024-09-13T15:16:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.069+0000 7f2d20a00640 1 -- 172.21.15.7:0/3313069953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1c14fdd0 con 0x7f2d1c071760 2024-09-13T15:16:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.069+0000 7f2d20a00640 1 -- 172.21.15.7:0/3313069953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2d1c06ddd0 con 0x7f2d1c071760 2024-09-13T15:16:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.069+0000 7f2d13400640 1 -- 172.21.15.7:0/3313069953 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2d040039a0 con 0x7f2d1c071760 2024-09-13T15:16:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.069+0000 7f2d13400640 1 --2- 172.21.15.7:0/3313069953 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2cf8066690 0x7f2cf8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.069+0000 7f2d13400640 1 -- 172.21.15.7:0/3313069953 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f2d040843e0 con 0x7f2d1c071760 2024-09-13T15:16:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.073+0000 7f2d13400640 1 --2- 172.21.15.7:0/3313069953 >> [v2:172.21.15.77:6824/328054321,v1:172.21.15.77:6825/328054321] conn(0x7f2cf80703a0 0x7f2cf8072840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.073+0000 7f2d1b400640 1 --2- 172.21.15.7:0/3313069953 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2cf8066690 0x7f2cf8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.073+0000 7f2d13400640 1 -- 172.21.15.7:0/3313069953 --> [v2:172.21.15.77:6824/328054321,v1:172.21.15.77:6825/328054321] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2cf8072f10 con 0x7f2cf80703a0 2024-09-13T15:16:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.073+0000 7f2d13400640 1 -- 172.21.15.7:0/3313069953 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d04084750 con 0x7f2d1c071760 2024-09-13T15:16:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.073+0000 7f2d1be00640 1 --2- 172.21.15.7:0/3313069953 >> [v2:172.21.15.77:6824/328054321,v1:172.21.15.77:6825/328054321] conn(0x7f2cf80703a0 0x7f2cf8072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.073+0000 7f2d1b400640 1 --2- 172.21.15.7:0/3313069953 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2cf8066690 0x7f2cf8068b50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009bb0 tx=0x7f2d0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.073+0000 7f2d1be00640 1 --2- 172.21.15.7:0/3313069953 >> [v2:172.21.15.77:6824/328054321,v1:172.21.15.77:6825/328054321] conn(0x7f2cf80703a0 0x7f2cf8072840 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:22.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.073+0000 7f2d13400640 1 -- 172.21.15.7:0/3313069953 <== osd.7 v2:172.21.15.77:6824/328054321 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f2cf8072f10 con 0x7f2cf80703a0 2024-09-13T15:16:22.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.089+0000 7f2d20a00640 1 -- 172.21.15.7:0/3313069953 --> [v2:172.21.15.77:6824/328054321,v1:172.21.15.77:6825/328054321] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2d1c159b50 con 0x7f2cf80703a0 2024-09-13T15:16:22.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.089+0000 7f2d13400640 1 -- 172.21.15.7:0/3313069953 <== osd.7 v2:172.21.15.77:6824/328054321 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2d140b9440 con 0x7f2cf80703a0 2024-09-13T15:16:22.088 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-13T15:16:22.088 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T15:16:22.088 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-13T15:16:22.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.089+0000 7f2d20a00640 1 -- 172.21.15.7:0/3313069953 >> [v2:172.21.15.77:6824/328054321,v1:172.21.15.77:6825/328054321] conn(0x7f2cf80703a0 msgr2=0x7f2cf8072840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.089+0000 7f2d20a00640 1 --2- 172.21.15.7:0/3313069953 >> [v2:172.21.15.77:6824/328054321,v1:172.21.15.77:6825/328054321] conn(0x7f2cf80703a0 0x7f2cf8072840 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.089+0000 7f2d20a00640 1 -- 172.21.15.7:0/3313069953 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2cf8066690 msgr2=0x7f2cf8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.089+0000 7f2d20a00640 1 --2- 172.21.15.7:0/3313069953 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2cf8066690 0x7f2cf8068b50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009bb0 tx=0x7f2d0c008040 comp rx=0 tx=0).stop 2024-09-13T15:16:22.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.089+0000 7f2d20a00640 1 -- 172.21.15.7:0/3313069953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c071760 msgr2=0x7f2d1c0ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.089+0000 7f2d20a00640 1 --2- 172.21.15.7:0/3313069953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d1c071760 0x7f2d1c0ca7b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400c3c0 tx=0x7f2d0400c880 comp rx=0 tx=0).stop 2024-09-13T15:16:22.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.089+0000 7f2d1be00640 1 -- 172.21.15.7:0/3313069953 reap_dead start 2024-09-13T15:16:22.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.089+0000 7f2d20a00640 1 -- 172.21.15.7:0/3313069953 shutdown_connections 2024-09-13T15:16:22.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.089+0000 7f2d20a00640 1 -- 172.21.15.7:0/3313069953 >> 172.21.15.7:0/3313069953 conn(0x7f2d1c0cc9b0 msgr2=0x7f2d1c06f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:22.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.089+0000 7f2d20a00640 1 -- 172.21.15.7:0/3313069953 shutdown_connections 2024-09-13T15:16:22.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.089+0000 7f2d20a00640 1 -- 172.21.15.7:0/3313069953 wait complete. 2024-09-13T15:16:22.108 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T15:16:22.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.253+0000 7f83c1e00640 1 Processor -- start 2024-09-13T15:16:22.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.253+0000 7f83c1e00640 1 -- start start 2024-09-13T15:16:22.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.253+0000 7f83c1e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f83bc1510d0 0x7f83bc0cd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.253+0000 7f83c1e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f83bc071cf0 0x7f83bc156de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.253+0000 7f83c1e00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83bc15adf0 con 0x7f83bc157320 2024-09-13T15:16:22.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.253+0000 7f83c1e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc0cd7d0 con 0x7f83bc071cf0 2024-09-13T15:16:22.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.253+0000 7f83c1e00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83bc072580 con 0x7f83bc1510d0 2024-09-13T15:16:22.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.253+0000 7f83b2000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f83bc071cf0 0x7f83bc156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.253+0000 7f83b2000640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f83bc071cf0 0x7f83bc156de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60336/0 (socket says 172.21.15.7:60336) 2024-09-13T15:16:22.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.253+0000 7f83b2000640 1 -- 172.21.15.7:0/2902829320 learned_addr learned my addr 172.21.15.7:0/2902829320 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:22.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.253+0000 7f83baa00640 1 --2- 172.21.15.7:0/2902829320 >> v2:172.21.15.77:3300/0 conn(0x7f83bc1510d0 0x7f83bc0cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.253+0000 7f83b2000640 1 -- 172.21.15.7:0/2902829320 >> v2:172.21.15.77:3300/0 conn(0x7f83bc1510d0 msgr2=0x7f83bc0cd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:22.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.253+0000 7f83b2000640 1 --2- 172.21.15.7:0/2902829320 >> v2:172.21.15.77:3300/0 conn(0x7f83bc1510d0 0x7f83bc0cd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.253+0000 7f83b2000640 1 -- 172.21.15.7:0/2902829320 >> v1:172.21.15.77:6789/0 conn(0x7f83bc157320 legacy=0x7f83bc0c62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:22.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.253+0000 7f83b2000640 1 -- 172.21.15.7:0/2902829320 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc15a500 con 0x7f83bc071cf0 2024-09-13T15:16:22.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.253+0000 7f83baa00640 1 --2- 172.21.15.7:0/2902829320 >> v2:172.21.15.77:3300/0 conn(0x7f83bc1510d0 0x7f83bc0cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:16:22.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.257+0000 7f83b2000640 1 --2- 172.21.15.7:0/2902829320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc071cf0 0x7f83bc156de0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0cc880 tx=0x7f83a401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5a245812aa997a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:22.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.257+0000 7f83ba000640 1 -- 172.21.15.7:0/2902829320 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a40aa640 con 0x7f83bc071cf0 2024-09-13T15:16:22.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.257+0000 7f83ba000640 1 -- 172.21.15.7:0/2902829320 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a40aa7a0 con 0x7f83bc071cf0 2024-09-13T15:16:22.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.257+0000 7f83ba000640 1 -- 172.21.15.7:0/2902829320 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a40aab30 con 0x7f83bc071cf0 2024-09-13T15:16:22.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.257+0000 7f83c1e00640 1 -- 172.21.15.7:0/2902829320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc071cf0 msgr2=0x7f83bc156de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.257+0000 7f83c1e00640 1 --2- 172.21.15.7:0/2902829320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc071cf0 0x7f83bc156de0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0cc880 tx=0x7f83a401c4e0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.257+0000 7f83c1e00640 1 -- 172.21.15.7:0/2902829320 shutdown_connections 2024-09-13T15:16:22.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.257+0000 7f83c1e00640 1 --2- 172.21.15.7:0/2902829320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc071cf0 0x7f83bc156de0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.257+0000 7f83c1e00640 1 --2- 172.21.15.7:0/2902829320 >> v2:172.21.15.77:3300/0 conn(0x7f83bc1510d0 0x7f83bc0cd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.257+0000 7f83c1e00640 1 -- 172.21.15.7:0/2902829320 >> 172.21.15.7:0/2902829320 conn(0x7f83bc065d40 msgr2=0x7f83bc066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:22.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.257+0000 7f83c1e00640 1 -- 172.21.15.7:0/2902829320 shutdown_connections 2024-09-13T15:16:22.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.257+0000 7f83c1e00640 1 -- 172.21.15.7:0/2902829320 wait complete. 2024-09-13T15:16:22.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83c1e00640 1 Processor -- start 2024-09-13T15:16:22.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83c1e00640 1 -- start start 2024-09-13T15:16:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83c1e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc071cf0 0x7f83bc160360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83c1e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83bc1510d0 0x7f83bc1f1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83c1e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83bc157320 0x7f83bc1f2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83c1e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc150310 con 0x7f83bc071cf0 2024-09-13T15:16:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83c1e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc1f1670 con 0x7f83bc157320 2024-09-13T15:16:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83c1e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc150630 con 0x7f83bc1510d0 2024-09-13T15:16:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83baa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc071cf0 0x7f83bc160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83baa00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc071cf0 0x7f83bc160360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60338/0 (socket says 172.21.15.7:60338) 2024-09-13T15:16:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83baa00640 1 -- 172.21.15.7:0/2896897992 learned_addr learned my addr 172.21.15.7:0/2896897992 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:22.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83bb400640 1 --2- 172.21.15.7:0/2896897992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83bc157320 0x7f83bc1f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83b2000640 1 --2- 172.21.15.7:0/2896897992 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83bc1510d0 0x7f83bc1f1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83baa00640 1 -- 172.21.15.7:0/2896897992 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83bc1510d0 msgr2=0x7f83bc1f1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83baa00640 1 --2- 172.21.15.7:0/2896897992 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83bc1510d0 0x7f83bc1f1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83baa00640 1 -- 172.21.15.7:0/2896897992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83bc157320 msgr2=0x7f83bc1f2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83baa00640 1 --2- 172.21.15.7:0/2896897992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83bc157320 0x7f83bc1f2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83baa00640 1 -- 172.21.15.7:0/2896897992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a40094d0 con 0x7f83bc071cf0 2024-09-13T15:16:22.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83baa00640 1 --2- 172.21.15.7:0/2896897992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc071cf0 0x7f83bc160360 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00e810 tx=0x7f83ac00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:22.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83b3e00640 1 -- 172.21.15.7:0/2896897992 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00c8d0 con 0x7f83bc071cf0 2024-09-13T15:16:22.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83b3e00640 1 -- 172.21.15.7:0/2896897992 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac00ca30 con 0x7f83bc071cf0 2024-09-13T15:16:22.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83b3e00640 1 -- 172.21.15.7:0/2896897992 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac00cdc0 con 0x7f83bc071cf0 2024-09-13T15:16:22.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83c1e00640 1 -- 172.21.15.7:0/2896897992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc1f5680 con 0x7f83bc071cf0 2024-09-13T15:16:22.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83c1e00640 1 -- 172.21.15.7:0/2896897992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc14ffb0 con 0x7f83bc071cf0 2024-09-13T15:16:22.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.261+0000 7f83c1e00640 1 -- 172.21.15.7:0/2896897992 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc1f54e0 con 0x7f83bc071cf0 2024-09-13T15:16:22.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.265+0000 7f83b3e00640 1 -- 172.21.15.7:0/2896897992 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f83ac013410 con 0x7f83bc071cf0 2024-09-13T15:16:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.265+0000 7f83b3e00640 1 --2- 172.21.15.7:0/2896897992 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8398066690 0x7f8398068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.265+0000 7f83b3e00640 1 -- 172.21.15.7:0/2896897992 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f83ac0845b0 con 0x7f83bc071cf0 2024-09-13T15:16:22.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.265+0000 7f83b2000640 1 --2- 172.21.15.7:0/2896897992 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8398066690 0x7f8398068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.265+0000 7f83b2000640 1 --2- 172.21.15.7:0/2896897992 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8398066690 0x7f8398068b50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f83a40ae000 tx=0x7f83a40a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:22.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.273+0000 7f83b3e00640 1 -- 172.21.15.7:0/2896897992 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f83bc1f54e0 con 0x7f83bc071cf0 2024-09-13T15:16:22.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.441+0000 7f83c1e00640 1 -- 172.21.15.7:0/2896897992 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f83bc1568c0 con 0x7f8398066690 2024-09-13T15:16:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.441+0000 7f83b3e00640 1 -- 172.21.15.7:0/2896897992 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f83bc1568c0 con 0x7f8398066690 2024-09-13T15:16:22.440 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T15:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.441+0000 7f83c1e00640 1 -- 172.21.15.7:0/2896897992 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8398066690 msgr2=0x7f8398068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.441+0000 7f83c1e00640 1 --2- 172.21.15.7:0/2896897992 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8398066690 0x7f8398068b50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f83a40ae000 tx=0x7f83a40a7000 comp rx=0 tx=0).stop 2024-09-13T15:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.441+0000 7f83c1e00640 1 -- 172.21.15.7:0/2896897992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc071cf0 msgr2=0x7f83bc160360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.441+0000 7f83c1e00640 1 --2- 172.21.15.7:0/2896897992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc071cf0 0x7f83bc160360 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00e810 tx=0x7f83ac00ecd0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.441+0000 7f83c1e00640 1 -- 172.21.15.7:0/2896897992 shutdown_connections 2024-09-13T15:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.441+0000 7f83c1e00640 1 --2- 172.21.15.7:0/2896897992 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8398066690 0x7f8398068b50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.441+0000 7f83c1e00640 1 --2- 172.21.15.7:0/2896897992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83bc157320 0x7f83bc1f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.441+0000 7f83c1e00640 1 --2- 172.21.15.7:0/2896897992 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f83bc1510d0 0x7f83bc1f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.441+0000 7f83c1e00640 1 --2- 172.21.15.7:0/2896897992 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83bc071cf0 0x7f83bc160360 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.441+0000 7f83c1e00640 1 -- 172.21.15.7:0/2896897992 >> 172.21.15.7:0/2896897992 conn(0x7f83bc065d40 msgr2=0x7f83bc154c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:22.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.441+0000 7f83c1e00640 1 -- 172.21.15.7:0/2896897992 shutdown_connections 2024-09-13T15:16:22.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.441+0000 7f83c1e00640 1 -- 172.21.15.7:0/2896897992 wait complete. 2024-09-13T15:16:22.463 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:16:22.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.605+0000 7fb026400640 1 Processor -- start 2024-09-13T15:16:22.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.605+0000 7fb026400640 1 -- start start 2024-09-13T15:16:22.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.609+0000 7fb026400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb020150f40 0x7fb0201579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.609+0000 7fb026400640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0200c5d30 con 0x7fb02015f900 2024-09-13T15:16:22.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.609+0000 7fb026400640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb020157510 con 0x7fb020158480 2024-09-13T15:16:22.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.609+0000 7fb026400640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb020156f90 con 0x7fb020150f40 2024-09-13T15:16:22.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.609+0000 7fb01f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb020150f40 0x7fb0201579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.609+0000 7fb01f400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fb020150f40 0x7fb0201579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60354/0 (socket says 172.21.15.7:60354) 2024-09-13T15:16:22.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.609+0000 7fb01f400640 1 -- 172.21.15.7:0/920067989 learned_addr learned my addr 172.21.15.7:0/920067989 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:22.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.609+0000 7fb01f400640 1 -- 172.21.15.7:0/920067989 >> v1:172.21.15.77:6789/0 conn(0x7fb020158480 legacy=0x7fb020066180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.609+0000 7fb01f400640 1 -- 172.21.15.7:0/920067989 >> v1:172.21.15.7:6789/0 conn(0x7fb02015f900 legacy=0x7fb020161cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.609+0000 7fb01f400640 1 -- 172.21.15.7:0/920067989 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0200c5490 con 0x7fb020150f40 2024-09-13T15:16:22.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb01f400640 1 --2- 172.21.15.7:0/920067989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb020150f40 0x7fb0201579a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb010009870 tx=0x7fb01001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab848f8a69df70b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:22.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb01ea00640 1 -- 172.21.15.7:0/920067989 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100a95f0 con 0x7fb020150f40 2024-09-13T15:16:22.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb01ea00640 1 -- 172.21.15.7:0/920067989 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0100a9750 con 0x7fb020150f40 2024-09-13T15:16:22.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb01ea00640 1 -- 172.21.15.7:0/920067989 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100a9ae0 con 0x7fb020150f40 2024-09-13T15:16:22.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb026400640 1 -- 172.21.15.7:0/920067989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb020150f40 msgr2=0x7fb0201579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb026400640 1 --2- 172.21.15.7:0/920067989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb020150f40 0x7fb0201579a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb010009870 tx=0x7fb01001c530 comp rx=0 tx=0).stop 2024-09-13T15:16:22.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb026400640 1 -- 172.21.15.7:0/920067989 shutdown_connections 2024-09-13T15:16:22.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb026400640 1 --2- 172.21.15.7:0/920067989 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb020150f40 0x7fb0201579a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb026400640 1 -- 172.21.15.7:0/920067989 >> 172.21.15.7:0/920067989 conn(0x7fb02006e110 msgr2=0x7fb02006e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:22.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb026400640 1 -- 172.21.15.7:0/920067989 shutdown_connections 2024-09-13T15:16:22.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb026400640 1 -- 172.21.15.7:0/920067989 wait complete. 2024-09-13T15:16:22.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb026400640 1 Processor -- start 2024-09-13T15:16:22.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb026400640 1 -- start start 2024-09-13T15:16:22.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb026400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb020150f40 0x7fb020161af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb026400640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb020158480 0x7fb020155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb026400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb02015f900 0x7fb020152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb026400640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb020156840 con 0x7fb020150f40 2024-09-13T15:16:22.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb026400640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb020151ed0 con 0x7fb020158480 2024-09-13T15:16:22.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb026400640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0201536e0 con 0x7fb02015f900 2024-09-13T15:16:22.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.613+0000 7fb01f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb020150f40 0x7fb020161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb01f400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb020150f40 0x7fb020161af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:60362/0 (socket says 172.21.15.7:60362) 2024-09-13T15:16:22.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb01f400640 1 -- 172.21.15.7:0/2009188825 learned_addr learned my addr 172.21.15.7:0/2009188825 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:22.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb017e00640 1 --2- 172.21.15.7:0/2009188825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb020158480 0x7fb020155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb01fe00640 1 --2- 172.21.15.7:0/2009188825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb02015f900 0x7fb020152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb01f400640 1 -- 172.21.15.7:0/2009188825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb02015f900 msgr2=0x7fb020152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb01f400640 1 --2- 172.21.15.7:0/2009188825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb02015f900 0x7fb020152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb01f400640 1 -- 172.21.15.7:0/2009188825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb020158480 msgr2=0x7fb020155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb01f400640 1 --2- 172.21.15.7:0/2009188825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb020158480 0x7fb020155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb01f400640 1 -- 172.21.15.7:0/2009188825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0100094d0 con 0x7fb020150f40 2024-09-13T15:16:22.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb01f400640 1 --2- 172.21.15.7:0/2009188825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb020150f40 0x7fb020161af0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb0100ab040 tx=0x7fb01001ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:22.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb017400640 1 -- 172.21.15.7:0/2009188825 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100b1800 con 0x7fb020150f40 2024-09-13T15:16:22.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb017400640 1 -- 172.21.15.7:0/2009188825 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0100b1980 con 0x7fb020150f40 2024-09-13T15:16:22.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb026400640 1 -- 172.21.15.7:0/2009188825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0201539c0 con 0x7fb020150f40 2024-09-13T15:16:22.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb017400640 1 -- 172.21.15.7:0/2009188825 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100b1d30 con 0x7fb020150f40 2024-09-13T15:16:22.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb026400640 1 -- 172.21.15.7:0/2009188825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb020162030 con 0x7fb020150f40 2024-09-13T15:16:22.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb026400640 1 -- 172.21.15.7:0/2009188825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb020067a60 con 0x7fb020150f40 2024-09-13T15:16:22.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb017400640 1 -- 172.21.15.7:0/2009188825 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb0100bc450 con 0x7fb020150f40 2024-09-13T15:16:22.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb017400640 1 --2- 172.21.15.7:0/2009188825 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faffc066690 0x7faffc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:22.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.617+0000 7fb017400640 1 -- 172.21.15.7:0/2009188825 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7fb01011f4b0 con 0x7fb020150f40 2024-09-13T15:16:22.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.621+0000 7fb017e00640 1 --2- 172.21.15.7:0/2009188825 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faffc066690 0x7faffc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:22.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.621+0000 7fb017e00640 1 --2- 172.21.15.7:0/2009188825 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faffc066690 0x7faffc068b50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb020066ad0 tx=0x7fb008009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:22.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.621+0000 7fb017400640 1 -- 172.21.15.7:0/2009188825 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb0100ec2f0 con 0x7fb020150f40 2024-09-13T15:16:22.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.781+0000 7fb026400640 1 -- 172.21.15.7:0/2009188825 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb020071550 con 0x7faffc066690 2024-09-13T15:16:22.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.809+0000 7fb017400640 1 -- 172.21.15.7:0/2009188825 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368460 (secure 0 0 0) 0x7fb008001ca0 con 0x7faffc066690 2024-09-13T15:16:22.814 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:16:22.816 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T15:16:22.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.813+0000 7fb026400640 1 -- 172.21.15.7:0/2009188825 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faffc066690 msgr2=0x7faffc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.813+0000 7fb026400640 1 --2- 172.21.15.7:0/2009188825 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faffc066690 0x7faffc068b50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb020066ad0 tx=0x7fb008009040 comp rx=0 tx=0).stop 2024-09-13T15:16:22.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.813+0000 7fb026400640 1 -- 172.21.15.7:0/2009188825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb020150f40 msgr2=0x7fb020161af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:22.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.813+0000 7fb026400640 1 --2- 172.21.15.7:0/2009188825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb020150f40 0x7fb020161af0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb0100ab040 tx=0x7fb01001ad70 comp rx=0 tx=0).stop 2024-09-13T15:16:22.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.813+0000 7fb026400640 1 -- 172.21.15.7:0/2009188825 shutdown_connections 2024-09-13T15:16:22.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.813+0000 7fb026400640 1 --2- 172.21.15.7:0/2009188825 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7faffc066690 0x7faffc068b50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.813+0000 7fb026400640 1 --2- 172.21.15.7:0/2009188825 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fb02015f900 0x7fb020152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.813+0000 7fb026400640 1 --2- 172.21.15.7:0/2009188825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb020158480 0x7fb020155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.813+0000 7fb026400640 1 --2- 172.21.15.7:0/2009188825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb020150f40 0x7fb020161af0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:22.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.813+0000 7fb026400640 1 -- 172.21.15.7:0/2009188825 >> 172.21.15.7:0/2009188825 conn(0x7fb02006e110 msgr2=0x7fb020159200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:22.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.813+0000 7fb026400640 1 -- 172.21.15.7:0/2009188825 shutdown_connections 2024-09-13T15:16:22.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:22.813+0000 7fb026400640 1 -- 172.21.15.7:0/2009188825 wait complete. 2024-09-13T15:16:22.835 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":467,"stamp":"2024-09-13T15:16:20.954862+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2422958799,"num_objects":872,"num_object_clones":0,"num_object_copies":3218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":872,"num_whiteouts":0,"num_read":617,"num_read_kb":111053,"num_write":2173808,"num_write_kb":31188654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":74,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152249,"ondisk_log_size":152249,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":13860080,"kb_used_data":5167408,"kb_used_omap":12,"kb_used_meta":8686451,"kb_avail":741114640,"statfs":{"total":773094113280,"available":758901391360,"internally_reserved":0,"allocated":5291425792,"data_stored":5289575922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":8894926392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,0,7,4,6,7,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":77,"apply_latency_ms":77,"commit_latency_ns":77000000,"apply_latency_ns":77000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4894752156,"num_objects":-1167,"num_object_clones":0,"num_object_copies":-4668,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1167,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1178,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007285"},"pg_stats":[{"pgid":"2.1f","version":"31'35","reported_seq":77,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:13.327825+0000","last_change":"2024-09-13T15:01:44.418856+0000","last_active":"2024-09-13T15:16:13.327825+0000","last_peered":"2024-09-13T15:16:13.327825+0000","last_clean":"2024-09-13T15:16:13.327825+0000","last_became_active":"2024-09-13T15:01:44.418641+0000","last_became_peered":"2024-09-13T15:01:44.418641+0000","last_unstale":"2024-09-13T15:16:13.327825+0000","last_undegraded":"2024-09-13T15:16:13.327825+0000","last_fullsized":"2024-09-13T15:16:13.327825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":25,"num_read_kb":4120,"num_write":35,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:18.012502+0000","last_change":"2024-09-13T15:01:44.809371+0000","last_active":"2024-09-13T15:16:18.012502+0000","last_peered":"2024-09-13T15:16:18.012502+0000","last_clean":"2024-09-13T15:16:18.012502+0000","last_became_active":"2024-09-13T15:01:44.809091+0000","last_became_peered":"2024-09-13T15:01:44.809091+0000","last_unstale":"2024-09-13T15:16:18.012502+0000","last_undegraded":"2024-09-13T15:16:18.012502+0000","last_fullsized":"2024-09-13T15:16:18.012502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'4462","reported_seq":4488,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:17.894955+0000","last_change":"2024-09-13T15:01:48.910757+0000","last_active":"2024-09-13T15:16:17.894955+0000","last_peered":"2024-09-13T15:16:17.894955+0000","last_clean":"2024-09-13T15:16:17.894955+0000","last_became_active":"2024-09-13T15:01:48.910262+0000","last_became_peered":"2024-09-13T15:01:48.910262+0000","last_unstale":"2024-09-13T15:16:17.894955+0000","last_undegraded":"2024-09-13T15:16:17.894955+0000","last_fullsized":"2024-09-13T15:16:17.894955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4462,"log_dups_size":0,"ondisk_log_size":4462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71333862,"num_objects":21,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65354,"num_write_kb":904330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"31'21","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:59.629484+0000","last_change":"2024-09-13T15:01:44.404818+0000","last_active":"2024-09-13T15:15:59.629484+0000","last_peered":"2024-09-13T15:15:59.629484+0000","last_clean":"2024-09-13T15:15:59.629484+0000","last_became_active":"2024-09-13T15:01:44.401666+0000","last_became_peered":"2024-09-13T15:01:44.401666+0000","last_unstale":"2024-09-13T15:15:59.629484+0000","last_undegraded":"2024-09-13T15:15:59.629484+0000","last_fullsized":"2024-09-13T15:15:59.629484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":18,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'5","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:16.942112+0000","last_change":"2024-09-13T15:01:44.850292+0000","last_active":"2024-09-13T15:16:16.942112+0000","last_peered":"2024-09-13T15:16:16.942112+0000","last_clean":"2024-09-13T15:16:16.942112+0000","last_became_active":"2024-09-13T15:01:44.849825+0000","last_became_peered":"2024-09-13T15:01:44.849825+0000","last_unstale":"2024-09-13T15:16:16.942112+0000","last_undegraded":"2024-09-13T15:16:16.942112+0000","last_fullsized":"2024-09-13T15:16:16.942112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"33'4924","reported_seq":4949,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:18.169204+0000","last_change":"2024-09-13T15:01:48.850426+0000","last_active":"2024-09-13T15:16:18.169204+0000","last_peered":"2024-09-13T15:16:18.169204+0000","last_clean":"2024-09-13T15:16:18.169204+0000","last_became_active":"2024-09-13T15:01:48.848750+0000","last_became_peered":"2024-09-13T15:01:48.848750+0000","last_unstale":"2024-09-13T15:16:18.169204+0000","last_undegraded":"2024-09-13T15:16:18.169204+0000","last_fullsized":"2024-09-13T15:16:18.169204+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4924,"log_dups_size":0,"ondisk_log_size":4924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:55.871489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58811731,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71658,"num_write_kb":1026932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"33'61","reported_seq":107,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.125487+0000","last_change":"2024-09-13T15:01:44.437850+0000","last_active":"2024-09-13T15:15:57.125487+0000","last_peered":"2024-09-13T15:15:57.125487+0000","last_clean":"2024-09-13T15:15:57.125487+0000","last_became_active":"2024-09-13T15:01:44.437168+0000","last_became_peered":"2024-09-13T15:01:44.437168+0000","last_unstale":"2024-09-13T15:15:57.125487+0000","last_undegraded":"2024-09-13T15:15:57.125487+0000","last_fullsized":"2024-09-13T15:15:57.125487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:57:23.540408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":50,"num_read_kb":12337,"num_write":58,"num_write_kb":12312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:05.987657+0000","last_change":"2024-09-13T15:01:44.845989+0000","last_active":"2024-09-13T15:16:05.987657+0000","last_peered":"2024-09-13T15:16:05.987657+0000","last_clean":"2024-09-13T15:16:05.987657+0000","last_became_active":"2024-09-13T15:01:44.845395+0000","last_became_peered":"2024-09-13T15:01:44.845395+0000","last_unstale":"2024-09-13T15:16:05.987657+0000","last_undegraded":"2024-09-13T15:16:05.987657+0000","last_fullsized":"2024-09-13T15:16:05.987657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4428","reported_seq":4453,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:18.203640+0000","last_change":"2024-09-13T15:01:48.865388+0000","last_active":"2024-09-13T15:16:18.203640+0000","last_peered":"2024-09-13T15:16:18.203640+0000","last_clean":"2024-09-13T15:16:18.203640+0000","last_became_active":"2024-09-13T15:01:48.864314+0000","last_became_peered":"2024-09-13T15:01:48.864314+0000","last_unstale":"2024-09-13T15:16:18.203640+0000","last_undegraded":"2024-09-13T15:16:18.203640+0000","last_fullsized":"2024-09-13T15:16:18.203640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4428,"log_dups_size":0,"ondisk_log_size":4428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:18.637430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58725372,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64535,"num_write_kb":920306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"30'15","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.086111+0000","last_change":"2024-09-13T15:01:44.424080+0000","last_active":"2024-09-13T15:15:57.086111+0000","last_peered":"2024-09-13T15:15:57.086111+0000","last_clean":"2024-09-13T15:15:57.086111+0000","last_became_active":"2024-09-13T15:01:44.423381+0000","last_became_peered":"2024-09-13T15:01:44.423381+0000","last_unstale":"2024-09-13T15:15:57.086111+0000","last_undegraded":"2024-09-13T15:15:57.086111+0000","last_fullsized":"2024-09-13T15:15:57.086111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:38:20.455380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":4116,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"33'16","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:17.608751+0000","last_change":"2024-09-13T15:01:44.849670+0000","last_active":"2024-09-13T15:16:17.608751+0000","last_peered":"2024-09-13T15:16:17.608751+0000","last_clean":"2024-09-13T15:16:17.608751+0000","last_became_active":"2024-09-13T15:01:44.849038+0000","last_became_peered":"2024-09-13T15:01:44.849038+0000","last_unstale":"2024-09-13T15:16:17.608751+0000","last_undegraded":"2024-09-13T15:16:17.608751+0000","last_fullsized":"2024-09-13T15:16:17.608751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4170","reported_seq":4195,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:18.271101+0000","last_change":"2024-09-13T15:01:48.854953+0000","last_active":"2024-09-13T15:16:18.271101+0000","last_peered":"2024-09-13T15:16:18.271101+0000","last_clean":"2024-09-13T15:16:18.271101+0000","last_became_active":"2024-09-13T15:01:48.853858+0000","last_became_peered":"2024-09-13T15:01:48.853858+0000","last_unstale":"2024-09-13T15:16:18.271101+0000","last_undegraded":"2024-09-13T15:16:18.271101+0000","last_fullsized":"2024-09-13T15:16:18.271101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":0,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:50:07.203581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100718444,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61285,"num_write_kb":864366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.599588+0000","last_change":"2024-09-13T15:01:44.824391+0000","last_active":"2024-09-13T15:15:28.599588+0000","last_peered":"2024-09-13T15:15:28.599588+0000","last_clean":"2024-09-13T15:15:28.599588+0000","last_became_active":"2024-09-13T15:01:44.823690+0000","last_became_peered":"2024-09-13T15:01:44.823690+0000","last_unstale":"2024-09-13T15:15:28.599588+0000","last_undegraded":"2024-09-13T15:15:28.599588+0000","last_fullsized":"2024-09-13T15:15:28.599588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:13:43.539283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'133","reported_seq":166,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:34.462327+0000","last_change":"2024-09-13T15:01:44.421523+0000","last_active":"2024-09-13T15:15:34.462327+0000","last_peered":"2024-09-13T15:15:34.462327+0000","last_clean":"2024-09-13T15:15:34.462327+0000","last_became_active":"2024-09-13T15:01:44.419965+0000","last_became_peered":"2024-09-13T15:01:44.419965+0000","last_unstale":"2024-09-13T15:15:34.462327+0000","last_undegraded":"2024-09-13T15:15:34.462327+0000","last_fullsized":"2024-09-13T15:15:34.462327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:34.918774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":8200,"num_write":130,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"33'4487","reported_seq":4513,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:18.216842+0000","last_change":"2024-09-13T15:01:48.850895+0000","last_active":"2024-09-13T15:16:18.216842+0000","last_peered":"2024-09-13T15:16:18.216842+0000","last_clean":"2024-09-13T15:16:18.216842+0000","last_became_active":"2024-09-13T15:01:48.849856+0000","last_became_peered":"2024-09-13T15:01:48.849856+0000","last_unstale":"2024-09-13T15:16:18.216842+0000","last_undegraded":"2024-09-13T15:16:18.216842+0000","last_fullsized":"2024-09-13T15:16:18.216842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4487,"log_dups_size":0,"ondisk_log_size":4487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:07:59.616442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54608192,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65561,"num_write_kb":929153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.595159+0000","last_change":"2024-09-13T15:01:44.806026+0000","last_active":"2024-09-13T15:15:58.595159+0000","last_peered":"2024-09-13T15:15:58.595159+0000","last_clean":"2024-09-13T15:15:58.595159+0000","last_became_active":"2024-09-13T15:01:44.805767+0000","last_became_peered":"2024-09-13T15:01:44.805767+0000","last_unstale":"2024-09-13T15:15:58.595159+0000","last_undegraded":"2024-09-13T15:15:58.595159+0000","last_fullsized":"2024-09-13T15:15:58.595159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"32'19","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.712356+0000","last_change":"2024-09-13T15:01:44.401897+0000","last_active":"2024-09-13T15:15:28.712356+0000","last_peered":"2024-09-13T15:15:28.712356+0000","last_clean":"2024-09-13T15:15:28.712356+0000","last_became_active":"2024-09-13T15:01:44.401559+0000","last_became_peered":"2024-09-13T15:01:44.401559+0000","last_unstale":"2024-09-13T15:15:28.712356+0000","last_undegraded":"2024-09-13T15:15:28.712356+0000","last_fullsized":"2024-09-13T15:15:28.712356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:58.535567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"33'4726","reported_seq":4752,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:18.293208+0000","last_change":"2024-09-13T15:01:48.858808+0000","last_active":"2024-09-13T15:16:18.293208+0000","last_peered":"2024-09-13T15:16:18.293208+0000","last_clean":"2024-09-13T15:16:18.293208+0000","last_became_active":"2024-09-13T15:01:48.857802+0000","last_became_peered":"2024-09-13T15:01:48.857802+0000","last_unstale":"2024-09-13T15:16:18.293208+0000","last_undegraded":"2024-09-13T15:16:18.293208+0000","last_fullsized":"2024-09-13T15:16:18.293208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4726,"log_dups_size":0,"ondisk_log_size":4726,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:41.628058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67114822,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69000,"num_write_kb":974815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:01.800958+0000","last_change":"2024-09-13T15:01:44.808674+0000","last_active":"2024-09-13T15:16:01.800958+0000","last_peered":"2024-09-13T15:16:01.800958+0000","last_clean":"2024-09-13T15:16:01.800958+0000","last_became_active":"2024-09-13T15:01:44.808420+0000","last_became_peered":"2024-09-13T15:01:44.808420+0000","last_unstale":"2024-09-13T15:16:01.800958+0000","last_undegraded":"2024-09-13T15:16:01.800958+0000","last_fullsized":"2024-09-13T15:16:01.800958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"32'9","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:15:01.212922+0000","last_change":"2024-09-13T15:01:44.406717+0000","last_active":"2024-09-13T15:15:01.212922+0000","last_peered":"2024-09-13T15:15:01.212922+0000","last_clean":"2024-09-13T15:15:01.212922+0000","last_became_active":"2024-09-13T15:01:44.406354+0000","last_became_peered":"2024-09-13T15:01:44.406354+0000","last_unstale":"2024-09-13T15:15:01.212922+0000","last_undegraded":"2024-09-13T15:15:01.212922+0000","last_fullsized":"2024-09-13T15:15:01.212922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:49.413632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"33'4753","reported_seq":4779,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:14.765106+0000","last_change":"2024-09-13T15:01:48.909879+0000","last_active":"2024-09-13T15:16:14.765106+0000","last_peered":"2024-09-13T15:16:14.765106+0000","last_clean":"2024-09-13T15:16:14.765106+0000","last_became_active":"2024-09-13T15:01:48.909494+0000","last_became_peered":"2024-09-13T15:01:48.909494+0000","last_unstale":"2024-09-13T15:16:14.765106+0000","last_undegraded":"2024-09-13T15:16:14.765106+0000","last_fullsized":"2024-09-13T15:16:14.765106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4753,"log_dups_size":0,"ondisk_log_size":4753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:54.415920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142611640,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69921,"num_write_kb":1001010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:53.670234+0000","last_change":"2024-09-13T15:01:44.825065+0000","last_active":"2024-09-13T15:14:53.670234+0000","last_peered":"2024-09-13T15:14:53.670234+0000","last_clean":"2024-09-13T15:14:53.670234+0000","last_became_active":"2024-09-13T15:01:44.824392+0000","last_became_peered":"2024-09-13T15:01:44.824392+0000","last_unstale":"2024-09-13T15:14:53.670234+0000","last_undegraded":"2024-09-13T15:14:53.670234+0000","last_fullsized":"2024-09-13T15:14:53.670234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:42:49.717211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"30'15","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.866614+0000","last_change":"2024-09-13T15:01:44.421119+0000","last_active":"2024-09-13T15:15:27.866614+0000","last_peered":"2024-09-13T15:15:27.866614+0000","last_clean":"2024-09-13T15:15:27.866614+0000","last_became_active":"2024-09-13T15:01:44.419082+0000","last_became_peered":"2024-09-13T15:01:44.419082+0000","last_unstale":"2024-09-13T15:15:27.866614+0000","last_undegraded":"2024-09-13T15:15:27.866614+0000","last_fullsized":"2024-09-13T15:15:27.866614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:09.011350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"33'4683","reported_seq":4709,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:18.518656+0000","last_change":"2024-09-13T15:01:48.856387+0000","last_active":"2024-09-13T15:16:18.518656+0000","last_peered":"2024-09-13T15:16:18.518656+0000","last_clean":"2024-09-13T15:16:18.518656+0000","last_became_active":"2024-09-13T15:01:48.855433+0000","last_became_peered":"2024-09-13T15:01:48.855433+0000","last_unstale":"2024-09-13T15:16:18.518656+0000","last_undegraded":"2024-09-13T15:16:18.518656+0000","last_fullsized":"2024-09-13T15:16:18.518656+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4683,"log_dups_size":0,"ondisk_log_size":4683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:18:58.309929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46154977,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68057,"num_write_kb":991498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"33'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:16.942033+0000","last_change":"2024-09-13T15:01:44.807909+0000","last_active":"2024-09-13T15:16:16.942033+0000","last_peered":"2024-09-13T15:16:16.942033+0000","last_clean":"2024-09-13T15:16:16.942033+0000","last_became_active":"2024-09-13T15:01:44.807643+0000","last_became_peered":"2024-09-13T15:01:44.807643+0000","last_unstale":"2024-09-13T15:16:16.942033+0000","last_undegraded":"2024-09-13T15:16:16.942033+0000","last_fullsized":"2024-09-13T15:16:16.942033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"30'9","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.087518+0000","last_change":"2024-09-13T15:01:44.430200+0000","last_active":"2024-09-13T15:15:57.087518+0000","last_peered":"2024-09-13T15:15:57.087518+0000","last_clean":"2024-09-13T15:15:57.087518+0000","last_became_active":"2024-09-13T15:01:44.429510+0000","last_became_peered":"2024-09-13T15:01:44.429510+0000","last_unstale":"2024-09-13T15:15:57.087518+0000","last_undegraded":"2024-09-13T15:15:57.087518+0000","last_fullsized":"2024-09-13T15:15:57.087518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:52.921485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":13,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'4818","reported_seq":4844,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:18.257467+0000","last_change":"2024-09-13T15:01:48.912116+0000","last_active":"2024-09-13T15:16:18.257467+0000","last_peered":"2024-09-13T15:16:18.257467+0000","last_clean":"2024-09-13T15:16:18.257467+0000","last_became_active":"2024-09-13T15:01:48.911578+0000","last_became_peered":"2024-09-13T15:01:48.911578+0000","last_unstale":"2024-09-13T15:16:18.257467+0000","last_undegraded":"2024-09-13T15:16:18.257467+0000","last_fullsized":"2024-09-13T15:16:18.257467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4818,"log_dups_size":0,"ondisk_log_size":4818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:50.826715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96493640,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70476,"num_write_kb":1030585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"33'8","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:16.498889+0000","last_change":"2024-09-13T15:01:44.838344+0000","last_active":"2024-09-13T15:16:16.498889+0000","last_peered":"2024-09-13T15:16:16.498889+0000","last_clean":"2024-09-13T15:16:16.498889+0000","last_became_active":"2024-09-13T15:01:44.838128+0000","last_became_peered":"2024-09-13T15:01:44.838128+0000","last_unstale":"2024-09-13T15:16:16.498889+0000","last_undegraded":"2024-09-13T15:16:16.498889+0000","last_fullsized":"2024-09-13T15:16:16.498889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'115","reported_seq":151,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.079099+0000","last_change":"2024-09-13T15:01:44.430749+0000","last_active":"2024-09-13T15:16:02.079099+0000","last_peered":"2024-09-13T15:16:02.079099+0000","last_clean":"2024-09-13T15:16:02.079099+0000","last_became_active":"2024-09-13T15:01:44.430548+0000","last_became_peered":"2024-09-13T15:01:44.430548+0000","last_unstale":"2024-09-13T15:16:02.079099+0000","last_undegraded":"2024-09-13T15:16:02.079099+0000","last_fullsized":"2024-09-13T15:16:02.079099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:30.312447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":251,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"33'4825","reported_seq":4853,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:19.268676+0000","last_change":"2024-09-13T15:01:48.911224+0000","last_active":"2024-09-13T15:16:19.268676+0000","last_peered":"2024-09-13T15:16:19.268676+0000","last_clean":"2024-09-13T15:16:19.268676+0000","last_became_active":"2024-09-13T15:01:48.910150+0000","last_became_peered":"2024-09-13T15:01:48.910150+0000","last_unstale":"2024-09-13T15:16:19.268676+0000","last_undegraded":"2024-09-13T15:16:19.268676+0000","last_fullsized":"2024-09-13T15:16:19.268676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4825,"log_dups_size":0,"ondisk_log_size":4825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67200822,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70423,"num_write_kb":999196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"33'10","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:59.270956+0000","last_change":"2024-09-13T15:01:44.812200+0000","last_active":"2024-09-13T15:15:59.270956+0000","last_peered":"2024-09-13T15:15:59.270956+0000","last_clean":"2024-09-13T15:15:59.270956+0000","last_became_active":"2024-09-13T15:01:44.811915+0000","last_became_peered":"2024-09-13T15:01:44.811915+0000","last_unstale":"2024-09-13T15:15:59.270956+0000","last_undegraded":"2024-09-13T15:15:59.270956+0000","last_fullsized":"2024-09-13T15:15:59.270956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:32:07.944520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'7","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:35.668362+0000","last_change":"2024-09-13T15:01:44.423119+0000","last_active":"2024-09-13T15:15:35.668362+0000","last_peered":"2024-09-13T15:15:35.668362+0000","last_clean":"2024-09-13T15:15:35.668362+0000","last_became_active":"2024-09-13T15:01:44.422297+0000","last_became_peered":"2024-09-13T15:01:44.422297+0000","last_unstale":"2024-09-13T15:15:35.668362+0000","last_undegraded":"2024-09-13T15:15:35.668362+0000","last_fullsized":"2024-09-13T15:15:35.668362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:56:09.798196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"33'4783","reported_seq":4810,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:18.082909+0000","last_change":"2024-09-13T15:01:48.908569+0000","last_active":"2024-09-13T15:16:18.082909+0000","last_peered":"2024-09-13T15:16:18.082909+0000","last_clean":"2024-09-13T15:16:18.082909+0000","last_became_active":"2024-09-13T15:01:48.908118+0000","last_became_peered":"2024-09-13T15:01:48.908118+0000","last_unstale":"2024-09-13T15:16:18.082909+0000","last_undegraded":"2024-09-13T15:16:18.082909+0000","last_fullsized":"2024-09-13T15:16:18.082909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4783,"log_dups_size":0,"ondisk_log_size":4783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41996301,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69545,"num_write_kb":1001647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"28'2","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.871385+0000","last_change":"2024-09-13T15:01:44.850837+0000","last_active":"2024-09-13T15:15:27.871385+0000","last_peered":"2024-09-13T15:15:27.871385+0000","last_clean":"2024-09-13T15:15:27.871385+0000","last_became_active":"2024-09-13T15:01:44.850263+0000","last_became_peered":"2024-09-13T15:01:44.850263+0000","last_unstale":"2024-09-13T15:15:27.871385+0000","last_undegraded":"2024-09-13T15:15:27.871385+0000","last_fullsized":"2024-09-13T15:15:27.871385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"30'3","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:18.534907+0000","last_change":"2024-09-13T15:01:44.399163+0000","last_active":"2024-09-13T15:14:18.534907+0000","last_peered":"2024-09-13T15:14:18.534907+0000","last_clean":"2024-09-13T15:14:18.534907+0000","last_became_active":"2024-09-13T15:01:44.398881+0000","last_became_peered":"2024-09-13T15:01:44.398881+0000","last_unstale":"2024-09-13T15:14:18.534907+0000","last_undegraded":"2024-09-13T15:14:18.534907+0000","last_fullsized":"2024-09-13T15:14:18.534907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:49.622676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4022","reported_seq":4048,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:14.558004+0000","last_change":"2024-09-13T15:01:48.852798+0000","last_active":"2024-09-13T15:16:14.558004+0000","last_peered":"2024-09-13T15:16:14.558004+0000","last_clean":"2024-09-13T15:16:14.558004+0000","last_became_active":"2024-09-13T15:01:48.851948+0000","last_became_peered":"2024-09-13T15:01:48.851948+0000","last_unstale":"2024-09-13T15:16:14.558004+0000","last_undegraded":"2024-09-13T15:16:14.558004+0000","last_fullsized":"2024-09-13T15:16:14.558004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4022,"log_dups_size":0,"ondisk_log_size":4022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:37:20.061043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125945874,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58888,"num_write_kb":861513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.484077+0000","last_change":"2024-09-13T15:01:44.824074+0000","last_active":"2024-09-13T15:15:28.484077+0000","last_peered":"2024-09-13T15:15:28.484077+0000","last_clean":"2024-09-13T15:15:28.484077+0000","last_became_active":"2024-09-13T15:01:44.821475+0000","last_became_peered":"2024-09-13T15:01:44.821475+0000","last_unstale":"2024-09-13T15:15:28.484077+0000","last_undegraded":"2024-09-13T15:15:28.484077+0000","last_fullsized":"2024-09-13T15:15:28.484077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:21.755093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"31'34","reported_seq":75,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:20.693066+0000","last_change":"2024-09-13T15:01:44.433502+0000","last_active":"2024-09-13T15:16:20.693066+0000","last_peered":"2024-09-13T15:16:20.693066+0000","last_clean":"2024-09-13T15:16:20.693066+0000","last_became_active":"2024-09-13T15:01:44.432902+0000","last_became_peered":"2024-09-13T15:01:44.432902+0000","last_unstale":"2024-09-13T15:16:20.693066+0000","last_undegraded":"2024-09-13T15:16:20.693066+0000","last_fullsized":"2024-09-13T15:16:20.693066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389688,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":8206,"num_write":28,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"33'4508","reported_seq":4534,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:14.980717+0000","last_change":"2024-09-13T15:01:48.846695+0000","last_active":"2024-09-13T15:16:14.980717+0000","last_peered":"2024-09-13T15:16:14.980717+0000","last_clean":"2024-09-13T15:16:14.980717+0000","last_became_active":"2024-09-13T15:01:48.846301+0000","last_became_peered":"2024-09-13T15:01:48.846301+0000","last_unstale":"2024-09-13T15:16:14.980717+0000","last_undegraded":"2024-09-13T15:16:14.980717+0000","last_fullsized":"2024-09-13T15:16:14.980717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4508,"log_dups_size":0,"ondisk_log_size":4508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:17.532499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109074139,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66114,"num_write_kb":975469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"33'7","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:00.870032+0000","last_change":"2024-09-13T15:01:44.814483+0000","last_active":"2024-09-13T15:16:00.870032+0000","last_peered":"2024-09-13T15:16:00.870032+0000","last_clean":"2024-09-13T15:16:00.870032+0000","last_became_active":"2024-09-13T15:01:44.814192+0000","last_became_peered":"2024-09-13T15:01:44.814192+0000","last_unstale":"2024-09-13T15:16:00.870032+0000","last_undegraded":"2024-09-13T15:16:00.870032+0000","last_fullsized":"2024-09-13T15:16:00.870032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:32:30.303635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'31","reported_seq":88,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.677968+0000","last_change":"2024-09-13T15:01:44.399314+0000","last_active":"2024-09-13T15:16:10.677968+0000","last_peered":"2024-09-13T15:16:10.677968+0000","last_clean":"2024-09-13T15:16:10.677968+0000","last_became_active":"2024-09-13T15:01:44.398904+0000","last_became_peered":"2024-09-13T15:01:44.398904+0000","last_unstale":"2024-09-13T15:16:10.677968+0000","last_undegraded":"2024-09-13T15:16:10.677968+0000","last_fullsized":"2024-09-13T15:16:10.677968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:38.645179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70412,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":156,"num_write":29,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'5188","reported_seq":5214,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:14.931138+0000","last_change":"2024-09-13T15:01:48.859142+0000","last_active":"2024-09-13T15:16:14.931138+0000","last_peered":"2024-09-13T15:16:14.931138+0000","last_clean":"2024-09-13T15:16:14.931138+0000","last_became_active":"2024-09-13T15:01:48.858649+0000","last_became_peered":"2024-09-13T15:01:48.858649+0000","last_unstale":"2024-09-13T15:16:14.931138+0000","last_undegraded":"2024-09-13T15:16:14.931138+0000","last_fullsized":"2024-09-13T15:16:14.931138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5188,"log_dups_size":0,"ondisk_log_size":5188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:27.314012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130098270,"num_objects":36,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76289,"num_write_kb":1087992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"28'1","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:16.941952+0000","last_change":"2024-09-13T15:01:44.826501+0000","last_active":"2024-09-13T15:16:16.941952+0000","last_peered":"2024-09-13T15:16:16.941952+0000","last_clean":"2024-09-13T15:16:16.941952+0000","last_became_active":"2024-09-13T15:01:44.826222+0000","last_became_peered":"2024-09-13T15:01:44.826222+0000","last_unstale":"2024-09-13T15:16:16.941952+0000","last_undegraded":"2024-09-13T15:16:16.941952+0000","last_fullsized":"2024-09-13T15:16:16.941952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"32'26","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:33.062368+0000","last_change":"2024-09-13T15:01:44.421891+0000","last_active":"2024-09-13T15:15:33.062368+0000","last_peered":"2024-09-13T15:15:33.062368+0000","last_clean":"2024-09-13T15:15:33.062368+0000","last_became_active":"2024-09-13T15:01:44.419660+0000","last_became_peered":"2024-09-13T15:01:44.419660+0000","last_unstale":"2024-09-13T15:15:33.062368+0000","last_undegraded":"2024-09-13T15:15:33.062368+0000","last_fullsized":"2024-09-13T15:15:33.062368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:27.554128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":20,"num_write_kb":8201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'4186","reported_seq":4223,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:17.230077+0000","last_change":"2024-09-13T15:02:34.119111+0000","last_active":"2024-09-13T15:16:17.230077+0000","last_peered":"2024-09-13T15:16:17.230077+0000","last_clean":"2024-09-13T15:16:17.230077+0000","last_became_active":"2024-09-13T15:02:34.118461+0000","last_became_peered":"2024-09-13T15:02:34.118461+0000","last_unstale":"2024-09-13T15:16:17.230077+0000","last_undegraded":"2024-09-13T15:16:17.230077+0000","last_fullsized":"2024-09-13T15:16:17.230077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":0,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63247989,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60754,"num_write_kb":878332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:16.965058+0000","last_change":"2024-09-13T15:01:44.850498+0000","last_active":"2024-09-13T15:16:16.965058+0000","last_peered":"2024-09-13T15:16:16.965058+0000","last_clean":"2024-09-13T15:16:16.965058+0000","last_became_active":"2024-09-13T15:01:44.850234+0000","last_became_peered":"2024-09-13T15:01:44.850234+0000","last_unstale":"2024-09-13T15:16:16.965058+0000","last_undegraded":"2024-09-13T15:16:16.965058+0000","last_fullsized":"2024-09-13T15:16:16.965058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:20.693169+0000","last_change":"2024-09-13T15:01:44.411997+0000","last_active":"2024-09-13T15:16:20.693169+0000","last_peered":"2024-09-13T15:16:20.693169+0000","last_clean":"2024-09-13T15:16:20.693169+0000","last_became_active":"2024-09-13T15:01:44.410675+0000","last_became_peered":"2024-09-13T15:01:44.410675+0000","last_unstale":"2024-09-13T15:16:20.693169+0000","last_undegraded":"2024-09-13T15:16:20.693169+0000","last_fullsized":"2024-09-13T15:16:20.693169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":18,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":182,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.866875+0000","last_change":"2024-09-13T15:01:40.834440+0000","last_active":"2024-09-13T15:15:27.866875+0000","last_peered":"2024-09-13T15:15:27.866875+0000","last_clean":"2024-09-13T15:15:27.866875+0000","last_became_active":"2024-09-13T15:01:40.832279+0000","last_became_peered":"2024-09-13T15:01:40.832279+0000","last_unstale":"2024-09-13T15:15:27.866875+0000","last_undegraded":"2024-09-13T15:15:27.866875+0000","last_fullsized":"2024-09-13T15:15:27.866875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:39.264455+0000","last_clean_scrub_stamp":"2024-09-13T15:01:39.264455+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:56:11.875506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"33'5119","reported_seq":5145,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:20.209628+0000","last_change":"2024-09-13T15:01:48.919580+0000","last_active":"2024-09-13T15:16:20.209628+0000","last_peered":"2024-09-13T15:16:20.209628+0000","last_clean":"2024-09-13T15:16:20.209628+0000","last_became_active":"2024-09-13T15:01:48.918678+0000","last_became_peered":"2024-09-13T15:01:48.918678+0000","last_unstale":"2024-09-13T15:16:20.209628+0000","last_undegraded":"2024-09-13T15:16:20.209628+0000","last_fullsized":"2024-09-13T15:16:20.209628+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5119,"log_dups_size":0,"ondisk_log_size":5119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:02.840528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58723686,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74830,"num_write_kb":1044614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.222286+0000","last_change":"2024-09-13T15:01:44.849975+0000","last_active":"2024-09-13T15:16:02.222286+0000","last_peered":"2024-09-13T15:16:02.222286+0000","last_clean":"2024-09-13T15:16:02.222286+0000","last_became_active":"2024-09-13T15:01:44.849457+0000","last_became_peered":"2024-09-13T15:01:44.849457+0000","last_unstale":"2024-09-13T15:16:02.222286+0000","last_undegraded":"2024-09-13T15:16:02.222286+0000","last_fullsized":"2024-09-13T15:16:02.222286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:51.139153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"33'10","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:29.143262+0000","last_change":"2024-09-13T15:01:44.420906+0000","last_active":"2024-09-13T15:15:29.143262+0000","last_peered":"2024-09-13T15:15:29.143262+0000","last_clean":"2024-09-13T15:15:29.143262+0000","last_became_active":"2024-09-13T15:01:44.420601+0000","last_became_peered":"2024-09-13T15:01:44.420601+0000","last_unstale":"2024-09-13T15:15:29.143262+0000","last_undegraded":"2024-09-13T15:15:29.143262+0000","last_fullsized":"2024-09-13T15:15:29.143262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:33.245745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"33'4511","reported_seq":4537,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:20.498162+0000","last_change":"2024-09-13T15:01:48.911047+0000","last_active":"2024-09-13T15:16:20.498162+0000","last_peered":"2024-09-13T15:16:20.498162+0000","last_clean":"2024-09-13T15:16:20.498162+0000","last_became_active":"2024-09-13T15:01:48.910479+0000","last_became_peered":"2024-09-13T15:01:48.910479+0000","last_unstale":"2024-09-13T15:16:20.498162+0000","last_undegraded":"2024-09-13T15:16:20.498162+0000","last_fullsized":"2024-09-13T15:16:20.498162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":0,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:41:06.558889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360209,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65899,"num_write_kb":920675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"33'8","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:18.130920+0000","last_change":"2024-09-13T15:01:44.838098+0000","last_active":"2024-09-13T15:16:18.130920+0000","last_peered":"2024-09-13T15:16:18.130920+0000","last_clean":"2024-09-13T15:16:18.130920+0000","last_became_active":"2024-09-13T15:01:44.837429+0000","last_became_peered":"2024-09-13T15:01:44.837429+0000","last_unstale":"2024-09-13T15:16:18.130920+0000","last_undegraded":"2024-09-13T15:16:18.130920+0000","last_fullsized":"2024-09-13T15:16:18.130920+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"30'15","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:32.877991+0000","last_change":"2024-09-13T15:01:44.406999+0000","last_active":"2024-09-13T15:15:32.877991+0000","last_peered":"2024-09-13T15:15:32.877991+0000","last_clean":"2024-09-13T15:15:32.877991+0000","last_became_active":"2024-09-13T15:01:44.406719+0000","last_became_peered":"2024-09-13T15:01:44.406719+0000","last_unstale":"2024-09-13T15:15:32.877991+0000","last_undegraded":"2024-09-13T15:15:32.877991+0000","last_fullsized":"2024-09-13T15:15:32.877991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:01:33.397091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":9,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"33'5102","reported_seq":5129,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:17.518055+0000","last_change":"2024-09-13T15:01:48.857931+0000","last_active":"2024-09-13T15:16:17.518055+0000","last_peered":"2024-09-13T15:16:17.518055+0000","last_clean":"2024-09-13T15:16:17.518055+0000","last_became_active":"2024-09-13T15:01:48.857542+0000","last_became_peered":"2024-09-13T15:01:48.857542+0000","last_unstale":"2024-09-13T15:16:17.518055+0000","last_undegraded":"2024-09-13T15:16:17.518055+0000","last_fullsized":"2024-09-13T15:16:17.518055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5102,"log_dups_size":0,"ondisk_log_size":5102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67754361,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74222,"num_write_kb":1079868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:05.311578+0000","last_change":"2024-09-13T15:01:44.835470+0000","last_active":"2024-09-13T15:16:05.311578+0000","last_peered":"2024-09-13T15:16:05.311578+0000","last_clean":"2024-09-13T15:16:05.311578+0000","last_became_active":"2024-09-13T15:01:44.831166+0000","last_became_peered":"2024-09-13T15:01:44.831166+0000","last_unstale":"2024-09-13T15:16:05.311578+0000","last_undegraded":"2024-09-13T15:16:05.311578+0000","last_fullsized":"2024-09-13T15:16:05.311578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:43:05.887592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"30'19","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.085247+0000","last_change":"2024-09-13T15:01:44.403111+0000","last_active":"2024-09-13T15:15:57.085247+0000","last_peered":"2024-09-13T15:15:57.085247+0000","last_clean":"2024-09-13T15:15:57.085247+0000","last_became_active":"2024-09-13T15:01:44.401799+0000","last_became_peered":"2024-09-13T15:01:44.401799+0000","last_unstale":"2024-09-13T15:15:57.085247+0000","last_undegraded":"2024-09-13T15:15:57.085247+0000","last_fullsized":"2024-09-13T15:15:57.085247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:54.589470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":4114,"num_write":17,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"33'4755","reported_seq":4782,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:20.544505+0000","last_change":"2024-09-13T15:01:48.912490+0000","last_active":"2024-09-13T15:16:20.544505+0000","last_peered":"2024-09-13T15:16:20.544505+0000","last_clean":"2024-09-13T15:16:20.544505+0000","last_became_active":"2024-09-13T15:01:48.911474+0000","last_became_peered":"2024-09-13T15:01:48.911474+0000","last_unstale":"2024-09-13T15:16:20.544505+0000","last_undegraded":"2024-09-13T15:16:20.544505+0000","last_fullsized":"2024-09-13T15:16:20.544505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4755,"log_dups_size":0,"ondisk_log_size":4755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21039595,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69035,"num_write_kb":987747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"33'5","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.323892+0000","last_change":"2024-09-13T15:01:44.818472+0000","last_active":"2024-09-13T15:16:02.323892+0000","last_peered":"2024-09-13T15:16:02.323892+0000","last_clean":"2024-09-13T15:16:02.323892+0000","last_became_active":"2024-09-13T15:01:44.817718+0000","last_became_peered":"2024-09-13T15:01:44.817718+0000","last_unstale":"2024-09-13T15:16:02.323892+0000","last_undegraded":"2024-09-13T15:16:02.323892+0000","last_fullsized":"2024-09-13T15:16:02.323892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:21.310696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"31'15","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:32.879744+0000","last_change":"2024-09-13T15:01:44.410376+0000","last_active":"2024-09-13T15:15:32.879744+0000","last_peered":"2024-09-13T15:15:32.879744+0000","last_clean":"2024-09-13T15:15:32.879744+0000","last_became_active":"2024-09-13T15:01:44.409585+0000","last_became_peered":"2024-09-13T15:01:44.409585+0000","last_unstale":"2024-09-13T15:15:32.879744+0000","last_undegraded":"2024-09-13T15:15:32.879744+0000","last_fullsized":"2024-09-13T15:15:32.879744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:45.845804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"33'5292","reported_seq":5318,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:18.194219+0000","last_change":"2024-09-13T15:01:48.861130+0000","last_active":"2024-09-13T15:16:18.194219+0000","last_peered":"2024-09-13T15:16:18.194219+0000","last_clean":"2024-09-13T15:16:18.194219+0000","last_became_active":"2024-09-13T15:01:48.860317+0000","last_became_peered":"2024-09-13T15:01:48.860317+0000","last_unstale":"2024-09-13T15:16:18.194219+0000","last_undegraded":"2024-09-13T15:16:18.194219+0000","last_fullsized":"2024-09-13T15:16:18.194219+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5292,"log_dups_size":0,"ondisk_log_size":5292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:45.317747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96488134,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77536,"num_write_kb":1107255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.458366+0000","last_change":"2024-09-13T15:01:44.835494+0000","last_active":"2024-09-13T15:16:10.458366+0000","last_peered":"2024-09-13T15:16:10.458366+0000","last_clean":"2024-09-13T15:16:10.458366+0000","last_became_active":"2024-09-13T15:01:44.831150+0000","last_became_peered":"2024-09-13T15:01:44.831150+0000","last_unstale":"2024-09-13T15:16:10.458366+0000","last_undegraded":"2024-09-13T15:16:10.458366+0000","last_fullsized":"2024-09-13T15:16:10.458366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:36:29.538665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"31'22","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.115656+0000","last_change":"2024-09-13T15:01:44.390278+0000","last_active":"2024-09-13T15:15:57.115656+0000","last_peered":"2024-09-13T15:15:57.115656+0000","last_clean":"2024-09-13T15:15:57.115656+0000","last_became_active":"2024-09-13T15:01:44.389946+0000","last_became_peered":"2024-09-13T15:01:44.389946+0000","last_unstale":"2024-09-13T15:15:57.115656+0000","last_undegraded":"2024-09-13T15:15:57.115656+0000","last_fullsized":"2024-09-13T15:15:57.115656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:53.072270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"33'4103","reported_seq":4130,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:18.180284+0000","last_change":"2024-09-13T15:01:48.848009+0000","last_active":"2024-09-13T15:16:18.180284+0000","last_peered":"2024-09-13T15:16:18.180284+0000","last_clean":"2024-09-13T15:16:18.180284+0000","last_became_active":"2024-09-13T15:01:48.847605+0000","last_became_peered":"2024-09-13T15:01:48.847605+0000","last_unstale":"2024-09-13T15:16:18.180284+0000","last_undegraded":"2024-09-13T15:16:18.180284+0000","last_fullsized":"2024-09-13T15:16:18.180284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4103,"log_dups_size":0,"ondisk_log_size":4103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54610433,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59554,"num_write_kb":873580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"28'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.599764+0000","last_change":"2024-09-13T15:01:44.808572+0000","last_active":"2024-09-13T15:15:28.599764+0000","last_peered":"2024-09-13T15:15:28.599764+0000","last_clean":"2024-09-13T15:15:28.599764+0000","last_became_active":"2024-09-13T15:01:44.808140+0000","last_became_peered":"2024-09-13T15:01:44.808140+0000","last_unstale":"2024-09-13T15:15:28.599764+0000","last_undegraded":"2024-09-13T15:15:28.599764+0000","last_fullsized":"2024-09-13T15:15:28.599764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:15.497720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"33'9","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:45.745857+0000","last_change":"2024-09-13T15:01:44.428794+0000","last_active":"2024-09-13T15:15:45.745857+0000","last_peered":"2024-09-13T15:15:45.745857+0000","last_clean":"2024-09-13T15:15:45.745857+0000","last_became_active":"2024-09-13T15:01:44.428271+0000","last_became_peered":"2024-09-13T15:01:44.428271+0000","last_unstale":"2024-09-13T15:15:45.745857+0000","last_undegraded":"2024-09-13T15:15:45.745857+0000","last_fullsized":"2024-09-13T15:15:45.745857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:38:53.225826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"33'4932","reported_seq":4959,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:19.236699+0000","last_change":"2024-09-13T15:01:48.916354+0000","last_active":"2024-09-13T15:16:19.236699+0000","last_peered":"2024-09-13T15:16:19.236699+0000","last_clean":"2024-09-13T15:16:19.236699+0000","last_became_active":"2024-09-13T15:01:48.916008+0000","last_became_peered":"2024-09-13T15:01:48.916008+0000","last_unstale":"2024-09-13T15:16:19.236699+0000","last_undegraded":"2024-09-13T15:16:19.236699+0000","last_fullsized":"2024-09-13T15:16:19.236699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4932,"log_dups_size":0,"ondisk_log_size":4932,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88104194,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72349,"num_write_kb":1020409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'15","reported_seq":42,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.217211+0000","last_change":"2024-09-13T15:01:44.826700+0000","last_active":"2024-09-13T15:16:08.217211+0000","last_peered":"2024-09-13T15:16:08.217211+0000","last_clean":"2024-09-13T15:16:08.217211+0000","last_became_active":"2024-09-13T15:01:44.825996+0000","last_became_peered":"2024-09-13T15:01:44.825996+0000","last_unstale":"2024-09-13T15:16:08.217211+0000","last_undegraded":"2024-09-13T15:16:08.217211+0000","last_fullsized":"2024-09-13T15:16:08.217211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:49:11.963837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"32'6","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:45.836982+0000","last_change":"2024-09-13T15:01:44.409339+0000","last_active":"2024-09-13T15:15:45.836982+0000","last_peered":"2024-09-13T15:15:45.836982+0000","last_clean":"2024-09-13T15:15:45.836982+0000","last_became_active":"2024-09-13T15:01:44.408644+0000","last_became_peered":"2024-09-13T15:01:44.408644+0000","last_unstale":"2024-09-13T15:15:45.836982+0000","last_undegraded":"2024-09-13T15:15:45.836982+0000","last_fullsized":"2024-09-13T15:15:45.836982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'4715","reported_seq":4742,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:18.986123+0000","last_change":"2024-09-13T15:01:48.916478+0000","last_active":"2024-09-13T15:16:18.986123+0000","last_peered":"2024-09-13T15:16:18.986123+0000","last_clean":"2024-09-13T15:16:18.986123+0000","last_became_active":"2024-09-13T15:01:48.916198+0000","last_became_peered":"2024-09-13T15:01:48.916198+0000","last_unstale":"2024-09-13T15:16:18.986123+0000","last_undegraded":"2024-09-13T15:16:18.986123+0000","last_fullsized":"2024-09-13T15:16:18.986123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4715,"log_dups_size":0,"ondisk_log_size":4715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54602807,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68950,"num_write_kb":974417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'6","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:07.421928+0000","last_change":"2024-09-13T15:01:44.831833+0000","last_active":"2024-09-13T15:16:07.421928+0000","last_peered":"2024-09-13T15:16:07.421928+0000","last_clean":"2024-09-13T15:16:07.421928+0000","last_became_active":"2024-09-13T15:01:44.831583+0000","last_became_peered":"2024-09-13T15:01:44.831583+0000","last_unstale":"2024-09-13T15:16:07.421928+0000","last_undegraded":"2024-09-13T15:16:07.421928+0000","last_fullsized":"2024-09-13T15:16:07.421928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"30'30","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.071504+0000","last_change":"2024-09-13T15:01:44.408752+0000","last_active":"2024-09-13T15:15:57.071504+0000","last_peered":"2024-09-13T15:15:57.071504+0000","last_clean":"2024-09-13T15:15:57.071504+0000","last_became_active":"2024-09-13T15:01:44.408453+0000","last_became_peered":"2024-09-13T15:01:44.408453+0000","last_unstale":"2024-09-13T15:15:57.071504+0000","last_undegraded":"2024-09-13T15:15:57.071504+0000","last_fullsized":"2024-09-13T15:15:57.071504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":8225,"num_write":32,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'5120","reported_seq":5147,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:20.531630+0000","last_change":"2024-09-13T15:01:48.916681+0000","last_active":"2024-09-13T15:16:20.531630+0000","last_peered":"2024-09-13T15:16:20.531630+0000","last_clean":"2024-09-13T15:16:20.531630+0000","last_became_active":"2024-09-13T15:01:48.916185+0000","last_became_peered":"2024-09-13T15:01:48.916185+0000","last_unstale":"2024-09-13T15:16:20.531630+0000","last_undegraded":"2024-09-13T15:16:20.531630+0000","last_fullsized":"2024-09-13T15:16:20.531630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5120,"log_dups_size":0,"ondisk_log_size":5120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29498562,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74453,"num_write_kb":1089564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"33'5","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:16.612650+0000","last_change":"2024-09-13T15:01:44.817007+0000","last_active":"2024-09-13T15:16:16.612650+0000","last_peered":"2024-09-13T15:16:16.612650+0000","last_clean":"2024-09-13T15:16:16.612650+0000","last_became_active":"2024-09-13T15:01:44.815435+0000","last_became_peered":"2024-09-13T15:01:44.815435+0000","last_unstale":"2024-09-13T15:16:16.612650+0000","last_undegraded":"2024-09-13T15:16:16.612650+0000","last_fullsized":"2024-09-13T15:16:16.612650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:25.887993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'576","reported_seq":617,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.679087+0000","last_change":"2024-09-13T15:01:44.435688+0000","last_active":"2024-09-13T15:16:10.679087+0000","last_peered":"2024-09-13T15:16:10.679087+0000","last_clean":"2024-09-13T15:16:10.679087+0000","last_became_active":"2024-09-13T15:01:44.435222+0000","last_became_peered":"2024-09-13T15:01:44.435222+0000","last_unstale":"2024-09-13T15:16:10.679087+0000","last_undegraded":"2024-09-13T15:16:10.679087+0000","last_fullsized":"2024-09-13T15:16:10.679087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:51:24.705633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8159583,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":7965,"num_write":571,"num_write_kb":8183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"33'4417","reported_seq":4443,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:15.019930+0000","last_change":"2024-09-13T15:01:48.847694+0000","last_active":"2024-09-13T15:16:15.019930+0000","last_peered":"2024-09-13T15:16:15.019930+0000","last_clean":"2024-09-13T15:16:15.019930+0000","last_became_active":"2024-09-13T15:01:48.846835+0000","last_became_peered":"2024-09-13T15:01:48.846835+0000","last_unstale":"2024-09-13T15:16:15.019930+0000","last_undegraded":"2024-09-13T15:16:15.019930+0000","last_fullsized":"2024-09-13T15:16:15.019930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4417,"log_dups_size":0,"ondisk_log_size":4417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:04:49.763472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163604090,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64967,"num_write_kb":924599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.484365+0000","last_change":"2024-09-13T15:01:44.835315+0000","last_active":"2024-09-13T15:15:28.484365+0000","last_peered":"2024-09-13T15:15:28.484365+0000","last_clean":"2024-09-13T15:15:28.484365+0000","last_became_active":"2024-09-13T15:01:44.834643+0000","last_became_peered":"2024-09-13T15:01:44.834643+0000","last_unstale":"2024-09-13T15:15:28.484365+0000","last_undegraded":"2024-09-13T15:15:28.484365+0000","last_fullsized":"2024-09-13T15:15:28.484365+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:15.535195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'15","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.909799+0000","last_change":"2024-09-13T15:01:44.424966+0000","last_active":"2024-09-13T15:16:10.909799+0000","last_peered":"2024-09-13T15:16:10.909799+0000","last_clean":"2024-09-13T15:16:10.909799+0000","last_became_active":"2024-09-13T15:01:44.424714+0000","last_became_peered":"2024-09-13T15:01:44.424714+0000","last_unstale":"2024-09-13T15:16:10.909799+0000","last_undegraded":"2024-09-13T15:16:10.909799+0000","last_fullsized":"2024-09-13T15:16:10.909799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:05:46.010024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":15,"num_write":17,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'4785","reported_seq":4821,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:18.264894+0000","last_change":"2024-09-13T15:02:33.753482+0000","last_active":"2024-09-13T15:16:18.264894+0000","last_peered":"2024-09-13T15:16:18.264894+0000","last_clean":"2024-09-13T15:16:18.264894+0000","last_became_active":"2024-09-13T15:02:33.752505+0000","last_became_peered":"2024-09-13T15:02:33.752505+0000","last_unstale":"2024-09-13T15:16:18.264894+0000","last_undegraded":"2024-09-13T15:16:18.264894+0000","last_fullsized":"2024-09-13T15:16:18.264894+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4785,"log_dups_size":0,"ondisk_log_size":4785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:39:59.041586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62945647,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69720,"num_write_kb":999376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"33'9","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:15.871984+0000","last_change":"2024-09-13T15:01:44.837032+0000","last_active":"2024-09-13T15:16:15.871984+0000","last_peered":"2024-09-13T15:16:15.871984+0000","last_clean":"2024-09-13T15:16:15.871984+0000","last_became_active":"2024-09-13T15:01:44.836750+0000","last_became_peered":"2024-09-13T15:01:44.836750+0000","last_unstale":"2024-09-13T15:16:15.871984+0000","last_undegraded":"2024-09-13T15:16:15.871984+0000","last_fullsized":"2024-09-13T15:16:15.871984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"33'9","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:15.880187+0000","last_change":"2024-09-13T15:01:44.437854+0000","last_active":"2024-09-13T15:16:15.880187+0000","last_peered":"2024-09-13T15:16:15.880187+0000","last_clean":"2024-09-13T15:16:15.880187+0000","last_became_active":"2024-09-13T15:01:44.437433+0000","last_became_peered":"2024-09-13T15:01:44.437433+0000","last_unstale":"2024-09-13T15:16:15.880187+0000","last_undegraded":"2024-09-13T15:16:15.880187+0000","last_fullsized":"2024-09-13T15:16:15.880187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":18,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'4880","reported_seq":4907,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:19.221343+0000","last_change":"2024-09-13T15:01:48.841829+0000","last_active":"2024-09-13T15:16:19.221343+0000","last_peered":"2024-09-13T15:16:19.221343+0000","last_clean":"2024-09-13T15:16:19.221343+0000","last_became_active":"2024-09-13T15:01:48.841267+0000","last_became_peered":"2024-09-13T15:01:48.841267+0000","last_unstale":"2024-09-13T15:16:19.221343+0000","last_undegraded":"2024-09-13T15:16:19.221343+0000","last_fullsized":"2024-09-13T15:16:19.221343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4880,"log_dups_size":0,"ondisk_log_size":4880,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67136632,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71227,"num_write_kb":1004130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:20.693069+0000","last_change":"2024-09-13T15:01:44.844701+0000","last_active":"2024-09-13T15:16:20.693069+0000","last_peered":"2024-09-13T15:16:20.693069+0000","last_clean":"2024-09-13T15:16:20.693069+0000","last_became_active":"2024-09-13T15:01:44.843982+0000","last_became_peered":"2024-09-13T15:01:44.843982+0000","last_unstale":"2024-09-13T15:16:20.693069+0000","last_undegraded":"2024-09-13T15:16:20.693069+0000","last_fullsized":"2024-09-13T15:16:20.693069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"33'14","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.660174+0000","last_change":"2024-09-13T15:01:44.436081+0000","last_active":"2024-09-13T15:16:10.660174+0000","last_peered":"2024-09-13T15:16:10.660174+0000","last_clean":"2024-09-13T15:16:10.660174+0000","last_became_active":"2024-09-13T15:01:44.435367+0000","last_became_peered":"2024-09-13T15:01:44.435367+0000","last_unstale":"2024-09-13T15:16:10.660174+0000","last_undegraded":"2024-09-13T15:16:10.660174+0000","last_fullsized":"2024-09-13T15:16:10.660174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:57:57.065719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":15,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"33'3923","reported_seq":3950,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:19.146148+0000","last_change":"2024-09-13T15:01:48.910562+0000","last_active":"2024-09-13T15:16:19.146148+0000","last_peered":"2024-09-13T15:16:19.146148+0000","last_clean":"2024-09-13T15:16:19.146148+0000","last_became_active":"2024-09-13T15:01:48.909681+0000","last_became_peered":"2024-09-13T15:01:48.909681+0000","last_unstale":"2024-09-13T15:16:19.146148+0000","last_undegraded":"2024-09-13T15:16:19.146148+0000","last_fullsized":"2024-09-13T15:16:19.146148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":3923,"log_dups_size":0,"ondisk_log_size":3923,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50355379,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57377,"num_write_kb":843085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'3661","reported_seq":3699,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:17.909671+0000","last_change":"2024-09-13T15:02:34.118951+0000","last_active":"2024-09-13T15:16:17.909671+0000","last_peered":"2024-09-13T15:16:17.909671+0000","last_clean":"2024-09-13T15:16:17.909671+0000","last_became_active":"2024-09-13T15:02:34.118477+0000","last_became_peered":"2024-09-13T15:02:34.118477+0000","last_unstale":"2024-09-13T15:16:17.909671+0000","last_undegraded":"2024-09-13T15:16:17.909671+0000","last_fullsized":"2024-09-13T15:16:17.909671+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":3661,"log_dups_size":0,"ondisk_log_size":3661,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50426356,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53422,"num_write_kb":757724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'7","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:05.388722+0000","last_change":"2024-09-13T15:01:44.808417+0000","last_active":"2024-09-13T15:16:05.388722+0000","last_peered":"2024-09-13T15:16:05.388722+0000","last_clean":"2024-09-13T15:16:05.388722+0000","last_became_active":"2024-09-13T15:01:44.807641+0000","last_became_peered":"2024-09-13T15:01:44.807641+0000","last_unstale":"2024-09-13T15:16:05.388722+0000","last_undegraded":"2024-09-13T15:16:05.388722+0000","last_fullsized":"2024-09-13T15:16:05.388722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:47:58.296966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"32'34","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:15.880043+0000","last_change":"2024-09-13T15:01:44.433582+0000","last_active":"2024-09-13T15:16:15.880043+0000","last_peered":"2024-09-13T15:16:15.880043+0000","last_clean":"2024-09-13T15:16:15.880043+0000","last_became_active":"2024-09-13T15:01:44.433124+0000","last_became_peered":"2024-09-13T15:01:44.433124+0000","last_unstale":"2024-09-13T15:16:15.880043+0000","last_undegraded":"2024-09-13T15:16:15.880043+0000","last_fullsized":"2024-09-13T15:16:15.880043+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":8193,"num_write":27,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4905","reported_seq":4932,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:19.302340+0000","last_change":"2024-09-13T15:01:48.855090+0000","last_active":"2024-09-13T15:16:19.302340+0000","last_peered":"2024-09-13T15:16:19.302340+0000","last_clean":"2024-09-13T15:16:19.302340+0000","last_became_active":"2024-09-13T15:01:48.852925+0000","last_became_peered":"2024-09-13T15:01:48.852925+0000","last_unstale":"2024-09-13T15:16:19.302340+0000","last_undegraded":"2024-09-13T15:16:19.302340+0000","last_fullsized":"2024-09-13T15:16:19.302340+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4905,"log_dups_size":0,"ondisk_log_size":4905,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.176480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75527342,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71623,"num_write_kb":1060070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"33'9","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.732294+0000","last_change":"2024-09-13T15:02:33.746356+0000","last_active":"2024-09-13T15:15:58.732294+0000","last_peered":"2024-09-13T15:15:58.732294+0000","last_clean":"2024-09-13T15:15:58.732294+0000","last_became_active":"2024-09-13T15:02:33.746005+0000","last_became_peered":"2024-09-13T15:02:33.746005+0000","last_unstale":"2024-09-13T15:15:58.732294+0000","last_undegraded":"2024-09-13T15:15:58.732294+0000","last_fullsized":"2024-09-13T15:15:58.732294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:41.159781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"33'6","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:19.228846+0000","last_change":"2024-09-13T15:01:44.436900+0000","last_active":"2024-09-13T15:16:19.228846+0000","last_peered":"2024-09-13T15:16:19.228846+0000","last_clean":"2024-09-13T15:16:19.228846+0000","last_became_active":"2024-09-13T15:01:44.436646+0000","last_became_peered":"2024-09-13T15:01:44.436646+0000","last_unstale":"2024-09-13T15:16:19.228846+0000","last_undegraded":"2024-09-13T15:16:19.228846+0000","last_fullsized":"2024-09-13T15:16:19.228846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":27,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"33'47","reported_seq":83,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:34.359088+0000","last_change":"2024-09-13T15:01:44.430115+0000","last_active":"2024-09-13T15:15:34.359088+0000","last_peered":"2024-09-13T15:15:34.359088+0000","last_clean":"2024-09-13T15:15:34.359088+0000","last_became_active":"2024-09-13T15:01:44.429339+0000","last_became_peered":"2024-09-13T15:01:44.429339+0000","last_unstale":"2024-09-13T15:15:34.359088+0000","last_undegraded":"2024-09-13T15:15:34.359088+0000","last_fullsized":"2024-09-13T15:15:34.359088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:47.224125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":8210,"num_write":46,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.771450+0000","last_change":"2024-09-13T15:01:44.822034+0000","last_active":"2024-09-13T15:16:10.771450+0000","last_peered":"2024-09-13T15:16:10.771450+0000","last_clean":"2024-09-13T15:16:10.771450+0000","last_became_active":"2024-09-13T15:01:44.821734+0000","last_became_peered":"2024-09-13T15:01:44.821734+0000","last_unstale":"2024-09-13T15:16:10.771450+0000","last_undegraded":"2024-09-13T15:16:10.771450+0000","last_fullsized":"2024-09-13T15:16:10.771450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"33'4690","reported_seq":4715,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:17.099367+0000","last_change":"2024-09-13T15:01:48.858033+0000","last_active":"2024-09-13T15:16:17.099367+0000","last_peered":"2024-09-13T15:16:17.099367+0000","last_clean":"2024-09-13T15:16:17.099367+0000","last_became_active":"2024-09-13T15:01:48.857584+0000","last_became_peered":"2024-09-13T15:01:48.857584+0000","last_unstale":"2024-09-13T15:16:17.099367+0000","last_undegraded":"2024-09-13T15:16:17.099367+0000","last_fullsized":"2024-09-13T15:16:17.099367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4690,"log_dups_size":0,"ondisk_log_size":4690,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:50:04.797167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71336559,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68659,"num_write_kb":960930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"33'1779","reported_seq":1811,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:10.674762+0000","last_change":"2024-09-13T15:01:44.422582+0000","last_active":"2024-09-13T15:16:10.674762+0000","last_peered":"2024-09-13T15:16:10.674762+0000","last_clean":"2024-09-13T15:16:10.674762+0000","last_became_active":"2024-09-13T15:01:44.422367+0000","last_became_peered":"2024-09-13T15:01:44.422367+0000","last_unstale":"2024-09-13T15:16:10.674762+0000","last_undegraded":"2024-09-13T15:16:10.674762+0000","last_fullsized":"2024-09-13T15:16:10.674762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":1779,"log_dups_size":0,"ondisk_log_size":1779,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195394,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":4098,"num_write":1775,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.483036+0000","last_change":"2024-09-13T15:01:44.820841+0000","last_active":"2024-09-13T15:15:28.483036+0000","last_peered":"2024-09-13T15:15:28.483036+0000","last_clean":"2024-09-13T15:15:28.483036+0000","last_became_active":"2024-09-13T15:01:44.816584+0000","last_became_peered":"2024-09-13T15:01:44.816584+0000","last_unstale":"2024-09-13T15:15:28.483036+0000","last_undegraded":"2024-09-13T15:15:28.483036+0000","last_fullsized":"2024-09-13T15:15:28.483036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:26.763818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4709","reported_seq":4735,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:19.102196+0000","last_change":"2024-09-13T15:01:48.840771+0000","last_active":"2024-09-13T15:16:19.102196+0000","last_peered":"2024-09-13T15:16:19.102196+0000","last_clean":"2024-09-13T15:16:19.102196+0000","last_became_active":"2024-09-13T15:01:48.840397+0000","last_became_peered":"2024-09-13T15:01:48.840397+0000","last_unstale":"2024-09-13T15:16:19.102196+0000","last_undegraded":"2024-09-13T15:16:19.102196+0000","last_fullsized":"2024-09-13T15:16:19.102196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4709,"log_dups_size":0,"ondisk_log_size":4709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37816873,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68729,"num_write_kb":983871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:06.767140+0000","last_change":"2024-09-13T15:01:44.809497+0000","last_active":"2024-09-13T15:16:06.767140+0000","last_peered":"2024-09-13T15:16:06.767140+0000","last_clean":"2024-09-13T15:16:06.767140+0000","last_became_active":"2024-09-13T15:01:44.808669+0000","last_became_peered":"2024-09-13T15:01:44.808669+0000","last_unstale":"2024-09-13T15:16:06.767140+0000","last_undegraded":"2024-09-13T15:16:06.767140+0000","last_fullsized":"2024-09-13T15:16:06.767140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:40:45.361562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"33'8","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.091461+0000","last_change":"2024-09-13T15:01:44.836353+0000","last_active":"2024-09-13T15:16:02.091461+0000","last_peered":"2024-09-13T15:16:02.091461+0000","last_clean":"2024-09-13T15:16:02.091461+0000","last_became_active":"2024-09-13T15:01:44.836102+0000","last_became_peered":"2024-09-13T15:01:44.836102+0000","last_unstale":"2024-09-13T15:16:02.091461+0000","last_undegraded":"2024-09-13T15:16:02.091461+0000","last_fullsized":"2024-09-13T15:16:02.091461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:45:14.014683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'6","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.868696+0000","last_change":"2024-09-13T15:01:44.849091+0000","last_active":"2024-09-13T15:15:27.868696+0000","last_peered":"2024-09-13T15:15:27.868696+0000","last_clean":"2024-09-13T15:15:27.868696+0000","last_became_active":"2024-09-13T15:01:44.846506+0000","last_became_peered":"2024-09-13T15:01:44.846506+0000","last_unstale":"2024-09-13T15:15:27.868696+0000","last_undegraded":"2024-09-13T15:15:27.868696+0000","last_fullsized":"2024-09-13T15:15:27.868696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"33'7","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:05.425378+0000","last_change":"2024-09-13T15:01:44.809873+0000","last_active":"2024-09-13T15:16:05.425378+0000","last_peered":"2024-09-13T15:16:05.425378+0000","last_clean":"2024-09-13T15:16:05.425378+0000","last_became_active":"2024-09-13T15:01:44.809585+0000","last_became_peered":"2024-09-13T15:01:44.809585+0000","last_unstale":"2024-09-13T15:16:05.425378+0000","last_undegraded":"2024-09-13T15:16:05.425378+0000","last_fullsized":"2024-09-13T15:16:05.425378+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'3","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:14.555946+0000","last_change":"2024-09-13T15:01:44.816761+0000","last_active":"2024-09-13T15:16:14.555946+0000","last_peered":"2024-09-13T15:16:14.555946+0000","last_clean":"2024-09-13T15:16:14.555946+0000","last_became_active":"2024-09-13T15:01:44.816480+0000","last_became_peered":"2024-09-13T15:01:44.816480+0000","last_unstale":"2024-09-13T15:16:14.555946+0000","last_undegraded":"2024-09-13T15:16:14.555946+0000","last_fullsized":"2024-09-13T15:16:14.555946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.712144+0000","last_change":"2024-09-13T15:01:44.808373+0000","last_active":"2024-09-13T15:15:28.712144+0000","last_peered":"2024-09-13T15:15:28.712144+0000","last_clean":"2024-09-13T15:15:28.712144+0000","last_became_active":"2024-09-13T15:01:44.807622+0000","last_became_peered":"2024-09-13T15:01:44.807622+0000","last_unstale":"2024-09-13T15:15:28.712144+0000","last_undegraded":"2024-09-13T15:15:28.712144+0000","last_fullsized":"2024-09-13T15:15:28.712144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:49:38.584426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"33'9","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:00.989658+0000","last_change":"2024-09-13T15:01:44.832521+0000","last_active":"2024-09-13T15:16:00.989658+0000","last_peered":"2024-09-13T15:16:00.989658+0000","last_clean":"2024-09-13T15:16:00.989658+0000","last_became_active":"2024-09-13T15:01:44.831889+0000","last_became_peered":"2024-09-13T15:01:44.831889+0000","last_unstale":"2024-09-13T15:16:00.989658+0000","last_undegraded":"2024-09-13T15:16:00.989658+0000","last_fullsized":"2024-09-13T15:16:00.989658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:17:07.563684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":28,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.390728+0000","last_change":"2024-09-13T15:01:44.817583+0000","last_active":"2024-09-13T15:15:28.390728+0000","last_peered":"2024-09-13T15:15:28.390728+0000","last_clean":"2024-09-13T15:15:28.390728+0000","last_became_active":"2024-09-13T15:01:44.817350+0000","last_became_peered":"2024-09-13T15:01:44.817350+0000","last_unstale":"2024-09-13T15:15:28.390728+0000","last_undegraded":"2024-09-13T15:15:28.390728+0000","last_fullsized":"2024-09-13T15:15:28.390728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"33'6","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:08.848783+0000","last_change":"2024-09-13T15:01:44.838372+0000","last_active":"2024-09-13T15:16:08.848783+0000","last_peered":"2024-09-13T15:16:08.848783+0000","last_clean":"2024-09-13T15:16:08.848783+0000","last_became_active":"2024-09-13T15:01:44.837588+0000","last_became_peered":"2024-09-13T15:01:44.837588+0000","last_unstale":"2024-09-13T15:16:08.848783+0000","last_undegraded":"2024-09-13T15:16:08.848783+0000","last_fullsized":"2024-09-13T15:16:08.848783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:13.717095+0000","last_change":"2024-09-13T15:01:44.828159+0000","last_active":"2024-09-13T15:16:13.717095+0000","last_peered":"2024-09-13T15:16:13.717095+0000","last_clean":"2024-09-13T15:16:13.717095+0000","last_became_active":"2024-09-13T15:01:44.827910+0000","last_became_peered":"2024-09-13T15:01:44.827910+0000","last_unstale":"2024-09-13T15:16:13.717095+0000","last_undegraded":"2024-09-13T15:16:13.717095+0000","last_fullsized":"2024-09-13T15:16:13.717095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"33'8","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:06.655643+0000","last_change":"2024-09-13T15:02:34.119204+0000","last_active":"2024-09-13T15:16:06.655643+0000","last_peered":"2024-09-13T15:16:06.655643+0000","last_clean":"2024-09-13T15:16:06.655643+0000","last_became_active":"2024-09-13T15:02:34.118621+0000","last_became_peered":"2024-09-13T15:02:34.118621+0000","last_unstale":"2024-09-13T15:16:06.655643+0000","last_undegraded":"2024-09-13T15:16:06.655643+0000","last_fullsized":"2024-09-13T15:16:06.655643+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:55:33.356064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"33'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:14.876217+0000","last_change":"2024-09-13T15:01:44.831717+0000","last_active":"2024-09-13T15:16:14.876217+0000","last_peered":"2024-09-13T15:16:14.876217+0000","last_clean":"2024-09-13T15:16:14.876217+0000","last_became_active":"2024-09-13T15:01:44.831495+0000","last_became_peered":"2024-09-13T15:01:44.831495+0000","last_unstale":"2024-09-13T15:16:14.876217+0000","last_undegraded":"2024-09-13T15:16:14.876217+0000","last_fullsized":"2024-09-13T15:16:14.876217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"33'9","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:12.590959+0000","last_change":"2024-09-13T15:01:44.829698+0000","last_active":"2024-09-13T15:16:12.590959+0000","last_peered":"2024-09-13T15:16:12.590959+0000","last_clean":"2024-09-13T15:16:12.590959+0000","last_became_active":"2024-09-13T15:01:44.828999+0000","last_became_peered":"2024-09-13T15:01:44.828999+0000","last_unstale":"2024-09-13T15:16:12.590959+0000","last_undegraded":"2024-09-13T15:16:12.590959+0000","last_fullsized":"2024-09-13T15:16:12.590959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:30.591718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"33'5","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.870580+0000","last_change":"2024-09-13T15:01:44.817554+0000","last_active":"2024-09-13T15:15:27.870580+0000","last_peered":"2024-09-13T15:15:27.870580+0000","last_clean":"2024-09-13T15:15:27.870580+0000","last_became_active":"2024-09-13T15:01:44.816258+0000","last_became_peered":"2024-09-13T15:01:44.816258+0000","last_unstale":"2024-09-13T15:15:27.870580+0000","last_undegraded":"2024-09-13T15:15:27.870580+0000","last_fullsized":"2024-09-13T15:15:27.870580+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:20:07.927802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"33'15","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.185393+0000","last_change":"2024-09-13T15:01:44.809979+0000","last_active":"2024-09-13T15:16:02.185393+0000","last_peered":"2024-09-13T15:16:02.185393+0000","last_clean":"2024-09-13T15:16:02.185393+0000","last_became_active":"2024-09-13T15:01:44.809687+0000","last_became_peered":"2024-09-13T15:01:44.809687+0000","last_unstale":"2024-09-13T15:16:02.185393+0000","last_undegraded":"2024-09-13T15:16:02.185393+0000","last_fullsized":"2024-09-13T15:16:02.185393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:33:45.583840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"33'10","reported_seq":31,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:05.355494+0000","last_change":"2024-09-13T15:02:34.119233+0000","last_active":"2024-09-13T15:16:05.355494+0000","last_peered":"2024-09-13T15:16:05.355494+0000","last_clean":"2024-09-13T15:16:05.355494+0000","last_became_active":"2024-09-13T15:02:34.118798+0000","last_became_peered":"2024-09-13T15:02:34.118798+0000","last_unstale":"2024-09-13T15:16:05.355494+0000","last_undegraded":"2024-09-13T15:16:05.355494+0000","last_fullsized":"2024-09-13T15:16:05.355494+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:12.367569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"33'7","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:01.691958+0000","last_change":"2024-09-13T15:01:44.848904+0000","last_active":"2024-09-13T15:16:01.691958+0000","last_peered":"2024-09-13T15:16:01.691958+0000","last_clean":"2024-09-13T15:16:01.691958+0000","last_became_active":"2024-09-13T15:01:44.846074+0000","last_became_peered":"2024-09-13T15:01:44.846074+0000","last_unstale":"2024-09-13T15:16:01.691958+0000","last_undegraded":"2024-09-13T15:16:01.691958+0000","last_fullsized":"2024-09-13T15:16:01.691958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.757358+0000","last_change":"2024-09-13T15:01:44.828243+0000","last_active":"2024-09-13T15:15:58.757358+0000","last_peered":"2024-09-13T15:15:58.757358+0000","last_clean":"2024-09-13T15:15:58.757358+0000","last_became_active":"2024-09-13T15:01:44.828024+0000","last_became_peered":"2024-09-13T15:01:44.828024+0000","last_unstale":"2024-09-13T15:15:58.757358+0000","last_undegraded":"2024-09-13T15:15:58.757358+0000","last_fullsized":"2024-09-13T15:15:58.757358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:28:47.388087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'4","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:58.196443+0000","last_change":"2024-09-13T15:01:44.808879+0000","last_active":"2024-09-13T15:15:58.196443+0000","last_peered":"2024-09-13T15:15:58.196443+0000","last_clean":"2024-09-13T15:15:58.196443+0000","last_became_active":"2024-09-13T15:01:44.808609+0000","last_became_peered":"2024-09-13T15:01:44.808609+0000","last_unstale":"2024-09-13T15:15:58.196443+0000","last_undegraded":"2024-09-13T15:15:58.196443+0000","last_fullsized":"2024-09-13T15:15:58.196443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:19.236667+0000","last_change":"2024-09-13T15:01:44.811171+0000","last_active":"2024-09-13T15:16:19.236667+0000","last_peered":"2024-09-13T15:16:19.236667+0000","last_clean":"2024-09-13T15:16:19.236667+0000","last_became_active":"2024-09-13T15:01:44.809918+0000","last_became_peered":"2024-09-13T15:01:44.809918+0000","last_unstale":"2024-09-13T15:16:19.236667+0000","last_undegraded":"2024-09-13T15:16:19.236667+0000","last_fullsized":"2024-09-13T15:16:19.236667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"33'3","reported_seq":30,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:28.484061+0000","last_change":"2024-09-13T15:01:44.833663+0000","last_active":"2024-09-13T15:15:28.484061+0000","last_peered":"2024-09-13T15:15:28.484061+0000","last_clean":"2024-09-13T15:15:28.484061+0000","last_became_active":"2024-09-13T15:01:44.828737+0000","last_became_peered":"2024-09-13T15:01:44.828737+0000","last_unstale":"2024-09-13T15:15:28.484061+0000","last_undegraded":"2024-09-13T15:15:28.484061+0000","last_fullsized":"2024-09-13T15:15:28.484061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:23:08.579890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:18.919901+0000","last_change":"2024-09-13T15:01:44.851143+0000","last_active":"2024-09-13T15:16:18.919901+0000","last_peered":"2024-09-13T15:16:18.919901+0000","last_clean":"2024-09-13T15:16:18.919901+0000","last_became_active":"2024-09-13T15:01:44.850410+0000","last_became_peered":"2024-09-13T15:01:44.850410+0000","last_unstale":"2024-09-13T15:16:18.919901+0000","last_undegraded":"2024-09-13T15:16:18.919901+0000","last_fullsized":"2024-09-13T15:16:18.919901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:11.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:17.487776+0000","last_change":"2024-09-13T15:01:44.840082+0000","last_active":"2024-09-13T15:16:17.487776+0000","last_peered":"2024-09-13T15:16:17.487776+0000","last_clean":"2024-09-13T15:16:17.487776+0000","last_became_active":"2024-09-13T15:01:44.839371+0000","last_became_peered":"2024-09-13T15:01:44.839371+0000","last_unstale":"2024-09-13T15:16:17.487776+0000","last_undegraded":"2024-09-13T15:16:17.487776+0000","last_fullsized":"2024-09-13T15:16:17.487776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:13.433036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"33'10","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:17.876368+0000","last_change":"2024-09-13T15:01:44.850416+0000","last_active":"2024-09-13T15:16:17.876368+0000","last_peered":"2024-09-13T15:16:17.876368+0000","last_clean":"2024-09-13T15:16:17.876368+0000","last_became_active":"2024-09-13T15:01:44.849766+0000","last_became_peered":"2024-09-13T15:01:44.849766+0000","last_unstale":"2024-09-13T15:16:17.876368+0000","last_undegraded":"2024-09-13T15:16:17.876368+0000","last_fullsized":"2024-09-13T15:16:17.876368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:11.985610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"33'6","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:00.925796+0000","last_change":"2024-09-13T15:01:44.837060+0000","last_active":"2024-09-13T15:16:00.925796+0000","last_peered":"2024-09-13T15:16:00.925796+0000","last_clean":"2024-09-13T15:16:00.925796+0000","last_became_active":"2024-09-13T15:01:44.836770+0000","last_became_peered":"2024-09-13T15:01:44.836770+0000","last_unstale":"2024-09-13T15:16:00.925796+0000","last_undegraded":"2024-09-13T15:16:00.925796+0000","last_fullsized":"2024-09-13T15:16:00.925796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'6","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:27.867509+0000","last_change":"2024-09-13T15:01:44.815867+0000","last_active":"2024-09-13T15:15:27.867509+0000","last_peered":"2024-09-13T15:15:27.867509+0000","last_clean":"2024-09-13T15:15:27.867509+0000","last_became_active":"2024-09-13T15:01:44.815116+0000","last_became_peered":"2024-09-13T15:01:44.815116+0000","last_unstale":"2024-09-13T15:15:27.867509+0000","last_undegraded":"2024-09-13T15:15:27.867509+0000","last_fullsized":"2024-09-13T15:15:27.867509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:51:02.814724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:19.211466+0000","last_change":"2024-09-13T15:01:44.850022+0000","last_active":"2024-09-13T15:16:19.211466+0000","last_peered":"2024-09-13T15:16:19.211466+0000","last_clean":"2024-09-13T15:16:19.211466+0000","last_became_active":"2024-09-13T15:01:44.849533+0000","last_became_peered":"2024-09-13T15:01:44.849533+0000","last_unstale":"2024-09-13T15:16:19.211466+0000","last_undegraded":"2024-09-13T15:16:19.211466+0000","last_fullsized":"2024-09-13T15:16:19.211466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:19.453803+0000","last_change":"2024-09-13T15:01:44.817139+0000","last_active":"2024-09-13T15:14:19.453803+0000","last_peered":"2024-09-13T15:14:19.453803+0000","last_clean":"2024-09-13T15:14:19.453803+0000","last_became_active":"2024-09-13T15:01:44.816416+0000","last_became_peered":"2024-09-13T15:01:44.816416+0000","last_unstale":"2024-09-13T15:14:19.453803+0000","last_undegraded":"2024-09-13T15:14:19.453803+0000","last_fullsized":"2024-09-13T15:14:19.453803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:55:38.382210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"33'5","reported_seq":27,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:29.143022+0000","last_change":"2024-09-13T15:02:33.747735+0000","last_active":"2024-09-13T15:15:29.143022+0000","last_peered":"2024-09-13T15:15:29.143022+0000","last_clean":"2024-09-13T15:15:29.143022+0000","last_became_active":"2024-09-13T15:02:33.747405+0000","last_became_peered":"2024-09-13T15:02:33.747405+0000","last_unstale":"2024-09-13T15:15:29.143022+0000","last_undegraded":"2024-09-13T15:15:29.143022+0000","last_fullsized":"2024-09-13T15:15:29.143022+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:20.616184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"33'5","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:16.941970+0000","last_change":"2024-09-13T15:01:44.808264+0000","last_active":"2024-09-13T15:16:16.941970+0000","last_peered":"2024-09-13T15:16:16.941970+0000","last_clean":"2024-09-13T15:16:16.941970+0000","last_became_active":"2024-09-13T15:01:44.807776+0000","last_became_peered":"2024-09-13T15:01:44.807776+0000","last_unstale":"2024-09-13T15:16:16.941970+0000","last_undegraded":"2024-09-13T15:16:16.941970+0000","last_fullsized":"2024-09-13T15:16:16.941970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"28'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T15:14:18.534958+0000","last_change":"2024-09-13T15:01:44.804985+0000","last_active":"2024-09-13T15:14:18.534958+0000","last_peered":"2024-09-13T15:14:18.534958+0000","last_clean":"2024-09-13T15:14:18.534958+0000","last_became_active":"2024-09-13T15:01:44.803977+0000","last_became_peered":"2024-09-13T15:01:44.803977+0000","last_unstale":"2024-09-13T15:14:18.534958+0000","last_undegraded":"2024-09-13T15:14:18.534958+0000","last_fullsized":"2024-09-13T15:14:18.534958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:12.999738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"33'9","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:06.045422+0000","last_change":"2024-09-13T15:01:44.824666+0000","last_active":"2024-09-13T15:16:06.045422+0000","last_peered":"2024-09-13T15:16:06.045422+0000","last_clean":"2024-09-13T15:16:06.045422+0000","last_became_active":"2024-09-13T15:01:44.815381+0000","last_became_peered":"2024-09-13T15:01:44.815381+0000","last_unstale":"2024-09-13T15:16:06.045422+0000","last_undegraded":"2024-09-13T15:16:06.045422+0000","last_fullsized":"2024-09-13T15:16:06.045422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:12:17.680247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2313466934,"num_objects":737,"num_object_clones":0,"num_object_copies":2948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":737,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2170412,"num_write_kb":31079058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4517756928,"data_stored":4517756928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148582,"ondisk_log_size":148582,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":405,"ondisk_log_size":405,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":108901497,"num_objects":133,"num_object_clones":0,"num_object_copies":266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":133,"num_whiteouts":0,"num_read":501,"num_read_kb":110953,"num_write":3237,"num_write_kb":107180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":74,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":218046464,"data_stored":217802994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3145,"ondisk_log_size":3145,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542323,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1420784,"kb_used_data":507496,"kb_used_omap":1,"kb_used_meta":913278,"kb_avail":92951056,"statfs":{"total":96636764160,"available":95181881344,"internally_reserved":0,"allocated":519675904,"data_stored":519438144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":935197131},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,0,0,1,1],"upper_bound":64},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":4.9580000000000002,"5min":7.657,"15min":4.8689999999999998},"min":{"1min":0.497,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":108.818,"5min":254.13499999999999,"15min":254.13499999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":5.016,"5min":7.7190000000000003,"15min":4.883},"min":{"1min":0.46100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":108.85299999999999,"5min":254.119,"15min":254.119},"last":0.745}]},{"osd":1,"last update":"Fri Sep 13 15:16:00 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":14.494999999999999,"15min":8.6910000000000007},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.29999999999999999},"max":{"1min":4.3449999999999998,"5min":281.399,"15min":281.399},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.1379999999999999,"5min":12.275,"15min":9.9440000000000008},"min":{"1min":0.41099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.3120000000000003,"5min":265.74299999999999,"15min":557.92399999999998},"last":0.70499999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":5.1769999999999996,"5min":9.6869999999999994,"15min":5.5309999999999997},"min":{"1min":0.47099999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":119.023,"5min":280.29700000000003,"15min":280.29700000000003},"last":1.9239999999999999},{"interface":"front","average":{"1min":5.2130000000000001,"5min":9.0009999999999994,"15min":5.2590000000000003},"min":{"1min":0.48299999999999998,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":115.961,"5min":274.03500000000003,"15min":274.03500000000003},"last":0.64200000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:16:03 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":10.202999999999999,"15min":6.407},"min":{"1min":0.377,"5min":0.377,"15min":0.32300000000000001},"max":{"1min":5.0300000000000002,"5min":261.36000000000001,"15min":261.36000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.94399999999999995,"5min":7.5250000000000004,"15min":5.0149999999999997},"min":{"1min":0.502,"5min":0.37,"15min":0.29599999999999999},"max":{"1min":5.2889999999999997,"5min":252.90000000000001,"15min":252.90000000000001},"last":0.98399999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":2.141,"15min":1.3029999999999999},"min":{"1min":0.60199999999999998,"5min":0.248,"15min":0.23699999999999999},"max":{"1min":2.0089999999999999,"5min":20.928999999999998,"15min":20.928999999999998},"last":6.9660000000000002},{"interface":"front","average":{"1min":1.2250000000000001,"5min":2.2869999999999999,"15min":1.379},"min":{"1min":0.61199999999999999,"5min":0.254,"15min":0.24199999999999999},"max":{"1min":6.4589999999999996,"5min":20.893000000000001,"15min":20.893000000000001},"last":3.8159999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.123,"15min":1.093},"min":{"1min":0.30299999999999999,"5min":0.248,"15min":0.248},"max":{"1min":1.2869999999999999,"5min":11.800000000000001,"15min":11.800000000000001},"last":7.6509999999999998},{"interface":"front","average":{"1min":1.02,"5min":1.0649999999999999,"15min":1.014},"min":{"1min":0.34100000000000003,"5min":0.252,"15min":0.252},"max":{"1min":2.625,"5min":8.593,"15min":8.593},"last":7.415}]},{"osd":6,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.988,"15min":1.377},"min":{"1min":0.42899999999999999,"5min":0.29699999999999999,"15min":0.27700000000000002},"max":{"1min":2.677,"5min":20.835000000000001,"15min":20.835000000000001},"last":0.443},{"interface":"front","average":{"1min":1.177,"5min":1.716,"15min":1.244},"min":{"1min":0.53900000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":4.9550000000000001,"5min":21.518000000000001,"15min":21.518000000000001},"last":3.6320000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542324,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1607644,"kb_used_data":445076,"kb_used_omap":1,"kb_used_meta":1162558,"kb_avail":92764196,"statfs":{"total":96636764160,"available":94990536704,"internally_reserved":0,"allocated":455757824,"data_stored":455534945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1190459847},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,0,1,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":11.609999999999999,"15min":5.5949999999999998},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":9.6809999999999992,"5min":343.02800000000002,"15min":343.02800000000002},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.325,"5min":11.821999999999999,"15min":5.4180000000000001},"min":{"1min":0.45900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":9.5060000000000002,"5min":370.00099999999998,"15min":370.00099999999998},"last":0.49299999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":11.769,"15min":6.1059999999999999},"min":{"1min":0.46600000000000003,"5min":0.317,"15min":0.26900000000000002},"max":{"1min":9.6489999999999991,"5min":236.12100000000001,"15min":236.12100000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":1.4990000000000001,"5min":13.35,"15min":7.2480000000000002},"min":{"1min":0.52300000000000002,"5min":0.35099999999999998,"15min":0.32300000000000001},"max":{"1min":9.5340000000000007,"5min":274.46800000000002,"15min":274.46800000000002},"last":1.1519999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":5.9189999999999996,"15min":3.6299999999999999},"min":{"1min":0.38600000000000001,"5min":0.33800000000000002,"15min":0.311},"max":{"1min":9.7539999999999996,"5min":249.75700000000001,"15min":249.75700000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.2470000000000001,"5min":7.0469999999999997,"15min":4.0259999999999998},"min":{"1min":0.47799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":9.5649999999999995,"5min":283.36700000000002,"15min":283.36700000000002},"last":0.74199999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":7.6120000000000001,"15min":4.4770000000000003},"min":{"1min":0.54200000000000004,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":9.5920000000000005,"5min":239.05099999999999,"15min":239.05099999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":13.24,"15min":6.3559999999999999},"min":{"1min":0.58799999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":9.6180000000000003,"5min":352.03800000000001,"15min":352.03800000000001},"last":1.04}]},{"osd":4,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":3.827,"15min":2.1779999999999999},"min":{"1min":0.46000000000000002,"5min":0.25700000000000001,"15min":0.23300000000000001},"max":{"1min":1.0820000000000001,"5min":37.261000000000003,"15min":91.054000000000002},"last":1.2430000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":3.8769999999999998,"15min":2.2330000000000001},"min":{"1min":0.42099999999999999,"5min":0.312,"15min":0.254},"max":{"1min":1.323,"5min":52.167000000000002,"15min":99.084000000000003},"last":1.4350000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.3680000000000001,"15min":1.032},"min":{"1min":0.41399999999999998,"5min":0.28699999999999998,"15min":0.253},"max":{"1min":1.2929999999999999,"5min":15.196,"15min":15.196},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.6859999999999999,"15min":1.1870000000000001},"min":{"1min":0.49199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.389,"5min":25.192,"15min":25.192},"last":1.353}]},{"osd":7,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":1.8420000000000001,"15min":1.306},"min":{"1min":0.49099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1599999999999999,"5min":37.219999999999999,"15min":37.219999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.379,"15min":1.123},"min":{"1min":0.57299999999999995,"5min":0.308,"15min":0.308},"max":{"1min":1.28,"5min":14.654,"15min":14.654},"last":1.3089999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542323,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1159540,"kb_used_data":327020,"kb_used_omap":1,"kb_used_meta":832510,"kb_avail":93212300,"statfs":{"total":96636764160,"available":95449395200,"internally_reserved":0,"allocated":334868480,"data_stored":334624308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":852490694},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":3.613,"15min":2.6589999999999998},"min":{"1min":0.27600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0109999999999999,"5min":70.611000000000004,"15min":94.078999999999994},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":3.3210000000000002,"15min":2.0489999999999999},"min":{"1min":0.60099999999999998,"5min":0.27800000000000002,"15min":0.27000000000000002},"max":{"1min":1.681,"5min":76.866,"15min":76.866},"last":0.91400000000000003}]},{"osd":1,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":5.2690000000000001,"15min":4.3250000000000002},"min":{"1min":0.66500000000000004,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.708,"5min":214.21199999999999,"15min":214.21199999999999},"last":1.006},{"interface":"front","average":{"1min":0.83699999999999997,"5min":4.6760000000000002,"15min":6.625},"min":{"1min":0.57999999999999996,"5min":0.317,"15min":0.317},"max":{"1min":1.6559999999999999,"5min":206.20699999999999,"15min":559.69500000000005},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":3.3490000000000002,"15min":2.3210000000000002},"min":{"1min":0.64200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.375,"5min":67.366,"15min":67.366},"last":0.872},{"interface":"front","average":{"1min":1.0209999999999999,"5min":2.8820000000000001,"15min":2.0659999999999998},"min":{"1min":0.67100000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.462,"5min":65.522000000000006,"15min":65.522000000000006},"last":0.81499999999999995}]},{"osd":3,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":5.0529999999999999,"15min":3.1219999999999999},"min":{"1min":0.59799999999999998,"5min":0.40300000000000002,"15min":0.37},"max":{"1min":1.4350000000000001,"5min":169.30600000000001,"15min":169.30600000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.091,"5min":6.7750000000000004,"15min":4.1289999999999996},"min":{"1min":0.70199999999999996,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.736,"5min":169.33799999999999,"15min":169.33799999999999},"last":1.0700000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":2.4340000000000002,"15min":1.4059999999999999},"min":{"1min":0.34899999999999998,"5min":0.26100000000000001,"15min":0.223},"max":{"1min":1.6200000000000001,"5min":36.151000000000003,"15min":36.151000000000003},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.125,"5min":2.581,"15min":1.482},"min":{"1min":0.44900000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":1.6539999999999999,"5min":36.219000000000001,"15min":36.219000000000001},"last":0.97299999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.7310000000000001,"15min":1.2170000000000001},"min":{"1min":0.39900000000000002,"5min":0.27300000000000002,"15min":0.25600000000000001},"max":{"1min":1.8500000000000001,"5min":25.734000000000002,"15min":25.734000000000002},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.236,"5min":1.5489999999999999,"15min":1.169},"min":{"1min":0.54600000000000004,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.6140000000000001,"5min":29.106999999999999,"15min":29.106999999999999},"last":0.83999999999999997}]},{"osd":7,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.014,"15min":0.98199999999999998},"min":{"1min":0.497,"5min":0.314,"15min":0.314},"max":{"1min":1.6359999999999999,"5min":10.798,"15min":10.798},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.1559999999999999,"15min":1.0589999999999999},"min":{"1min":0.51900000000000002,"5min":0.314,"15min":0.29699999999999999},"max":{"1min":1.718,"5min":12.874000000000001,"15min":12.874000000000001},"last":1.044}]}]},{"osd":4,"up_from":14,"seq":60129542322,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1763504,"kb_used_data":699624,"kb_used_omap":1,"kb_used_meta":1063870,"kb_avail":92608336,"statfs":{"total":96636764160,"available":94830936064,"internally_reserved":0,"allocated":716414976,"data_stored":716192286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1089403334},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,4,2,1,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":2.6800000000000002,"15min":1.6659999999999999},"min":{"1min":0.47099999999999997,"5min":0.28299999999999997,"15min":0.27100000000000002},"max":{"1min":1,"5min":18.741,"15min":18.741},"last":2.8559999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":3.1909999999999998,"15min":1.964},"min":{"1min":0.316,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":4.2850000000000001,"5min":27.876999999999999,"15min":27.876999999999999},"last":3.452}]},{"osd":1,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":15.648999999999999,"15min":6.7729999999999997},"min":{"1min":0.47299999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0089999999999999,"5min":1296.6300000000001,"15min":1296.6300000000001},"last":2.911},{"interface":"front","average":{"1min":0.75,"5min":3.3599999999999999,"15min":2.6190000000000002},"min":{"1min":0.45400000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.109,"5min":25.800999999999998,"15min":47.923999999999999},"last":3.476}]},{"osd":2,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":2.8319999999999999,"15min":1.8480000000000001},"min":{"1min":0.55300000000000005,"5min":0.309,"15min":0.29999999999999999},"max":{"1min":4.8799999999999999,"5min":23.760999999999999,"15min":23.760999999999999},"last":2.6389999999999998},{"interface":"front","average":{"1min":0.94299999999999995,"5min":2.746,"15min":1.899},"min":{"1min":0.40000000000000002,"5min":0.34000000000000002,"15min":0.32500000000000001},"max":{"1min":3.2839999999999998,"5min":23.709,"15min":30.510000000000002},"last":2.6629999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":4.9370000000000003,"15min":2.9359999999999999},"min":{"1min":0.48099999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.6360000000000001,"5min":94.281000000000006,"15min":94.281000000000006},"last":3.3719999999999999},{"interface":"front","average":{"1min":1.232,"5min":4.9859999999999998,"15min":3.2210000000000001},"min":{"1min":0.72699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.6699999999999999,"5min":94.319999999999993,"15min":94.319999999999993},"last":3.4279999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.5249999999999999,"15min":1.1599999999999999},"min":{"1min":0.86699999999999999,"5min":0.245,"15min":0.245},"max":{"1min":2.9249999999999998,"5min":18.623999999999999,"15min":18.623999999999999},"last":3.3420000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.4630000000000001,"15min":1.1319999999999999},"min":{"1min":0.72099999999999997,"5min":0.246,"15min":0.246},"max":{"1min":4.2469999999999999,"5min":16.155999999999999,"15min":16.155999999999999},"last":0.26600000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":2.2090000000000001,"15min":1.462},"min":{"1min":0.42999999999999999,"5min":0.27000000000000002,"15min":0.24099999999999999},"max":{"1min":1.226,"5min":27.984000000000002,"15min":27.984000000000002},"last":4.9619999999999997},{"interface":"front","average":{"1min":1.052,"5min":2.1019999999999999,"15min":1.367},"min":{"1min":0.33700000000000002,"5min":0.247,"15min":0.23799999999999999},"max":{"1min":3.21,"5min":28.077000000000002,"15min":28.077000000000002},"last":2.5960000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.9830000000000001,"15min":1.375},"min":{"1min":0.38300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.948,"5min":25.266999999999999,"15min":25.266999999999999},"last":3.3039999999999998},{"interface":"front","average":{"1min":1.1519999999999999,"5min":2.0800000000000001,"15min":1.4770000000000001},"min":{"1min":0.41399999999999998,"5min":0.34300000000000003,"15min":0.32600000000000001},"max":{"1min":2.0289999999999999,"5min":25.309999999999999,"15min":25.309999999999999},"last":3.395}]}]},{"osd":3,"up_from":14,"seq":60129542316,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2252604,"kb_used_data":734196,"kb_used_omap":1,"kb_used_meta":1518398,"kb_avail":92119236,"statfs":{"total":96636764160,"available":94330097664,"internally_reserved":0,"allocated":751816704,"data_stored":751586335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1554840008},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,2,1,3],"upper_bound":64},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":8.9239999999999995,"15min":6.4690000000000003},"min":{"1min":0.29199999999999998,"5min":0.28000000000000003,"15min":0.253},"max":{"1min":2.6190000000000002,"5min":108.956,"15min":170.35599999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":5.8860000000000001,"15min":4.5140000000000002},"min":{"1min":0.309,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.6659999999999999,"5min":63.624000000000002,"15min":168.80699999999999},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":8.8640000000000008,"15min":4.6429999999999998},"min":{"1min":0.378,"5min":0.32500000000000001,"15min":0.28499999999999998},"max":{"1min":2.3460000000000001,"5min":92.722999999999999,"15min":92.722999999999999},"last":8.5640000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":10.815,"15min":6.258},"min":{"1min":0.31,"5min":0.29899999999999999,"15min":0.26600000000000001},"max":{"1min":1.756,"5min":89.245000000000005,"15min":104.51300000000001},"last":9.1180000000000003}]},{"osd":2,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":6.1130000000000004,"15min":3.8919999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.149,"5min":74.825000000000003,"15min":74.825000000000003},"last":9.1560000000000006},{"interface":"front","average":{"1min":0.79300000000000004,"5min":6.3570000000000002,"15min":3.8730000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.36499999999999999},"max":{"1min":2.2029999999999998,"5min":74.870999999999995,"15min":74.870999999999995},"last":9.1859999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":5.7009999999999996,"15min":3.056},"min":{"1min":0.46400000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.3849999999999998,"5min":85.710999999999999,"15min":85.710999999999999},"last":1.032},{"interface":"front","average":{"1min":0.99299999999999999,"5min":7.335,"15min":3.948},"min":{"1min":0.499,"5min":0.443,"15min":0.377},"max":{"1min":2.177,"5min":105.875,"15min":105.875},"last":2.258}]},{"osd":5,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":5.8570000000000002,"15min":3.379},"min":{"1min":0.61799999999999999,"5min":0.46700000000000003,"15min":0.40400000000000003},"max":{"1min":4.7380000000000004,"5min":95.748999999999995,"15min":95.748999999999995},"last":2.597},{"interface":"front","average":{"1min":1.2829999999999999,"5min":7.4969999999999999,"15min":4.3460000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":8.7870000000000008,"5min":100.325,"15min":100.325},"last":8.9190000000000005}]},{"osd":6,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":4.7149999999999999,"15min":2.7639999999999998},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":4.7050000000000001,"5min":85.492999999999995,"15min":85.492999999999995},"last":1.853},{"interface":"front","average":{"1min":1.3160000000000001,"5min":5.9450000000000003,"15min":3.2440000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.501},"max":{"1min":4.75,"5min":100.376,"15min":100.376},"last":1.887}]},{"osd":7,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":5.4859999999999998,"15min":3.085},"min":{"1min":0.57499999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.7509999999999999,"5min":97.268000000000001,"15min":97.268000000000001},"last":1.6319999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":5.8440000000000003,"15min":3.5470000000000002},"min":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.48599999999999999},"max":{"1min":1.9870000000000001,"5min":100.583,"15min":100.583},"last":1.5760000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542322,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1339908,"kb_used_data":527484,"kb_used_omap":1,"kb_used_meta":808318,"kb_avail":93031932,"statfs":{"total":96636764160,"available":95264698368,"internally_reserved":0,"allocated":540143616,"data_stored":539909438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":827718086},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":7.1529999999999996,"15min":3.738},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.249},"max":{"1min":0.68899999999999995,"5min":170.77199999999999,"15min":170.77199999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":11.09,"15min":5.3769999999999998},"min":{"1min":0.316,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78100000000000003,"5min":237.53800000000001,"15min":237.53800000000001},"last":0.57299999999999995}]},{"osd":1,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":5.7750000000000004,"15min":3.7890000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28899999999999998},"max":{"1min":0.67400000000000004,"5min":109.104,"15min":109.104},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.502,"5min":12.032,"15min":5.8540000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.30499999999999999},"max":{"1min":0.72499999999999998,"5min":295.73500000000001,"15min":295.73500000000001},"last":0.63600000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":5.1139999999999999,"15min":3.7080000000000002},"min":{"1min":0.35999999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73299999999999998,"5min":109.152,"15min":109.152},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.46800000000000003,"5min":7.391,"15min":4.8259999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66600000000000004,"5min":264.87599999999998,"15min":264.87599999999998},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":6.5869999999999997,"15min":3.8879999999999999},"min":{"1min":0.56699999999999995,"5min":0.41599999999999998,"15min":0.38100000000000001},"max":{"1min":0.97499999999999998,"5min":251.97300000000001,"15min":251.97300000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":4.2599999999999998,"15min":2.5590000000000002},"min":{"1min":0.59199999999999997,"5min":0.42099999999999999,"15min":0.34899999999999998},"max":{"1min":1.081,"5min":42.012,"15min":42.012},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":3.3980000000000001,"15min":2.508},"min":{"1min":0.67100000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.163,"5min":41.942999999999998,"15min":41.942999999999998},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.878,"5min":6.3769999999999998,"15min":3.4990000000000001},"min":{"1min":0.71999999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.135,"5min":237.58799999999999,"15min":237.58799999999999},"last":0.95099999999999996}]},{"osd":6,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":3.419,"15min":2.4430000000000001},"min":{"1min":0.64300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.127,"5min":41.981999999999999,"15min":41.981999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.85699999999999998,"5min":3.6709999999999998,"15min":2.556},"min":{"1min":0.66100000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.177,"5min":41.890999999999998,"15min":41.890999999999998},"last":0.83999999999999997}]},{"osd":7,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":5.8559999999999999,"15min":3.403},"min":{"1min":0.627,"5min":0.44,"15min":0.44},"max":{"1min":0.98899999999999999,"5min":237.626,"15min":237.626},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.755,"5min":6.157,"15min":3.2559999999999998},"min":{"1min":0.52900000000000003,"5min":0.432,"15min":0.39200000000000002},"max":{"1min":1.0640000000000001,"5min":252.005,"15min":252.005},"last":0.68000000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542316,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2730124,"kb_used_data":1287556,"kb_used_omap":1,"kb_used_meta":1442558,"kb_avail":91641716,"statfs":{"total":96636764160,"available":93841117184,"internally_reserved":0,"allocated":1318457344,"data_stored":1318230784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1477179846},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":5.8120000000000003,"15min":4.1059999999999999},"min":{"1min":0.27400000000000002,"5min":0.23799999999999999,"15min":0.22500000000000001},"max":{"1min":4.843,"5min":104.246,"15min":104.246},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":6.8700000000000001,"15min":4.0330000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":2.093,"5min":103.157,"15min":103.157},"last":0.46300000000000002}]},{"osd":2,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":7.484,"15min":5.1639999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":19.100000000000001,"5min":113.79600000000001,"15min":191.00899999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.667,"5min":5.1849999999999996,"15min":3.4020000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.318},"max":{"1min":19.143999999999998,"5min":30.704999999999998,"15min":47.537999999999997},"last":0.58999999999999997}]},{"osd":3,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":6.9560000000000004,"15min":4.0339999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":19.419,"5min":52.975000000000001,"15min":52.975000000000001},"last":0.495},{"interface":"front","average":{"1min":1.778,"5min":7.4269999999999996,"15min":3.992},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":19.202999999999999,"5min":104.319,"15min":104.319},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":5.032,"15min":3.9329999999999998},"min":{"1min":0.47099999999999997,"5min":0.45400000000000001,"15min":0.38700000000000001},"max":{"1min":1.738,"5min":41.862000000000002,"15min":125.44799999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.8069999999999999,"5min":6.9349999999999996,"15min":4.2110000000000003},"min":{"1min":0.52100000000000002,"5min":0.47399999999999998,"15min":0.38800000000000001},"max":{"1min":19.291,"5min":102.962,"15min":117.842},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":4.9829999999999997,"15min":3.944},"min":{"1min":0.59399999999999997,"5min":0.436,"15min":0.40000000000000002},"max":{"1min":1.8029999999999999,"5min":104.19,"15min":154.875},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.93300000000000005,"5min":5.2560000000000002,"15min":4.0609999999999999},"min":{"1min":0.46200000000000002,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":3.5470000000000002,"5min":45.369999999999997,"15min":126.485},"last":0.92900000000000005}]},{"osd":6,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":5.633,"15min":3.609},"min":{"1min":0.54100000000000004,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.825,"5min":103.191,"15min":103.191},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.85399999999999998,"5min":5.0759999999999996,"15min":3.1739999999999999},"min":{"1min":0.60999999999999999,"5min":0.55000000000000004,"15min":0.42399999999999999},"max":{"1min":1.774,"5min":104.28400000000001,"15min":104.28400000000001},"last":0.84599999999999997}]},{"osd":7,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":4.9619999999999997,"15min":3.5329999999999999},"min":{"1min":0.54400000000000004,"5min":0.53700000000000003,"15min":0.438},"max":{"1min":3.5939999999999999,"5min":45.472999999999999,"15min":77.366},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":5.548,"15min":3.8479999999999999},"min":{"1min":0.60499999999999998,"5min":0.443,"15min":0.443},"max":{"1min":1.857,"5min":112.69499999999999,"15min":112.69499999999999},"last":0.86799999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542321,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1585972,"kb_used_data":638956,"kb_used_omap":1,"kb_used_meta":944958,"kb_avail":92785868,"statfs":{"total":96636764160,"available":95012728832,"internally_reserved":0,"allocated":654290944,"data_stored":654059682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":967637446},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,4,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":4.5049999999999999,"15min":4.3040000000000003},"min":{"1min":0.25,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.71799999999999997,"5min":43.508000000000003,"15min":279.90600000000001},"last":3.331},{"interface":"front","average":{"1min":0.51700000000000002,"5min":5.3109999999999999,"15min":6.2300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.28100000000000003},"max":{"1min":1.595,"5min":58.280000000000001,"15min":510.15699999999998},"last":3.3759999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":6.4219999999999997,"15min":3.3039999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26000000000000001},"max":{"1min":0.92200000000000004,"5min":101.73399999999999,"15min":101.73399999999999},"last":2.8420000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":4.4029999999999996,"15min":2.738},"min":{"1min":0.40999999999999998,"5min":0.39400000000000002,"15min":0.34200000000000003},"max":{"1min":1.55,"5min":35.527999999999999,"15min":35.527999999999999},"last":3.2440000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":7.8099999999999996,"15min":4.6559999999999997},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.28699999999999998},"max":{"1min":3.4630000000000001,"5min":101.76300000000001,"15min":101.76300000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":6.3259999999999996,"15min":4.3860000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.7090000000000001,"5min":75.828000000000003,"15min":75.828000000000003},"last":0.437}]},{"osd":4,"last update":"Fri Sep 13 15:16:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":4.556,"15min":2.7400000000000002},"min":{"1min":0.51900000000000002,"5min":0.495,"15min":0.34200000000000003},"max":{"1min":5.1379999999999999,"5min":30.207999999999998,"15min":30.207999999999998},"last":3.23},{"interface":"front","average":{"1min":1.3600000000000001,"5min":4.0010000000000003,"15min":2.5550000000000002},"min":{"1min":0.55500000000000005,"5min":0.46999999999999997,"15min":0.38500000000000001},"max":{"1min":6.859,"5min":30.135000000000002,"15min":30.135000000000002},"last":3.2749999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:16:16 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":5.3230000000000004,"15min":2.8719999999999999},"min":{"1min":0.626,"5min":0.46600000000000003,"15min":0.377},"max":{"1min":6.5609999999999999,"5min":101.702,"15min":101.702},"last":3.2989999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":3.593,"15min":2.3140000000000001},"min":{"1min":0.59599999999999997,"5min":0.434,"15min":0.379},"max":{"1min":7.1820000000000004,"5min":43.249000000000002,"15min":43.249000000000002},"last":3.149}]},{"osd":6,"last update":"Fri Sep 13 15:16:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":4.4279999999999999,"15min":2.649},"min":{"1min":0.58599999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.0170000000000003,"5min":45.140000000000001,"15min":45.140000000000001},"last":3.3519999999999999},{"interface":"front","average":{"1min":0.92200000000000004,"5min":4.4870000000000001,"15min":2.742},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.50600000000000001},"max":{"1min":1.484,"5min":44.737000000000002,"15min":44.737000000000002},"last":3.198}]},{"osd":7,"last update":"Fri Sep 13 15:16:08 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":5.5979999999999999,"15min":3.0030000000000001},"min":{"1min":0.61799999999999999,"5min":0.44700000000000001,"15min":0.42499999999999999},"max":{"1min":4.8049999999999997,"5min":101.655,"15min":101.655},"last":3.395},{"interface":"front","average":{"1min":1.2649999999999999,"5min":4.1820000000000004,"15min":2.6309999999999998},"min":{"1min":0.68100000000000005,"5min":0.51500000000000001,"15min":0.434},"max":{"1min":6.8120000000000003,"5min":46.649000000000001,"15min":46.649000000000001},"last":6.6559999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25194496,"data_stored":25166698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25194496,"data_stored":25167848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4300800,"data_stored":4266534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25038848,"data_stored":25008391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41967616,"data_stored":41944838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21020672,"data_stored":20976412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29155328,"data_stored":29132361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":46174208,"data_stored":46139912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":483438592,"data_stored":483438592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1278222336,"data_stored":1278222336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":420139008,"data_stored":420139008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":634142720,"data_stored":634142720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":573423616,"data_stored":573423616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":292515840,"data_stored":292515840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":426242048,"data_stored":426242048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":409632768,"data_stored":409632768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:16:22.901 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.901 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.901 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.901 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.902 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.902 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.902 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.902 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.902 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.902 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.902 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.902 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.902 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.903 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.903 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.903 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.903 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.903 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.903 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.903 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.903 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.904 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.904 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.904 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.904 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.904 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.904 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.904 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.904 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.904 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.905 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.905 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.905 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.905 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.905 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.905 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.905 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.905 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.906 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.906 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.906 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.906 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.906 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.906 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.906 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.906 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.906 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.907 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T15:01:39.264455+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=39, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.907 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.907 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.907 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.907 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.907 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.907 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.907 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.907 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.908 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.908 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.908 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.908 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.908 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.908 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.908 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.908 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.908 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.909 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.909 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.909 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.909 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.909 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.909 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.909 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.909 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.909 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.910 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.910 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.910 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.910 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.910 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.910 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.910 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.910 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.911 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.911 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.911 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.911 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.911 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.911 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.911 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.911 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.911 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.912 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.912 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.912 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.912 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.912 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.912 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.912 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.912 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.912 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.913 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.913 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.913 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.913 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.913 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.913 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.913 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.913 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.913 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.914 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.914 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.914 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.914 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.914 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.914 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.914 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.914 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.914 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.915 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.915 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.915 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.915 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.915 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.915 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.915 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.915 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.916 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.916 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.916 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:22.916 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T15:16:42.917 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:16:43.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.060+0000 7f054be00640 1 Processor -- start 2024-09-13T15:16:43.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.060+0000 7f054be00640 1 -- start start 2024-09-13T15:16:43.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.060+0000 7f054be00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05440b0bf0 0x7f0544150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:43.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.060+0000 7f054be00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f054406ddb0 0x7f0544151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:43.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.060+0000 7f054be00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05440c5530 con 0x7f0544071a70 2024-09-13T15:16:43.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.060+0000 7f054be00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0544151750 con 0x7f054406ddb0 2024-09-13T15:16:43.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.060+0000 7f054be00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05441583b0 con 0x7f05440b0bf0 2024-09-13T15:16:43.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.060+0000 7f0549e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f054406ddb0 0x7f0544151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:43.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.060+0000 7f0549e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f054406ddb0 0x7f0544151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57350/0 (socket says 172.21.15.7:57350) 2024-09-13T15:16:43.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.060+0000 7f0549e00640 1 -- 172.21.15.7:0/717212155 learned_addr learned my addr 172.21.15.7:0/717212155 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:43.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.060+0000 7f0548a00640 1 --2- 172.21.15.7:0/717212155 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05440b0bf0 0x7f0544150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:43.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.060+0000 7f0549e00640 1 -- 172.21.15.7:0/717212155 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05440b0bf0 msgr2=0x7f0544150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:16:43.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.060+0000 7f0549e00640 1 --2- 172.21.15.7:0/717212155 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05440b0bf0 0x7f0544150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:43.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.060+0000 7f0549e00640 1 -- 172.21.15.7:0/717212155 >> v1:172.21.15.77:6789/0 conn(0x7f0544071a70 legacy=0x7f05441576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:43.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.060+0000 7f0549e00640 1 -- 172.21.15.7:0/717212155 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0544156f40 con 0x7f054406ddb0 2024-09-13T15:16:43.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.060+0000 7f0548a00640 1 --2- 172.21.15.7:0/717212155 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05440b0bf0 0x7f0544150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:16:43.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.064+0000 7f0549e00640 1 --2- 172.21.15.7:0/717212155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f054406ddb0 0x7f0544151210 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f053c009e50 tx=0x7f053c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca9d1914f55c044 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:43.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.064+0000 7f0543e00640 1 -- 172.21.15.7:0/717212155 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c0a58d0 con 0x7f054406ddb0 2024-09-13T15:16:43.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.064+0000 7f0543e00640 1 -- 172.21.15.7:0/717212155 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c0a5a30 con 0x7f054406ddb0 2024-09-13T15:16:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.064+0000 7f0543e00640 1 -- 172.21.15.7:0/717212155 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c0a5dc0 con 0x7f054406ddb0 2024-09-13T15:16:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.064+0000 7f054be00640 1 -- 172.21.15.7:0/717212155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f054406ddb0 msgr2=0x7f0544151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.064+0000 7f054be00640 1 --2- 172.21.15.7:0/717212155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f054406ddb0 0x7f0544151210 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f053c009e50 tx=0x7f053c01ca00 comp rx=0 tx=0).stop 2024-09-13T15:16:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.064+0000 7f054be00640 1 -- 172.21.15.7:0/717212155 shutdown_connections 2024-09-13T15:16:43.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.064+0000 7f054be00640 1 --2- 172.21.15.7:0/717212155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f054406ddb0 0x7f0544151210 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.064+0000 7f054be00640 1 --2- 172.21.15.7:0/717212155 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05440b0bf0 0x7f0544150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.064+0000 7f054be00640 1 -- 172.21.15.7:0/717212155 >> 172.21.15.7:0/717212155 conn(0x7f0544065d40 msgr2=0x7f0544066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.064+0000 7f054be00640 1 -- 172.21.15.7:0/717212155 shutdown_connections 2024-09-13T15:16:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.064+0000 7f054be00640 1 -- 172.21.15.7:0/717212155 wait complete. 2024-09-13T15:16:43.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.064+0000 7f054be00640 1 Processor -- start 2024-09-13T15:16:43.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f054be00640 1 -- start start 2024-09-13T15:16:43.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f054be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f054406ddb0 0x7f054414ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:43.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f054be00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0544071a70 0x7f05440708b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:43.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f054be00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05440b0bf0 0x7f05441f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:43.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f054be00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05440c2e40 con 0x7f054406ddb0 2024-09-13T15:16:43.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f054be00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0544150740 con 0x7f0544071a70 2024-09-13T15:16:43.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f054be00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0544150520 con 0x7f05440b0bf0 2024-09-13T15:16:43.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f0549400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f054406ddb0 0x7f054414ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:43.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f0549400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f054406ddb0 0x7f054414ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57366/0 (socket says 172.21.15.7:57366) 2024-09-13T15:16:43.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f0549400640 1 -- 172.21.15.7:0/1370309160 learned_addr learned my addr 172.21.15.7:0/1370309160 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:16:43.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f0548a00640 1 --2- 172.21.15.7:0/1370309160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0544071a70 0x7f05440708b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:43.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f0549e00640 1 --2- 172.21.15.7:0/1370309160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05440b0bf0 0x7f05441f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:43.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f0549400640 1 -- 172.21.15.7:0/1370309160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05440b0bf0 msgr2=0x7f05441f5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:43.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f0549400640 1 --2- 172.21.15.7:0/1370309160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05440b0bf0 0x7f05441f5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:43.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f0549400640 1 -- 172.21.15.7:0/1370309160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0544071a70 msgr2=0x7f05440708b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:43.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f0549400640 1 --2- 172.21.15.7:0/1370309160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0544071a70 0x7f05440708b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:43.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f0549400640 1 -- 172.21.15.7:0/1370309160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c009b30 con 0x7f054406ddb0 2024-09-13T15:16:43.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f0548a00640 1 --2- 172.21.15.7:0/1370309160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0544071a70 0x7f05440708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:16:43.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f0549400640 1 --2- 172.21.15.7:0/1370309160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f054406ddb0 0x7f054414ffe0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f053800c420 tx=0x7f053800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:43.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f0541600640 1 -- 172.21.15.7:0/1370309160 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05380052d0 con 0x7f054406ddb0 2024-09-13T15:16:43.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f0541600640 1 -- 172.21.15.7:0/1370309160 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0538005430 con 0x7f054406ddb0 2024-09-13T15:16:43.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f0541600640 1 -- 172.21.15.7:0/1370309160 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538003840 con 0x7f054406ddb0 2024-09-13T15:16:43.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f054be00640 1 -- 172.21.15.7:0/1370309160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05440c22c0 con 0x7f054406ddb0 2024-09-13T15:16:43.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f054be00640 1 -- 172.21.15.7:0/1370309160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05440c2880 con 0x7f054406ddb0 2024-09-13T15:16:43.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.068+0000 7f054be00640 1 -- 172.21.15.7:0/1370309160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0544067650 con 0x7f054406ddb0 2024-09-13T15:16:43.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.072+0000 7f0541600640 1 -- 172.21.15.7:0/1370309160 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f05380039a0 con 0x7f054406ddb0 2024-09-13T15:16:43.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.072+0000 7f0541600640 1 --2- 172.21.15.7:0/1370309160 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0524066690 0x7f0524068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:16:43.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.072+0000 7f0541600640 1 -- 172.21.15.7:0/1370309160 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f0538083cc0 con 0x7f054406ddb0 2024-09-13T15:16:43.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.072+0000 7f0548a00640 1 --2- 172.21.15.7:0/1370309160 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0524066690 0x7f0524068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:16:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.072+0000 7f0548a00640 1 --2- 172.21.15.7:0/1370309160 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0524066690 0x7f0524068b50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f054413cf10 tx=0x7f0530008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:16:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.076+0000 7f0541600640 1 -- 172.21.15.7:0/1370309160 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f053808a080 con 0x7f054406ddb0 2024-09-13T15:16:43.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.236+0000 7f054be00640 1 -- 172.21.15.7:0/1370309160 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0544157a10 con 0x7f0524066690 2024-09-13T15:16:43.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.264+0000 7f0541600640 1 -- 172.21.15.7:0/1370309160 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368627 (secure 0 0 0) 0x7f0544157a10 con 0x7f0524066690 2024-09-13T15:16:43.270 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:16:43.273 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T15:16:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.268+0000 7f054be00640 1 -- 172.21.15.7:0/1370309160 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0524066690 msgr2=0x7f0524068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.268+0000 7f054be00640 1 --2- 172.21.15.7:0/1370309160 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0524066690 0x7f0524068b50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f054413cf10 tx=0x7f0530008040 comp rx=0 tx=0).stop 2024-09-13T15:16:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.268+0000 7f054be00640 1 -- 172.21.15.7:0/1370309160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f054406ddb0 msgr2=0x7f054414ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:16:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.268+0000 7f054be00640 1 --2- 172.21.15.7:0/1370309160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f054406ddb0 0x7f054414ffe0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f053800c420 tx=0x7f053800c8e0 comp rx=0 tx=0).stop 2024-09-13T15:16:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.268+0000 7f054be00640 1 -- 172.21.15.7:0/1370309160 shutdown_connections 2024-09-13T15:16:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.268+0000 7f054be00640 1 --2- 172.21.15.7:0/1370309160 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f0524066690 0x7f0524068b50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:43.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.268+0000 7f054be00640 1 --2- 172.21.15.7:0/1370309160 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f05440b0bf0 0x7f05441f5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:43.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.268+0000 7f054be00640 1 --2- 172.21.15.7:0/1370309160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0544071a70 0x7f05440708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:43.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.268+0000 7f054be00640 1 --2- 172.21.15.7:0/1370309160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f054406ddb0 0x7f054414ffe0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:16:43.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.268+0000 7f054be00640 1 -- 172.21.15.7:0/1370309160 >> 172.21.15.7:0/1370309160 conn(0x7f0544065d40 msgr2=0x7f05440c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:16:43.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.268+0000 7f054be00640 1 -- 172.21.15.7:0/1370309160 shutdown_connections 2024-09-13T15:16:43.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:16:43.268+0000 7f054be00640 1 -- 172.21.15.7:0/1370309160 wait complete. 2024-09-13T15:16:43.291 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":478,"stamp":"2024-09-13T15:16:42.964205+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":109491865,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":617,"num_read_kb":111053,"num_write":2174555,"num_write_kb":31188655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":50628,"num_omap_keys":97,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153384,"ondisk_log_size":153384,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8980496,"kb_used_data":216912,"kb_used_omap":12,"kb_used_meta":8763507,"kb_avail":745994224,"statfs":{"total":773094113280,"available":763898085376,"internally_reserved":0,"allocated":222117888,"data_stored":220268018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":8973831736},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005224"},"pg_stats":[{"pgid":"2.1f","version":"33'47","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.748758+0000","last_change":"2024-09-13T15:16:21.447074+0000","last_active":"2024-09-13T15:16:23.748758+0000","last_peered":"2024-09-13T15:16:23.748758+0000","last_clean":"2024-09-13T15:16:23.748758+0000","last_became_active":"2024-09-13T15:01:44.418641+0000","last_became_peered":"2024-09-13T15:01:44.418641+0000","last_unstale":"2024-09-13T15:16:23.748758+0000","last_undegraded":"2024-09-13T15:16:23.748758+0000","last_fullsized":"2024-09-13T15:16:23.748758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-09-13T15:16:21.446893+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-09-13T15:16:21.446893+0000","last_clean_scrub_stamp":"2024-09-13T15:16:21.446893+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:15:25.634510+0000","scrub_duration":0.039130482000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":4120,"num_write":37,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18304,"num_omap_keys":34,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.034899+0000","last_change":"2024-09-13T15:16:22.973595+0000","last_active":"2024-09-13T15:16:24.034899+0000","last_peered":"2024-09-13T15:16:24.034899+0000","last_clean":"2024-09-13T15:16:24.034899+0000","last_became_active":"2024-09-13T15:01:44.809091+0000","last_became_peered":"2024-09-13T15:01:44.809091+0000","last_unstale":"2024-09-13T15:16:24.034899+0000","last_undegraded":"2024-09-13T15:16:24.034899+0000","last_fullsized":"2024-09-13T15:16:24.034899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T15:16:22.973417+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T15:16:22.973417+0000","last_clean_scrub_stamp":"2024-09-13T15:16:22.973417+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.248726+0000","scrub_duration":0.003905291,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'4483","reported_seq":4510,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.231339+0000","last_change":"2024-09-13T15:01:48.910757+0000","last_active":"2024-09-13T15:16:24.231339+0000","last_peered":"2024-09-13T15:16:24.231339+0000","last_clean":"2024-09-13T15:16:24.231339+0000","last_became_active":"2024-09-13T15:01:48.910262+0000","last_became_peered":"2024-09-13T15:01:48.910262+0000","last_unstale":"2024-09-13T15:16:24.231339+0000","last_undegraded":"2024-09-13T15:16:24.231339+0000","last_fullsized":"2024-09-13T15:16:24.231339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4483,"log_dups_size":0,"ondisk_log_size":4483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65375,"num_write_kb":904330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"33'25","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:32.945023+0000","last_change":"2024-09-13T15:16:32.945101+0000","last_active":"2024-09-13T15:16:32.945023+0000","last_peered":"2024-09-13T15:16:32.945023+0000","last_clean":"2024-09-13T15:16:32.945023+0000","last_became_active":"2024-09-13T15:01:44.401666+0000","last_became_peered":"2024-09-13T15:01:44.401666+0000","last_unstale":"2024-09-13T15:16:32.945023+0000","last_undegraded":"2024-09-13T15:16:32.945023+0000","last_fullsized":"2024-09-13T15:16:32.945023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2024-09-13T15:16:32.945005+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2024-09-13T15:16:32.945005+0000","last_clean_scrub_stamp":"2024-09-13T15:16:32.945005+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:38.266030+0000","scrub_duration":0.011797106999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":18,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"33'7","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.019733+0000","last_change":"2024-09-13T15:01:44.850292+0000","last_active":"2024-09-13T15:16:24.019733+0000","last_peered":"2024-09-13T15:16:24.019733+0000","last_clean":"2024-09-13T15:16:24.019733+0000","last_became_active":"2024-09-13T15:01:44.849825+0000","last_became_peered":"2024-09-13T15:01:44.849825+0000","last_unstale":"2024-09-13T15:16:24.019733+0000","last_undegraded":"2024-09-13T15:16:24.019733+0000","last_fullsized":"2024-09-13T15:16:24.019733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"33'4943","reported_seq":4981,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.322856+0000","last_change":"2024-09-13T15:16:34.323110+0000","last_active":"2024-09-13T15:16:34.322856+0000","last_peered":"2024-09-13T15:16:34.322856+0000","last_clean":"2024-09-13T15:16:34.322856+0000","last_became_active":"2024-09-13T15:01:48.848750+0000","last_became_peered":"2024-09-13T15:01:48.848750+0000","last_unstale":"2024-09-13T15:16:34.322856+0000","last_undegraded":"2024-09-13T15:16:34.322856+0000","last_fullsized":"2024-09-13T15:16:34.322856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4943","last_scrub_stamp":"2024-09-13T15:16:34.322797+0000","last_deep_scrub":"33'4943","last_deep_scrub_stamp":"2024-09-13T15:16:34.322797+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.322797+0000","objects_scrubbed":0,"log_size":4943,"log_dups_size":0,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:02.000213+0000","scrub_duration":0.059598802999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71676,"num_write_kb":1026932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"33'64","reported_seq":111,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.971510+0000","last_change":"2024-09-13T15:01:44.437850+0000","last_active":"2024-09-13T15:16:23.971510+0000","last_peered":"2024-09-13T15:16:23.971510+0000","last_clean":"2024-09-13T15:16:23.971510+0000","last_became_active":"2024-09-13T15:01:44.437168+0000","last_became_peered":"2024-09-13T15:01:44.437168+0000","last_unstale":"2024-09-13T15:16:23.971510+0000","last_undegraded":"2024-09-13T15:16:23.971510+0000","last_fullsized":"2024-09-13T15:16:23.971510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":50,"num_read_kb":12337,"num_write":58,"num_write_kb":12312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"33'8","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:20.693314+0000","last_change":"2024-09-13T15:01:44.845989+0000","last_active":"2024-09-13T15:16:20.693314+0000","last_peered":"2024-09-13T15:16:20.693314+0000","last_clean":"2024-09-13T15:16:20.693314+0000","last_became_active":"2024-09-13T15:01:44.845395+0000","last_became_peered":"2024-09-13T15:01:44.845395+0000","last_unstale":"2024-09-13T15:16:20.693314+0000","last_undegraded":"2024-09-13T15:16:20.693314+0000","last_fullsized":"2024-09-13T15:16:20.693314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4446","reported_seq":4472,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.101509+0000","last_change":"2024-09-13T15:01:48.865388+0000","last_active":"2024-09-13T15:16:24.101509+0000","last_peered":"2024-09-13T15:16:24.101509+0000","last_clean":"2024-09-13T15:16:24.101509+0000","last_became_active":"2024-09-13T15:01:48.864314+0000","last_became_peered":"2024-09-13T15:01:48.864314+0000","last_unstale":"2024-09-13T15:16:24.101509+0000","last_undegraded":"2024-09-13T15:16:24.101509+0000","last_fullsized":"2024-09-13T15:16:24.101509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4446,"log_dups_size":0,"ondisk_log_size":4446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64553,"num_write_kb":920306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"30'15","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:15:57.127367+0000","last_change":"2024-09-13T15:01:44.424080+0000","last_active":"2024-09-13T15:15:57.127367+0000","last_peered":"2024-09-13T15:15:57.127367+0000","last_clean":"2024-09-13T15:15:57.127367+0000","last_became_active":"2024-09-13T15:01:44.423381+0000","last_became_peered":"2024-09-13T15:01:44.423381+0000","last_unstale":"2024-09-13T15:15:57.127367+0000","last_undegraded":"2024-09-13T15:15:57.127367+0000","last_fullsized":"2024-09-13T15:15:57.127367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":4116,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"33'19","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.124006+0000","last_change":"2024-09-13T15:01:44.849670+0000","last_active":"2024-09-13T15:16:24.124006+0000","last_peered":"2024-09-13T15:16:24.124006+0000","last_clean":"2024-09-13T15:16:24.124006+0000","last_became_active":"2024-09-13T15:01:44.849038+0000","last_became_peered":"2024-09-13T15:01:44.849038+0000","last_unstale":"2024-09-13T15:16:24.124006+0000","last_undegraded":"2024-09-13T15:16:24.124006+0000","last_fullsized":"2024-09-13T15:16:24.124006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4201","reported_seq":4228,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.236730+0000","last_change":"2024-09-13T15:01:48.854953+0000","last_active":"2024-09-13T15:16:24.236730+0000","last_peered":"2024-09-13T15:16:24.236730+0000","last_clean":"2024-09-13T15:16:24.236730+0000","last_became_active":"2024-09-13T15:01:48.853858+0000","last_became_peered":"2024-09-13T15:01:48.853858+0000","last_unstale":"2024-09-13T15:16:24.236730+0000","last_undegraded":"2024-09-13T15:16:24.236730+0000","last_fullsized":"2024-09-13T15:16:24.236730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4201,"log_dups_size":0,"ondisk_log_size":4201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61316,"num_write_kb":864366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"33'5","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:02.123155+0000","last_change":"2024-09-13T15:01:44.824391+0000","last_active":"2024-09-13T15:16:02.123155+0000","last_peered":"2024-09-13T15:16:02.123155+0000","last_clean":"2024-09-13T15:16:02.123155+0000","last_became_active":"2024-09-13T15:01:44.823690+0000","last_became_peered":"2024-09-13T15:01:44.823690+0000","last_unstale":"2024-09-13T15:16:02.123155+0000","last_undegraded":"2024-09-13T15:16:02.123155+0000","last_fullsized":"2024-09-13T15:16:02.123155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'140","reported_seq":174,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.092705+0000","last_change":"2024-09-13T15:01:44.421523+0000","last_active":"2024-09-13T15:16:24.092705+0000","last_peered":"2024-09-13T15:16:24.092705+0000","last_clean":"2024-09-13T15:16:24.092705+0000","last_became_active":"2024-09-13T15:01:44.419965+0000","last_became_peered":"2024-09-13T15:01:44.419965+0000","last_unstale":"2024-09-13T15:16:24.092705+0000","last_undegraded":"2024-09-13T15:16:24.092705+0000","last_fullsized":"2024-09-13T15:16:24.092705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":8200,"num_write":130,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"33'4505","reported_seq":4532,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.190249+0000","last_change":"2024-09-13T15:01:48.850895+0000","last_active":"2024-09-13T15:16:24.190249+0000","last_peered":"2024-09-13T15:16:24.190249+0000","last_clean":"2024-09-13T15:16:24.190249+0000","last_became_active":"2024-09-13T15:01:48.849856+0000","last_became_peered":"2024-09-13T15:01:48.849856+0000","last_unstale":"2024-09-13T15:16:24.190249+0000","last_undegraded":"2024-09-13T15:16:24.190249+0000","last_fullsized":"2024-09-13T15:16:24.190249+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4505,"log_dups_size":0,"ondisk_log_size":4505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65579,"num_write_kb":929153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"33'8","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:36.980712+0000","last_change":"2024-09-13T15:16:36.980882+0000","last_active":"2024-09-13T15:16:36.980712+0000","last_peered":"2024-09-13T15:16:36.980712+0000","last_clean":"2024-09-13T15:16:36.980712+0000","last_became_active":"2024-09-13T15:01:44.805767+0000","last_became_peered":"2024-09-13T15:01:44.805767+0000","last_unstale":"2024-09-13T15:16:36.980712+0000","last_undegraded":"2024-09-13T15:16:36.980712+0000","last_fullsized":"2024-09-13T15:16:36.980712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:36.980692+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:36.980692+0000","last_clean_scrub_stamp":"2024-09-13T15:16:36.980692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:34.434100+0000","scrub_duration":0.0013482559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"33'26","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.606183+0000","last_change":"2024-09-13T15:16:24.606279+0000","last_active":"2024-09-13T15:16:24.606183+0000","last_peered":"2024-09-13T15:16:24.606183+0000","last_clean":"2024-09-13T15:16:24.606183+0000","last_became_active":"2024-09-13T15:01:44.401559+0000","last_became_peered":"2024-09-13T15:01:44.401559+0000","last_unstale":"2024-09-13T15:16:24.606183+0000","last_undegraded":"2024-09-13T15:16:24.606183+0000","last_fullsized":"2024-09-13T15:16:24.606183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-09-13T15:16:24.606164+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-09-13T15:16:24.606164+0000","last_clean_scrub_stamp":"2024-09-13T15:16:24.606164+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:58.610420+0000","scrub_duration":0.010477458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"33'4744","reported_seq":4782,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:33.297530+0000","last_change":"2024-09-13T15:16:33.297858+0000","last_active":"2024-09-13T15:16:33.297530+0000","last_peered":"2024-09-13T15:16:33.297530+0000","last_clean":"2024-09-13T15:16:33.297530+0000","last_became_active":"2024-09-13T15:01:48.857802+0000","last_became_peered":"2024-09-13T15:01:48.857802+0000","last_unstale":"2024-09-13T15:16:33.297530+0000","last_undegraded":"2024-09-13T15:16:33.297530+0000","last_fullsized":"2024-09-13T15:16:33.297530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4744","last_scrub_stamp":"2024-09-13T15:16:33.297473+0000","last_deep_scrub":"33'4744","last_deep_scrub_stamp":"2024-09-13T15:16:33.297473+0000","last_clean_scrub_stamp":"2024-09-13T15:16:33.297473+0000","objects_scrubbed":0,"log_size":4744,"log_dups_size":0,"ondisk_log_size":4744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:00.056232+0000","scrub_duration":0.060614465999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69018,"num_write_kb":974815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"33'10","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.909669+0000","last_change":"2024-09-13T15:16:19.917251+0000","last_active":"2024-09-13T15:16:23.909669+0000","last_peered":"2024-09-13T15:16:23.909669+0000","last_clean":"2024-09-13T15:16:23.909669+0000","last_became_active":"2024-09-13T15:01:44.808420+0000","last_became_peered":"2024-09-13T15:01:44.808420+0000","last_unstale":"2024-09-13T15:16:23.909669+0000","last_undegraded":"2024-09-13T15:16:23.909669+0000","last_fullsized":"2024-09-13T15:16:23.909669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:19.917131+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:19.917131+0000","last_clean_scrub_stamp":"2024-09-13T15:16:19.917131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:55.912312+0000","scrub_duration":0.001471523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"33'15","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.044409+0000","last_change":"2024-09-13T15:16:22.548304+0000","last_active":"2024-09-13T15:16:24.044409+0000","last_peered":"2024-09-13T15:16:24.044409+0000","last_clean":"2024-09-13T15:16:24.044409+0000","last_became_active":"2024-09-13T15:01:44.406354+0000","last_became_peered":"2024-09-13T15:01:44.406354+0000","last_unstale":"2024-09-13T15:16:24.044409+0000","last_undegraded":"2024-09-13T15:16:24.044409+0000","last_fullsized":"2024-09-13T15:16:24.044409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T15:16:22.548208+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T15:16:22.548208+0000","last_clean_scrub_stamp":"2024-09-13T15:16:22.548208+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:10.347627+0000","scrub_duration":0.0063788459999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"33'4791","reported_seq":4818,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.950693+0000","last_change":"2024-09-13T15:01:48.909879+0000","last_active":"2024-09-13T15:16:23.950693+0000","last_peered":"2024-09-13T15:16:23.950693+0000","last_clean":"2024-09-13T15:16:23.950693+0000","last_became_active":"2024-09-13T15:01:48.909494+0000","last_became_peered":"2024-09-13T15:01:48.909494+0000","last_unstale":"2024-09-13T15:16:23.950693+0000","last_undegraded":"2024-09-13T15:16:23.950693+0000","last_fullsized":"2024-09-13T15:16:23.950693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4791,"log_dups_size":0,"ondisk_log_size":4791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69959,"num_write_kb":1001010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"33'3","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.090655+0000","last_change":"2024-09-13T15:16:26.090842+0000","last_active":"2024-09-13T15:16:26.090655+0000","last_peered":"2024-09-13T15:16:26.090655+0000","last_clean":"2024-09-13T15:16:26.090655+0000","last_became_active":"2024-09-13T15:01:44.824392+0000","last_became_peered":"2024-09-13T15:01:44.824392+0000","last_unstale":"2024-09-13T15:16:26.090655+0000","last_undegraded":"2024-09-13T15:16:26.090655+0000","last_fullsized":"2024-09-13T15:16:26.090655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T15:16:26.090602+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T15:16:26.090602+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.090602+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:41:02.638139+0000","scrub_duration":0.0027170839999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"33'17","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.973006+0000","last_change":"2024-09-13T15:01:44.421119+0000","last_active":"2024-09-13T15:16:23.973006+0000","last_peered":"2024-09-13T15:16:23.973006+0000","last_clean":"2024-09-13T15:16:23.973006+0000","last_became_active":"2024-09-13T15:01:44.419082+0000","last_became_peered":"2024-09-13T15:01:44.419082+0000","last_unstale":"2024-09-13T15:16:23.973006+0000","last_undegraded":"2024-09-13T15:16:23.973006+0000","last_fullsized":"2024-09-13T15:16:23.973006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"33'4700","reported_seq":4727,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.157465+0000","last_change":"2024-09-13T15:01:48.856387+0000","last_active":"2024-09-13T15:16:24.157465+0000","last_peered":"2024-09-13T15:16:24.157465+0000","last_clean":"2024-09-13T15:16:24.157465+0000","last_became_active":"2024-09-13T15:01:48.855433+0000","last_became_peered":"2024-09-13T15:01:48.855433+0000","last_unstale":"2024-09-13T15:16:24.157465+0000","last_undegraded":"2024-09-13T15:16:24.157465+0000","last_fullsized":"2024-09-13T15:16:24.157465+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4700,"log_dups_size":0,"ondisk_log_size":4700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68074,"num_write_kb":991498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"33'7","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.348832+0000","last_change":"2024-09-13T15:16:26.348910+0000","last_active":"2024-09-13T15:16:26.348832+0000","last_peered":"2024-09-13T15:16:26.348832+0000","last_clean":"2024-09-13T15:16:26.348832+0000","last_became_active":"2024-09-13T15:01:44.807643+0000","last_became_peered":"2024-09-13T15:01:44.807643+0000","last_unstale":"2024-09-13T15:16:26.348832+0000","last_undegraded":"2024-09-13T15:16:26.348832+0000","last_fullsized":"2024-09-13T15:16:26.348832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:26.348813+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:26.348813+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.348813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:35.883729+0000","scrub_duration":0.001321298,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"33'19","reported_seq":69,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:25.746959+0000","last_change":"2024-09-13T15:16:25.747184+0000","last_active":"2024-09-13T15:16:25.746959+0000","last_peered":"2024-09-13T15:16:25.746959+0000","last_clean":"2024-09-13T15:16:25.746959+0000","last_became_active":"2024-09-13T15:01:44.429510+0000","last_became_peered":"2024-09-13T15:01:44.429510+0000","last_unstale":"2024-09-13T15:16:25.746959+0000","last_undegraded":"2024-09-13T15:16:25.746959+0000","last_fullsized":"2024-09-13T15:16:25.746959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:25.746901+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:25.746901+0000","last_clean_scrub_stamp":"2024-09-13T15:16:25.746901+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:29.626332+0000","scrub_duration":0.0090965799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'4847","reported_seq":4886,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:37.402053+0000","last_change":"2024-09-13T15:16:37.402307+0000","last_active":"2024-09-13T15:16:37.402053+0000","last_peered":"2024-09-13T15:16:37.402053+0000","last_clean":"2024-09-13T15:16:37.402053+0000","last_became_active":"2024-09-13T15:01:48.911578+0000","last_became_peered":"2024-09-13T15:01:48.911578+0000","last_unstale":"2024-09-13T15:16:37.402053+0000","last_undegraded":"2024-09-13T15:16:37.402053+0000","last_fullsized":"2024-09-13T15:16:37.402053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4847","last_scrub_stamp":"2024-09-13T15:16:37.402012+0000","last_deep_scrub":"33'4847","last_deep_scrub_stamp":"2024-09-13T15:16:37.402012+0000","last_clean_scrub_stamp":"2024-09-13T15:16:37.402012+0000","objects_scrubbed":0,"log_size":4847,"log_dups_size":0,"ondisk_log_size":4847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:44.796269+0000","scrub_duration":0.079726367000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70505,"num_write_kb":1030585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"33'9","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:19.233785+0000","last_change":"2024-09-13T15:01:44.838344+0000","last_active":"2024-09-13T15:16:19.233785+0000","last_peered":"2024-09-13T15:16:19.233785+0000","last_clean":"2024-09-13T15:16:19.233785+0000","last_became_active":"2024-09-13T15:01:44.838128+0000","last_became_peered":"2024-09-13T15:01:44.838128+0000","last_unstale":"2024-09-13T15:16:19.233785+0000","last_undegraded":"2024-09-13T15:16:19.233785+0000","last_fullsized":"2024-09-13T15:16:19.233785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'119","reported_seq":167,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.571933+0000","last_change":"2024-09-13T15:16:26.572041+0000","last_active":"2024-09-13T15:16:26.571933+0000","last_peered":"2024-09-13T15:16:26.571933+0000","last_clean":"2024-09-13T15:16:26.571933+0000","last_became_active":"2024-09-13T15:01:44.430548+0000","last_became_peered":"2024-09-13T15:01:44.430548+0000","last_unstale":"2024-09-13T15:16:26.571933+0000","last_undegraded":"2024-09-13T15:16:26.571933+0000","last_fullsized":"2024-09-13T15:16:26.571933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-09-13T15:16:26.571900+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-09-13T15:16:26.571900+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.571900+0000","objects_scrubbed":4,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:58.749238+0000","scrub_duration":0.0068987069999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":251,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"33'4848","reported_seq":4876,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.180347+0000","last_change":"2024-09-13T15:01:48.911224+0000","last_active":"2024-09-13T15:16:24.180347+0000","last_peered":"2024-09-13T15:16:24.180347+0000","last_clean":"2024-09-13T15:16:24.180347+0000","last_became_active":"2024-09-13T15:01:48.910150+0000","last_became_peered":"2024-09-13T15:01:48.910150+0000","last_unstale":"2024-09-13T15:16:24.180347+0000","last_undegraded":"2024-09-13T15:16:24.180347+0000","last_fullsized":"2024-09-13T15:16:24.180347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4848,"log_dups_size":0,"ondisk_log_size":4848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70446,"num_write_kb":999196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"33'14","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:40.382671+0000","last_change":"2024-09-13T15:16:40.382752+0000","last_active":"2024-09-13T15:16:40.382671+0000","last_peered":"2024-09-13T15:16:40.382671+0000","last_clean":"2024-09-13T15:16:40.382671+0000","last_became_active":"2024-09-13T15:01:44.811915+0000","last_became_peered":"2024-09-13T15:01:44.811915+0000","last_unstale":"2024-09-13T15:16:40.382671+0000","last_undegraded":"2024-09-13T15:16:40.382671+0000","last_fullsized":"2024-09-13T15:16:40.382671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:40.382651+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:40.382651+0000","last_clean_scrub_stamp":"2024-09-13T15:16:40.382651+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:21.251984+0000","scrub_duration":0.001494736,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'13","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:36.714995+0000","last_change":"2024-09-13T15:16:36.715178+0000","last_active":"2024-09-13T15:16:36.714995+0000","last_peered":"2024-09-13T15:16:36.714995+0000","last_clean":"2024-09-13T15:16:36.714995+0000","last_became_active":"2024-09-13T15:01:44.422297+0000","last_became_peered":"2024-09-13T15:01:44.422297+0000","last_unstale":"2024-09-13T15:16:36.714995+0000","last_undegraded":"2024-09-13T15:16:36.714995+0000","last_fullsized":"2024-09-13T15:16:36.714995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T15:16:36.714944+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T15:16:36.714944+0000","last_clean_scrub_stamp":"2024-09-13T15:16:36.714944+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:53.830394+0000","scrub_duration":0.0057288749999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"33'4797","reported_seq":4825,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.238328+0000","last_change":"2024-09-13T15:01:48.908569+0000","last_active":"2024-09-13T15:16:24.238328+0000","last_peered":"2024-09-13T15:16:24.238328+0000","last_clean":"2024-09-13T15:16:24.238328+0000","last_became_active":"2024-09-13T15:01:48.908118+0000","last_became_peered":"2024-09-13T15:01:48.908118+0000","last_unstale":"2024-09-13T15:16:24.238328+0000","last_undegraded":"2024-09-13T15:16:24.238328+0000","last_fullsized":"2024-09-13T15:16:24.238328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4797,"log_dups_size":0,"ondisk_log_size":4797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69559,"num_write_kb":1001647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"33'5","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:37.634781+0000","last_change":"2024-09-13T15:16:37.634978+0000","last_active":"2024-09-13T15:16:37.634781+0000","last_peered":"2024-09-13T15:16:37.634781+0000","last_clean":"2024-09-13T15:16:37.634781+0000","last_became_active":"2024-09-13T15:01:44.850263+0000","last_became_peered":"2024-09-13T15:01:44.850263+0000","last_unstale":"2024-09-13T15:16:37.634781+0000","last_undegraded":"2024-09-13T15:16:37.634781+0000","last_fullsized":"2024-09-13T15:16:37.634781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T15:16:37.634730+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T15:16:37.634730+0000","last_clean_scrub_stamp":"2024-09-13T15:16:37.634730+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:49.903072+0000","scrub_duration":0.0026524399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.015510+0000","last_change":"2024-09-13T15:16:23.590960+0000","last_active":"2024-09-13T15:16:24.015510+0000","last_peered":"2024-09-13T15:16:24.015510+0000","last_clean":"2024-09-13T15:16:24.015510+0000","last_became_active":"2024-09-13T15:01:44.398881+0000","last_became_peered":"2024-09-13T15:01:44.398881+0000","last_unstale":"2024-09-13T15:16:24.015510+0000","last_undegraded":"2024-09-13T15:16:24.015510+0000","last_fullsized":"2024-09-13T15:16:24.015510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T15:16:23.590800+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T15:16:23.590800+0000","last_clean_scrub_stamp":"2024-09-13T15:16:23.590800+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:44.286646+0000","scrub_duration":0.023094673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2694,"num_omap_keys":5,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4059","reported_seq":4087,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.106375+0000","last_change":"2024-09-13T15:01:48.852798+0000","last_active":"2024-09-13T15:16:24.106375+0000","last_peered":"2024-09-13T15:16:24.106375+0000","last_clean":"2024-09-13T15:16:24.106375+0000","last_became_active":"2024-09-13T15:01:48.851948+0000","last_became_peered":"2024-09-13T15:01:48.851948+0000","last_unstale":"2024-09-13T15:16:24.106375+0000","last_undegraded":"2024-09-13T15:16:24.106375+0000","last_fullsized":"2024-09-13T15:16:24.106375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4059,"log_dups_size":0,"ondisk_log_size":4059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58925,"num_write_kb":861513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"33'7","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:28.083406+0000","last_change":"2024-09-13T15:16:28.083406+0000","last_active":"2024-09-13T15:16:28.083406+0000","last_peered":"2024-09-13T15:16:28.083406+0000","last_clean":"2024-09-13T15:16:28.083406+0000","last_became_active":"2024-09-13T15:01:44.821475+0000","last_became_peered":"2024-09-13T15:01:44.821475+0000","last_unstale":"2024-09-13T15:16:28.083406+0000","last_undegraded":"2024-09-13T15:16:28.083406+0000","last_fullsized":"2024-09-13T15:16:28.083406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:28.083138+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:28.083138+0000","last_clean_scrub_stamp":"2024-09-13T15:16:28.083138+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:39.566336+0000","scrub_duration":0.0028025329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'40","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.600169+0000","last_change":"2024-09-13T15:16:26.600795+0000","last_active":"2024-09-13T15:16:26.600169+0000","last_peered":"2024-09-13T15:16:26.600169+0000","last_clean":"2024-09-13T15:16:26.600169+0000","last_became_active":"2024-09-13T15:01:44.432902+0000","last_became_peered":"2024-09-13T15:01:44.432902+0000","last_unstale":"2024-09-13T15:16:26.600169+0000","last_undegraded":"2024-09-13T15:16:26.600169+0000","last_fullsized":"2024-09-13T15:16:26.600169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'40","last_scrub_stamp":"2024-09-13T15:16:26.600116+0000","last_deep_scrub":"33'40","last_deep_scrub_stamp":"2024-09-13T15:16:26.600116+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.600116+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:35.079765+0000","scrub_duration":0.027584299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389688,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":8206,"num_write":28,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"33'4539","reported_seq":4567,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.079503+0000","last_change":"2024-09-13T15:01:48.846695+0000","last_active":"2024-09-13T15:16:24.079503+0000","last_peered":"2024-09-13T15:16:24.079503+0000","last_clean":"2024-09-13T15:16:24.079503+0000","last_became_active":"2024-09-13T15:01:48.846301+0000","last_became_peered":"2024-09-13T15:01:48.846301+0000","last_unstale":"2024-09-13T15:16:24.079503+0000","last_undegraded":"2024-09-13T15:16:24.079503+0000","last_fullsized":"2024-09-13T15:16:24.079503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66145,"num_write_kb":975469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"33'12","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.078239+0000","last_change":"2024-09-13T15:16:17.879916+0000","last_active":"2024-09-13T15:16:24.078239+0000","last_peered":"2024-09-13T15:16:24.078239+0000","last_clean":"2024-09-13T15:16:24.078239+0000","last_became_active":"2024-09-13T15:01:44.814192+0000","last_became_peered":"2024-09-13T15:01:44.814192+0000","last_unstale":"2024-09-13T15:16:24.078239+0000","last_undegraded":"2024-09-13T15:16:24.078239+0000","last_fullsized":"2024-09-13T15:16:24.078239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:17.879753+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:17.879753+0000","last_clean_scrub_stamp":"2024-09-13T15:16:17.879753+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:36.906977+0000","scrub_duration":0.33901714599999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'35","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.123746+0000","last_change":"2024-09-13T15:16:26.123827+0000","last_active":"2024-09-13T15:16:26.123746+0000","last_peered":"2024-09-13T15:16:26.123746+0000","last_clean":"2024-09-13T15:16:26.123746+0000","last_became_active":"2024-09-13T15:01:44.398904+0000","last_became_peered":"2024-09-13T15:01:44.398904+0000","last_unstale":"2024-09-13T15:16:26.123746+0000","last_undegraded":"2024-09-13T15:16:26.123746+0000","last_fullsized":"2024-09-13T15:16:26.123746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-09-13T15:16:26.123727+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-09-13T15:16:26.123727+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.123727+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:19.696735+0000","scrub_duration":0.0038650519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70412,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":156,"num_write":30,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'5224","reported_seq":5251,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.057926+0000","last_change":"2024-09-13T15:01:48.859142+0000","last_active":"2024-09-13T15:16:24.057926+0000","last_peered":"2024-09-13T15:16:24.057926+0000","last_clean":"2024-09-13T15:16:24.057926+0000","last_became_active":"2024-09-13T15:01:48.858649+0000","last_became_peered":"2024-09-13T15:01:48.858649+0000","last_unstale":"2024-09-13T15:16:24.057926+0000","last_undegraded":"2024-09-13T15:16:24.057926+0000","last_fullsized":"2024-09-13T15:16:24.057926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76325,"num_write_kb":1087992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"33'4","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.866594+0000","last_change":"2024-09-13T15:01:44.826501+0000","last_active":"2024-09-13T15:16:23.866594+0000","last_peered":"2024-09-13T15:16:23.866594+0000","last_clean":"2024-09-13T15:16:23.866594+0000","last_became_active":"2024-09-13T15:01:44.826222+0000","last_became_peered":"2024-09-13T15:01:44.826222+0000","last_unstale":"2024-09-13T15:16:23.866594+0000","last_undegraded":"2024-09-13T15:16:23.866594+0000","last_fullsized":"2024-09-13T15:16:23.866594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'29","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.057513+0000","last_change":"2024-09-13T15:01:44.421891+0000","last_active":"2024-09-13T15:16:24.057513+0000","last_peered":"2024-09-13T15:16:24.057513+0000","last_clean":"2024-09-13T15:16:24.057513+0000","last_became_active":"2024-09-13T15:01:44.419660+0000","last_became_peered":"2024-09-13T15:01:44.419660+0000","last_unstale":"2024-09-13T15:16:24.057513+0000","last_undegraded":"2024-09-13T15:16:24.057513+0000","last_fullsized":"2024-09-13T15:16:24.057513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:43.358710+0000","last_clean_scrub_stamp":"2024-09-13T15:01:43.358710+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":20,"num_write_kb":8201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'4215","reported_seq":4252,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.205221+0000","last_change":"2024-09-13T15:02:34.119111+0000","last_active":"2024-09-13T15:16:24.205221+0000","last_peered":"2024-09-13T15:16:24.205221+0000","last_clean":"2024-09-13T15:16:24.205221+0000","last_became_active":"2024-09-13T15:02:34.118461+0000","last_became_peered":"2024-09-13T15:02:34.118461+0000","last_unstale":"2024-09-13T15:16:24.205221+0000","last_undegraded":"2024-09-13T15:16:24.205221+0000","last_fullsized":"2024-09-13T15:16:24.205221+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60783,"num_write_kb":878332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:35.977004+0000","last_change":"2024-09-13T15:16:35.977077+0000","last_active":"2024-09-13T15:16:35.977004+0000","last_peered":"2024-09-13T15:16:35.977004+0000","last_clean":"2024-09-13T15:16:35.977004+0000","last_became_active":"2024-09-13T15:01:44.850234+0000","last_became_peered":"2024-09-13T15:01:44.850234+0000","last_unstale":"2024-09-13T15:16:35.977004+0000","last_undegraded":"2024-09-13T15:16:35.977004+0000","last_fullsized":"2024-09-13T15:16:35.977004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:35.976986+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:35.976986+0000","last_clean_scrub_stamp":"2024-09-13T15:16:35.976986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:15.229979+0000","scrub_duration":0.0024425779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"33'14","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:27.599430+0000","last_change":"2024-09-13T15:16:27.599633+0000","last_active":"2024-09-13T15:16:27.599430+0000","last_peered":"2024-09-13T15:16:27.599430+0000","last_clean":"2024-09-13T15:16:27.599430+0000","last_became_active":"2024-09-13T15:01:44.410675+0000","last_became_peered":"2024-09-13T15:01:44.410675+0000","last_unstale":"2024-09-13T15:16:27.599430+0000","last_undegraded":"2024-09-13T15:16:27.599430+0000","last_fullsized":"2024-09-13T15:16:27.599430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:27.599376+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:27.599376+0000","last_clean_scrub_stamp":"2024-09-13T15:16:27.599376+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:49.535267+0000","scrub_duration":0.0074093939999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":18,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:29.740890+0000","last_change":"2024-09-13T15:16:29.741095+0000","last_active":"2024-09-13T15:16:29.740890+0000","last_peered":"2024-09-13T15:16:29.740890+0000","last_clean":"2024-09-13T15:16:29.740890+0000","last_became_active":"2024-09-13T15:01:40.832279+0000","last_became_peered":"2024-09-13T15:01:40.832279+0000","last_unstale":"2024-09-13T15:16:29.740890+0000","last_undegraded":"2024-09-13T15:16:29.740890+0000","last_fullsized":"2024-09-13T15:16:29.740890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-09-13T15:16:29.740837+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-09-13T15:16:29.740837+0000","last_clean_scrub_stamp":"2024-09-13T15:16:29.740837+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:37.631981+0000","scrub_duration":0.0066710290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"33'5137","reported_seq":5165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.175569+0000","last_change":"2024-09-13T15:01:48.919580+0000","last_active":"2024-09-13T15:16:24.175569+0000","last_peered":"2024-09-13T15:16:24.175569+0000","last_clean":"2024-09-13T15:16:24.175569+0000","last_became_active":"2024-09-13T15:01:48.918678+0000","last_became_peered":"2024-09-13T15:01:48.918678+0000","last_unstale":"2024-09-13T15:16:24.175569+0000","last_undegraded":"2024-09-13T15:16:24.175569+0000","last_fullsized":"2024-09-13T15:16:24.175569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5137,"log_dups_size":0,"ondisk_log_size":5137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74848,"num_write_kb":1044614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"33'7","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:22.684165+0000","last_change":"2024-09-13T15:16:22.684165+0000","last_active":"2024-09-13T15:16:22.684165+0000","last_peered":"2024-09-13T15:16:22.684165+0000","last_clean":"2024-09-13T15:16:22.684165+0000","last_became_active":"2024-09-13T15:01:44.849457+0000","last_became_peered":"2024-09-13T15:01:44.849457+0000","last_unstale":"2024-09-13T15:16:22.684165+0000","last_undegraded":"2024-09-13T15:16:22.684165+0000","last_fullsized":"2024-09-13T15:16:22.684165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:22.683907+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:22.683907+0000","last_clean_scrub_stamp":"2024-09-13T15:16:22.683907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:51.010493+0000","scrub_duration":0.0033186610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"33'18","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.088002+0000","last_change":"2024-09-13T15:16:19.393403+0000","last_active":"2024-09-13T15:16:24.088002+0000","last_peered":"2024-09-13T15:16:24.088002+0000","last_clean":"2024-09-13T15:16:24.088002+0000","last_became_active":"2024-09-13T15:01:44.420601+0000","last_became_peered":"2024-09-13T15:01:44.420601+0000","last_unstale":"2024-09-13T15:16:24.088002+0000","last_undegraded":"2024-09-13T15:16:24.088002+0000","last_fullsized":"2024-09-13T15:16:24.088002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T15:16:19.393308+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T15:16:19.393308+0000","last_clean_scrub_stamp":"2024-09-13T15:16:19.393308+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:04.511597+0000","scrub_duration":0.25461208400000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"33'4520","reported_seq":4547,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.014652+0000","last_change":"2024-09-13T15:01:48.911047+0000","last_active":"2024-09-13T15:16:24.014652+0000","last_peered":"2024-09-13T15:16:24.014652+0000","last_clean":"2024-09-13T15:16:24.014652+0000","last_became_active":"2024-09-13T15:01:48.910479+0000","last_became_peered":"2024-09-13T15:01:48.910479+0000","last_unstale":"2024-09-13T15:16:24.014652+0000","last_undegraded":"2024-09-13T15:16:24.014652+0000","last_fullsized":"2024-09-13T15:16:24.014652+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65908,"num_write_kb":920675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:36.610995+0000","last_change":"2024-09-13T15:16:36.611191+0000","last_active":"2024-09-13T15:16:36.610995+0000","last_peered":"2024-09-13T15:16:36.610995+0000","last_clean":"2024-09-13T15:16:36.610995+0000","last_became_active":"2024-09-13T15:01:44.837429+0000","last_became_peered":"2024-09-13T15:01:44.837429+0000","last_unstale":"2024-09-13T15:16:36.610995+0000","last_undegraded":"2024-09-13T15:16:36.610995+0000","last_fullsized":"2024-09-13T15:16:36.610995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:36.610935+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:36.610935+0000","last_clean_scrub_stamp":"2024-09-13T15:16:36.610935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:41.442948+0000","scrub_duration":0.0026950490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"33'18","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:25.592150+0000","last_change":"2024-09-13T15:16:25.592225+0000","last_active":"2024-09-13T15:16:25.592150+0000","last_peered":"2024-09-13T15:16:25.592150+0000","last_clean":"2024-09-13T15:16:25.592150+0000","last_became_active":"2024-09-13T15:01:44.406719+0000","last_became_peered":"2024-09-13T15:01:44.406719+0000","last_unstale":"2024-09-13T15:16:25.592150+0000","last_undegraded":"2024-09-13T15:16:25.592150+0000","last_fullsized":"2024-09-13T15:16:25.592150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T15:16:25.592132+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T15:16:25.592132+0000","last_clean_scrub_stamp":"2024-09-13T15:16:25.592132+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:03:43.505817+0000","scrub_duration":0.015211931,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":9,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"33'5126","reported_seq":5153,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.211112+0000","last_change":"2024-09-13T15:01:48.857931+0000","last_active":"2024-09-13T15:16:24.211112+0000","last_peered":"2024-09-13T15:16:24.211112+0000","last_clean":"2024-09-13T15:16:24.211112+0000","last_became_active":"2024-09-13T15:01:48.857542+0000","last_became_peered":"2024-09-13T15:01:48.857542+0000","last_unstale":"2024-09-13T15:16:24.211112+0000","last_undegraded":"2024-09-13T15:16:24.211112+0000","last_fullsized":"2024-09-13T15:16:24.211112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5126,"log_dups_size":0,"ondisk_log_size":5126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74246,"num_write_kb":1079868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"33'12","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.936148+0000","last_change":"2024-09-13T15:01:44.835470+0000","last_active":"2024-09-13T15:16:23.936148+0000","last_peered":"2024-09-13T15:16:23.936148+0000","last_clean":"2024-09-13T15:16:23.936148+0000","last_became_active":"2024-09-13T15:01:44.831166+0000","last_became_peered":"2024-09-13T15:01:44.831166+0000","last_unstale":"2024-09-13T15:16:23.936148+0000","last_undegraded":"2024-09-13T15:16:23.936148+0000","last_fullsized":"2024-09-13T15:16:23.936148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"33'24","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:28.070586+0000","last_change":"2024-09-13T15:16:28.070673+0000","last_active":"2024-09-13T15:16:28.070586+0000","last_peered":"2024-09-13T15:16:28.070586+0000","last_clean":"2024-09-13T15:16:28.070586+0000","last_became_active":"2024-09-13T15:01:44.401799+0000","last_became_peered":"2024-09-13T15:01:44.401799+0000","last_unstale":"2024-09-13T15:16:28.070586+0000","last_undegraded":"2024-09-13T15:16:28.070586+0000","last_fullsized":"2024-09-13T15:16:28.070586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-13T15:16:28.070566+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-13T15:16:28.070566+0000","last_clean_scrub_stamp":"2024-09-13T15:16:28.070566+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:35.758129+0000","scrub_duration":0.0088310460000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":4114,"num_write":17,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"33'4768","reported_seq":4795,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.161305+0000","last_change":"2024-09-13T15:01:48.912490+0000","last_active":"2024-09-13T15:16:24.161305+0000","last_peered":"2024-09-13T15:16:24.161305+0000","last_clean":"2024-09-13T15:16:24.161305+0000","last_became_active":"2024-09-13T15:01:48.911474+0000","last_became_peered":"2024-09-13T15:01:48.911474+0000","last_unstale":"2024-09-13T15:16:24.161305+0000","last_undegraded":"2024-09-13T15:16:24.161305+0000","last_fullsized":"2024-09-13T15:16:24.161305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4768,"log_dups_size":0,"ondisk_log_size":4768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69048,"num_write_kb":987747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.938473+0000","last_change":"2024-09-13T15:01:44.818472+0000","last_active":"2024-09-13T15:16:23.938473+0000","last_peered":"2024-09-13T15:16:23.938473+0000","last_clean":"2024-09-13T15:16:23.938473+0000","last_became_active":"2024-09-13T15:01:44.817718+0000","last_became_peered":"2024-09-13T15:01:44.817718+0000","last_unstale":"2024-09-13T15:16:23.938473+0000","last_undegraded":"2024-09-13T15:16:23.938473+0000","last_fullsized":"2024-09-13T15:16:23.938473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"33'19","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:21.104702+0000","last_change":"2024-09-13T15:16:21.104702+0000","last_active":"2024-09-13T15:16:21.104702+0000","last_peered":"2024-09-13T15:16:21.104702+0000","last_clean":"2024-09-13T15:16:21.104702+0000","last_became_active":"2024-09-13T15:01:44.409585+0000","last_became_peered":"2024-09-13T15:01:44.409585+0000","last_unstale":"2024-09-13T15:16:21.104702+0000","last_undegraded":"2024-09-13T15:16:21.104702+0000","last_fullsized":"2024-09-13T15:16:21.104702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T15:16:21.104582+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T15:16:21.104582+0000","last_clean_scrub_stamp":"2024-09-13T15:16:21.104582+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:29.612823+0000","scrub_duration":0.054426386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"33'5322","reported_seq":5349,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.118674+0000","last_change":"2024-09-13T15:01:48.861130+0000","last_active":"2024-09-13T15:16:24.118674+0000","last_peered":"2024-09-13T15:16:24.118674+0000","last_clean":"2024-09-13T15:16:24.118674+0000","last_became_active":"2024-09-13T15:01:48.860317+0000","last_became_peered":"2024-09-13T15:01:48.860317+0000","last_unstale":"2024-09-13T15:16:24.118674+0000","last_undegraded":"2024-09-13T15:16:24.118674+0000","last_fullsized":"2024-09-13T15:16:24.118674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5322,"log_dups_size":0,"ondisk_log_size":5322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77566,"num_write_kb":1107255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:22.445096+0000","last_change":"2024-09-13T15:01:44.835494+0000","last_active":"2024-09-13T15:16:22.445096+0000","last_peered":"2024-09-13T15:16:22.445096+0000","last_clean":"2024-09-13T15:16:22.445096+0000","last_became_active":"2024-09-13T15:01:44.831150+0000","last_became_peered":"2024-09-13T15:01:44.831150+0000","last_unstale":"2024-09-13T15:16:22.445096+0000","last_undegraded":"2024-09-13T15:16:22.445096+0000","last_fullsized":"2024-09-13T15:16:22.445096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'37","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.090066+0000","last_change":"2024-09-13T15:16:23.110015+0000","last_active":"2024-09-13T15:16:24.090066+0000","last_peered":"2024-09-13T15:16:24.090066+0000","last_clean":"2024-09-13T15:16:24.090066+0000","last_became_active":"2024-09-13T15:01:44.389946+0000","last_became_peered":"2024-09-13T15:01:44.389946+0000","last_unstale":"2024-09-13T15:16:24.090066+0000","last_undegraded":"2024-09-13T15:16:24.090066+0000","last_fullsized":"2024-09-13T15:16:24.090066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'31","last_scrub_stamp":"2024-09-13T15:16:23.109915+0000","last_deep_scrub":"33'31","last_deep_scrub_stamp":"2024-09-13T15:16:23.109915+0000","last_clean_scrub_stamp":"2024-09-13T15:16:23.109915+0000","objects_scrubbed":9,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:49.142729+0000","scrub_duration":0.0066126249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":23,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9630,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"33'4126","reported_seq":4153,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.223137+0000","last_change":"2024-09-13T15:01:48.848009+0000","last_active":"2024-09-13T15:16:24.223137+0000","last_peered":"2024-09-13T15:16:24.223137+0000","last_clean":"2024-09-13T15:16:24.223137+0000","last_became_active":"2024-09-13T15:01:48.847605+0000","last_became_peered":"2024-09-13T15:01:48.847605+0000","last_unstale":"2024-09-13T15:16:24.223137+0000","last_undegraded":"2024-09-13T15:16:24.223137+0000","last_fullsized":"2024-09-13T15:16:24.223137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4126,"log_dups_size":0,"ondisk_log_size":4126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59577,"num_write_kb":873580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'9","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.013455+0000","last_change":"2024-09-13T15:01:44.808572+0000","last_active":"2024-09-13T15:16:24.013455+0000","last_peered":"2024-09-13T15:16:24.013455+0000","last_clean":"2024-09-13T15:16:24.013455+0000","last_became_active":"2024-09-13T15:01:44.808140+0000","last_became_peered":"2024-09-13T15:01:44.808140+0000","last_unstale":"2024-09-13T15:16:24.013455+0000","last_undegraded":"2024-09-13T15:16:24.013455+0000","last_fullsized":"2024-09-13T15:16:24.013455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"33'14","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:31.855992+0000","last_change":"2024-09-13T15:16:31.856223+0000","last_active":"2024-09-13T15:16:31.855992+0000","last_peered":"2024-09-13T15:16:31.855992+0000","last_clean":"2024-09-13T15:16:31.855992+0000","last_became_active":"2024-09-13T15:01:44.428271+0000","last_became_peered":"2024-09-13T15:01:44.428271+0000","last_unstale":"2024-09-13T15:16:31.855992+0000","last_undegraded":"2024-09-13T15:16:31.855992+0000","last_fullsized":"2024-09-13T15:16:31.855992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:31.855936+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:31.855936+0000","last_clean_scrub_stamp":"2024-09-13T15:16:31.855936+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:54.569226+0000","scrub_duration":0.0071886169999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"33'4957","reported_seq":4984,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.114620+0000","last_change":"2024-09-13T15:01:48.916354+0000","last_active":"2024-09-13T15:16:24.114620+0000","last_peered":"2024-09-13T15:16:24.114620+0000","last_clean":"2024-09-13T15:16:24.114620+0000","last_became_active":"2024-09-13T15:01:48.916008+0000","last_became_peered":"2024-09-13T15:01:48.916008+0000","last_unstale":"2024-09-13T15:16:24.114620+0000","last_undegraded":"2024-09-13T15:16:24.114620+0000","last_fullsized":"2024-09-13T15:16:24.114620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4957,"log_dups_size":0,"ondisk_log_size":4957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72374,"num_write_kb":1020409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'20","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.700019+0000","last_change":"2024-09-13T15:16:24.700227+0000","last_active":"2024-09-13T15:16:24.700019+0000","last_peered":"2024-09-13T15:16:24.700019+0000","last_clean":"2024-09-13T15:16:24.700019+0000","last_became_active":"2024-09-13T15:01:44.825996+0000","last_became_peered":"2024-09-13T15:01:44.825996+0000","last_unstale":"2024-09-13T15:16:24.700019+0000","last_undegraded":"2024-09-13T15:16:24.700019+0000","last_fullsized":"2024-09-13T15:16:24.700019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-13T15:16:24.699962+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-13T15:16:24.699962+0000","last_clean_scrub_stamp":"2024-09-13T15:16:24.699962+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:57.006772+0000","scrub_duration":0.003063091,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"33'11","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:30.633435+0000","last_change":"2024-09-13T15:16:30.633635+0000","last_active":"2024-09-13T15:16:30.633435+0000","last_peered":"2024-09-13T15:16:30.633435+0000","last_clean":"2024-09-13T15:16:30.633435+0000","last_became_active":"2024-09-13T15:01:44.408644+0000","last_became_peered":"2024-09-13T15:01:44.408644+0000","last_unstale":"2024-09-13T15:16:30.633435+0000","last_undegraded":"2024-09-13T15:16:30.633435+0000","last_fullsized":"2024-09-13T15:16:30.633435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:30.633381+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:30.633381+0000","last_clean_scrub_stamp":"2024-09-13T15:16:30.633381+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:48.589150+0000","scrub_duration":0.005668729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'4735","reported_seq":4762,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.166943+0000","last_change":"2024-09-13T15:01:48.916478+0000","last_active":"2024-09-13T15:16:24.166943+0000","last_peered":"2024-09-13T15:16:24.166943+0000","last_clean":"2024-09-13T15:16:24.166943+0000","last_became_active":"2024-09-13T15:01:48.916198+0000","last_became_peered":"2024-09-13T15:01:48.916198+0000","last_unstale":"2024-09-13T15:16:24.166943+0000","last_undegraded":"2024-09-13T15:16:24.166943+0000","last_fullsized":"2024-09-13T15:16:24.166943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4735,"log_dups_size":0,"ondisk_log_size":4735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68970,"num_write_kb":974417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.305261+0000","last_change":"2024-09-13T15:16:34.305358+0000","last_active":"2024-09-13T15:16:34.305261+0000","last_peered":"2024-09-13T15:16:34.305261+0000","last_clean":"2024-09-13T15:16:34.305261+0000","last_became_active":"2024-09-13T15:01:44.831583+0000","last_became_peered":"2024-09-13T15:01:44.831583+0000","last_unstale":"2024-09-13T15:16:34.305261+0000","last_undegraded":"2024-09-13T15:16:34.305261+0000","last_fullsized":"2024-09-13T15:16:34.305261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:34.305240+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:34.305240+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.305240+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:40.060577+0000","scrub_duration":0.0020742930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"33'41","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.078546+0000","last_change":"2024-09-13T15:16:20.445448+0000","last_active":"2024-09-13T15:16:24.078546+0000","last_peered":"2024-09-13T15:16:24.078546+0000","last_clean":"2024-09-13T15:16:24.078546+0000","last_became_active":"2024-09-13T15:01:44.408453+0000","last_became_peered":"2024-09-13T15:01:44.408453+0000","last_unstale":"2024-09-13T15:16:24.078546+0000","last_undegraded":"2024-09-13T15:16:24.078546+0000","last_fullsized":"2024-09-13T15:16:24.078546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'38","last_scrub_stamp":"2024-09-13T15:16:20.444690+0000","last_deep_scrub":"33'38","last_deep_scrub_stamp":"2024-09-13T15:16:20.444690+0000","last_clean_scrub_stamp":"2024-09-13T15:16:20.444690+0000","objects_scrubbed":8,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:18.099238+0000","scrub_duration":0.086113890999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":8225,"num_write":32,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'5131","reported_seq":5158,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.201763+0000","last_change":"2024-09-13T15:01:48.916681+0000","last_active":"2024-09-13T15:16:24.201763+0000","last_peered":"2024-09-13T15:16:24.201763+0000","last_clean":"2024-09-13T15:16:24.201763+0000","last_became_active":"2024-09-13T15:01:48.916185+0000","last_became_peered":"2024-09-13T15:01:48.916185+0000","last_unstale":"2024-09-13T15:16:24.201763+0000","last_undegraded":"2024-09-13T15:16:24.201763+0000","last_fullsized":"2024-09-13T15:16:24.201763+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5131,"log_dups_size":0,"ondisk_log_size":5131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74464,"num_write_kb":1089564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.839720+0000","last_change":"2024-09-13T15:01:44.817007+0000","last_active":"2024-09-13T15:16:23.839720+0000","last_peered":"2024-09-13T15:16:23.839720+0000","last_clean":"2024-09-13T15:16:23.839720+0000","last_became_active":"2024-09-13T15:01:44.815435+0000","last_became_peered":"2024-09-13T15:01:44.815435+0000","last_unstale":"2024-09-13T15:16:23.839720+0000","last_undegraded":"2024-09-13T15:16:23.839720+0000","last_fullsized":"2024-09-13T15:16:23.839720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'583","reported_seq":636,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:29.820102+0000","last_change":"2024-09-13T15:16:29.820334+0000","last_active":"2024-09-13T15:16:29.820102+0000","last_peered":"2024-09-13T15:16:29.820102+0000","last_clean":"2024-09-13T15:16:29.820102+0000","last_became_active":"2024-09-13T15:01:44.435222+0000","last_became_peered":"2024-09-13T15:01:44.435222+0000","last_unstale":"2024-09-13T15:16:29.820102+0000","last_undegraded":"2024-09-13T15:16:29.820102+0000","last_fullsized":"2024-09-13T15:16:29.820102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'583","last_scrub_stamp":"2024-09-13T15:16:29.820047+0000","last_deep_scrub":"33'583","last_deep_scrub_stamp":"2024-09-13T15:16:29.820047+0000","last_clean_scrub_stamp":"2024-09-13T15:16:29.820047+0000","objects_scrubbed":7,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:27:24.758478+0000","scrub_duration":0.044190934000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8159583,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":7965,"num_write":571,"num_write_kb":8183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"33'4464","reported_seq":4491,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.171162+0000","last_change":"2024-09-13T15:01:48.847694+0000","last_active":"2024-09-13T15:16:24.171162+0000","last_peered":"2024-09-13T15:16:24.171162+0000","last_clean":"2024-09-13T15:16:24.171162+0000","last_became_active":"2024-09-13T15:01:48.846835+0000","last_became_peered":"2024-09-13T15:01:48.846835+0000","last_unstale":"2024-09-13T15:16:24.171162+0000","last_undegraded":"2024-09-13T15:16:24.171162+0000","last_fullsized":"2024-09-13T15:16:24.171162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4464,"log_dups_size":0,"ondisk_log_size":4464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65013,"num_write_kb":924599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.140565+0000","last_change":"2024-09-13T15:16:23.083422+0000","last_active":"2024-09-13T15:16:24.140565+0000","last_peered":"2024-09-13T15:16:24.140565+0000","last_clean":"2024-09-13T15:16:24.140565+0000","last_became_active":"2024-09-13T15:01:44.834643+0000","last_became_peered":"2024-09-13T15:01:44.834643+0000","last_unstale":"2024-09-13T15:16:24.140565+0000","last_undegraded":"2024-09-13T15:16:24.140565+0000","last_fullsized":"2024-09-13T15:16:24.140565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-13T15:16:23.083116+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-13T15:16:23.083116+0000","last_clean_scrub_stamp":"2024-09-13T15:16:23.083116+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:43:56.932464+0000","scrub_duration":0.001347029,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'20","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.432148+0000","last_change":"2024-09-13T15:16:34.432220+0000","last_active":"2024-09-13T15:16:34.432148+0000","last_peered":"2024-09-13T15:16:34.432148+0000","last_clean":"2024-09-13T15:16:34.432148+0000","last_became_active":"2024-09-13T15:01:44.424714+0000","last_became_peered":"2024-09-13T15:01:44.424714+0000","last_unstale":"2024-09-13T15:16:34.432148+0000","last_undegraded":"2024-09-13T15:16:34.432148+0000","last_fullsized":"2024-09-13T15:16:34.432148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-13T15:16:34.432129+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-13T15:16:34.432129+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.432129+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:01.436564+0000","scrub_duration":0.0064639520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":15,"num_write":18,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'4809","reported_seq":4846,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.112571+0000","last_change":"2024-09-13T15:02:33.753482+0000","last_active":"2024-09-13T15:16:24.112571+0000","last_peered":"2024-09-13T15:16:24.112571+0000","last_clean":"2024-09-13T15:16:24.112571+0000","last_became_active":"2024-09-13T15:02:33.752505+0000","last_became_peered":"2024-09-13T15:02:33.752505+0000","last_unstale":"2024-09-13T15:16:24.112571+0000","last_undegraded":"2024-09-13T15:16:24.112571+0000","last_fullsized":"2024-09-13T15:16:24.112571+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4809,"log_dups_size":0,"ondisk_log_size":4809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69744,"num_write_kb":999376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"33'11","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.758382+0000","last_change":"2024-09-13T15:01:44.837032+0000","last_active":"2024-09-13T15:16:23.758382+0000","last_peered":"2024-09-13T15:16:23.758382+0000","last_clean":"2024-09-13T15:16:23.758382+0000","last_became_active":"2024-09-13T15:01:44.836750+0000","last_became_peered":"2024-09-13T15:01:44.836750+0000","last_unstale":"2024-09-13T15:16:23.758382+0000","last_undegraded":"2024-09-13T15:16:23.758382+0000","last_fullsized":"2024-09-13T15:16:23.758382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"33'14","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:31.641077+0000","last_change":"2024-09-13T15:16:31.641324+0000","last_active":"2024-09-13T15:16:31.641077+0000","last_peered":"2024-09-13T15:16:31.641077+0000","last_clean":"2024-09-13T15:16:31.641077+0000","last_became_active":"2024-09-13T15:01:44.437433+0000","last_became_peered":"2024-09-13T15:01:44.437433+0000","last_unstale":"2024-09-13T15:16:31.641077+0000","last_undegraded":"2024-09-13T15:16:31.641077+0000","last_fullsized":"2024-09-13T15:16:31.641077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:31.641025+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:31.641025+0000","last_clean_scrub_stamp":"2024-09-13T15:16:31.641025+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:08.039896+0000","scrub_duration":0.0069456680000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":18,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'4904","reported_seq":4931,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.091077+0000","last_change":"2024-09-13T15:01:48.841829+0000","last_active":"2024-09-13T15:16:24.091077+0000","last_peered":"2024-09-13T15:16:24.091077+0000","last_clean":"2024-09-13T15:16:24.091077+0000","last_became_active":"2024-09-13T15:01:48.841267+0000","last_became_peered":"2024-09-13T15:01:48.841267+0000","last_unstale":"2024-09-13T15:16:24.091077+0000","last_undegraded":"2024-09-13T15:16:24.091077+0000","last_fullsized":"2024-09-13T15:16:24.091077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4904,"log_dups_size":0,"ondisk_log_size":4904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71251,"num_write_kb":1004130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'8","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.207623+0000","last_change":"2024-09-13T15:01:44.844701+0000","last_active":"2024-09-13T15:16:24.207623+0000","last_peered":"2024-09-13T15:16:24.207623+0000","last_clean":"2024-09-13T15:16:24.207623+0000","last_became_active":"2024-09-13T15:01:44.843982+0000","last_became_peered":"2024-09-13T15:01:44.843982+0000","last_unstale":"2024-09-13T15:16:24.207623+0000","last_undegraded":"2024-09-13T15:16:24.207623+0000","last_fullsized":"2024-09-13T15:16:24.207623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"33'18","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:32.864296+0000","last_change":"2024-09-13T15:16:32.864508+0000","last_active":"2024-09-13T15:16:32.864296+0000","last_peered":"2024-09-13T15:16:32.864296+0000","last_clean":"2024-09-13T15:16:32.864296+0000","last_became_active":"2024-09-13T15:01:44.435367+0000","last_became_peered":"2024-09-13T15:01:44.435367+0000","last_unstale":"2024-09-13T15:16:32.864296+0000","last_undegraded":"2024-09-13T15:16:32.864296+0000","last_fullsized":"2024-09-13T15:16:32.864296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T15:16:32.864235+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T15:16:32.864235+0000","last_clean_scrub_stamp":"2024-09-13T15:16:32.864235+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:20.427017+0000","scrub_duration":0.0072294949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"33'3940","reported_seq":3967,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.061791+0000","last_change":"2024-09-13T15:01:48.910562+0000","last_active":"2024-09-13T15:16:24.061791+0000","last_peered":"2024-09-13T15:16:24.061791+0000","last_clean":"2024-09-13T15:16:24.061791+0000","last_became_active":"2024-09-13T15:01:48.909681+0000","last_became_peered":"2024-09-13T15:01:48.909681+0000","last_unstale":"2024-09-13T15:16:24.061791+0000","last_undegraded":"2024-09-13T15:16:24.061791+0000","last_fullsized":"2024-09-13T15:16:24.061791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":3940,"log_dups_size":0,"ondisk_log_size":3940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57394,"num_write_kb":843085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'3678","reported_seq":3716,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.035337+0000","last_change":"2024-09-13T15:02:34.118951+0000","last_active":"2024-09-13T15:16:24.035337+0000","last_peered":"2024-09-13T15:16:24.035337+0000","last_clean":"2024-09-13T15:16:24.035337+0000","last_became_active":"2024-09-13T15:02:34.118477+0000","last_became_peered":"2024-09-13T15:02:34.118477+0000","last_unstale":"2024-09-13T15:16:24.035337+0000","last_undegraded":"2024-09-13T15:16:24.035337+0000","last_fullsized":"2024-09-13T15:16:24.035337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53439,"num_write_kb":757724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'11","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.227570+0000","last_change":"2024-09-13T15:01:44.808417+0000","last_active":"2024-09-13T15:16:24.227570+0000","last_peered":"2024-09-13T15:16:24.227570+0000","last_clean":"2024-09-13T15:16:24.227570+0000","last_became_active":"2024-09-13T15:01:44.807641+0000","last_became_peered":"2024-09-13T15:01:44.807641+0000","last_unstale":"2024-09-13T15:16:24.227570+0000","last_undegraded":"2024-09-13T15:16:24.227570+0000","last_fullsized":"2024-09-13T15:16:24.227570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"33'38","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:25.574908+0000","last_change":"2024-09-13T15:16:25.575105+0000","last_active":"2024-09-13T15:16:25.574908+0000","last_peered":"2024-09-13T15:16:25.574908+0000","last_clean":"2024-09-13T15:16:25.574908+0000","last_became_active":"2024-09-13T15:01:44.433124+0000","last_became_peered":"2024-09-13T15:01:44.433124+0000","last_unstale":"2024-09-13T15:16:25.574908+0000","last_undegraded":"2024-09-13T15:16:25.574908+0000","last_fullsized":"2024-09-13T15:16:25.574908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'38","last_scrub_stamp":"2024-09-13T15:16:25.574855+0000","last_deep_scrub":"33'38","last_deep_scrub_stamp":"2024-09-13T15:16:25.574855+0000","last_clean_scrub_stamp":"2024-09-13T15:16:25.574855+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:45.303091+0000","scrub_duration":0.033176627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":8193,"num_write":27,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4928","reported_seq":4956,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.022772+0000","last_change":"2024-09-13T15:01:48.855090+0000","last_active":"2024-09-13T15:16:24.022772+0000","last_peered":"2024-09-13T15:16:24.022772+0000","last_clean":"2024-09-13T15:16:24.022772+0000","last_became_active":"2024-09-13T15:01:48.852925+0000","last_became_peered":"2024-09-13T15:01:48.852925+0000","last_unstale":"2024-09-13T15:16:24.022772+0000","last_undegraded":"2024-09-13T15:16:24.022772+0000","last_fullsized":"2024-09-13T15:16:24.022772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4928,"log_dups_size":0,"ondisk_log_size":4928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71646,"num_write_kb":1060070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"33'13","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.854698+0000","last_change":"2024-09-13T15:02:33.746356+0000","last_active":"2024-09-13T15:16:23.854698+0000","last_peered":"2024-09-13T15:16:23.854698+0000","last_clean":"2024-09-13T15:16:23.854698+0000","last_became_active":"2024-09-13T15:02:33.746005+0000","last_became_peered":"2024-09-13T15:02:33.746005+0000","last_unstale":"2024-09-13T15:16:23.854698+0000","last_undegraded":"2024-09-13T15:16:23.854698+0000","last_fullsized":"2024-09-13T15:16:23.854698+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"33'11","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:33.955676+0000","last_change":"2024-09-13T15:16:33.955756+0000","last_active":"2024-09-13T15:16:33.955676+0000","last_peered":"2024-09-13T15:16:33.955676+0000","last_clean":"2024-09-13T15:16:33.955676+0000","last_became_active":"2024-09-13T15:01:44.436646+0000","last_became_peered":"2024-09-13T15:01:44.436646+0000","last_unstale":"2024-09-13T15:16:33.955676+0000","last_undegraded":"2024-09-13T15:16:33.955676+0000","last_fullsized":"2024-09-13T15:16:33.955676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:33.955656+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:33.955656+0000","last_clean_scrub_stamp":"2024-09-13T15:16:33.955656+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:59.640305+0000","scrub_duration":0.0059488070000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":27,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"33'53","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.923151+0000","last_change":"2024-09-13T15:16:34.923151+0000","last_active":"2024-09-13T15:16:34.923151+0000","last_peered":"2024-09-13T15:16:34.923151+0000","last_clean":"2024-09-13T15:16:34.923151+0000","last_became_active":"2024-09-13T15:01:44.429339+0000","last_became_peered":"2024-09-13T15:01:44.429339+0000","last_unstale":"2024-09-13T15:16:34.923151+0000","last_undegraded":"2024-09-13T15:16:34.923151+0000","last_fullsized":"2024-09-13T15:16:34.923151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'53","last_scrub_stamp":"2024-09-13T15:16:34.922888+0000","last_deep_scrub":"33'53","last_deep_scrub_stamp":"2024-09-13T15:16:34.922888+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.922888+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:24.468558+0000","scrub_duration":0.034548224000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":8210,"num_write":46,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"33'9","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:33.344455+0000","last_change":"2024-09-13T15:16:33.344530+0000","last_active":"2024-09-13T15:16:33.344455+0000","last_peered":"2024-09-13T15:16:33.344455+0000","last_clean":"2024-09-13T15:16:33.344455+0000","last_became_active":"2024-09-13T15:01:44.821734+0000","last_became_peered":"2024-09-13T15:01:44.821734+0000","last_unstale":"2024-09-13T15:16:33.344455+0000","last_undegraded":"2024-09-13T15:16:33.344455+0000","last_fullsized":"2024-09-13T15:16:33.344455+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:33.344436+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:33.344436+0000","last_clean_scrub_stamp":"2024-09-13T15:16:33.344436+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:18.534801+0000","scrub_duration":0.0023763030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"33'4710","reported_seq":4747,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:35.170850+0000","last_change":"2024-09-13T15:16:35.170988+0000","last_active":"2024-09-13T15:16:35.170850+0000","last_peered":"2024-09-13T15:16:35.170850+0000","last_clean":"2024-09-13T15:16:35.170850+0000","last_became_active":"2024-09-13T15:01:48.857584+0000","last_became_peered":"2024-09-13T15:01:48.857584+0000","last_unstale":"2024-09-13T15:16:35.170850+0000","last_undegraded":"2024-09-13T15:16:35.170850+0000","last_fullsized":"2024-09-13T15:16:35.170850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4710","last_scrub_stamp":"2024-09-13T15:16:35.170829+0000","last_deep_scrub":"33'4710","last_deep_scrub_stamp":"2024-09-13T15:16:35.170829+0000","last_clean_scrub_stamp":"2024-09-13T15:16:35.170829+0000","objects_scrubbed":0,"log_size":4710,"log_dups_size":0,"ondisk_log_size":4710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:45.991405+0000","scrub_duration":0.042675653000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68679,"num_write_kb":960930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"33'1786","reported_seq":1829,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:31.928085+0000","last_change":"2024-09-13T15:16:31.928330+0000","last_active":"2024-09-13T15:16:31.928085+0000","last_peered":"2024-09-13T15:16:31.928085+0000","last_clean":"2024-09-13T15:16:31.928085+0000","last_became_active":"2024-09-13T15:01:44.422367+0000","last_became_peered":"2024-09-13T15:01:44.422367+0000","last_unstale":"2024-09-13T15:16:31.928085+0000","last_undegraded":"2024-09-13T15:16:31.928085+0000","last_fullsized":"2024-09-13T15:16:31.928085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'1786","last_scrub_stamp":"2024-09-13T15:16:31.928065+0000","last_deep_scrub":"33'1786","last_deep_scrub_stamp":"2024-09-13T15:16:31.928065+0000","last_clean_scrub_stamp":"2024-09-13T15:16:31.928065+0000","objects_scrubbed":3,"log_size":1786,"log_dups_size":0,"ondisk_log_size":1786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:44.840912+0000","scrub_duration":0.023676508999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4098,"num_write":1776,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.230513+0000","last_change":"2024-09-13T15:16:24.080158+0000","last_active":"2024-09-13T15:16:24.230513+0000","last_peered":"2024-09-13T15:16:24.230513+0000","last_clean":"2024-09-13T15:16:24.230513+0000","last_became_active":"2024-09-13T15:01:44.816584+0000","last_became_peered":"2024-09-13T15:01:44.816584+0000","last_unstale":"2024-09-13T15:16:24.230513+0000","last_undegraded":"2024-09-13T15:16:24.230513+0000","last_fullsized":"2024-09-13T15:16:24.230513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:24.080065+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:24.080065+0000","last_clean_scrub_stamp":"2024-09-13T15:16:24.080065+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:18.277593+0000","scrub_duration":0.0033993309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4724","reported_seq":4750,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.128022+0000","last_change":"2024-09-13T15:01:48.840771+0000","last_active":"2024-09-13T15:16:24.128022+0000","last_peered":"2024-09-13T15:16:24.128022+0000","last_clean":"2024-09-13T15:16:24.128022+0000","last_became_active":"2024-09-13T15:01:48.840397+0000","last_became_peered":"2024-09-13T15:01:48.840397+0000","last_unstale":"2024-09-13T15:16:24.128022+0000","last_undegraded":"2024-09-13T15:16:24.128022+0000","last_fullsized":"2024-09-13T15:16:24.128022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4724,"log_dups_size":0,"ondisk_log_size":4724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68744,"num_write_kb":983871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"33'14","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.243579+0000","last_change":"2024-09-13T15:01:44.809497+0000","last_active":"2024-09-13T15:16:24.243579+0000","last_peered":"2024-09-13T15:16:24.243579+0000","last_clean":"2024-09-13T15:16:24.243579+0000","last_became_active":"2024-09-13T15:01:44.808669+0000","last_became_peered":"2024-09-13T15:01:44.808669+0000","last_unstale":"2024-09-13T15:16:24.243579+0000","last_undegraded":"2024-09-13T15:16:24.243579+0000","last_fullsized":"2024-09-13T15:16:24.243579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"33'13","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:31.136709+0000","last_change":"2024-09-13T15:16:31.136790+0000","last_active":"2024-09-13T15:16:31.136709+0000","last_peered":"2024-09-13T15:16:31.136709+0000","last_clean":"2024-09-13T15:16:31.136709+0000","last_became_active":"2024-09-13T15:01:44.836102+0000","last_became_peered":"2024-09-13T15:01:44.836102+0000","last_unstale":"2024-09-13T15:16:31.136709+0000","last_undegraded":"2024-09-13T15:16:31.136709+0000","last_fullsized":"2024-09-13T15:16:31.136709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T15:16:31.136690+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T15:16:31.136690+0000","last_clean_scrub_stamp":"2024-09-13T15:16:31.136690+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:55.607725+0000","scrub_duration":0.0019713320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"33'10","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:32.625887+0000","last_change":"2024-09-13T15:16:32.626112+0000","last_active":"2024-09-13T15:16:32.625887+0000","last_peered":"2024-09-13T15:16:32.625887+0000","last_clean":"2024-09-13T15:16:32.625887+0000","last_became_active":"2024-09-13T15:01:44.846506+0000","last_became_peered":"2024-09-13T15:01:44.846506+0000","last_unstale":"2024-09-13T15:16:32.625887+0000","last_undegraded":"2024-09-13T15:16:32.625887+0000","last_fullsized":"2024-09-13T15:16:32.625887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T15:16:32.625828+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T15:16:32.625828+0000","last_clean_scrub_stamp":"2024-09-13T15:16:32.625828+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:38.132404+0000","scrub_duration":0.002756784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"33'10","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:38.251444+0000","last_change":"2024-09-13T15:16:38.251543+0000","last_active":"2024-09-13T15:16:38.251444+0000","last_peered":"2024-09-13T15:16:38.251444+0000","last_clean":"2024-09-13T15:16:38.251444+0000","last_became_active":"2024-09-13T15:01:44.809585+0000","last_became_peered":"2024-09-13T15:01:44.809585+0000","last_unstale":"2024-09-13T15:16:38.251444+0000","last_undegraded":"2024-09-13T15:16:38.251444+0000","last_fullsized":"2024-09-13T15:16:38.251444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T15:16:38.251426+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T15:16:38.251426+0000","last_clean_scrub_stamp":"2024-09-13T15:16:38.251426+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:13:40.307246+0000","scrub_duration":0.0015167939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'4","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:19.236411+0000","last_change":"2024-09-13T15:01:44.816761+0000","last_active":"2024-09-13T15:16:19.236411+0000","last_peered":"2024-09-13T15:16:19.236411+0000","last_clean":"2024-09-13T15:16:19.236411+0000","last_became_active":"2024-09-13T15:01:44.816480+0000","last_became_peered":"2024-09-13T15:01:44.816480+0000","last_unstale":"2024-09-13T15:16:19.236411+0000","last_undegraded":"2024-09-13T15:16:19.236411+0000","last_fullsized":"2024-09-13T15:16:19.236411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.128400+0000","last_change":"2024-09-13T15:16:20.596249+0000","last_active":"2024-09-13T15:16:24.128400+0000","last_peered":"2024-09-13T15:16:24.128400+0000","last_clean":"2024-09-13T15:16:24.128400+0000","last_became_active":"2024-09-13T15:01:44.807622+0000","last_became_peered":"2024-09-13T15:01:44.807622+0000","last_unstale":"2024-09-13T15:16:24.128400+0000","last_undegraded":"2024-09-13T15:16:24.128400+0000","last_fullsized":"2024-09-13T15:16:24.128400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:20.596153+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:20.596153+0000","last_clean_scrub_stamp":"2024-09-13T15:16:20.596153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:27:28.285632+0000","scrub_duration":0.0016568729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"33'19","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.043112+0000","last_change":"2024-09-13T15:01:44.832521+0000","last_active":"2024-09-13T15:16:24.043112+0000","last_peered":"2024-09-13T15:16:24.043112+0000","last_clean":"2024-09-13T15:16:24.043112+0000","last_became_active":"2024-09-13T15:01:44.831889+0000","last_became_peered":"2024-09-13T15:01:44.831889+0000","last_unstale":"2024-09-13T15:16:24.043112+0000","last_undegraded":"2024-09-13T15:16:24.043112+0000","last_fullsized":"2024-09-13T15:16:24.043112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"33'5","reported_seq":33,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.047594+0000","last_change":"2024-09-13T15:01:44.817583+0000","last_active":"2024-09-13T15:16:24.047594+0000","last_peered":"2024-09-13T15:16:24.047594+0000","last_clean":"2024-09-13T15:16:24.047594+0000","last_became_active":"2024-09-13T15:01:44.817350+0000","last_became_peered":"2024-09-13T15:01:44.817350+0000","last_unstale":"2024-09-13T15:16:24.047594+0000","last_undegraded":"2024-09-13T15:16:24.047594+0000","last_fullsized":"2024-09-13T15:16:24.047594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"33'10","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.613833+0000","last_change":"2024-09-13T15:16:34.614046+0000","last_active":"2024-09-13T15:16:34.613833+0000","last_peered":"2024-09-13T15:16:34.613833+0000","last_clean":"2024-09-13T15:16:34.613833+0000","last_became_active":"2024-09-13T15:01:44.837588+0000","last_became_peered":"2024-09-13T15:01:44.837588+0000","last_unstale":"2024-09-13T15:16:34.613833+0000","last_undegraded":"2024-09-13T15:16:34.613833+0000","last_fullsized":"2024-09-13T15:16:34.613833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T15:16:34.613780+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T15:16:34.613780+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.613780+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:41.237672+0000","scrub_duration":0.0026563189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"33'11","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.113688+0000","last_change":"2024-09-13T15:01:44.828159+0000","last_active":"2024-09-13T15:16:24.113688+0000","last_peered":"2024-09-13T15:16:24.113688+0000","last_clean":"2024-09-13T15:16:24.113688+0000","last_became_active":"2024-09-13T15:01:44.827910+0000","last_became_peered":"2024-09-13T15:01:44.827910+0000","last_unstale":"2024-09-13T15:16:24.113688+0000","last_undegraded":"2024-09-13T15:16:24.113688+0000","last_fullsized":"2024-09-13T15:16:24.113688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"33'11","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.009000+0000","last_change":"2024-09-13T15:02:34.119204+0000","last_active":"2024-09-13T15:16:24.009000+0000","last_peered":"2024-09-13T15:16:24.009000+0000","last_clean":"2024-09-13T15:16:24.009000+0000","last_became_active":"2024-09-13T15:02:34.118621+0000","last_became_peered":"2024-09-13T15:02:34.118621+0000","last_unstale":"2024-09-13T15:16:24.009000+0000","last_undegraded":"2024-09-13T15:16:24.009000+0000","last_fullsized":"2024-09-13T15:16:24.009000+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"33'14","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.856791+0000","last_change":"2024-09-13T15:01:44.831717+0000","last_active":"2024-09-13T15:16:23.856791+0000","last_peered":"2024-09-13T15:16:23.856791+0000","last_clean":"2024-09-13T15:16:23.856791+0000","last_became_active":"2024-09-13T15:01:44.831495+0000","last_became_peered":"2024-09-13T15:01:44.831495+0000","last_unstale":"2024-09-13T15:16:23.856791+0000","last_undegraded":"2024-09-13T15:16:23.856791+0000","last_fullsized":"2024-09-13T15:16:23.856791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"33'11","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.914328+0000","last_change":"2024-09-13T15:01:44.829698+0000","last_active":"2024-09-13T15:16:23.914328+0000","last_peered":"2024-09-13T15:16:23.914328+0000","last_clean":"2024-09-13T15:16:23.914328+0000","last_became_active":"2024-09-13T15:01:44.828999+0000","last_became_peered":"2024-09-13T15:01:44.828999+0000","last_unstale":"2024-09-13T15:16:23.914328+0000","last_undegraded":"2024-09-13T15:16:23.914328+0000","last_fullsized":"2024-09-13T15:16:23.914328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"33'9","reported_seq":37,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.091811+0000","last_change":"2024-09-13T15:01:44.817554+0000","last_active":"2024-09-13T15:16:24.091811+0000","last_peered":"2024-09-13T15:16:24.091811+0000","last_clean":"2024-09-13T15:16:24.091811+0000","last_became_active":"2024-09-13T15:01:44.816258+0000","last_became_peered":"2024-09-13T15:01:44.816258+0000","last_unstale":"2024-09-13T15:16:24.091811+0000","last_undegraded":"2024-09-13T15:16:24.091811+0000","last_fullsized":"2024-09-13T15:16:24.091811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"33'19","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:29.104737+0000","last_change":"2024-09-13T15:16:29.104820+0000","last_active":"2024-09-13T15:16:29.104737+0000","last_peered":"2024-09-13T15:16:29.104737+0000","last_clean":"2024-09-13T15:16:29.104737+0000","last_became_active":"2024-09-13T15:01:44.809687+0000","last_became_peered":"2024-09-13T15:01:44.809687+0000","last_unstale":"2024-09-13T15:16:29.104737+0000","last_undegraded":"2024-09-13T15:16:29.104737+0000","last_fullsized":"2024-09-13T15:16:29.104737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:29.104716+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:29.104716+0000","last_clean_scrub_stamp":"2024-09-13T15:16:29.104716+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:42:33.959556+0000","scrub_duration":0.0023385429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"33'11","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.745751+0000","last_change":"2024-09-13T15:02:34.119233+0000","last_active":"2024-09-13T15:16:23.745751+0000","last_peered":"2024-09-13T15:16:23.745751+0000","last_clean":"2024-09-13T15:16:23.745751+0000","last_became_active":"2024-09-13T15:02:34.118798+0000","last_became_peered":"2024-09-13T15:02:34.118798+0000","last_unstale":"2024-09-13T15:16:23.745751+0000","last_undegraded":"2024-09-13T15:16:23.745751+0000","last_fullsized":"2024-09-13T15:16:23.745751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"33'11","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.957906+0000","last_change":"2024-09-13T15:01:44.848904+0000","last_active":"2024-09-13T15:16:23.957906+0000","last_peered":"2024-09-13T15:16:23.957906+0000","last_clean":"2024-09-13T15:16:23.957906+0000","last_became_active":"2024-09-13T15:01:44.846074+0000","last_became_peered":"2024-09-13T15:01:44.846074+0000","last_unstale":"2024-09-13T15:16:23.957906+0000","last_undegraded":"2024-09-13T15:16:23.957906+0000","last_fullsized":"2024-09-13T15:16:23.957906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"33'11","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:39.422600+0000","last_change":"2024-09-13T15:16:39.422675+0000","last_active":"2024-09-13T15:16:39.422600+0000","last_peered":"2024-09-13T15:16:39.422600+0000","last_clean":"2024-09-13T15:16:39.422600+0000","last_became_active":"2024-09-13T15:01:44.828024+0000","last_became_peered":"2024-09-13T15:01:44.828024+0000","last_unstale":"2024-09-13T15:16:39.422600+0000","last_undegraded":"2024-09-13T15:16:39.422600+0000","last_fullsized":"2024-09-13T15:16:39.422600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:39.422580+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:39.422580+0000","last_clean_scrub_stamp":"2024-09-13T15:16:39.422580+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:23.054857+0000","scrub_duration":0.0024637970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'10","reported_seq":39,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.175052+0000","last_change":"2024-09-13T15:01:44.808879+0000","last_active":"2024-09-13T15:16:24.175052+0000","last_peered":"2024-09-13T15:16:24.175052+0000","last_clean":"2024-09-13T15:16:24.175052+0000","last_became_active":"2024-09-13T15:01:44.808609+0000","last_became_peered":"2024-09-13T15:01:44.808609+0000","last_unstale":"2024-09-13T15:16:24.175052+0000","last_undegraded":"2024-09-13T15:16:24.175052+0000","last_fullsized":"2024-09-13T15:16:24.175052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"33'11","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:29.866264+0000","last_change":"2024-09-13T15:16:29.866373+0000","last_active":"2024-09-13T15:16:29.866264+0000","last_peered":"2024-09-13T15:16:29.866264+0000","last_clean":"2024-09-13T15:16:29.866264+0000","last_became_active":"2024-09-13T15:01:44.809918+0000","last_became_peered":"2024-09-13T15:01:44.809918+0000","last_unstale":"2024-09-13T15:16:29.866264+0000","last_undegraded":"2024-09-13T15:16:29.866264+0000","last_fullsized":"2024-09-13T15:16:29.866264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:29.866245+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:29.866245+0000","last_clean_scrub_stamp":"2024-09-13T15:16:29.866245+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:11.754182+0000","scrub_duration":0.0021947170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:30.138653+0000","last_change":"2024-09-13T15:16:30.138848+0000","last_active":"2024-09-13T15:16:30.138653+0000","last_peered":"2024-09-13T15:16:30.138653+0000","last_clean":"2024-09-13T15:16:30.138653+0000","last_became_active":"2024-09-13T15:01:44.828737+0000","last_became_peered":"2024-09-13T15:01:44.828737+0000","last_unstale":"2024-09-13T15:16:30.138653+0000","last_undegraded":"2024-09-13T15:16:30.138653+0000","last_fullsized":"2024-09-13T15:16:30.138653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:30.138598+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:30.138598+0000","last_clean_scrub_stamp":"2024-09-13T15:16:30.138598+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:12.240506+0000","scrub_duration":0.0030438290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"33'9","reported_seq":38,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.779994+0000","last_change":"2024-09-13T15:01:44.851143+0000","last_active":"2024-09-13T15:16:23.779994+0000","last_peered":"2024-09-13T15:16:23.779994+0000","last_clean":"2024-09-13T15:16:23.779994+0000","last_became_active":"2024-09-13T15:01:44.850410+0000","last_became_peered":"2024-09-13T15:01:44.850410+0000","last_unstale":"2024-09-13T15:16:23.779994+0000","last_undegraded":"2024-09-13T15:16:23.779994+0000","last_fullsized":"2024-09-13T15:16:23.779994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"33'17","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.185291+0000","last_change":"2024-09-13T15:01:44.840082+0000","last_active":"2024-09-13T15:16:24.185291+0000","last_peered":"2024-09-13T15:16:24.185291+0000","last_clean":"2024-09-13T15:16:24.185291+0000","last_became_active":"2024-09-13T15:01:44.839371+0000","last_became_peered":"2024-09-13T15:01:44.839371+0000","last_unstale":"2024-09-13T15:16:24.185291+0000","last_undegraded":"2024-09-13T15:16:24.185291+0000","last_fullsized":"2024-09-13T15:16:24.185291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"33'12","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.785070+0000","last_change":"2024-09-13T15:01:44.850416+0000","last_active":"2024-09-13T15:16:23.785070+0000","last_peered":"2024-09-13T15:16:23.785070+0000","last_clean":"2024-09-13T15:16:23.785070+0000","last_became_active":"2024-09-13T15:01:44.849766+0000","last_became_peered":"2024-09-13T15:01:44.849766+0000","last_unstale":"2024-09-13T15:16:23.785070+0000","last_undegraded":"2024-09-13T15:16:23.785070+0000","last_fullsized":"2024-09-13T15:16:23.785070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"33'9","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.938178+0000","last_change":"2024-09-13T15:16:26.938178+0000","last_active":"2024-09-13T15:16:26.938178+0000","last_peered":"2024-09-13T15:16:26.938178+0000","last_clean":"2024-09-13T15:16:26.938178+0000","last_became_active":"2024-09-13T15:01:44.836770+0000","last_became_peered":"2024-09-13T15:01:44.836770+0000","last_unstale":"2024-09-13T15:16:26.938178+0000","last_undegraded":"2024-09-13T15:16:26.938178+0000","last_fullsized":"2024-09-13T15:16:26.938178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:26.938077+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:26.938077+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.938077+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:49.727468+0000","scrub_duration":0.0024780219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'8","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.987208+0000","last_change":"2024-09-13T15:01:44.815867+0000","last_active":"2024-09-13T15:16:23.987208+0000","last_peered":"2024-09-13T15:16:23.987208+0000","last_clean":"2024-09-13T15:16:23.987208+0000","last_became_active":"2024-09-13T15:01:44.815116+0000","last_became_peered":"2024-09-13T15:01:44.815116+0000","last_unstale":"2024-09-13T15:16:23.987208+0000","last_undegraded":"2024-09-13T15:16:23.987208+0000","last_fullsized":"2024-09-13T15:16:23.987208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"33'6","reported_seq":34,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.795256+0000","last_change":"2024-09-13T15:01:44.850022+0000","last_active":"2024-09-13T15:16:23.795256+0000","last_peered":"2024-09-13T15:16:23.795256+0000","last_clean":"2024-09-13T15:16:23.795256+0000","last_became_active":"2024-09-13T15:01:44.849533+0000","last_became_peered":"2024-09-13T15:01:44.849533+0000","last_unstale":"2024-09-13T15:16:23.795256+0000","last_undegraded":"2024-09-13T15:16:23.795256+0000","last_fullsized":"2024-09-13T15:16:23.795256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"33'5","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.097761+0000","last_change":"2024-09-13T15:01:44.817139+0000","last_active":"2024-09-13T15:16:24.097761+0000","last_peered":"2024-09-13T15:16:24.097761+0000","last_clean":"2024-09-13T15:16:24.097761+0000","last_became_active":"2024-09-13T15:01:44.816416+0000","last_became_peered":"2024-09-13T15:01:44.816416+0000","last_unstale":"2024-09-13T15:16:24.097761+0000","last_undegraded":"2024-09-13T15:16:24.097761+0000","last_fullsized":"2024-09-13T15:16:24.097761+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"33'8","reported_seq":32,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.175972+0000","last_change":"2024-09-13T15:02:33.747735+0000","last_active":"2024-09-13T15:16:24.175972+0000","last_peered":"2024-09-13T15:16:24.175972+0000","last_clean":"2024-09-13T15:16:24.175972+0000","last_became_active":"2024-09-13T15:02:33.747405+0000","last_became_peered":"2024-09-13T15:02:33.747405+0000","last_unstale":"2024-09-13T15:16:24.175972+0000","last_undegraded":"2024-09-13T15:16:24.175972+0000","last_fullsized":"2024-09-13T15:16:24.175972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.891346+0000","last_change":"2024-09-13T15:16:19.392504+0000","last_active":"2024-09-13T15:16:23.891346+0000","last_peered":"2024-09-13T15:16:23.891346+0000","last_clean":"2024-09-13T15:16:23.891346+0000","last_became_active":"2024-09-13T15:01:44.807776+0000","last_became_peered":"2024-09-13T15:01:44.807776+0000","last_unstale":"2024-09-13T15:16:23.891346+0000","last_undegraded":"2024-09-13T15:16:23.891346+0000","last_fullsized":"2024-09-13T15:16:23.891346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T15:16:19.392397+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T15:16:19.392397+0000","last_clean_scrub_stamp":"2024-09-13T15:16:19.392397+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:54.356146+0000","scrub_duration":0.0023579180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"33'3","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:35.447363+0000","last_change":"2024-09-13T15:16:35.447440+0000","last_active":"2024-09-13T15:16:35.447363+0000","last_peered":"2024-09-13T15:16:35.447363+0000","last_clean":"2024-09-13T15:16:35.447363+0000","last_became_active":"2024-09-13T15:01:44.803977+0000","last_became_peered":"2024-09-13T15:01:44.803977+0000","last_unstale":"2024-09-13T15:16:35.447363+0000","last_undegraded":"2024-09-13T15:16:35.447363+0000","last_fullsized":"2024-09-13T15:16:35.447363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T15:16:35.447342+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T15:16:35.447342+0000","last_clean_scrub_stamp":"2024-09-13T15:16:35.447342+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:40.015172+0000","scrub_duration":0.001429317,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"33'12","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.007169+0000","last_change":"2024-09-13T15:01:44.824666+0000","last_active":"2024-09-13T15:16:24.007169+0000","last_peered":"2024-09-13T15:16:24.007169+0000","last_clean":"2024-09-13T15:16:24.007169+0000","last_became_active":"2024-09-13T15:01:44.815381+0000","last_became_peered":"2024-09-13T15:01:44.815381+0000","last_unstale":"2024-09-13T15:16:24.007169+0000","last_undegraded":"2024-09-13T15:16:24.007169+0000","last_fullsized":"2024-09-13T15:16:24.007169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2171149,"num_write_kb":31079058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149321,"ondisk_log_size":149321,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":615,"ondisk_log_size":615,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":108901497,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":501,"num_read_kb":110953,"num_write":3247,"num_write_kb":107181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":50628,"num_omap_keys":97,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":218046464,"data_stored":217802994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3329,"ondisk_log_size":3329,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542327,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":959312,"kb_used_data":46024,"kb_used_omap":1,"kb_used_meta":913278,"kb_avail":93412528,"statfs":{"total":96636764160,"available":95654428672,"internally_reserved":0,"allocated":47128576,"data_stored":46890816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":935197131},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":4.9580000000000002,"5min":7.657,"15min":4.8689999999999998},"min":{"1min":0.497,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":108.818,"5min":254.13499999999999,"15min":254.13499999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":5.016,"5min":7.7190000000000003,"15min":4.883},"min":{"1min":0.46100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":108.85299999999999,"5min":254.119,"15min":254.119},"last":0.91000000000000003}]},{"osd":1,"last update":"Fri Sep 13 15:16:00 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":14.494999999999999,"15min":8.6910000000000007},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.29999999999999999},"max":{"1min":4.3449999999999998,"5min":281.399,"15min":281.399},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.1379999999999999,"5min":12.275,"15min":9.9440000000000008},"min":{"1min":0.41099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.3120000000000003,"5min":265.74299999999999,"15min":557.92399999999998},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":5.1769999999999996,"5min":9.6869999999999994,"15min":5.5309999999999997},"min":{"1min":0.47099999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":119.023,"5min":280.29700000000003,"15min":280.29700000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":5.2130000000000001,"5min":9.0009999999999994,"15min":5.2590000000000003},"min":{"1min":0.48299999999999998,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":115.961,"5min":274.03500000000003,"15min":274.03500000000003},"last":0.95599999999999996}]},{"osd":3,"last update":"Fri Sep 13 15:16:03 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":10.202999999999999,"15min":6.407},"min":{"1min":0.377,"5min":0.377,"15min":0.32300000000000001},"max":{"1min":5.0300000000000002,"5min":261.36000000000001,"15min":261.36000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.94399999999999995,"5min":7.5250000000000004,"15min":5.0149999999999997},"min":{"1min":0.502,"5min":0.37,"15min":0.29599999999999999},"max":{"1min":5.2889999999999997,"5min":252.90000000000001,"15min":252.90000000000001},"last":0.81399999999999995}]},{"osd":4,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":2.141,"15min":1.3029999999999999},"min":{"1min":0.60199999999999998,"5min":0.248,"15min":0.23699999999999999},"max":{"1min":2.0089999999999999,"5min":20.928999999999998,"15min":20.928999999999998},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":2.2869999999999999,"15min":1.379},"min":{"1min":0.61199999999999999,"5min":0.254,"15min":0.24199999999999999},"max":{"1min":6.4589999999999996,"5min":20.893000000000001,"15min":20.893000000000001},"last":1.0069999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.123,"15min":1.093},"min":{"1min":0.30299999999999999,"5min":0.248,"15min":0.248},"max":{"1min":1.2869999999999999,"5min":11.800000000000001,"15min":11.800000000000001},"last":1.113},{"interface":"front","average":{"1min":1.02,"5min":1.0649999999999999,"15min":1.014},"min":{"1min":0.34100000000000003,"5min":0.252,"15min":0.252},"max":{"1min":2.625,"5min":8.593,"15min":8.593},"last":1.1439999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.988,"15min":1.377},"min":{"1min":0.42899999999999999,"5min":0.29699999999999999,"15min":0.27700000000000002},"max":{"1min":2.677,"5min":20.835000000000001,"15min":20.835000000000001},"last":1.228},{"interface":"front","average":{"1min":1.177,"5min":1.716,"15min":1.244},"min":{"1min":0.53900000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":4.9550000000000001,"5min":21.518000000000001,"15min":21.518000000000001},"last":1.0860000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542328,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1195488,"kb_used_data":28824,"kb_used_omap":1,"kb_used_meta":1166654,"kb_avail":93176352,"statfs":{"total":96636764160,"available":95412584448,"internally_reserved":0,"allocated":29515776,"data_stored":29292897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1194654151},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":11.609999999999999,"15min":5.5949999999999998},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":9.6809999999999992,"5min":343.02800000000002,"15min":343.02800000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.325,"5min":11.821999999999999,"15min":5.4180000000000001},"min":{"1min":0.45900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":9.5060000000000002,"5min":370.00099999999998,"15min":370.00099999999998},"last":0.90400000000000003}]},{"osd":1,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":11.769,"15min":6.1059999999999999},"min":{"1min":0.46600000000000003,"5min":0.317,"15min":0.26900000000000002},"max":{"1min":9.6489999999999991,"5min":236.12100000000001,"15min":236.12100000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":1.4990000000000001,"5min":13.35,"15min":7.2480000000000002},"min":{"1min":0.52300000000000002,"5min":0.35099999999999998,"15min":0.32300000000000001},"max":{"1min":9.5340000000000007,"5min":274.46800000000002,"15min":274.46800000000002},"last":0.747}]},{"osd":2,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":5.9189999999999996,"15min":3.6299999999999999},"min":{"1min":0.38600000000000001,"5min":0.33800000000000002,"15min":0.311},"max":{"1min":9.7539999999999996,"5min":249.75700000000001,"15min":249.75700000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.2470000000000001,"5min":7.0469999999999997,"15min":4.0259999999999998},"min":{"1min":0.47799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":9.5649999999999995,"5min":283.36700000000002,"15min":283.36700000000002},"last":1.0069999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":7.6120000000000001,"15min":4.4770000000000003},"min":{"1min":0.54200000000000004,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":9.5920000000000005,"5min":239.05099999999999,"15min":239.05099999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.4039999999999999,"5min":13.24,"15min":6.3559999999999999},"min":{"1min":0.58799999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":9.6180000000000003,"5min":352.03800000000001,"15min":352.03800000000001},"last":0.875}]},{"osd":4,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":3.827,"15min":2.1779999999999999},"min":{"1min":0.46000000000000002,"5min":0.25700000000000001,"15min":0.23300000000000001},"max":{"1min":1.0820000000000001,"5min":37.261000000000003,"15min":91.054000000000002},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.93700000000000006,"5min":3.8769999999999998,"15min":2.2330000000000001},"min":{"1min":0.42099999999999999,"5min":0.312,"15min":0.254},"max":{"1min":1.323,"5min":52.167000000000002,"15min":99.084000000000003},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.3680000000000001,"15min":1.032},"min":{"1min":0.41399999999999998,"5min":0.28699999999999998,"15min":0.253},"max":{"1min":1.2929999999999999,"5min":15.196,"15min":15.196},"last":1.04},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.6859999999999999,"15min":1.1870000000000001},"min":{"1min":0.49199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.389,"5min":25.192,"15min":25.192},"last":1.1799999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":1.8420000000000001,"15min":1.306},"min":{"1min":0.49099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1599999999999999,"5min":37.219999999999999,"15min":37.219999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.379,"15min":1.123},"min":{"1min":0.57299999999999995,"5min":0.308,"15min":0.308},"max":{"1min":1.28,"5min":14.654,"15min":14.654},"last":1.0700000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542327,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":871448,"kb_used_data":20880,"kb_used_omap":1,"kb_used_meta":850558,"kb_avail":93500392,"statfs":{"total":96636764160,"available":95744401408,"internally_reserved":0,"allocated":21381120,"data_stored":21136948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":870971846},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":3.613,"15min":2.6589999999999998},"min":{"1min":0.27600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0109999999999999,"5min":70.611000000000004,"15min":94.078999999999994},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":3.3210000000000002,"15min":2.0489999999999999},"min":{"1min":0.60099999999999998,"5min":0.27800000000000002,"15min":0.27000000000000002},"max":{"1min":1.681,"5min":76.866,"15min":76.866},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":5.2690000000000001,"15min":4.3250000000000002},"min":{"1min":0.66500000000000004,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.708,"5min":214.21199999999999,"15min":214.21199999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":4.6760000000000002,"15min":6.625},"min":{"1min":0.57999999999999996,"5min":0.317,"15min":0.317},"max":{"1min":1.6559999999999999,"5min":206.20699999999999,"15min":559.69500000000005},"last":0.90600000000000003}]},{"osd":2,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":3.3490000000000002,"15min":2.3210000000000002},"min":{"1min":0.64200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.375,"5min":67.366,"15min":67.366},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.0209999999999999,"5min":2.8820000000000001,"15min":2.0659999999999998},"min":{"1min":0.67100000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.462,"5min":65.522000000000006,"15min":65.522000000000006},"last":0.76200000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":5.0529999999999999,"15min":3.1219999999999999},"min":{"1min":0.59799999999999998,"5min":0.40300000000000002,"15min":0.37},"max":{"1min":1.4350000000000001,"5min":169.30600000000001,"15min":169.30600000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.091,"5min":6.7750000000000004,"15min":4.1289999999999996},"min":{"1min":0.70199999999999996,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.736,"5min":169.33799999999999,"15min":169.33799999999999},"last":0.997}]},{"osd":4,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":2.4340000000000002,"15min":1.4059999999999999},"min":{"1min":0.34899999999999998,"5min":0.26100000000000001,"15min":0.223},"max":{"1min":1.6200000000000001,"5min":36.151000000000003,"15min":36.151000000000003},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.125,"5min":2.581,"15min":1.482},"min":{"1min":0.44900000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":1.6539999999999999,"5min":36.219000000000001,"15min":36.219000000000001},"last":1.046}]},{"osd":6,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.7310000000000001,"15min":1.2170000000000001},"min":{"1min":0.39900000000000002,"5min":0.27300000000000002,"15min":0.25600000000000001},"max":{"1min":1.8500000000000001,"5min":25.734000000000002,"15min":25.734000000000002},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.5489999999999999,"15min":1.169},"min":{"1min":0.54600000000000004,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.6140000000000001,"5min":29.106999999999999,"15min":29.106999999999999},"last":1.135}]},{"osd":7,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.014,"15min":0.98199999999999998},"min":{"1min":0.497,"5min":0.314,"15min":0.314},"max":{"1min":1.6359999999999999,"5min":10.798,"15min":10.798},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.1559999999999999,"15min":1.0589999999999999},"min":{"1min":0.51900000000000002,"5min":0.314,"15min":0.29699999999999999},"max":{"1min":1.718,"5min":12.874000000000001,"15min":12.874000000000001},"last":1.155}]}]},{"osd":4,"up_from":14,"seq":60129542326,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1128128,"kb_used_data":41336,"kb_used_omap":1,"kb_used_meta":1086782,"kb_avail":93243712,"statfs":{"total":96636764160,"available":95481561088,"internally_reserved":0,"allocated":42328064,"data_stored":42105374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1112865222},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":2.6800000000000002,"15min":1.6659999999999999},"min":{"1min":0.47099999999999997,"5min":0.28299999999999997,"15min":0.27100000000000002},"max":{"1min":1,"5min":18.741,"15min":18.741},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.86699999999999999,"5min":3.1909999999999998,"15min":1.964},"min":{"1min":0.316,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":4.2850000000000001,"5min":27.876999999999999,"15min":27.876999999999999},"last":0.81200000000000006}]},{"osd":1,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":15.648999999999999,"15min":6.7729999999999997},"min":{"1min":0.47299999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0089999999999999,"5min":1296.6300000000001,"15min":1296.6300000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.75,"5min":3.3599999999999999,"15min":2.6190000000000002},"min":{"1min":0.45400000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.109,"5min":25.800999999999998,"15min":47.923999999999999},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":2.8319999999999999,"15min":1.8480000000000001},"min":{"1min":0.55300000000000005,"5min":0.309,"15min":0.29999999999999999},"max":{"1min":4.8799999999999999,"5min":23.760999999999999,"15min":23.760999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.94299999999999995,"5min":2.746,"15min":1.899},"min":{"1min":0.40000000000000002,"5min":0.34000000000000002,"15min":0.32500000000000001},"max":{"1min":3.2839999999999998,"5min":23.709,"15min":30.510000000000002},"last":1.0649999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":4.9370000000000003,"15min":2.9359999999999999},"min":{"1min":0.48099999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.6360000000000001,"5min":94.281000000000006,"15min":94.281000000000006},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.232,"5min":4.9859999999999998,"15min":3.2210000000000001},"min":{"1min":0.72699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.6699999999999999,"5min":94.319999999999993,"15min":94.319999999999993},"last":1.038}]},{"osd":5,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.5249999999999999,"15min":1.1599999999999999},"min":{"1min":0.86699999999999999,"5min":0.245,"15min":0.245},"max":{"1min":2.9249999999999998,"5min":18.623999999999999,"15min":18.623999999999999},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.4630000000000001,"15min":1.1319999999999999},"min":{"1min":0.72099999999999997,"5min":0.246,"15min":0.246},"max":{"1min":4.2469999999999999,"5min":16.155999999999999,"15min":16.155999999999999},"last":0.86899999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":2.2090000000000001,"15min":1.462},"min":{"1min":0.42999999999999999,"5min":0.27000000000000002,"15min":0.24099999999999999},"max":{"1min":1.226,"5min":27.984000000000002,"15min":27.984000000000002},"last":0.754},{"interface":"front","average":{"1min":1.052,"5min":2.1019999999999999,"15min":1.367},"min":{"1min":0.33700000000000002,"5min":0.247,"15min":0.23799999999999999},"max":{"1min":3.21,"5min":28.077000000000002,"15min":28.077000000000002},"last":0.98999999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.9830000000000001,"15min":1.375},"min":{"1min":0.38300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.948,"5min":25.266999999999999,"15min":25.266999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.1519999999999999,"5min":2.0800000000000001,"15min":1.4770000000000001},"min":{"1min":0.41399999999999998,"5min":0.34300000000000003,"15min":0.32600000000000001},"max":{"1min":2.0289999999999999,"5min":25.309999999999999,"15min":25.309999999999999},"last":1.1830000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542320,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1547308,"kb_used_data":24804,"kb_used_omap":1,"kb_used_meta":1522494,"kb_avail":92824532,"statfs":{"total":96636764160,"available":95052320768,"internally_reserved":0,"allocated":25399296,"data_stored":25168927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1559034312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":8.9239999999999995,"15min":6.4690000000000003},"min":{"1min":0.29199999999999998,"5min":0.28000000000000003,"15min":0.253},"max":{"1min":2.6190000000000002,"5min":108.956,"15min":170.35599999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":5.8860000000000001,"15min":4.5140000000000002},"min":{"1min":0.309,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.6659999999999999,"5min":63.624000000000002,"15min":168.80699999999999},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":8.8640000000000008,"15min":4.6429999999999998},"min":{"1min":0.378,"5min":0.32500000000000001,"15min":0.28499999999999998},"max":{"1min":2.3460000000000001,"5min":92.722999999999999,"15min":92.722999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":10.815,"15min":6.258},"min":{"1min":0.31,"5min":0.29899999999999999,"15min":0.26600000000000001},"max":{"1min":1.756,"5min":89.245000000000005,"15min":104.51300000000001},"last":0.38500000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":6.1130000000000004,"15min":3.8919999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.149,"5min":74.825000000000003,"15min":74.825000000000003},"last":0.432},{"interface":"front","average":{"1min":0.79300000000000004,"5min":6.3570000000000002,"15min":3.8730000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.36499999999999999},"max":{"1min":2.2029999999999998,"5min":74.870999999999995,"15min":74.870999999999995},"last":0.495}]},{"osd":4,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":5.7009999999999996,"15min":3.056},"min":{"1min":0.46400000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.3849999999999998,"5min":85.710999999999999,"15min":85.710999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.99299999999999999,"5min":7.335,"15min":3.948},"min":{"1min":0.499,"5min":0.443,"15min":0.377},"max":{"1min":2.177,"5min":105.875,"15min":105.875},"last":0.86199999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":5.8570000000000002,"15min":3.379},"min":{"1min":0.61799999999999999,"5min":0.46700000000000003,"15min":0.40400000000000003},"max":{"1min":4.7380000000000004,"5min":95.748999999999995,"15min":95.748999999999995},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":7.4969999999999999,"15min":4.3460000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":8.7870000000000008,"5min":100.325,"15min":100.325},"last":0.76500000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":4.7149999999999999,"15min":2.7639999999999998},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":4.7050000000000001,"5min":85.492999999999995,"15min":85.492999999999995},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.3160000000000001,"5min":5.9450000000000003,"15min":3.2440000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.501},"max":{"1min":4.75,"5min":100.376,"15min":100.376},"last":0.79100000000000004}]},{"osd":7,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":5.4859999999999998,"15min":3.085},"min":{"1min":0.57499999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.7509999999999999,"5min":97.268000000000001,"15min":97.268000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.83499999999999996,"5min":5.8440000000000003,"15min":3.5470000000000002},"min":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.48599999999999999},"max":{"1min":1.9870000000000001,"5min":100.583,"15min":100.583},"last":0.66100000000000003}]}]},{"osd":2,"up_from":14,"seq":60129542327,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":814544,"kb_used_data":4552,"kb_used_omap":1,"kb_used_meta":809982,"kb_avail":93557296,"statfs":{"total":96636764160,"available":95802671104,"internally_reserved":0,"allocated":4661248,"data_stored":4427070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":829422022},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":7.1529999999999996,"15min":3.738},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.249},"max":{"1min":0.68899999999999995,"5min":170.77199999999999,"15min":170.77199999999999},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.48599999999999999,"5min":11.09,"15min":5.3769999999999998},"min":{"1min":0.316,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78100000000000003,"5min":237.53800000000001,"15min":237.53800000000001},"last":0.436}]},{"osd":1,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":5.7750000000000004,"15min":3.7890000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28899999999999998},"max":{"1min":0.67400000000000004,"5min":109.104,"15min":109.104},"last":0.308},{"interface":"front","average":{"1min":0.502,"5min":12.032,"15min":5.8540000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.30499999999999999},"max":{"1min":0.72499999999999998,"5min":295.73500000000001,"15min":295.73500000000001},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":5.1139999999999999,"15min":3.7080000000000002},"min":{"1min":0.35999999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73299999999999998,"5min":109.152,"15min":109.152},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.46800000000000003,"5min":7.391,"15min":4.8259999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66600000000000004,"5min":264.87599999999998,"15min":264.87599999999998},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":6.5869999999999997,"15min":3.8879999999999999},"min":{"1min":0.56699999999999995,"5min":0.41599999999999998,"15min":0.38100000000000001},"max":{"1min":0.97499999999999998,"5min":251.97300000000001,"15min":251.97300000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":4.2599999999999998,"15min":2.5590000000000002},"min":{"1min":0.59199999999999997,"5min":0.42099999999999999,"15min":0.34899999999999998},"max":{"1min":1.081,"5min":42.012,"15min":42.012},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":3.3980000000000001,"15min":2.508},"min":{"1min":0.67100000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.163,"5min":41.942999999999998,"15min":41.942999999999998},"last":0.745},{"interface":"front","average":{"1min":0.878,"5min":6.3769999999999998,"15min":3.4990000000000001},"min":{"1min":0.71999999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.135,"5min":237.58799999999999,"15min":237.58799999999999},"last":0.77500000000000002}]},{"osd":6,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":3.419,"15min":2.4430000000000001},"min":{"1min":0.64300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.127,"5min":41.981999999999999,"15min":41.981999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":3.6709999999999998,"15min":2.556},"min":{"1min":0.66100000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.177,"5min":41.890999999999998,"15min":41.890999999999998},"last":0.80400000000000005}]},{"osd":7,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":5.8559999999999999,"15min":3.403},"min":{"1min":0.627,"5min":0.44,"15min":0.44},"max":{"1min":0.98899999999999999,"5min":237.626,"15min":237.626},"last":0.62},{"interface":"front","average":{"1min":0.755,"5min":6.157,"15min":3.2559999999999998},"min":{"1min":0.52900000000000003,"5min":0.432,"15min":0.39200000000000002},"max":{"1min":1.0640000000000001,"5min":252.005,"15min":252.005},"last":0.71999999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542321,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1493764,"kb_used_data":24956,"kb_used_omap":1,"kb_used_meta":1468798,"kb_avail":92878076,"statfs":{"total":96636764160,"available":95107149824,"internally_reserved":0,"allocated":25554944,"data_stored":25328384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1504049606},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":5.8120000000000003,"15min":4.1059999999999999},"min":{"1min":0.27400000000000002,"5min":0.23799999999999999,"15min":0.22500000000000001},"max":{"1min":4.843,"5min":104.246,"15min":104.246},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":6.8700000000000001,"15min":4.0330000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":2.093,"5min":103.157,"15min":103.157},"last":0.36199999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":7.484,"15min":5.1639999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":19.100000000000001,"5min":113.79600000000001,"15min":191.00899999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":1.667,"5min":5.1849999999999996,"15min":3.4020000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.318},"max":{"1min":19.143999999999998,"5min":30.704999999999998,"15min":47.537999999999997},"last":0.42999999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":6.9560000000000004,"15min":4.0339999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":19.419,"5min":52.975000000000001,"15min":52.975000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":1.778,"5min":7.4269999999999996,"15min":3.992},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":19.202999999999999,"5min":104.319,"15min":104.319},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":5.032,"15min":3.9329999999999998},"min":{"1min":0.47099999999999997,"5min":0.45400000000000001,"15min":0.38700000000000001},"max":{"1min":1.738,"5min":41.862000000000002,"15min":125.44799999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.8069999999999999,"5min":6.9349999999999996,"15min":4.2110000000000003},"min":{"1min":0.52100000000000002,"5min":0.47399999999999998,"15min":0.38800000000000001},"max":{"1min":19.291,"5min":102.962,"15min":117.842},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":4.9829999999999997,"15min":3.944},"min":{"1min":0.59399999999999997,"5min":0.436,"15min":0.40000000000000002},"max":{"1min":1.8029999999999999,"5min":104.19,"15min":154.875},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.93300000000000005,"5min":5.2560000000000002,"15min":4.0609999999999999},"min":{"1min":0.46200000000000002,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":3.5470000000000002,"5min":45.369999999999997,"15min":126.485},"last":0.72199999999999998}]},{"osd":6,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":5.633,"15min":3.609},"min":{"1min":0.54100000000000004,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.825,"5min":103.191,"15min":103.191},"last":0.872},{"interface":"front","average":{"1min":0.85399999999999998,"5min":5.0759999999999996,"15min":3.1739999999999999},"min":{"1min":0.60999999999999999,"5min":0.55000000000000004,"15min":0.42399999999999999},"max":{"1min":1.774,"5min":104.28400000000001,"15min":104.28400000000001},"last":0.92900000000000005}]},{"osd":7,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":4.9619999999999997,"15min":3.5329999999999999},"min":{"1min":0.54400000000000004,"5min":0.53700000000000003,"15min":0.438},"max":{"1min":3.5939999999999999,"5min":45.472999999999999,"15min":77.366},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":5.548,"15min":3.8479999999999999},"min":{"1min":0.60499999999999998,"5min":0.443,"15min":0.443},"max":{"1min":1.857,"5min":112.69499999999999,"15min":112.69499999999999},"last":0.81799999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542325,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":970504,"kb_used_data":25536,"kb_used_omap":1,"kb_used_meta":944958,"kb_avail":93401336,"statfs":{"total":96636764160,"available":95642968064,"internally_reserved":0,"allocated":26148864,"data_stored":25917602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":967637446},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":4.5049999999999999,"15min":4.3040000000000003},"min":{"1min":0.25,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.71799999999999997,"5min":43.508000000000003,"15min":279.90600000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":5.3109999999999999,"15min":6.2300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.28100000000000003},"max":{"1min":1.595,"5min":58.280000000000001,"15min":510.15699999999998},"last":0.495}]},{"osd":2,"last update":"Fri Sep 13 15:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":6.4219999999999997,"15min":3.3039999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26000000000000001},"max":{"1min":0.92200000000000004,"5min":101.73399999999999,"15min":101.73399999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":4.4029999999999996,"15min":2.738},"min":{"1min":0.40999999999999998,"5min":0.39400000000000002,"15min":0.34200000000000003},"max":{"1min":1.55,"5min":35.527999999999999,"15min":35.527999999999999},"last":0.46700000000000003}]},{"osd":3,"last update":"Fri Sep 13 15:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":7.8099999999999996,"15min":4.6559999999999997},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.28699999999999998},"max":{"1min":3.4630000000000001,"5min":101.76300000000001,"15min":101.76300000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":6.3259999999999996,"15min":4.3860000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.7090000000000001,"5min":75.828000000000003,"15min":75.828000000000003},"last":0.66800000000000004}]},{"osd":4,"last update":"Fri Sep 13 15:16:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":4.556,"15min":2.7400000000000002},"min":{"1min":0.51900000000000002,"5min":0.495,"15min":0.34200000000000003},"max":{"1min":5.1379999999999999,"5min":30.207999999999998,"15min":30.207999999999998},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.3600000000000001,"5min":4.0010000000000003,"15min":2.5550000000000002},"min":{"1min":0.55500000000000005,"5min":0.46999999999999997,"15min":0.38500000000000001},"max":{"1min":6.859,"5min":30.135000000000002,"15min":30.135000000000002},"last":0.86799999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:16:16 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":5.3230000000000004,"15min":2.8719999999999999},"min":{"1min":0.626,"5min":0.46600000000000003,"15min":0.377},"max":{"1min":6.5609999999999999,"5min":101.702,"15min":101.702},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.2190000000000001,"5min":3.593,"15min":2.3140000000000001},"min":{"1min":0.59599999999999997,"5min":0.434,"15min":0.379},"max":{"1min":7.1820000000000004,"5min":43.249000000000002,"15min":43.249000000000002},"last":0.70899999999999996}]},{"osd":6,"last update":"Fri Sep 13 15:16:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":4.4279999999999999,"15min":2.649},"min":{"1min":0.58599999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.0170000000000003,"5min":45.140000000000001,"15min":45.140000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.92200000000000004,"5min":4.4870000000000001,"15min":2.742},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.50600000000000001},"max":{"1min":1.484,"5min":44.737000000000002,"15min":44.737000000000002},"last":0.89200000000000002}]},{"osd":7,"last update":"Fri Sep 13 15:16:08 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":5.5979999999999999,"15min":3.0030000000000001},"min":{"1min":0.61799999999999999,"5min":0.44700000000000001,"15min":0.42499999999999999},"max":{"1min":4.8049999999999997,"5min":101.655,"15min":101.655},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.2649999999999999,"5min":4.1820000000000004,"15min":2.6309999999999998},"min":{"1min":0.68100000000000005,"5min":0.51500000000000001,"15min":0.434},"max":{"1min":6.8120000000000003,"5min":46.649000000000001,"15min":46.649000000000001},"last":0.69399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25194496,"data_stored":25166698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25194496,"data_stored":25167848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4300800,"data_stored":4266534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25038848,"data_stored":25008391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41967616,"data_stored":41944838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21020672,"data_stored":20976412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29155328,"data_stored":29132361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":46174208,"data_stored":46139912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:16:43.297 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.298 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.298 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.298 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.298 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.298 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.298 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.298 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.298 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.298 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.298 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.299 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.299 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.299 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.299 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.299 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.299 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.299 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.300 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.300 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.300 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.300 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T15:01:43.358710+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=43, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.300 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.300 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.301 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.301 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.301 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.301 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.301 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.301 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.301 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.301 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.302 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.302 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.302 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.302 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.302 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.302 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.302 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.303 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.303 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.303 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.303 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.303 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.303 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.303 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.304 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.304 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.304 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.304 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.304 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.304 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.304 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.304 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.305 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.305 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.305 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.305 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.305 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.305 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.305 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.305 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.306 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.306 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.306 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.306 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.306 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.306 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:16:43.306 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T15:17:03.308 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:17:03.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5bef600640 1 Processor -- start 2024-09-13T15:17:03.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5bef600640 1 -- start start 2024-09-13T15:17:03.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5bef600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be80c5e90 0x7f5be815cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:03.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5bef600640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be80c8380 con 0x7f5be815d180 2024-09-13T15:17:03.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5bef600640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be806cce0 con 0x7f5be80c5ab0 2024-09-13T15:17:03.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5bef600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be815d610 con 0x7f5be80c5e90 2024-09-13T15:17:03.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5bed600640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5be815d180 0x7f5be80c6360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:44642/0 (socket says 172.21.15.7:44642) 2024-09-13T15:17:03.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5bed600640 1 -- 172.21.15.7:0/950946772 learned_addr learned my addr 172.21.15.7:0/950946772 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:17:03.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7e00640 1 --2- 172.21.15.7:0/950946772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be80c5e90 0x7f5be815cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:03.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7400640 1 -- 172.21.15.7:0/950946772 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3655439818 0 0) 0x7f5be00014a0 con 0x7f5be815d180 2024-09-13T15:17:03.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7400640 1 -- 172.21.15.7:0/950946772 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bd0003530 con 0x7f5be815d180 2024-09-13T15:17:03.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7400640 1 -- 172.21.15.7:0/950946772 <== mon.1 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21777834 0 0) 0x7f5be806cce0 con 0x7f5be80c5ab0 2024-09-13T15:17:03.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7400640 1 -- 172.21.15.7:0/950946772 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5be00014a0 con 0x7f5be80c5ab0 2024-09-13T15:17:03.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7400640 1 -- 172.21.15.7:0/950946772 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3069554537 0 0) 0x7f5bd0003530 con 0x7f5be815d180 2024-09-13T15:17:03.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7400640 1 -- 172.21.15.7:0/950946772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be80c5e90 msgr2=0x7f5be815cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:17:03.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7400640 1 --2- 172.21.15.7:0/950946772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be80c5e90 0x7f5be815cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:03.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7400640 1 -- 172.21.15.7:0/950946772 >> v1:172.21.15.77:6789/0 conn(0x7f5be80c5ab0 legacy=0x7f5be8153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:03.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7400640 1 -- 172.21.15.7:0/950946772 --> v1:172.21.15.7:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be806cf30 con 0x7f5be815d180 2024-09-13T15:17:03.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7400640 1 -- 172.21.15.7:0/950946772 <== mon.0 v1:172.21.15.7:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 237469550 0 0) 0x7f5be0001b90 con 0x7f5be815d180 2024-09-13T15:17:03.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7400640 1 -- 172.21.15.7:0/950946772 >> v1:172.21.15.7:6789/0 conn(0x7f5be815d180 legacy=0x7f5be80c6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:03.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7400640 1 --2- 172.21.15.7:0/950946772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be80c5e90 0x7f5bd0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:03.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7400640 1 --2- 172.21.15.7:0/950946772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd00040a0 0x7f5bd00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:03.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7400640 1 --2- 172.21.15.7:0/950946772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bd0004d10 0x7f5bd0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:03.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7400640 1 -- 172.21.15.7:0/950946772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be815d610 con 0x7f5bd0004d10 2024-09-13T15:17:03.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7400640 1 -- 172.21.15.7:0/950946772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd000ba70 con 0x7f5bd00040a0 2024-09-13T15:17:03.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7400640 1 -- 172.21.15.7:0/950946772 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd000bc30 con 0x7f5be80c5e90 2024-09-13T15:17:03.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5bed600640 1 --2- 172.21.15.7:0/950946772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bd0004d10 0x7f5bd0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:03.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5becc00640 1 --2- 172.21.15.7:0/950946772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be80c5e90 0x7f5bd0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:03.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.452+0000 7f5be7e00640 1 --2- 172.21.15.7:0/950946772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd00040a0 0x7f5bd00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:03.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.456+0000 7f5bed600640 1 -- 172.21.15.7:0/950946772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be80c5e90 msgr2=0x7f5bd0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:17:03.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.456+0000 7f5bed600640 1 --2- 172.21.15.7:0/950946772 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5be80c5e90 0x7f5bd0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:03.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.456+0000 7f5bed600640 1 -- 172.21.15.7:0/950946772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd00040a0 msgr2=0x7f5bd00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:17:03.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.456+0000 7f5bed600640 1 --2- 172.21.15.7:0/950946772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bd00040a0 0x7f5bd00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:03.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.456+0000 7f5bed600640 1 -- 172.21.15.7:0/950946772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd0003530 con 0x7f5bd0004d10 2024-09-13T15:17:03.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.456+0000 7f5bed600640 1 --2- 172.21.15.7:0/950946772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bd0004d10 0x7f5bd0005190 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5be000a790 tx=0x7f5be001fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23a91e8bd9cd72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:03.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.456+0000 7f5be7400640 1 -- 172.21.15.7:0/950946772 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be00aa650 con 0x7f5bd0004d10 2024-09-13T15:17:03.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.456+0000 7f5be7400640 1 -- 172.21.15.7:0/950946772 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be00aa7d0 con 0x7f5bd0004d10 2024-09-13T15:17:03.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.456+0000 7f5be7400640 1 -- 172.21.15.7:0/950946772 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be00aabc0 con 0x7f5bd0004d10 2024-09-13T15:17:03.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.456+0000 7f5bef600640 1 -- 172.21.15.7:0/950946772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bd0004d10 msgr2=0x7f5bd0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:03.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.456+0000 7f5bef600640 1 --2- 172.21.15.7:0/950946772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bd0004d10 0x7f5bd0005190 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5be000a790 tx=0x7f5be001fa20 comp rx=0 tx=0).stop 2024-09-13T15:17:03.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.456+0000 7f5bed600640 1 -- 172.21.15.7:0/950946772 reap_dead start 2024-09-13T15:17:03.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.460+0000 7f5bef600640 1 -- 172.21.15.7:0/950946772 shutdown_connections 2024-09-13T15:17:03.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.460+0000 7f5bef600640 1 -- 172.21.15.7:0/950946772 >> 172.21.15.7:0/950946772 conn(0x7f5be8065d40 msgr2=0x7f5be8066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:03.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.460+0000 7f5bef600640 1 -- 172.21.15.7:0/950946772 shutdown_connections 2024-09-13T15:17:03.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.460+0000 7f5bef600640 1 -- 172.21.15.7:0/950946772 wait complete. 2024-09-13T15:17:03.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.460+0000 7f5bef600640 1 Processor -- start 2024-09-13T15:17:03.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.460+0000 7f5bef600640 1 -- start start 2024-09-13T15:17:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bef600640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd0004d10 0x7f5be8141d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bef600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5be80ca610 0x7f5be80718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:03.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bef600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be80c9e60 0x7f5be813f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:03.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bef600640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be8141a70 con 0x7f5be80c9e60 2024-09-13T15:17:03.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bef600640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be815c4f0 con 0x7f5be80ca610 2024-09-13T15:17:03.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bef600640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be81f27d0 con 0x7f5bd0004d10 2024-09-13T15:17:03.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bed600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be80c9e60 0x7f5be813f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:03.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bed600640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be80c9e60 0x7f5be813f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35218/0 (socket says 172.21.15.7:35218) 2024-09-13T15:17:03.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bed600640 1 -- 172.21.15.7:0/1103280184 learned_addr learned my addr 172.21.15.7:0/1103280184 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:03.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5be7e00640 1 --2- 172.21.15.7:0/1103280184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5be80ca610 0x7f5be80718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:03.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5becc00640 1 --2- 172.21.15.7:0/1103280184 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd0004d10 0x7f5be8141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:03.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bed600640 1 -- 172.21.15.7:0/1103280184 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd0004d10 msgr2=0x7f5be8141d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:03.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bed600640 1 --2- 172.21.15.7:0/1103280184 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd0004d10 0x7f5be8141d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:03.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bed600640 1 -- 172.21.15.7:0/1103280184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5be80ca610 msgr2=0x7f5be80718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:03.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bed600640 1 --2- 172.21.15.7:0/1103280184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5be80ca610 0x7f5be80718f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bed600640 1 -- 172.21.15.7:0/1103280184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be815bf30 con 0x7f5be80c9e60 2024-09-13T15:17:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bed600640 1 --2- 172.21.15.7:0/1103280184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be80c9e60 0x7f5be813f220 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5be0005c30 tx=0x7f5be001c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5be4c00640 1 -- 172.21.15.7:0/1103280184 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be0001b90 con 0x7f5be80c9e60 2024-09-13T15:17:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5be4c00640 1 -- 172.21.15.7:0/1103280184 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be00011d0 con 0x7f5be80c9e60 2024-09-13T15:17:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bef600640 1 -- 172.21.15.7:0/1103280184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be815c210 con 0x7f5be80c9e60 2024-09-13T15:17:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5be4c00640 1 -- 172.21.15.7:0/1103280184 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be00aa650 con 0x7f5be80c9e60 2024-09-13T15:17:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bef600640 1 -- 172.21.15.7:0/1103280184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be814b390 con 0x7f5be80c9e60 2024-09-13T15:17:03.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.464+0000 7f5bef600640 1 -- 172.21.15.7:0/1103280184 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be8067650 con 0x7f5be80c9e60 2024-09-13T15:17:03.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.468+0000 7f5be4c00640 1 -- 172.21.15.7:0/1103280184 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5be00070e0 con 0x7f5be80c9e60 2024-09-13T15:17:03.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.468+0000 7f5be4c00640 1 --2- 172.21.15.7:0/1103280184 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5bc80666c0 0x7f5bc8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:03.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.468+0000 7f5be4c00640 1 -- 172.21.15.7:0/1103280184 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f5be0121ff0 con 0x7f5be80c9e60 2024-09-13T15:17:03.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.468+0000 7f5becc00640 1 --2- 172.21.15.7:0/1103280184 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5bc80666c0 0x7f5bc8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:03.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.468+0000 7f5becc00640 1 --2- 172.21.15.7:0/1103280184 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5bc80666c0 0x7f5bc8068b80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc007fd0 tx=0x7f5bdc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:03.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.472+0000 7f5be4c00640 1 -- 172.21.15.7:0/1103280184 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5be00eee00 con 0x7f5be80c9e60 2024-09-13T15:17:03.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.652+0000 7f5bef600640 1 -- 172.21.15.7:0/1103280184 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5be8141a70 con 0x7f5bc80666c0 2024-09-13T15:17:03.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.680+0000 7f5be4c00640 1 -- 172.21.15.7:0/1103280184 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+371835 (secure 0 0 0) 0x7f5be8141a70 con 0x7f5bc80666c0 2024-09-13T15:17:03.685 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:17:03.687 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T15:17:03.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.684+0000 7f5bef600640 1 -- 172.21.15.7:0/1103280184 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5bc80666c0 msgr2=0x7f5bc8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:03.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.684+0000 7f5bef600640 1 --2- 172.21.15.7:0/1103280184 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5bc80666c0 0x7f5bc8068b80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc007fd0 tx=0x7f5bdc009040 comp rx=0 tx=0).stop 2024-09-13T15:17:03.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.684+0000 7f5bef600640 1 -- 172.21.15.7:0/1103280184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be80c9e60 msgr2=0x7f5be813f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:03.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.684+0000 7f5bef600640 1 --2- 172.21.15.7:0/1103280184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be80c9e60 0x7f5be813f220 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5be0005c30 tx=0x7f5be001c7c0 comp rx=0 tx=0).stop 2024-09-13T15:17:03.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.684+0000 7f5bef600640 1 -- 172.21.15.7:0/1103280184 shutdown_connections 2024-09-13T15:17:03.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.684+0000 7f5bef600640 1 --2- 172.21.15.7:0/1103280184 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5bc80666c0 0x7f5bc8068b80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:03.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.684+0000 7f5bef600640 1 --2- 172.21.15.7:0/1103280184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5be80c9e60 0x7f5be813f220 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:03.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.684+0000 7f5bef600640 1 --2- 172.21.15.7:0/1103280184 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5be80ca610 0x7f5be80718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:03.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.684+0000 7f5bef600640 1 --2- 172.21.15.7:0/1103280184 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5bd0004d10 0x7f5be8141d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:03.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.684+0000 7f5bef600640 1 -- 172.21.15.7:0/1103280184 >> 172.21.15.7:0/1103280184 conn(0x7f5be8065d40 msgr2=0x7f5be80c62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:03.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.684+0000 7f5bef600640 1 -- 172.21.15.7:0/1103280184 shutdown_connections 2024-09-13T15:17:03.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:03.684+0000 7f5bef600640 1 -- 172.21.15.7:0/1103280184 wait complete. 2024-09-13T15:17:03.708 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":488,"stamp":"2024-09-13T15:17:02.973504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":109491865,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":617,"num_read_kb":111053,"num_write":2174555,"num_write_kb":31188655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":55628,"num_omap_keys":107,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153407,"ondisk_log_size":153407,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8980496,"kb_used_data":216912,"kb_used_omap":12,"kb_used_meta":8763507,"kb_avail":745994224,"statfs":{"total":773094113280,"available":763898085376,"internally_reserved":0,"allocated":222117888,"data_stored":220268018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":8973831736},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005533"},"pg_stats":[{"pgid":"2.1f","version":"33'47","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.748758+0000","last_change":"2024-09-13T15:16:21.447074+0000","last_active":"2024-09-13T15:16:23.748758+0000","last_peered":"2024-09-13T15:16:23.748758+0000","last_clean":"2024-09-13T15:16:23.748758+0000","last_became_active":"2024-09-13T15:01:44.418641+0000","last_became_peered":"2024-09-13T15:01:44.418641+0000","last_unstale":"2024-09-13T15:16:23.748758+0000","last_undegraded":"2024-09-13T15:16:23.748758+0000","last_fullsized":"2024-09-13T15:16:23.748758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-09-13T15:16:21.446893+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-09-13T15:16:21.446893+0000","last_clean_scrub_stamp":"2024-09-13T15:16:21.446893+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:15:25.634510+0000","scrub_duration":0.039130482000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":4120,"num_write":37,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18304,"num_omap_keys":34,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.034899+0000","last_change":"2024-09-13T15:16:22.973595+0000","last_active":"2024-09-13T15:16:24.034899+0000","last_peered":"2024-09-13T15:16:24.034899+0000","last_clean":"2024-09-13T15:16:24.034899+0000","last_became_active":"2024-09-13T15:01:44.809091+0000","last_became_peered":"2024-09-13T15:01:44.809091+0000","last_unstale":"2024-09-13T15:16:24.034899+0000","last_undegraded":"2024-09-13T15:16:24.034899+0000","last_fullsized":"2024-09-13T15:16:24.034899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T15:16:22.973417+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T15:16:22.973417+0000","last_clean_scrub_stamp":"2024-09-13T15:16:22.973417+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.248726+0000","scrub_duration":0.003905291,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'4483","reported_seq":4510,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.231339+0000","last_change":"2024-09-13T15:01:48.910757+0000","last_active":"2024-09-13T15:16:24.231339+0000","last_peered":"2024-09-13T15:16:24.231339+0000","last_clean":"2024-09-13T15:16:24.231339+0000","last_became_active":"2024-09-13T15:01:48.910262+0000","last_became_peered":"2024-09-13T15:01:48.910262+0000","last_unstale":"2024-09-13T15:16:24.231339+0000","last_undegraded":"2024-09-13T15:16:24.231339+0000","last_fullsized":"2024-09-13T15:16:24.231339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4483,"log_dups_size":0,"ondisk_log_size":4483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65375,"num_write_kb":904330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"33'25","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:32.945023+0000","last_change":"2024-09-13T15:16:32.945101+0000","last_active":"2024-09-13T15:16:32.945023+0000","last_peered":"2024-09-13T15:16:32.945023+0000","last_clean":"2024-09-13T15:16:32.945023+0000","last_became_active":"2024-09-13T15:01:44.401666+0000","last_became_peered":"2024-09-13T15:01:44.401666+0000","last_unstale":"2024-09-13T15:16:32.945023+0000","last_undegraded":"2024-09-13T15:16:32.945023+0000","last_fullsized":"2024-09-13T15:16:32.945023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2024-09-13T15:16:32.945005+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2024-09-13T15:16:32.945005+0000","last_clean_scrub_stamp":"2024-09-13T15:16:32.945005+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:38.266030+0000","scrub_duration":0.011797106999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":18,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"33'7","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:54.232342+0000","last_change":"2024-09-13T15:16:54.232441+0000","last_active":"2024-09-13T15:16:54.232342+0000","last_peered":"2024-09-13T15:16:54.232342+0000","last_clean":"2024-09-13T15:16:54.232342+0000","last_became_active":"2024-09-13T15:01:44.849825+0000","last_became_peered":"2024-09-13T15:01:44.849825+0000","last_unstale":"2024-09-13T15:16:54.232342+0000","last_undegraded":"2024-09-13T15:16:54.232342+0000","last_fullsized":"2024-09-13T15:16:54.232342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:54.232320+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:54.232320+0000","last_clean_scrub_stamp":"2024-09-13T15:16:54.232320+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:34.087214+0000","scrub_duration":0.0026587659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"33'4943","reported_seq":4981,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.322856+0000","last_change":"2024-09-13T15:16:34.323110+0000","last_active":"2024-09-13T15:16:34.322856+0000","last_peered":"2024-09-13T15:16:34.322856+0000","last_clean":"2024-09-13T15:16:34.322856+0000","last_became_active":"2024-09-13T15:01:48.848750+0000","last_became_peered":"2024-09-13T15:01:48.848750+0000","last_unstale":"2024-09-13T15:16:34.322856+0000","last_undegraded":"2024-09-13T15:16:34.322856+0000","last_fullsized":"2024-09-13T15:16:34.322856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4943","last_scrub_stamp":"2024-09-13T15:16:34.322797+0000","last_deep_scrub":"33'4943","last_deep_scrub_stamp":"2024-09-13T15:16:34.322797+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.322797+0000","objects_scrubbed":0,"log_size":4943,"log_dups_size":0,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:02.000213+0000","scrub_duration":0.059598802999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71676,"num_write_kb":1026932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"33'74","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:43.853486+0000","last_change":"2024-09-13T15:16:43.853486+0000","last_active":"2024-09-13T15:16:43.853486+0000","last_peered":"2024-09-13T15:16:43.853486+0000","last_clean":"2024-09-13T15:16:43.853486+0000","last_became_active":"2024-09-13T15:01:44.437168+0000","last_became_peered":"2024-09-13T15:01:44.437168+0000","last_unstale":"2024-09-13T15:16:43.853486+0000","last_undegraded":"2024-09-13T15:16:43.853486+0000","last_fullsized":"2024-09-13T15:16:43.853486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-09-13T15:16:43.853192+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-09-13T15:16:43.853192+0000","last_clean_scrub_stamp":"2024-09-13T15:16:43.853192+0000","objects_scrubbed":10,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:18:05.006017+0000","scrub_duration":0.051040786999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":50,"num_read_kb":12337,"num_write":58,"num_write_kb":12312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.585752+0000","last_change":"2024-09-13T15:16:46.585752+0000","last_active":"2024-09-13T15:16:46.585752+0000","last_peered":"2024-09-13T15:16:46.585752+0000","last_clean":"2024-09-13T15:16:46.585752+0000","last_became_active":"2024-09-13T15:01:44.845395+0000","last_became_peered":"2024-09-13T15:01:44.845395+0000","last_unstale":"2024-09-13T15:16:46.585752+0000","last_undegraded":"2024-09-13T15:16:46.585752+0000","last_fullsized":"2024-09-13T15:16:46.585752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:46.585439+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:46.585439+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.585439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:26.653766+0000","scrub_duration":0.0039872960000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4446","reported_seq":4473,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.156946+0000","last_change":"2024-09-13T15:01:48.865388+0000","last_active":"2024-09-13T15:16:24.156946+0000","last_peered":"2024-09-13T15:16:24.156946+0000","last_clean":"2024-09-13T15:16:24.156946+0000","last_became_active":"2024-09-13T15:01:48.864314+0000","last_became_peered":"2024-09-13T15:01:48.864314+0000","last_unstale":"2024-09-13T15:16:24.156946+0000","last_undegraded":"2024-09-13T15:16:24.156946+0000","last_fullsized":"2024-09-13T15:16:24.156946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4446,"log_dups_size":0,"ondisk_log_size":4446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64553,"num_write_kb":920306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"33'19","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:44.786729+0000","last_change":"2024-09-13T15:16:44.786932+0000","last_active":"2024-09-13T15:16:44.786729+0000","last_peered":"2024-09-13T15:16:44.786729+0000","last_clean":"2024-09-13T15:16:44.786729+0000","last_became_active":"2024-09-13T15:01:44.423381+0000","last_became_peered":"2024-09-13T15:01:44.423381+0000","last_unstale":"2024-09-13T15:16:44.786729+0000","last_undegraded":"2024-09-13T15:16:44.786729+0000","last_fullsized":"2024-09-13T15:16:44.786729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:44.786676+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:44.786676+0000","last_clean_scrub_stamp":"2024-09-13T15:16:44.786676+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:07.262617+0000","scrub_duration":0.019597004000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":4116,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"33'19","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:49.648254+0000","last_change":"2024-09-13T15:16:49.648254+0000","last_active":"2024-09-13T15:16:49.648254+0000","last_peered":"2024-09-13T15:16:49.648254+0000","last_clean":"2024-09-13T15:16:49.648254+0000","last_became_active":"2024-09-13T15:01:44.849038+0000","last_became_peered":"2024-09-13T15:01:44.849038+0000","last_unstale":"2024-09-13T15:16:49.648254+0000","last_undegraded":"2024-09-13T15:16:49.648254+0000","last_fullsized":"2024-09-13T15:16:49.648254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:49.647989+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:49.647989+0000","last_clean_scrub_stamp":"2024-09-13T15:16:49.647989+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:17.250145+0000","scrub_duration":0.0032904990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4201","reported_seq":4239,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:54.451927+0000","last_change":"2024-09-13T15:16:54.452194+0000","last_active":"2024-09-13T15:16:54.451927+0000","last_peered":"2024-09-13T15:16:54.451927+0000","last_clean":"2024-09-13T15:16:54.451927+0000","last_became_active":"2024-09-13T15:01:48.853858+0000","last_became_peered":"2024-09-13T15:01:48.853858+0000","last_unstale":"2024-09-13T15:16:54.451927+0000","last_undegraded":"2024-09-13T15:16:54.451927+0000","last_fullsized":"2024-09-13T15:16:54.451927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4201","last_scrub_stamp":"2024-09-13T15:16:54.451870+0000","last_deep_scrub":"33'4201","last_deep_scrub_stamp":"2024-09-13T15:16:54.451870+0000","last_clean_scrub_stamp":"2024-09-13T15:16:54.451870+0000","objects_scrubbed":0,"log_size":4201,"log_dups_size":0,"ondisk_log_size":4201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:09.325806+0000","scrub_duration":0.061230010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61316,"num_write_kb":864366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"33'5","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:44.852767+0000","last_change":"2024-09-13T15:16:44.852767+0000","last_active":"2024-09-13T15:16:44.852767+0000","last_peered":"2024-09-13T15:16:44.852767+0000","last_clean":"2024-09-13T15:16:44.852767+0000","last_became_active":"2024-09-13T15:01:44.823690+0000","last_became_peered":"2024-09-13T15:01:44.823690+0000","last_unstale":"2024-09-13T15:16:44.852767+0000","last_undegraded":"2024-09-13T15:16:44.852767+0000","last_fullsized":"2024-09-13T15:16:44.852767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T15:16:44.852533+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T15:16:44.852533+0000","last_clean_scrub_stamp":"2024-09-13T15:16:44.852533+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:54:44.010971+0000","scrub_duration":0.0029740539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'144","reported_seq":189,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.859299+0000","last_change":"2024-09-13T15:16:46.859566+0000","last_active":"2024-09-13T15:16:46.859299+0000","last_peered":"2024-09-13T15:16:46.859299+0000","last_clean":"2024-09-13T15:16:46.859299+0000","last_became_active":"2024-09-13T15:01:44.419965+0000","last_became_peered":"2024-09-13T15:01:44.419965+0000","last_unstale":"2024-09-13T15:16:46.859299+0000","last_undegraded":"2024-09-13T15:16:46.859299+0000","last_fullsized":"2024-09-13T15:16:46.859299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'144","last_scrub_stamp":"2024-09-13T15:16:46.859246+0000","last_deep_scrub":"33'144","last_deep_scrub_stamp":"2024-09-13T15:16:46.859246+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.859246+0000","objects_scrubbed":4,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:13.077229+0000","scrub_duration":0.030972208000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":8200,"num_write":130,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"33'4505","reported_seq":4543,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:39.352834+0000","last_change":"2024-09-13T15:16:39.353112+0000","last_active":"2024-09-13T15:16:39.352834+0000","last_peered":"2024-09-13T15:16:39.352834+0000","last_clean":"2024-09-13T15:16:39.352834+0000","last_became_active":"2024-09-13T15:01:48.849856+0000","last_became_peered":"2024-09-13T15:01:48.849856+0000","last_unstale":"2024-09-13T15:16:39.352834+0000","last_undegraded":"2024-09-13T15:16:39.352834+0000","last_fullsized":"2024-09-13T15:16:39.352834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4505","last_scrub_stamp":"2024-09-13T15:16:39.352782+0000","last_deep_scrub":"33'4505","last_deep_scrub_stamp":"2024-09-13T15:16:39.352782+0000","last_clean_scrub_stamp":"2024-09-13T15:16:39.352782+0000","objects_scrubbed":0,"log_size":4505,"log_dups_size":0,"ondisk_log_size":4505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:43.506716+0000","scrub_duration":0.052549373000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65579,"num_write_kb":929153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"33'8","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:36.980712+0000","last_change":"2024-09-13T15:16:36.980882+0000","last_active":"2024-09-13T15:16:36.980712+0000","last_peered":"2024-09-13T15:16:36.980712+0000","last_clean":"2024-09-13T15:16:36.980712+0000","last_became_active":"2024-09-13T15:01:44.805767+0000","last_became_peered":"2024-09-13T15:01:44.805767+0000","last_unstale":"2024-09-13T15:16:36.980712+0000","last_undegraded":"2024-09-13T15:16:36.980712+0000","last_fullsized":"2024-09-13T15:16:36.980712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:36.980692+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:36.980692+0000","last_clean_scrub_stamp":"2024-09-13T15:16:36.980692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:34.434100+0000","scrub_duration":0.0013482559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"33'26","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.606183+0000","last_change":"2024-09-13T15:16:24.606279+0000","last_active":"2024-09-13T15:16:24.606183+0000","last_peered":"2024-09-13T15:16:24.606183+0000","last_clean":"2024-09-13T15:16:24.606183+0000","last_became_active":"2024-09-13T15:01:44.401559+0000","last_became_peered":"2024-09-13T15:01:44.401559+0000","last_unstale":"2024-09-13T15:16:24.606183+0000","last_undegraded":"2024-09-13T15:16:24.606183+0000","last_fullsized":"2024-09-13T15:16:24.606183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-09-13T15:16:24.606164+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-09-13T15:16:24.606164+0000","last_clean_scrub_stamp":"2024-09-13T15:16:24.606164+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:58.610420+0000","scrub_duration":0.010477458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"33'4744","reported_seq":4782,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:33.297530+0000","last_change":"2024-09-13T15:16:33.297858+0000","last_active":"2024-09-13T15:16:33.297530+0000","last_peered":"2024-09-13T15:16:33.297530+0000","last_clean":"2024-09-13T15:16:33.297530+0000","last_became_active":"2024-09-13T15:01:48.857802+0000","last_became_peered":"2024-09-13T15:01:48.857802+0000","last_unstale":"2024-09-13T15:16:33.297530+0000","last_undegraded":"2024-09-13T15:16:33.297530+0000","last_fullsized":"2024-09-13T15:16:33.297530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4744","last_scrub_stamp":"2024-09-13T15:16:33.297473+0000","last_deep_scrub":"33'4744","last_deep_scrub_stamp":"2024-09-13T15:16:33.297473+0000","last_clean_scrub_stamp":"2024-09-13T15:16:33.297473+0000","objects_scrubbed":0,"log_size":4744,"log_dups_size":0,"ondisk_log_size":4744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:00.056232+0000","scrub_duration":0.060614465999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69018,"num_write_kb":974815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"33'10","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.909669+0000","last_change":"2024-09-13T15:16:19.917251+0000","last_active":"2024-09-13T15:16:23.909669+0000","last_peered":"2024-09-13T15:16:23.909669+0000","last_clean":"2024-09-13T15:16:23.909669+0000","last_became_active":"2024-09-13T15:01:44.808420+0000","last_became_peered":"2024-09-13T15:01:44.808420+0000","last_unstale":"2024-09-13T15:16:23.909669+0000","last_undegraded":"2024-09-13T15:16:23.909669+0000","last_fullsized":"2024-09-13T15:16:23.909669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:19.917131+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:19.917131+0000","last_clean_scrub_stamp":"2024-09-13T15:16:19.917131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:55.912312+0000","scrub_duration":0.001471523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"33'15","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.059692+0000","last_change":"2024-09-13T15:16:22.548304+0000","last_active":"2024-09-13T15:16:24.059692+0000","last_peered":"2024-09-13T15:16:24.059692+0000","last_clean":"2024-09-13T15:16:24.059692+0000","last_became_active":"2024-09-13T15:01:44.406354+0000","last_became_peered":"2024-09-13T15:01:44.406354+0000","last_unstale":"2024-09-13T15:16:24.059692+0000","last_undegraded":"2024-09-13T15:16:24.059692+0000","last_fullsized":"2024-09-13T15:16:24.059692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T15:16:22.548208+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T15:16:22.548208+0000","last_clean_scrub_stamp":"2024-09-13T15:16:22.548208+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:10.347627+0000","scrub_duration":0.0063788459999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"33'4791","reported_seq":4829,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:52.318445+0000","last_change":"2024-09-13T15:16:52.318588+0000","last_active":"2024-09-13T15:16:52.318445+0000","last_peered":"2024-09-13T15:16:52.318445+0000","last_clean":"2024-09-13T15:16:52.318445+0000","last_became_active":"2024-09-13T15:01:48.909494+0000","last_became_peered":"2024-09-13T15:01:48.909494+0000","last_unstale":"2024-09-13T15:16:52.318445+0000","last_undegraded":"2024-09-13T15:16:52.318445+0000","last_fullsized":"2024-09-13T15:16:52.318445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4791","last_scrub_stamp":"2024-09-13T15:16:52.318426+0000","last_deep_scrub":"33'4791","last_deep_scrub_stamp":"2024-09-13T15:16:52.318426+0000","last_clean_scrub_stamp":"2024-09-13T15:16:52.318426+0000","objects_scrubbed":0,"log_size":4791,"log_dups_size":0,"ondisk_log_size":4791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:36.300358+0000","scrub_duration":0.051287922999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69959,"num_write_kb":1001010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"33'3","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.090655+0000","last_change":"2024-09-13T15:16:26.090842+0000","last_active":"2024-09-13T15:16:26.090655+0000","last_peered":"2024-09-13T15:16:26.090655+0000","last_clean":"2024-09-13T15:16:26.090655+0000","last_became_active":"2024-09-13T15:01:44.824392+0000","last_became_peered":"2024-09-13T15:01:44.824392+0000","last_unstale":"2024-09-13T15:16:26.090655+0000","last_undegraded":"2024-09-13T15:16:26.090655+0000","last_fullsized":"2024-09-13T15:16:26.090655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T15:16:26.090602+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T15:16:26.090602+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.090602+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:41:02.638139+0000","scrub_duration":0.0027170839999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"33'19","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:50.928613+0000","last_change":"2024-09-13T15:16:50.928613+0000","last_active":"2024-09-13T15:16:50.928613+0000","last_peered":"2024-09-13T15:16:50.928613+0000","last_clean":"2024-09-13T15:16:50.928613+0000","last_became_active":"2024-09-13T15:01:44.419082+0000","last_became_peered":"2024-09-13T15:01:44.419082+0000","last_unstale":"2024-09-13T15:16:50.928613+0000","last_undegraded":"2024-09-13T15:16:50.928613+0000","last_fullsized":"2024-09-13T15:16:50.928613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:50.928331+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:50.928331+0000","last_clean_scrub_stamp":"2024-09-13T15:16:50.928331+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:08.247608+0000","scrub_duration":0.017025906,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"33'4700","reported_seq":4738,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:47.376059+0000","last_change":"2024-09-13T15:16:47.376368+0000","last_active":"2024-09-13T15:16:47.376059+0000","last_peered":"2024-09-13T15:16:47.376059+0000","last_clean":"2024-09-13T15:16:47.376059+0000","last_became_active":"2024-09-13T15:01:48.855433+0000","last_became_peered":"2024-09-13T15:01:48.855433+0000","last_unstale":"2024-09-13T15:16:47.376059+0000","last_undegraded":"2024-09-13T15:16:47.376059+0000","last_fullsized":"2024-09-13T15:16:47.376059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4700","last_scrub_stamp":"2024-09-13T15:16:47.375999+0000","last_deep_scrub":"33'4700","last_deep_scrub_stamp":"2024-09-13T15:16:47.375999+0000","last_clean_scrub_stamp":"2024-09-13T15:16:47.375999+0000","objects_scrubbed":0,"log_size":4700,"log_dups_size":0,"ondisk_log_size":4700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:00.786470+0000","scrub_duration":0.06414396,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68074,"num_write_kb":991498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"33'7","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.348910+0000","last_change":"2024-09-13T15:16:26.348910+0000","last_active":"2024-09-13T15:16:26.348910+0000","last_peered":"2024-09-13T15:16:26.348910+0000","last_clean":"2024-09-13T15:16:26.348910+0000","last_became_active":"2024-09-13T15:01:44.807643+0000","last_became_peered":"2024-09-13T15:01:44.807643+0000","last_unstale":"2024-09-13T15:16:26.348910+0000","last_undegraded":"2024-09-13T15:16:26.348910+0000","last_fullsized":"2024-09-13T15:16:26.348910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:26.348813+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:26.348813+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.348813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:35.883729+0000","scrub_duration":0.001321298,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"33'19","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:25.747184+0000","last_change":"2024-09-13T15:16:25.747184+0000","last_active":"2024-09-13T15:16:25.747184+0000","last_peered":"2024-09-13T15:16:25.747184+0000","last_clean":"2024-09-13T15:16:25.747184+0000","last_became_active":"2024-09-13T15:01:44.429510+0000","last_became_peered":"2024-09-13T15:01:44.429510+0000","last_unstale":"2024-09-13T15:16:25.747184+0000","last_undegraded":"2024-09-13T15:16:25.747184+0000","last_fullsized":"2024-09-13T15:16:25.747184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:25.746901+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:25.746901+0000","last_clean_scrub_stamp":"2024-09-13T15:16:25.746901+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:29.626332+0000","scrub_duration":0.0090965799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'4847","reported_seq":4886,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:37.402053+0000","last_change":"2024-09-13T15:16:37.402307+0000","last_active":"2024-09-13T15:16:37.402053+0000","last_peered":"2024-09-13T15:16:37.402053+0000","last_clean":"2024-09-13T15:16:37.402053+0000","last_became_active":"2024-09-13T15:01:48.911578+0000","last_became_peered":"2024-09-13T15:01:48.911578+0000","last_unstale":"2024-09-13T15:16:37.402053+0000","last_undegraded":"2024-09-13T15:16:37.402053+0000","last_fullsized":"2024-09-13T15:16:37.402053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4847","last_scrub_stamp":"2024-09-13T15:16:37.402012+0000","last_deep_scrub":"33'4847","last_deep_scrub_stamp":"2024-09-13T15:16:37.402012+0000","last_clean_scrub_stamp":"2024-09-13T15:16:37.402012+0000","objects_scrubbed":0,"log_size":4847,"log_dups_size":0,"ondisk_log_size":4847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:44.796269+0000","scrub_duration":0.079726367000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70505,"num_write_kb":1030585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.009623+0000","last_change":"2024-09-13T15:16:46.009623+0000","last_active":"2024-09-13T15:16:46.009623+0000","last_peered":"2024-09-13T15:16:46.009623+0000","last_clean":"2024-09-13T15:16:46.009623+0000","last_became_active":"2024-09-13T15:01:44.838128+0000","last_became_peered":"2024-09-13T15:01:44.838128+0000","last_unstale":"2024-09-13T15:16:46.009623+0000","last_undegraded":"2024-09-13T15:16:46.009623+0000","last_fullsized":"2024-09-13T15:16:46.009623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:46.008515+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:46.008515+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.008515+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:27:19.737003+0000","scrub_duration":0.0026910200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'119","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.572041+0000","last_change":"2024-09-13T15:16:26.572041+0000","last_active":"2024-09-13T15:16:26.572041+0000","last_peered":"2024-09-13T15:16:26.572041+0000","last_clean":"2024-09-13T15:16:26.572041+0000","last_became_active":"2024-09-13T15:01:44.430548+0000","last_became_peered":"2024-09-13T15:01:44.430548+0000","last_unstale":"2024-09-13T15:16:26.572041+0000","last_undegraded":"2024-09-13T15:16:26.572041+0000","last_fullsized":"2024-09-13T15:16:26.572041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-09-13T15:16:26.571900+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-09-13T15:16:26.571900+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.571900+0000","objects_scrubbed":4,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:58.749238+0000","scrub_duration":0.0068987069999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":251,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"33'4848","reported_seq":4876,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.180347+0000","last_change":"2024-09-13T15:01:48.911224+0000","last_active":"2024-09-13T15:16:24.180347+0000","last_peered":"2024-09-13T15:16:24.180347+0000","last_clean":"2024-09-13T15:16:24.180347+0000","last_became_active":"2024-09-13T15:01:48.910150+0000","last_became_peered":"2024-09-13T15:01:48.910150+0000","last_unstale":"2024-09-13T15:16:24.180347+0000","last_undegraded":"2024-09-13T15:16:24.180347+0000","last_fullsized":"2024-09-13T15:16:24.180347+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4848,"log_dups_size":0,"ondisk_log_size":4848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70446,"num_write_kb":999196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"33'14","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:40.382671+0000","last_change":"2024-09-13T15:16:40.382752+0000","last_active":"2024-09-13T15:16:40.382671+0000","last_peered":"2024-09-13T15:16:40.382671+0000","last_clean":"2024-09-13T15:16:40.382671+0000","last_became_active":"2024-09-13T15:01:44.811915+0000","last_became_peered":"2024-09-13T15:01:44.811915+0000","last_unstale":"2024-09-13T15:16:40.382671+0000","last_undegraded":"2024-09-13T15:16:40.382671+0000","last_fullsized":"2024-09-13T15:16:40.382671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:40.382651+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:40.382651+0000","last_clean_scrub_stamp":"2024-09-13T15:16:40.382651+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:21.251984+0000","scrub_duration":0.001494736,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'13","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:36.714995+0000","last_change":"2024-09-13T15:16:36.715178+0000","last_active":"2024-09-13T15:16:36.714995+0000","last_peered":"2024-09-13T15:16:36.714995+0000","last_clean":"2024-09-13T15:16:36.714995+0000","last_became_active":"2024-09-13T15:01:44.422297+0000","last_became_peered":"2024-09-13T15:01:44.422297+0000","last_unstale":"2024-09-13T15:16:36.714995+0000","last_undegraded":"2024-09-13T15:16:36.714995+0000","last_fullsized":"2024-09-13T15:16:36.714995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T15:16:36.714944+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T15:16:36.714944+0000","last_clean_scrub_stamp":"2024-09-13T15:16:36.714944+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:53.830394+0000","scrub_duration":0.0057288749999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"33'4797","reported_seq":4836,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:57.381405+0000","last_change":"2024-09-13T15:16:57.381540+0000","last_active":"2024-09-13T15:16:57.381405+0000","last_peered":"2024-09-13T15:16:57.381405+0000","last_clean":"2024-09-13T15:16:57.381405+0000","last_became_active":"2024-09-13T15:01:48.908118+0000","last_became_peered":"2024-09-13T15:01:48.908118+0000","last_unstale":"2024-09-13T15:16:57.381405+0000","last_undegraded":"2024-09-13T15:16:57.381405+0000","last_fullsized":"2024-09-13T15:16:57.381405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4797","last_scrub_stamp":"2024-09-13T15:16:57.381384+0000","last_deep_scrub":"33'4797","last_deep_scrub_stamp":"2024-09-13T15:16:57.381384+0000","last_clean_scrub_stamp":"2024-09-13T15:16:57.381384+0000","objects_scrubbed":0,"log_size":4797,"log_dups_size":0,"ondisk_log_size":4797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:04.766466+0000","scrub_duration":0.052226372,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69559,"num_write_kb":1001647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"33'5","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:37.634781+0000","last_change":"2024-09-13T15:16:37.634978+0000","last_active":"2024-09-13T15:16:37.634781+0000","last_peered":"2024-09-13T15:16:37.634781+0000","last_clean":"2024-09-13T15:16:37.634781+0000","last_became_active":"2024-09-13T15:01:44.850263+0000","last_became_peered":"2024-09-13T15:01:44.850263+0000","last_unstale":"2024-09-13T15:16:37.634781+0000","last_undegraded":"2024-09-13T15:16:37.634781+0000","last_fullsized":"2024-09-13T15:16:37.634781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T15:16:37.634730+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T15:16:37.634730+0000","last_clean_scrub_stamp":"2024-09-13T15:16:37.634730+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:49.903072+0000","scrub_duration":0.0026524399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.015510+0000","last_change":"2024-09-13T15:16:23.590960+0000","last_active":"2024-09-13T15:16:24.015510+0000","last_peered":"2024-09-13T15:16:24.015510+0000","last_clean":"2024-09-13T15:16:24.015510+0000","last_became_active":"2024-09-13T15:01:44.398881+0000","last_became_peered":"2024-09-13T15:01:44.398881+0000","last_unstale":"2024-09-13T15:16:24.015510+0000","last_undegraded":"2024-09-13T15:16:24.015510+0000","last_fullsized":"2024-09-13T15:16:24.015510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T15:16:23.590800+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T15:16:23.590800+0000","last_clean_scrub_stamp":"2024-09-13T15:16:23.590800+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:44.286646+0000","scrub_duration":0.023094673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2694,"num_omap_keys":5,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4059","reported_seq":4098,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:51.315149+0000","last_change":"2024-09-13T15:16:51.315264+0000","last_active":"2024-09-13T15:16:51.315149+0000","last_peered":"2024-09-13T15:16:51.315149+0000","last_clean":"2024-09-13T15:16:51.315149+0000","last_became_active":"2024-09-13T15:01:48.851948+0000","last_became_peered":"2024-09-13T15:01:48.851948+0000","last_unstale":"2024-09-13T15:16:51.315149+0000","last_undegraded":"2024-09-13T15:16:51.315149+0000","last_fullsized":"2024-09-13T15:16:51.315149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4059","last_scrub_stamp":"2024-09-13T15:16:51.315130+0000","last_deep_scrub":"33'4059","last_deep_scrub_stamp":"2024-09-13T15:16:51.315130+0000","last_clean_scrub_stamp":"2024-09-13T15:16:51.315130+0000","objects_scrubbed":0,"log_size":4059,"log_dups_size":0,"ondisk_log_size":4059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:59:45.048586+0000","scrub_duration":0.037480123999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58925,"num_write_kb":861513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"33'7","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:28.083406+0000","last_change":"2024-09-13T15:16:28.083406+0000","last_active":"2024-09-13T15:16:28.083406+0000","last_peered":"2024-09-13T15:16:28.083406+0000","last_clean":"2024-09-13T15:16:28.083406+0000","last_became_active":"2024-09-13T15:01:44.821475+0000","last_became_peered":"2024-09-13T15:01:44.821475+0000","last_unstale":"2024-09-13T15:16:28.083406+0000","last_undegraded":"2024-09-13T15:16:28.083406+0000","last_fullsized":"2024-09-13T15:16:28.083406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:28.083138+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:28.083138+0000","last_clean_scrub_stamp":"2024-09-13T15:16:28.083138+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:39.566336+0000","scrub_duration":0.0028025329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'40","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.600169+0000","last_change":"2024-09-13T15:16:26.600795+0000","last_active":"2024-09-13T15:16:26.600169+0000","last_peered":"2024-09-13T15:16:26.600169+0000","last_clean":"2024-09-13T15:16:26.600169+0000","last_became_active":"2024-09-13T15:01:44.432902+0000","last_became_peered":"2024-09-13T15:01:44.432902+0000","last_unstale":"2024-09-13T15:16:26.600169+0000","last_undegraded":"2024-09-13T15:16:26.600169+0000","last_fullsized":"2024-09-13T15:16:26.600169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'40","last_scrub_stamp":"2024-09-13T15:16:26.600116+0000","last_deep_scrub":"33'40","last_deep_scrub_stamp":"2024-09-13T15:16:26.600116+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.600116+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:35.079765+0000","scrub_duration":0.027584299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389688,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":8206,"num_write":28,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"33'4539","reported_seq":4578,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:42.385854+0000","last_change":"2024-09-13T15:16:42.385984+0000","last_active":"2024-09-13T15:16:42.385854+0000","last_peered":"2024-09-13T15:16:42.385854+0000","last_clean":"2024-09-13T15:16:42.385854+0000","last_became_active":"2024-09-13T15:01:48.846301+0000","last_became_peered":"2024-09-13T15:01:48.846301+0000","last_unstale":"2024-09-13T15:16:42.385854+0000","last_undegraded":"2024-09-13T15:16:42.385854+0000","last_fullsized":"2024-09-13T15:16:42.385854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4539","last_scrub_stamp":"2024-09-13T15:16:42.385833+0000","last_deep_scrub":"33'4539","last_deep_scrub_stamp":"2024-09-13T15:16:42.385833+0000","last_clean_scrub_stamp":"2024-09-13T15:16:42.385833+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:56.294090+0000","scrub_duration":0.044831939000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66145,"num_write_kb":975469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"33'12","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.078239+0000","last_change":"2024-09-13T15:16:17.879916+0000","last_active":"2024-09-13T15:16:24.078239+0000","last_peered":"2024-09-13T15:16:24.078239+0000","last_clean":"2024-09-13T15:16:24.078239+0000","last_became_active":"2024-09-13T15:01:44.814192+0000","last_became_peered":"2024-09-13T15:01:44.814192+0000","last_unstale":"2024-09-13T15:16:24.078239+0000","last_undegraded":"2024-09-13T15:16:24.078239+0000","last_fullsized":"2024-09-13T15:16:24.078239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:17.879753+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:17.879753+0000","last_clean_scrub_stamp":"2024-09-13T15:16:17.879753+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:36.906977+0000","scrub_duration":0.33901714599999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'35","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.123746+0000","last_change":"2024-09-13T15:16:26.123827+0000","last_active":"2024-09-13T15:16:26.123746+0000","last_peered":"2024-09-13T15:16:26.123746+0000","last_clean":"2024-09-13T15:16:26.123746+0000","last_became_active":"2024-09-13T15:01:44.398904+0000","last_became_peered":"2024-09-13T15:01:44.398904+0000","last_unstale":"2024-09-13T15:16:26.123746+0000","last_undegraded":"2024-09-13T15:16:26.123746+0000","last_fullsized":"2024-09-13T15:16:26.123746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-09-13T15:16:26.123727+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-09-13T15:16:26.123727+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.123727+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:19.696735+0000","scrub_duration":0.0038650519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70412,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":156,"num_write":30,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'5224","reported_seq":5263,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:50.323166+0000","last_change":"2024-09-13T15:16:50.323166+0000","last_active":"2024-09-13T15:16:50.323166+0000","last_peered":"2024-09-13T15:16:50.323166+0000","last_clean":"2024-09-13T15:16:50.323166+0000","last_became_active":"2024-09-13T15:01:48.858649+0000","last_became_peered":"2024-09-13T15:01:48.858649+0000","last_unstale":"2024-09-13T15:16:50.323166+0000","last_undegraded":"2024-09-13T15:16:50.323166+0000","last_fullsized":"2024-09-13T15:16:50.323166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5224","last_scrub_stamp":"2024-09-13T15:16:50.323018+0000","last_deep_scrub":"33'5224","last_deep_scrub_stamp":"2024-09-13T15:16:50.323018+0000","last_clean_scrub_stamp":"2024-09-13T15:16:50.323018+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:11.290072+0000","scrub_duration":0.049882793000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76325,"num_write_kb":1087992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:39.281590+0000","last_change":"2024-09-13T15:16:39.281681+0000","last_active":"2024-09-13T15:16:39.281590+0000","last_peered":"2024-09-13T15:16:39.281590+0000","last_clean":"2024-09-13T15:16:39.281590+0000","last_became_active":"2024-09-13T15:01:44.826222+0000","last_became_peered":"2024-09-13T15:01:44.826222+0000","last_unstale":"2024-09-13T15:16:39.281590+0000","last_undegraded":"2024-09-13T15:16:39.281590+0000","last_fullsized":"2024-09-13T15:16:39.281590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T15:16:39.281570+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T15:16:39.281570+0000","last_clean_scrub_stamp":"2024-09-13T15:16:39.281570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:44.314476+0000","scrub_duration":0.0023677669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'32","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:40.787167+0000","last_change":"2024-09-13T15:16:40.787346+0000","last_active":"2024-09-13T15:16:40.787167+0000","last_peered":"2024-09-13T15:16:40.787167+0000","last_clean":"2024-09-13T15:16:40.787167+0000","last_became_active":"2024-09-13T15:01:44.419660+0000","last_became_peered":"2024-09-13T15:01:44.419660+0000","last_unstale":"2024-09-13T15:16:40.787167+0000","last_undegraded":"2024-09-13T15:16:40.787167+0000","last_fullsized":"2024-09-13T15:16:40.787167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'32","last_scrub_stamp":"2024-09-13T15:16:40.787112+0000","last_deep_scrub":"33'32","last_deep_scrub_stamp":"2024-09-13T15:16:40.787112+0000","last_clean_scrub_stamp":"2024-09-13T15:16:40.787112+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:08.058596+0000","scrub_duration":0.026405371,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":20,"num_write_kb":8201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'4215","reported_seq":4264,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:55.325420+0000","last_change":"2024-09-13T15:16:55.325544+0000","last_active":"2024-09-13T15:16:55.325420+0000","last_peered":"2024-09-13T15:16:55.325420+0000","last_clean":"2024-09-13T15:16:55.325420+0000","last_became_active":"2024-09-13T15:02:34.118461+0000","last_became_peered":"2024-09-13T15:02:34.118461+0000","last_unstale":"2024-09-13T15:16:55.325420+0000","last_undegraded":"2024-09-13T15:16:55.325420+0000","last_fullsized":"2024-09-13T15:16:55.325420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4215","last_scrub_stamp":"2024-09-13T15:16:55.325400+0000","last_deep_scrub":"33'4215","last_deep_scrub_stamp":"2024-09-13T15:16:55.325400+0000","last_clean_scrub_stamp":"2024-09-13T15:16:55.325400+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:05.926263+0000","scrub_duration":0.065180481999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60783,"num_write_kb":878332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:35.977004+0000","last_change":"2024-09-13T15:16:35.977077+0000","last_active":"2024-09-13T15:16:35.977004+0000","last_peered":"2024-09-13T15:16:35.977004+0000","last_clean":"2024-09-13T15:16:35.977004+0000","last_became_active":"2024-09-13T15:01:44.850234+0000","last_became_peered":"2024-09-13T15:01:44.850234+0000","last_unstale":"2024-09-13T15:16:35.977004+0000","last_undegraded":"2024-09-13T15:16:35.977004+0000","last_fullsized":"2024-09-13T15:16:35.977004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:35.976986+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:35.976986+0000","last_clean_scrub_stamp":"2024-09-13T15:16:35.976986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:15.229979+0000","scrub_duration":0.0024425779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"33'14","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:27.599430+0000","last_change":"2024-09-13T15:16:27.599633+0000","last_active":"2024-09-13T15:16:27.599430+0000","last_peered":"2024-09-13T15:16:27.599430+0000","last_clean":"2024-09-13T15:16:27.599430+0000","last_became_active":"2024-09-13T15:01:44.410675+0000","last_became_peered":"2024-09-13T15:01:44.410675+0000","last_unstale":"2024-09-13T15:16:27.599430+0000","last_undegraded":"2024-09-13T15:16:27.599430+0000","last_fullsized":"2024-09-13T15:16:27.599430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:27.599376+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:27.599376+0000","last_clean_scrub_stamp":"2024-09-13T15:16:27.599376+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:49.535267+0000","scrub_duration":0.0074093939999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":18,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:29.740890+0000","last_change":"2024-09-13T15:16:29.741095+0000","last_active":"2024-09-13T15:16:29.740890+0000","last_peered":"2024-09-13T15:16:29.740890+0000","last_clean":"2024-09-13T15:16:29.740890+0000","last_became_active":"2024-09-13T15:01:40.832279+0000","last_became_peered":"2024-09-13T15:01:40.832279+0000","last_unstale":"2024-09-13T15:16:29.740890+0000","last_undegraded":"2024-09-13T15:16:29.740890+0000","last_fullsized":"2024-09-13T15:16:29.740890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-09-13T15:16:29.740837+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-09-13T15:16:29.740837+0000","last_clean_scrub_stamp":"2024-09-13T15:16:29.740837+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:37.631981+0000","scrub_duration":0.0066710290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"33'5137","reported_seq":5165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.175569+0000","last_change":"2024-09-13T15:01:48.919580+0000","last_active":"2024-09-13T15:16:24.175569+0000","last_peered":"2024-09-13T15:16:24.175569+0000","last_clean":"2024-09-13T15:16:24.175569+0000","last_became_active":"2024-09-13T15:01:48.918678+0000","last_became_peered":"2024-09-13T15:01:48.918678+0000","last_unstale":"2024-09-13T15:16:24.175569+0000","last_undegraded":"2024-09-13T15:16:24.175569+0000","last_fullsized":"2024-09-13T15:16:24.175569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":5137,"log_dups_size":0,"ondisk_log_size":5137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74848,"num_write_kb":1044614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"33'7","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:22.684165+0000","last_change":"2024-09-13T15:16:22.684165+0000","last_active":"2024-09-13T15:16:22.684165+0000","last_peered":"2024-09-13T15:16:22.684165+0000","last_clean":"2024-09-13T15:16:22.684165+0000","last_became_active":"2024-09-13T15:01:44.849457+0000","last_became_peered":"2024-09-13T15:01:44.849457+0000","last_unstale":"2024-09-13T15:16:22.684165+0000","last_undegraded":"2024-09-13T15:16:22.684165+0000","last_fullsized":"2024-09-13T15:16:22.684165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:22.683907+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:22.683907+0000","last_clean_scrub_stamp":"2024-09-13T15:16:22.683907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:51.010493+0000","scrub_duration":0.0033186610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"33'18","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.088002+0000","last_change":"2024-09-13T15:16:19.393403+0000","last_active":"2024-09-13T15:16:24.088002+0000","last_peered":"2024-09-13T15:16:24.088002+0000","last_clean":"2024-09-13T15:16:24.088002+0000","last_became_active":"2024-09-13T15:01:44.420601+0000","last_became_peered":"2024-09-13T15:01:44.420601+0000","last_unstale":"2024-09-13T15:16:24.088002+0000","last_undegraded":"2024-09-13T15:16:24.088002+0000","last_fullsized":"2024-09-13T15:16:24.088002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T15:16:19.393308+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T15:16:19.393308+0000","last_clean_scrub_stamp":"2024-09-13T15:16:19.393308+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:04.511597+0000","scrub_duration":0.25461208400000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"33'4520","reported_seq":4559,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:58.878819+0000","last_change":"2024-09-13T15:16:58.878819+0000","last_active":"2024-09-13T15:16:58.878819+0000","last_peered":"2024-09-13T15:16:58.878819+0000","last_clean":"2024-09-13T15:16:58.878819+0000","last_became_active":"2024-09-13T15:01:48.910479+0000","last_became_peered":"2024-09-13T15:01:48.910479+0000","last_unstale":"2024-09-13T15:16:58.878819+0000","last_undegraded":"2024-09-13T15:16:58.878819+0000","last_fullsized":"2024-09-13T15:16:58.878819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4520","last_scrub_stamp":"2024-09-13T15:16:58.878450+0000","last_deep_scrub":"33'4520","last_deep_scrub_stamp":"2024-09-13T15:16:58.878450+0000","last_clean_scrub_stamp":"2024-09-13T15:16:58.878450+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:36.119849+0000","scrub_duration":0.070444623999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65908,"num_write_kb":920675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:36.610995+0000","last_change":"2024-09-13T15:16:36.611191+0000","last_active":"2024-09-13T15:16:36.610995+0000","last_peered":"2024-09-13T15:16:36.610995+0000","last_clean":"2024-09-13T15:16:36.610995+0000","last_became_active":"2024-09-13T15:01:44.837429+0000","last_became_peered":"2024-09-13T15:01:44.837429+0000","last_unstale":"2024-09-13T15:16:36.610995+0000","last_undegraded":"2024-09-13T15:16:36.610995+0000","last_fullsized":"2024-09-13T15:16:36.610995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:36.610935+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:36.610935+0000","last_clean_scrub_stamp":"2024-09-13T15:16:36.610935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:41.442948+0000","scrub_duration":0.0026950490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"33'18","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:25.592150+0000","last_change":"2024-09-13T15:16:25.592225+0000","last_active":"2024-09-13T15:16:25.592150+0000","last_peered":"2024-09-13T15:16:25.592150+0000","last_clean":"2024-09-13T15:16:25.592150+0000","last_became_active":"2024-09-13T15:01:44.406719+0000","last_became_peered":"2024-09-13T15:01:44.406719+0000","last_unstale":"2024-09-13T15:16:25.592150+0000","last_undegraded":"2024-09-13T15:16:25.592150+0000","last_fullsized":"2024-09-13T15:16:25.592150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T15:16:25.592132+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T15:16:25.592132+0000","last_clean_scrub_stamp":"2024-09-13T15:16:25.592132+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:03:43.505817+0000","scrub_duration":0.015211931,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":9,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"33'5126","reported_seq":5164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:56.359514+0000","last_change":"2024-09-13T15:16:56.359631+0000","last_active":"2024-09-13T15:16:56.359514+0000","last_peered":"2024-09-13T15:16:56.359514+0000","last_clean":"2024-09-13T15:16:56.359514+0000","last_became_active":"2024-09-13T15:01:48.857542+0000","last_became_peered":"2024-09-13T15:01:48.857542+0000","last_unstale":"2024-09-13T15:16:56.359514+0000","last_undegraded":"2024-09-13T15:16:56.359514+0000","last_fullsized":"2024-09-13T15:16:56.359514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5126","last_scrub_stamp":"2024-09-13T15:16:56.359491+0000","last_deep_scrub":"33'5126","last_deep_scrub_stamp":"2024-09-13T15:16:56.359491+0000","last_clean_scrub_stamp":"2024-09-13T15:16:56.359491+0000","objects_scrubbed":0,"log_size":5126,"log_dups_size":0,"ondisk_log_size":5126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:55.537170+0000","scrub_duration":0.051104059,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74246,"num_write_kb":1079868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"33'12","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.936148+0000","last_change":"2024-09-13T15:01:44.835470+0000","last_active":"2024-09-13T15:16:23.936148+0000","last_peered":"2024-09-13T15:16:23.936148+0000","last_clean":"2024-09-13T15:16:23.936148+0000","last_became_active":"2024-09-13T15:01:44.831166+0000","last_became_peered":"2024-09-13T15:01:44.831166+0000","last_unstale":"2024-09-13T15:16:23.936148+0000","last_undegraded":"2024-09-13T15:16:23.936148+0000","last_fullsized":"2024-09-13T15:16:23.936148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"33'24","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:28.070586+0000","last_change":"2024-09-13T15:16:28.070673+0000","last_active":"2024-09-13T15:16:28.070586+0000","last_peered":"2024-09-13T15:16:28.070586+0000","last_clean":"2024-09-13T15:16:28.070586+0000","last_became_active":"2024-09-13T15:01:44.401799+0000","last_became_peered":"2024-09-13T15:01:44.401799+0000","last_unstale":"2024-09-13T15:16:28.070586+0000","last_undegraded":"2024-09-13T15:16:28.070586+0000","last_fullsized":"2024-09-13T15:16:28.070586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-13T15:16:28.070566+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-13T15:16:28.070566+0000","last_clean_scrub_stamp":"2024-09-13T15:16:28.070566+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:35.758129+0000","scrub_duration":0.0088310460000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":4114,"num_write":17,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"33'4768","reported_seq":4807,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:56.710326+0000","last_change":"2024-09-13T15:16:56.710326+0000","last_active":"2024-09-13T15:16:56.710326+0000","last_peered":"2024-09-13T15:16:56.710326+0000","last_clean":"2024-09-13T15:16:56.710326+0000","last_became_active":"2024-09-13T15:01:48.911474+0000","last_became_peered":"2024-09-13T15:01:48.911474+0000","last_unstale":"2024-09-13T15:16:56.710326+0000","last_undegraded":"2024-09-13T15:16:56.710326+0000","last_fullsized":"2024-09-13T15:16:56.710326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4768","last_scrub_stamp":"2024-09-13T15:16:56.709952+0000","last_deep_scrub":"33'4768","last_deep_scrub_stamp":"2024-09-13T15:16:56.709952+0000","last_clean_scrub_stamp":"2024-09-13T15:16:56.709952+0000","objects_scrubbed":0,"log_size":4768,"log_dups_size":0,"ondisk_log_size":4768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:20.071727+0000","scrub_duration":0.088888849000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69048,"num_write_kb":987747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.938473+0000","last_change":"2024-09-13T15:01:44.818472+0000","last_active":"2024-09-13T15:16:23.938473+0000","last_peered":"2024-09-13T15:16:23.938473+0000","last_clean":"2024-09-13T15:16:23.938473+0000","last_became_active":"2024-09-13T15:01:44.817718+0000","last_became_peered":"2024-09-13T15:01:44.817718+0000","last_unstale":"2024-09-13T15:16:23.938473+0000","last_undegraded":"2024-09-13T15:16:23.938473+0000","last_fullsized":"2024-09-13T15:16:23.938473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"33'19","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:21.104702+0000","last_change":"2024-09-13T15:16:21.104702+0000","last_active":"2024-09-13T15:16:21.104702+0000","last_peered":"2024-09-13T15:16:21.104702+0000","last_clean":"2024-09-13T15:16:21.104702+0000","last_became_active":"2024-09-13T15:01:44.409585+0000","last_became_peered":"2024-09-13T15:01:44.409585+0000","last_unstale":"2024-09-13T15:16:21.104702+0000","last_undegraded":"2024-09-13T15:16:21.104702+0000","last_fullsized":"2024-09-13T15:16:21.104702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T15:16:21.104582+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T15:16:21.104582+0000","last_clean_scrub_stamp":"2024-09-13T15:16:21.104582+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:29.612823+0000","scrub_duration":0.054426386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"33'5322","reported_seq":5360,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:50.420911+0000","last_change":"2024-09-13T15:16:50.421188+0000","last_active":"2024-09-13T15:16:50.420911+0000","last_peered":"2024-09-13T15:16:50.420911+0000","last_clean":"2024-09-13T15:16:50.420911+0000","last_became_active":"2024-09-13T15:01:48.860317+0000","last_became_peered":"2024-09-13T15:01:48.860317+0000","last_unstale":"2024-09-13T15:16:50.420911+0000","last_undegraded":"2024-09-13T15:16:50.420911+0000","last_fullsized":"2024-09-13T15:16:50.420911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5322","last_scrub_stamp":"2024-09-13T15:16:50.420854+0000","last_deep_scrub":"33'5322","last_deep_scrub_stamp":"2024-09-13T15:16:50.420854+0000","last_clean_scrub_stamp":"2024-09-13T15:16:50.420854+0000","objects_scrubbed":0,"log_size":5322,"log_dups_size":0,"ondisk_log_size":5322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:27.164571+0000","scrub_duration":0.069188280000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77566,"num_write_kb":1107255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:22.445096+0000","last_change":"2024-09-13T15:01:44.835494+0000","last_active":"2024-09-13T15:16:22.445096+0000","last_peered":"2024-09-13T15:16:22.445096+0000","last_clean":"2024-09-13T15:16:22.445096+0000","last_became_active":"2024-09-13T15:01:44.831150+0000","last_became_peered":"2024-09-13T15:01:44.831150+0000","last_unstale":"2024-09-13T15:16:22.445096+0000","last_undegraded":"2024-09-13T15:16:22.445096+0000","last_fullsized":"2024-09-13T15:16:22.445096+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'37","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.090066+0000","last_change":"2024-09-13T15:16:23.110015+0000","last_active":"2024-09-13T15:16:24.090066+0000","last_peered":"2024-09-13T15:16:24.090066+0000","last_clean":"2024-09-13T15:16:24.090066+0000","last_became_active":"2024-09-13T15:01:44.389946+0000","last_became_peered":"2024-09-13T15:01:44.389946+0000","last_unstale":"2024-09-13T15:16:24.090066+0000","last_undegraded":"2024-09-13T15:16:24.090066+0000","last_fullsized":"2024-09-13T15:16:24.090066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'31","last_scrub_stamp":"2024-09-13T15:16:23.109915+0000","last_deep_scrub":"33'31","last_deep_scrub_stamp":"2024-09-13T15:16:23.109915+0000","last_clean_scrub_stamp":"2024-09-13T15:16:23.109915+0000","objects_scrubbed":9,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:49.142729+0000","scrub_duration":0.0066126249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":23,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9630,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"33'4126","reported_seq":4164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:58.334577+0000","last_change":"2024-09-13T15:16:58.334773+0000","last_active":"2024-09-13T15:16:58.334577+0000","last_peered":"2024-09-13T15:16:58.334577+0000","last_clean":"2024-09-13T15:16:58.334577+0000","last_became_active":"2024-09-13T15:01:48.847605+0000","last_became_peered":"2024-09-13T15:01:48.847605+0000","last_unstale":"2024-09-13T15:16:58.334577+0000","last_undegraded":"2024-09-13T15:16:58.334577+0000","last_fullsized":"2024-09-13T15:16:58.334577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4126","last_scrub_stamp":"2024-09-13T15:16:58.334532+0000","last_deep_scrub":"33'4126","last_deep_scrub_stamp":"2024-09-13T15:16:58.334532+0000","last_clean_scrub_stamp":"2024-09-13T15:16:58.334532+0000","objects_scrubbed":0,"log_size":4126,"log_dups_size":0,"ondisk_log_size":4126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:15:05.258006+0000","scrub_duration":0.047342742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59577,"num_write_kb":873580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:40.892263+0000","last_change":"2024-09-13T15:16:40.892463+0000","last_active":"2024-09-13T15:16:40.892263+0000","last_peered":"2024-09-13T15:16:40.892263+0000","last_clean":"2024-09-13T15:16:40.892263+0000","last_became_active":"2024-09-13T15:01:44.808140+0000","last_became_peered":"2024-09-13T15:01:44.808140+0000","last_unstale":"2024-09-13T15:16:40.892263+0000","last_undegraded":"2024-09-13T15:16:40.892263+0000","last_fullsized":"2024-09-13T15:16:40.892263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:40.892207+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:40.892207+0000","last_clean_scrub_stamp":"2024-09-13T15:16:40.892207+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:10.273365+0000","scrub_duration":0.0030575229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"33'14","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:31.855992+0000","last_change":"2024-09-13T15:16:31.856223+0000","last_active":"2024-09-13T15:16:31.855992+0000","last_peered":"2024-09-13T15:16:31.855992+0000","last_clean":"2024-09-13T15:16:31.855992+0000","last_became_active":"2024-09-13T15:01:44.428271+0000","last_became_peered":"2024-09-13T15:01:44.428271+0000","last_unstale":"2024-09-13T15:16:31.855992+0000","last_undegraded":"2024-09-13T15:16:31.855992+0000","last_fullsized":"2024-09-13T15:16:31.855992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:31.855936+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:31.855936+0000","last_clean_scrub_stamp":"2024-09-13T15:16:31.855936+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:54.569226+0000","scrub_duration":0.0071886169999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"33'4957","reported_seq":4995,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:58.849246+0000","last_change":"2024-09-13T15:16:58.849437+0000","last_active":"2024-09-13T15:16:58.849246+0000","last_peered":"2024-09-13T15:16:58.849246+0000","last_clean":"2024-09-13T15:16:58.849246+0000","last_became_active":"2024-09-13T15:01:48.916008+0000","last_became_peered":"2024-09-13T15:01:48.916008+0000","last_unstale":"2024-09-13T15:16:58.849246+0000","last_undegraded":"2024-09-13T15:16:58.849246+0000","last_fullsized":"2024-09-13T15:16:58.849246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4957","last_scrub_stamp":"2024-09-13T15:16:58.849204+0000","last_deep_scrub":"33'4957","last_deep_scrub_stamp":"2024-09-13T15:16:58.849204+0000","last_clean_scrub_stamp":"2024-09-13T15:16:58.849204+0000","objects_scrubbed":0,"log_size":4957,"log_dups_size":0,"ondisk_log_size":4957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:04.395536+0000","scrub_duration":0.054487189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72374,"num_write_kb":1020409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'20","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.700019+0000","last_change":"2024-09-13T15:16:24.700227+0000","last_active":"2024-09-13T15:16:24.700019+0000","last_peered":"2024-09-13T15:16:24.700019+0000","last_clean":"2024-09-13T15:16:24.700019+0000","last_became_active":"2024-09-13T15:01:44.825996+0000","last_became_peered":"2024-09-13T15:01:44.825996+0000","last_unstale":"2024-09-13T15:16:24.700019+0000","last_undegraded":"2024-09-13T15:16:24.700019+0000","last_fullsized":"2024-09-13T15:16:24.700019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-13T15:16:24.699962+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-13T15:16:24.699962+0000","last_clean_scrub_stamp":"2024-09-13T15:16:24.699962+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:57.006772+0000","scrub_duration":0.003063091,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"33'11","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:30.633435+0000","last_change":"2024-09-13T15:16:30.633635+0000","last_active":"2024-09-13T15:16:30.633435+0000","last_peered":"2024-09-13T15:16:30.633435+0000","last_clean":"2024-09-13T15:16:30.633435+0000","last_became_active":"2024-09-13T15:01:44.408644+0000","last_became_peered":"2024-09-13T15:01:44.408644+0000","last_unstale":"2024-09-13T15:16:30.633435+0000","last_undegraded":"2024-09-13T15:16:30.633435+0000","last_fullsized":"2024-09-13T15:16:30.633435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:30.633381+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:30.633381+0000","last_clean_scrub_stamp":"2024-09-13T15:16:30.633381+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:48.589150+0000","scrub_duration":0.005668729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'4735","reported_seq":4762,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.166943+0000","last_change":"2024-09-13T15:01:48.916478+0000","last_active":"2024-09-13T15:16:24.166943+0000","last_peered":"2024-09-13T15:16:24.166943+0000","last_clean":"2024-09-13T15:16:24.166943+0000","last_became_active":"2024-09-13T15:01:48.916198+0000","last_became_peered":"2024-09-13T15:01:48.916198+0000","last_unstale":"2024-09-13T15:16:24.166943+0000","last_undegraded":"2024-09-13T15:16:24.166943+0000","last_fullsized":"2024-09-13T15:16:24.166943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4735,"log_dups_size":0,"ondisk_log_size":4735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68970,"num_write_kb":974417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.305261+0000","last_change":"2024-09-13T15:16:34.305358+0000","last_active":"2024-09-13T15:16:34.305261+0000","last_peered":"2024-09-13T15:16:34.305261+0000","last_clean":"2024-09-13T15:16:34.305261+0000","last_became_active":"2024-09-13T15:01:44.831583+0000","last_became_peered":"2024-09-13T15:01:44.831583+0000","last_unstale":"2024-09-13T15:16:34.305261+0000","last_undegraded":"2024-09-13T15:16:34.305261+0000","last_fullsized":"2024-09-13T15:16:34.305261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:34.305240+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:34.305240+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.305240+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:40.060577+0000","scrub_duration":0.0020742930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"33'41","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.078546+0000","last_change":"2024-09-13T15:16:20.445448+0000","last_active":"2024-09-13T15:16:24.078546+0000","last_peered":"2024-09-13T15:16:24.078546+0000","last_clean":"2024-09-13T15:16:24.078546+0000","last_became_active":"2024-09-13T15:01:44.408453+0000","last_became_peered":"2024-09-13T15:01:44.408453+0000","last_unstale":"2024-09-13T15:16:24.078546+0000","last_undegraded":"2024-09-13T15:16:24.078546+0000","last_fullsized":"2024-09-13T15:16:24.078546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'38","last_scrub_stamp":"2024-09-13T15:16:20.444690+0000","last_deep_scrub":"33'38","last_deep_scrub_stamp":"2024-09-13T15:16:20.444690+0000","last_clean_scrub_stamp":"2024-09-13T15:16:20.444690+0000","objects_scrubbed":8,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:18.099238+0000","scrub_duration":0.086113890999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":8225,"num_write":32,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'5131","reported_seq":5169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:57.718333+0000","last_change":"2024-09-13T15:16:57.718567+0000","last_active":"2024-09-13T15:16:57.718333+0000","last_peered":"2024-09-13T15:16:57.718333+0000","last_clean":"2024-09-13T15:16:57.718333+0000","last_became_active":"2024-09-13T15:01:48.916185+0000","last_became_peered":"2024-09-13T15:01:48.916185+0000","last_unstale":"2024-09-13T15:16:57.718333+0000","last_undegraded":"2024-09-13T15:16:57.718333+0000","last_fullsized":"2024-09-13T15:16:57.718333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5131","last_scrub_stamp":"2024-09-13T15:16:57.718290+0000","last_deep_scrub":"33'5131","last_deep_scrub_stamp":"2024-09-13T15:16:57.718290+0000","last_clean_scrub_stamp":"2024-09-13T15:16:57.718290+0000","objects_scrubbed":0,"log_size":5131,"log_dups_size":0,"ondisk_log_size":5131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:48.355046+0000","scrub_duration":0.072062320999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74464,"num_write_kb":1089564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"33'7","reported_seq":35,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.839720+0000","last_change":"2024-09-13T15:01:44.817007+0000","last_active":"2024-09-13T15:16:23.839720+0000","last_peered":"2024-09-13T15:16:23.839720+0000","last_clean":"2024-09-13T15:16:23.839720+0000","last_became_active":"2024-09-13T15:01:44.815435+0000","last_became_peered":"2024-09-13T15:01:44.815435+0000","last_unstale":"2024-09-13T15:16:23.839720+0000","last_undegraded":"2024-09-13T15:16:23.839720+0000","last_fullsized":"2024-09-13T15:16:23.839720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'583","reported_seq":636,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:29.820102+0000","last_change":"2024-09-13T15:16:29.820334+0000","last_active":"2024-09-13T15:16:29.820102+0000","last_peered":"2024-09-13T15:16:29.820102+0000","last_clean":"2024-09-13T15:16:29.820102+0000","last_became_active":"2024-09-13T15:01:44.435222+0000","last_became_peered":"2024-09-13T15:01:44.435222+0000","last_unstale":"2024-09-13T15:16:29.820102+0000","last_undegraded":"2024-09-13T15:16:29.820102+0000","last_fullsized":"2024-09-13T15:16:29.820102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'583","last_scrub_stamp":"2024-09-13T15:16:29.820047+0000","last_deep_scrub":"33'583","last_deep_scrub_stamp":"2024-09-13T15:16:29.820047+0000","last_clean_scrub_stamp":"2024-09-13T15:16:29.820047+0000","objects_scrubbed":7,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:27:24.758478+0000","scrub_duration":0.044190934000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8159583,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":7965,"num_write":571,"num_write_kb":8183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"33'4464","reported_seq":4502,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:43.348361+0000","last_change":"2024-09-13T15:16:43.348487+0000","last_active":"2024-09-13T15:16:43.348361+0000","last_peered":"2024-09-13T15:16:43.348361+0000","last_clean":"2024-09-13T15:16:43.348361+0000","last_became_active":"2024-09-13T15:01:48.846835+0000","last_became_peered":"2024-09-13T15:01:48.846835+0000","last_unstale":"2024-09-13T15:16:43.348361+0000","last_undegraded":"2024-09-13T15:16:43.348361+0000","last_fullsized":"2024-09-13T15:16:43.348361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4464","last_scrub_stamp":"2024-09-13T15:16:43.348342+0000","last_deep_scrub":"33'4464","last_deep_scrub_stamp":"2024-09-13T15:16:43.348342+0000","last_clean_scrub_stamp":"2024-09-13T15:16:43.348342+0000","objects_scrubbed":0,"log_size":4464,"log_dups_size":0,"ondisk_log_size":4464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:38.060347+0000","scrub_duration":0.041296739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65013,"num_write_kb":924599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.140565+0000","last_change":"2024-09-13T15:16:23.083422+0000","last_active":"2024-09-13T15:16:24.140565+0000","last_peered":"2024-09-13T15:16:24.140565+0000","last_clean":"2024-09-13T15:16:24.140565+0000","last_became_active":"2024-09-13T15:01:44.834643+0000","last_became_peered":"2024-09-13T15:01:44.834643+0000","last_unstale":"2024-09-13T15:16:24.140565+0000","last_undegraded":"2024-09-13T15:16:24.140565+0000","last_fullsized":"2024-09-13T15:16:24.140565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-13T15:16:23.083116+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-13T15:16:23.083116+0000","last_clean_scrub_stamp":"2024-09-13T15:16:23.083116+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:43:56.932464+0000","scrub_duration":0.001347029,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'20","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.432148+0000","last_change":"2024-09-13T15:16:34.432220+0000","last_active":"2024-09-13T15:16:34.432148+0000","last_peered":"2024-09-13T15:16:34.432148+0000","last_clean":"2024-09-13T15:16:34.432148+0000","last_became_active":"2024-09-13T15:01:44.424714+0000","last_became_peered":"2024-09-13T15:01:44.424714+0000","last_unstale":"2024-09-13T15:16:34.432148+0000","last_undegraded":"2024-09-13T15:16:34.432148+0000","last_fullsized":"2024-09-13T15:16:34.432148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-13T15:16:34.432129+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-13T15:16:34.432129+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.432129+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:01.436564+0000","scrub_duration":0.0064639520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":15,"num_write":18,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'4809","reported_seq":4857,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:56.556835+0000","last_change":"2024-09-13T15:16:56.557113+0000","last_active":"2024-09-13T15:16:56.556835+0000","last_peered":"2024-09-13T15:16:56.556835+0000","last_clean":"2024-09-13T15:16:56.556835+0000","last_became_active":"2024-09-13T15:02:33.752505+0000","last_became_peered":"2024-09-13T15:02:33.752505+0000","last_unstale":"2024-09-13T15:16:56.556835+0000","last_undegraded":"2024-09-13T15:16:56.556835+0000","last_fullsized":"2024-09-13T15:16:56.556835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4809","last_scrub_stamp":"2024-09-13T15:16:56.556771+0000","last_deep_scrub":"33'4809","last_deep_scrub_stamp":"2024-09-13T15:16:56.556771+0000","last_clean_scrub_stamp":"2024-09-13T15:16:56.556771+0000","objects_scrubbed":0,"log_size":4809,"log_dups_size":0,"ondisk_log_size":4809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:34.746748+0000","scrub_duration":0.082653001000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69744,"num_write_kb":999376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"33'11","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:44.289532+0000","last_change":"2024-09-13T15:16:44.289614+0000","last_active":"2024-09-13T15:16:44.289532+0000","last_peered":"2024-09-13T15:16:44.289532+0000","last_clean":"2024-09-13T15:16:44.289532+0000","last_became_active":"2024-09-13T15:01:44.836750+0000","last_became_peered":"2024-09-13T15:01:44.836750+0000","last_unstale":"2024-09-13T15:16:44.289532+0000","last_undegraded":"2024-09-13T15:16:44.289532+0000","last_fullsized":"2024-09-13T15:16:44.289532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:44.289512+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:44.289512+0000","last_clean_scrub_stamp":"2024-09-13T15:16:44.289512+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:49.109457+0000","scrub_duration":0.0024700170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"33'14","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:31.641077+0000","last_change":"2024-09-13T15:16:31.641324+0000","last_active":"2024-09-13T15:16:31.641077+0000","last_peered":"2024-09-13T15:16:31.641077+0000","last_clean":"2024-09-13T15:16:31.641077+0000","last_became_active":"2024-09-13T15:01:44.437433+0000","last_became_peered":"2024-09-13T15:01:44.437433+0000","last_unstale":"2024-09-13T15:16:31.641077+0000","last_undegraded":"2024-09-13T15:16:31.641077+0000","last_fullsized":"2024-09-13T15:16:31.641077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:31.641025+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:31.641025+0000","last_clean_scrub_stamp":"2024-09-13T15:16:31.641025+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:08.039896+0000","scrub_duration":0.0069456680000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":18,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'4904","reported_seq":4942,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:54.936692+0000","last_change":"2024-09-13T15:16:54.936843+0000","last_active":"2024-09-13T15:16:54.936692+0000","last_peered":"2024-09-13T15:16:54.936692+0000","last_clean":"2024-09-13T15:16:54.936692+0000","last_became_active":"2024-09-13T15:01:48.841267+0000","last_became_peered":"2024-09-13T15:01:48.841267+0000","last_unstale":"2024-09-13T15:16:54.936692+0000","last_undegraded":"2024-09-13T15:16:54.936692+0000","last_fullsized":"2024-09-13T15:16:54.936692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4904","last_scrub_stamp":"2024-09-13T15:16:54.936672+0000","last_deep_scrub":"33'4904","last_deep_scrub_stamp":"2024-09-13T15:16:54.936672+0000","last_clean_scrub_stamp":"2024-09-13T15:16:54.936672+0000","objects_scrubbed":0,"log_size":4904,"log_dups_size":0,"ondisk_log_size":4904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:54.982378+0000","scrub_duration":0.053950104999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71251,"num_write_kb":1004130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:42.644422+0000","last_change":"2024-09-13T15:16:42.644621+0000","last_active":"2024-09-13T15:16:42.644422+0000","last_peered":"2024-09-13T15:16:42.644422+0000","last_clean":"2024-09-13T15:16:42.644422+0000","last_became_active":"2024-09-13T15:01:44.843982+0000","last_became_peered":"2024-09-13T15:01:44.843982+0000","last_unstale":"2024-09-13T15:16:42.644422+0000","last_undegraded":"2024-09-13T15:16:42.644422+0000","last_fullsized":"2024-09-13T15:16:42.644422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:42.644367+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:42.644367+0000","last_clean_scrub_stamp":"2024-09-13T15:16:42.644367+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:45.557277+0000","scrub_duration":0.003222496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"33'18","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:32.864296+0000","last_change":"2024-09-13T15:16:32.864508+0000","last_active":"2024-09-13T15:16:32.864296+0000","last_peered":"2024-09-13T15:16:32.864296+0000","last_clean":"2024-09-13T15:16:32.864296+0000","last_became_active":"2024-09-13T15:01:44.435367+0000","last_became_peered":"2024-09-13T15:01:44.435367+0000","last_unstale":"2024-09-13T15:16:32.864296+0000","last_undegraded":"2024-09-13T15:16:32.864296+0000","last_fullsized":"2024-09-13T15:16:32.864296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T15:16:32.864235+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T15:16:32.864235+0000","last_clean_scrub_stamp":"2024-09-13T15:16:32.864235+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:20.427017+0000","scrub_duration":0.0072294949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"33'3940","reported_seq":3978,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:57.850695+0000","last_change":"2024-09-13T15:16:57.850836+0000","last_active":"2024-09-13T15:16:57.850695+0000","last_peered":"2024-09-13T15:16:57.850695+0000","last_clean":"2024-09-13T15:16:57.850695+0000","last_became_active":"2024-09-13T15:01:48.909681+0000","last_became_peered":"2024-09-13T15:01:48.909681+0000","last_unstale":"2024-09-13T15:16:57.850695+0000","last_undegraded":"2024-09-13T15:16:57.850695+0000","last_fullsized":"2024-09-13T15:16:57.850695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3940","last_scrub_stamp":"2024-09-13T15:16:57.850672+0000","last_deep_scrub":"33'3940","last_deep_scrub_stamp":"2024-09-13T15:16:57.850672+0000","last_clean_scrub_stamp":"2024-09-13T15:16:57.850672+0000","objects_scrubbed":0,"log_size":3940,"log_dups_size":0,"ondisk_log_size":3940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:26.658522+0000","scrub_duration":0.046163484999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57394,"num_write_kb":843085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'3678","reported_seq":3716,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.035337+0000","last_change":"2024-09-13T15:02:34.118951+0000","last_active":"2024-09-13T15:16:24.035337+0000","last_peered":"2024-09-13T15:16:24.035337+0000","last_clean":"2024-09-13T15:16:24.035337+0000","last_became_active":"2024-09-13T15:02:34.118477+0000","last_became_peered":"2024-09-13T15:02:34.118477+0000","last_unstale":"2024-09-13T15:16:24.035337+0000","last_undegraded":"2024-09-13T15:16:24.035337+0000","last_fullsized":"2024-09-13T15:16:24.035337+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53439,"num_write_kb":757724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'11","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:41.369001+0000","last_change":"2024-09-13T15:16:41.369073+0000","last_active":"2024-09-13T15:16:41.369001+0000","last_peered":"2024-09-13T15:16:41.369001+0000","last_clean":"2024-09-13T15:16:41.369001+0000","last_became_active":"2024-09-13T15:01:44.807641+0000","last_became_peered":"2024-09-13T15:01:44.807641+0000","last_unstale":"2024-09-13T15:16:41.369001+0000","last_undegraded":"2024-09-13T15:16:41.369001+0000","last_fullsized":"2024-09-13T15:16:41.369001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:41.368984+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:41.368984+0000","last_clean_scrub_stamp":"2024-09-13T15:16:41.368984+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:10.060267+0000","scrub_duration":0.0013486590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"33'38","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:25.574908+0000","last_change":"2024-09-13T15:16:25.575105+0000","last_active":"2024-09-13T15:16:25.574908+0000","last_peered":"2024-09-13T15:16:25.574908+0000","last_clean":"2024-09-13T15:16:25.574908+0000","last_became_active":"2024-09-13T15:01:44.433124+0000","last_became_peered":"2024-09-13T15:01:44.433124+0000","last_unstale":"2024-09-13T15:16:25.574908+0000","last_undegraded":"2024-09-13T15:16:25.574908+0000","last_fullsized":"2024-09-13T15:16:25.574908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'38","last_scrub_stamp":"2024-09-13T15:16:25.574855+0000","last_deep_scrub":"33'38","last_deep_scrub_stamp":"2024-09-13T15:16:25.574855+0000","last_clean_scrub_stamp":"2024-09-13T15:16:25.574855+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:45.303091+0000","scrub_duration":0.033176627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":8193,"num_write":27,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4928","reported_seq":4956,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.022772+0000","last_change":"2024-09-13T15:01:48.855090+0000","last_active":"2024-09-13T15:16:24.022772+0000","last_peered":"2024-09-13T15:16:24.022772+0000","last_clean":"2024-09-13T15:16:24.022772+0000","last_became_active":"2024-09-13T15:01:48.852925+0000","last_became_peered":"2024-09-13T15:01:48.852925+0000","last_unstale":"2024-09-13T15:16:24.022772+0000","last_undegraded":"2024-09-13T15:16:24.022772+0000","last_fullsized":"2024-09-13T15:16:24.022772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4928,"log_dups_size":0,"ondisk_log_size":4928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71646,"num_write_kb":1060070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"33'13","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:56.238659+0000","last_change":"2024-09-13T15:16:56.238735+0000","last_active":"2024-09-13T15:16:56.238659+0000","last_peered":"2024-09-13T15:16:56.238659+0000","last_clean":"2024-09-13T15:16:56.238659+0000","last_became_active":"2024-09-13T15:02:33.746005+0000","last_became_peered":"2024-09-13T15:02:33.746005+0000","last_unstale":"2024-09-13T15:16:56.238659+0000","last_undegraded":"2024-09-13T15:16:56.238659+0000","last_fullsized":"2024-09-13T15:16:56.238659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T15:16:56.238642+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T15:16:56.238642+0000","last_clean_scrub_stamp":"2024-09-13T15:16:56.238642+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:49.877447+0000","scrub_duration":0.0013265359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"33'11","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:33.955676+0000","last_change":"2024-09-13T15:16:33.955756+0000","last_active":"2024-09-13T15:16:33.955676+0000","last_peered":"2024-09-13T15:16:33.955676+0000","last_clean":"2024-09-13T15:16:33.955676+0000","last_became_active":"2024-09-13T15:01:44.436646+0000","last_became_peered":"2024-09-13T15:01:44.436646+0000","last_unstale":"2024-09-13T15:16:33.955676+0000","last_undegraded":"2024-09-13T15:16:33.955676+0000","last_fullsized":"2024-09-13T15:16:33.955676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:33.955656+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:33.955656+0000","last_clean_scrub_stamp":"2024-09-13T15:16:33.955656+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:59.640305+0000","scrub_duration":0.0059488070000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":27,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"33'53","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.923151+0000","last_change":"2024-09-13T15:16:34.923151+0000","last_active":"2024-09-13T15:16:34.923151+0000","last_peered":"2024-09-13T15:16:34.923151+0000","last_clean":"2024-09-13T15:16:34.923151+0000","last_became_active":"2024-09-13T15:01:44.429339+0000","last_became_peered":"2024-09-13T15:01:44.429339+0000","last_unstale":"2024-09-13T15:16:34.923151+0000","last_undegraded":"2024-09-13T15:16:34.923151+0000","last_fullsized":"2024-09-13T15:16:34.923151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'53","last_scrub_stamp":"2024-09-13T15:16:34.922888+0000","last_deep_scrub":"33'53","last_deep_scrub_stamp":"2024-09-13T15:16:34.922888+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.922888+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:24.468558+0000","scrub_duration":0.034548224000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":8210,"num_write":46,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:33.344530+0000","last_change":"2024-09-13T15:16:33.344530+0000","last_active":"2024-09-13T15:16:33.344530+0000","last_peered":"2024-09-13T15:16:33.344530+0000","last_clean":"2024-09-13T15:16:33.344530+0000","last_became_active":"2024-09-13T15:01:44.821734+0000","last_became_peered":"2024-09-13T15:01:44.821734+0000","last_unstale":"2024-09-13T15:16:33.344530+0000","last_undegraded":"2024-09-13T15:16:33.344530+0000","last_fullsized":"2024-09-13T15:16:33.344530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:33.344436+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:33.344436+0000","last_clean_scrub_stamp":"2024-09-13T15:16:33.344436+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:18.534801+0000","scrub_duration":0.0023763030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"33'4710","reported_seq":4748,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:35.170988+0000","last_change":"2024-09-13T15:16:35.170988+0000","last_active":"2024-09-13T15:16:35.170988+0000","last_peered":"2024-09-13T15:16:35.170988+0000","last_clean":"2024-09-13T15:16:35.170988+0000","last_became_active":"2024-09-13T15:01:48.857584+0000","last_became_peered":"2024-09-13T15:01:48.857584+0000","last_unstale":"2024-09-13T15:16:35.170988+0000","last_undegraded":"2024-09-13T15:16:35.170988+0000","last_fullsized":"2024-09-13T15:16:35.170988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4710","last_scrub_stamp":"2024-09-13T15:16:35.170829+0000","last_deep_scrub":"33'4710","last_deep_scrub_stamp":"2024-09-13T15:16:35.170829+0000","last_clean_scrub_stamp":"2024-09-13T15:16:35.170829+0000","objects_scrubbed":0,"log_size":4710,"log_dups_size":0,"ondisk_log_size":4710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:45.991405+0000","scrub_duration":0.042675653000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68679,"num_write_kb":960930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"33'1786","reported_seq":1830,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:31.928330+0000","last_change":"2024-09-13T15:16:31.928330+0000","last_active":"2024-09-13T15:16:31.928330+0000","last_peered":"2024-09-13T15:16:31.928330+0000","last_clean":"2024-09-13T15:16:31.928330+0000","last_became_active":"2024-09-13T15:01:44.422367+0000","last_became_peered":"2024-09-13T15:01:44.422367+0000","last_unstale":"2024-09-13T15:16:31.928330+0000","last_undegraded":"2024-09-13T15:16:31.928330+0000","last_fullsized":"2024-09-13T15:16:31.928330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'1786","last_scrub_stamp":"2024-09-13T15:16:31.928065+0000","last_deep_scrub":"33'1786","last_deep_scrub_stamp":"2024-09-13T15:16:31.928065+0000","last_clean_scrub_stamp":"2024-09-13T15:16:31.928065+0000","objects_scrubbed":3,"log_size":1786,"log_dups_size":0,"ondisk_log_size":1786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:44.840912+0000","scrub_duration":0.023676508999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4098,"num_write":1776,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.230513+0000","last_change":"2024-09-13T15:16:24.080158+0000","last_active":"2024-09-13T15:16:24.230513+0000","last_peered":"2024-09-13T15:16:24.230513+0000","last_clean":"2024-09-13T15:16:24.230513+0000","last_became_active":"2024-09-13T15:01:44.816584+0000","last_became_peered":"2024-09-13T15:01:44.816584+0000","last_unstale":"2024-09-13T15:16:24.230513+0000","last_undegraded":"2024-09-13T15:16:24.230513+0000","last_fullsized":"2024-09-13T15:16:24.230513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:24.080065+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:24.080065+0000","last_clean_scrub_stamp":"2024-09-13T15:16:24.080065+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:18.277593+0000","scrub_duration":0.0033993309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4724","reported_seq":4751,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.257077+0000","last_change":"2024-09-13T15:01:48.840771+0000","last_active":"2024-09-13T15:16:24.257077+0000","last_peered":"2024-09-13T15:16:24.257077+0000","last_clean":"2024-09-13T15:16:24.257077+0000","last_became_active":"2024-09-13T15:01:48.840397+0000","last_became_peered":"2024-09-13T15:01:48.840397+0000","last_unstale":"2024-09-13T15:16:24.257077+0000","last_undegraded":"2024-09-13T15:16:24.257077+0000","last_fullsized":"2024-09-13T15:16:24.257077+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:47.796184+0000","last_clean_scrub_stamp":"2024-09-13T15:01:47.796184+0000","objects_scrubbed":0,"log_size":4724,"log_dups_size":0,"ondisk_log_size":4724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68744,"num_write_kb":983871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"33'14","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:56.883362+0000","last_change":"2024-09-13T15:16:56.883575+0000","last_active":"2024-09-13T15:16:56.883362+0000","last_peered":"2024-09-13T15:16:56.883362+0000","last_clean":"2024-09-13T15:16:56.883362+0000","last_became_active":"2024-09-13T15:01:44.808669+0000","last_became_peered":"2024-09-13T15:01:44.808669+0000","last_unstale":"2024-09-13T15:16:56.883362+0000","last_undegraded":"2024-09-13T15:16:56.883362+0000","last_fullsized":"2024-09-13T15:16:56.883362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:56.883310+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:56.883310+0000","last_clean_scrub_stamp":"2024-09-13T15:16:56.883310+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:50.733643+0000","scrub_duration":0.0027636959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"33'13","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:31.136709+0000","last_change":"2024-09-13T15:16:31.136790+0000","last_active":"2024-09-13T15:16:31.136709+0000","last_peered":"2024-09-13T15:16:31.136709+0000","last_clean":"2024-09-13T15:16:31.136709+0000","last_became_active":"2024-09-13T15:01:44.836102+0000","last_became_peered":"2024-09-13T15:01:44.836102+0000","last_unstale":"2024-09-13T15:16:31.136709+0000","last_undegraded":"2024-09-13T15:16:31.136709+0000","last_fullsized":"2024-09-13T15:16:31.136709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T15:16:31.136690+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T15:16:31.136690+0000","last_clean_scrub_stamp":"2024-09-13T15:16:31.136690+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:55.607725+0000","scrub_duration":0.0019713320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"33'10","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:32.625887+0000","last_change":"2024-09-13T15:16:32.626112+0000","last_active":"2024-09-13T15:16:32.625887+0000","last_peered":"2024-09-13T15:16:32.625887+0000","last_clean":"2024-09-13T15:16:32.625887+0000","last_became_active":"2024-09-13T15:01:44.846506+0000","last_became_peered":"2024-09-13T15:01:44.846506+0000","last_unstale":"2024-09-13T15:16:32.625887+0000","last_undegraded":"2024-09-13T15:16:32.625887+0000","last_fullsized":"2024-09-13T15:16:32.625887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T15:16:32.625828+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T15:16:32.625828+0000","last_clean_scrub_stamp":"2024-09-13T15:16:32.625828+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:38.132404+0000","scrub_duration":0.002756784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"33'10","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:38.251444+0000","last_change":"2024-09-13T15:16:38.251543+0000","last_active":"2024-09-13T15:16:38.251444+0000","last_peered":"2024-09-13T15:16:38.251444+0000","last_clean":"2024-09-13T15:16:38.251444+0000","last_became_active":"2024-09-13T15:01:44.809585+0000","last_became_peered":"2024-09-13T15:01:44.809585+0000","last_unstale":"2024-09-13T15:16:38.251444+0000","last_undegraded":"2024-09-13T15:16:38.251444+0000","last_fullsized":"2024-09-13T15:16:38.251444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T15:16:38.251426+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T15:16:38.251426+0000","last_clean_scrub_stamp":"2024-09-13T15:16:38.251426+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:13:40.307246+0000","scrub_duration":0.0015167939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:40.948205+0000","last_change":"2024-09-13T15:16:40.948205+0000","last_active":"2024-09-13T15:16:40.948205+0000","last_peered":"2024-09-13T15:16:40.948205+0000","last_clean":"2024-09-13T15:16:40.948205+0000","last_became_active":"2024-09-13T15:01:44.816480+0000","last_became_peered":"2024-09-13T15:01:44.816480+0000","last_unstale":"2024-09-13T15:16:40.948205+0000","last_undegraded":"2024-09-13T15:16:40.948205+0000","last_fullsized":"2024-09-13T15:16:40.948205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T15:16:40.948080+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T15:16:40.948080+0000","last_clean_scrub_stamp":"2024-09-13T15:16:40.948080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:44:09.162042+0000","scrub_duration":0.0024445700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.177350+0000","last_change":"2024-09-13T15:16:20.596249+0000","last_active":"2024-09-13T15:16:24.177350+0000","last_peered":"2024-09-13T15:16:24.177350+0000","last_clean":"2024-09-13T15:16:24.177350+0000","last_became_active":"2024-09-13T15:01:44.807622+0000","last_became_peered":"2024-09-13T15:01:44.807622+0000","last_unstale":"2024-09-13T15:16:24.177350+0000","last_undegraded":"2024-09-13T15:16:24.177350+0000","last_fullsized":"2024-09-13T15:16:24.177350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:20.596153+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:20.596153+0000","last_clean_scrub_stamp":"2024-09-13T15:16:20.596153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:27:28.285632+0000","scrub_duration":0.0016568729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"33'19","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:45.892738+0000","last_change":"2024-09-13T15:16:45.892738+0000","last_active":"2024-09-13T15:16:45.892738+0000","last_peered":"2024-09-13T15:16:45.892738+0000","last_clean":"2024-09-13T15:16:45.892738+0000","last_became_active":"2024-09-13T15:01:44.831889+0000","last_became_peered":"2024-09-13T15:01:44.831889+0000","last_unstale":"2024-09-13T15:16:45.892738+0000","last_undegraded":"2024-09-13T15:16:45.892738+0000","last_fullsized":"2024-09-13T15:16:45.892738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:45.892453+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:45.892453+0000","last_clean_scrub_stamp":"2024-09-13T15:16:45.892453+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:35.870588+0000","scrub_duration":0.0037740270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"33'5","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.973364+0000","last_change":"2024-09-13T15:16:46.973489+0000","last_active":"2024-09-13T15:16:46.973364+0000","last_peered":"2024-09-13T15:16:46.973364+0000","last_clean":"2024-09-13T15:16:46.973364+0000","last_became_active":"2024-09-13T15:01:44.817350+0000","last_became_peered":"2024-09-13T15:01:44.817350+0000","last_unstale":"2024-09-13T15:16:46.973364+0000","last_undegraded":"2024-09-13T15:16:46.973364+0000","last_fullsized":"2024-09-13T15:16:46.973364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T15:16:46.973340+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T15:16:46.973340+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.973340+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:24.189302+0000","scrub_duration":0.0028596519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"33'10","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.614046+0000","last_change":"2024-09-13T15:16:34.614046+0000","last_active":"2024-09-13T15:16:34.614046+0000","last_peered":"2024-09-13T15:16:34.614046+0000","last_clean":"2024-09-13T15:16:34.614046+0000","last_became_active":"2024-09-13T15:01:44.837588+0000","last_became_peered":"2024-09-13T15:01:44.837588+0000","last_unstale":"2024-09-13T15:16:34.614046+0000","last_undegraded":"2024-09-13T15:16:34.614046+0000","last_fullsized":"2024-09-13T15:16:34.614046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T15:16:34.613780+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T15:16:34.613780+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.613780+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:41.237672+0000","scrub_duration":0.0026563189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"33'11","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:41.992598+0000","last_change":"2024-09-13T15:16:41.992681+0000","last_active":"2024-09-13T15:16:41.992598+0000","last_peered":"2024-09-13T15:16:41.992598+0000","last_clean":"2024-09-13T15:16:41.992598+0000","last_became_active":"2024-09-13T15:01:44.827910+0000","last_became_peered":"2024-09-13T15:01:44.827910+0000","last_unstale":"2024-09-13T15:16:41.992598+0000","last_undegraded":"2024-09-13T15:16:41.992598+0000","last_fullsized":"2024-09-13T15:16:41.992598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:41.992580+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:41.992580+0000","last_clean_scrub_stamp":"2024-09-13T15:16:41.992580+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:17.653254+0000","scrub_duration":0.0021428760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"33'11","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.126418+0000","last_change":"2024-09-13T15:16:46.126559+0000","last_active":"2024-09-13T15:16:46.126418+0000","last_peered":"2024-09-13T15:16:46.126418+0000","last_clean":"2024-09-13T15:16:46.126418+0000","last_became_active":"2024-09-13T15:02:34.118621+0000","last_became_peered":"2024-09-13T15:02:34.118621+0000","last_unstale":"2024-09-13T15:16:46.126418+0000","last_undegraded":"2024-09-13T15:16:46.126418+0000","last_fullsized":"2024-09-13T15:16:46.126418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:46.126393+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:46.126393+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.126393+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:28.249838+0000","scrub_duration":0.0026115209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"33'14","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:47.262085+0000","last_change":"2024-09-13T15:16:47.262190+0000","last_active":"2024-09-13T15:16:47.262085+0000","last_peered":"2024-09-13T15:16:47.262085+0000","last_clean":"2024-09-13T15:16:47.262085+0000","last_became_active":"2024-09-13T15:01:44.831495+0000","last_became_peered":"2024-09-13T15:01:44.831495+0000","last_unstale":"2024-09-13T15:16:47.262085+0000","last_undegraded":"2024-09-13T15:16:47.262085+0000","last_fullsized":"2024-09-13T15:16:47.262085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:47.262063+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:47.262063+0000","last_clean_scrub_stamp":"2024-09-13T15:16:47.262063+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:35.471712+0000","scrub_duration":0.0025945270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"33'11","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.904712+0000","last_change":"2024-09-13T15:16:46.904991+0000","last_active":"2024-09-13T15:16:46.904712+0000","last_peered":"2024-09-13T15:16:46.904712+0000","last_clean":"2024-09-13T15:16:46.904712+0000","last_became_active":"2024-09-13T15:01:44.828999+0000","last_became_peered":"2024-09-13T15:01:44.828999+0000","last_unstale":"2024-09-13T15:16:46.904712+0000","last_undegraded":"2024-09-13T15:16:46.904712+0000","last_fullsized":"2024-09-13T15:16:46.904712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:46.904653+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:46.904653+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.904653+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:23.576664+0000","scrub_duration":0.0029663189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"33'9","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:57.857900+0000","last_change":"2024-09-13T15:16:57.858095+0000","last_active":"2024-09-13T15:16:57.857900+0000","last_peered":"2024-09-13T15:16:57.857900+0000","last_clean":"2024-09-13T15:16:57.857900+0000","last_became_active":"2024-09-13T15:01:44.816258+0000","last_became_peered":"2024-09-13T15:01:44.816258+0000","last_unstale":"2024-09-13T15:16:57.857900+0000","last_undegraded":"2024-09-13T15:16:57.857900+0000","last_fullsized":"2024-09-13T15:16:57.857900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:57.857844+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:57.857844+0000","last_clean_scrub_stamp":"2024-09-13T15:16:57.857844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:27.484892+0000","scrub_duration":0.0023279020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"33'19","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:29.104737+0000","last_change":"2024-09-13T15:16:29.104820+0000","last_active":"2024-09-13T15:16:29.104737+0000","last_peered":"2024-09-13T15:16:29.104737+0000","last_clean":"2024-09-13T15:16:29.104737+0000","last_became_active":"2024-09-13T15:01:44.809687+0000","last_became_peered":"2024-09-13T15:01:44.809687+0000","last_unstale":"2024-09-13T15:16:29.104737+0000","last_undegraded":"2024-09-13T15:16:29.104737+0000","last_fullsized":"2024-09-13T15:16:29.104737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:29.104716+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:29.104716+0000","last_clean_scrub_stamp":"2024-09-13T15:16:29.104716+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:42:33.959556+0000","scrub_duration":0.0023385429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"33'11","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:48.131258+0000","last_change":"2024-09-13T15:16:48.131340+0000","last_active":"2024-09-13T15:16:48.131258+0000","last_peered":"2024-09-13T15:16:48.131258+0000","last_clean":"2024-09-13T15:16:48.131258+0000","last_became_active":"2024-09-13T15:02:34.118798+0000","last_became_peered":"2024-09-13T15:02:34.118798+0000","last_unstale":"2024-09-13T15:16:48.131258+0000","last_undegraded":"2024-09-13T15:16:48.131258+0000","last_fullsized":"2024-09-13T15:16:48.131258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:48.131238+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:48.131238+0000","last_clean_scrub_stamp":"2024-09-13T15:16:48.131238+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:33.220146+0000","scrub_duration":0.002534644,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"33'11","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:51.697042+0000","last_change":"2024-09-13T15:16:51.697248+0000","last_active":"2024-09-13T15:16:51.697042+0000","last_peered":"2024-09-13T15:16:51.697042+0000","last_clean":"2024-09-13T15:16:51.697042+0000","last_became_active":"2024-09-13T15:01:44.846074+0000","last_became_peered":"2024-09-13T15:01:44.846074+0000","last_unstale":"2024-09-13T15:16:51.697042+0000","last_undegraded":"2024-09-13T15:16:51.697042+0000","last_fullsized":"2024-09-13T15:16:51.697042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:51.696990+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:51.696990+0000","last_clean_scrub_stamp":"2024-09-13T15:16:51.696990+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:47.001747+0000","scrub_duration":0.002759938,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"33'11","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:39.422600+0000","last_change":"2024-09-13T15:16:39.422675+0000","last_active":"2024-09-13T15:16:39.422600+0000","last_peered":"2024-09-13T15:16:39.422600+0000","last_clean":"2024-09-13T15:16:39.422600+0000","last_became_active":"2024-09-13T15:01:44.828024+0000","last_became_peered":"2024-09-13T15:01:44.828024+0000","last_unstale":"2024-09-13T15:16:39.422600+0000","last_undegraded":"2024-09-13T15:16:39.422600+0000","last_fullsized":"2024-09-13T15:16:39.422600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:39.422580+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:39.422580+0000","last_clean_scrub_stamp":"2024-09-13T15:16:39.422580+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:23.054857+0000","scrub_duration":0.0024637970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'10","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:53.196421+0000","last_change":"2024-09-13T15:16:53.196528+0000","last_active":"2024-09-13T15:16:53.196421+0000","last_peered":"2024-09-13T15:16:53.196421+0000","last_clean":"2024-09-13T15:16:53.196421+0000","last_became_active":"2024-09-13T15:01:44.808609+0000","last_became_peered":"2024-09-13T15:01:44.808609+0000","last_unstale":"2024-09-13T15:16:53.196421+0000","last_undegraded":"2024-09-13T15:16:53.196421+0000","last_fullsized":"2024-09-13T15:16:53.196421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T15:16:53.196397+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T15:16:53.196397+0000","last_clean_scrub_stamp":"2024-09-13T15:16:53.196397+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:32.009203+0000","scrub_duration":0.00170444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"33'11","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:29.866264+0000","last_change":"2024-09-13T15:16:29.866373+0000","last_active":"2024-09-13T15:16:29.866264+0000","last_peered":"2024-09-13T15:16:29.866264+0000","last_clean":"2024-09-13T15:16:29.866264+0000","last_became_active":"2024-09-13T15:01:44.809918+0000","last_became_peered":"2024-09-13T15:01:44.809918+0000","last_unstale":"2024-09-13T15:16:29.866264+0000","last_undegraded":"2024-09-13T15:16:29.866264+0000","last_fullsized":"2024-09-13T15:16:29.866264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:29.866245+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:29.866245+0000","last_clean_scrub_stamp":"2024-09-13T15:16:29.866245+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:11.754182+0000","scrub_duration":0.0021947170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:30.138653+0000","last_change":"2024-09-13T15:16:30.138848+0000","last_active":"2024-09-13T15:16:30.138653+0000","last_peered":"2024-09-13T15:16:30.138653+0000","last_clean":"2024-09-13T15:16:30.138653+0000","last_became_active":"2024-09-13T15:01:44.828737+0000","last_became_peered":"2024-09-13T15:01:44.828737+0000","last_unstale":"2024-09-13T15:16:30.138653+0000","last_undegraded":"2024-09-13T15:16:30.138653+0000","last_fullsized":"2024-09-13T15:16:30.138653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:30.138598+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:30.138598+0000","last_clean_scrub_stamp":"2024-09-13T15:16:30.138598+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:12.240506+0000","scrub_duration":0.0030438290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:54.909482+0000","last_change":"2024-09-13T15:16:54.909891+0000","last_active":"2024-09-13T15:16:54.909482+0000","last_peered":"2024-09-13T15:16:54.909482+0000","last_clean":"2024-09-13T15:16:54.909482+0000","last_became_active":"2024-09-13T15:01:44.850410+0000","last_became_peered":"2024-09-13T15:01:44.850410+0000","last_unstale":"2024-09-13T15:16:54.909482+0000","last_undegraded":"2024-09-13T15:16:54.909482+0000","last_fullsized":"2024-09-13T15:16:54.909482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:54.909424+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:54.909424+0000","last_clean_scrub_stamp":"2024-09-13T15:16:54.909424+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:46:18.893400+0000","scrub_duration":0.0032718840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"33'17","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:57.846402+0000","last_change":"2024-09-13T15:16:57.846648+0000","last_active":"2024-09-13T15:16:57.846402+0000","last_peered":"2024-09-13T15:16:57.846402+0000","last_clean":"2024-09-13T15:16:57.846402+0000","last_became_active":"2024-09-13T15:01:44.839371+0000","last_became_peered":"2024-09-13T15:01:44.839371+0000","last_unstale":"2024-09-13T15:16:57.846402+0000","last_undegraded":"2024-09-13T15:16:57.846402+0000","last_fullsized":"2024-09-13T15:16:57.846402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'17","last_scrub_stamp":"2024-09-13T15:16:57.846335+0000","last_deep_scrub":"33'17","last_deep_scrub_stamp":"2024-09-13T15:16:57.846335+0000","last_clean_scrub_stamp":"2024-09-13T15:16:57.846335+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:25.103988+0000","scrub_duration":0.0040927480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"33'12","reported_seq":40,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.785070+0000","last_change":"2024-09-13T15:01:44.850416+0000","last_active":"2024-09-13T15:16:23.785070+0000","last_peered":"2024-09-13T15:16:23.785070+0000","last_clean":"2024-09-13T15:16:23.785070+0000","last_became_active":"2024-09-13T15:01:44.849766+0000","last_became_peered":"2024-09-13T15:01:44.849766+0000","last_unstale":"2024-09-13T15:16:23.785070+0000","last_undegraded":"2024-09-13T15:16:23.785070+0000","last_fullsized":"2024-09-13T15:16:23.785070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"33'9","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.938178+0000","last_change":"2024-09-13T15:16:26.938178+0000","last_active":"2024-09-13T15:16:26.938178+0000","last_peered":"2024-09-13T15:16:26.938178+0000","last_clean":"2024-09-13T15:16:26.938178+0000","last_became_active":"2024-09-13T15:01:44.836770+0000","last_became_peered":"2024-09-13T15:01:44.836770+0000","last_unstale":"2024-09-13T15:16:26.938178+0000","last_undegraded":"2024-09-13T15:16:26.938178+0000","last_fullsized":"2024-09-13T15:16:26.938178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:26.938077+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:26.938077+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.938077+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:49.727468+0000","scrub_duration":0.0024780219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'8","reported_seq":36,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.223953+0000","last_change":"2024-09-13T15:01:44.815867+0000","last_active":"2024-09-13T15:16:24.223953+0000","last_peered":"2024-09-13T15:16:24.223953+0000","last_clean":"2024-09-13T15:16:24.223953+0000","last_became_active":"2024-09-13T15:01:44.815116+0000","last_became_peered":"2024-09-13T15:01:44.815116+0000","last_unstale":"2024-09-13T15:16:24.223953+0000","last_undegraded":"2024-09-13T15:16:24.223953+0000","last_fullsized":"2024-09-13T15:16:24.223953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:53.715759+0000","last_change":"2024-09-13T15:16:53.715967+0000","last_active":"2024-09-13T15:16:53.715759+0000","last_peered":"2024-09-13T15:16:53.715759+0000","last_clean":"2024-09-13T15:16:53.715759+0000","last_became_active":"2024-09-13T15:01:44.849533+0000","last_became_peered":"2024-09-13T15:01:44.849533+0000","last_unstale":"2024-09-13T15:16:53.715759+0000","last_undegraded":"2024-09-13T15:16:53.715759+0000","last_fullsized":"2024-09-13T15:16:53.715759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:53.715707+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:53.715707+0000","last_clean_scrub_stamp":"2024-09-13T15:16:53.715707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:42.062562+0000","scrub_duration":0.0033990539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"33'5","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:58.875049+0000","last_change":"2024-09-13T15:16:58.875265+0000","last_active":"2024-09-13T15:16:58.875049+0000","last_peered":"2024-09-13T15:16:58.875049+0000","last_clean":"2024-09-13T15:16:58.875049+0000","last_became_active":"2024-09-13T15:01:44.816416+0000","last_became_peered":"2024-09-13T15:01:44.816416+0000","last_unstale":"2024-09-13T15:16:58.875049+0000","last_undegraded":"2024-09-13T15:16:58.875049+0000","last_fullsized":"2024-09-13T15:16:58.875049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T15:16:58.874995+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T15:16:58.874995+0000","last_clean_scrub_stamp":"2024-09-13T15:16:58.874995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:36.770217+0000","scrub_duration":0.0025367900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"33'8","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:44.144359+0000","last_change":"2024-09-13T15:16:44.144455+0000","last_active":"2024-09-13T15:16:44.144359+0000","last_peered":"2024-09-13T15:16:44.144359+0000","last_clean":"2024-09-13T15:16:44.144359+0000","last_became_active":"2024-09-13T15:02:33.747405+0000","last_became_peered":"2024-09-13T15:02:33.747405+0000","last_unstale":"2024-09-13T15:16:44.144359+0000","last_undegraded":"2024-09-13T15:16:44.144359+0000","last_fullsized":"2024-09-13T15:16:44.144359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:44.144337+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:44.144337+0000","last_clean_scrub_stamp":"2024-09-13T15:16:44.144337+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:30.857496+0000","scrub_duration":0.0014038189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.891346+0000","last_change":"2024-09-13T15:16:19.392504+0000","last_active":"2024-09-13T15:16:23.891346+0000","last_peered":"2024-09-13T15:16:23.891346+0000","last_clean":"2024-09-13T15:16:23.891346+0000","last_became_active":"2024-09-13T15:01:44.807776+0000","last_became_peered":"2024-09-13T15:01:44.807776+0000","last_unstale":"2024-09-13T15:16:23.891346+0000","last_undegraded":"2024-09-13T15:16:23.891346+0000","last_fullsized":"2024-09-13T15:16:23.891346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T15:16:19.392397+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T15:16:19.392397+0000","last_clean_scrub_stamp":"2024-09-13T15:16:19.392397+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:54.356146+0000","scrub_duration":0.0023579180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"33'3","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:35.447363+0000","last_change":"2024-09-13T15:16:35.447440+0000","last_active":"2024-09-13T15:16:35.447363+0000","last_peered":"2024-09-13T15:16:35.447363+0000","last_clean":"2024-09-13T15:16:35.447363+0000","last_became_active":"2024-09-13T15:01:44.803977+0000","last_became_peered":"2024-09-13T15:01:44.803977+0000","last_unstale":"2024-09-13T15:16:35.447363+0000","last_undegraded":"2024-09-13T15:16:35.447363+0000","last_fullsized":"2024-09-13T15:16:35.447363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T15:16:35.447342+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T15:16:35.447342+0000","last_clean_scrub_stamp":"2024-09-13T15:16:35.447342+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:40.015172+0000","scrub_duration":0.001429317,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"33'12","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.007169+0000","last_change":"2024-09-13T15:01:44.824666+0000","last_active":"2024-09-13T15:16:24.007169+0000","last_peered":"2024-09-13T15:16:24.007169+0000","last_clean":"2024-09-13T15:16:24.007169+0000","last_became_active":"2024-09-13T15:01:44.815381+0000","last_became_peered":"2024-09-13T15:01:44.815381+0000","last_unstale":"2024-09-13T15:16:24.007169+0000","last_undegraded":"2024-09-13T15:16:24.007169+0000","last_fullsized":"2024-09-13T15:16:24.007169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2171149,"num_write_kb":31079058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149321,"ondisk_log_size":149321,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":615,"ondisk_log_size":615,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":108901497,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":501,"num_read_kb":110953,"num_write":3247,"num_write_kb":107181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":55628,"num_omap_keys":107,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":218046464,"data_stored":217802994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3352,"ondisk_log_size":3352,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542331,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":959312,"kb_used_data":46024,"kb_used_omap":1,"kb_used_meta":913278,"kb_avail":93412528,"statfs":{"total":96636764160,"available":95654428672,"internally_reserved":0,"allocated":47128576,"data_stored":46890816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":935197131},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":4.9580000000000002,"5min":7.657,"15min":4.8689999999999998},"min":{"1min":0.497,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":108.818,"5min":254.13499999999999,"15min":254.13499999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":5.016,"5min":7.7190000000000003,"15min":4.883},"min":{"1min":0.46100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":108.85299999999999,"5min":254.119,"15min":254.119},"last":0.78600000000000003}]},{"osd":1,"last update":"Fri Sep 13 15:16:00 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":14.494999999999999,"15min":8.6910000000000007},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.29999999999999999},"max":{"1min":4.3449999999999998,"5min":281.399,"15min":281.399},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":12.275,"15min":9.9440000000000008},"min":{"1min":0.41099999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.3120000000000003,"5min":265.74299999999999,"15min":557.92399999999998},"last":0.83899999999999997}]},{"osd":2,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":5.1769999999999996,"5min":9.6869999999999994,"15min":5.5309999999999997},"min":{"1min":0.47099999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":119.023,"5min":280.29700000000003,"15min":280.29700000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":5.2130000000000001,"5min":9.0009999999999994,"15min":5.2590000000000003},"min":{"1min":0.48299999999999998,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":115.961,"5min":274.03500000000003,"15min":274.03500000000003},"last":0.94099999999999995}]},{"osd":3,"last update":"Fri Sep 13 15:16:03 2024","interfaces":[{"interface":"back","average":{"1min":1,"5min":10.202999999999999,"15min":6.407},"min":{"1min":0.377,"5min":0.377,"15min":0.32300000000000001},"max":{"1min":5.0300000000000002,"5min":261.36000000000001,"15min":261.36000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.94399999999999995,"5min":7.5250000000000004,"15min":5.0149999999999997},"min":{"1min":0.502,"5min":0.37,"15min":0.29599999999999999},"max":{"1min":5.2889999999999997,"5min":252.90000000000001,"15min":252.90000000000001},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":2.141,"15min":1.3029999999999999},"min":{"1min":0.60199999999999998,"5min":0.248,"15min":0.23699999999999999},"max":{"1min":2.0089999999999999,"5min":20.928999999999998,"15min":20.928999999999998},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":2.2869999999999999,"15min":1.379},"min":{"1min":0.61199999999999999,"5min":0.254,"15min":0.24199999999999999},"max":{"1min":6.4589999999999996,"5min":20.893000000000001,"15min":20.893000000000001},"last":0.98299999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.123,"15min":1.093},"min":{"1min":0.30299999999999999,"5min":0.248,"15min":0.248},"max":{"1min":1.2869999999999999,"5min":11.800000000000001,"15min":11.800000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.02,"5min":1.0649999999999999,"15min":1.014},"min":{"1min":0.34100000000000003,"5min":0.252,"15min":0.252},"max":{"1min":2.625,"5min":8.593,"15min":8.593},"last":1.0109999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.988,"15min":1.377},"min":{"1min":0.42899999999999999,"5min":0.29699999999999999,"15min":0.27700000000000002},"max":{"1min":2.677,"5min":20.835000000000001,"15min":20.835000000000001},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.177,"5min":1.716,"15min":1.244},"min":{"1min":0.53900000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":4.9550000000000001,"5min":21.518000000000001,"15min":21.518000000000001},"last":1.1499999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542332,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1195488,"kb_used_data":28824,"kb_used_omap":1,"kb_used_meta":1166654,"kb_avail":93176352,"statfs":{"total":96636764160,"available":95412584448,"internally_reserved":0,"allocated":29515776,"data_stored":29292897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1194654151},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":11.609999999999999,"15min":5.5949999999999998},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":9.6809999999999992,"5min":343.02800000000002,"15min":343.02800000000002},"last":0.46700000000000003},{"interface":"front","average":{"1min":1.325,"5min":11.821999999999999,"15min":5.4180000000000001},"min":{"1min":0.45900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":9.5060000000000002,"5min":370.00099999999998,"15min":370.00099999999998},"last":0.56100000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":11.769,"15min":6.1059999999999999},"min":{"1min":0.46600000000000003,"5min":0.317,"15min":0.26900000000000002},"max":{"1min":9.6489999999999991,"5min":236.12100000000001,"15min":236.12100000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.4990000000000001,"5min":13.35,"15min":7.2480000000000002},"min":{"1min":0.52300000000000002,"5min":0.35099999999999998,"15min":0.32300000000000001},"max":{"1min":9.5340000000000007,"5min":274.46800000000002,"15min":274.46800000000002},"last":0.90600000000000003}]},{"osd":2,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":5.9189999999999996,"15min":3.6299999999999999},"min":{"1min":0.38600000000000001,"5min":0.33800000000000002,"15min":0.311},"max":{"1min":9.7539999999999996,"5min":249.75700000000001,"15min":249.75700000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.2470000000000001,"5min":7.0469999999999997,"15min":4.0259999999999998},"min":{"1min":0.47799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":9.5649999999999995,"5min":283.36700000000002,"15min":283.36700000000002},"last":0.81999999999999995}]},{"osd":3,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":1.72,"5min":7.6120000000000001,"15min":4.4770000000000003},"min":{"1min":0.54200000000000004,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":9.5920000000000005,"5min":239.05099999999999,"15min":239.05099999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.4039999999999999,"5min":13.24,"15min":6.3559999999999999},"min":{"1min":0.58799999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":9.6180000000000003,"5min":352.03800000000001,"15min":352.03800000000001},"last":1.0880000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":3.827,"15min":2.1779999999999999},"min":{"1min":0.46000000000000002,"5min":0.25700000000000001,"15min":0.23300000000000001},"max":{"1min":1.0820000000000001,"5min":37.261000000000003,"15min":91.054000000000002},"last":1.008},{"interface":"front","average":{"1min":0.93700000000000006,"5min":3.8769999999999998,"15min":2.2330000000000001},"min":{"1min":0.42099999999999999,"5min":0.312,"15min":0.254},"max":{"1min":1.323,"5min":52.167000000000002,"15min":99.084000000000003},"last":0.97599999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.3680000000000001,"15min":1.032},"min":{"1min":0.41399999999999998,"5min":0.28699999999999998,"15min":0.253},"max":{"1min":1.2929999999999999,"5min":15.196,"15min":15.196},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.6859999999999999,"15min":1.1870000000000001},"min":{"1min":0.49199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.389,"5min":25.192,"15min":25.192},"last":1.0549999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:16:12 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":1.8420000000000001,"15min":1.306},"min":{"1min":0.49099999999999999,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":1.1599999999999999,"5min":37.219999999999999,"15min":37.219999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.379,"15min":1.123},"min":{"1min":0.57299999999999995,"5min":0.308,"15min":0.308},"max":{"1min":1.28,"5min":14.654,"15min":14.654},"last":1.141}]}]},{"osd":5,"up_from":14,"seq":60129542331,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":871448,"kb_used_data":20880,"kb_used_omap":1,"kb_used_meta":850558,"kb_avail":93500392,"statfs":{"total":96636764160,"available":95744401408,"internally_reserved":0,"allocated":21381120,"data_stored":21136948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":870971846},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":3.613,"15min":2.6589999999999998},"min":{"1min":0.27600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.0109999999999999,"5min":70.611000000000004,"15min":94.078999999999994},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":3.3210000000000002,"15min":2.0489999999999999},"min":{"1min":0.60099999999999998,"5min":0.27800000000000002,"15min":0.27000000000000002},"max":{"1min":1.681,"5min":76.866,"15min":76.866},"last":0.57099999999999995}]},{"osd":1,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":5.2690000000000001,"15min":4.3250000000000002},"min":{"1min":0.66500000000000004,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.708,"5min":214.21199999999999,"15min":214.21199999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":4.6760000000000002,"15min":6.625},"min":{"1min":0.57999999999999996,"5min":0.317,"15min":0.317},"max":{"1min":1.6559999999999999,"5min":206.20699999999999,"15min":559.69500000000005},"last":0.65600000000000003}]},{"osd":2,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":3.3490000000000002,"15min":2.3210000000000002},"min":{"1min":0.64200000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.375,"5min":67.366,"15min":67.366},"last":0.61499999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":2.8820000000000001,"15min":2.0659999999999998},"min":{"1min":0.67100000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.462,"5min":65.522000000000006,"15min":65.522000000000006},"last":0.88500000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":5.0529999999999999,"15min":3.1219999999999999},"min":{"1min":0.59799999999999998,"5min":0.40300000000000002,"15min":0.37},"max":{"1min":1.4350000000000001,"5min":169.30600000000001,"15min":169.30600000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.091,"5min":6.7750000000000004,"15min":4.1289999999999996},"min":{"1min":0.70199999999999996,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.736,"5min":169.33799999999999,"15min":169.33799999999999},"last":0.96799999999999997}]},{"osd":4,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":2.4340000000000002,"15min":1.4059999999999999},"min":{"1min":0.34899999999999998,"5min":0.26100000000000001,"15min":0.223},"max":{"1min":1.6200000000000001,"5min":36.151000000000003,"15min":36.151000000000003},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.125,"5min":2.581,"15min":1.482},"min":{"1min":0.44900000000000001,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":1.6539999999999999,"5min":36.219000000000001,"15min":36.219000000000001},"last":1.03}]},{"osd":6,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.7310000000000001,"15min":1.2170000000000001},"min":{"1min":0.39900000000000002,"5min":0.27300000000000002,"15min":0.25600000000000001},"max":{"1min":1.8500000000000001,"5min":25.734000000000002,"15min":25.734000000000002},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.5489999999999999,"15min":1.169},"min":{"1min":0.54600000000000004,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.6140000000000001,"5min":29.106999999999999,"15min":29.106999999999999},"last":1.0009999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.014,"15min":0.98199999999999998},"min":{"1min":0.497,"5min":0.314,"15min":0.314},"max":{"1min":1.6359999999999999,"5min":10.798,"15min":10.798},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.1559999999999999,"15min":1.0589999999999999},"min":{"1min":0.51900000000000002,"5min":0.314,"15min":0.29699999999999999},"max":{"1min":1.718,"5min":12.874000000000001,"15min":12.874000000000001},"last":1.161}]}]},{"osd":4,"up_from":14,"seq":60129542330,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1128128,"kb_used_data":41336,"kb_used_omap":1,"kb_used_meta":1086782,"kb_avail":93243712,"statfs":{"total":96636764160,"available":95481561088,"internally_reserved":0,"allocated":42328064,"data_stored":42105374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1112865222},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:04 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":2.6800000000000002,"15min":1.6659999999999999},"min":{"1min":0.47099999999999997,"5min":0.28299999999999997,"15min":0.27100000000000002},"max":{"1min":1,"5min":18.741,"15min":18.741},"last":0.497},{"interface":"front","average":{"1min":0.86699999999999999,"5min":3.1909999999999998,"15min":1.964},"min":{"1min":0.316,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":4.2850000000000001,"5min":27.876999999999999,"15min":27.876999999999999},"last":0.53200000000000003}]},{"osd":1,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":15.648999999999999,"15min":6.7729999999999997},"min":{"1min":0.47299999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.0089999999999999,"5min":1296.6300000000001,"15min":1296.6300000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.75,"5min":3.3599999999999999,"15min":2.6190000000000002},"min":{"1min":0.45400000000000001,"5min":0.307,"15min":0.307},"max":{"1min":1.109,"5min":25.800999999999998,"15min":47.923999999999999},"last":0.81100000000000005}]},{"osd":2,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":2.8319999999999999,"15min":1.8480000000000001},"min":{"1min":0.55300000000000005,"5min":0.309,"15min":0.29999999999999999},"max":{"1min":4.8799999999999999,"5min":23.760999999999999,"15min":23.760999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.94299999999999995,"5min":2.746,"15min":1.899},"min":{"1min":0.40000000000000002,"5min":0.34000000000000002,"15min":0.32500000000000001},"max":{"1min":3.2839999999999998,"5min":23.709,"15min":30.510000000000002},"last":0.66500000000000004}]},{"osd":3,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":4.9370000000000003,"15min":2.9359999999999999},"min":{"1min":0.48099999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":6.6360000000000001,"5min":94.281000000000006,"15min":94.281000000000006},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.232,"5min":4.9859999999999998,"15min":3.2210000000000001},"min":{"1min":0.72699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":6.6699999999999999,"5min":94.319999999999993,"15min":94.319999999999993},"last":0.998}]},{"osd":5,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.5249999999999999,"15min":1.1599999999999999},"min":{"1min":0.86699999999999999,"5min":0.245,"15min":0.245},"max":{"1min":2.9249999999999998,"5min":18.623999999999999,"15min":18.623999999999999},"last":1.054},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.4630000000000001,"15min":1.1319999999999999},"min":{"1min":0.72099999999999997,"5min":0.246,"15min":0.246},"max":{"1min":4.2469999999999999,"5min":16.155999999999999,"15min":16.155999999999999},"last":0.75}]},{"osd":6,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":2.2090000000000001,"15min":1.462},"min":{"1min":0.42999999999999999,"5min":0.27000000000000002,"15min":0.24099999999999999},"max":{"1min":1.226,"5min":27.984000000000002,"15min":27.984000000000002},"last":0.88},{"interface":"front","average":{"1min":1.052,"5min":2.1019999999999999,"15min":1.367},"min":{"1min":0.33700000000000002,"5min":0.247,"15min":0.23799999999999999},"max":{"1min":3.21,"5min":28.077000000000002,"15min":28.077000000000002},"last":0.96199999999999997}]},{"osd":7,"last update":"Fri Sep 13 15:15:59 2024","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.9830000000000001,"15min":1.375},"min":{"1min":0.38300000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.948,"5min":25.266999999999999,"15min":25.266999999999999},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":2.0800000000000001,"15min":1.4770000000000001},"min":{"1min":0.41399999999999998,"5min":0.34300000000000003,"15min":0.32600000000000001},"max":{"1min":2.0289999999999999,"5min":25.309999999999999,"15min":25.309999999999999},"last":1.1830000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542324,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1547308,"kb_used_data":24804,"kb_used_omap":1,"kb_used_meta":1522494,"kb_avail":92824532,"statfs":{"total":96636764160,"available":95052320768,"internally_reserved":0,"allocated":25399296,"data_stored":25168927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1559034312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":8.9239999999999995,"15min":6.4690000000000003},"min":{"1min":0.29199999999999998,"5min":0.28000000000000003,"15min":0.253},"max":{"1min":2.6190000000000002,"5min":108.956,"15min":170.35599999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":5.8860000000000001,"15min":4.5140000000000002},"min":{"1min":0.309,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.6659999999999999,"5min":63.624000000000002,"15min":168.80699999999999},"last":0.39600000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":8.8640000000000008,"15min":4.6429999999999998},"min":{"1min":0.378,"5min":0.32500000000000001,"15min":0.28499999999999998},"max":{"1min":2.3460000000000001,"5min":92.722999999999999,"15min":92.722999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":10.815,"15min":6.258},"min":{"1min":0.31,"5min":0.29899999999999999,"15min":0.26600000000000001},"max":{"1min":1.756,"5min":89.245000000000005,"15min":104.51300000000001},"last":0.36499999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":6.1130000000000004,"15min":3.8919999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.149,"5min":74.825000000000003,"15min":74.825000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":6.3570000000000002,"15min":3.8730000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.36499999999999999},"max":{"1min":2.2029999999999998,"5min":74.870999999999995,"15min":74.870999999999995},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":5.7009999999999996,"15min":3.056},"min":{"1min":0.46400000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.3849999999999998,"5min":85.710999999999999,"15min":85.710999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.99299999999999999,"5min":7.335,"15min":3.948},"min":{"1min":0.499,"5min":0.443,"15min":0.377},"max":{"1min":2.177,"5min":105.875,"15min":105.875},"last":0.88400000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":5.8570000000000002,"15min":3.379},"min":{"1min":0.61799999999999999,"5min":0.46700000000000003,"15min":0.40400000000000003},"max":{"1min":4.7380000000000004,"5min":95.748999999999995,"15min":95.748999999999995},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.2829999999999999,"5min":7.4969999999999999,"15min":4.3460000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":8.7870000000000008,"5min":100.325,"15min":100.325},"last":0.63600000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":4.7149999999999999,"15min":2.7639999999999998},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":4.7050000000000001,"5min":85.492999999999995,"15min":85.492999999999995},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.3160000000000001,"5min":5.9450000000000003,"15min":3.2440000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.501},"max":{"1min":4.75,"5min":100.376,"15min":100.376},"last":0.90000000000000002}]},{"osd":7,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":5.4859999999999998,"15min":3.085},"min":{"1min":0.57499999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.7509999999999999,"5min":97.268000000000001,"15min":97.268000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":5.8440000000000003,"15min":3.5470000000000002},"min":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.48599999999999999},"max":{"1min":1.9870000000000001,"5min":100.583,"15min":100.583},"last":0.68999999999999995}]}]},{"osd":2,"up_from":14,"seq":60129542331,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":814544,"kb_used_data":4552,"kb_used_omap":1,"kb_used_meta":809982,"kb_avail":93557296,"statfs":{"total":96636764160,"available":95802671104,"internally_reserved":0,"allocated":4661248,"data_stored":4427070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":829422022},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":7.1529999999999996,"15min":3.738},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.249},"max":{"1min":0.68899999999999995,"5min":170.77199999999999,"15min":170.77199999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":11.09,"15min":5.3769999999999998},"min":{"1min":0.316,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78100000000000003,"5min":237.53800000000001,"15min":237.53800000000001},"last":0.41699999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":5.7750000000000004,"15min":3.7890000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.28899999999999998},"max":{"1min":0.67400000000000004,"5min":109.104,"15min":109.104},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.502,"5min":12.032,"15min":5.8540000000000001},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.30499999999999999},"max":{"1min":0.72499999999999998,"5min":295.73500000000001,"15min":295.73500000000001},"last":0.36599999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":5.1139999999999999,"15min":3.7080000000000002},"min":{"1min":0.35999999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73299999999999998,"5min":109.152,"15min":109.152},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":7.391,"15min":4.8259999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66600000000000004,"5min":264.87599999999998,"15min":264.87599999999998},"last":0.40600000000000003}]},{"osd":4,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":6.5869999999999997,"15min":3.8879999999999999},"min":{"1min":0.56699999999999995,"5min":0.41599999999999998,"15min":0.38100000000000001},"max":{"1min":0.97499999999999998,"5min":251.97300000000001,"15min":251.97300000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":4.2599999999999998,"15min":2.5590000000000002},"min":{"1min":0.59199999999999997,"5min":0.42099999999999999,"15min":0.34899999999999998},"max":{"1min":1.081,"5min":42.012,"15min":42.012},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":3.3980000000000001,"15min":2.508},"min":{"1min":0.67100000000000004,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.163,"5min":41.942999999999998,"15min":41.942999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.878,"5min":6.3769999999999998,"15min":3.4990000000000001},"min":{"1min":0.71999999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.135,"5min":237.58799999999999,"15min":237.58799999999999},"last":0.748}]},{"osd":6,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":3.419,"15min":2.4430000000000001},"min":{"1min":0.64300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.127,"5min":41.981999999999999,"15min":41.981999999999999},"last":0.625},{"interface":"front","average":{"1min":0.85699999999999998,"5min":3.6709999999999998,"15min":2.556},"min":{"1min":0.66100000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.177,"5min":41.890999999999998,"15min":41.890999999999998},"last":0.76900000000000002}]},{"osd":7,"last update":"Fri Sep 13 15:16:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":5.8559999999999999,"15min":3.403},"min":{"1min":0.627,"5min":0.44,"15min":0.44},"max":{"1min":0.98899999999999999,"5min":237.626,"15min":237.626},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.755,"5min":6.157,"15min":3.2559999999999998},"min":{"1min":0.52900000000000003,"5min":0.432,"15min":0.39200000000000002},"max":{"1min":1.0640000000000001,"5min":252.005,"15min":252.005},"last":0.70099999999999996}]}]},{"osd":1,"up_from":14,"seq":60129542325,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1493764,"kb_used_data":24956,"kb_used_omap":1,"kb_used_meta":1468798,"kb_avail":92878076,"statfs":{"total":96636764160,"available":95107149824,"internally_reserved":0,"allocated":25554944,"data_stored":25328384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1504049606},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":5.8120000000000003,"15min":4.1059999999999999},"min":{"1min":0.27400000000000002,"5min":0.23799999999999999,"15min":0.22500000000000001},"max":{"1min":4.843,"5min":104.246,"15min":104.246},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59199999999999997,"5min":6.8700000000000001,"15min":4.0330000000000004},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":2.093,"5min":103.157,"15min":103.157},"last":0.60899999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":7.484,"15min":5.1639999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32200000000000001},"max":{"1min":19.100000000000001,"5min":113.79600000000001,"15min":191.00899999999999},"last":0.44},{"interface":"front","average":{"1min":1.667,"5min":5.1849999999999996,"15min":3.4020000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.318},"max":{"1min":19.143999999999998,"5min":30.704999999999998,"15min":47.537999999999997},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":6.9560000000000004,"15min":4.0339999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":19.419,"5min":52.975000000000001,"15min":52.975000000000001},"last":0.627},{"interface":"front","average":{"1min":1.778,"5min":7.4269999999999996,"15min":3.992},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":19.202999999999999,"5min":104.319,"15min":104.319},"last":0.55600000000000005}]},{"osd":4,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":5.032,"15min":3.9329999999999998},"min":{"1min":0.47099999999999997,"5min":0.45400000000000001,"15min":0.38700000000000001},"max":{"1min":1.738,"5min":41.862000000000002,"15min":125.44799999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.8069999999999999,"5min":6.9349999999999996,"15min":4.2110000000000003},"min":{"1min":0.52100000000000002,"5min":0.47399999999999998,"15min":0.38800000000000001},"max":{"1min":19.291,"5min":102.962,"15min":117.842},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":4.9829999999999997,"15min":3.944},"min":{"1min":0.59399999999999997,"5min":0.436,"15min":0.40000000000000002},"max":{"1min":1.8029999999999999,"5min":104.19,"15min":154.875},"last":1.03},{"interface":"front","average":{"1min":0.93300000000000005,"5min":5.2560000000000002,"15min":4.0609999999999999},"min":{"1min":0.46200000000000002,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":3.5470000000000002,"5min":45.369999999999997,"15min":126.485},"last":0.98599999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":5.633,"15min":3.609},"min":{"1min":0.54100000000000004,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.825,"5min":103.191,"15min":103.191},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":5.0759999999999996,"15min":3.1739999999999999},"min":{"1min":0.60999999999999999,"5min":0.55000000000000004,"15min":0.42399999999999999},"max":{"1min":1.774,"5min":104.28400000000001,"15min":104.28400000000001},"last":0.80500000000000005}]},{"osd":7,"last update":"Fri Sep 13 15:16:13 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":4.9619999999999997,"15min":3.5329999999999999},"min":{"1min":0.54400000000000004,"5min":0.53700000000000003,"15min":0.438},"max":{"1min":3.5939999999999999,"5min":45.472999999999999,"15min":77.366},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.84099999999999997,"5min":5.548,"15min":3.8479999999999999},"min":{"1min":0.60499999999999998,"5min":0.443,"15min":0.443},"max":{"1min":1.857,"5min":112.69499999999999,"15min":112.69499999999999},"last":0.75800000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542329,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":970504,"kb_used_data":25536,"kb_used_omap":1,"kb_used_meta":944958,"kb_avail":93401336,"statfs":{"total":96636764160,"available":95642968064,"internally_reserved":0,"allocated":26148864,"data_stored":25917602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":967637446},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":4.5049999999999999,"15min":4.3040000000000003},"min":{"1min":0.25,"5min":0.25,"15min":0.22900000000000001},"max":{"1min":0.71799999999999997,"5min":43.508000000000003,"15min":279.90600000000001},"last":0.311},{"interface":"front","average":{"1min":0.51700000000000002,"5min":5.3109999999999999,"15min":6.2300000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.28100000000000003},"max":{"1min":1.595,"5min":58.280000000000001,"15min":510.15699999999998},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":6.4219999999999997,"15min":3.3039999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26000000000000001},"max":{"1min":0.92200000000000004,"5min":101.73399999999999,"15min":101.73399999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58999999999999997,"5min":4.4029999999999996,"15min":2.738},"min":{"1min":0.40999999999999998,"5min":0.39400000000000002,"15min":0.34200000000000003},"max":{"1min":1.55,"5min":35.527999999999999,"15min":35.527999999999999},"last":0.45200000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:16:08 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":7.8099999999999996,"15min":4.6559999999999997},"min":{"1min":0.39700000000000002,"5min":0.371,"15min":0.28699999999999998},"max":{"1min":3.4630000000000001,"5min":101.76300000000001,"15min":101.76300000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":6.3259999999999996,"15min":4.3860000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":3.7090000000000001,"5min":75.828000000000003,"15min":75.828000000000003},"last":0.51900000000000002}]},{"osd":4,"last update":"Fri Sep 13 15:16:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":4.556,"15min":2.7400000000000002},"min":{"1min":0.51900000000000002,"5min":0.495,"15min":0.34200000000000003},"max":{"1min":5.1379999999999999,"5min":30.207999999999998,"15min":30.207999999999998},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.3600000000000001,"5min":4.0010000000000003,"15min":2.5550000000000002},"min":{"1min":0.55500000000000005,"5min":0.46999999999999997,"15min":0.38500000000000001},"max":{"1min":6.859,"5min":30.135000000000002,"15min":30.135000000000002},"last":0.64700000000000002}]},{"osd":5,"last update":"Fri Sep 13 15:16:16 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":5.3230000000000004,"15min":2.8719999999999999},"min":{"1min":0.626,"5min":0.46600000000000003,"15min":0.377},"max":{"1min":6.5609999999999999,"5min":101.702,"15min":101.702},"last":0.627},{"interface":"front","average":{"1min":1.2190000000000001,"5min":3.593,"15min":2.3140000000000001},"min":{"1min":0.59599999999999997,"5min":0.434,"15min":0.379},"max":{"1min":7.1820000000000004,"5min":43.249000000000002,"15min":43.249000000000002},"last":0.76900000000000002}]},{"osd":6,"last update":"Fri Sep 13 15:16:08 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":4.4279999999999999,"15min":2.649},"min":{"1min":0.58599999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.0170000000000003,"5min":45.140000000000001,"15min":45.140000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.92200000000000004,"5min":4.4870000000000001,"15min":2.742},"min":{"1min":0.68100000000000005,"5min":0.52500000000000002,"15min":0.50600000000000001},"max":{"1min":1.484,"5min":44.737000000000002,"15min":44.737000000000002},"last":0.85099999999999998}]},{"osd":7,"last update":"Fri Sep 13 15:16:08 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":5.5979999999999999,"15min":3.0030000000000001},"min":{"1min":0.61799999999999999,"5min":0.44700000000000001,"15min":0.42499999999999999},"max":{"1min":4.8049999999999997,"5min":101.655,"15min":101.655},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.2649999999999999,"5min":4.1820000000000004,"15min":2.6309999999999998},"min":{"1min":0.68100000000000005,"5min":0.51500000000000001,"15min":0.434},"max":{"1min":6.8120000000000003,"5min":46.649000000000001,"15min":46.649000000000001},"last":0.67800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25194496,"data_stored":25166698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25194496,"data_stored":25167848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4300800,"data_stored":4266534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25038848,"data_stored":25008391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41967616,"data_stored":41944838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21020672,"data_stored":20976412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29155328,"data_stored":29132361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":46174208,"data_stored":46139912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:17:03.714 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:17:03.715 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:17:03.715 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:17:03.715 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:17:03.715 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:17:03.715 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:17:03.716 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:17:03.716 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:17:03.716 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:17:03.716 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:17:03.716 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:17:03.717 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-13T15:01:47.796184+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=47, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:17:03.717 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:17:03.717 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:17:03.717 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:17:03.717 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T15:17:23.718 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:17:23.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.876+0000 7fe958800640 1 Processor -- start 2024-09-13T15:17:23.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.876+0000 7fe958800640 1 -- start start 2024-09-13T15:17:23.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.876+0000 7fe958800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe9500b0bf0 0x7fe950150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:23.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.876+0000 7fe958800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe95006ddb0 0x7fe950151210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:23.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.876+0000 7fe958800640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9500c5530 con 0x7fe950071a70 2024-09-13T15:17:23.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.876+0000 7fe958800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe950151750 con 0x7fe95006ddb0 2024-09-13T15:17:23.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.876+0000 7fe958800640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9501583b0 con 0x7fe9500b0bf0 2024-09-13T15:17:23.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.876+0000 7fe956800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe95006ddb0 0x7fe950151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:23.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.876+0000 7fe956800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7fe95006ddb0 0x7fe950151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32808/0 (socket says 172.21.15.7:32808) 2024-09-13T15:17:23.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.876+0000 7fe956800640 1 -- 172.21.15.7:0/3854645215 learned_addr learned my addr 172.21.15.7:0/3854645215 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:23.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.876+0000 7fe955400640 1 --2- 172.21.15.7:0/3854645215 >> v2:172.21.15.77:3300/0 conn(0x7fe9500b0bf0 0x7fe950150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:23.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.876+0000 7fe956800640 1 -- 172.21.15.7:0/3854645215 >> v2:172.21.15.77:3300/0 conn(0x7fe9500b0bf0 msgr2=0x7fe950150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:17:23.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.876+0000 7fe956800640 1 --2- 172.21.15.7:0/3854645215 >> v2:172.21.15.77:3300/0 conn(0x7fe9500b0bf0 0x7fe950150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:23.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.876+0000 7fe956800640 1 -- 172.21.15.7:0/3854645215 >> v1:172.21.15.77:6789/0 conn(0x7fe950071a70 legacy=0x7fe9501576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:17:23.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.876+0000 7fe956800640 1 -- 172.21.15.7:0/3854645215 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe950156f40 con 0x7fe95006ddb0 2024-09-13T15:17:23.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.880+0000 7fe956800640 1 --2- 172.21.15.7:0/3854645215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe95006ddb0 0x7fe950151210 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe950072760 tx=0x7fe94c01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab879c317a2337f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:23.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe954a00640 1 -- 172.21.15.7:0/3854645215 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c0a5840 con 0x7fe95006ddb0 2024-09-13T15:17:23.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe954a00640 1 -- 172.21.15.7:0/3854645215 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c0a59a0 con 0x7fe95006ddb0 2024-09-13T15:17:23.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe954a00640 1 -- 172.21.15.7:0/3854645215 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c0a5d30 con 0x7fe95006ddb0 2024-09-13T15:17:23.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe958800640 1 -- 172.21.15.7:0/3854645215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe95006ddb0 msgr2=0x7fe950151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:23.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe958800640 1 --2- 172.21.15.7:0/3854645215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe95006ddb0 0x7fe950151210 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe950072760 tx=0x7fe94c01c980 comp rx=0 tx=0).stop 2024-09-13T15:17:23.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe958800640 1 -- 172.21.15.7:0/3854645215 shutdown_connections 2024-09-13T15:17:23.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe958800640 1 --2- 172.21.15.7:0/3854645215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe95006ddb0 0x7fe950151210 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:23.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe958800640 1 --2- 172.21.15.7:0/3854645215 >> v2:172.21.15.77:3300/0 conn(0x7fe9500b0bf0 0x7fe950150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:23.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe958800640 1 -- 172.21.15.7:0/3854645215 >> 172.21.15.7:0/3854645215 conn(0x7fe950065d40 msgr2=0x7fe950066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:23.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe958800640 1 -- 172.21.15.7:0/3854645215 shutdown_connections 2024-09-13T15:17:23.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe958800640 1 -- 172.21.15.7:0/3854645215 wait complete. 2024-09-13T15:17:23.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe958800640 1 Processor -- start 2024-09-13T15:17:23.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe958800640 1 -- start start 2024-09-13T15:17:23.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe958800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe95006ddb0 0x7fe9501502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:23.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe958800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe950071a70 0x7fe9501f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:23.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe958800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9500b0bf0 0x7fe9501f5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:23.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe958800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9500c7670 con 0x7fe9500b0bf0 2024-09-13T15:17:23.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe958800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe950140280 con 0x7fe950071a70 2024-09-13T15:17:23.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe958800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95013ffe0 con 0x7fe95006ddb0 2024-09-13T15:17:23.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.884+0000 7fe956800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9500b0bf0 0x7fe9501f5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:23.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.888+0000 7fe956800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9500b0bf0 0x7fe9501f5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:32812/0 (socket says 172.21.15.7:32812) 2024-09-13T15:17:23.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.888+0000 7fe956800640 1 -- 172.21.15.7:0/3302685919 learned_addr learned my addr 172.21.15.7:0/3302685919 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:23.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.888+0000 7fe955e00640 1 --2- 172.21.15.7:0/3302685919 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe95006ddb0 0x7fe9501502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:23.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.888+0000 7fe955400640 1 --2- 172.21.15.7:0/3302685919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe950071a70 0x7fe9501f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:23.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.888+0000 7fe956800640 1 -- 172.21.15.7:0/3302685919 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe95006ddb0 msgr2=0x7fe9501502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:23.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.888+0000 7fe956800640 1 --2- 172.21.15.7:0/3302685919 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe95006ddb0 0x7fe9501502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:23.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.888+0000 7fe956800640 1 -- 172.21.15.7:0/3302685919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe950071a70 msgr2=0x7fe9501f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:23.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.888+0000 7fe956800640 1 --2- 172.21.15.7:0/3302685919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe950071a70 0x7fe9501f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:23.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.888+0000 7fe956800640 1 -- 172.21.15.7:0/3302685919 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c009b30 con 0x7fe9500b0bf0 2024-09-13T15:17:23.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.888+0000 7fe956800640 1 --2- 172.21.15.7:0/3302685919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9500b0bf0 0x7fe9501f5790 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe94c01b030 tx=0x7fe94c019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:23.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.888+0000 7fe94a000640 1 -- 172.21.15.7:0/3302685919 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c0b8670 con 0x7fe9500b0bf0 2024-09-13T15:17:23.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.888+0000 7fe94a000640 1 -- 172.21.15.7:0/3302685919 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c0b87f0 con 0x7fe9500b0bf0 2024-09-13T15:17:23.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.888+0000 7fe94a000640 1 -- 172.21.15.7:0/3302685919 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c0b8ba0 con 0x7fe9500b0bf0 2024-09-13T15:17:23.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.888+0000 7fe958800640 1 -- 172.21.15.7:0/3302685919 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95013f830 con 0x7fe9500b0bf0 2024-09-13T15:17:23.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.888+0000 7fe958800640 1 -- 172.21.15.7:0/3302685919 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95013f550 con 0x7fe9500b0bf0 2024-09-13T15:17:23.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.888+0000 7fe958800640 1 -- 172.21.15.7:0/3302685919 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe950067650 con 0x7fe9500b0bf0 2024-09-13T15:17:23.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.888+0000 7fe94a000640 1 -- 172.21.15.7:0/3302685919 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe94c0b8d00 con 0x7fe9500b0bf0 2024-09-13T15:17:23.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.892+0000 7fe94a000640 1 --2- 172.21.15.7:0/3302685919 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe934066690 0x7fe934068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:23.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.892+0000 7fe94a000640 1 -- 172.21.15.7:0/3302685919 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7fe94c11fba0 con 0x7fe9500b0bf0 2024-09-13T15:17:23.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.892+0000 7fe955e00640 1 --2- 172.21.15.7:0/3302685919 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe934066690 0x7fe934068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:23.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.892+0000 7fe955e00640 1 --2- 172.21.15.7:0/3302685919 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe934066690 0x7fe934068b50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe944007fd0 tx=0x7fe944007e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:23.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:23.896+0000 7fe94a000640 1 -- 172.21.15.7:0/3302685919 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe94c0ecb20 con 0x7fe9500b0bf0 2024-09-13T15:17:24.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:24.056+0000 7fe958800640 1 -- 172.21.15.7:0/3302685919 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9501571c0 con 0x7fe934066690 2024-09-13T15:17:24.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:24.100+0000 7fe94a000640 1 -- 172.21.15.7:0/3302685919 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372737 (secure 0 0 0) 0x7fe944004c00 con 0x7fe934066690 2024-09-13T15:17:24.102 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:17:24.106 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T15:17:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:24.104+0000 7fe958800640 1 -- 172.21.15.7:0/3302685919 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe934066690 msgr2=0x7fe934068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:24.104+0000 7fe958800640 1 --2- 172.21.15.7:0/3302685919 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe934066690 0x7fe934068b50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe944007fd0 tx=0x7fe944007e40 comp rx=0 tx=0).stop 2024-09-13T15:17:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:24.104+0000 7fe958800640 1 -- 172.21.15.7:0/3302685919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9500b0bf0 msgr2=0x7fe9501f5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:24.104+0000 7fe958800640 1 --2- 172.21.15.7:0/3302685919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9500b0bf0 0x7fe9501f5790 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe94c01b030 tx=0x7fe94c019720 comp rx=0 tx=0).stop 2024-09-13T15:17:24.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:24.104+0000 7fe958800640 1 -- 172.21.15.7:0/3302685919 shutdown_connections 2024-09-13T15:17:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:24.104+0000 7fe958800640 1 --2- 172.21.15.7:0/3302685919 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fe934066690 0x7fe934068b50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:24.104+0000 7fe958800640 1 --2- 172.21.15.7:0/3302685919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9500b0bf0 0x7fe9501f5790 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:24.104+0000 7fe958800640 1 --2- 172.21.15.7:0/3302685919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe950071a70 0x7fe9501f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:24.104+0000 7fe958800640 1 --2- 172.21.15.7:0/3302685919 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fe95006ddb0 0x7fe9501502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:24.104+0000 7fe958800640 1 -- 172.21.15.7:0/3302685919 >> 172.21.15.7:0/3302685919 conn(0x7fe950065d40 msgr2=0x7fe9500c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:24.104+0000 7fe958800640 1 -- 172.21.15.7:0/3302685919 shutdown_connections 2024-09-13T15:17:24.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:24.104+0000 7fe958800640 1 -- 172.21.15.7:0/3302685919 wait complete. 2024-09-13T15:17:24.127 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2024-09-13T15:17:22.982147+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":109491865,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":617,"num_read_kb":111053,"num_write":2174555,"num_write_kb":31188655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":55628,"num_omap_keys":107,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153407,"ondisk_log_size":153407,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8980496,"kb_used_data":216912,"kb_used_omap":12,"kb_used_meta":8763507,"kb_avail":745994224,"statfs":{"total":773094113280,"available":763898085376,"internally_reserved":0,"allocated":222117888,"data_stored":220268018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":8973831736},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005303"},"pg_stats":[{"pgid":"2.1f","version":"33'47","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.748758+0000","last_change":"2024-09-13T15:16:21.447074+0000","last_active":"2024-09-13T15:16:23.748758+0000","last_peered":"2024-09-13T15:16:23.748758+0000","last_clean":"2024-09-13T15:16:23.748758+0000","last_became_active":"2024-09-13T15:01:44.418641+0000","last_became_peered":"2024-09-13T15:01:44.418641+0000","last_unstale":"2024-09-13T15:16:23.748758+0000","last_undegraded":"2024-09-13T15:16:23.748758+0000","last_fullsized":"2024-09-13T15:16:23.748758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-09-13T15:16:21.446893+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-09-13T15:16:21.446893+0000","last_clean_scrub_stamp":"2024-09-13T15:16:21.446893+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:15:25.634510+0000","scrub_duration":0.039130482000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":4120,"num_write":37,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18304,"num_omap_keys":34,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.034899+0000","last_change":"2024-09-13T15:16:22.973595+0000","last_active":"2024-09-13T15:16:24.034899+0000","last_peered":"2024-09-13T15:16:24.034899+0000","last_clean":"2024-09-13T15:16:24.034899+0000","last_became_active":"2024-09-13T15:01:44.809091+0000","last_became_peered":"2024-09-13T15:01:44.809091+0000","last_unstale":"2024-09-13T15:16:24.034899+0000","last_undegraded":"2024-09-13T15:16:24.034899+0000","last_fullsized":"2024-09-13T15:16:24.034899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T15:16:22.973417+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T15:16:22.973417+0000","last_clean_scrub_stamp":"2024-09-13T15:16:22.973417+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.248726+0000","scrub_duration":0.003905291,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'4483","reported_seq":4521,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:03.830518+0000","last_change":"2024-09-13T15:17:03.830667+0000","last_active":"2024-09-13T15:17:03.830518+0000","last_peered":"2024-09-13T15:17:03.830518+0000","last_clean":"2024-09-13T15:17:03.830518+0000","last_became_active":"2024-09-13T15:01:48.910262+0000","last_became_peered":"2024-09-13T15:01:48.910262+0000","last_unstale":"2024-09-13T15:17:03.830518+0000","last_undegraded":"2024-09-13T15:17:03.830518+0000","last_fullsized":"2024-09-13T15:17:03.830518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4483","last_scrub_stamp":"2024-09-13T15:17:03.830498+0000","last_deep_scrub":"33'4483","last_deep_scrub_stamp":"2024-09-13T15:17:03.830498+0000","last_clean_scrub_stamp":"2024-09-13T15:17:03.830498+0000","objects_scrubbed":0,"log_size":4483,"log_dups_size":0,"ondisk_log_size":4483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:26.185321+0000","scrub_duration":0.044532061999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65375,"num_write_kb":904330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"33'25","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:32.945023+0000","last_change":"2024-09-13T15:16:32.945101+0000","last_active":"2024-09-13T15:16:32.945023+0000","last_peered":"2024-09-13T15:16:32.945023+0000","last_clean":"2024-09-13T15:16:32.945023+0000","last_became_active":"2024-09-13T15:01:44.401666+0000","last_became_peered":"2024-09-13T15:01:44.401666+0000","last_unstale":"2024-09-13T15:16:32.945023+0000","last_undegraded":"2024-09-13T15:16:32.945023+0000","last_fullsized":"2024-09-13T15:16:32.945023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2024-09-13T15:16:32.945005+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2024-09-13T15:16:32.945005+0000","last_clean_scrub_stamp":"2024-09-13T15:16:32.945005+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:38.266030+0000","scrub_duration":0.011797106999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":18,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"33'7","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:54.232342+0000","last_change":"2024-09-13T15:16:54.232441+0000","last_active":"2024-09-13T15:16:54.232342+0000","last_peered":"2024-09-13T15:16:54.232342+0000","last_clean":"2024-09-13T15:16:54.232342+0000","last_became_active":"2024-09-13T15:01:44.849825+0000","last_became_peered":"2024-09-13T15:01:44.849825+0000","last_unstale":"2024-09-13T15:16:54.232342+0000","last_undegraded":"2024-09-13T15:16:54.232342+0000","last_fullsized":"2024-09-13T15:16:54.232342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:54.232320+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:54.232320+0000","last_clean_scrub_stamp":"2024-09-13T15:16:54.232320+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:34.087214+0000","scrub_duration":0.0026587659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"33'4943","reported_seq":4981,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.322856+0000","last_change":"2024-09-13T15:16:34.323110+0000","last_active":"2024-09-13T15:16:34.322856+0000","last_peered":"2024-09-13T15:16:34.322856+0000","last_clean":"2024-09-13T15:16:34.322856+0000","last_became_active":"2024-09-13T15:01:48.848750+0000","last_became_peered":"2024-09-13T15:01:48.848750+0000","last_unstale":"2024-09-13T15:16:34.322856+0000","last_undegraded":"2024-09-13T15:16:34.322856+0000","last_fullsized":"2024-09-13T15:16:34.322856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4943","last_scrub_stamp":"2024-09-13T15:16:34.322797+0000","last_deep_scrub":"33'4943","last_deep_scrub_stamp":"2024-09-13T15:16:34.322797+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.322797+0000","objects_scrubbed":0,"log_size":4943,"log_dups_size":0,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:02.000213+0000","scrub_duration":0.059598802999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71676,"num_write_kb":1026932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"33'74","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:43.853486+0000","last_change":"2024-09-13T15:16:43.853486+0000","last_active":"2024-09-13T15:16:43.853486+0000","last_peered":"2024-09-13T15:16:43.853486+0000","last_clean":"2024-09-13T15:16:43.853486+0000","last_became_active":"2024-09-13T15:01:44.437168+0000","last_became_peered":"2024-09-13T15:01:44.437168+0000","last_unstale":"2024-09-13T15:16:43.853486+0000","last_undegraded":"2024-09-13T15:16:43.853486+0000","last_fullsized":"2024-09-13T15:16:43.853486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-09-13T15:16:43.853192+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-09-13T15:16:43.853192+0000","last_clean_scrub_stamp":"2024-09-13T15:16:43.853192+0000","objects_scrubbed":10,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:18:05.006017+0000","scrub_duration":0.051040786999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":50,"num_read_kb":12337,"num_write":58,"num_write_kb":12312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.585752+0000","last_change":"2024-09-13T15:16:46.585752+0000","last_active":"2024-09-13T15:16:46.585752+0000","last_peered":"2024-09-13T15:16:46.585752+0000","last_clean":"2024-09-13T15:16:46.585752+0000","last_became_active":"2024-09-13T15:01:44.845395+0000","last_became_peered":"2024-09-13T15:01:44.845395+0000","last_unstale":"2024-09-13T15:16:46.585752+0000","last_undegraded":"2024-09-13T15:16:46.585752+0000","last_fullsized":"2024-09-13T15:16:46.585752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:46.585439+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:46.585439+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.585439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:26.653766+0000","scrub_duration":0.0039872960000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4446","reported_seq":4484,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:01.660444+0000","last_change":"2024-09-13T15:17:01.660795+0000","last_active":"2024-09-13T15:17:01.660444+0000","last_peered":"2024-09-13T15:17:01.660444+0000","last_clean":"2024-09-13T15:17:01.660444+0000","last_became_active":"2024-09-13T15:01:48.864314+0000","last_became_peered":"2024-09-13T15:01:48.864314+0000","last_unstale":"2024-09-13T15:17:01.660444+0000","last_undegraded":"2024-09-13T15:17:01.660444+0000","last_fullsized":"2024-09-13T15:17:01.660444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4446","last_scrub_stamp":"2024-09-13T15:17:01.660386+0000","last_deep_scrub":"33'4446","last_deep_scrub_stamp":"2024-09-13T15:17:01.660386+0000","last_clean_scrub_stamp":"2024-09-13T15:17:01.660386+0000","objects_scrubbed":0,"log_size":4446,"log_dups_size":0,"ondisk_log_size":4446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:56.170494+0000","scrub_duration":0.060734819000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64553,"num_write_kb":920306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"33'19","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:44.786729+0000","last_change":"2024-09-13T15:16:44.786932+0000","last_active":"2024-09-13T15:16:44.786729+0000","last_peered":"2024-09-13T15:16:44.786729+0000","last_clean":"2024-09-13T15:16:44.786729+0000","last_became_active":"2024-09-13T15:01:44.423381+0000","last_became_peered":"2024-09-13T15:01:44.423381+0000","last_unstale":"2024-09-13T15:16:44.786729+0000","last_undegraded":"2024-09-13T15:16:44.786729+0000","last_fullsized":"2024-09-13T15:16:44.786729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:44.786676+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:44.786676+0000","last_clean_scrub_stamp":"2024-09-13T15:16:44.786676+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:07.262617+0000","scrub_duration":0.019597004000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":4116,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"33'19","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:49.648254+0000","last_change":"2024-09-13T15:16:49.648254+0000","last_active":"2024-09-13T15:16:49.648254+0000","last_peered":"2024-09-13T15:16:49.648254+0000","last_clean":"2024-09-13T15:16:49.648254+0000","last_became_active":"2024-09-13T15:01:44.849038+0000","last_became_peered":"2024-09-13T15:01:44.849038+0000","last_unstale":"2024-09-13T15:16:49.648254+0000","last_undegraded":"2024-09-13T15:16:49.648254+0000","last_fullsized":"2024-09-13T15:16:49.648254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:49.647989+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:49.647989+0000","last_clean_scrub_stamp":"2024-09-13T15:16:49.647989+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:17.250145+0000","scrub_duration":0.0032904990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4201","reported_seq":4239,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:54.451927+0000","last_change":"2024-09-13T15:16:54.452194+0000","last_active":"2024-09-13T15:16:54.451927+0000","last_peered":"2024-09-13T15:16:54.451927+0000","last_clean":"2024-09-13T15:16:54.451927+0000","last_became_active":"2024-09-13T15:01:48.853858+0000","last_became_peered":"2024-09-13T15:01:48.853858+0000","last_unstale":"2024-09-13T15:16:54.451927+0000","last_undegraded":"2024-09-13T15:16:54.451927+0000","last_fullsized":"2024-09-13T15:16:54.451927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4201","last_scrub_stamp":"2024-09-13T15:16:54.451870+0000","last_deep_scrub":"33'4201","last_deep_scrub_stamp":"2024-09-13T15:16:54.451870+0000","last_clean_scrub_stamp":"2024-09-13T15:16:54.451870+0000","objects_scrubbed":0,"log_size":4201,"log_dups_size":0,"ondisk_log_size":4201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:09.325806+0000","scrub_duration":0.061230010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61316,"num_write_kb":864366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"33'5","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:44.852767+0000","last_change":"2024-09-13T15:16:44.852767+0000","last_active":"2024-09-13T15:16:44.852767+0000","last_peered":"2024-09-13T15:16:44.852767+0000","last_clean":"2024-09-13T15:16:44.852767+0000","last_became_active":"2024-09-13T15:01:44.823690+0000","last_became_peered":"2024-09-13T15:01:44.823690+0000","last_unstale":"2024-09-13T15:16:44.852767+0000","last_undegraded":"2024-09-13T15:16:44.852767+0000","last_fullsized":"2024-09-13T15:16:44.852767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T15:16:44.852533+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T15:16:44.852533+0000","last_clean_scrub_stamp":"2024-09-13T15:16:44.852533+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:54:44.010971+0000","scrub_duration":0.0029740539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'144","reported_seq":189,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.859299+0000","last_change":"2024-09-13T15:16:46.859566+0000","last_active":"2024-09-13T15:16:46.859299+0000","last_peered":"2024-09-13T15:16:46.859299+0000","last_clean":"2024-09-13T15:16:46.859299+0000","last_became_active":"2024-09-13T15:01:44.419965+0000","last_became_peered":"2024-09-13T15:01:44.419965+0000","last_unstale":"2024-09-13T15:16:46.859299+0000","last_undegraded":"2024-09-13T15:16:46.859299+0000","last_fullsized":"2024-09-13T15:16:46.859299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'144","last_scrub_stamp":"2024-09-13T15:16:46.859246+0000","last_deep_scrub":"33'144","last_deep_scrub_stamp":"2024-09-13T15:16:46.859246+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.859246+0000","objects_scrubbed":4,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:13.077229+0000","scrub_duration":0.030972208000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":8200,"num_write":130,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"33'4505","reported_seq":4543,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:39.352834+0000","last_change":"2024-09-13T15:16:39.353112+0000","last_active":"2024-09-13T15:16:39.352834+0000","last_peered":"2024-09-13T15:16:39.352834+0000","last_clean":"2024-09-13T15:16:39.352834+0000","last_became_active":"2024-09-13T15:01:48.849856+0000","last_became_peered":"2024-09-13T15:01:48.849856+0000","last_unstale":"2024-09-13T15:16:39.352834+0000","last_undegraded":"2024-09-13T15:16:39.352834+0000","last_fullsized":"2024-09-13T15:16:39.352834+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4505","last_scrub_stamp":"2024-09-13T15:16:39.352782+0000","last_deep_scrub":"33'4505","last_deep_scrub_stamp":"2024-09-13T15:16:39.352782+0000","last_clean_scrub_stamp":"2024-09-13T15:16:39.352782+0000","objects_scrubbed":0,"log_size":4505,"log_dups_size":0,"ondisk_log_size":4505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:43.506716+0000","scrub_duration":0.052549373000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65579,"num_write_kb":929153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"33'8","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:36.980712+0000","last_change":"2024-09-13T15:16:36.980882+0000","last_active":"2024-09-13T15:16:36.980712+0000","last_peered":"2024-09-13T15:16:36.980712+0000","last_clean":"2024-09-13T15:16:36.980712+0000","last_became_active":"2024-09-13T15:01:44.805767+0000","last_became_peered":"2024-09-13T15:01:44.805767+0000","last_unstale":"2024-09-13T15:16:36.980712+0000","last_undegraded":"2024-09-13T15:16:36.980712+0000","last_fullsized":"2024-09-13T15:16:36.980712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:36.980692+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:36.980692+0000","last_clean_scrub_stamp":"2024-09-13T15:16:36.980692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:34.434100+0000","scrub_duration":0.0013482559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"33'26","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.606279+0000","last_change":"2024-09-13T15:16:24.606279+0000","last_active":"2024-09-13T15:16:24.606279+0000","last_peered":"2024-09-13T15:16:24.606279+0000","last_clean":"2024-09-13T15:16:24.606279+0000","last_became_active":"2024-09-13T15:01:44.401559+0000","last_became_peered":"2024-09-13T15:01:44.401559+0000","last_unstale":"2024-09-13T15:16:24.606279+0000","last_undegraded":"2024-09-13T15:16:24.606279+0000","last_fullsized":"2024-09-13T15:16:24.606279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-09-13T15:16:24.606164+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-09-13T15:16:24.606164+0000","last_clean_scrub_stamp":"2024-09-13T15:16:24.606164+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:58.610420+0000","scrub_duration":0.010477458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"33'4744","reported_seq":4782,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:33.297530+0000","last_change":"2024-09-13T15:16:33.297858+0000","last_active":"2024-09-13T15:16:33.297530+0000","last_peered":"2024-09-13T15:16:33.297530+0000","last_clean":"2024-09-13T15:16:33.297530+0000","last_became_active":"2024-09-13T15:01:48.857802+0000","last_became_peered":"2024-09-13T15:01:48.857802+0000","last_unstale":"2024-09-13T15:16:33.297530+0000","last_undegraded":"2024-09-13T15:16:33.297530+0000","last_fullsized":"2024-09-13T15:16:33.297530+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4744","last_scrub_stamp":"2024-09-13T15:16:33.297473+0000","last_deep_scrub":"33'4744","last_deep_scrub_stamp":"2024-09-13T15:16:33.297473+0000","last_clean_scrub_stamp":"2024-09-13T15:16:33.297473+0000","objects_scrubbed":0,"log_size":4744,"log_dups_size":0,"ondisk_log_size":4744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:00.056232+0000","scrub_duration":0.060614465999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69018,"num_write_kb":974815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"33'10","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.161757+0000","last_change":"2024-09-13T15:16:19.917251+0000","last_active":"2024-09-13T15:16:24.161757+0000","last_peered":"2024-09-13T15:16:24.161757+0000","last_clean":"2024-09-13T15:16:24.161757+0000","last_became_active":"2024-09-13T15:01:44.808420+0000","last_became_peered":"2024-09-13T15:01:44.808420+0000","last_unstale":"2024-09-13T15:16:24.161757+0000","last_undegraded":"2024-09-13T15:16:24.161757+0000","last_fullsized":"2024-09-13T15:16:24.161757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:19.917131+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:19.917131+0000","last_clean_scrub_stamp":"2024-09-13T15:16:19.917131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:55.912312+0000","scrub_duration":0.001471523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"33'15","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.059692+0000","last_change":"2024-09-13T15:16:22.548304+0000","last_active":"2024-09-13T15:16:24.059692+0000","last_peered":"2024-09-13T15:16:24.059692+0000","last_clean":"2024-09-13T15:16:24.059692+0000","last_became_active":"2024-09-13T15:01:44.406354+0000","last_became_peered":"2024-09-13T15:01:44.406354+0000","last_unstale":"2024-09-13T15:16:24.059692+0000","last_undegraded":"2024-09-13T15:16:24.059692+0000","last_fullsized":"2024-09-13T15:16:24.059692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T15:16:22.548208+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T15:16:22.548208+0000","last_clean_scrub_stamp":"2024-09-13T15:16:22.548208+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:10.347627+0000","scrub_duration":0.0063788459999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"33'4791","reported_seq":4829,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:52.318445+0000","last_change":"2024-09-13T15:16:52.318588+0000","last_active":"2024-09-13T15:16:52.318445+0000","last_peered":"2024-09-13T15:16:52.318445+0000","last_clean":"2024-09-13T15:16:52.318445+0000","last_became_active":"2024-09-13T15:01:48.909494+0000","last_became_peered":"2024-09-13T15:01:48.909494+0000","last_unstale":"2024-09-13T15:16:52.318445+0000","last_undegraded":"2024-09-13T15:16:52.318445+0000","last_fullsized":"2024-09-13T15:16:52.318445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4791","last_scrub_stamp":"2024-09-13T15:16:52.318426+0000","last_deep_scrub":"33'4791","last_deep_scrub_stamp":"2024-09-13T15:16:52.318426+0000","last_clean_scrub_stamp":"2024-09-13T15:16:52.318426+0000","objects_scrubbed":0,"log_size":4791,"log_dups_size":0,"ondisk_log_size":4791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:36.300358+0000","scrub_duration":0.051287922999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69959,"num_write_kb":1001010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"33'3","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.090842+0000","last_change":"2024-09-13T15:16:26.090842+0000","last_active":"2024-09-13T15:16:26.090842+0000","last_peered":"2024-09-13T15:16:26.090842+0000","last_clean":"2024-09-13T15:16:26.090842+0000","last_became_active":"2024-09-13T15:01:44.824392+0000","last_became_peered":"2024-09-13T15:01:44.824392+0000","last_unstale":"2024-09-13T15:16:26.090842+0000","last_undegraded":"2024-09-13T15:16:26.090842+0000","last_fullsized":"2024-09-13T15:16:26.090842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T15:16:26.090602+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T15:16:26.090602+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.090602+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:41:02.638139+0000","scrub_duration":0.0027170839999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"33'19","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:50.928613+0000","last_change":"2024-09-13T15:16:50.928613+0000","last_active":"2024-09-13T15:16:50.928613+0000","last_peered":"2024-09-13T15:16:50.928613+0000","last_clean":"2024-09-13T15:16:50.928613+0000","last_became_active":"2024-09-13T15:01:44.419082+0000","last_became_peered":"2024-09-13T15:01:44.419082+0000","last_unstale":"2024-09-13T15:16:50.928613+0000","last_undegraded":"2024-09-13T15:16:50.928613+0000","last_fullsized":"2024-09-13T15:16:50.928613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:50.928331+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:50.928331+0000","last_clean_scrub_stamp":"2024-09-13T15:16:50.928331+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:08.247608+0000","scrub_duration":0.017025906,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"33'4700","reported_seq":4738,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:47.376059+0000","last_change":"2024-09-13T15:16:47.376368+0000","last_active":"2024-09-13T15:16:47.376059+0000","last_peered":"2024-09-13T15:16:47.376059+0000","last_clean":"2024-09-13T15:16:47.376059+0000","last_became_active":"2024-09-13T15:01:48.855433+0000","last_became_peered":"2024-09-13T15:01:48.855433+0000","last_unstale":"2024-09-13T15:16:47.376059+0000","last_undegraded":"2024-09-13T15:16:47.376059+0000","last_fullsized":"2024-09-13T15:16:47.376059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4700","last_scrub_stamp":"2024-09-13T15:16:47.375999+0000","last_deep_scrub":"33'4700","last_deep_scrub_stamp":"2024-09-13T15:16:47.375999+0000","last_clean_scrub_stamp":"2024-09-13T15:16:47.375999+0000","objects_scrubbed":0,"log_size":4700,"log_dups_size":0,"ondisk_log_size":4700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:00.786470+0000","scrub_duration":0.06414396,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68074,"num_write_kb":991498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"33'7","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.348910+0000","last_change":"2024-09-13T15:16:26.348910+0000","last_active":"2024-09-13T15:16:26.348910+0000","last_peered":"2024-09-13T15:16:26.348910+0000","last_clean":"2024-09-13T15:16:26.348910+0000","last_became_active":"2024-09-13T15:01:44.807643+0000","last_became_peered":"2024-09-13T15:01:44.807643+0000","last_unstale":"2024-09-13T15:16:26.348910+0000","last_undegraded":"2024-09-13T15:16:26.348910+0000","last_fullsized":"2024-09-13T15:16:26.348910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:26.348813+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:26.348813+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.348813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:35.883729+0000","scrub_duration":0.001321298,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"33'19","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:25.747184+0000","last_change":"2024-09-13T15:16:25.747184+0000","last_active":"2024-09-13T15:16:25.747184+0000","last_peered":"2024-09-13T15:16:25.747184+0000","last_clean":"2024-09-13T15:16:25.747184+0000","last_became_active":"2024-09-13T15:01:44.429510+0000","last_became_peered":"2024-09-13T15:01:44.429510+0000","last_unstale":"2024-09-13T15:16:25.747184+0000","last_undegraded":"2024-09-13T15:16:25.747184+0000","last_fullsized":"2024-09-13T15:16:25.747184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:25.746901+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:25.746901+0000","last_clean_scrub_stamp":"2024-09-13T15:16:25.746901+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:29.626332+0000","scrub_duration":0.0090965799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'4847","reported_seq":4886,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:37.402053+0000","last_change":"2024-09-13T15:16:37.402307+0000","last_active":"2024-09-13T15:16:37.402053+0000","last_peered":"2024-09-13T15:16:37.402053+0000","last_clean":"2024-09-13T15:16:37.402053+0000","last_became_active":"2024-09-13T15:01:48.911578+0000","last_became_peered":"2024-09-13T15:01:48.911578+0000","last_unstale":"2024-09-13T15:16:37.402053+0000","last_undegraded":"2024-09-13T15:16:37.402053+0000","last_fullsized":"2024-09-13T15:16:37.402053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4847","last_scrub_stamp":"2024-09-13T15:16:37.402012+0000","last_deep_scrub":"33'4847","last_deep_scrub_stamp":"2024-09-13T15:16:37.402012+0000","last_clean_scrub_stamp":"2024-09-13T15:16:37.402012+0000","objects_scrubbed":0,"log_size":4847,"log_dups_size":0,"ondisk_log_size":4847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:44.796269+0000","scrub_duration":0.079726367000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70505,"num_write_kb":1030585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.009623+0000","last_change":"2024-09-13T15:16:46.009623+0000","last_active":"2024-09-13T15:16:46.009623+0000","last_peered":"2024-09-13T15:16:46.009623+0000","last_clean":"2024-09-13T15:16:46.009623+0000","last_became_active":"2024-09-13T15:01:44.838128+0000","last_became_peered":"2024-09-13T15:01:44.838128+0000","last_unstale":"2024-09-13T15:16:46.009623+0000","last_undegraded":"2024-09-13T15:16:46.009623+0000","last_fullsized":"2024-09-13T15:16:46.009623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:46.008515+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:46.008515+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.008515+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:27:19.737003+0000","scrub_duration":0.0026910200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'119","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.572041+0000","last_change":"2024-09-13T15:16:26.572041+0000","last_active":"2024-09-13T15:16:26.572041+0000","last_peered":"2024-09-13T15:16:26.572041+0000","last_clean":"2024-09-13T15:16:26.572041+0000","last_became_active":"2024-09-13T15:01:44.430548+0000","last_became_peered":"2024-09-13T15:01:44.430548+0000","last_unstale":"2024-09-13T15:16:26.572041+0000","last_undegraded":"2024-09-13T15:16:26.572041+0000","last_fullsized":"2024-09-13T15:16:26.572041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-09-13T15:16:26.571900+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-09-13T15:16:26.571900+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.571900+0000","objects_scrubbed":4,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:58.749238+0000","scrub_duration":0.0068987069999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":251,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"33'4848","reported_seq":4887,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:14.896071+0000","last_change":"2024-09-13T15:17:14.896208+0000","last_active":"2024-09-13T15:17:14.896071+0000","last_peered":"2024-09-13T15:17:14.896071+0000","last_clean":"2024-09-13T15:17:14.896071+0000","last_became_active":"2024-09-13T15:01:48.910150+0000","last_became_peered":"2024-09-13T15:01:48.910150+0000","last_unstale":"2024-09-13T15:17:14.896071+0000","last_undegraded":"2024-09-13T15:17:14.896071+0000","last_fullsized":"2024-09-13T15:17:14.896071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4848","last_scrub_stamp":"2024-09-13T15:17:14.896050+0000","last_deep_scrub":"33'4848","last_deep_scrub_stamp":"2024-09-13T15:17:14.896050+0000","last_clean_scrub_stamp":"2024-09-13T15:17:14.896050+0000","objects_scrubbed":0,"log_size":4848,"log_dups_size":0,"ondisk_log_size":4848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:10.990249+0000","scrub_duration":0.043703262,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70446,"num_write_kb":999196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"33'14","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:40.382671+0000","last_change":"2024-09-13T15:16:40.382752+0000","last_active":"2024-09-13T15:16:40.382671+0000","last_peered":"2024-09-13T15:16:40.382671+0000","last_clean":"2024-09-13T15:16:40.382671+0000","last_became_active":"2024-09-13T15:01:44.811915+0000","last_became_peered":"2024-09-13T15:01:44.811915+0000","last_unstale":"2024-09-13T15:16:40.382671+0000","last_undegraded":"2024-09-13T15:16:40.382671+0000","last_fullsized":"2024-09-13T15:16:40.382671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:40.382651+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:40.382651+0000","last_clean_scrub_stamp":"2024-09-13T15:16:40.382651+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:21.251984+0000","scrub_duration":0.001494736,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'13","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:36.714995+0000","last_change":"2024-09-13T15:16:36.715178+0000","last_active":"2024-09-13T15:16:36.714995+0000","last_peered":"2024-09-13T15:16:36.714995+0000","last_clean":"2024-09-13T15:16:36.714995+0000","last_became_active":"2024-09-13T15:01:44.422297+0000","last_became_peered":"2024-09-13T15:01:44.422297+0000","last_unstale":"2024-09-13T15:16:36.714995+0000","last_undegraded":"2024-09-13T15:16:36.714995+0000","last_fullsized":"2024-09-13T15:16:36.714995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T15:16:36.714944+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T15:16:36.714944+0000","last_clean_scrub_stamp":"2024-09-13T15:16:36.714944+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:53.830394+0000","scrub_duration":0.0057288749999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"33'4797","reported_seq":4836,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:57.381405+0000","last_change":"2024-09-13T15:16:57.381540+0000","last_active":"2024-09-13T15:16:57.381405+0000","last_peered":"2024-09-13T15:16:57.381405+0000","last_clean":"2024-09-13T15:16:57.381405+0000","last_became_active":"2024-09-13T15:01:48.908118+0000","last_became_peered":"2024-09-13T15:01:48.908118+0000","last_unstale":"2024-09-13T15:16:57.381405+0000","last_undegraded":"2024-09-13T15:16:57.381405+0000","last_fullsized":"2024-09-13T15:16:57.381405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4797","last_scrub_stamp":"2024-09-13T15:16:57.381384+0000","last_deep_scrub":"33'4797","last_deep_scrub_stamp":"2024-09-13T15:16:57.381384+0000","last_clean_scrub_stamp":"2024-09-13T15:16:57.381384+0000","objects_scrubbed":0,"log_size":4797,"log_dups_size":0,"ondisk_log_size":4797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:04.766466+0000","scrub_duration":0.052226372,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69559,"num_write_kb":1001647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"33'5","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:37.634781+0000","last_change":"2024-09-13T15:16:37.634978+0000","last_active":"2024-09-13T15:16:37.634781+0000","last_peered":"2024-09-13T15:16:37.634781+0000","last_clean":"2024-09-13T15:16:37.634781+0000","last_became_active":"2024-09-13T15:01:44.850263+0000","last_became_peered":"2024-09-13T15:01:44.850263+0000","last_unstale":"2024-09-13T15:16:37.634781+0000","last_undegraded":"2024-09-13T15:16:37.634781+0000","last_fullsized":"2024-09-13T15:16:37.634781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T15:16:37.634730+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T15:16:37.634730+0000","last_clean_scrub_stamp":"2024-09-13T15:16:37.634730+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:49.903072+0000","scrub_duration":0.0026524399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.015510+0000","last_change":"2024-09-13T15:16:23.590960+0000","last_active":"2024-09-13T15:16:24.015510+0000","last_peered":"2024-09-13T15:16:24.015510+0000","last_clean":"2024-09-13T15:16:24.015510+0000","last_became_active":"2024-09-13T15:01:44.398881+0000","last_became_peered":"2024-09-13T15:01:44.398881+0000","last_unstale":"2024-09-13T15:16:24.015510+0000","last_undegraded":"2024-09-13T15:16:24.015510+0000","last_fullsized":"2024-09-13T15:16:24.015510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T15:16:23.590800+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T15:16:23.590800+0000","last_clean_scrub_stamp":"2024-09-13T15:16:23.590800+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:44.286646+0000","scrub_duration":0.023094673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2694,"num_omap_keys":5,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4059","reported_seq":4098,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:51.315149+0000","last_change":"2024-09-13T15:16:51.315264+0000","last_active":"2024-09-13T15:16:51.315149+0000","last_peered":"2024-09-13T15:16:51.315149+0000","last_clean":"2024-09-13T15:16:51.315149+0000","last_became_active":"2024-09-13T15:01:48.851948+0000","last_became_peered":"2024-09-13T15:01:48.851948+0000","last_unstale":"2024-09-13T15:16:51.315149+0000","last_undegraded":"2024-09-13T15:16:51.315149+0000","last_fullsized":"2024-09-13T15:16:51.315149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4059","last_scrub_stamp":"2024-09-13T15:16:51.315130+0000","last_deep_scrub":"33'4059","last_deep_scrub_stamp":"2024-09-13T15:16:51.315130+0000","last_clean_scrub_stamp":"2024-09-13T15:16:51.315130+0000","objects_scrubbed":0,"log_size":4059,"log_dups_size":0,"ondisk_log_size":4059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:59:45.048586+0000","scrub_duration":0.037480123999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58925,"num_write_kb":861513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"33'7","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:28.083406+0000","last_change":"2024-09-13T15:16:28.083406+0000","last_active":"2024-09-13T15:16:28.083406+0000","last_peered":"2024-09-13T15:16:28.083406+0000","last_clean":"2024-09-13T15:16:28.083406+0000","last_became_active":"2024-09-13T15:01:44.821475+0000","last_became_peered":"2024-09-13T15:01:44.821475+0000","last_unstale":"2024-09-13T15:16:28.083406+0000","last_undegraded":"2024-09-13T15:16:28.083406+0000","last_fullsized":"2024-09-13T15:16:28.083406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:28.083138+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:28.083138+0000","last_clean_scrub_stamp":"2024-09-13T15:16:28.083138+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:39.566336+0000","scrub_duration":0.0028025329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'40","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.600169+0000","last_change":"2024-09-13T15:16:26.600795+0000","last_active":"2024-09-13T15:16:26.600169+0000","last_peered":"2024-09-13T15:16:26.600169+0000","last_clean":"2024-09-13T15:16:26.600169+0000","last_became_active":"2024-09-13T15:01:44.432902+0000","last_became_peered":"2024-09-13T15:01:44.432902+0000","last_unstale":"2024-09-13T15:16:26.600169+0000","last_undegraded":"2024-09-13T15:16:26.600169+0000","last_fullsized":"2024-09-13T15:16:26.600169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'40","last_scrub_stamp":"2024-09-13T15:16:26.600116+0000","last_deep_scrub":"33'40","last_deep_scrub_stamp":"2024-09-13T15:16:26.600116+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.600116+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:35.079765+0000","scrub_duration":0.027584299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389688,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":8206,"num_write":28,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"33'4539","reported_seq":4578,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:42.385854+0000","last_change":"2024-09-13T15:16:42.385984+0000","last_active":"2024-09-13T15:16:42.385854+0000","last_peered":"2024-09-13T15:16:42.385854+0000","last_clean":"2024-09-13T15:16:42.385854+0000","last_became_active":"2024-09-13T15:01:48.846301+0000","last_became_peered":"2024-09-13T15:01:48.846301+0000","last_unstale":"2024-09-13T15:16:42.385854+0000","last_undegraded":"2024-09-13T15:16:42.385854+0000","last_fullsized":"2024-09-13T15:16:42.385854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4539","last_scrub_stamp":"2024-09-13T15:16:42.385833+0000","last_deep_scrub":"33'4539","last_deep_scrub_stamp":"2024-09-13T15:16:42.385833+0000","last_clean_scrub_stamp":"2024-09-13T15:16:42.385833+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:56.294090+0000","scrub_duration":0.044831939000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66145,"num_write_kb":975469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"33'12","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.078239+0000","last_change":"2024-09-13T15:16:17.879916+0000","last_active":"2024-09-13T15:16:24.078239+0000","last_peered":"2024-09-13T15:16:24.078239+0000","last_clean":"2024-09-13T15:16:24.078239+0000","last_became_active":"2024-09-13T15:01:44.814192+0000","last_became_peered":"2024-09-13T15:01:44.814192+0000","last_unstale":"2024-09-13T15:16:24.078239+0000","last_undegraded":"2024-09-13T15:16:24.078239+0000","last_fullsized":"2024-09-13T15:16:24.078239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:17.879753+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:17.879753+0000","last_clean_scrub_stamp":"2024-09-13T15:16:17.879753+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:36.906977+0000","scrub_duration":0.33901714599999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'35","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.123746+0000","last_change":"2024-09-13T15:16:26.123827+0000","last_active":"2024-09-13T15:16:26.123746+0000","last_peered":"2024-09-13T15:16:26.123746+0000","last_clean":"2024-09-13T15:16:26.123746+0000","last_became_active":"2024-09-13T15:01:44.398904+0000","last_became_peered":"2024-09-13T15:01:44.398904+0000","last_unstale":"2024-09-13T15:16:26.123746+0000","last_undegraded":"2024-09-13T15:16:26.123746+0000","last_fullsized":"2024-09-13T15:16:26.123746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-09-13T15:16:26.123727+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-09-13T15:16:26.123727+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.123727+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:19.696735+0000","scrub_duration":0.0038650519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70412,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":156,"num_write":30,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'5224","reported_seq":5263,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:50.323166+0000","last_change":"2024-09-13T15:16:50.323166+0000","last_active":"2024-09-13T15:16:50.323166+0000","last_peered":"2024-09-13T15:16:50.323166+0000","last_clean":"2024-09-13T15:16:50.323166+0000","last_became_active":"2024-09-13T15:01:48.858649+0000","last_became_peered":"2024-09-13T15:01:48.858649+0000","last_unstale":"2024-09-13T15:16:50.323166+0000","last_undegraded":"2024-09-13T15:16:50.323166+0000","last_fullsized":"2024-09-13T15:16:50.323166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5224","last_scrub_stamp":"2024-09-13T15:16:50.323018+0000","last_deep_scrub":"33'5224","last_deep_scrub_stamp":"2024-09-13T15:16:50.323018+0000","last_clean_scrub_stamp":"2024-09-13T15:16:50.323018+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:11.290072+0000","scrub_duration":0.049882793000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76325,"num_write_kb":1087992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:39.281590+0000","last_change":"2024-09-13T15:16:39.281681+0000","last_active":"2024-09-13T15:16:39.281590+0000","last_peered":"2024-09-13T15:16:39.281590+0000","last_clean":"2024-09-13T15:16:39.281590+0000","last_became_active":"2024-09-13T15:01:44.826222+0000","last_became_peered":"2024-09-13T15:01:44.826222+0000","last_unstale":"2024-09-13T15:16:39.281590+0000","last_undegraded":"2024-09-13T15:16:39.281590+0000","last_fullsized":"2024-09-13T15:16:39.281590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T15:16:39.281570+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T15:16:39.281570+0000","last_clean_scrub_stamp":"2024-09-13T15:16:39.281570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:44.314476+0000","scrub_duration":0.0023677669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'32","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:40.787167+0000","last_change":"2024-09-13T15:16:40.787346+0000","last_active":"2024-09-13T15:16:40.787167+0000","last_peered":"2024-09-13T15:16:40.787167+0000","last_clean":"2024-09-13T15:16:40.787167+0000","last_became_active":"2024-09-13T15:01:44.419660+0000","last_became_peered":"2024-09-13T15:01:44.419660+0000","last_unstale":"2024-09-13T15:16:40.787167+0000","last_undegraded":"2024-09-13T15:16:40.787167+0000","last_fullsized":"2024-09-13T15:16:40.787167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'32","last_scrub_stamp":"2024-09-13T15:16:40.787112+0000","last_deep_scrub":"33'32","last_deep_scrub_stamp":"2024-09-13T15:16:40.787112+0000","last_clean_scrub_stamp":"2024-09-13T15:16:40.787112+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:08.058596+0000","scrub_duration":0.026405371,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":20,"num_write_kb":8201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'4215","reported_seq":4264,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:55.325420+0000","last_change":"2024-09-13T15:16:55.325544+0000","last_active":"2024-09-13T15:16:55.325420+0000","last_peered":"2024-09-13T15:16:55.325420+0000","last_clean":"2024-09-13T15:16:55.325420+0000","last_became_active":"2024-09-13T15:02:34.118461+0000","last_became_peered":"2024-09-13T15:02:34.118461+0000","last_unstale":"2024-09-13T15:16:55.325420+0000","last_undegraded":"2024-09-13T15:16:55.325420+0000","last_fullsized":"2024-09-13T15:16:55.325420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4215","last_scrub_stamp":"2024-09-13T15:16:55.325400+0000","last_deep_scrub":"33'4215","last_deep_scrub_stamp":"2024-09-13T15:16:55.325400+0000","last_clean_scrub_stamp":"2024-09-13T15:16:55.325400+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:05.926263+0000","scrub_duration":0.065180481999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60783,"num_write_kb":878332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:35.977004+0000","last_change":"2024-09-13T15:16:35.977077+0000","last_active":"2024-09-13T15:16:35.977004+0000","last_peered":"2024-09-13T15:16:35.977004+0000","last_clean":"2024-09-13T15:16:35.977004+0000","last_became_active":"2024-09-13T15:01:44.850234+0000","last_became_peered":"2024-09-13T15:01:44.850234+0000","last_unstale":"2024-09-13T15:16:35.977004+0000","last_undegraded":"2024-09-13T15:16:35.977004+0000","last_fullsized":"2024-09-13T15:16:35.977004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:35.976986+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:35.976986+0000","last_clean_scrub_stamp":"2024-09-13T15:16:35.976986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:15.229979+0000","scrub_duration":0.0024425779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"33'14","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:27.599430+0000","last_change":"2024-09-13T15:16:27.599633+0000","last_active":"2024-09-13T15:16:27.599430+0000","last_peered":"2024-09-13T15:16:27.599430+0000","last_clean":"2024-09-13T15:16:27.599430+0000","last_became_active":"2024-09-13T15:01:44.410675+0000","last_became_peered":"2024-09-13T15:01:44.410675+0000","last_unstale":"2024-09-13T15:16:27.599430+0000","last_undegraded":"2024-09-13T15:16:27.599430+0000","last_fullsized":"2024-09-13T15:16:27.599430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:27.599376+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:27.599376+0000","last_clean_scrub_stamp":"2024-09-13T15:16:27.599376+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:49.535267+0000","scrub_duration":0.0074093939999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":18,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:29.740890+0000","last_change":"2024-09-13T15:16:29.741095+0000","last_active":"2024-09-13T15:16:29.740890+0000","last_peered":"2024-09-13T15:16:29.740890+0000","last_clean":"2024-09-13T15:16:29.740890+0000","last_became_active":"2024-09-13T15:01:40.832279+0000","last_became_peered":"2024-09-13T15:01:40.832279+0000","last_unstale":"2024-09-13T15:16:29.740890+0000","last_undegraded":"2024-09-13T15:16:29.740890+0000","last_fullsized":"2024-09-13T15:16:29.740890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-09-13T15:16:29.740837+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-09-13T15:16:29.740837+0000","last_clean_scrub_stamp":"2024-09-13T15:16:29.740837+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:37.631981+0000","scrub_duration":0.0066710290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"33'5137","reported_seq":5176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:03.930377+0000","last_change":"2024-09-13T15:17:03.930611+0000","last_active":"2024-09-13T15:17:03.930377+0000","last_peered":"2024-09-13T15:17:03.930377+0000","last_clean":"2024-09-13T15:17:03.930377+0000","last_became_active":"2024-09-13T15:01:48.918678+0000","last_became_peered":"2024-09-13T15:01:48.918678+0000","last_unstale":"2024-09-13T15:17:03.930377+0000","last_undegraded":"2024-09-13T15:17:03.930377+0000","last_fullsized":"2024-09-13T15:17:03.930377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5137","last_scrub_stamp":"2024-09-13T15:17:03.930331+0000","last_deep_scrub":"33'5137","last_deep_scrub_stamp":"2024-09-13T15:17:03.930331+0000","last_clean_scrub_stamp":"2024-09-13T15:17:03.930331+0000","objects_scrubbed":0,"log_size":5137,"log_dups_size":0,"ondisk_log_size":5137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:10.205490+0000","scrub_duration":0.095690918999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74848,"num_write_kb":1044614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"33'7","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:22.684165+0000","last_change":"2024-09-13T15:16:22.684165+0000","last_active":"2024-09-13T15:16:22.684165+0000","last_peered":"2024-09-13T15:16:22.684165+0000","last_clean":"2024-09-13T15:16:22.684165+0000","last_became_active":"2024-09-13T15:01:44.849457+0000","last_became_peered":"2024-09-13T15:01:44.849457+0000","last_unstale":"2024-09-13T15:16:22.684165+0000","last_undegraded":"2024-09-13T15:16:22.684165+0000","last_fullsized":"2024-09-13T15:16:22.684165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:22.683907+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:22.683907+0000","last_clean_scrub_stamp":"2024-09-13T15:16:22.683907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:51.010493+0000","scrub_duration":0.0033186610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"33'18","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.088002+0000","last_change":"2024-09-13T15:16:19.393403+0000","last_active":"2024-09-13T15:16:24.088002+0000","last_peered":"2024-09-13T15:16:24.088002+0000","last_clean":"2024-09-13T15:16:24.088002+0000","last_became_active":"2024-09-13T15:01:44.420601+0000","last_became_peered":"2024-09-13T15:01:44.420601+0000","last_unstale":"2024-09-13T15:16:24.088002+0000","last_undegraded":"2024-09-13T15:16:24.088002+0000","last_fullsized":"2024-09-13T15:16:24.088002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T15:16:19.393308+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T15:16:19.393308+0000","last_clean_scrub_stamp":"2024-09-13T15:16:19.393308+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:04.511597+0000","scrub_duration":0.25461208400000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"33'4520","reported_seq":4559,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:58.878819+0000","last_change":"2024-09-13T15:16:58.878819+0000","last_active":"2024-09-13T15:16:58.878819+0000","last_peered":"2024-09-13T15:16:58.878819+0000","last_clean":"2024-09-13T15:16:58.878819+0000","last_became_active":"2024-09-13T15:01:48.910479+0000","last_became_peered":"2024-09-13T15:01:48.910479+0000","last_unstale":"2024-09-13T15:16:58.878819+0000","last_undegraded":"2024-09-13T15:16:58.878819+0000","last_fullsized":"2024-09-13T15:16:58.878819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4520","last_scrub_stamp":"2024-09-13T15:16:58.878450+0000","last_deep_scrub":"33'4520","last_deep_scrub_stamp":"2024-09-13T15:16:58.878450+0000","last_clean_scrub_stamp":"2024-09-13T15:16:58.878450+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:36.119849+0000","scrub_duration":0.070444623999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65908,"num_write_kb":920675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:36.610995+0000","last_change":"2024-09-13T15:16:36.611191+0000","last_active":"2024-09-13T15:16:36.610995+0000","last_peered":"2024-09-13T15:16:36.610995+0000","last_clean":"2024-09-13T15:16:36.610995+0000","last_became_active":"2024-09-13T15:01:44.837429+0000","last_became_peered":"2024-09-13T15:01:44.837429+0000","last_unstale":"2024-09-13T15:16:36.610995+0000","last_undegraded":"2024-09-13T15:16:36.610995+0000","last_fullsized":"2024-09-13T15:16:36.610995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:36.610935+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:36.610935+0000","last_clean_scrub_stamp":"2024-09-13T15:16:36.610935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:41.442948+0000","scrub_duration":0.0026950490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"33'18","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:25.592150+0000","last_change":"2024-09-13T15:16:25.592225+0000","last_active":"2024-09-13T15:16:25.592150+0000","last_peered":"2024-09-13T15:16:25.592150+0000","last_clean":"2024-09-13T15:16:25.592150+0000","last_became_active":"2024-09-13T15:01:44.406719+0000","last_became_peered":"2024-09-13T15:01:44.406719+0000","last_unstale":"2024-09-13T15:16:25.592150+0000","last_undegraded":"2024-09-13T15:16:25.592150+0000","last_fullsized":"2024-09-13T15:16:25.592150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T15:16:25.592132+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T15:16:25.592132+0000","last_clean_scrub_stamp":"2024-09-13T15:16:25.592132+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:03:43.505817+0000","scrub_duration":0.015211931,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":9,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"33'5126","reported_seq":5164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:56.359514+0000","last_change":"2024-09-13T15:16:56.359631+0000","last_active":"2024-09-13T15:16:56.359514+0000","last_peered":"2024-09-13T15:16:56.359514+0000","last_clean":"2024-09-13T15:16:56.359514+0000","last_became_active":"2024-09-13T15:01:48.857542+0000","last_became_peered":"2024-09-13T15:01:48.857542+0000","last_unstale":"2024-09-13T15:16:56.359514+0000","last_undegraded":"2024-09-13T15:16:56.359514+0000","last_fullsized":"2024-09-13T15:16:56.359514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5126","last_scrub_stamp":"2024-09-13T15:16:56.359491+0000","last_deep_scrub":"33'5126","last_deep_scrub_stamp":"2024-09-13T15:16:56.359491+0000","last_clean_scrub_stamp":"2024-09-13T15:16:56.359491+0000","objects_scrubbed":0,"log_size":5126,"log_dups_size":0,"ondisk_log_size":5126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:55.537170+0000","scrub_duration":0.051104059,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74246,"num_write_kb":1079868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"33'12","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:02.946281+0000","last_change":"2024-09-13T15:17:02.946480+0000","last_active":"2024-09-13T15:17:02.946281+0000","last_peered":"2024-09-13T15:17:02.946281+0000","last_clean":"2024-09-13T15:17:02.946281+0000","last_became_active":"2024-09-13T15:01:44.831166+0000","last_became_peered":"2024-09-13T15:01:44.831166+0000","last_unstale":"2024-09-13T15:17:02.946281+0000","last_undegraded":"2024-09-13T15:17:02.946281+0000","last_fullsized":"2024-09-13T15:17:02.946281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T15:17:02.946228+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T15:17:02.946228+0000","last_clean_scrub_stamp":"2024-09-13T15:17:02.946228+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:32.392312+0000","scrub_duration":0.003277716,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"33'24","reported_seq":72,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:28.070586+0000","last_change":"2024-09-13T15:16:28.070673+0000","last_active":"2024-09-13T15:16:28.070586+0000","last_peered":"2024-09-13T15:16:28.070586+0000","last_clean":"2024-09-13T15:16:28.070586+0000","last_became_active":"2024-09-13T15:01:44.401799+0000","last_became_peered":"2024-09-13T15:01:44.401799+0000","last_unstale":"2024-09-13T15:16:28.070586+0000","last_undegraded":"2024-09-13T15:16:28.070586+0000","last_fullsized":"2024-09-13T15:16:28.070586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-13T15:16:28.070566+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-13T15:16:28.070566+0000","last_clean_scrub_stamp":"2024-09-13T15:16:28.070566+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:35.758129+0000","scrub_duration":0.0088310460000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":4114,"num_write":17,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"33'4768","reported_seq":4807,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:56.710326+0000","last_change":"2024-09-13T15:16:56.710326+0000","last_active":"2024-09-13T15:16:56.710326+0000","last_peered":"2024-09-13T15:16:56.710326+0000","last_clean":"2024-09-13T15:16:56.710326+0000","last_became_active":"2024-09-13T15:01:48.911474+0000","last_became_peered":"2024-09-13T15:01:48.911474+0000","last_unstale":"2024-09-13T15:16:56.710326+0000","last_undegraded":"2024-09-13T15:16:56.710326+0000","last_fullsized":"2024-09-13T15:16:56.710326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4768","last_scrub_stamp":"2024-09-13T15:16:56.709952+0000","last_deep_scrub":"33'4768","last_deep_scrub_stamp":"2024-09-13T15:16:56.709952+0000","last_clean_scrub_stamp":"2024-09-13T15:16:56.709952+0000","objects_scrubbed":0,"log_size":4768,"log_dups_size":0,"ondisk_log_size":4768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:20.071727+0000","scrub_duration":0.088888849000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69048,"num_write_kb":987747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"33'7","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:03.945661+0000","last_change":"2024-09-13T15:17:03.945852+0000","last_active":"2024-09-13T15:17:03.945661+0000","last_peered":"2024-09-13T15:17:03.945661+0000","last_clean":"2024-09-13T15:17:03.945661+0000","last_became_active":"2024-09-13T15:01:44.817718+0000","last_became_peered":"2024-09-13T15:01:44.817718+0000","last_unstale":"2024-09-13T15:17:03.945661+0000","last_undegraded":"2024-09-13T15:17:03.945661+0000","last_fullsized":"2024-09-13T15:17:03.945661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:17:03.945606+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:17:03.945606+0000","last_clean_scrub_stamp":"2024-09-13T15:17:03.945606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:58.674997+0000","scrub_duration":0.0033964189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"33'19","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:21.104702+0000","last_change":"2024-09-13T15:16:21.104702+0000","last_active":"2024-09-13T15:16:21.104702+0000","last_peered":"2024-09-13T15:16:21.104702+0000","last_clean":"2024-09-13T15:16:21.104702+0000","last_became_active":"2024-09-13T15:01:44.409585+0000","last_became_peered":"2024-09-13T15:01:44.409585+0000","last_unstale":"2024-09-13T15:16:21.104702+0000","last_undegraded":"2024-09-13T15:16:21.104702+0000","last_fullsized":"2024-09-13T15:16:21.104702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T15:16:21.104582+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T15:16:21.104582+0000","last_clean_scrub_stamp":"2024-09-13T15:16:21.104582+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:29.612823+0000","scrub_duration":0.054426386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"33'5322","reported_seq":5361,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:50.421188+0000","last_change":"2024-09-13T15:16:50.421188+0000","last_active":"2024-09-13T15:16:50.421188+0000","last_peered":"2024-09-13T15:16:50.421188+0000","last_clean":"2024-09-13T15:16:50.421188+0000","last_became_active":"2024-09-13T15:01:48.860317+0000","last_became_peered":"2024-09-13T15:01:48.860317+0000","last_unstale":"2024-09-13T15:16:50.421188+0000","last_undegraded":"2024-09-13T15:16:50.421188+0000","last_fullsized":"2024-09-13T15:16:50.421188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5322","last_scrub_stamp":"2024-09-13T15:16:50.420854+0000","last_deep_scrub":"33'5322","last_deep_scrub_stamp":"2024-09-13T15:16:50.420854+0000","last_clean_scrub_stamp":"2024-09-13T15:16:50.420854+0000","objects_scrubbed":0,"log_size":5322,"log_dups_size":0,"ondisk_log_size":5322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:27.164571+0000","scrub_duration":0.069188280000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77566,"num_write_kb":1107255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"33'7","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:05.936709+0000","last_change":"2024-09-13T15:17:05.936930+0000","last_active":"2024-09-13T15:17:05.936709+0000","last_peered":"2024-09-13T15:17:05.936709+0000","last_clean":"2024-09-13T15:17:05.936709+0000","last_became_active":"2024-09-13T15:01:44.831150+0000","last_became_peered":"2024-09-13T15:01:44.831150+0000","last_unstale":"2024-09-13T15:17:05.936709+0000","last_undegraded":"2024-09-13T15:17:05.936709+0000","last_fullsized":"2024-09-13T15:17:05.936709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:17:05.936657+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:17:05.936657+0000","last_clean_scrub_stamp":"2024-09-13T15:17:05.936657+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:06.321071+0000","scrub_duration":0.0030559329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'37","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.090066+0000","last_change":"2024-09-13T15:16:23.110015+0000","last_active":"2024-09-13T15:16:24.090066+0000","last_peered":"2024-09-13T15:16:24.090066+0000","last_clean":"2024-09-13T15:16:24.090066+0000","last_became_active":"2024-09-13T15:01:44.389946+0000","last_became_peered":"2024-09-13T15:01:44.389946+0000","last_unstale":"2024-09-13T15:16:24.090066+0000","last_undegraded":"2024-09-13T15:16:24.090066+0000","last_fullsized":"2024-09-13T15:16:24.090066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'31","last_scrub_stamp":"2024-09-13T15:16:23.109915+0000","last_deep_scrub":"33'31","last_deep_scrub_stamp":"2024-09-13T15:16:23.109915+0000","last_clean_scrub_stamp":"2024-09-13T15:16:23.109915+0000","objects_scrubbed":9,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:49.142729+0000","scrub_duration":0.0066126249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":23,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9630,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"33'4126","reported_seq":4164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:58.334577+0000","last_change":"2024-09-13T15:16:58.334773+0000","last_active":"2024-09-13T15:16:58.334577+0000","last_peered":"2024-09-13T15:16:58.334577+0000","last_clean":"2024-09-13T15:16:58.334577+0000","last_became_active":"2024-09-13T15:01:48.847605+0000","last_became_peered":"2024-09-13T15:01:48.847605+0000","last_unstale":"2024-09-13T15:16:58.334577+0000","last_undegraded":"2024-09-13T15:16:58.334577+0000","last_fullsized":"2024-09-13T15:16:58.334577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4126","last_scrub_stamp":"2024-09-13T15:16:58.334532+0000","last_deep_scrub":"33'4126","last_deep_scrub_stamp":"2024-09-13T15:16:58.334532+0000","last_clean_scrub_stamp":"2024-09-13T15:16:58.334532+0000","objects_scrubbed":0,"log_size":4126,"log_dups_size":0,"ondisk_log_size":4126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:15:05.258006+0000","scrub_duration":0.047342742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59577,"num_write_kb":873580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:40.892263+0000","last_change":"2024-09-13T15:16:40.892463+0000","last_active":"2024-09-13T15:16:40.892263+0000","last_peered":"2024-09-13T15:16:40.892263+0000","last_clean":"2024-09-13T15:16:40.892263+0000","last_became_active":"2024-09-13T15:01:44.808140+0000","last_became_peered":"2024-09-13T15:01:44.808140+0000","last_unstale":"2024-09-13T15:16:40.892263+0000","last_undegraded":"2024-09-13T15:16:40.892263+0000","last_fullsized":"2024-09-13T15:16:40.892263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:40.892207+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:40.892207+0000","last_clean_scrub_stamp":"2024-09-13T15:16:40.892207+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:10.273365+0000","scrub_duration":0.0030575229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"33'14","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:31.855992+0000","last_change":"2024-09-13T15:16:31.856223+0000","last_active":"2024-09-13T15:16:31.855992+0000","last_peered":"2024-09-13T15:16:31.855992+0000","last_clean":"2024-09-13T15:16:31.855992+0000","last_became_active":"2024-09-13T15:01:44.428271+0000","last_became_peered":"2024-09-13T15:01:44.428271+0000","last_unstale":"2024-09-13T15:16:31.855992+0000","last_undegraded":"2024-09-13T15:16:31.855992+0000","last_fullsized":"2024-09-13T15:16:31.855992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:31.855936+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:31.855936+0000","last_clean_scrub_stamp":"2024-09-13T15:16:31.855936+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:54.569226+0000","scrub_duration":0.0071886169999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"33'4957","reported_seq":4995,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:58.849246+0000","last_change":"2024-09-13T15:16:58.849437+0000","last_active":"2024-09-13T15:16:58.849246+0000","last_peered":"2024-09-13T15:16:58.849246+0000","last_clean":"2024-09-13T15:16:58.849246+0000","last_became_active":"2024-09-13T15:01:48.916008+0000","last_became_peered":"2024-09-13T15:01:48.916008+0000","last_unstale":"2024-09-13T15:16:58.849246+0000","last_undegraded":"2024-09-13T15:16:58.849246+0000","last_fullsized":"2024-09-13T15:16:58.849246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4957","last_scrub_stamp":"2024-09-13T15:16:58.849204+0000","last_deep_scrub":"33'4957","last_deep_scrub_stamp":"2024-09-13T15:16:58.849204+0000","last_clean_scrub_stamp":"2024-09-13T15:16:58.849204+0000","objects_scrubbed":0,"log_size":4957,"log_dups_size":0,"ondisk_log_size":4957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:04.395536+0000","scrub_duration":0.054487189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72374,"num_write_kb":1020409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'20","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.700019+0000","last_change":"2024-09-13T15:16:24.700227+0000","last_active":"2024-09-13T15:16:24.700019+0000","last_peered":"2024-09-13T15:16:24.700019+0000","last_clean":"2024-09-13T15:16:24.700019+0000","last_became_active":"2024-09-13T15:01:44.825996+0000","last_became_peered":"2024-09-13T15:01:44.825996+0000","last_unstale":"2024-09-13T15:16:24.700019+0000","last_undegraded":"2024-09-13T15:16:24.700019+0000","last_fullsized":"2024-09-13T15:16:24.700019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-13T15:16:24.699962+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-13T15:16:24.699962+0000","last_clean_scrub_stamp":"2024-09-13T15:16:24.699962+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:57.006772+0000","scrub_duration":0.003063091,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"33'11","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:30.633435+0000","last_change":"2024-09-13T15:16:30.633635+0000","last_active":"2024-09-13T15:16:30.633435+0000","last_peered":"2024-09-13T15:16:30.633435+0000","last_clean":"2024-09-13T15:16:30.633435+0000","last_became_active":"2024-09-13T15:01:44.408644+0000","last_became_peered":"2024-09-13T15:01:44.408644+0000","last_unstale":"2024-09-13T15:16:30.633435+0000","last_undegraded":"2024-09-13T15:16:30.633435+0000","last_fullsized":"2024-09-13T15:16:30.633435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:30.633381+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:30.633381+0000","last_clean_scrub_stamp":"2024-09-13T15:16:30.633381+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:48.589150+0000","scrub_duration":0.005668729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'4735","reported_seq":4773,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:59.827420+0000","last_change":"2024-09-13T15:16:59.827539+0000","last_active":"2024-09-13T15:16:59.827420+0000","last_peered":"2024-09-13T15:16:59.827420+0000","last_clean":"2024-09-13T15:16:59.827420+0000","last_became_active":"2024-09-13T15:01:48.916198+0000","last_became_peered":"2024-09-13T15:01:48.916198+0000","last_unstale":"2024-09-13T15:16:59.827420+0000","last_undegraded":"2024-09-13T15:16:59.827420+0000","last_fullsized":"2024-09-13T15:16:59.827420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4735","last_scrub_stamp":"2024-09-13T15:16:59.827399+0000","last_deep_scrub":"33'4735","last_deep_scrub_stamp":"2024-09-13T15:16:59.827399+0000","last_clean_scrub_stamp":"2024-09-13T15:16:59.827399+0000","objects_scrubbed":0,"log_size":4735,"log_dups_size":0,"ondisk_log_size":4735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:59.155793+0000","scrub_duration":0.046810262999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68970,"num_write_kb":974417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.305261+0000","last_change":"2024-09-13T15:16:34.305358+0000","last_active":"2024-09-13T15:16:34.305261+0000","last_peered":"2024-09-13T15:16:34.305261+0000","last_clean":"2024-09-13T15:16:34.305261+0000","last_became_active":"2024-09-13T15:01:44.831583+0000","last_became_peered":"2024-09-13T15:01:44.831583+0000","last_unstale":"2024-09-13T15:16:34.305261+0000","last_undegraded":"2024-09-13T15:16:34.305261+0000","last_fullsized":"2024-09-13T15:16:34.305261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:34.305240+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:34.305240+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.305240+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:40.060577+0000","scrub_duration":0.0020742930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"33'41","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.078546+0000","last_change":"2024-09-13T15:16:20.445448+0000","last_active":"2024-09-13T15:16:24.078546+0000","last_peered":"2024-09-13T15:16:24.078546+0000","last_clean":"2024-09-13T15:16:24.078546+0000","last_became_active":"2024-09-13T15:01:44.408453+0000","last_became_peered":"2024-09-13T15:01:44.408453+0000","last_unstale":"2024-09-13T15:16:24.078546+0000","last_undegraded":"2024-09-13T15:16:24.078546+0000","last_fullsized":"2024-09-13T15:16:24.078546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'38","last_scrub_stamp":"2024-09-13T15:16:20.444690+0000","last_deep_scrub":"33'38","last_deep_scrub_stamp":"2024-09-13T15:16:20.444690+0000","last_clean_scrub_stamp":"2024-09-13T15:16:20.444690+0000","objects_scrubbed":8,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:18.099238+0000","scrub_duration":0.086113890999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":8225,"num_write":32,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'5131","reported_seq":5169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:57.718333+0000","last_change":"2024-09-13T15:16:57.718567+0000","last_active":"2024-09-13T15:16:57.718333+0000","last_peered":"2024-09-13T15:16:57.718333+0000","last_clean":"2024-09-13T15:16:57.718333+0000","last_became_active":"2024-09-13T15:01:48.916185+0000","last_became_peered":"2024-09-13T15:01:48.916185+0000","last_unstale":"2024-09-13T15:16:57.718333+0000","last_undegraded":"2024-09-13T15:16:57.718333+0000","last_fullsized":"2024-09-13T15:16:57.718333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5131","last_scrub_stamp":"2024-09-13T15:16:57.718290+0000","last_deep_scrub":"33'5131","last_deep_scrub_stamp":"2024-09-13T15:16:57.718290+0000","last_clean_scrub_stamp":"2024-09-13T15:16:57.718290+0000","objects_scrubbed":0,"log_size":5131,"log_dups_size":0,"ondisk_log_size":5131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:48.355046+0000","scrub_duration":0.072062320999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74464,"num_write_kb":1089564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"33'7","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:01.914919+0000","last_change":"2024-09-13T15:17:01.915166+0000","last_active":"2024-09-13T15:17:01.914919+0000","last_peered":"2024-09-13T15:17:01.914919+0000","last_clean":"2024-09-13T15:17:01.914919+0000","last_became_active":"2024-09-13T15:01:44.815435+0000","last_became_peered":"2024-09-13T15:01:44.815435+0000","last_unstale":"2024-09-13T15:17:01.914919+0000","last_undegraded":"2024-09-13T15:17:01.914919+0000","last_fullsized":"2024-09-13T15:17:01.914919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:17:01.914861+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:17:01.914861+0000","last_clean_scrub_stamp":"2024-09-13T15:17:01.914861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:45.853767+0000","scrub_duration":0.0024798210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'583","reported_seq":636,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:29.820102+0000","last_change":"2024-09-13T15:16:29.820334+0000","last_active":"2024-09-13T15:16:29.820102+0000","last_peered":"2024-09-13T15:16:29.820102+0000","last_clean":"2024-09-13T15:16:29.820102+0000","last_became_active":"2024-09-13T15:01:44.435222+0000","last_became_peered":"2024-09-13T15:01:44.435222+0000","last_unstale":"2024-09-13T15:16:29.820102+0000","last_undegraded":"2024-09-13T15:16:29.820102+0000","last_fullsized":"2024-09-13T15:16:29.820102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'583","last_scrub_stamp":"2024-09-13T15:16:29.820047+0000","last_deep_scrub":"33'583","last_deep_scrub_stamp":"2024-09-13T15:16:29.820047+0000","last_clean_scrub_stamp":"2024-09-13T15:16:29.820047+0000","objects_scrubbed":7,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:27:24.758478+0000","scrub_duration":0.044190934000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8159583,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":7965,"num_write":571,"num_write_kb":8183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"33'4464","reported_seq":4502,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:43.348361+0000","last_change":"2024-09-13T15:16:43.348487+0000","last_active":"2024-09-13T15:16:43.348361+0000","last_peered":"2024-09-13T15:16:43.348361+0000","last_clean":"2024-09-13T15:16:43.348361+0000","last_became_active":"2024-09-13T15:01:48.846835+0000","last_became_peered":"2024-09-13T15:01:48.846835+0000","last_unstale":"2024-09-13T15:16:43.348361+0000","last_undegraded":"2024-09-13T15:16:43.348361+0000","last_fullsized":"2024-09-13T15:16:43.348361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4464","last_scrub_stamp":"2024-09-13T15:16:43.348342+0000","last_deep_scrub":"33'4464","last_deep_scrub_stamp":"2024-09-13T15:16:43.348342+0000","last_clean_scrub_stamp":"2024-09-13T15:16:43.348342+0000","objects_scrubbed":0,"log_size":4464,"log_dups_size":0,"ondisk_log_size":4464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:38.060347+0000","scrub_duration":0.041296739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65013,"num_write_kb":924599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.140565+0000","last_change":"2024-09-13T15:16:23.083422+0000","last_active":"2024-09-13T15:16:24.140565+0000","last_peered":"2024-09-13T15:16:24.140565+0000","last_clean":"2024-09-13T15:16:24.140565+0000","last_became_active":"2024-09-13T15:01:44.834643+0000","last_became_peered":"2024-09-13T15:01:44.834643+0000","last_unstale":"2024-09-13T15:16:24.140565+0000","last_undegraded":"2024-09-13T15:16:24.140565+0000","last_fullsized":"2024-09-13T15:16:24.140565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-13T15:16:23.083116+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-13T15:16:23.083116+0000","last_clean_scrub_stamp":"2024-09-13T15:16:23.083116+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:43:56.932464+0000","scrub_duration":0.001347029,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'20","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.432148+0000","last_change":"2024-09-13T15:16:34.432220+0000","last_active":"2024-09-13T15:16:34.432148+0000","last_peered":"2024-09-13T15:16:34.432148+0000","last_clean":"2024-09-13T15:16:34.432148+0000","last_became_active":"2024-09-13T15:01:44.424714+0000","last_became_peered":"2024-09-13T15:01:44.424714+0000","last_unstale":"2024-09-13T15:16:34.432148+0000","last_undegraded":"2024-09-13T15:16:34.432148+0000","last_fullsized":"2024-09-13T15:16:34.432148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-13T15:16:34.432129+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-13T15:16:34.432129+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.432129+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:01.436564+0000","scrub_duration":0.0064639520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":15,"num_write":18,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'4809","reported_seq":4857,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:56.556835+0000","last_change":"2024-09-13T15:16:56.557113+0000","last_active":"2024-09-13T15:16:56.556835+0000","last_peered":"2024-09-13T15:16:56.556835+0000","last_clean":"2024-09-13T15:16:56.556835+0000","last_became_active":"2024-09-13T15:02:33.752505+0000","last_became_peered":"2024-09-13T15:02:33.752505+0000","last_unstale":"2024-09-13T15:16:56.556835+0000","last_undegraded":"2024-09-13T15:16:56.556835+0000","last_fullsized":"2024-09-13T15:16:56.556835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4809","last_scrub_stamp":"2024-09-13T15:16:56.556771+0000","last_deep_scrub":"33'4809","last_deep_scrub_stamp":"2024-09-13T15:16:56.556771+0000","last_clean_scrub_stamp":"2024-09-13T15:16:56.556771+0000","objects_scrubbed":0,"log_size":4809,"log_dups_size":0,"ondisk_log_size":4809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:34.746748+0000","scrub_duration":0.082653001000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69744,"num_write_kb":999376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"33'11","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:44.289532+0000","last_change":"2024-09-13T15:16:44.289614+0000","last_active":"2024-09-13T15:16:44.289532+0000","last_peered":"2024-09-13T15:16:44.289532+0000","last_clean":"2024-09-13T15:16:44.289532+0000","last_became_active":"2024-09-13T15:01:44.836750+0000","last_became_peered":"2024-09-13T15:01:44.836750+0000","last_unstale":"2024-09-13T15:16:44.289532+0000","last_undegraded":"2024-09-13T15:16:44.289532+0000","last_fullsized":"2024-09-13T15:16:44.289532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:44.289512+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:44.289512+0000","last_clean_scrub_stamp":"2024-09-13T15:16:44.289512+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:49.109457+0000","scrub_duration":0.0024700170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"33'14","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:31.641077+0000","last_change":"2024-09-13T15:16:31.641324+0000","last_active":"2024-09-13T15:16:31.641077+0000","last_peered":"2024-09-13T15:16:31.641077+0000","last_clean":"2024-09-13T15:16:31.641077+0000","last_became_active":"2024-09-13T15:01:44.437433+0000","last_became_peered":"2024-09-13T15:01:44.437433+0000","last_unstale":"2024-09-13T15:16:31.641077+0000","last_undegraded":"2024-09-13T15:16:31.641077+0000","last_fullsized":"2024-09-13T15:16:31.641077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:31.641025+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:31.641025+0000","last_clean_scrub_stamp":"2024-09-13T15:16:31.641025+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:08.039896+0000","scrub_duration":0.0069456680000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":18,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'4904","reported_seq":4942,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:54.936692+0000","last_change":"2024-09-13T15:16:54.936843+0000","last_active":"2024-09-13T15:16:54.936692+0000","last_peered":"2024-09-13T15:16:54.936692+0000","last_clean":"2024-09-13T15:16:54.936692+0000","last_became_active":"2024-09-13T15:01:48.841267+0000","last_became_peered":"2024-09-13T15:01:48.841267+0000","last_unstale":"2024-09-13T15:16:54.936692+0000","last_undegraded":"2024-09-13T15:16:54.936692+0000","last_fullsized":"2024-09-13T15:16:54.936692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4904","last_scrub_stamp":"2024-09-13T15:16:54.936672+0000","last_deep_scrub":"33'4904","last_deep_scrub_stamp":"2024-09-13T15:16:54.936672+0000","last_clean_scrub_stamp":"2024-09-13T15:16:54.936672+0000","objects_scrubbed":0,"log_size":4904,"log_dups_size":0,"ondisk_log_size":4904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:54.982378+0000","scrub_duration":0.053950104999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71251,"num_write_kb":1004130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:42.644422+0000","last_change":"2024-09-13T15:16:42.644621+0000","last_active":"2024-09-13T15:16:42.644422+0000","last_peered":"2024-09-13T15:16:42.644422+0000","last_clean":"2024-09-13T15:16:42.644422+0000","last_became_active":"2024-09-13T15:01:44.843982+0000","last_became_peered":"2024-09-13T15:01:44.843982+0000","last_unstale":"2024-09-13T15:16:42.644422+0000","last_undegraded":"2024-09-13T15:16:42.644422+0000","last_fullsized":"2024-09-13T15:16:42.644422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:42.644367+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:42.644367+0000","last_clean_scrub_stamp":"2024-09-13T15:16:42.644367+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:45.557277+0000","scrub_duration":0.003222496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"33'18","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:32.864296+0000","last_change":"2024-09-13T15:16:32.864508+0000","last_active":"2024-09-13T15:16:32.864296+0000","last_peered":"2024-09-13T15:16:32.864296+0000","last_clean":"2024-09-13T15:16:32.864296+0000","last_became_active":"2024-09-13T15:01:44.435367+0000","last_became_peered":"2024-09-13T15:01:44.435367+0000","last_unstale":"2024-09-13T15:16:32.864296+0000","last_undegraded":"2024-09-13T15:16:32.864296+0000","last_fullsized":"2024-09-13T15:16:32.864296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T15:16:32.864235+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T15:16:32.864235+0000","last_clean_scrub_stamp":"2024-09-13T15:16:32.864235+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:20.427017+0000","scrub_duration":0.0072294949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"33'3940","reported_seq":3978,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:57.850695+0000","last_change":"2024-09-13T15:16:57.850836+0000","last_active":"2024-09-13T15:16:57.850695+0000","last_peered":"2024-09-13T15:16:57.850695+0000","last_clean":"2024-09-13T15:16:57.850695+0000","last_became_active":"2024-09-13T15:01:48.909681+0000","last_became_peered":"2024-09-13T15:01:48.909681+0000","last_unstale":"2024-09-13T15:16:57.850695+0000","last_undegraded":"2024-09-13T15:16:57.850695+0000","last_fullsized":"2024-09-13T15:16:57.850695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3940","last_scrub_stamp":"2024-09-13T15:16:57.850672+0000","last_deep_scrub":"33'3940","last_deep_scrub_stamp":"2024-09-13T15:16:57.850672+0000","last_clean_scrub_stamp":"2024-09-13T15:16:57.850672+0000","objects_scrubbed":0,"log_size":3940,"log_dups_size":0,"ondisk_log_size":3940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:26.658522+0000","scrub_duration":0.046163484999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57394,"num_write_kb":843085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'3678","reported_seq":3727,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:01.354778+0000","last_change":"2024-09-13T15:17:01.354892+0000","last_active":"2024-09-13T15:17:01.354778+0000","last_peered":"2024-09-13T15:17:01.354778+0000","last_clean":"2024-09-13T15:17:01.354778+0000","last_became_active":"2024-09-13T15:02:34.118477+0000","last_became_peered":"2024-09-13T15:02:34.118477+0000","last_unstale":"2024-09-13T15:17:01.354778+0000","last_undegraded":"2024-09-13T15:17:01.354778+0000","last_fullsized":"2024-09-13T15:17:01.354778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3678","last_scrub_stamp":"2024-09-13T15:17:01.354757+0000","last_deep_scrub":"33'3678","last_deep_scrub_stamp":"2024-09-13T15:17:01.354757+0000","last_clean_scrub_stamp":"2024-09-13T15:17:01.354757+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:15.395588+0000","scrub_duration":0.041383452000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53439,"num_write_kb":757724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'11","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:41.369001+0000","last_change":"2024-09-13T15:16:41.369073+0000","last_active":"2024-09-13T15:16:41.369001+0000","last_peered":"2024-09-13T15:16:41.369001+0000","last_clean":"2024-09-13T15:16:41.369001+0000","last_became_active":"2024-09-13T15:01:44.807641+0000","last_became_peered":"2024-09-13T15:01:44.807641+0000","last_unstale":"2024-09-13T15:16:41.369001+0000","last_undegraded":"2024-09-13T15:16:41.369001+0000","last_fullsized":"2024-09-13T15:16:41.369001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:41.368984+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:41.368984+0000","last_clean_scrub_stamp":"2024-09-13T15:16:41.368984+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:10.060267+0000","scrub_duration":0.0013486590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"33'38","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:25.574908+0000","last_change":"2024-09-13T15:16:25.575105+0000","last_active":"2024-09-13T15:16:25.574908+0000","last_peered":"2024-09-13T15:16:25.574908+0000","last_clean":"2024-09-13T15:16:25.574908+0000","last_became_active":"2024-09-13T15:01:44.433124+0000","last_became_peered":"2024-09-13T15:01:44.433124+0000","last_unstale":"2024-09-13T15:16:25.574908+0000","last_undegraded":"2024-09-13T15:16:25.574908+0000","last_fullsized":"2024-09-13T15:16:25.574908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'38","last_scrub_stamp":"2024-09-13T15:16:25.574855+0000","last_deep_scrub":"33'38","last_deep_scrub_stamp":"2024-09-13T15:16:25.574855+0000","last_clean_scrub_stamp":"2024-09-13T15:16:25.574855+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:45.303091+0000","scrub_duration":0.033176627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":8193,"num_write":27,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4928","reported_seq":4967,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:04.912527+0000","last_change":"2024-09-13T15:17:04.912790+0000","last_active":"2024-09-13T15:17:04.912527+0000","last_peered":"2024-09-13T15:17:04.912527+0000","last_clean":"2024-09-13T15:17:04.912527+0000","last_became_active":"2024-09-13T15:01:48.852925+0000","last_became_peered":"2024-09-13T15:01:48.852925+0000","last_unstale":"2024-09-13T15:17:04.912527+0000","last_undegraded":"2024-09-13T15:17:04.912527+0000","last_fullsized":"2024-09-13T15:17:04.912527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4928","last_scrub_stamp":"2024-09-13T15:17:04.912471+0000","last_deep_scrub":"33'4928","last_deep_scrub_stamp":"2024-09-13T15:17:04.912471+0000","last_clean_scrub_stamp":"2024-09-13T15:17:04.912471+0000","objects_scrubbed":0,"log_size":4928,"log_dups_size":0,"ondisk_log_size":4928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:09.742976+0000","scrub_duration":0.082938472999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71646,"num_write_kb":1060070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"33'13","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:56.238735+0000","last_change":"2024-09-13T15:16:56.238735+0000","last_active":"2024-09-13T15:16:56.238735+0000","last_peered":"2024-09-13T15:16:56.238735+0000","last_clean":"2024-09-13T15:16:56.238735+0000","last_became_active":"2024-09-13T15:02:33.746005+0000","last_became_peered":"2024-09-13T15:02:33.746005+0000","last_unstale":"2024-09-13T15:16:56.238735+0000","last_undegraded":"2024-09-13T15:16:56.238735+0000","last_fullsized":"2024-09-13T15:16:56.238735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T15:16:56.238642+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T15:16:56.238642+0000","last_clean_scrub_stamp":"2024-09-13T15:16:56.238642+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:49.877447+0000","scrub_duration":0.0013265359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"33'11","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:33.955676+0000","last_change":"2024-09-13T15:16:33.955756+0000","last_active":"2024-09-13T15:16:33.955676+0000","last_peered":"2024-09-13T15:16:33.955676+0000","last_clean":"2024-09-13T15:16:33.955676+0000","last_became_active":"2024-09-13T15:01:44.436646+0000","last_became_peered":"2024-09-13T15:01:44.436646+0000","last_unstale":"2024-09-13T15:16:33.955676+0000","last_undegraded":"2024-09-13T15:16:33.955676+0000","last_fullsized":"2024-09-13T15:16:33.955676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:33.955656+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:33.955656+0000","last_clean_scrub_stamp":"2024-09-13T15:16:33.955656+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:59.640305+0000","scrub_duration":0.0059488070000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":27,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"33'53","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.923151+0000","last_change":"2024-09-13T15:16:34.923151+0000","last_active":"2024-09-13T15:16:34.923151+0000","last_peered":"2024-09-13T15:16:34.923151+0000","last_clean":"2024-09-13T15:16:34.923151+0000","last_became_active":"2024-09-13T15:01:44.429339+0000","last_became_peered":"2024-09-13T15:01:44.429339+0000","last_unstale":"2024-09-13T15:16:34.923151+0000","last_undegraded":"2024-09-13T15:16:34.923151+0000","last_fullsized":"2024-09-13T15:16:34.923151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'53","last_scrub_stamp":"2024-09-13T15:16:34.922888+0000","last_deep_scrub":"33'53","last_deep_scrub_stamp":"2024-09-13T15:16:34.922888+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.922888+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:24.468558+0000","scrub_duration":0.034548224000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":8210,"num_write":46,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:33.344530+0000","last_change":"2024-09-13T15:16:33.344530+0000","last_active":"2024-09-13T15:16:33.344530+0000","last_peered":"2024-09-13T15:16:33.344530+0000","last_clean":"2024-09-13T15:16:33.344530+0000","last_became_active":"2024-09-13T15:01:44.821734+0000","last_became_peered":"2024-09-13T15:01:44.821734+0000","last_unstale":"2024-09-13T15:16:33.344530+0000","last_undegraded":"2024-09-13T15:16:33.344530+0000","last_fullsized":"2024-09-13T15:16:33.344530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:33.344436+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:33.344436+0000","last_clean_scrub_stamp":"2024-09-13T15:16:33.344436+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:18.534801+0000","scrub_duration":0.0023763030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"33'4710","reported_seq":4748,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:35.170988+0000","last_change":"2024-09-13T15:16:35.170988+0000","last_active":"2024-09-13T15:16:35.170988+0000","last_peered":"2024-09-13T15:16:35.170988+0000","last_clean":"2024-09-13T15:16:35.170988+0000","last_became_active":"2024-09-13T15:01:48.857584+0000","last_became_peered":"2024-09-13T15:01:48.857584+0000","last_unstale":"2024-09-13T15:16:35.170988+0000","last_undegraded":"2024-09-13T15:16:35.170988+0000","last_fullsized":"2024-09-13T15:16:35.170988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4710","last_scrub_stamp":"2024-09-13T15:16:35.170829+0000","last_deep_scrub":"33'4710","last_deep_scrub_stamp":"2024-09-13T15:16:35.170829+0000","last_clean_scrub_stamp":"2024-09-13T15:16:35.170829+0000","objects_scrubbed":0,"log_size":4710,"log_dups_size":0,"ondisk_log_size":4710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:45.991405+0000","scrub_duration":0.042675653000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68679,"num_write_kb":960930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"33'1786","reported_seq":1830,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:31.928330+0000","last_change":"2024-09-13T15:16:31.928330+0000","last_active":"2024-09-13T15:16:31.928330+0000","last_peered":"2024-09-13T15:16:31.928330+0000","last_clean":"2024-09-13T15:16:31.928330+0000","last_became_active":"2024-09-13T15:01:44.422367+0000","last_became_peered":"2024-09-13T15:01:44.422367+0000","last_unstale":"2024-09-13T15:16:31.928330+0000","last_undegraded":"2024-09-13T15:16:31.928330+0000","last_fullsized":"2024-09-13T15:16:31.928330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'1786","last_scrub_stamp":"2024-09-13T15:16:31.928065+0000","last_deep_scrub":"33'1786","last_deep_scrub_stamp":"2024-09-13T15:16:31.928065+0000","last_clean_scrub_stamp":"2024-09-13T15:16:31.928065+0000","objects_scrubbed":3,"log_size":1786,"log_dups_size":0,"ondisk_log_size":1786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:44.840912+0000","scrub_duration":0.023676508999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4098,"num_write":1776,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.230513+0000","last_change":"2024-09-13T15:16:24.080158+0000","last_active":"2024-09-13T15:16:24.230513+0000","last_peered":"2024-09-13T15:16:24.230513+0000","last_clean":"2024-09-13T15:16:24.230513+0000","last_became_active":"2024-09-13T15:01:44.816584+0000","last_became_peered":"2024-09-13T15:01:44.816584+0000","last_unstale":"2024-09-13T15:16:24.230513+0000","last_undegraded":"2024-09-13T15:16:24.230513+0000","last_fullsized":"2024-09-13T15:16:24.230513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:24.080065+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:24.080065+0000","last_clean_scrub_stamp":"2024-09-13T15:16:24.080065+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:18.277593+0000","scrub_duration":0.0033993309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4724","reported_seq":4762,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:01.824558+0000","last_change":"2024-09-13T15:17:01.824694+0000","last_active":"2024-09-13T15:17:01.824558+0000","last_peered":"2024-09-13T15:17:01.824558+0000","last_clean":"2024-09-13T15:17:01.824558+0000","last_became_active":"2024-09-13T15:01:48.840397+0000","last_became_peered":"2024-09-13T15:01:48.840397+0000","last_unstale":"2024-09-13T15:17:01.824558+0000","last_undegraded":"2024-09-13T15:17:01.824558+0000","last_fullsized":"2024-09-13T15:17:01.824558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4724","last_scrub_stamp":"2024-09-13T15:17:01.824537+0000","last_deep_scrub":"33'4724","last_deep_scrub_stamp":"2024-09-13T15:17:01.824537+0000","last_clean_scrub_stamp":"2024-09-13T15:17:01.824537+0000","objects_scrubbed":0,"log_size":4724,"log_dups_size":0,"ondisk_log_size":4724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:37.014863+0000","scrub_duration":0.036114977999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68744,"num_write_kb":983871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"33'14","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:56.883362+0000","last_change":"2024-09-13T15:16:56.883575+0000","last_active":"2024-09-13T15:16:56.883362+0000","last_peered":"2024-09-13T15:16:56.883362+0000","last_clean":"2024-09-13T15:16:56.883362+0000","last_became_active":"2024-09-13T15:01:44.808669+0000","last_became_peered":"2024-09-13T15:01:44.808669+0000","last_unstale":"2024-09-13T15:16:56.883362+0000","last_undegraded":"2024-09-13T15:16:56.883362+0000","last_fullsized":"2024-09-13T15:16:56.883362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:56.883310+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:56.883310+0000","last_clean_scrub_stamp":"2024-09-13T15:16:56.883310+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:50.733643+0000","scrub_duration":0.0027636959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"33'13","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:31.136709+0000","last_change":"2024-09-13T15:16:31.136790+0000","last_active":"2024-09-13T15:16:31.136709+0000","last_peered":"2024-09-13T15:16:31.136709+0000","last_clean":"2024-09-13T15:16:31.136709+0000","last_became_active":"2024-09-13T15:01:44.836102+0000","last_became_peered":"2024-09-13T15:01:44.836102+0000","last_unstale":"2024-09-13T15:16:31.136709+0000","last_undegraded":"2024-09-13T15:16:31.136709+0000","last_fullsized":"2024-09-13T15:16:31.136709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T15:16:31.136690+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T15:16:31.136690+0000","last_clean_scrub_stamp":"2024-09-13T15:16:31.136690+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:55.607725+0000","scrub_duration":0.0019713320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"33'10","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:32.625887+0000","last_change":"2024-09-13T15:16:32.626112+0000","last_active":"2024-09-13T15:16:32.625887+0000","last_peered":"2024-09-13T15:16:32.625887+0000","last_clean":"2024-09-13T15:16:32.625887+0000","last_became_active":"2024-09-13T15:01:44.846506+0000","last_became_peered":"2024-09-13T15:01:44.846506+0000","last_unstale":"2024-09-13T15:16:32.625887+0000","last_undegraded":"2024-09-13T15:16:32.625887+0000","last_fullsized":"2024-09-13T15:16:32.625887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T15:16:32.625828+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T15:16:32.625828+0000","last_clean_scrub_stamp":"2024-09-13T15:16:32.625828+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:38.132404+0000","scrub_duration":0.002756784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"33'10","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:38.251444+0000","last_change":"2024-09-13T15:16:38.251543+0000","last_active":"2024-09-13T15:16:38.251444+0000","last_peered":"2024-09-13T15:16:38.251444+0000","last_clean":"2024-09-13T15:16:38.251444+0000","last_became_active":"2024-09-13T15:01:44.809585+0000","last_became_peered":"2024-09-13T15:01:44.809585+0000","last_unstale":"2024-09-13T15:16:38.251444+0000","last_undegraded":"2024-09-13T15:16:38.251444+0000","last_fullsized":"2024-09-13T15:16:38.251444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T15:16:38.251426+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T15:16:38.251426+0000","last_clean_scrub_stamp":"2024-09-13T15:16:38.251426+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:13:40.307246+0000","scrub_duration":0.0015167939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:40.948205+0000","last_change":"2024-09-13T15:16:40.948205+0000","last_active":"2024-09-13T15:16:40.948205+0000","last_peered":"2024-09-13T15:16:40.948205+0000","last_clean":"2024-09-13T15:16:40.948205+0000","last_became_active":"2024-09-13T15:01:44.816480+0000","last_became_peered":"2024-09-13T15:01:44.816480+0000","last_unstale":"2024-09-13T15:16:40.948205+0000","last_undegraded":"2024-09-13T15:16:40.948205+0000","last_fullsized":"2024-09-13T15:16:40.948205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T15:16:40.948080+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T15:16:40.948080+0000","last_clean_scrub_stamp":"2024-09-13T15:16:40.948080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:44:09.162042+0000","scrub_duration":0.0024445700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.177350+0000","last_change":"2024-09-13T15:16:20.596249+0000","last_active":"2024-09-13T15:16:24.177350+0000","last_peered":"2024-09-13T15:16:24.177350+0000","last_clean":"2024-09-13T15:16:24.177350+0000","last_became_active":"2024-09-13T15:01:44.807622+0000","last_became_peered":"2024-09-13T15:01:44.807622+0000","last_unstale":"2024-09-13T15:16:24.177350+0000","last_undegraded":"2024-09-13T15:16:24.177350+0000","last_fullsized":"2024-09-13T15:16:24.177350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:20.596153+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:20.596153+0000","last_clean_scrub_stamp":"2024-09-13T15:16:20.596153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:27:28.285632+0000","scrub_duration":0.0016568729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"33'19","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:45.892738+0000","last_change":"2024-09-13T15:16:45.892738+0000","last_active":"2024-09-13T15:16:45.892738+0000","last_peered":"2024-09-13T15:16:45.892738+0000","last_clean":"2024-09-13T15:16:45.892738+0000","last_became_active":"2024-09-13T15:01:44.831889+0000","last_became_peered":"2024-09-13T15:01:44.831889+0000","last_unstale":"2024-09-13T15:16:45.892738+0000","last_undegraded":"2024-09-13T15:16:45.892738+0000","last_fullsized":"2024-09-13T15:16:45.892738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:45.892453+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:45.892453+0000","last_clean_scrub_stamp":"2024-09-13T15:16:45.892453+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:35.870588+0000","scrub_duration":0.0037740270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"33'5","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.973489+0000","last_change":"2024-09-13T15:16:46.973489+0000","last_active":"2024-09-13T15:16:46.973489+0000","last_peered":"2024-09-13T15:16:46.973489+0000","last_clean":"2024-09-13T15:16:46.973489+0000","last_became_active":"2024-09-13T15:01:44.817350+0000","last_became_peered":"2024-09-13T15:01:44.817350+0000","last_unstale":"2024-09-13T15:16:46.973489+0000","last_undegraded":"2024-09-13T15:16:46.973489+0000","last_fullsized":"2024-09-13T15:16:46.973489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T15:16:46.973340+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T15:16:46.973340+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.973340+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:24.189302+0000","scrub_duration":0.0028596519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"33'10","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.614046+0000","last_change":"2024-09-13T15:16:34.614046+0000","last_active":"2024-09-13T15:16:34.614046+0000","last_peered":"2024-09-13T15:16:34.614046+0000","last_clean":"2024-09-13T15:16:34.614046+0000","last_became_active":"2024-09-13T15:01:44.837588+0000","last_became_peered":"2024-09-13T15:01:44.837588+0000","last_unstale":"2024-09-13T15:16:34.614046+0000","last_undegraded":"2024-09-13T15:16:34.614046+0000","last_fullsized":"2024-09-13T15:16:34.614046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T15:16:34.613780+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T15:16:34.613780+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.613780+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:41.237672+0000","scrub_duration":0.0026563189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"33'11","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:41.992598+0000","last_change":"2024-09-13T15:16:41.992681+0000","last_active":"2024-09-13T15:16:41.992598+0000","last_peered":"2024-09-13T15:16:41.992598+0000","last_clean":"2024-09-13T15:16:41.992598+0000","last_became_active":"2024-09-13T15:01:44.827910+0000","last_became_peered":"2024-09-13T15:01:44.827910+0000","last_unstale":"2024-09-13T15:16:41.992598+0000","last_undegraded":"2024-09-13T15:16:41.992598+0000","last_fullsized":"2024-09-13T15:16:41.992598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:41.992580+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:41.992580+0000","last_clean_scrub_stamp":"2024-09-13T15:16:41.992580+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:17.653254+0000","scrub_duration":0.0021428760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"33'11","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.126418+0000","last_change":"2024-09-13T15:16:46.126559+0000","last_active":"2024-09-13T15:16:46.126418+0000","last_peered":"2024-09-13T15:16:46.126418+0000","last_clean":"2024-09-13T15:16:46.126418+0000","last_became_active":"2024-09-13T15:02:34.118621+0000","last_became_peered":"2024-09-13T15:02:34.118621+0000","last_unstale":"2024-09-13T15:16:46.126418+0000","last_undegraded":"2024-09-13T15:16:46.126418+0000","last_fullsized":"2024-09-13T15:16:46.126418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:46.126393+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:46.126393+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.126393+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:28.249838+0000","scrub_duration":0.0026115209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"33'14","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:47.262085+0000","last_change":"2024-09-13T15:16:47.262190+0000","last_active":"2024-09-13T15:16:47.262085+0000","last_peered":"2024-09-13T15:16:47.262085+0000","last_clean":"2024-09-13T15:16:47.262085+0000","last_became_active":"2024-09-13T15:01:44.831495+0000","last_became_peered":"2024-09-13T15:01:44.831495+0000","last_unstale":"2024-09-13T15:16:47.262085+0000","last_undegraded":"2024-09-13T15:16:47.262085+0000","last_fullsized":"2024-09-13T15:16:47.262085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:47.262063+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:47.262063+0000","last_clean_scrub_stamp":"2024-09-13T15:16:47.262063+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:35.471712+0000","scrub_duration":0.0025945270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"33'11","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.904712+0000","last_change":"2024-09-13T15:16:46.904991+0000","last_active":"2024-09-13T15:16:46.904712+0000","last_peered":"2024-09-13T15:16:46.904712+0000","last_clean":"2024-09-13T15:16:46.904712+0000","last_became_active":"2024-09-13T15:01:44.828999+0000","last_became_peered":"2024-09-13T15:01:44.828999+0000","last_unstale":"2024-09-13T15:16:46.904712+0000","last_undegraded":"2024-09-13T15:16:46.904712+0000","last_fullsized":"2024-09-13T15:16:46.904712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:46.904653+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:46.904653+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.904653+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:23.576664+0000","scrub_duration":0.0029663189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"33'9","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:57.857900+0000","last_change":"2024-09-13T15:16:57.858095+0000","last_active":"2024-09-13T15:16:57.857900+0000","last_peered":"2024-09-13T15:16:57.857900+0000","last_clean":"2024-09-13T15:16:57.857900+0000","last_became_active":"2024-09-13T15:01:44.816258+0000","last_became_peered":"2024-09-13T15:01:44.816258+0000","last_unstale":"2024-09-13T15:16:57.857900+0000","last_undegraded":"2024-09-13T15:16:57.857900+0000","last_fullsized":"2024-09-13T15:16:57.857900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:57.857844+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:57.857844+0000","last_clean_scrub_stamp":"2024-09-13T15:16:57.857844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:27.484892+0000","scrub_duration":0.0023279020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"33'19","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:29.104737+0000","last_change":"2024-09-13T15:16:29.104820+0000","last_active":"2024-09-13T15:16:29.104737+0000","last_peered":"2024-09-13T15:16:29.104737+0000","last_clean":"2024-09-13T15:16:29.104737+0000","last_became_active":"2024-09-13T15:01:44.809687+0000","last_became_peered":"2024-09-13T15:01:44.809687+0000","last_unstale":"2024-09-13T15:16:29.104737+0000","last_undegraded":"2024-09-13T15:16:29.104737+0000","last_fullsized":"2024-09-13T15:16:29.104737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:29.104716+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:29.104716+0000","last_clean_scrub_stamp":"2024-09-13T15:16:29.104716+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:42:33.959556+0000","scrub_duration":0.0023385429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"33'11","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:48.131258+0000","last_change":"2024-09-13T15:16:48.131340+0000","last_active":"2024-09-13T15:16:48.131258+0000","last_peered":"2024-09-13T15:16:48.131258+0000","last_clean":"2024-09-13T15:16:48.131258+0000","last_became_active":"2024-09-13T15:02:34.118798+0000","last_became_peered":"2024-09-13T15:02:34.118798+0000","last_unstale":"2024-09-13T15:16:48.131258+0000","last_undegraded":"2024-09-13T15:16:48.131258+0000","last_fullsized":"2024-09-13T15:16:48.131258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:48.131238+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:48.131238+0000","last_clean_scrub_stamp":"2024-09-13T15:16:48.131238+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:33.220146+0000","scrub_duration":0.002534644,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"33'11","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:51.697042+0000","last_change":"2024-09-13T15:16:51.697248+0000","last_active":"2024-09-13T15:16:51.697042+0000","last_peered":"2024-09-13T15:16:51.697042+0000","last_clean":"2024-09-13T15:16:51.697042+0000","last_became_active":"2024-09-13T15:01:44.846074+0000","last_became_peered":"2024-09-13T15:01:44.846074+0000","last_unstale":"2024-09-13T15:16:51.697042+0000","last_undegraded":"2024-09-13T15:16:51.697042+0000","last_fullsized":"2024-09-13T15:16:51.697042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:51.696990+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:51.696990+0000","last_clean_scrub_stamp":"2024-09-13T15:16:51.696990+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:47.001747+0000","scrub_duration":0.002759938,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"33'11","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:39.422600+0000","last_change":"2024-09-13T15:16:39.422675+0000","last_active":"2024-09-13T15:16:39.422600+0000","last_peered":"2024-09-13T15:16:39.422600+0000","last_clean":"2024-09-13T15:16:39.422600+0000","last_became_active":"2024-09-13T15:01:44.828024+0000","last_became_peered":"2024-09-13T15:01:44.828024+0000","last_unstale":"2024-09-13T15:16:39.422600+0000","last_undegraded":"2024-09-13T15:16:39.422600+0000","last_fullsized":"2024-09-13T15:16:39.422600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:39.422580+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:39.422580+0000","last_clean_scrub_stamp":"2024-09-13T15:16:39.422580+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:23.054857+0000","scrub_duration":0.0024637970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'10","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:53.196421+0000","last_change":"2024-09-13T15:16:53.196528+0000","last_active":"2024-09-13T15:16:53.196421+0000","last_peered":"2024-09-13T15:16:53.196421+0000","last_clean":"2024-09-13T15:16:53.196421+0000","last_became_active":"2024-09-13T15:01:44.808609+0000","last_became_peered":"2024-09-13T15:01:44.808609+0000","last_unstale":"2024-09-13T15:16:53.196421+0000","last_undegraded":"2024-09-13T15:16:53.196421+0000","last_fullsized":"2024-09-13T15:16:53.196421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T15:16:53.196397+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T15:16:53.196397+0000","last_clean_scrub_stamp":"2024-09-13T15:16:53.196397+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:32.009203+0000","scrub_duration":0.00170444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"33'11","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:29.866264+0000","last_change":"2024-09-13T15:16:29.866373+0000","last_active":"2024-09-13T15:16:29.866264+0000","last_peered":"2024-09-13T15:16:29.866264+0000","last_clean":"2024-09-13T15:16:29.866264+0000","last_became_active":"2024-09-13T15:01:44.809918+0000","last_became_peered":"2024-09-13T15:01:44.809918+0000","last_unstale":"2024-09-13T15:16:29.866264+0000","last_undegraded":"2024-09-13T15:16:29.866264+0000","last_fullsized":"2024-09-13T15:16:29.866264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:29.866245+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:29.866245+0000","last_clean_scrub_stamp":"2024-09-13T15:16:29.866245+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:11.754182+0000","scrub_duration":0.0021947170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:30.138653+0000","last_change":"2024-09-13T15:16:30.138848+0000","last_active":"2024-09-13T15:16:30.138653+0000","last_peered":"2024-09-13T15:16:30.138653+0000","last_clean":"2024-09-13T15:16:30.138653+0000","last_became_active":"2024-09-13T15:01:44.828737+0000","last_became_peered":"2024-09-13T15:01:44.828737+0000","last_unstale":"2024-09-13T15:16:30.138653+0000","last_undegraded":"2024-09-13T15:16:30.138653+0000","last_fullsized":"2024-09-13T15:16:30.138653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:30.138598+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:30.138598+0000","last_clean_scrub_stamp":"2024-09-13T15:16:30.138598+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:12.240506+0000","scrub_duration":0.0030438290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:54.909482+0000","last_change":"2024-09-13T15:16:54.909891+0000","last_active":"2024-09-13T15:16:54.909482+0000","last_peered":"2024-09-13T15:16:54.909482+0000","last_clean":"2024-09-13T15:16:54.909482+0000","last_became_active":"2024-09-13T15:01:44.850410+0000","last_became_peered":"2024-09-13T15:01:44.850410+0000","last_unstale":"2024-09-13T15:16:54.909482+0000","last_undegraded":"2024-09-13T15:16:54.909482+0000","last_fullsized":"2024-09-13T15:16:54.909482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:54.909424+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:54.909424+0000","last_clean_scrub_stamp":"2024-09-13T15:16:54.909424+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:46:18.893400+0000","scrub_duration":0.0032718840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"33'17","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:57.846402+0000","last_change":"2024-09-13T15:16:57.846648+0000","last_active":"2024-09-13T15:16:57.846402+0000","last_peered":"2024-09-13T15:16:57.846402+0000","last_clean":"2024-09-13T15:16:57.846402+0000","last_became_active":"2024-09-13T15:01:44.839371+0000","last_became_peered":"2024-09-13T15:01:44.839371+0000","last_unstale":"2024-09-13T15:16:57.846402+0000","last_undegraded":"2024-09-13T15:16:57.846402+0000","last_fullsized":"2024-09-13T15:16:57.846402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'17","last_scrub_stamp":"2024-09-13T15:16:57.846335+0000","last_deep_scrub":"33'17","last_deep_scrub_stamp":"2024-09-13T15:16:57.846335+0000","last_clean_scrub_stamp":"2024-09-13T15:16:57.846335+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:25.103988+0000","scrub_duration":0.0040927480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"33'12","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:10.971482+0000","last_change":"2024-09-13T15:17:10.971705+0000","last_active":"2024-09-13T15:17:10.971482+0000","last_peered":"2024-09-13T15:17:10.971482+0000","last_clean":"2024-09-13T15:17:10.971482+0000","last_became_active":"2024-09-13T15:01:44.849766+0000","last_became_peered":"2024-09-13T15:01:44.849766+0000","last_unstale":"2024-09-13T15:17:10.971482+0000","last_undegraded":"2024-09-13T15:17:10.971482+0000","last_fullsized":"2024-09-13T15:17:10.971482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T15:17:10.971428+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T15:17:10.971428+0000","last_clean_scrub_stamp":"2024-09-13T15:17:10.971428+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:02.541432+0000","scrub_duration":0.0033692150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"33'9","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.938178+0000","last_change":"2024-09-13T15:16:26.938178+0000","last_active":"2024-09-13T15:16:26.938178+0000","last_peered":"2024-09-13T15:16:26.938178+0000","last_clean":"2024-09-13T15:16:26.938178+0000","last_became_active":"2024-09-13T15:01:44.836770+0000","last_became_peered":"2024-09-13T15:01:44.836770+0000","last_unstale":"2024-09-13T15:16:26.938178+0000","last_undegraded":"2024-09-13T15:16:26.938178+0000","last_fullsized":"2024-09-13T15:16:26.938178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:26.938077+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:26.938077+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.938077+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:49.727468+0000","scrub_duration":0.0024780219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'8","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:15.908660+0000","last_change":"2024-09-13T15:17:15.908874+0000","last_active":"2024-09-13T15:17:15.908660+0000","last_peered":"2024-09-13T15:17:15.908660+0000","last_clean":"2024-09-13T15:17:15.908660+0000","last_became_active":"2024-09-13T15:01:44.815116+0000","last_became_peered":"2024-09-13T15:01:44.815116+0000","last_unstale":"2024-09-13T15:17:15.908660+0000","last_undegraded":"2024-09-13T15:17:15.908660+0000","last_fullsized":"2024-09-13T15:17:15.908660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:17:15.908609+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:17:15.908609+0000","last_clean_scrub_stamp":"2024-09-13T15:17:15.908609+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:38.731258+0000","scrub_duration":0.0025887140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:53.715759+0000","last_change":"2024-09-13T15:16:53.715967+0000","last_active":"2024-09-13T15:16:53.715759+0000","last_peered":"2024-09-13T15:16:53.715759+0000","last_clean":"2024-09-13T15:16:53.715759+0000","last_became_active":"2024-09-13T15:01:44.849533+0000","last_became_peered":"2024-09-13T15:01:44.849533+0000","last_unstale":"2024-09-13T15:16:53.715759+0000","last_undegraded":"2024-09-13T15:16:53.715759+0000","last_fullsized":"2024-09-13T15:16:53.715759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:53.715707+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:53.715707+0000","last_clean_scrub_stamp":"2024-09-13T15:16:53.715707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:42.062562+0000","scrub_duration":0.0033990539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"33'5","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:58.875049+0000","last_change":"2024-09-13T15:16:58.875265+0000","last_active":"2024-09-13T15:16:58.875049+0000","last_peered":"2024-09-13T15:16:58.875049+0000","last_clean":"2024-09-13T15:16:58.875049+0000","last_became_active":"2024-09-13T15:01:44.816416+0000","last_became_peered":"2024-09-13T15:01:44.816416+0000","last_unstale":"2024-09-13T15:16:58.875049+0000","last_undegraded":"2024-09-13T15:16:58.875049+0000","last_fullsized":"2024-09-13T15:16:58.875049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T15:16:58.874995+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T15:16:58.874995+0000","last_clean_scrub_stamp":"2024-09-13T15:16:58.874995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:36.770217+0000","scrub_duration":0.0025367900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"33'8","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:44.144359+0000","last_change":"2024-09-13T15:16:44.144455+0000","last_active":"2024-09-13T15:16:44.144359+0000","last_peered":"2024-09-13T15:16:44.144359+0000","last_clean":"2024-09-13T15:16:44.144359+0000","last_became_active":"2024-09-13T15:02:33.747405+0000","last_became_peered":"2024-09-13T15:02:33.747405+0000","last_unstale":"2024-09-13T15:16:44.144359+0000","last_undegraded":"2024-09-13T15:16:44.144359+0000","last_fullsized":"2024-09-13T15:16:44.144359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:44.144337+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:44.144337+0000","last_clean_scrub_stamp":"2024-09-13T15:16:44.144337+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:30.857496+0000","scrub_duration":0.0014038189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.891346+0000","last_change":"2024-09-13T15:16:19.392504+0000","last_active":"2024-09-13T15:16:23.891346+0000","last_peered":"2024-09-13T15:16:23.891346+0000","last_clean":"2024-09-13T15:16:23.891346+0000","last_became_active":"2024-09-13T15:01:44.807776+0000","last_became_peered":"2024-09-13T15:01:44.807776+0000","last_unstale":"2024-09-13T15:16:23.891346+0000","last_undegraded":"2024-09-13T15:16:23.891346+0000","last_fullsized":"2024-09-13T15:16:23.891346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T15:16:19.392397+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T15:16:19.392397+0000","last_clean_scrub_stamp":"2024-09-13T15:16:19.392397+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:54.356146+0000","scrub_duration":0.0023579180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"33'3","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:35.447363+0000","last_change":"2024-09-13T15:16:35.447440+0000","last_active":"2024-09-13T15:16:35.447363+0000","last_peered":"2024-09-13T15:16:35.447363+0000","last_clean":"2024-09-13T15:16:35.447363+0000","last_became_active":"2024-09-13T15:01:44.803977+0000","last_became_peered":"2024-09-13T15:01:44.803977+0000","last_unstale":"2024-09-13T15:16:35.447363+0000","last_undegraded":"2024-09-13T15:16:35.447363+0000","last_fullsized":"2024-09-13T15:16:35.447363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T15:16:35.447342+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T15:16:35.447342+0000","last_clean_scrub_stamp":"2024-09-13T15:16:35.447342+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:40.015172+0000","scrub_duration":0.001429317,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"33'12","reported_seq":41,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.007169+0000","last_change":"2024-09-13T15:01:44.824666+0000","last_active":"2024-09-13T15:16:24.007169+0000","last_peered":"2024-09-13T15:16:24.007169+0000","last_clean":"2024-09-13T15:16:24.007169+0000","last_became_active":"2024-09-13T15:01:44.815381+0000","last_became_peered":"2024-09-13T15:01:44.815381+0000","last_unstale":"2024-09-13T15:16:24.007169+0000","last_undegraded":"2024-09-13T15:16:24.007169+0000","last_fullsized":"2024-09-13T15:16:24.007169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T15:01:44.370034+0000","last_clean_scrub_stamp":"2024-09-13T15:01:44.370034+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2171149,"num_write_kb":31079058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149321,"ondisk_log_size":149321,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":615,"ondisk_log_size":615,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":108901497,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":501,"num_read_kb":110953,"num_write":3247,"num_write_kb":107181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":55628,"num_omap_keys":107,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":218046464,"data_stored":217802994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3352,"ondisk_log_size":3352,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542335,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":959312,"kb_used_data":46024,"kb_used_omap":1,"kb_used_meta":913278,"kb_avail":93412528,"statfs":{"total":96636764160,"available":95654428672,"internally_reserved":0,"allocated":47128576,"data_stored":46890816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":935197131},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:17:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":4.2770000000000001,"15min":4.8760000000000003},"min":{"1min":0.435,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.7050000000000001,"5min":130.31299999999999,"15min":254.13499999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.1830000000000001,"5min":4.3570000000000002,"15min":4.9039999999999999},"min":{"1min":0.54400000000000004,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":4.7279999999999998,"5min":130.13499999999999,"15min":254.119},"last":0.73899999999999999}]},{"osd":1,"last update":"Fri Sep 13 15:17:01 2024","interfaces":[{"interface":"back","average":{"1min":7.1920000000000002,"5min":6.6130000000000004,"15min":9.1120000000000001},"min":{"1min":0.39600000000000002,"5min":0.30599999999999999,"15min":0.29999999999999999},"max":{"1min":116.92400000000001,"5min":132.92500000000001,"15min":281.399},"last":0.61199999999999999},{"interface":"front","average":{"1min":7.2960000000000003,"5min":5.3339999999999996,"15min":10.361000000000001},"min":{"1min":0.46000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":116.828,"5min":134.523,"15min":557.92399999999998},"last":0.95199999999999996}]},{"osd":2,"last update":"Fri Sep 13 15:17:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":2.8879999999999999,"15min":5.532},"min":{"1min":0.38800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":4.3789999999999996,"5min":119.023,"15min":280.29700000000003},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":2.4039999999999999,"15min":5.2489999999999997},"min":{"1min":0.50700000000000001,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":1.343,"5min":115.961,"15min":274.03500000000003},"last":1.052}]},{"osd":3,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":6.5010000000000003,"5min":5.4989999999999997,"15min":6.7779999999999996},"min":{"1min":0.48199999999999998,"5min":0.377,"15min":0.32300000000000001},"max":{"1min":111.05500000000001,"5min":126.226,"15min":261.36000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":7.3730000000000002,"5min":5.351,"15min":5.4320000000000004},"min":{"1min":0.504,"5min":0.37,"15min":0.29599999999999999},"max":{"1min":111.715,"5min":126.05,"15min":252.90000000000001},"last":0.86899999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:17:11 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":2.105,"15min":1.3180000000000001},"min":{"1min":0.41499999999999998,"5min":0.28100000000000003,"15min":0.23699999999999999},"max":{"1min":6.9660000000000002,"5min":20.928999999999998,"15min":20.928999999999998},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.167,"5min":2.3180000000000001,"15min":1.3859999999999999},"min":{"1min":0.46200000000000002,"5min":0.28000000000000003,"15min":0.24199999999999999},"max":{"1min":3.8159999999999998,"5min":20.893000000000001,"15min":20.893000000000001},"last":1.073}]},{"osd":5,"last update":"Fri Sep 13 15:17:11 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.0089999999999999,"15min":1.103},"min":{"1min":0.40000000000000002,"5min":0.251,"15min":0.248},"max":{"1min":7.6509999999999998,"5min":8.2360000000000007,"15min":11.800000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.0409999999999999,"15min":1.022},"min":{"1min":0.42199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":7.415,"5min":8.593,"15min":8.593},"last":0.91700000000000004}]},{"osd":6,"last update":"Fri Sep 13 15:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.7729999999999999,"15min":1.3620000000000001},"min":{"1min":0.443,"5min":0.29699999999999999,"15min":0.27700000000000002},"max":{"1min":1.357,"5min":20.835000000000001,"15min":20.835000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.21,"5min":1.663,"15min":1.2470000000000001},"min":{"1min":0.53300000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":3.6320000000000001,"5min":21.518000000000001,"15min":21.518000000000001},"last":1.1399999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542336,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1195488,"kb_used_data":28824,"kb_used_omap":1,"kb_used_meta":1166654,"kb_avail":93176352,"statfs":{"total":96636764160,"available":95412584448,"internally_reserved":0,"allocated":29515776,"data_stored":29292897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1194654151},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":10.839,"15min":5.5960000000000001},"min":{"1min":0.439,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":3.125,"5min":343.02800000000002,"15min":343.02800000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.98599999999999999,"5min":11.129,"15min":5.423},"min":{"1min":0.49299999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":3.2109999999999999,"5min":370.00099999999998,"15min":370.00099999999998},"last":0.96899999999999997}]},{"osd":1,"last update":"Fri Sep 13 15:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":7.9480000000000004,"15min":6.101},"min":{"1min":0.48699999999999999,"5min":0.317,"15min":0.26900000000000002},"max":{"1min":3.2799999999999998,"5min":236.12100000000001,"15min":236.12100000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.93799999999999994,"5min":9.6120000000000001,"15min":7.25},"min":{"1min":0.58099999999999996,"5min":0.35099999999999998,"15min":0.32300000000000001},"max":{"1min":3.343,"5min":274.46800000000002,"15min":274.46800000000002},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":5.7990000000000004,"15min":3.625},"min":{"1min":0.59699999999999998,"5min":0.35099999999999998,"15min":0.311},"max":{"1min":0.94899999999999995,"5min":249.75700000000001,"15min":249.75700000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.091,"5min":6.6619999999999999,"15min":4.0389999999999997},"min":{"1min":0.74199999999999999,"5min":0.36899999999999999,"15min":0.30299999999999999},"max":{"1min":3.0990000000000002,"5min":283.36700000000002,"15min":283.36700000000002},"last":1.034}]},{"osd":3,"last update":"Fri Sep 13 15:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":6.0700000000000003,"15min":4.4690000000000003},"min":{"1min":0.60799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.373,"5min":239.05099999999999,"15min":239.05099999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.0509999999999999,"5min":11.765000000000001,"15min":6.3630000000000004},"min":{"1min":0.68100000000000005,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.9359999999999999,"5min":352.03800000000001,"15min":352.03800000000001},"last":0.71699999999999997}]},{"osd":4,"last update":"Fri Sep 13 15:17:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":3.3940000000000001,"15min":2.1909999999999998},"min":{"1min":0.80800000000000005,"5min":0.25700000000000001,"15min":0.23300000000000001},"max":{"1min":3.0760000000000001,"5min":37.261000000000003,"15min":91.054000000000002},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.1990000000000001,"5min":3.766,"15min":2.246},"min":{"1min":0.84599999999999997,"5min":0.312,"15min":0.254},"max":{"1min":3.1499999999999999,"5min":52.167000000000002,"15min":99.084000000000003},"last":1.0820000000000001}]},{"osd":5,"last update":"Fri Sep 13 15:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.216,"15min":1.0309999999999999},"min":{"1min":0.40300000000000002,"5min":0.28699999999999998,"15min":0.253},"max":{"1min":2.456,"5min":15.196,"15min":15.196},"last":0.877},{"interface":"front","average":{"1min":1.319,"5min":1.669,"15min":1.204},"min":{"1min":0.93300000000000005,"5min":0.317,"15min":0.26000000000000001},"max":{"1min":3.1789999999999998,"5min":25.192,"15min":25.192},"last":1.1259999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.623,"15min":1.3029999999999999},"min":{"1min":0.56699999999999995,"5min":0.33200000000000002,"15min":0.27800000000000002},"max":{"1min":2.0190000000000001,"5min":37.219999999999999,"15min":37.219999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.361,"5min":1.2430000000000001,"15min":1.139},"min":{"1min":0.88700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":4.5199999999999996,"5min":12.577,"15min":14.654},"last":0.999}]}]},{"osd":5,"up_from":14,"seq":60129542335,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":871448,"kb_used_data":20880,"kb_used_omap":1,"kb_used_meta":850558,"kb_avail":93500392,"statfs":{"total":96636764160,"available":95744401408,"internally_reserved":0,"allocated":21381120,"data_stored":21136948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":870971846},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":2.556,"15min":2.6600000000000001},"min":{"1min":0.38800000000000001,"5min":0.27600000000000002,"15min":0.26300000000000001},"max":{"1min":3.4020000000000001,"5min":67.037999999999997,"15min":94.078999999999994},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":2.0750000000000002,"15min":2.0390000000000001},"min":{"1min":0.38100000000000001,"5min":0.27800000000000002,"15min":0.27000000000000002},"max":{"1min":1.4890000000000001,"5min":67.555000000000007,"15min":76.866},"last":0.93100000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":2.7410000000000001,"15min":4.3150000000000004},"min":{"1min":0.47699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.123,"5min":65.730000000000004,"15min":214.21199999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.6319999999999999,"5min":2.556,"15min":6.6740000000000004},"min":{"1min":0.34799999999999998,"5min":0.31900000000000001,"15min":0.317},"max":{"1min":18.373999999999999,"5min":72.069000000000003,"15min":559.69500000000005},"last":0.76700000000000002}]},{"osd":2,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":2.6880000000000002,"15min":2.306},"min":{"1min":0.38400000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.98099999999999998,"5min":67.366,"15min":67.366},"last":1.042},{"interface":"front","average":{"1min":0.82499999999999996,"5min":2.3490000000000002,"15min":2.0579999999999998},"min":{"1min":0.44800000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.087,"5min":65.522000000000006,"15min":65.522000000000006},"last":0.97999999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":4.5979999999999999,"15min":3.1230000000000002},"min":{"1min":0.53900000000000003,"5min":0.40699999999999997,"15min":0.37},"max":{"1min":2.2349999999999999,"5min":169.30600000000001,"15min":169.30600000000001},"last":0.998},{"interface":"front","average":{"1min":1.0600000000000001,"5min":4.7009999999999996,"15min":4.1349999999999998},"min":{"1min":0.57699999999999996,"5min":0.437,"15min":0.40899999999999997},"max":{"1min":2.2519999999999998,"5min":169.33799999999999,"15min":169.33799999999999},"last":1.0189999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":2.2810000000000001,"15min":1.3979999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.223},"max":{"1min":1.2390000000000001,"5min":36.151000000000003,"15min":36.151000000000003},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.89100000000000001,"5min":2.431,"15min":1.4690000000000001},"min":{"1min":0.307,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":1.177,"5min":36.219000000000001,"15min":36.219000000000001},"last":1.0900000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":1.661,"15min":1.202},"min":{"1min":0.31,"5min":0.27300000000000002,"15min":0.25600000000000001},"max":{"1min":1.1899999999999999,"5min":25.734000000000002,"15min":25.734000000000002},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.5349999999999999,"15min":1.157},"min":{"1min":0.375,"5min":0.28999999999999998,"15min":0.26200000000000001},"max":{"1min":1.2390000000000001,"5min":29.106999999999999,"15min":29.106999999999999},"last":0.95499999999999996}]},{"osd":7,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.0029999999999999,"15min":0.97399999999999998},"min":{"1min":0.35799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.212,"5min":9.0329999999999995,"15min":10.798},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.226,"15min":1.048},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.2350000000000001,"5min":12.874000000000001,"15min":12.874000000000001},"last":0.89700000000000002}]}]},{"osd":4,"up_from":14,"seq":60129542334,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1128128,"kb_used_data":41336,"kb_used_omap":1,"kb_used_meta":1086782,"kb_avail":93243712,"statfs":{"total":96636764160,"available":95481561088,"internally_reserved":0,"allocated":42328064,"data_stored":42105374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1112865222},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":2.6059999999999999,"15min":1.6930000000000001},"min":{"1min":0.42999999999999999,"5min":0.308,"15min":0.27100000000000002},"max":{"1min":12.763999999999999,"5min":18.741,"15min":18.741},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":2.8559999999999999,"15min":1.96},"min":{"1min":0.46999999999999997,"5min":0.29699999999999999,"15min":0.28699999999999998},"max":{"1min":3.452,"5min":27.876999999999999,"15min":27.876999999999999},"last":0.50900000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":1.8700000000000001,"5min":15.220000000000001,"15min":6.8360000000000003},"min":{"1min":0.48299999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":19.812000000000001,"5min":1296.6300000000001,"15min":1296.6300000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.4610000000000001,"5min":3.165,"15min":2.6579999999999999},"min":{"1min":0.55300000000000005,"5min":0.313,"15min":0.307},"max":{"1min":9.0589999999999993,"5min":25.800999999999998,"15min":47.923999999999999},"last":0.68000000000000005}]},{"osd":2,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":2.4329999999999998,"15min":1.857},"min":{"1min":0.52200000000000002,"5min":0.309,"15min":0.29999999999999999},"max":{"1min":6.3639999999999999,"5min":23.760999999999999,"15min":23.760999999999999},"last":0.629},{"interface":"front","average":{"1min":1.173,"5min":2.399,"15min":1.913},"min":{"1min":0.61399999999999999,"5min":0.34000000000000002,"15min":0.32500000000000001},"max":{"1min":6.3949999999999996,"5min":23.709,"15min":30.510000000000002},"last":0.752}]},{"osd":3,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":4.577,"15min":2.9550000000000001},"min":{"1min":0.68200000000000005,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":4.7510000000000003,"5min":94.281000000000006,"15min":94.281000000000006},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":4.6340000000000003,"15min":3.238},"min":{"1min":0.76300000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":4.798,"5min":94.319999999999993,"15min":94.319999999999993},"last":0.95699999999999996}]},{"osd":5,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.6419999999999999,"15min":1.177},"min":{"1min":0.55200000000000005,"5min":0.245,"15min":0.245},"max":{"1min":4.1749999999999998,"5min":18.623999999999999,"15min":18.623999999999999},"last":1.038},{"interface":"front","average":{"1min":1.208,"5min":1.3779999999999999,"15min":1.1459999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.246},"max":{"1min":7.9740000000000002,"5min":16.155999999999999,"15min":16.155999999999999},"last":0.99399999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":2.0760000000000001,"15min":1.4950000000000001},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.24099999999999999},"max":{"1min":12.823,"5min":27.984000000000002,"15min":27.984000000000002},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.585,"5min":2.161,"15min":1.399},"min":{"1min":0.68200000000000005,"5min":0.28499999999999998,"15min":0.23799999999999999},"max":{"1min":12.941000000000001,"5min":28.077000000000002,"15min":28.077000000000002},"last":0.93999999999999995}]},{"osd":7,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.952,"15min":1.3899999999999999},"min":{"1min":0.89200000000000002,"5min":0.309,"15min":0.26200000000000001},"max":{"1min":3.339,"5min":25.266999999999999,"15min":25.266999999999999},"last":1.089},{"interface":"front","average":{"1min":1.3660000000000001,"5min":2.0430000000000001,"15min":1.486},"min":{"1min":0.98799999999999999,"5min":0.39400000000000002,"15min":0.32600000000000001},"max":{"1min":3.395,"5min":25.309999999999999,"15min":25.309999999999999},"last":1.2110000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542328,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1547308,"kb_used_data":24804,"kb_used_omap":1,"kb_used_meta":1522494,"kb_avail":92824532,"statfs":{"total":96636764160,"available":95052320768,"internally_reserved":0,"allocated":25399296,"data_stored":25168927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1559034312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":8.9239999999999995,"15min":6.4690000000000003},"min":{"1min":0.29199999999999998,"5min":0.28000000000000003,"15min":0.253},"max":{"1min":2.6190000000000002,"5min":108.956,"15min":170.35599999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":5.8860000000000001,"15min":4.5140000000000002},"min":{"1min":0.309,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.6659999999999999,"5min":63.624000000000002,"15min":168.80699999999999},"last":0.39300000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":8.8640000000000008,"15min":4.6429999999999998},"min":{"1min":0.378,"5min":0.32500000000000001,"15min":0.28499999999999998},"max":{"1min":2.3460000000000001,"5min":92.722999999999999,"15min":92.722999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":10.815,"15min":6.258},"min":{"1min":0.31,"5min":0.29899999999999999,"15min":0.26600000000000001},"max":{"1min":1.756,"5min":89.245000000000005,"15min":104.51300000000001},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":6.1130000000000004,"15min":3.8919999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":2.149,"5min":74.825000000000003,"15min":74.825000000000003},"last":0.378},{"interface":"front","average":{"1min":0.79300000000000004,"5min":6.3570000000000002,"15min":3.8730000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.36499999999999999},"max":{"1min":2.2029999999999998,"5min":74.870999999999995,"15min":74.870999999999995},"last":0.46700000000000003}]},{"osd":4,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":5.7009999999999996,"15min":3.056},"min":{"1min":0.46400000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.3849999999999998,"5min":85.710999999999999,"15min":85.710999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.99299999999999999,"5min":7.335,"15min":3.948},"min":{"1min":0.499,"5min":0.443,"15min":0.377},"max":{"1min":2.177,"5min":105.875,"15min":105.875},"last":0.72499999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":5.8570000000000002,"15min":3.379},"min":{"1min":0.61799999999999999,"5min":0.46700000000000003,"15min":0.40400000000000003},"max":{"1min":4.7380000000000004,"5min":95.748999999999995,"15min":95.748999999999995},"last":0.751},{"interface":"front","average":{"1min":1.2829999999999999,"5min":7.4969999999999999,"15min":4.3460000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":8.7870000000000008,"5min":100.325,"15min":100.325},"last":0.629}]},{"osd":6,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":4.7149999999999999,"15min":2.7639999999999998},"min":{"1min":0.433,"5min":0.432,"15min":0.432},"max":{"1min":4.7050000000000001,"5min":85.492999999999995,"15min":85.492999999999995},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":5.9450000000000003,"15min":3.2440000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.501},"max":{"1min":4.75,"5min":100.376,"15min":100.376},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 15:16:15 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":5.4859999999999998,"15min":3.085},"min":{"1min":0.57499999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.7509999999999999,"5min":97.268000000000001,"15min":97.268000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":5.8440000000000003,"15min":3.5470000000000002},"min":{"1min":0.51000000000000001,"5min":0.50800000000000001,"15min":0.48599999999999999},"max":{"1min":1.9870000000000001,"5min":100.583,"15min":100.583},"last":0.82599999999999996}]}]},{"osd":2,"up_from":14,"seq":60129542335,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":814544,"kb_used_data":4552,"kb_used_omap":1,"kb_used_meta":809982,"kb_avail":93557296,"statfs":{"total":96636764160,"available":95802671104,"internally_reserved":0,"allocated":4661248,"data_stored":4427070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":829422022},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:17:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":6.0439999999999996,"15min":3.7759999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":9.1750000000000007,"5min":170.77199999999999,"15min":170.77199999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":1.109,"5min":9.6739999999999995,"15min":5.4130000000000003},"min":{"1min":0.27700000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":9.1449999999999996,"5min":237.53800000000001,"15min":237.53800000000001},"last":0.35799999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":3.9260000000000002,"15min":3.7919999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28899999999999998},"max":{"1min":3.637,"5min":109.104,"15min":109.104},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.0029999999999999,"5min":10.397,"15min":5.8819999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.30499999999999999},"max":{"1min":9.2040000000000006,"5min":295.73500000000001,"15min":295.73500000000001},"last":0.39500000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:17:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":4.7539999999999996,"15min":3.7429999999999999},"min":{"1min":0.36599999999999999,"5min":0.35999999999999999,"15min":0.27900000000000003},"max":{"1min":8.9570000000000007,"5min":109.152,"15min":109.152},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":7.0780000000000003,"15min":4.8259999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.5600000000000001,"5min":264.87599999999998,"15min":264.87599999999998},"last":0.432}]},{"osd":4,"last update":"Fri Sep 13 15:17:14 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":6.4580000000000002,"15min":3.9049999999999998},"min":{"1min":0.41999999999999998,"5min":0.41599999999999998,"15min":0.38100000000000001},"max":{"1min":11.708,"5min":251.97300000000001,"15min":251.97300000000001},"last":0.628},{"interface":"front","average":{"1min":1.0529999999999999,"5min":3.891,"15min":2.5640000000000001},"min":{"1min":0.46899999999999997,"5min":0.42099999999999999,"15min":0.34899999999999998},"max":{"1min":9.1270000000000007,"5min":42.012,"15min":42.012},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Sep 13 15:17:14 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":2.8239999999999998,"15min":2.5209999999999999},"min":{"1min":0.54200000000000004,"5min":0.49099999999999999,"15min":0.46000000000000002},"max":{"1min":9.0229999999999997,"5min":41.942999999999998,"15min":41.942999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.177,"5min":5.2809999999999997,"15min":3.5179999999999998},"min":{"1min":0.58399999999999996,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":9.0909999999999993,"5min":237.58799999999999,"15min":237.58799999999999},"last":0.81899999999999995}]},{"osd":6,"last update":"Fri Sep 13 15:17:14 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":2.8300000000000001,"15min":2.456},"min":{"1min":0.57399999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":8.8460000000000001,"5min":41.981999999999999,"15min":41.981999999999999},"last":0.746},{"interface":"front","average":{"1min":1.1499999999999999,"5min":3.1080000000000001,"15min":2.5699999999999998},"min":{"1min":0.64300000000000002,"5min":0.502,"15min":0.49099999999999999},"max":{"1min":8.9920000000000009,"5min":41.890999999999998,"15min":41.890999999999998},"last":0.621}]},{"osd":7,"last update":"Fri Sep 13 15:17:14 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":5.3259999999999996,"15min":3.4089999999999998},"min":{"1min":0.47899999999999998,"5min":0.44,"15min":0.44},"max":{"1min":8.8970000000000002,"5min":237.626,"15min":237.626},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.879,"5min":5.3479999999999999,"15min":3.2480000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.39200000000000002},"max":{"1min":3.4620000000000002,"5min":252.005,"15min":252.005},"last":0.59599999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542329,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1493764,"kb_used_data":24956,"kb_used_omap":1,"kb_used_meta":1468798,"kb_avail":92878076,"statfs":{"total":96636764160,"available":95107149824,"internally_reserved":0,"allocated":25554944,"data_stored":25328384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1504049606},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:17:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":4.2000000000000002,"15min":4.1600000000000001},"min":{"1min":0.26700000000000002,"5min":0.23799999999999999,"15min":0.22500000000000001},"max":{"1min":15.843999999999999,"5min":104.246,"15min":104.246},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.69199999999999995,"5min":4.5720000000000001,"15min":4.0419999999999998},"min":{"1min":0.29199999999999998,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":4.6609999999999996,"5min":103.157,"15min":103.157},"last":0.33700000000000002}]},{"osd":2,"last update":"Fri Sep 13 15:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":6.21,"15min":5.1689999999999996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.4299999999999997,"5min":113.79600000000001,"15min":191.00899999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":3.6080000000000001,"15min":3.3929999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.318},"max":{"1min":0.61399999999999999,"5min":30.704999999999998,"15min":47.537999999999997},"last":0.40999999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":4.9299999999999997,"15min":4.0410000000000004},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.577,"5min":52.975000000000001,"15min":52.975000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.754,"5min":5.8949999999999996,"15min":4},"min":{"1min":0.39800000000000002,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":4.7519999999999998,"5min":104.319,"15min":104.319},"last":0.44500000000000001}]},{"osd":4,"last update":"Fri Sep 13 15:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":3.9510000000000001,"15min":3.9180000000000001},"min":{"1min":0.53400000000000003,"5min":0.45400000000000001,"15min":0.38700000000000001},"max":{"1min":0.93700000000000006,"5min":29.739000000000001,"15min":125.44799999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":5.859,"15min":4.1959999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.38800000000000001},"max":{"1min":0.96999999999999997,"5min":102.962,"15min":117.842},"last":0.77800000000000002}]},{"osd":5,"last update":"Fri Sep 13 15:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":4.0519999999999996,"15min":3.9369999999999998},"min":{"1min":0.57699999999999996,"5min":0.51600000000000001,"15min":0.40000000000000002},"max":{"1min":1.0449999999999999,"5min":104.19,"15min":154.875},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.012,"5min":4.2729999999999997,"15min":4.0659999999999998},"min":{"1min":0.53300000000000003,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":4.3899999999999997,"5min":45.369999999999997,"15min":126.485},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Sep 13 15:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":4.4720000000000004,"15min":3.5990000000000002},"min":{"1min":0.56799999999999995,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0069999999999999,"5min":103.191,"15min":103.191},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":3.9399999999999999,"15min":3.1619999999999999},"min":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.42399999999999999},"max":{"1min":1.006,"5min":104.28400000000001,"15min":104.28400000000001},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri Sep 13 15:17:13 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":4.1340000000000003,"15min":3.536},"min":{"1min":0.629,"5min":0.53700000000000003,"15min":0.438},"max":{"1min":3.5489999999999999,"5min":45.472999999999999,"15min":77.366},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.81999999999999995,"5min":4.681,"15min":3.839},"min":{"1min":0.59599999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.98499999999999999,"5min":112.69499999999999,"15min":112.69499999999999},"last":0.79800000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542333,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":970504,"kb_used_data":25536,"kb_used_omap":1,"kb_used_meta":944958,"kb_avail":93401336,"statfs":{"total":96636764160,"available":95642968064,"internally_reserved":0,"allocated":26148864,"data_stored":25917602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":967637446},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:17:08 2024","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":3.875,"15min":4.375},"min":{"1min":0.248,"5min":0.248,"15min":0.22900000000000001},"max":{"1min":16.885999999999999,"5min":43.508000000000003,"15min":279.90600000000001},"last":0.30399999999999999},{"interface":"front","average":{"1min":1.177,"5min":4.2640000000000002,"15min":6.2679999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.28100000000000003},"max":{"1min":8.7650000000000006,"5min":58.280000000000001,"15min":510.15699999999998},"last":0.42999999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":5.0460000000000003,"15min":3.3170000000000002},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.26000000000000001},"max":{"1min":4.9470000000000001,"5min":101.73399999999999,"15min":101.73399999999999},"last":0.374},{"interface":"front","average":{"1min":1.0700000000000001,"5min":3.6699999999999999,"15min":2.77},"min":{"1min":0.39500000000000002,"5min":0.39400000000000002,"15min":0.34200000000000003},"max":{"1min":7.0940000000000003,"5min":35.527999999999999,"15min":35.527999999999999},"last":0.45100000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:17:08 2024","interfaces":[{"interface":"back","average":{"1min":9.8650000000000002,"5min":7.1369999999999996,"15min":5.2750000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.28699999999999998},"max":{"1min":142.06200000000001,"5min":142.06200000000001,"15min":142.06200000000001},"last":0.41699999999999998},{"interface":"front","average":{"1min":10.363,"5min":5.8460000000000001,"15min":5.032},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":141.85300000000001,"5min":141.85300000000001,"15min":141.85300000000001},"last":0.36599999999999999}]},{"osd":4,"last update":"Fri Sep 13 15:16:16 2024","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":4.556,"15min":2.7400000000000002},"min":{"1min":0.51900000000000002,"5min":0.495,"15min":0.34200000000000003},"max":{"1min":5.1379999999999999,"5min":30.207999999999998,"15min":30.207999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.3600000000000001,"5min":4.0010000000000003,"15min":2.5550000000000002},"min":{"1min":0.55500000000000005,"5min":0.46999999999999997,"15min":0.38500000000000001},"max":{"1min":6.859,"5min":30.135000000000002,"15min":30.135000000000002},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Sep 13 15:16:16 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":5.3230000000000004,"15min":2.8719999999999999},"min":{"1min":0.626,"5min":0.46600000000000003,"15min":0.377},"max":{"1min":6.5609999999999999,"5min":101.702,"15min":101.702},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":3.593,"15min":2.3140000000000001},"min":{"1min":0.59599999999999997,"5min":0.434,"15min":0.379},"max":{"1min":7.1820000000000004,"5min":43.249000000000002,"15min":43.249000000000002},"last":0.75600000000000001}]},{"osd":6,"last update":"Fri Sep 13 15:17:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":4.048,"15min":2.6600000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.40000000000000002},"max":{"1min":5.1760000000000002,"5min":45.140000000000001,"15min":45.140000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":3.9430000000000001,"15min":2.7770000000000001},"min":{"1min":0.59699999999999998,"5min":0.52500000000000002,"15min":0.50600000000000001},"max":{"1min":8.7070000000000007,"5min":44.737000000000002,"15min":44.737000000000002},"last":0.77900000000000003}]},{"osd":7,"last update":"Fri Sep 13 15:17:08 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":4.5519999999999996,"15min":3.0209999999999999},"min":{"1min":0.60199999999999998,"5min":0.44700000000000001,"15min":0.42499999999999999},"max":{"1min":5.25,"5min":101.655,"15min":101.655},"last":0.746},{"interface":"front","average":{"1min":1.4279999999999999,"5min":3.6509999999999998,"15min":2.6629999999999998},"min":{"1min":0.63,"5min":0.51500000000000001,"15min":0.434},"max":{"1min":6.6559999999999997,"5min":46.649000000000001,"15min":46.649000000000001},"last":0.66800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25194496,"data_stored":25166698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25194496,"data_stored":25167848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4300800,"data_stored":4266534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25038848,"data_stored":25008391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41967616,"data_stored":41944838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21020672,"data_stored":20976412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29155328,"data_stored":29132361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":46174208,"data_stored":46139912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:17:24.136 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T15:01:44.370034+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=1, tm_sec=44, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=15, tm_min=16, tm_sec=13, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T15:17:24.136 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T15:17:44.138 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T15:17:44.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.279+0000 7f892fe00640 1 Processor -- start 2024-09-13T15:17:44.281 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.279+0000 7f892fe00640 1 -- start start 2024-09-13T15:17:44.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.279+0000 7f892fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8928071a70 0x7f89281576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:44.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.279+0000 7f892fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f892806ddb0 0x7f8928161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:44.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.279+0000 7f892fe00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89280c5530 con 0x7f89280b0bf0 2024-09-13T15:17:44.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.279+0000 7f892fe00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89281583b0 con 0x7f892806ddb0 2024-09-13T15:17:44.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.279+0000 7f892fe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8928156f40 con 0x7f8928071a70 2024-09-13T15:17:44.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.279+0000 7f892de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f892806ddb0 0x7f8928161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:44.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.279+0000 7f892de00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f892806ddb0 0x7f8928161800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40926/0 (socket says 172.21.15.7:40926) 2024-09-13T15:17:44.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.279+0000 7f892de00640 1 -- 172.21.15.7:0/2507335949 learned_addr learned my addr 172.21.15.7:0/2507335949 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:44.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.279+0000 7f892ca00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f89280b0bf0 0x7f8928150cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59112/0 (socket says 172.21.15.7:59112) 2024-09-13T15:17:44.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.279+0000 7f892d400640 1 --2- 172.21.15.7:0/2507335949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8928071a70 0x7f89281576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:44.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.279+0000 7f892de00640 1 -- 172.21.15.7:0/2507335949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8928071a70 msgr2=0x7f89281576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:17:44.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.279+0000 7f892de00640 1 --2- 172.21.15.7:0/2507335949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8928071a70 0x7f89281576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.279+0000 7f892de00640 1 -- 172.21.15.7:0/2507335949 >> v1:172.21.15.7:6789/0 conn(0x7f89280b0bf0 legacy=0x7f8928150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:44.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.279+0000 7f892de00640 1 -- 172.21.15.7:0/2507335949 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89280b10c0 con 0x7f892806ddb0 2024-09-13T15:17:44.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.279+0000 7f8927e00640 1 -- 172.21.15.7:0/2507335949 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169113289 0 0) 0x7f89280c5530 con 0x7f89280b0bf0 2024-09-13T15:17:44.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.283+0000 7f892de00640 1 --2- 172.21.15.7:0/2507335949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f892806ddb0 0x7f8928161800 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8920009e50 tx=0x7f892001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ecd52aa18a79672 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:44.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.283+0000 7f8927e00640 1 -- 172.21.15.7:0/2507335949 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89200a58d0 con 0x7f892806ddb0 2024-09-13T15:17:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.283+0000 7f8927e00640 1 -- 172.21.15.7:0/2507335949 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89200a5a30 con 0x7f892806ddb0 2024-09-13T15:17:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.283+0000 7f8927e00640 1 -- 172.21.15.7:0/2507335949 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89200a5dc0 con 0x7f892806ddb0 2024-09-13T15:17:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.283+0000 7f892fe00640 1 -- 172.21.15.7:0/2507335949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f892806ddb0 msgr2=0x7f8928161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.283+0000 7f892fe00640 1 --2- 172.21.15.7:0/2507335949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f892806ddb0 0x7f8928161800 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8920009e50 tx=0x7f892001ca00 comp rx=0 tx=0).stop 2024-09-13T15:17:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.283+0000 7f892fe00640 1 -- 172.21.15.7:0/2507335949 shutdown_connections 2024-09-13T15:17:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.283+0000 7f892fe00640 1 --2- 172.21.15.7:0/2507335949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f892806ddb0 0x7f8928161800 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.283+0000 7f892fe00640 1 --2- 172.21.15.7:0/2507335949 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8928071a70 0x7f89281576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.283+0000 7f892fe00640 1 -- 172.21.15.7:0/2507335949 >> 172.21.15.7:0/2507335949 conn(0x7f8928065d40 msgr2=0x7f8928066150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.283+0000 7f892fe00640 1 -- 172.21.15.7:0/2507335949 shutdown_connections 2024-09-13T15:17:44.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.283+0000 7f892fe00640 1 -- 172.21.15.7:0/2507335949 wait complete. 2024-09-13T15:17:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892fe00640 1 Processor -- start 2024-09-13T15:17:44.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892fe00640 1 -- start start 2024-09-13T15:17:44.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892fe00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f892806ddb0 0x7f8928155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:44.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892fe00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8928071a70 0x7f89281f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:44.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892fe00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89280b0bf0 0x7f89281f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:44.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892fe00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89280c34a0 con 0x7f892806ddb0 2024-09-13T15:17:44.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892fe00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89280c4310 con 0x7f89280b0bf0 2024-09-13T15:17:44.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892fe00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8928145e70 con 0x7f8928071a70 2024-09-13T15:17:44.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f892806ddb0 0x7f8928155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:44.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892d400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f892806ddb0 0x7f8928155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40930/0 (socket says 172.21.15.7:40930) 2024-09-13T15:17:44.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892d400640 1 -- 172.21.15.7:0/2708523564 learned_addr learned my addr 172.21.15.7:0/2708523564 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:44.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892ca00640 1 --2- 172.21.15.7:0/2708523564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8928071a70 0x7f89281f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:44.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892de00640 1 --2- 172.21.15.7:0/2708523564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89280b0bf0 0x7f89281f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:44.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892d400640 1 -- 172.21.15.7:0/2708523564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8928071a70 msgr2=0x7f89281f5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:44.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892d400640 1 --2- 172.21.15.7:0/2708523564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8928071a70 0x7f89281f5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892d400640 1 -- 172.21.15.7:0/2708523564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89280b0bf0 msgr2=0x7f89281f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:44.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892d400640 1 --2- 172.21.15.7:0/2708523564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89280b0bf0 0x7f89281f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892d400640 1 -- 172.21.15.7:0/2708523564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8920009b30 con 0x7f892806ddb0 2024-09-13T15:17:44.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892ca00640 1 --2- 172.21.15.7:0/2708523564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8928071a70 0x7f89281f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:17:44.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892de00640 1 --2- 172.21.15.7:0/2708523564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89280b0bf0 0x7f89281f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:17:44.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892d400640 1 --2- 172.21.15.7:0/2708523564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f892806ddb0 0x7f8928155e10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f891c00e870 tx=0x7f891c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:44.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f8925600640 1 -- 172.21.15.7:0/2708523564 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c009510 con 0x7f892806ddb0 2024-09-13T15:17:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f8925600640 1 -- 172.21.15.7:0/2708523564 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c00eec0 con 0x7f892806ddb0 2024-09-13T15:17:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f8925600640 1 -- 172.21.15.7:0/2708523564 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c00cb40 con 0x7f892806ddb0 2024-09-13T15:17:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892fe00640 1 -- 172.21.15.7:0/2708523564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89280c4540 con 0x7f892806ddb0 2024-09-13T15:17:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.287+0000 7f892fe00640 1 -- 172.21.15.7:0/2708523564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89280c4b00 con 0x7f892806ddb0 2024-09-13T15:17:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.291+0000 7f892fe00640 1 -- 172.21.15.7:0/2708523564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8928067650 con 0x7f892806ddb0 2024-09-13T15:17:44.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.291+0000 7f8925600640 1 -- 172.21.15.7:0/2708523564 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f891c00cca0 con 0x7f892806ddb0 2024-09-13T15:17:44.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.291+0000 7f8925600640 1 --2- 172.21.15.7:0/2708523564 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8908066690 0x7f8908068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:44.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.291+0000 7f8925600640 1 -- 172.21.15.7:0/2708523564 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f891c084c80 con 0x7f892806ddb0 2024-09-13T15:17:44.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.291+0000 7f892ca00640 1 --2- 172.21.15.7:0/2708523564 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8908066690 0x7f8908068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:44.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.291+0000 7f892ca00640 1 --2- 172.21.15.7:0/2708523564 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8908066690 0x7f8908068b50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8928145ba0 tx=0x7f8914007c40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:44.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.295+0000 7f8925600640 1 -- 172.21.15.7:0/2708523564 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f891c051990 con 0x7f892806ddb0 2024-09-13T15:17:44.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.507+0000 7f892fe00640 1 -- 172.21.15.7:0/2708523564 --> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89280c09a0 con 0x7f8908066690 2024-09-13T15:17:44.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.535+0000 7f8925600640 1 -- 172.21.15.7:0/2708523564 <== mgr.4110 v2:172.21.15.77:6832/1464925128 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372968 (secure 0 0 0) 0x7f8914007320 con 0x7f8908066690 2024-09-13T15:17:44.541 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:17:44.543 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-13T15:17:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.539+0000 7f892fe00640 1 -- 172.21.15.7:0/2708523564 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8908066690 msgr2=0x7f8908068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.539+0000 7f892fe00640 1 --2- 172.21.15.7:0/2708523564 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8908066690 0x7f8908068b50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8928145ba0 tx=0x7f8914007c40 comp rx=0 tx=0).stop 2024-09-13T15:17:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.539+0000 7f892fe00640 1 -- 172.21.15.7:0/2708523564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f892806ddb0 msgr2=0x7f8928155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.539+0000 7f892fe00640 1 --2- 172.21.15.7:0/2708523564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f892806ddb0 0x7f8928155e10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f891c00e870 tx=0x7f891c00ec70 comp rx=0 tx=0).stop 2024-09-13T15:17:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.539+0000 7f892fe00640 1 -- 172.21.15.7:0/2708523564 shutdown_connections 2024-09-13T15:17:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.539+0000 7f892fe00640 1 --2- 172.21.15.7:0/2708523564 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f8908066690 0x7f8908068b50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.539+0000 7f892fe00640 1 --2- 172.21.15.7:0/2708523564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f89280b0bf0 0x7f89281f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.539+0000 7f892fe00640 1 --2- 172.21.15.7:0/2708523564 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f8928071a70 0x7f89281f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.539+0000 7f892fe00640 1 --2- 172.21.15.7:0/2708523564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f892806ddb0 0x7f8928155e10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.539+0000 7f892fe00640 1 -- 172.21.15.7:0/2708523564 >> 172.21.15.7:0/2708523564 conn(0x7f8928065d40 msgr2=0x7f89280c93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:44.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.539+0000 7f892fe00640 1 -- 172.21.15.7:0/2708523564 shutdown_connections 2024-09-13T15:17:44.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.539+0000 7f892fe00640 1 -- 172.21.15.7:0/2708523564 wait complete. 2024-09-13T15:17:44.562 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":508,"stamp":"2024-09-13T15:17:42.990488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":109491865,"num_objects":126,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":126,"num_whiteouts":0,"num_read":617,"num_read_kb":111053,"num_write":2174555,"num_write_kb":31188655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":55628,"num_omap_keys":107,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153407,"ondisk_log_size":153407,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8980496,"kb_used_data":216912,"kb_used_omap":12,"kb_used_meta":8763507,"kb_avail":745994224,"statfs":{"total":773094113280,"available":763898085376,"internally_reserved":0,"allocated":222117888,"data_stored":220268018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":8973831736},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005005"},"pg_stats":[{"pgid":"2.1f","version":"33'47","reported_seq":100,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.748758+0000","last_change":"2024-09-13T15:16:21.447074+0000","last_active":"2024-09-13T15:16:23.748758+0000","last_peered":"2024-09-13T15:16:23.748758+0000","last_clean":"2024-09-13T15:16:23.748758+0000","last_became_active":"2024-09-13T15:01:44.418641+0000","last_became_peered":"2024-09-13T15:01:44.418641+0000","last_unstale":"2024-09-13T15:16:23.748758+0000","last_undegraded":"2024-09-13T15:16:23.748758+0000","last_fullsized":"2024-09-13T15:16:23.748758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'44","last_scrub_stamp":"2024-09-13T15:16:21.446893+0000","last_deep_scrub":"33'44","last_deep_scrub_stamp":"2024-09-13T15:16:21.446893+0000","last_clean_scrub_stamp":"2024-09-13T15:16:21.446893+0000","objects_scrubbed":9,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:15:25.634510+0000","scrub_duration":0.039130482000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":4120,"num_write":37,"num_write_kb":4130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18304,"num_omap_keys":34,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.034899+0000","last_change":"2024-09-13T15:16:22.973595+0000","last_active":"2024-09-13T15:16:24.034899+0000","last_peered":"2024-09-13T15:16:24.034899+0000","last_clean":"2024-09-13T15:16:24.034899+0000","last_became_active":"2024-09-13T15:01:44.809091+0000","last_became_peered":"2024-09-13T15:01:44.809091+0000","last_unstale":"2024-09-13T15:16:24.034899+0000","last_undegraded":"2024-09-13T15:16:24.034899+0000","last_fullsized":"2024-09-13T15:16:24.034899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T15:16:22.973417+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T15:16:22.973417+0000","last_clean_scrub_stamp":"2024-09-13T15:16:22.973417+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:22.248726+0000","scrub_duration":0.003905291,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"33'4483","reported_seq":4521,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:03.830518+0000","last_change":"2024-09-13T15:17:03.830667+0000","last_active":"2024-09-13T15:17:03.830518+0000","last_peered":"2024-09-13T15:17:03.830518+0000","last_clean":"2024-09-13T15:17:03.830518+0000","last_became_active":"2024-09-13T15:01:48.910262+0000","last_became_peered":"2024-09-13T15:01:48.910262+0000","last_unstale":"2024-09-13T15:17:03.830518+0000","last_undegraded":"2024-09-13T15:17:03.830518+0000","last_fullsized":"2024-09-13T15:17:03.830518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4483","last_scrub_stamp":"2024-09-13T15:17:03.830498+0000","last_deep_scrub":"33'4483","last_deep_scrub_stamp":"2024-09-13T15:17:03.830498+0000","last_clean_scrub_stamp":"2024-09-13T15:17:03.830498+0000","objects_scrubbed":0,"log_size":4483,"log_dups_size":0,"ondisk_log_size":4483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:38:26.185321+0000","scrub_duration":0.044532061999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65375,"num_write_kb":904330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"33'25","reported_seq":67,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:32.945023+0000","last_change":"2024-09-13T15:16:32.945101+0000","last_active":"2024-09-13T15:16:32.945023+0000","last_peered":"2024-09-13T15:16:32.945023+0000","last_clean":"2024-09-13T15:16:32.945023+0000","last_became_active":"2024-09-13T15:01:44.401666+0000","last_became_peered":"2024-09-13T15:01:44.401666+0000","last_unstale":"2024-09-13T15:16:32.945023+0000","last_undegraded":"2024-09-13T15:16:32.945023+0000","last_fullsized":"2024-09-13T15:16:32.945023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'25","last_scrub_stamp":"2024-09-13T15:16:32.945005+0000","last_deep_scrub":"33'25","last_deep_scrub_stamp":"2024-09-13T15:16:32.945005+0000","last_clean_scrub_stamp":"2024-09-13T15:16:32.945005+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:38.266030+0000","scrub_duration":0.011797106999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":18,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"33'7","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:54.232342+0000","last_change":"2024-09-13T15:16:54.232441+0000","last_active":"2024-09-13T15:16:54.232342+0000","last_peered":"2024-09-13T15:16:54.232342+0000","last_clean":"2024-09-13T15:16:54.232342+0000","last_became_active":"2024-09-13T15:01:44.849825+0000","last_became_peered":"2024-09-13T15:01:44.849825+0000","last_unstale":"2024-09-13T15:16:54.232342+0000","last_undegraded":"2024-09-13T15:16:54.232342+0000","last_fullsized":"2024-09-13T15:16:54.232342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:54.232320+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:54.232320+0000","last_clean_scrub_stamp":"2024-09-13T15:16:54.232320+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:34.087214+0000","scrub_duration":0.0026587659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"33'4943","reported_seq":4981,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.322856+0000","last_change":"2024-09-13T15:16:34.323110+0000","last_active":"2024-09-13T15:16:34.322856+0000","last_peered":"2024-09-13T15:16:34.322856+0000","last_clean":"2024-09-13T15:16:34.322856+0000","last_became_active":"2024-09-13T15:01:48.848750+0000","last_became_peered":"2024-09-13T15:01:48.848750+0000","last_unstale":"2024-09-13T15:16:34.322856+0000","last_undegraded":"2024-09-13T15:16:34.322856+0000","last_fullsized":"2024-09-13T15:16:34.322856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4943","last_scrub_stamp":"2024-09-13T15:16:34.322797+0000","last_deep_scrub":"33'4943","last_deep_scrub_stamp":"2024-09-13T15:16:34.322797+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.322797+0000","objects_scrubbed":0,"log_size":4943,"log_dups_size":0,"ondisk_log_size":4943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:02.000213+0000","scrub_duration":0.059598802999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71676,"num_write_kb":1026932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"33'74","reported_seq":133,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:43.853486+0000","last_change":"2024-09-13T15:16:43.853486+0000","last_active":"2024-09-13T15:16:43.853486+0000","last_peered":"2024-09-13T15:16:43.853486+0000","last_clean":"2024-09-13T15:16:43.853486+0000","last_became_active":"2024-09-13T15:01:44.437168+0000","last_became_peered":"2024-09-13T15:01:44.437168+0000","last_unstale":"2024-09-13T15:16:43.853486+0000","last_undegraded":"2024-09-13T15:16:43.853486+0000","last_fullsized":"2024-09-13T15:16:43.853486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'74","last_scrub_stamp":"2024-09-13T15:16:43.853192+0000","last_deep_scrub":"33'74","last_deep_scrub_stamp":"2024-09-13T15:16:43.853192+0000","last_clean_scrub_stamp":"2024-09-13T15:16:43.853192+0000","objects_scrubbed":10,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:18:05.006017+0000","scrub_duration":0.051040786999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":50,"num_read_kb":12337,"num_write":58,"num_write_kb":12312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.585752+0000","last_change":"2024-09-13T15:16:46.585752+0000","last_active":"2024-09-13T15:16:46.585752+0000","last_peered":"2024-09-13T15:16:46.585752+0000","last_clean":"2024-09-13T15:16:46.585752+0000","last_became_active":"2024-09-13T15:01:44.845395+0000","last_became_peered":"2024-09-13T15:01:44.845395+0000","last_unstale":"2024-09-13T15:16:46.585752+0000","last_undegraded":"2024-09-13T15:16:46.585752+0000","last_fullsized":"2024-09-13T15:16:46.585752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:46.585439+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:46.585439+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.585439+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:26.653766+0000","scrub_duration":0.0039872960000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"33'4446","reported_seq":4484,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:01.660444+0000","last_change":"2024-09-13T15:17:01.660795+0000","last_active":"2024-09-13T15:17:01.660444+0000","last_peered":"2024-09-13T15:17:01.660444+0000","last_clean":"2024-09-13T15:17:01.660444+0000","last_became_active":"2024-09-13T15:01:48.864314+0000","last_became_peered":"2024-09-13T15:01:48.864314+0000","last_unstale":"2024-09-13T15:17:01.660444+0000","last_undegraded":"2024-09-13T15:17:01.660444+0000","last_fullsized":"2024-09-13T15:17:01.660444+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4446","last_scrub_stamp":"2024-09-13T15:17:01.660386+0000","last_deep_scrub":"33'4446","last_deep_scrub_stamp":"2024-09-13T15:17:01.660386+0000","last_clean_scrub_stamp":"2024-09-13T15:17:01.660386+0000","objects_scrubbed":0,"log_size":4446,"log_dups_size":0,"ondisk_log_size":4446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:59:56.170494+0000","scrub_duration":0.060734819000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64553,"num_write_kb":920306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"33'19","reported_seq":68,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:44.786729+0000","last_change":"2024-09-13T15:16:44.786932+0000","last_active":"2024-09-13T15:16:44.786729+0000","last_peered":"2024-09-13T15:16:44.786729+0000","last_clean":"2024-09-13T15:16:44.786729+0000","last_became_active":"2024-09-13T15:01:44.423381+0000","last_became_peered":"2024-09-13T15:01:44.423381+0000","last_unstale":"2024-09-13T15:16:44.786729+0000","last_undegraded":"2024-09-13T15:16:44.786729+0000","last_fullsized":"2024-09-13T15:16:44.786729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:44.786676+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:44.786676+0000","last_clean_scrub_stamp":"2024-09-13T15:16:44.786676+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:18:07.262617+0000","scrub_duration":0.019597004000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":4116,"num_write":16,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"33'19","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:49.648254+0000","last_change":"2024-09-13T15:16:49.648254+0000","last_active":"2024-09-13T15:16:49.648254+0000","last_peered":"2024-09-13T15:16:49.648254+0000","last_clean":"2024-09-13T15:16:49.648254+0000","last_became_active":"2024-09-13T15:01:44.849038+0000","last_became_peered":"2024-09-13T15:01:44.849038+0000","last_unstale":"2024-09-13T15:16:49.648254+0000","last_undegraded":"2024-09-13T15:16:49.648254+0000","last_fullsized":"2024-09-13T15:16:49.648254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:49.647989+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:49.647989+0000","last_clean_scrub_stamp":"2024-09-13T15:16:49.647989+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:17.250145+0000","scrub_duration":0.0032904990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'4201","reported_seq":4239,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:54.451927+0000","last_change":"2024-09-13T15:16:54.452194+0000","last_active":"2024-09-13T15:16:54.451927+0000","last_peered":"2024-09-13T15:16:54.451927+0000","last_clean":"2024-09-13T15:16:54.451927+0000","last_became_active":"2024-09-13T15:01:48.853858+0000","last_became_peered":"2024-09-13T15:01:48.853858+0000","last_unstale":"2024-09-13T15:16:54.451927+0000","last_undegraded":"2024-09-13T15:16:54.451927+0000","last_fullsized":"2024-09-13T15:16:54.451927+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4201","last_scrub_stamp":"2024-09-13T15:16:54.451870+0000","last_deep_scrub":"33'4201","last_deep_scrub_stamp":"2024-09-13T15:16:54.451870+0000","last_clean_scrub_stamp":"2024-09-13T15:16:54.451870+0000","objects_scrubbed":0,"log_size":4201,"log_dups_size":0,"ondisk_log_size":4201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:09.325806+0000","scrub_duration":0.061230010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":61316,"num_write_kb":864366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"33'5","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:44.852767+0000","last_change":"2024-09-13T15:16:44.852767+0000","last_active":"2024-09-13T15:16:44.852767+0000","last_peered":"2024-09-13T15:16:44.852767+0000","last_clean":"2024-09-13T15:16:44.852767+0000","last_became_active":"2024-09-13T15:01:44.823690+0000","last_became_peered":"2024-09-13T15:01:44.823690+0000","last_unstale":"2024-09-13T15:16:44.852767+0000","last_undegraded":"2024-09-13T15:16:44.852767+0000","last_fullsized":"2024-09-13T15:16:44.852767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T15:16:44.852533+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T15:16:44.852533+0000","last_clean_scrub_stamp":"2024-09-13T15:16:44.852533+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:54:44.010971+0000","scrub_duration":0.0029740539999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"33'144","reported_seq":190,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.859566+0000","last_change":"2024-09-13T15:16:46.859566+0000","last_active":"2024-09-13T15:16:46.859566+0000","last_peered":"2024-09-13T15:16:46.859566+0000","last_clean":"2024-09-13T15:16:46.859566+0000","last_became_active":"2024-09-13T15:01:44.419965+0000","last_became_peered":"2024-09-13T15:01:44.419965+0000","last_unstale":"2024-09-13T15:16:46.859566+0000","last_undegraded":"2024-09-13T15:16:46.859566+0000","last_fullsized":"2024-09-13T15:16:46.859566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'144","last_scrub_stamp":"2024-09-13T15:16:46.859246+0000","last_deep_scrub":"33'144","last_deep_scrub_stamp":"2024-09-13T15:16:46.859246+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.859246+0000","objects_scrubbed":4,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:13.077229+0000","scrub_duration":0.030972208000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":8200,"num_write":130,"num_write_kb":8212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"33'4505","reported_seq":4544,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:39.353112+0000","last_change":"2024-09-13T15:16:39.353112+0000","last_active":"2024-09-13T15:16:39.353112+0000","last_peered":"2024-09-13T15:16:39.353112+0000","last_clean":"2024-09-13T15:16:39.353112+0000","last_became_active":"2024-09-13T15:01:48.849856+0000","last_became_peered":"2024-09-13T15:01:48.849856+0000","last_unstale":"2024-09-13T15:16:39.353112+0000","last_undegraded":"2024-09-13T15:16:39.353112+0000","last_fullsized":"2024-09-13T15:16:39.353112+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4505","last_scrub_stamp":"2024-09-13T15:16:39.352782+0000","last_deep_scrub":"33'4505","last_deep_scrub_stamp":"2024-09-13T15:16:39.352782+0000","last_clean_scrub_stamp":"2024-09-13T15:16:39.352782+0000","objects_scrubbed":0,"log_size":4505,"log_dups_size":0,"ondisk_log_size":4505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:43.506716+0000","scrub_duration":0.052549373000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65579,"num_write_kb":929153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:36.980882+0000","last_change":"2024-09-13T15:16:36.980882+0000","last_active":"2024-09-13T15:16:36.980882+0000","last_peered":"2024-09-13T15:16:36.980882+0000","last_clean":"2024-09-13T15:16:36.980882+0000","last_became_active":"2024-09-13T15:01:44.805767+0000","last_became_peered":"2024-09-13T15:01:44.805767+0000","last_unstale":"2024-09-13T15:16:36.980882+0000","last_undegraded":"2024-09-13T15:16:36.980882+0000","last_fullsized":"2024-09-13T15:16:36.980882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:36.980692+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:36.980692+0000","last_clean_scrub_stamp":"2024-09-13T15:16:36.980692+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:13:34.434100+0000","scrub_duration":0.0013482559999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"33'26","reported_seq":71,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.606279+0000","last_change":"2024-09-13T15:16:24.606279+0000","last_active":"2024-09-13T15:16:24.606279+0000","last_peered":"2024-09-13T15:16:24.606279+0000","last_clean":"2024-09-13T15:16:24.606279+0000","last_became_active":"2024-09-13T15:01:44.401559+0000","last_became_peered":"2024-09-13T15:01:44.401559+0000","last_unstale":"2024-09-13T15:16:24.606279+0000","last_undegraded":"2024-09-13T15:16:24.606279+0000","last_fullsized":"2024-09-13T15:16:24.606279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'26","last_scrub_stamp":"2024-09-13T15:16:24.606164+0000","last_deep_scrub":"33'26","last_deep_scrub_stamp":"2024-09-13T15:16:24.606164+0000","last_clean_scrub_stamp":"2024-09-13T15:16:24.606164+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:10:58.610420+0000","scrub_duration":0.010477458,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":4100,"num_write":19,"num_write_kb":4104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"33'4744","reported_seq":4783,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:33.297858+0000","last_change":"2024-09-13T15:16:33.297858+0000","last_active":"2024-09-13T15:16:33.297858+0000","last_peered":"2024-09-13T15:16:33.297858+0000","last_clean":"2024-09-13T15:16:33.297858+0000","last_became_active":"2024-09-13T15:01:48.857802+0000","last_became_peered":"2024-09-13T15:01:48.857802+0000","last_unstale":"2024-09-13T15:16:33.297858+0000","last_undegraded":"2024-09-13T15:16:33.297858+0000","last_fullsized":"2024-09-13T15:16:33.297858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4744","last_scrub_stamp":"2024-09-13T15:16:33.297473+0000","last_deep_scrub":"33'4744","last_deep_scrub_stamp":"2024-09-13T15:16:33.297473+0000","last_clean_scrub_stamp":"2024-09-13T15:16:33.297473+0000","objects_scrubbed":0,"log_size":4744,"log_dups_size":0,"ondisk_log_size":4744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:00.056232+0000","scrub_duration":0.060614465999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69018,"num_write_kb":974815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"33'10","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.161757+0000","last_change":"2024-09-13T15:16:19.917251+0000","last_active":"2024-09-13T15:16:24.161757+0000","last_peered":"2024-09-13T15:16:24.161757+0000","last_clean":"2024-09-13T15:16:24.161757+0000","last_became_active":"2024-09-13T15:01:44.808420+0000","last_became_peered":"2024-09-13T15:01:44.808420+0000","last_unstale":"2024-09-13T15:16:24.161757+0000","last_undegraded":"2024-09-13T15:16:24.161757+0000","last_fullsized":"2024-09-13T15:16:24.161757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:19.917131+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:19.917131+0000","last_clean_scrub_stamp":"2024-09-13T15:16:19.917131+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:55.912312+0000","scrub_duration":0.001471523,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"33'15","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.059692+0000","last_change":"2024-09-13T15:16:22.548304+0000","last_active":"2024-09-13T15:16:24.059692+0000","last_peered":"2024-09-13T15:16:24.059692+0000","last_clean":"2024-09-13T15:16:24.059692+0000","last_became_active":"2024-09-13T15:01:44.406354+0000","last_became_peered":"2024-09-13T15:01:44.406354+0000","last_unstale":"2024-09-13T15:16:24.059692+0000","last_undegraded":"2024-09-13T15:16:24.059692+0000","last_fullsized":"2024-09-13T15:16:24.059692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T15:16:22.548208+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T15:16:22.548208+0000","last_clean_scrub_stamp":"2024-09-13T15:16:22.548208+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:01:10.347627+0000","scrub_duration":0.0063788459999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"33'4791","reported_seq":4829,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:52.318445+0000","last_change":"2024-09-13T15:16:52.318588+0000","last_active":"2024-09-13T15:16:52.318445+0000","last_peered":"2024-09-13T15:16:52.318445+0000","last_clean":"2024-09-13T15:16:52.318445+0000","last_became_active":"2024-09-13T15:01:48.909494+0000","last_became_peered":"2024-09-13T15:01:48.909494+0000","last_unstale":"2024-09-13T15:16:52.318445+0000","last_undegraded":"2024-09-13T15:16:52.318445+0000","last_fullsized":"2024-09-13T15:16:52.318445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4791","last_scrub_stamp":"2024-09-13T15:16:52.318426+0000","last_deep_scrub":"33'4791","last_deep_scrub_stamp":"2024-09-13T15:16:52.318426+0000","last_clean_scrub_stamp":"2024-09-13T15:16:52.318426+0000","objects_scrubbed":0,"log_size":4791,"log_dups_size":0,"ondisk_log_size":4791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:36.300358+0000","scrub_duration":0.051287922999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69959,"num_write_kb":1001010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"33'3","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.090842+0000","last_change":"2024-09-13T15:16:26.090842+0000","last_active":"2024-09-13T15:16:26.090842+0000","last_peered":"2024-09-13T15:16:26.090842+0000","last_clean":"2024-09-13T15:16:26.090842+0000","last_became_active":"2024-09-13T15:01:44.824392+0000","last_became_peered":"2024-09-13T15:01:44.824392+0000","last_unstale":"2024-09-13T15:16:26.090842+0000","last_undegraded":"2024-09-13T15:16:26.090842+0000","last_fullsized":"2024-09-13T15:16:26.090842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T15:16:26.090602+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T15:16:26.090602+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.090602+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:41:02.638139+0000","scrub_duration":0.0027170839999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"33'19","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:50.928613+0000","last_change":"2024-09-13T15:16:50.928613+0000","last_active":"2024-09-13T15:16:50.928613+0000","last_peered":"2024-09-13T15:16:50.928613+0000","last_clean":"2024-09-13T15:16:50.928613+0000","last_became_active":"2024-09-13T15:01:44.419082+0000","last_became_peered":"2024-09-13T15:01:44.419082+0000","last_unstale":"2024-09-13T15:16:50.928613+0000","last_undegraded":"2024-09-13T15:16:50.928613+0000","last_fullsized":"2024-09-13T15:16:50.928613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:50.928331+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:50.928331+0000","last_clean_scrub_stamp":"2024-09-13T15:16:50.928331+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:08.247608+0000","scrub_duration":0.017025906,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":4102,"num_write":14,"num_write_kb":4101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"33'4700","reported_seq":4739,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:47.376368+0000","last_change":"2024-09-13T15:16:47.376368+0000","last_active":"2024-09-13T15:16:47.376368+0000","last_peered":"2024-09-13T15:16:47.376368+0000","last_clean":"2024-09-13T15:16:47.376368+0000","last_became_active":"2024-09-13T15:01:48.855433+0000","last_became_peered":"2024-09-13T15:01:48.855433+0000","last_unstale":"2024-09-13T15:16:47.376368+0000","last_undegraded":"2024-09-13T15:16:47.376368+0000","last_fullsized":"2024-09-13T15:16:47.376368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4700","last_scrub_stamp":"2024-09-13T15:16:47.375999+0000","last_deep_scrub":"33'4700","last_deep_scrub_stamp":"2024-09-13T15:16:47.375999+0000","last_clean_scrub_stamp":"2024-09-13T15:16:47.375999+0000","objects_scrubbed":0,"log_size":4700,"log_dups_size":0,"ondisk_log_size":4700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:39:00.786470+0000","scrub_duration":0.06414396,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68074,"num_write_kb":991498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"33'7","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.348910+0000","last_change":"2024-09-13T15:16:26.348910+0000","last_active":"2024-09-13T15:16:26.348910+0000","last_peered":"2024-09-13T15:16:26.348910+0000","last_clean":"2024-09-13T15:16:26.348910+0000","last_became_active":"2024-09-13T15:01:44.807643+0000","last_became_peered":"2024-09-13T15:01:44.807643+0000","last_unstale":"2024-09-13T15:16:26.348910+0000","last_undegraded":"2024-09-13T15:16:26.348910+0000","last_fullsized":"2024-09-13T15:16:26.348910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:26.348813+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:26.348813+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.348813+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:25:35.883729+0000","scrub_duration":0.001321298,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"33'19","reported_seq":70,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:25.747184+0000","last_change":"2024-09-13T15:16:25.747184+0000","last_active":"2024-09-13T15:16:25.747184+0000","last_peered":"2024-09-13T15:16:25.747184+0000","last_clean":"2024-09-13T15:16:25.747184+0000","last_became_active":"2024-09-13T15:01:44.429510+0000","last_became_peered":"2024-09-13T15:01:44.429510+0000","last_unstale":"2024-09-13T15:16:25.747184+0000","last_undegraded":"2024-09-13T15:16:25.747184+0000","last_fullsized":"2024-09-13T15:16:25.747184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:25.746901+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:25.746901+0000","last_clean_scrub_stamp":"2024-09-13T15:16:25.746901+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:29.626332+0000","scrub_duration":0.0090965799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"33'4847","reported_seq":4886,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:37.402053+0000","last_change":"2024-09-13T15:16:37.402307+0000","last_active":"2024-09-13T15:16:37.402053+0000","last_peered":"2024-09-13T15:16:37.402053+0000","last_clean":"2024-09-13T15:16:37.402053+0000","last_became_active":"2024-09-13T15:01:48.911578+0000","last_became_peered":"2024-09-13T15:01:48.911578+0000","last_unstale":"2024-09-13T15:16:37.402053+0000","last_undegraded":"2024-09-13T15:16:37.402053+0000","last_fullsized":"2024-09-13T15:16:37.402053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4847","last_scrub_stamp":"2024-09-13T15:16:37.402012+0000","last_deep_scrub":"33'4847","last_deep_scrub_stamp":"2024-09-13T15:16:37.402012+0000","last_clean_scrub_stamp":"2024-09-13T15:16:37.402012+0000","objects_scrubbed":0,"log_size":4847,"log_dups_size":0,"ondisk_log_size":4847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:44.796269+0000","scrub_duration":0.079726367000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70505,"num_write_kb":1030585,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.009623+0000","last_change":"2024-09-13T15:16:46.009623+0000","last_active":"2024-09-13T15:16:46.009623+0000","last_peered":"2024-09-13T15:16:46.009623+0000","last_clean":"2024-09-13T15:16:46.009623+0000","last_became_active":"2024-09-13T15:01:44.838128+0000","last_became_peered":"2024-09-13T15:01:44.838128+0000","last_unstale":"2024-09-13T15:16:46.009623+0000","last_undegraded":"2024-09-13T15:16:46.009623+0000","last_fullsized":"2024-09-13T15:16:46.009623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:46.008515+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:46.008515+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.008515+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:27:19.737003+0000","scrub_duration":0.0026910200000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"33'119","reported_seq":168,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.572041+0000","last_change":"2024-09-13T15:16:26.572041+0000","last_active":"2024-09-13T15:16:26.572041+0000","last_peered":"2024-09-13T15:16:26.572041+0000","last_clean":"2024-09-13T15:16:26.572041+0000","last_became_active":"2024-09-13T15:01:44.430548+0000","last_became_peered":"2024-09-13T15:01:44.430548+0000","last_unstale":"2024-09-13T15:16:26.572041+0000","last_undegraded":"2024-09-13T15:16:26.572041+0000","last_fullsized":"2024-09-13T15:16:26.572041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-09-13T15:16:26.571900+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-09-13T15:16:26.571900+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.571900+0000","objects_scrubbed":4,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:52:58.749238+0000","scrub_duration":0.0068987069999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":251,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"33'4848","reported_seq":4887,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:14.896071+0000","last_change":"2024-09-13T15:17:14.896208+0000","last_active":"2024-09-13T15:17:14.896071+0000","last_peered":"2024-09-13T15:17:14.896071+0000","last_clean":"2024-09-13T15:17:14.896071+0000","last_became_active":"2024-09-13T15:01:48.910150+0000","last_became_peered":"2024-09-13T15:01:48.910150+0000","last_unstale":"2024-09-13T15:17:14.896071+0000","last_undegraded":"2024-09-13T15:17:14.896071+0000","last_fullsized":"2024-09-13T15:17:14.896071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4848","last_scrub_stamp":"2024-09-13T15:17:14.896050+0000","last_deep_scrub":"33'4848","last_deep_scrub_stamp":"2024-09-13T15:17:14.896050+0000","last_clean_scrub_stamp":"2024-09-13T15:17:14.896050+0000","objects_scrubbed":0,"log_size":4848,"log_dups_size":0,"ondisk_log_size":4848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:09:10.990249+0000","scrub_duration":0.043703262,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":70446,"num_write_kb":999196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"33'14","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:40.382671+0000","last_change":"2024-09-13T15:16:40.382752+0000","last_active":"2024-09-13T15:16:40.382671+0000","last_peered":"2024-09-13T15:16:40.382671+0000","last_clean":"2024-09-13T15:16:40.382671+0000","last_became_active":"2024-09-13T15:01:44.811915+0000","last_became_peered":"2024-09-13T15:01:44.811915+0000","last_unstale":"2024-09-13T15:16:40.382671+0000","last_undegraded":"2024-09-13T15:16:40.382671+0000","last_fullsized":"2024-09-13T15:16:40.382671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:40.382651+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:40.382651+0000","last_clean_scrub_stamp":"2024-09-13T15:16:40.382651+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:05:21.251984+0000","scrub_duration":0.001494736,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"33'13","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:36.714995+0000","last_change":"2024-09-13T15:16:36.715178+0000","last_active":"2024-09-13T15:16:36.714995+0000","last_peered":"2024-09-13T15:16:36.714995+0000","last_clean":"2024-09-13T15:16:36.714995+0000","last_became_active":"2024-09-13T15:01:44.422297+0000","last_became_peered":"2024-09-13T15:01:44.422297+0000","last_unstale":"2024-09-13T15:16:36.714995+0000","last_undegraded":"2024-09-13T15:16:36.714995+0000","last_fullsized":"2024-09-13T15:16:36.714995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T15:16:36.714944+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T15:16:36.714944+0000","last_clean_scrub_stamp":"2024-09-13T15:16:36.714944+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:53.830394+0000","scrub_duration":0.0057288749999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"33'4797","reported_seq":4836,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:57.381405+0000","last_change":"2024-09-13T15:16:57.381540+0000","last_active":"2024-09-13T15:16:57.381405+0000","last_peered":"2024-09-13T15:16:57.381405+0000","last_clean":"2024-09-13T15:16:57.381405+0000","last_became_active":"2024-09-13T15:01:48.908118+0000","last_became_peered":"2024-09-13T15:01:48.908118+0000","last_unstale":"2024-09-13T15:16:57.381405+0000","last_undegraded":"2024-09-13T15:16:57.381405+0000","last_fullsized":"2024-09-13T15:16:57.381405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4797","last_scrub_stamp":"2024-09-13T15:16:57.381384+0000","last_deep_scrub":"33'4797","last_deep_scrub_stamp":"2024-09-13T15:16:57.381384+0000","last_clean_scrub_stamp":"2024-09-13T15:16:57.381384+0000","objects_scrubbed":0,"log_size":4797,"log_dups_size":0,"ondisk_log_size":4797,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:18:04.766466+0000","scrub_duration":0.052226372,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69559,"num_write_kb":1001647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"33'5","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:37.634781+0000","last_change":"2024-09-13T15:16:37.634978+0000","last_active":"2024-09-13T15:16:37.634781+0000","last_peered":"2024-09-13T15:16:37.634781+0000","last_clean":"2024-09-13T15:16:37.634781+0000","last_became_active":"2024-09-13T15:01:44.850263+0000","last_became_peered":"2024-09-13T15:01:44.850263+0000","last_unstale":"2024-09-13T15:16:37.634781+0000","last_undegraded":"2024-09-13T15:16:37.634781+0000","last_fullsized":"2024-09-13T15:16:37.634781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T15:16:37.634730+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T15:16:37.634730+0000","last_clean_scrub_stamp":"2024-09-13T15:16:37.634730+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:17:49.903072+0000","scrub_duration":0.0026524399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"33'6","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.015510+0000","last_change":"2024-09-13T15:16:23.590960+0000","last_active":"2024-09-13T15:16:24.015510+0000","last_peered":"2024-09-13T15:16:24.015510+0000","last_clean":"2024-09-13T15:16:24.015510+0000","last_became_active":"2024-09-13T15:01:44.398881+0000","last_became_peered":"2024-09-13T15:01:44.398881+0000","last_unstale":"2024-09-13T15:16:24.015510+0000","last_undegraded":"2024-09-13T15:16:24.015510+0000","last_fullsized":"2024-09-13T15:16:24.015510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T15:16:23.590800+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T15:16:23.590800+0000","last_clean_scrub_stamp":"2024-09-13T15:16:23.590800+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:37:44.286646+0000","scrub_duration":0.023094673,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2694,"num_omap_keys":5,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"33'4059","reported_seq":4098,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:51.315149+0000","last_change":"2024-09-13T15:16:51.315264+0000","last_active":"2024-09-13T15:16:51.315149+0000","last_peered":"2024-09-13T15:16:51.315149+0000","last_clean":"2024-09-13T15:16:51.315149+0000","last_became_active":"2024-09-13T15:01:48.851948+0000","last_became_peered":"2024-09-13T15:01:48.851948+0000","last_unstale":"2024-09-13T15:16:51.315149+0000","last_undegraded":"2024-09-13T15:16:51.315149+0000","last_fullsized":"2024-09-13T15:16:51.315149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4059","last_scrub_stamp":"2024-09-13T15:16:51.315130+0000","last_deep_scrub":"33'4059","last_deep_scrub_stamp":"2024-09-13T15:16:51.315130+0000","last_clean_scrub_stamp":"2024-09-13T15:16:51.315130+0000","objects_scrubbed":0,"log_size":4059,"log_dups_size":0,"ondisk_log_size":4059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:59:45.048586+0000","scrub_duration":0.037480123999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58925,"num_write_kb":861513,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"33'7","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:28.083406+0000","last_change":"2024-09-13T15:16:28.083406+0000","last_active":"2024-09-13T15:16:28.083406+0000","last_peered":"2024-09-13T15:16:28.083406+0000","last_clean":"2024-09-13T15:16:28.083406+0000","last_became_active":"2024-09-13T15:01:44.821475+0000","last_became_peered":"2024-09-13T15:01:44.821475+0000","last_unstale":"2024-09-13T15:16:28.083406+0000","last_undegraded":"2024-09-13T15:16:28.083406+0000","last_fullsized":"2024-09-13T15:16:28.083406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:28.083138+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:28.083138+0000","last_clean_scrub_stamp":"2024-09-13T15:16:28.083138+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:39.566336+0000","scrub_duration":0.0028025329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'40","reported_seq":92,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.600169+0000","last_change":"2024-09-13T15:16:26.600795+0000","last_active":"2024-09-13T15:16:26.600169+0000","last_peered":"2024-09-13T15:16:26.600169+0000","last_clean":"2024-09-13T15:16:26.600169+0000","last_became_active":"2024-09-13T15:01:44.432902+0000","last_became_peered":"2024-09-13T15:01:44.432902+0000","last_unstale":"2024-09-13T15:16:26.600169+0000","last_undegraded":"2024-09-13T15:16:26.600169+0000","last_fullsized":"2024-09-13T15:16:26.600169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'40","last_scrub_stamp":"2024-09-13T15:16:26.600116+0000","last_deep_scrub":"33'40","last_deep_scrub_stamp":"2024-09-13T15:16:26.600116+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.600116+0000","objects_scrubbed":4,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:35.079765+0000","scrub_duration":0.027584299,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389688,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":8206,"num_write":28,"num_write_kb":8203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"33'4539","reported_seq":4578,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:42.385854+0000","last_change":"2024-09-13T15:16:42.385984+0000","last_active":"2024-09-13T15:16:42.385854+0000","last_peered":"2024-09-13T15:16:42.385854+0000","last_clean":"2024-09-13T15:16:42.385854+0000","last_became_active":"2024-09-13T15:01:48.846301+0000","last_became_peered":"2024-09-13T15:01:48.846301+0000","last_unstale":"2024-09-13T15:16:42.385854+0000","last_undegraded":"2024-09-13T15:16:42.385854+0000","last_fullsized":"2024-09-13T15:16:42.385854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4539","last_scrub_stamp":"2024-09-13T15:16:42.385833+0000","last_deep_scrub":"33'4539","last_deep_scrub_stamp":"2024-09-13T15:16:42.385833+0000","last_clean_scrub_stamp":"2024-09-13T15:16:42.385833+0000","objects_scrubbed":0,"log_size":4539,"log_dups_size":0,"ondisk_log_size":4539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:56.294090+0000","scrub_duration":0.044831939000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":66145,"num_write_kb":975469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"33'12","reported_seq":53,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.078239+0000","last_change":"2024-09-13T15:16:17.879916+0000","last_active":"2024-09-13T15:16:24.078239+0000","last_peered":"2024-09-13T15:16:24.078239+0000","last_clean":"2024-09-13T15:16:24.078239+0000","last_became_active":"2024-09-13T15:01:44.814192+0000","last_became_peered":"2024-09-13T15:01:44.814192+0000","last_unstale":"2024-09-13T15:16:24.078239+0000","last_undegraded":"2024-09-13T15:16:24.078239+0000","last_fullsized":"2024-09-13T15:16:24.078239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:17.879753+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:17.879753+0000","last_clean_scrub_stamp":"2024-09-13T15:16:17.879753+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:36.906977+0000","scrub_duration":0.33901714599999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'35","reported_seq":104,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.123746+0000","last_change":"2024-09-13T15:16:26.123827+0000","last_active":"2024-09-13T15:16:26.123746+0000","last_peered":"2024-09-13T15:16:26.123746+0000","last_clean":"2024-09-13T15:16:26.123746+0000","last_became_active":"2024-09-13T15:01:44.398904+0000","last_became_peered":"2024-09-13T15:01:44.398904+0000","last_unstale":"2024-09-13T15:16:26.123746+0000","last_undegraded":"2024-09-13T15:16:26.123746+0000","last_fullsized":"2024-09-13T15:16:26.123746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'35","last_scrub_stamp":"2024-09-13T15:16:26.123727+0000","last_deep_scrub":"33'35","last_deep_scrub_stamp":"2024-09-13T15:16:26.123727+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.123727+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:19.696735+0000","scrub_duration":0.0038650519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70412,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":156,"num_write":30,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'5224","reported_seq":5263,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:50.323166+0000","last_change":"2024-09-13T15:16:50.323166+0000","last_active":"2024-09-13T15:16:50.323166+0000","last_peered":"2024-09-13T15:16:50.323166+0000","last_clean":"2024-09-13T15:16:50.323166+0000","last_became_active":"2024-09-13T15:01:48.858649+0000","last_became_peered":"2024-09-13T15:01:48.858649+0000","last_unstale":"2024-09-13T15:16:50.323166+0000","last_undegraded":"2024-09-13T15:16:50.323166+0000","last_fullsized":"2024-09-13T15:16:50.323166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5224","last_scrub_stamp":"2024-09-13T15:16:50.323018+0000","last_deep_scrub":"33'5224","last_deep_scrub_stamp":"2024-09-13T15:16:50.323018+0000","last_clean_scrub_stamp":"2024-09-13T15:16:50.323018+0000","objects_scrubbed":0,"log_size":5224,"log_dups_size":0,"ondisk_log_size":5224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:11.290072+0000","scrub_duration":0.049882793000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":76325,"num_write_kb":1087992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"33'4","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:39.281590+0000","last_change":"2024-09-13T15:16:39.281681+0000","last_active":"2024-09-13T15:16:39.281590+0000","last_peered":"2024-09-13T15:16:39.281590+0000","last_clean":"2024-09-13T15:16:39.281590+0000","last_became_active":"2024-09-13T15:01:44.826222+0000","last_became_peered":"2024-09-13T15:01:44.826222+0000","last_unstale":"2024-09-13T15:16:39.281590+0000","last_undegraded":"2024-09-13T15:16:39.281590+0000","last_fullsized":"2024-09-13T15:16:39.281590+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T15:16:39.281570+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T15:16:39.281570+0000","last_clean_scrub_stamp":"2024-09-13T15:16:39.281570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:44.314476+0000","scrub_duration":0.0023677669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'32","reported_seq":78,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:40.787167+0000","last_change":"2024-09-13T15:16:40.787346+0000","last_active":"2024-09-13T15:16:40.787167+0000","last_peered":"2024-09-13T15:16:40.787167+0000","last_clean":"2024-09-13T15:16:40.787167+0000","last_became_active":"2024-09-13T15:01:44.419660+0000","last_became_peered":"2024-09-13T15:01:44.419660+0000","last_unstale":"2024-09-13T15:16:40.787167+0000","last_undegraded":"2024-09-13T15:16:40.787167+0000","last_fullsized":"2024-09-13T15:16:40.787167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'32","last_scrub_stamp":"2024-09-13T15:16:40.787112+0000","last_deep_scrub":"33'32","last_deep_scrub_stamp":"2024-09-13T15:16:40.787112+0000","last_clean_scrub_stamp":"2024-09-13T15:16:40.787112+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:08.058596+0000","scrub_duration":0.026405371,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":20,"num_write_kb":8201,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"33'4215","reported_seq":4264,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:55.325420+0000","last_change":"2024-09-13T15:16:55.325544+0000","last_active":"2024-09-13T15:16:55.325420+0000","last_peered":"2024-09-13T15:16:55.325420+0000","last_clean":"2024-09-13T15:16:55.325420+0000","last_became_active":"2024-09-13T15:02:34.118461+0000","last_became_peered":"2024-09-13T15:02:34.118461+0000","last_unstale":"2024-09-13T15:16:55.325420+0000","last_undegraded":"2024-09-13T15:16:55.325420+0000","last_fullsized":"2024-09-13T15:16:55.325420+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4215","last_scrub_stamp":"2024-09-13T15:16:55.325400+0000","last_deep_scrub":"33'4215","last_deep_scrub_stamp":"2024-09-13T15:16:55.325400+0000","last_clean_scrub_stamp":"2024-09-13T15:16:55.325400+0000","objects_scrubbed":0,"log_size":4215,"log_dups_size":0,"ondisk_log_size":4215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:05.926263+0000","scrub_duration":0.065180481999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":60783,"num_write_kb":878332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:35.977004+0000","last_change":"2024-09-13T15:16:35.977077+0000","last_active":"2024-09-13T15:16:35.977004+0000","last_peered":"2024-09-13T15:16:35.977004+0000","last_clean":"2024-09-13T15:16:35.977004+0000","last_became_active":"2024-09-13T15:01:44.850234+0000","last_became_peered":"2024-09-13T15:01:44.850234+0000","last_unstale":"2024-09-13T15:16:35.977004+0000","last_undegraded":"2024-09-13T15:16:35.977004+0000","last_fullsized":"2024-09-13T15:16:35.977004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:35.976986+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:35.976986+0000","last_clean_scrub_stamp":"2024-09-13T15:16:35.976986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:15.229979+0000","scrub_duration":0.0024425779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"33'14","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:27.599430+0000","last_change":"2024-09-13T15:16:27.599633+0000","last_active":"2024-09-13T15:16:27.599430+0000","last_peered":"2024-09-13T15:16:27.599430+0000","last_clean":"2024-09-13T15:16:27.599430+0000","last_became_active":"2024-09-13T15:01:44.410675+0000","last_became_peered":"2024-09-13T15:01:44.410675+0000","last_unstale":"2024-09-13T15:16:27.599430+0000","last_undegraded":"2024-09-13T15:16:27.599430+0000","last_fullsized":"2024-09-13T15:16:27.599430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:27.599376+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:27.599376+0000","last_clean_scrub_stamp":"2024-09-13T15:16:27.599376+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:49.535267+0000","scrub_duration":0.0074093939999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":14,"num_read_kb":18,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"33'119","reported_seq":196,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:29.740890+0000","last_change":"2024-09-13T15:16:29.741095+0000","last_active":"2024-09-13T15:16:29.740890+0000","last_peered":"2024-09-13T15:16:29.740890+0000","last_clean":"2024-09-13T15:16:29.740890+0000","last_became_active":"2024-09-13T15:01:40.832279+0000","last_became_peered":"2024-09-13T15:01:40.832279+0000","last_unstale":"2024-09-13T15:16:29.740890+0000","last_undegraded":"2024-09-13T15:16:29.740890+0000","last_fullsized":"2024-09-13T15:16:29.740890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'119","last_scrub_stamp":"2024-09-13T15:16:29.740837+0000","last_deep_scrub":"33'119","last_deep_scrub_stamp":"2024-09-13T15:16:29.740837+0000","last_clean_scrub_stamp":"2024-09-13T15:16:29.740837+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:37.631981+0000","scrub_duration":0.0066710290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"33'5137","reported_seq":5176,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:03.930377+0000","last_change":"2024-09-13T15:17:03.930611+0000","last_active":"2024-09-13T15:17:03.930377+0000","last_peered":"2024-09-13T15:17:03.930377+0000","last_clean":"2024-09-13T15:17:03.930377+0000","last_became_active":"2024-09-13T15:01:48.918678+0000","last_became_peered":"2024-09-13T15:01:48.918678+0000","last_unstale":"2024-09-13T15:17:03.930377+0000","last_undegraded":"2024-09-13T15:17:03.930377+0000","last_fullsized":"2024-09-13T15:17:03.930377+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5137","last_scrub_stamp":"2024-09-13T15:17:03.930331+0000","last_deep_scrub":"33'5137","last_deep_scrub_stamp":"2024-09-13T15:17:03.930331+0000","last_clean_scrub_stamp":"2024-09-13T15:17:03.930331+0000","objects_scrubbed":0,"log_size":5137,"log_dups_size":0,"ondisk_log_size":5137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:16:10.205490+0000","scrub_duration":0.095690918999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74848,"num_write_kb":1044614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"33'7","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.178173+0000","last_change":"2024-09-13T15:16:22.684165+0000","last_active":"2024-09-13T15:16:24.178173+0000","last_peered":"2024-09-13T15:16:24.178173+0000","last_clean":"2024-09-13T15:16:24.178173+0000","last_became_active":"2024-09-13T15:01:44.849457+0000","last_became_peered":"2024-09-13T15:01:44.849457+0000","last_unstale":"2024-09-13T15:16:24.178173+0000","last_undegraded":"2024-09-13T15:16:24.178173+0000","last_fullsized":"2024-09-13T15:16:24.178173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:22.683907+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:22.683907+0000","last_clean_scrub_stamp":"2024-09-13T15:16:22.683907+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:51.010493+0000","scrub_duration":0.0033186610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"33'18","reported_seq":65,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.146190+0000","last_change":"2024-09-13T15:16:19.393403+0000","last_active":"2024-09-13T15:16:24.146190+0000","last_peered":"2024-09-13T15:16:24.146190+0000","last_clean":"2024-09-13T15:16:24.146190+0000","last_became_active":"2024-09-13T15:01:44.420601+0000","last_became_peered":"2024-09-13T15:01:44.420601+0000","last_unstale":"2024-09-13T15:16:24.146190+0000","last_undegraded":"2024-09-13T15:16:24.146190+0000","last_fullsized":"2024-09-13T15:16:24.146190+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T15:16:19.393308+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T15:16:19.393308+0000","last_clean_scrub_stamp":"2024-09-13T15:16:19.393308+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:04.511597+0000","scrub_duration":0.25461208400000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1638,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"33'4520","reported_seq":4559,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:58.878819+0000","last_change":"2024-09-13T15:16:58.878819+0000","last_active":"2024-09-13T15:16:58.878819+0000","last_peered":"2024-09-13T15:16:58.878819+0000","last_clean":"2024-09-13T15:16:58.878819+0000","last_became_active":"2024-09-13T15:01:48.910479+0000","last_became_peered":"2024-09-13T15:01:48.910479+0000","last_unstale":"2024-09-13T15:16:58.878819+0000","last_undegraded":"2024-09-13T15:16:58.878819+0000","last_fullsized":"2024-09-13T15:16:58.878819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4520","last_scrub_stamp":"2024-09-13T15:16:58.878450+0000","last_deep_scrub":"33'4520","last_deep_scrub_stamp":"2024-09-13T15:16:58.878450+0000","last_clean_scrub_stamp":"2024-09-13T15:16:58.878450+0000","objects_scrubbed":0,"log_size":4520,"log_dups_size":0,"ondisk_log_size":4520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:36.119849+0000","scrub_duration":0.070444623999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65908,"num_write_kb":920675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:36.611191+0000","last_change":"2024-09-13T15:16:36.611191+0000","last_active":"2024-09-13T15:16:36.611191+0000","last_peered":"2024-09-13T15:16:36.611191+0000","last_clean":"2024-09-13T15:16:36.611191+0000","last_became_active":"2024-09-13T15:01:44.837429+0000","last_became_peered":"2024-09-13T15:01:44.837429+0000","last_unstale":"2024-09-13T15:16:36.611191+0000","last_undegraded":"2024-09-13T15:16:36.611191+0000","last_fullsized":"2024-09-13T15:16:36.611191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:36.610935+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:36.610935+0000","last_clean_scrub_stamp":"2024-09-13T15:16:36.610935+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:41.442948+0000","scrub_duration":0.0026950490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"33'18","reported_seq":62,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:25.592225+0000","last_change":"2024-09-13T15:16:25.592225+0000","last_active":"2024-09-13T15:16:25.592225+0000","last_peered":"2024-09-13T15:16:25.592225+0000","last_clean":"2024-09-13T15:16:25.592225+0000","last_became_active":"2024-09-13T15:01:44.406719+0000","last_became_peered":"2024-09-13T15:01:44.406719+0000","last_unstale":"2024-09-13T15:16:25.592225+0000","last_undegraded":"2024-09-13T15:16:25.592225+0000","last_fullsized":"2024-09-13T15:16:25.592225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T15:16:25.592132+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T15:16:25.592132+0000","last_clean_scrub_stamp":"2024-09-13T15:16:25.592132+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:03:43.505817+0000","scrub_duration":0.015211931,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4097,"num_write":9,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"33'5126","reported_seq":5165,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:56.359631+0000","last_change":"2024-09-13T15:16:56.359631+0000","last_active":"2024-09-13T15:16:56.359631+0000","last_peered":"2024-09-13T15:16:56.359631+0000","last_clean":"2024-09-13T15:16:56.359631+0000","last_became_active":"2024-09-13T15:01:48.857542+0000","last_became_peered":"2024-09-13T15:01:48.857542+0000","last_unstale":"2024-09-13T15:16:56.359631+0000","last_undegraded":"2024-09-13T15:16:56.359631+0000","last_fullsized":"2024-09-13T15:16:56.359631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5126","last_scrub_stamp":"2024-09-13T15:16:56.359491+0000","last_deep_scrub":"33'5126","last_deep_scrub_stamp":"2024-09-13T15:16:56.359491+0000","last_clean_scrub_stamp":"2024-09-13T15:16:56.359491+0000","objects_scrubbed":0,"log_size":5126,"log_dups_size":0,"ondisk_log_size":5126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:39:55.537170+0000","scrub_duration":0.051104059,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74246,"num_write_kb":1079868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"33'12","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:02.946480+0000","last_change":"2024-09-13T15:17:02.946480+0000","last_active":"2024-09-13T15:17:02.946480+0000","last_peered":"2024-09-13T15:17:02.946480+0000","last_clean":"2024-09-13T15:17:02.946480+0000","last_became_active":"2024-09-13T15:01:44.831166+0000","last_became_peered":"2024-09-13T15:01:44.831166+0000","last_unstale":"2024-09-13T15:17:02.946480+0000","last_undegraded":"2024-09-13T15:17:02.946480+0000","last_fullsized":"2024-09-13T15:17:02.946480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T15:17:02.946228+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T15:17:02.946228+0000","last_clean_scrub_stamp":"2024-09-13T15:17:02.946228+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:50:32.392312+0000","scrub_duration":0.003277716,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"33'24","reported_seq":73,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:28.070673+0000","last_change":"2024-09-13T15:16:28.070673+0000","last_active":"2024-09-13T15:16:28.070673+0000","last_peered":"2024-09-13T15:16:28.070673+0000","last_clean":"2024-09-13T15:16:28.070673+0000","last_became_active":"2024-09-13T15:01:44.401799+0000","last_became_peered":"2024-09-13T15:01:44.401799+0000","last_unstale":"2024-09-13T15:16:28.070673+0000","last_undegraded":"2024-09-13T15:16:28.070673+0000","last_fullsized":"2024-09-13T15:16:28.070673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'24","last_scrub_stamp":"2024-09-13T15:16:28.070566+0000","last_deep_scrub":"33'24","last_deep_scrub_stamp":"2024-09-13T15:16:28.070566+0000","last_clean_scrub_stamp":"2024-09-13T15:16:28.070566+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:08:35.758129+0000","scrub_duration":0.0088310460000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":4114,"num_write":17,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"33'4768","reported_seq":4807,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:56.710326+0000","last_change":"2024-09-13T15:16:56.710326+0000","last_active":"2024-09-13T15:16:56.710326+0000","last_peered":"2024-09-13T15:16:56.710326+0000","last_clean":"2024-09-13T15:16:56.710326+0000","last_became_active":"2024-09-13T15:01:48.911474+0000","last_became_peered":"2024-09-13T15:01:48.911474+0000","last_unstale":"2024-09-13T15:16:56.710326+0000","last_undegraded":"2024-09-13T15:16:56.710326+0000","last_fullsized":"2024-09-13T15:16:56.710326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4768","last_scrub_stamp":"2024-09-13T15:16:56.709952+0000","last_deep_scrub":"33'4768","last_deep_scrub_stamp":"2024-09-13T15:16:56.709952+0000","last_clean_scrub_stamp":"2024-09-13T15:16:56.709952+0000","objects_scrubbed":0,"log_size":4768,"log_dups_size":0,"ondisk_log_size":4768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:20.071727+0000","scrub_duration":0.088888849000000006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69048,"num_write_kb":987747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"33'7","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:03.945852+0000","last_change":"2024-09-13T15:17:03.945852+0000","last_active":"2024-09-13T15:17:03.945852+0000","last_peered":"2024-09-13T15:17:03.945852+0000","last_clean":"2024-09-13T15:17:03.945852+0000","last_became_active":"2024-09-13T15:01:44.817718+0000","last_became_peered":"2024-09-13T15:01:44.817718+0000","last_unstale":"2024-09-13T15:17:03.945852+0000","last_undegraded":"2024-09-13T15:17:03.945852+0000","last_fullsized":"2024-09-13T15:17:03.945852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:17:03.945606+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:17:03.945606+0000","last_clean_scrub_stamp":"2024-09-13T15:17:03.945606+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:58.674997+0000","scrub_duration":0.0033964189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"33'19","reported_seq":64,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.950983+0000","last_change":"2024-09-13T15:16:21.104702+0000","last_active":"2024-09-13T15:16:23.950983+0000","last_peered":"2024-09-13T15:16:23.950983+0000","last_clean":"2024-09-13T15:16:23.950983+0000","last_became_active":"2024-09-13T15:01:44.409585+0000","last_became_peered":"2024-09-13T15:01:44.409585+0000","last_unstale":"2024-09-13T15:16:23.950983+0000","last_undegraded":"2024-09-13T15:16:23.950983+0000","last_fullsized":"2024-09-13T15:16:23.950983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T15:16:21.104582+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T15:16:21.104582+0000","last_clean_scrub_stamp":"2024-09-13T15:16:21.104582+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:29.612823+0000","scrub_duration":0.054426386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4099,"num_write":13,"num_write_kb":4102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"33'5322","reported_seq":5361,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:50.421188+0000","last_change":"2024-09-13T15:16:50.421188+0000","last_active":"2024-09-13T15:16:50.421188+0000","last_peered":"2024-09-13T15:16:50.421188+0000","last_clean":"2024-09-13T15:16:50.421188+0000","last_became_active":"2024-09-13T15:01:48.860317+0000","last_became_peered":"2024-09-13T15:01:48.860317+0000","last_unstale":"2024-09-13T15:16:50.421188+0000","last_undegraded":"2024-09-13T15:16:50.421188+0000","last_fullsized":"2024-09-13T15:16:50.421188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5322","last_scrub_stamp":"2024-09-13T15:16:50.420854+0000","last_deep_scrub":"33'5322","last_deep_scrub_stamp":"2024-09-13T15:16:50.420854+0000","last_clean_scrub_stamp":"2024-09-13T15:16:50.420854+0000","objects_scrubbed":0,"log_size":5322,"log_dups_size":0,"ondisk_log_size":5322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:27:27.164571+0000","scrub_duration":0.069188280000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77566,"num_write_kb":1107255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"33'7","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:05.936709+0000","last_change":"2024-09-13T15:17:05.936930+0000","last_active":"2024-09-13T15:17:05.936709+0000","last_peered":"2024-09-13T15:17:05.936709+0000","last_clean":"2024-09-13T15:17:05.936709+0000","last_became_active":"2024-09-13T15:01:44.831150+0000","last_became_peered":"2024-09-13T15:01:44.831150+0000","last_unstale":"2024-09-13T15:17:05.936709+0000","last_undegraded":"2024-09-13T15:17:05.936709+0000","last_fullsized":"2024-09-13T15:17:05.936709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:17:05.936657+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:17:05.936657+0000","last_clean_scrub_stamp":"2024-09-13T15:17:05.936657+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:06.321071+0000","scrub_duration":0.0030559329999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"33'37","reported_seq":90,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.090066+0000","last_change":"2024-09-13T15:16:23.110015+0000","last_active":"2024-09-13T15:16:24.090066+0000","last_peered":"2024-09-13T15:16:24.090066+0000","last_clean":"2024-09-13T15:16:24.090066+0000","last_became_active":"2024-09-13T15:01:44.389946+0000","last_became_peered":"2024-09-13T15:01:44.389946+0000","last_unstale":"2024-09-13T15:16:24.090066+0000","last_undegraded":"2024-09-13T15:16:24.090066+0000","last_fullsized":"2024-09-13T15:16:24.090066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'31","last_scrub_stamp":"2024-09-13T15:16:23.109915+0000","last_deep_scrub":"33'31","last_deep_scrub_stamp":"2024-09-13T15:16:23.109915+0000","last_clean_scrub_stamp":"2024-09-13T15:16:23.109915+0000","objects_scrubbed":9,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:49.142729+0000","scrub_duration":0.0066126249999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":23,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9630,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"33'4126","reported_seq":4164,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:58.334577+0000","last_change":"2024-09-13T15:16:58.334773+0000","last_active":"2024-09-13T15:16:58.334577+0000","last_peered":"2024-09-13T15:16:58.334577+0000","last_clean":"2024-09-13T15:16:58.334577+0000","last_became_active":"2024-09-13T15:01:48.847605+0000","last_became_peered":"2024-09-13T15:01:48.847605+0000","last_unstale":"2024-09-13T15:16:58.334577+0000","last_undegraded":"2024-09-13T15:16:58.334577+0000","last_fullsized":"2024-09-13T15:16:58.334577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4126","last_scrub_stamp":"2024-09-13T15:16:58.334532+0000","last_deep_scrub":"33'4126","last_deep_scrub_stamp":"2024-09-13T15:16:58.334532+0000","last_clean_scrub_stamp":"2024-09-13T15:16:58.334532+0000","objects_scrubbed":0,"log_size":4126,"log_dups_size":0,"ondisk_log_size":4126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:15:05.258006+0000","scrub_duration":0.047342742,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":59577,"num_write_kb":873580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:40.892263+0000","last_change":"2024-09-13T15:16:40.892463+0000","last_active":"2024-09-13T15:16:40.892263+0000","last_peered":"2024-09-13T15:16:40.892263+0000","last_clean":"2024-09-13T15:16:40.892263+0000","last_became_active":"2024-09-13T15:01:44.808140+0000","last_became_peered":"2024-09-13T15:01:44.808140+0000","last_unstale":"2024-09-13T15:16:40.892263+0000","last_undegraded":"2024-09-13T15:16:40.892263+0000","last_fullsized":"2024-09-13T15:16:40.892263+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:40.892207+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:40.892207+0000","last_clean_scrub_stamp":"2024-09-13T15:16:40.892207+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:10.273365+0000","scrub_duration":0.0030575229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"33'14","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:31.855992+0000","last_change":"2024-09-13T15:16:31.856223+0000","last_active":"2024-09-13T15:16:31.855992+0000","last_peered":"2024-09-13T15:16:31.855992+0000","last_clean":"2024-09-13T15:16:31.855992+0000","last_became_active":"2024-09-13T15:01:44.428271+0000","last_became_peered":"2024-09-13T15:01:44.428271+0000","last_unstale":"2024-09-13T15:16:31.855992+0000","last_undegraded":"2024-09-13T15:16:31.855992+0000","last_fullsized":"2024-09-13T15:16:31.855992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:31.855936+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:31.855936+0000","last_clean_scrub_stamp":"2024-09-13T15:16:31.855936+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:54.569226+0000","scrub_duration":0.0071886169999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"33'4957","reported_seq":4995,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:58.849246+0000","last_change":"2024-09-13T15:16:58.849437+0000","last_active":"2024-09-13T15:16:58.849246+0000","last_peered":"2024-09-13T15:16:58.849246+0000","last_clean":"2024-09-13T15:16:58.849246+0000","last_became_active":"2024-09-13T15:01:48.916008+0000","last_became_peered":"2024-09-13T15:01:48.916008+0000","last_unstale":"2024-09-13T15:16:58.849246+0000","last_undegraded":"2024-09-13T15:16:58.849246+0000","last_fullsized":"2024-09-13T15:16:58.849246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4957","last_scrub_stamp":"2024-09-13T15:16:58.849204+0000","last_deep_scrub":"33'4957","last_deep_scrub_stamp":"2024-09-13T15:16:58.849204+0000","last_clean_scrub_stamp":"2024-09-13T15:16:58.849204+0000","objects_scrubbed":0,"log_size":4957,"log_dups_size":0,"ondisk_log_size":4957,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:09:04.395536+0000","scrub_duration":0.054487189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":72374,"num_write_kb":1020409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"33'20","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.700019+0000","last_change":"2024-09-13T15:16:24.700227+0000","last_active":"2024-09-13T15:16:24.700019+0000","last_peered":"2024-09-13T15:16:24.700019+0000","last_clean":"2024-09-13T15:16:24.700019+0000","last_became_active":"2024-09-13T15:01:44.825996+0000","last_became_peered":"2024-09-13T15:01:44.825996+0000","last_unstale":"2024-09-13T15:16:24.700019+0000","last_undegraded":"2024-09-13T15:16:24.700019+0000","last_fullsized":"2024-09-13T15:16:24.700019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-13T15:16:24.699962+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-13T15:16:24.699962+0000","last_clean_scrub_stamp":"2024-09-13T15:16:24.699962+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:57.006772+0000","scrub_duration":0.003063091,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"33'11","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:30.633435+0000","last_change":"2024-09-13T15:16:30.633635+0000","last_active":"2024-09-13T15:16:30.633435+0000","last_peered":"2024-09-13T15:16:30.633435+0000","last_clean":"2024-09-13T15:16:30.633435+0000","last_became_active":"2024-09-13T15:01:44.408644+0000","last_became_peered":"2024-09-13T15:01:44.408644+0000","last_unstale":"2024-09-13T15:16:30.633435+0000","last_undegraded":"2024-09-13T15:16:30.633435+0000","last_fullsized":"2024-09-13T15:16:30.633435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:30.633381+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:30.633381+0000","last_clean_scrub_stamp":"2024-09-13T15:16:30.633381+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:54:48.589150+0000","scrub_duration":0.005668729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'4735","reported_seq":4773,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:59.827420+0000","last_change":"2024-09-13T15:16:59.827539+0000","last_active":"2024-09-13T15:16:59.827420+0000","last_peered":"2024-09-13T15:16:59.827420+0000","last_clean":"2024-09-13T15:16:59.827420+0000","last_became_active":"2024-09-13T15:01:48.916198+0000","last_became_peered":"2024-09-13T15:01:48.916198+0000","last_unstale":"2024-09-13T15:16:59.827420+0000","last_undegraded":"2024-09-13T15:16:59.827420+0000","last_fullsized":"2024-09-13T15:16:59.827420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4735","last_scrub_stamp":"2024-09-13T15:16:59.827399+0000","last_deep_scrub":"33'4735","last_deep_scrub_stamp":"2024-09-13T15:16:59.827399+0000","last_clean_scrub_stamp":"2024-09-13T15:16:59.827399+0000","objects_scrubbed":0,"log_size":4735,"log_dups_size":0,"ondisk_log_size":4735,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:59.155793+0000","scrub_duration":0.046810262999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68970,"num_write_kb":974417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.305261+0000","last_change":"2024-09-13T15:16:34.305358+0000","last_active":"2024-09-13T15:16:34.305261+0000","last_peered":"2024-09-13T15:16:34.305261+0000","last_clean":"2024-09-13T15:16:34.305261+0000","last_became_active":"2024-09-13T15:01:44.831583+0000","last_became_peered":"2024-09-13T15:01:44.831583+0000","last_unstale":"2024-09-13T15:16:34.305261+0000","last_undegraded":"2024-09-13T15:16:34.305261+0000","last_fullsized":"2024-09-13T15:16:34.305261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:34.305240+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:34.305240+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.305240+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:40.060577+0000","scrub_duration":0.0020742930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"33'41","reported_seq":95,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.078546+0000","last_change":"2024-09-13T15:16:20.445448+0000","last_active":"2024-09-13T15:16:24.078546+0000","last_peered":"2024-09-13T15:16:24.078546+0000","last_clean":"2024-09-13T15:16:24.078546+0000","last_became_active":"2024-09-13T15:01:44.408453+0000","last_became_peered":"2024-09-13T15:01:44.408453+0000","last_unstale":"2024-09-13T15:16:24.078546+0000","last_undegraded":"2024-09-13T15:16:24.078546+0000","last_fullsized":"2024-09-13T15:16:24.078546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'38","last_scrub_stamp":"2024-09-13T15:16:20.444690+0000","last_deep_scrub":"33'38","last_deep_scrub_stamp":"2024-09-13T15:16:20.444690+0000","last_clean_scrub_stamp":"2024-09-13T15:16:20.444690+0000","objects_scrubbed":8,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:18.099238+0000","scrub_duration":0.086113890999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":8225,"num_write":32,"num_write_kb":8211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"33'5131","reported_seq":5169,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:57.718333+0000","last_change":"2024-09-13T15:16:57.718567+0000","last_active":"2024-09-13T15:16:57.718333+0000","last_peered":"2024-09-13T15:16:57.718333+0000","last_clean":"2024-09-13T15:16:57.718333+0000","last_became_active":"2024-09-13T15:01:48.916185+0000","last_became_peered":"2024-09-13T15:01:48.916185+0000","last_unstale":"2024-09-13T15:16:57.718333+0000","last_undegraded":"2024-09-13T15:16:57.718333+0000","last_fullsized":"2024-09-13T15:16:57.718333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5131","last_scrub_stamp":"2024-09-13T15:16:57.718290+0000","last_deep_scrub":"33'5131","last_deep_scrub_stamp":"2024-09-13T15:16:57.718290+0000","last_clean_scrub_stamp":"2024-09-13T15:16:57.718290+0000","objects_scrubbed":0,"log_size":5131,"log_dups_size":0,"ondisk_log_size":5131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:31:48.355046+0000","scrub_duration":0.072062320999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":74464,"num_write_kb":1089564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"33'7","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:01.914919+0000","last_change":"2024-09-13T15:17:01.915166+0000","last_active":"2024-09-13T15:17:01.914919+0000","last_peered":"2024-09-13T15:17:01.914919+0000","last_clean":"2024-09-13T15:17:01.914919+0000","last_became_active":"2024-09-13T15:01:44.815435+0000","last_became_peered":"2024-09-13T15:01:44.815435+0000","last_unstale":"2024-09-13T15:17:01.914919+0000","last_undegraded":"2024-09-13T15:17:01.914919+0000","last_fullsized":"2024-09-13T15:17:01.914919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:17:01.914861+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:17:01.914861+0000","last_clean_scrub_stamp":"2024-09-13T15:17:01.914861+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:17:45.853767+0000","scrub_duration":0.0024798210000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"33'583","reported_seq":636,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:29.820102+0000","last_change":"2024-09-13T15:16:29.820334+0000","last_active":"2024-09-13T15:16:29.820102+0000","last_peered":"2024-09-13T15:16:29.820102+0000","last_clean":"2024-09-13T15:16:29.820102+0000","last_became_active":"2024-09-13T15:01:44.435222+0000","last_became_peered":"2024-09-13T15:01:44.435222+0000","last_unstale":"2024-09-13T15:16:29.820102+0000","last_undegraded":"2024-09-13T15:16:29.820102+0000","last_fullsized":"2024-09-13T15:16:29.820102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'583","last_scrub_stamp":"2024-09-13T15:16:29.820047+0000","last_deep_scrub":"33'583","last_deep_scrub_stamp":"2024-09-13T15:16:29.820047+0000","last_clean_scrub_stamp":"2024-09-13T15:16:29.820047+0000","objects_scrubbed":7,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:27:24.758478+0000","scrub_duration":0.044190934000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8159583,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":7965,"num_write":571,"num_write_kb":8183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"33'4464","reported_seq":4502,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:43.348361+0000","last_change":"2024-09-13T15:16:43.348487+0000","last_active":"2024-09-13T15:16:43.348361+0000","last_peered":"2024-09-13T15:16:43.348361+0000","last_clean":"2024-09-13T15:16:43.348361+0000","last_became_active":"2024-09-13T15:01:48.846835+0000","last_became_peered":"2024-09-13T15:01:48.846835+0000","last_unstale":"2024-09-13T15:16:43.348361+0000","last_undegraded":"2024-09-13T15:16:43.348361+0000","last_fullsized":"2024-09-13T15:16:43.348361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4464","last_scrub_stamp":"2024-09-13T15:16:43.348342+0000","last_deep_scrub":"33'4464","last_deep_scrub_stamp":"2024-09-13T15:16:43.348342+0000","last_clean_scrub_stamp":"2024-09-13T15:16:43.348342+0000","objects_scrubbed":0,"log_size":4464,"log_dups_size":0,"ondisk_log_size":4464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:38.060347+0000","scrub_duration":0.041296739999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":65013,"num_write_kb":924599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.140565+0000","last_change":"2024-09-13T15:16:23.083422+0000","last_active":"2024-09-13T15:16:24.140565+0000","last_peered":"2024-09-13T15:16:24.140565+0000","last_clean":"2024-09-13T15:16:24.140565+0000","last_became_active":"2024-09-13T15:01:44.834643+0000","last_became_peered":"2024-09-13T15:01:44.834643+0000","last_unstale":"2024-09-13T15:16:24.140565+0000","last_undegraded":"2024-09-13T15:16:24.140565+0000","last_fullsized":"2024-09-13T15:16:24.140565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4","last_scrub_stamp":"2024-09-13T15:16:23.083116+0000","last_deep_scrub":"28'4","last_deep_scrub_stamp":"2024-09-13T15:16:23.083116+0000","last_clean_scrub_stamp":"2024-09-13T15:16:23.083116+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:43:56.932464+0000","scrub_duration":0.001347029,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"33'20","reported_seq":66,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.432148+0000","last_change":"2024-09-13T15:16:34.432220+0000","last_active":"2024-09-13T15:16:34.432148+0000","last_peered":"2024-09-13T15:16:34.432148+0000","last_clean":"2024-09-13T15:16:34.432148+0000","last_became_active":"2024-09-13T15:01:44.424714+0000","last_became_peered":"2024-09-13T15:01:44.424714+0000","last_unstale":"2024-09-13T15:16:34.432148+0000","last_undegraded":"2024-09-13T15:16:34.432148+0000","last_fullsized":"2024-09-13T15:16:34.432148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'20","last_scrub_stamp":"2024-09-13T15:16:34.432129+0000","last_deep_scrub":"33'20","last_deep_scrub_stamp":"2024-09-13T15:16:34.432129+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.432129+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:57:01.436564+0000","scrub_duration":0.0064639520000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":11,"num_read_kb":15,"num_write":18,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'4809","reported_seq":4857,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:56.556835+0000","last_change":"2024-09-13T15:16:56.557113+0000","last_active":"2024-09-13T15:16:56.556835+0000","last_peered":"2024-09-13T15:16:56.556835+0000","last_clean":"2024-09-13T15:16:56.556835+0000","last_became_active":"2024-09-13T15:02:33.752505+0000","last_became_peered":"2024-09-13T15:02:33.752505+0000","last_unstale":"2024-09-13T15:16:56.556835+0000","last_undegraded":"2024-09-13T15:16:56.556835+0000","last_fullsized":"2024-09-13T15:16:56.556835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4809","last_scrub_stamp":"2024-09-13T15:16:56.556771+0000","last_deep_scrub":"33'4809","last_deep_scrub_stamp":"2024-09-13T15:16:56.556771+0000","last_clean_scrub_stamp":"2024-09-13T15:16:56.556771+0000","objects_scrubbed":0,"log_size":4809,"log_dups_size":0,"ondisk_log_size":4809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:23:34.746748+0000","scrub_duration":0.082653001000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":69744,"num_write_kb":999376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,2],"acting":[4,5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"33'11","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:44.289532+0000","last_change":"2024-09-13T15:16:44.289614+0000","last_active":"2024-09-13T15:16:44.289532+0000","last_peered":"2024-09-13T15:16:44.289532+0000","last_clean":"2024-09-13T15:16:44.289532+0000","last_became_active":"2024-09-13T15:01:44.836750+0000","last_became_peered":"2024-09-13T15:01:44.836750+0000","last_unstale":"2024-09-13T15:16:44.289532+0000","last_undegraded":"2024-09-13T15:16:44.289532+0000","last_fullsized":"2024-09-13T15:16:44.289532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:44.289512+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:44.289512+0000","last_clean_scrub_stamp":"2024-09-13T15:16:44.289512+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:01:49.109457+0000","scrub_duration":0.0024700170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"33'14","reported_seq":61,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:31.641077+0000","last_change":"2024-09-13T15:16:31.641324+0000","last_active":"2024-09-13T15:16:31.641077+0000","last_peered":"2024-09-13T15:16:31.641077+0000","last_clean":"2024-09-13T15:16:31.641077+0000","last_became_active":"2024-09-13T15:01:44.437433+0000","last_became_peered":"2024-09-13T15:01:44.437433+0000","last_unstale":"2024-09-13T15:16:31.641077+0000","last_undegraded":"2024-09-13T15:16:31.641077+0000","last_fullsized":"2024-09-13T15:16:31.641077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:31.641025+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:31.641025+0000","last_clean_scrub_stamp":"2024-09-13T15:16:31.641025+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:08.039896+0000","scrub_duration":0.0069456680000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":18,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"33'4904","reported_seq":4942,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:54.936692+0000","last_change":"2024-09-13T15:16:54.936843+0000","last_active":"2024-09-13T15:16:54.936692+0000","last_peered":"2024-09-13T15:16:54.936692+0000","last_clean":"2024-09-13T15:16:54.936692+0000","last_became_active":"2024-09-13T15:01:48.841267+0000","last_became_peered":"2024-09-13T15:01:48.841267+0000","last_unstale":"2024-09-13T15:16:54.936692+0000","last_undegraded":"2024-09-13T15:16:54.936692+0000","last_fullsized":"2024-09-13T15:16:54.936692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4904","last_scrub_stamp":"2024-09-13T15:16:54.936672+0000","last_deep_scrub":"33'4904","last_deep_scrub_stamp":"2024-09-13T15:16:54.936672+0000","last_clean_scrub_stamp":"2024-09-13T15:16:54.936672+0000","objects_scrubbed":0,"log_size":4904,"log_dups_size":0,"ondisk_log_size":4904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:41:54.982378+0000","scrub_duration":0.053950104999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71251,"num_write_kb":1004130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"33'8","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:42.644422+0000","last_change":"2024-09-13T15:16:42.644621+0000","last_active":"2024-09-13T15:16:42.644422+0000","last_peered":"2024-09-13T15:16:42.644422+0000","last_clean":"2024-09-13T15:16:42.644422+0000","last_became_active":"2024-09-13T15:01:44.843982+0000","last_became_peered":"2024-09-13T15:01:44.843982+0000","last_unstale":"2024-09-13T15:16:42.644422+0000","last_undegraded":"2024-09-13T15:16:42.644422+0000","last_fullsized":"2024-09-13T15:16:42.644422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:42.644367+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:42.644367+0000","last_clean_scrub_stamp":"2024-09-13T15:16:42.644367+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:45:45.557277+0000","scrub_duration":0.003222496,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"33'18","reported_seq":63,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:32.864296+0000","last_change":"2024-09-13T15:16:32.864508+0000","last_active":"2024-09-13T15:16:32.864296+0000","last_peered":"2024-09-13T15:16:32.864296+0000","last_clean":"2024-09-13T15:16:32.864296+0000","last_became_active":"2024-09-13T15:01:44.435367+0000","last_became_peered":"2024-09-13T15:01:44.435367+0000","last_unstale":"2024-09-13T15:16:32.864296+0000","last_undegraded":"2024-09-13T15:16:32.864296+0000","last_fullsized":"2024-09-13T15:16:32.864296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'18","last_scrub_stamp":"2024-09-13T15:16:32.864235+0000","last_deep_scrub":"33'18","last_deep_scrub_stamp":"2024-09-13T15:16:32.864235+0000","last_clean_scrub_stamp":"2024-09-13T15:16:32.864235+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:46:20.427017+0000","scrub_duration":0.0072294949999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"33'3940","reported_seq":3978,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:57.850695+0000","last_change":"2024-09-13T15:16:57.850836+0000","last_active":"2024-09-13T15:16:57.850695+0000","last_peered":"2024-09-13T15:16:57.850695+0000","last_clean":"2024-09-13T15:16:57.850695+0000","last_became_active":"2024-09-13T15:01:48.909681+0000","last_became_peered":"2024-09-13T15:01:48.909681+0000","last_unstale":"2024-09-13T15:16:57.850695+0000","last_undegraded":"2024-09-13T15:16:57.850695+0000","last_fullsized":"2024-09-13T15:16:57.850695+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3940","last_scrub_stamp":"2024-09-13T15:16:57.850672+0000","last_deep_scrub":"33'3940","last_deep_scrub_stamp":"2024-09-13T15:16:57.850672+0000","last_clean_scrub_stamp":"2024-09-13T15:16:57.850672+0000","objects_scrubbed":0,"log_size":3940,"log_dups_size":0,"ondisk_log_size":3940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:26.658522+0000","scrub_duration":0.046163484999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57394,"num_write_kb":843085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"33'3678","reported_seq":3727,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:01.354778+0000","last_change":"2024-09-13T15:17:01.354892+0000","last_active":"2024-09-13T15:17:01.354778+0000","last_peered":"2024-09-13T15:17:01.354778+0000","last_clean":"2024-09-13T15:17:01.354778+0000","last_became_active":"2024-09-13T15:02:34.118477+0000","last_became_peered":"2024-09-13T15:02:34.118477+0000","last_unstale":"2024-09-13T15:17:01.354778+0000","last_undegraded":"2024-09-13T15:17:01.354778+0000","last_fullsized":"2024-09-13T15:17:01.354778+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3678","last_scrub_stamp":"2024-09-13T15:17:01.354757+0000","last_deep_scrub":"33'3678","last_deep_scrub_stamp":"2024-09-13T15:17:01.354757+0000","last_clean_scrub_stamp":"2024-09-13T15:17:01.354757+0000","objects_scrubbed":0,"log_size":3678,"log_dups_size":0,"ondisk_log_size":3678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:08:15.395588+0000","scrub_duration":0.041383452000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53439,"num_write_kb":757724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,2],"acting":[0,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"33'11","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:41.369001+0000","last_change":"2024-09-13T15:16:41.369073+0000","last_active":"2024-09-13T15:16:41.369001+0000","last_peered":"2024-09-13T15:16:41.369001+0000","last_clean":"2024-09-13T15:16:41.369001+0000","last_became_active":"2024-09-13T15:01:44.807641+0000","last_became_peered":"2024-09-13T15:01:44.807641+0000","last_unstale":"2024-09-13T15:16:41.369001+0000","last_undegraded":"2024-09-13T15:16:41.369001+0000","last_fullsized":"2024-09-13T15:16:41.369001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:41.368984+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:41.368984+0000","last_clean_scrub_stamp":"2024-09-13T15:16:41.368984+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:01:10.060267+0000","scrub_duration":0.0013486590000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"33'38","reported_seq":82,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:25.574908+0000","last_change":"2024-09-13T15:16:25.575105+0000","last_active":"2024-09-13T15:16:25.574908+0000","last_peered":"2024-09-13T15:16:25.574908+0000","last_clean":"2024-09-13T15:16:25.574908+0000","last_became_active":"2024-09-13T15:01:44.433124+0000","last_became_peered":"2024-09-13T15:01:44.433124+0000","last_unstale":"2024-09-13T15:16:25.574908+0000","last_undegraded":"2024-09-13T15:16:25.574908+0000","last_fullsized":"2024-09-13T15:16:25.574908+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'38","last_scrub_stamp":"2024-09-13T15:16:25.574855+0000","last_deep_scrub":"33'38","last_deep_scrub_stamp":"2024-09-13T15:16:25.574855+0000","last_clean_scrub_stamp":"2024-09-13T15:16:25.574855+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:05:45.303091+0000","scrub_duration":0.033176627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":8193,"num_write":27,"num_write_kb":8205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4928","reported_seq":4967,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:04.912527+0000","last_change":"2024-09-13T15:17:04.912790+0000","last_active":"2024-09-13T15:17:04.912527+0000","last_peered":"2024-09-13T15:17:04.912527+0000","last_clean":"2024-09-13T15:17:04.912527+0000","last_became_active":"2024-09-13T15:01:48.852925+0000","last_became_peered":"2024-09-13T15:01:48.852925+0000","last_unstale":"2024-09-13T15:17:04.912527+0000","last_undegraded":"2024-09-13T15:17:04.912527+0000","last_fullsized":"2024-09-13T15:17:04.912527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4928","last_scrub_stamp":"2024-09-13T15:17:04.912471+0000","last_deep_scrub":"33'4928","last_deep_scrub_stamp":"2024-09-13T15:17:04.912471+0000","last_clean_scrub_stamp":"2024-09-13T15:17:04.912471+0000","objects_scrubbed":0,"log_size":4928,"log_dups_size":0,"ondisk_log_size":4928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:09.742976+0000","scrub_duration":0.082938472999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":71646,"num_write_kb":1060070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"33'13","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:56.238735+0000","last_change":"2024-09-13T15:16:56.238735+0000","last_active":"2024-09-13T15:16:56.238735+0000","last_peered":"2024-09-13T15:16:56.238735+0000","last_clean":"2024-09-13T15:16:56.238735+0000","last_became_active":"2024-09-13T15:02:33.746005+0000","last_became_peered":"2024-09-13T15:02:33.746005+0000","last_unstale":"2024-09-13T15:16:56.238735+0000","last_undegraded":"2024-09-13T15:16:56.238735+0000","last_fullsized":"2024-09-13T15:16:56.238735+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T15:16:56.238642+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T15:16:56.238642+0000","last_clean_scrub_stamp":"2024-09-13T15:16:56.238642+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:49.877447+0000","scrub_duration":0.0013265359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.19","version":"33'11","reported_seq":56,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:33.955676+0000","last_change":"2024-09-13T15:16:33.955756+0000","last_active":"2024-09-13T15:16:33.955676+0000","last_peered":"2024-09-13T15:16:33.955676+0000","last_clean":"2024-09-13T15:16:33.955676+0000","last_became_active":"2024-09-13T15:01:44.436646+0000","last_became_peered":"2024-09-13T15:01:44.436646+0000","last_unstale":"2024-09-13T15:16:33.955676+0000","last_undegraded":"2024-09-13T15:16:33.955676+0000","last_fullsized":"2024-09-13T15:16:33.955676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:33.955656+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:33.955656+0000","last_clean_scrub_stamp":"2024-09-13T15:16:33.955656+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:33:59.640305+0000","scrub_duration":0.0059488070000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":27,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"33'53","reported_seq":102,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.923151+0000","last_change":"2024-09-13T15:16:34.923151+0000","last_active":"2024-09-13T15:16:34.923151+0000","last_peered":"2024-09-13T15:16:34.923151+0000","last_clean":"2024-09-13T15:16:34.923151+0000","last_became_active":"2024-09-13T15:01:44.429339+0000","last_became_peered":"2024-09-13T15:01:44.429339+0000","last_unstale":"2024-09-13T15:16:34.923151+0000","last_undegraded":"2024-09-13T15:16:34.923151+0000","last_fullsized":"2024-09-13T15:16:34.923151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'53","last_scrub_stamp":"2024-09-13T15:16:34.922888+0000","last_deep_scrub":"33'53","last_deep_scrub_stamp":"2024-09-13T15:16:34.922888+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.922888+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:24.468558+0000","scrub_duration":0.034548224000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":8210,"num_write":46,"num_write_kb":8210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:33.344530+0000","last_change":"2024-09-13T15:16:33.344530+0000","last_active":"2024-09-13T15:16:33.344530+0000","last_peered":"2024-09-13T15:16:33.344530+0000","last_clean":"2024-09-13T15:16:33.344530+0000","last_became_active":"2024-09-13T15:01:44.821734+0000","last_became_peered":"2024-09-13T15:01:44.821734+0000","last_unstale":"2024-09-13T15:16:33.344530+0000","last_undegraded":"2024-09-13T15:16:33.344530+0000","last_fullsized":"2024-09-13T15:16:33.344530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:33.344436+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:33.344436+0000","last_clean_scrub_stamp":"2024-09-13T15:16:33.344436+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:19:18.534801+0000","scrub_duration":0.0023763030000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"33'4710","reported_seq":4748,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:35.170988+0000","last_change":"2024-09-13T15:16:35.170988+0000","last_active":"2024-09-13T15:16:35.170988+0000","last_peered":"2024-09-13T15:16:35.170988+0000","last_clean":"2024-09-13T15:16:35.170988+0000","last_became_active":"2024-09-13T15:01:48.857584+0000","last_became_peered":"2024-09-13T15:01:48.857584+0000","last_unstale":"2024-09-13T15:16:35.170988+0000","last_undegraded":"2024-09-13T15:16:35.170988+0000","last_fullsized":"2024-09-13T15:16:35.170988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4710","last_scrub_stamp":"2024-09-13T15:16:35.170829+0000","last_deep_scrub":"33'4710","last_deep_scrub_stamp":"2024-09-13T15:16:35.170829+0000","last_clean_scrub_stamp":"2024-09-13T15:16:35.170829+0000","objects_scrubbed":0,"log_size":4710,"log_dups_size":0,"ondisk_log_size":4710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:06:45.991405+0000","scrub_duration":0.042675653000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68679,"num_write_kb":960930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"33'1786","reported_seq":1830,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:31.928330+0000","last_change":"2024-09-13T15:16:31.928330+0000","last_active":"2024-09-13T15:16:31.928330+0000","last_peered":"2024-09-13T15:16:31.928330+0000","last_clean":"2024-09-13T15:16:31.928330+0000","last_became_active":"2024-09-13T15:01:44.422367+0000","last_became_peered":"2024-09-13T15:01:44.422367+0000","last_unstale":"2024-09-13T15:16:31.928330+0000","last_undegraded":"2024-09-13T15:16:31.928330+0000","last_fullsized":"2024-09-13T15:16:31.928330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'1786","last_scrub_stamp":"2024-09-13T15:16:31.928065+0000","last_deep_scrub":"33'1786","last_deep_scrub_stamp":"2024-09-13T15:16:31.928065+0000","last_clean_scrub_stamp":"2024-09-13T15:16:31.928065+0000","objects_scrubbed":3,"log_size":1786,"log_dups_size":0,"ondisk_log_size":1786,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:25:44.840912+0000","scrub_duration":0.023676508999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4098,"num_write":1776,"num_write_kb":4251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.230513+0000","last_change":"2024-09-13T15:16:24.080158+0000","last_active":"2024-09-13T15:16:24.230513+0000","last_peered":"2024-09-13T15:16:24.230513+0000","last_clean":"2024-09-13T15:16:24.230513+0000","last_became_active":"2024-09-13T15:01:44.816584+0000","last_became_peered":"2024-09-13T15:01:44.816584+0000","last_unstale":"2024-09-13T15:16:24.230513+0000","last_undegraded":"2024-09-13T15:16:24.230513+0000","last_fullsized":"2024-09-13T15:16:24.230513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'7","last_scrub_stamp":"2024-09-13T15:16:24.080065+0000","last_deep_scrub":"33'7","last_deep_scrub_stamp":"2024-09-13T15:16:24.080065+0000","last_clean_scrub_stamp":"2024-09-13T15:16:24.080065+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:23:18.277593+0000","scrub_duration":0.0033993309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'4724","reported_seq":4762,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:01.824558+0000","last_change":"2024-09-13T15:17:01.824694+0000","last_active":"2024-09-13T15:17:01.824558+0000","last_peered":"2024-09-13T15:17:01.824558+0000","last_clean":"2024-09-13T15:17:01.824558+0000","last_became_active":"2024-09-13T15:01:48.840397+0000","last_became_peered":"2024-09-13T15:01:48.840397+0000","last_unstale":"2024-09-13T15:17:01.824558+0000","last_undegraded":"2024-09-13T15:17:01.824558+0000","last_fullsized":"2024-09-13T15:17:01.824558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4724","last_scrub_stamp":"2024-09-13T15:17:01.824537+0000","last_deep_scrub":"33'4724","last_deep_scrub_stamp":"2024-09-13T15:17:01.824537+0000","last_clean_scrub_stamp":"2024-09-13T15:17:01.824537+0000","objects_scrubbed":0,"log_size":4724,"log_dups_size":0,"ondisk_log_size":4724,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:29:37.014863+0000","scrub_duration":0.036114977999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":68744,"num_write_kb":983871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"33'14","reported_seq":55,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:56.883362+0000","last_change":"2024-09-13T15:16:56.883575+0000","last_active":"2024-09-13T15:16:56.883362+0000","last_peered":"2024-09-13T15:16:56.883362+0000","last_clean":"2024-09-13T15:16:56.883362+0000","last_became_active":"2024-09-13T15:01:44.808669+0000","last_became_peered":"2024-09-13T15:01:44.808669+0000","last_unstale":"2024-09-13T15:16:56.883362+0000","last_undegraded":"2024-09-13T15:16:56.883362+0000","last_fullsized":"2024-09-13T15:16:56.883362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:56.883310+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:56.883310+0000","last_clean_scrub_stamp":"2024-09-13T15:16:56.883310+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:25:50.733643+0000","scrub_duration":0.0027636959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"33'13","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:31.136709+0000","last_change":"2024-09-13T15:16:31.136790+0000","last_active":"2024-09-13T15:16:31.136709+0000","last_peered":"2024-09-13T15:16:31.136709+0000","last_clean":"2024-09-13T15:16:31.136709+0000","last_became_active":"2024-09-13T15:01:44.836102+0000","last_became_peered":"2024-09-13T15:01:44.836102+0000","last_unstale":"2024-09-13T15:16:31.136709+0000","last_undegraded":"2024-09-13T15:16:31.136709+0000","last_fullsized":"2024-09-13T15:16:31.136709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'13","last_scrub_stamp":"2024-09-13T15:16:31.136690+0000","last_deep_scrub":"33'13","last_deep_scrub_stamp":"2024-09-13T15:16:31.136690+0000","last_clean_scrub_stamp":"2024-09-13T15:16:31.136690+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:55.607725+0000","scrub_duration":0.0019713320000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"33'10","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:32.625887+0000","last_change":"2024-09-13T15:16:32.626112+0000","last_active":"2024-09-13T15:16:32.625887+0000","last_peered":"2024-09-13T15:16:32.625887+0000","last_clean":"2024-09-13T15:16:32.625887+0000","last_became_active":"2024-09-13T15:01:44.846506+0000","last_became_peered":"2024-09-13T15:01:44.846506+0000","last_unstale":"2024-09-13T15:16:32.625887+0000","last_undegraded":"2024-09-13T15:16:32.625887+0000","last_fullsized":"2024-09-13T15:16:32.625887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T15:16:32.625828+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T15:16:32.625828+0000","last_clean_scrub_stamp":"2024-09-13T15:16:32.625828+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:38.132404+0000","scrub_duration":0.002756784,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"33'10","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:38.251444+0000","last_change":"2024-09-13T15:16:38.251543+0000","last_active":"2024-09-13T15:16:38.251444+0000","last_peered":"2024-09-13T15:16:38.251444+0000","last_clean":"2024-09-13T15:16:38.251444+0000","last_became_active":"2024-09-13T15:01:44.809585+0000","last_became_peered":"2024-09-13T15:01:44.809585+0000","last_unstale":"2024-09-13T15:16:38.251444+0000","last_undegraded":"2024-09-13T15:16:38.251444+0000","last_fullsized":"2024-09-13T15:16:38.251444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T15:16:38.251426+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T15:16:38.251426+0000","last_clean_scrub_stamp":"2024-09-13T15:16:38.251426+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T17:13:40.307246+0000","scrub_duration":0.0015167939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"33'4","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:40.948205+0000","last_change":"2024-09-13T15:16:40.948205+0000","last_active":"2024-09-13T15:16:40.948205+0000","last_peered":"2024-09-13T15:16:40.948205+0000","last_clean":"2024-09-13T15:16:40.948205+0000","last_became_active":"2024-09-13T15:01:44.816480+0000","last_became_peered":"2024-09-13T15:01:44.816480+0000","last_unstale":"2024-09-13T15:16:40.948205+0000","last_undegraded":"2024-09-13T15:16:40.948205+0000","last_fullsized":"2024-09-13T15:16:40.948205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'4","last_scrub_stamp":"2024-09-13T15:16:40.948080+0000","last_deep_scrub":"33'4","last_deep_scrub_stamp":"2024-09-13T15:16:40.948080+0000","last_clean_scrub_stamp":"2024-09-13T15:16:40.948080+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:44:09.162042+0000","scrub_duration":0.0024445700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:24.177350+0000","last_change":"2024-09-13T15:16:20.596249+0000","last_active":"2024-09-13T15:16:24.177350+0000","last_peered":"2024-09-13T15:16:24.177350+0000","last_clean":"2024-09-13T15:16:24.177350+0000","last_became_active":"2024-09-13T15:01:44.807622+0000","last_became_peered":"2024-09-13T15:01:44.807622+0000","last_unstale":"2024-09-13T15:16:24.177350+0000","last_undegraded":"2024-09-13T15:16:24.177350+0000","last_fullsized":"2024-09-13T15:16:24.177350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:20.596153+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:20.596153+0000","last_clean_scrub_stamp":"2024-09-13T15:16:20.596153+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:27:28.285632+0000","scrub_duration":0.0016568729999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"33'19","reported_seq":60,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:45.892738+0000","last_change":"2024-09-13T15:16:45.892738+0000","last_active":"2024-09-13T15:16:45.892738+0000","last_peered":"2024-09-13T15:16:45.892738+0000","last_clean":"2024-09-13T15:16:45.892738+0000","last_became_active":"2024-09-13T15:01:44.831889+0000","last_became_peered":"2024-09-13T15:01:44.831889+0000","last_unstale":"2024-09-13T15:16:45.892738+0000","last_undegraded":"2024-09-13T15:16:45.892738+0000","last_fullsized":"2024-09-13T15:16:45.892738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:45.892453+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:45.892453+0000","last_clean_scrub_stamp":"2024-09-13T15:16:45.892453+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:44:35.870588+0000","scrub_duration":0.0037740270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"33'5","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.973489+0000","last_change":"2024-09-13T15:16:46.973489+0000","last_active":"2024-09-13T15:16:46.973489+0000","last_peered":"2024-09-13T15:16:46.973489+0000","last_clean":"2024-09-13T15:16:46.973489+0000","last_became_active":"2024-09-13T15:01:44.817350+0000","last_became_peered":"2024-09-13T15:01:44.817350+0000","last_unstale":"2024-09-13T15:16:46.973489+0000","last_undegraded":"2024-09-13T15:16:46.973489+0000","last_fullsized":"2024-09-13T15:16:46.973489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T15:16:46.973340+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T15:16:46.973340+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.973340+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:24.189302+0000","scrub_duration":0.0028596519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"33'10","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:34.614046+0000","last_change":"2024-09-13T15:16:34.614046+0000","last_active":"2024-09-13T15:16:34.614046+0000","last_peered":"2024-09-13T15:16:34.614046+0000","last_clean":"2024-09-13T15:16:34.614046+0000","last_became_active":"2024-09-13T15:01:44.837588+0000","last_became_peered":"2024-09-13T15:01:44.837588+0000","last_unstale":"2024-09-13T15:16:34.614046+0000","last_undegraded":"2024-09-13T15:16:34.614046+0000","last_fullsized":"2024-09-13T15:16:34.614046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T15:16:34.613780+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T15:16:34.613780+0000","last_clean_scrub_stamp":"2024-09-13T15:16:34.613780+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:41.237672+0000","scrub_duration":0.0026563189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"33'11","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:41.992681+0000","last_change":"2024-09-13T15:16:41.992681+0000","last_active":"2024-09-13T15:16:41.992681+0000","last_peered":"2024-09-13T15:16:41.992681+0000","last_clean":"2024-09-13T15:16:41.992681+0000","last_became_active":"2024-09-13T15:01:44.827910+0000","last_became_peered":"2024-09-13T15:01:44.827910+0000","last_unstale":"2024-09-13T15:16:41.992681+0000","last_undegraded":"2024-09-13T15:16:41.992681+0000","last_fullsized":"2024-09-13T15:16:41.992681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:41.992580+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:41.992580+0000","last_clean_scrub_stamp":"2024-09-13T15:16:41.992580+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:17.653254+0000","scrub_duration":0.0021428760000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"33'11","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.126418+0000","last_change":"2024-09-13T15:16:46.126559+0000","last_active":"2024-09-13T15:16:46.126418+0000","last_peered":"2024-09-13T15:16:46.126418+0000","last_clean":"2024-09-13T15:16:46.126418+0000","last_became_active":"2024-09-13T15:02:34.118621+0000","last_became_peered":"2024-09-13T15:02:34.118621+0000","last_unstale":"2024-09-13T15:16:46.126418+0000","last_undegraded":"2024-09-13T15:16:46.126418+0000","last_fullsized":"2024-09-13T15:16:46.126418+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:46.126393+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:46.126393+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.126393+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:28.249838+0000","scrub_duration":0.0026115209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"33'14","reported_seq":54,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:47.262085+0000","last_change":"2024-09-13T15:16:47.262190+0000","last_active":"2024-09-13T15:16:47.262085+0000","last_peered":"2024-09-13T15:16:47.262085+0000","last_clean":"2024-09-13T15:16:47.262085+0000","last_became_active":"2024-09-13T15:01:44.831495+0000","last_became_peered":"2024-09-13T15:01:44.831495+0000","last_unstale":"2024-09-13T15:16:47.262085+0000","last_undegraded":"2024-09-13T15:16:47.262085+0000","last_fullsized":"2024-09-13T15:16:47.262085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'14","last_scrub_stamp":"2024-09-13T15:16:47.262063+0000","last_deep_scrub":"33'14","last_deep_scrub_stamp":"2024-09-13T15:16:47.262063+0000","last_clean_scrub_stamp":"2024-09-13T15:16:47.262063+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:35.471712+0000","scrub_duration":0.0025945270000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"33'11","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:46.904991+0000","last_change":"2024-09-13T15:16:46.904991+0000","last_active":"2024-09-13T15:16:46.904991+0000","last_peered":"2024-09-13T15:16:46.904991+0000","last_clean":"2024-09-13T15:16:46.904991+0000","last_became_active":"2024-09-13T15:01:44.828999+0000","last_became_peered":"2024-09-13T15:01:44.828999+0000","last_unstale":"2024-09-13T15:16:46.904991+0000","last_undegraded":"2024-09-13T15:16:46.904991+0000","last_fullsized":"2024-09-13T15:16:46.904991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:46.904653+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:46.904653+0000","last_clean_scrub_stamp":"2024-09-13T15:16:46.904653+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:48:23.576664+0000","scrub_duration":0.0029663189999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:57.858095+0000","last_change":"2024-09-13T15:16:57.858095+0000","last_active":"2024-09-13T15:16:57.858095+0000","last_peered":"2024-09-13T15:16:57.858095+0000","last_clean":"2024-09-13T15:16:57.858095+0000","last_became_active":"2024-09-13T15:01:44.816258+0000","last_became_peered":"2024-09-13T15:01:44.816258+0000","last_unstale":"2024-09-13T15:16:57.858095+0000","last_undegraded":"2024-09-13T15:16:57.858095+0000","last_fullsized":"2024-09-13T15:16:57.858095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:57.857844+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:57.857844+0000","last_clean_scrub_stamp":"2024-09-13T15:16:57.857844+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:27.484892+0000","scrub_duration":0.0023279020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"33'19","reported_seq":59,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:29.104737+0000","last_change":"2024-09-13T15:16:29.104820+0000","last_active":"2024-09-13T15:16:29.104737+0000","last_peered":"2024-09-13T15:16:29.104737+0000","last_clean":"2024-09-13T15:16:29.104737+0000","last_became_active":"2024-09-13T15:01:44.809687+0000","last_became_peered":"2024-09-13T15:01:44.809687+0000","last_unstale":"2024-09-13T15:16:29.104737+0000","last_undegraded":"2024-09-13T15:16:29.104737+0000","last_fullsized":"2024-09-13T15:16:29.104737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'19","last_scrub_stamp":"2024-09-13T15:16:29.104716+0000","last_deep_scrub":"33'19","last_deep_scrub_stamp":"2024-09-13T15:16:29.104716+0000","last_clean_scrub_stamp":"2024-09-13T15:16:29.104716+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:42:33.959556+0000","scrub_duration":0.0023385429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"33'11","reported_seq":45,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:48.131258+0000","last_change":"2024-09-13T15:16:48.131340+0000","last_active":"2024-09-13T15:16:48.131258+0000","last_peered":"2024-09-13T15:16:48.131258+0000","last_clean":"2024-09-13T15:16:48.131258+0000","last_became_active":"2024-09-13T15:02:34.118798+0000","last_became_peered":"2024-09-13T15:02:34.118798+0000","last_unstale":"2024-09-13T15:16:48.131258+0000","last_undegraded":"2024-09-13T15:16:48.131258+0000","last_fullsized":"2024-09-13T15:16:48.131258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:48.131238+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:48.131238+0000","last_clean_scrub_stamp":"2024-09-13T15:16:48.131238+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:33.220146+0000","scrub_duration":0.002534644,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"33'11","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:51.697042+0000","last_change":"2024-09-13T15:16:51.697248+0000","last_active":"2024-09-13T15:16:51.697042+0000","last_peered":"2024-09-13T15:16:51.697042+0000","last_clean":"2024-09-13T15:16:51.697042+0000","last_became_active":"2024-09-13T15:01:44.846074+0000","last_became_peered":"2024-09-13T15:01:44.846074+0000","last_unstale":"2024-09-13T15:16:51.697042+0000","last_undegraded":"2024-09-13T15:16:51.697042+0000","last_fullsized":"2024-09-13T15:16:51.697042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:51.696990+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:51.696990+0000","last_clean_scrub_stamp":"2024-09-13T15:16:51.696990+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:22:47.001747+0000","scrub_duration":0.002759938,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"33'11","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:39.422600+0000","last_change":"2024-09-13T15:16:39.422675+0000","last_active":"2024-09-13T15:16:39.422600+0000","last_peered":"2024-09-13T15:16:39.422600+0000","last_clean":"2024-09-13T15:16:39.422600+0000","last_became_active":"2024-09-13T15:01:44.828024+0000","last_became_peered":"2024-09-13T15:01:44.828024+0000","last_unstale":"2024-09-13T15:16:39.422600+0000","last_undegraded":"2024-09-13T15:16:39.422600+0000","last_fullsized":"2024-09-13T15:16:39.422600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:39.422580+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:39.422580+0000","last_clean_scrub_stamp":"2024-09-13T15:16:39.422580+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:51:23.054857+0000","scrub_duration":0.0024637970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"33'10","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:53.196421+0000","last_change":"2024-09-13T15:16:53.196528+0000","last_active":"2024-09-13T15:16:53.196421+0000","last_peered":"2024-09-13T15:16:53.196421+0000","last_clean":"2024-09-13T15:16:53.196421+0000","last_became_active":"2024-09-13T15:01:44.808609+0000","last_became_peered":"2024-09-13T15:01:44.808609+0000","last_unstale":"2024-09-13T15:16:53.196421+0000","last_undegraded":"2024-09-13T15:16:53.196421+0000","last_fullsized":"2024-09-13T15:16:53.196421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'10","last_scrub_stamp":"2024-09-13T15:16:53.196397+0000","last_deep_scrub":"33'10","last_deep_scrub_stamp":"2024-09-13T15:16:53.196397+0000","last_clean_scrub_stamp":"2024-09-13T15:16:53.196397+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:26:32.009203+0000","scrub_duration":0.00170444,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"33'11","reported_seq":50,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:29.866264+0000","last_change":"2024-09-13T15:16:29.866373+0000","last_active":"2024-09-13T15:16:29.866264+0000","last_peered":"2024-09-13T15:16:29.866264+0000","last_clean":"2024-09-13T15:16:29.866264+0000","last_became_active":"2024-09-13T15:01:44.809918+0000","last_became_peered":"2024-09-13T15:01:44.809918+0000","last_unstale":"2024-09-13T15:16:29.866264+0000","last_undegraded":"2024-09-13T15:16:29.866264+0000","last_fullsized":"2024-09-13T15:16:29.866264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'11","last_scrub_stamp":"2024-09-13T15:16:29.866245+0000","last_deep_scrub":"33'11","last_deep_scrub_stamp":"2024-09-13T15:16:29.866245+0000","last_clean_scrub_stamp":"2024-09-13T15:16:29.866245+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T16:27:11.754182+0000","scrub_duration":0.0021947170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:30.138653+0000","last_change":"2024-09-13T15:16:30.138848+0000","last_active":"2024-09-13T15:16:30.138653+0000","last_peered":"2024-09-13T15:16:30.138653+0000","last_clean":"2024-09-13T15:16:30.138653+0000","last_became_active":"2024-09-13T15:01:44.828737+0000","last_became_peered":"2024-09-13T15:01:44.828737+0000","last_unstale":"2024-09-13T15:16:30.138653+0000","last_undegraded":"2024-09-13T15:16:30.138653+0000","last_fullsized":"2024-09-13T15:16:30.138653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:30.138598+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:30.138598+0000","last_clean_scrub_stamp":"2024-09-13T15:16:30.138598+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:12.240506+0000","scrub_duration":0.0030438290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"33'9","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:54.909482+0000","last_change":"2024-09-13T15:16:54.909891+0000","last_active":"2024-09-13T15:16:54.909482+0000","last_peered":"2024-09-13T15:16:54.909482+0000","last_clean":"2024-09-13T15:16:54.909482+0000","last_became_active":"2024-09-13T15:01:44.850410+0000","last_became_peered":"2024-09-13T15:01:44.850410+0000","last_unstale":"2024-09-13T15:16:54.909482+0000","last_undegraded":"2024-09-13T15:16:54.909482+0000","last_fullsized":"2024-09-13T15:16:54.909482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:54.909424+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:54.909424+0000","last_clean_scrub_stamp":"2024-09-13T15:16:54.909424+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T15:46:18.893400+0000","scrub_duration":0.0032718840000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"33'17","reported_seq":57,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:57.846402+0000","last_change":"2024-09-13T15:16:57.846648+0000","last_active":"2024-09-13T15:16:57.846402+0000","last_peered":"2024-09-13T15:16:57.846402+0000","last_clean":"2024-09-13T15:16:57.846402+0000","last_became_active":"2024-09-13T15:01:44.839371+0000","last_became_peered":"2024-09-13T15:01:44.839371+0000","last_unstale":"2024-09-13T15:16:57.846402+0000","last_undegraded":"2024-09-13T15:16:57.846402+0000","last_fullsized":"2024-09-13T15:16:57.846402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'17","last_scrub_stamp":"2024-09-13T15:16:57.846335+0000","last_deep_scrub":"33'17","last_deep_scrub_stamp":"2024-09-13T15:16:57.846335+0000","last_clean_scrub_stamp":"2024-09-13T15:16:57.846335+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:25.103988+0000","scrub_duration":0.0040927480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"33'12","reported_seq":51,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:10.971482+0000","last_change":"2024-09-13T15:17:10.971705+0000","last_active":"2024-09-13T15:17:10.971482+0000","last_peered":"2024-09-13T15:17:10.971482+0000","last_clean":"2024-09-13T15:17:10.971482+0000","last_became_active":"2024-09-13T15:01:44.849766+0000","last_became_peered":"2024-09-13T15:01:44.849766+0000","last_unstale":"2024-09-13T15:17:10.971482+0000","last_undegraded":"2024-09-13T15:17:10.971482+0000","last_fullsized":"2024-09-13T15:17:10.971482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T15:17:10.971428+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T15:17:10.971428+0000","last_clean_scrub_stamp":"2024-09-13T15:17:10.971428+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:02.541432+0000","scrub_duration":0.0033692150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"33'9","reported_seq":48,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:26.938178+0000","last_change":"2024-09-13T15:16:26.938178+0000","last_active":"2024-09-13T15:16:26.938178+0000","last_peered":"2024-09-13T15:16:26.938178+0000","last_clean":"2024-09-13T15:16:26.938178+0000","last_became_active":"2024-09-13T15:01:44.836770+0000","last_became_peered":"2024-09-13T15:01:44.836770+0000","last_unstale":"2024-09-13T15:16:26.938178+0000","last_undegraded":"2024-09-13T15:16:26.938178+0000","last_fullsized":"2024-09-13T15:16:26.938178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'9","last_scrub_stamp":"2024-09-13T15:16:26.938077+0000","last_deep_scrub":"33'9","last_deep_scrub_stamp":"2024-09-13T15:16:26.938077+0000","last_clean_scrub_stamp":"2024-09-13T15:16:26.938077+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:49.727468+0000","scrub_duration":0.0024780219999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"33'8","reported_seq":47,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:15.908660+0000","last_change":"2024-09-13T15:17:15.908874+0000","last_active":"2024-09-13T15:17:15.908660+0000","last_peered":"2024-09-13T15:17:15.908660+0000","last_clean":"2024-09-13T15:17:15.908660+0000","last_became_active":"2024-09-13T15:01:44.815116+0000","last_became_peered":"2024-09-13T15:01:44.815116+0000","last_unstale":"2024-09-13T15:17:15.908660+0000","last_undegraded":"2024-09-13T15:17:15.908660+0000","last_fullsized":"2024-09-13T15:17:15.908660+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:17:15.908609+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:17:15.908609+0000","last_clean_scrub_stamp":"2024-09-13T15:17:15.908609+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:38.731258+0000","scrub_duration":0.0025887140000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"33'6","reported_seq":46,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:53.715759+0000","last_change":"2024-09-13T15:16:53.715967+0000","last_active":"2024-09-13T15:16:53.715759+0000","last_peered":"2024-09-13T15:16:53.715759+0000","last_clean":"2024-09-13T15:16:53.715759+0000","last_became_active":"2024-09-13T15:01:44.849533+0000","last_became_peered":"2024-09-13T15:01:44.849533+0000","last_unstale":"2024-09-13T15:16:53.715759+0000","last_undegraded":"2024-09-13T15:16:53.715759+0000","last_fullsized":"2024-09-13T15:16:53.715759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'6","last_scrub_stamp":"2024-09-13T15:16:53.715707+0000","last_deep_scrub":"33'6","last_deep_scrub_stamp":"2024-09-13T15:16:53.715707+0000","last_clean_scrub_stamp":"2024-09-13T15:16:53.715707+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:42.062562+0000","scrub_duration":0.0033990539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"33'5","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:58.875049+0000","last_change":"2024-09-13T15:16:58.875265+0000","last_active":"2024-09-13T15:16:58.875049+0000","last_peered":"2024-09-13T15:16:58.875049+0000","last_clean":"2024-09-13T15:16:58.875049+0000","last_became_active":"2024-09-13T15:01:44.816416+0000","last_became_peered":"2024-09-13T15:01:44.816416+0000","last_unstale":"2024-09-13T15:16:58.875049+0000","last_undegraded":"2024-09-13T15:16:58.875049+0000","last_fullsized":"2024-09-13T15:16:58.875049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T15:16:58.874995+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T15:16:58.874995+0000","last_clean_scrub_stamp":"2024-09-13T15:16:58.874995+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:24:36.770217+0000","scrub_duration":0.0025367900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"33'8","reported_seq":43,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:44.144359+0000","last_change":"2024-09-13T15:16:44.144455+0000","last_active":"2024-09-13T15:16:44.144359+0000","last_peered":"2024-09-13T15:16:44.144359+0000","last_clean":"2024-09-13T15:16:44.144359+0000","last_became_active":"2024-09-13T15:02:33.747405+0000","last_became_peered":"2024-09-13T15:02:33.747405+0000","last_unstale":"2024-09-13T15:16:44.144359+0000","last_undegraded":"2024-09-13T15:16:44.144359+0000","last_fullsized":"2024-09-13T15:16:44.144359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'8","last_scrub_stamp":"2024-09-13T15:16:44.144337+0000","last_deep_scrub":"33'8","last_deep_scrub_stamp":"2024-09-13T15:16:44.144337+0000","last_clean_scrub_stamp":"2024-09-13T15:16:44.144337+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:30.857496+0000","scrub_duration":0.0014038189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"33'8","reported_seq":49,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:23.891346+0000","last_change":"2024-09-13T15:16:19.392504+0000","last_active":"2024-09-13T15:16:23.891346+0000","last_peered":"2024-09-13T15:16:23.891346+0000","last_clean":"2024-09-13T15:16:23.891346+0000","last_became_active":"2024-09-13T15:01:44.807776+0000","last_became_peered":"2024-09-13T15:01:44.807776+0000","last_unstale":"2024-09-13T15:16:23.891346+0000","last_undegraded":"2024-09-13T15:16:23.891346+0000","last_fullsized":"2024-09-13T15:16:23.891346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'5","last_scrub_stamp":"2024-09-13T15:16:19.392397+0000","last_deep_scrub":"33'5","last_deep_scrub_stamp":"2024-09-13T15:16:19.392397+0000","last_clean_scrub_stamp":"2024-09-13T15:16:19.392397+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:12:54.356146+0000","scrub_duration":0.0023579180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"33'3","reported_seq":44,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:16:35.447363+0000","last_change":"2024-09-13T15:16:35.447440+0000","last_active":"2024-09-13T15:16:35.447363+0000","last_peered":"2024-09-13T15:16:35.447363+0000","last_clean":"2024-09-13T15:16:35.447363+0000","last_became_active":"2024-09-13T15:01:44.803977+0000","last_became_peered":"2024-09-13T15:01:44.803977+0000","last_unstale":"2024-09-13T15:16:35.447363+0000","last_undegraded":"2024-09-13T15:16:35.447363+0000","last_fullsized":"2024-09-13T15:16:35.447363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'3","last_scrub_stamp":"2024-09-13T15:16:35.447342+0000","last_deep_scrub":"33'3","last_deep_scrub_stamp":"2024-09-13T15:16:35.447342+0000","last_clean_scrub_stamp":"2024-09-13T15:16:35.447342+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:40.015172+0000","scrub_duration":0.001429317,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"33'12","reported_seq":52,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T15:17:20.921339+0000","last_change":"2024-09-13T15:17:20.921537+0000","last_active":"2024-09-13T15:17:20.921339+0000","last_peered":"2024-09-13T15:17:20.921339+0000","last_clean":"2024-09-13T15:17:20.921339+0000","last_became_active":"2024-09-13T15:01:44.815381+0000","last_became_peered":"2024-09-13T15:01:44.815381+0000","last_unstale":"2024-09-13T15:17:20.921339+0000","last_undegraded":"2024-09-13T15:17:20.921339+0000","last_fullsized":"2024-09-13T15:17:20.921339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"33'12","last_scrub_stamp":"2024-09-13T15:17:20.921260+0000","last_deep_scrub":"33'12","last_deep_scrub_stamp":"2024-09-13T15:17:20.921260+0000","last_clean_scrub_stamp":"2024-09-13T15:17:20.921260+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:36.703172+0000","scrub_duration":0.0029681989999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2171149,"num_write_kb":31079058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149321,"ondisk_log_size":149321,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":615,"ondisk_log_size":615,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":108901497,"num_objects":124,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":124,"num_whiteouts":0,"num_read":501,"num_read_kb":110953,"num_write":3247,"num_write_kb":107181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":55628,"num_omap_keys":107,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":218046464,"data_stored":217802994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3352,"ondisk_log_size":3352,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542339,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":959312,"kb_used_data":46024,"kb_used_omap":1,"kb_used_meta":913278,"kb_avail":93412528,"statfs":{"total":96636764160,"available":95654428672,"internally_reserved":0,"allocated":47128576,"data_stored":46890816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":935197131},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:17:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":4.2770000000000001,"15min":4.8760000000000003},"min":{"1min":0.435,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":4.7050000000000001,"5min":130.31299999999999,"15min":254.13499999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.1830000000000001,"5min":4.3570000000000002,"15min":4.9039999999999999},"min":{"1min":0.54400000000000004,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":4.7279999999999998,"5min":130.13499999999999,"15min":254.119},"last":0.68300000000000005}]},{"osd":1,"last update":"Fri Sep 13 15:17:01 2024","interfaces":[{"interface":"back","average":{"1min":7.1920000000000002,"5min":6.6130000000000004,"15min":9.1120000000000001},"min":{"1min":0.39600000000000002,"5min":0.30599999999999999,"15min":0.29999999999999999},"max":{"1min":116.92400000000001,"5min":132.92500000000001,"15min":281.399},"last":0.498},{"interface":"front","average":{"1min":7.2960000000000003,"5min":5.3339999999999996,"15min":10.361000000000001},"min":{"1min":0.46000000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":116.828,"5min":134.523,"15min":557.92399999999998},"last":1.0209999999999999}]},{"osd":2,"last update":"Fri Sep 13 15:17:11 2024","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":2.8879999999999999,"15min":5.532},"min":{"1min":0.38800000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":4.3789999999999996,"5min":119.023,"15min":280.29700000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.84899999999999998,"5min":2.4039999999999999,"15min":5.2489999999999997},"min":{"1min":0.50700000000000001,"5min":0.30499999999999999,"15min":0.28499999999999998},"max":{"1min":1.343,"5min":115.961,"15min":274.03500000000003},"last":0.91300000000000003}]},{"osd":3,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":6.5010000000000003,"5min":5.4989999999999997,"15min":6.7779999999999996},"min":{"1min":0.48199999999999998,"5min":0.377,"15min":0.32300000000000001},"max":{"1min":111.05500000000001,"5min":126.226,"15min":261.36000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":7.3730000000000002,"5min":5.351,"15min":5.4320000000000004},"min":{"1min":0.504,"5min":0.37,"15min":0.29599999999999999},"max":{"1min":111.715,"5min":126.05,"15min":252.90000000000001},"last":0.80100000000000005}]},{"osd":4,"last update":"Fri Sep 13 15:17:11 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":2.105,"15min":1.3180000000000001},"min":{"1min":0.41499999999999998,"5min":0.28100000000000003,"15min":0.23699999999999999},"max":{"1min":6.9660000000000002,"5min":20.928999999999998,"15min":20.928999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.167,"5min":2.3180000000000001,"15min":1.3859999999999999},"min":{"1min":0.46200000000000002,"5min":0.28000000000000003,"15min":0.24199999999999999},"max":{"1min":3.8159999999999998,"5min":20.893000000000001,"15min":20.893000000000001},"last":0.97299999999999998}]},{"osd":5,"last update":"Fri Sep 13 15:17:11 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.0089999999999999,"15min":1.103},"min":{"1min":0.40000000000000002,"5min":0.251,"15min":0.248},"max":{"1min":7.6509999999999998,"5min":8.2360000000000007,"15min":11.800000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.0409999999999999,"15min":1.022},"min":{"1min":0.42199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":7.415,"5min":8.593,"15min":8.593},"last":0.85999999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:17:11 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":1.7729999999999999,"15min":1.3620000000000001},"min":{"1min":0.443,"5min":0.29699999999999999,"15min":0.27700000000000002},"max":{"1min":1.357,"5min":20.835000000000001,"15min":20.835000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.21,"5min":1.663,"15min":1.2470000000000001},"min":{"1min":0.53300000000000003,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":3.6320000000000001,"5min":21.518000000000001,"15min":21.518000000000001},"last":1.141}]}]},{"osd":6,"up_from":14,"seq":60129542340,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1195488,"kb_used_data":28824,"kb_used_omap":1,"kb_used_meta":1166654,"kb_avail":93176352,"statfs":{"total":96636764160,"available":95412584448,"internally_reserved":0,"allocated":29515776,"data_stored":29292897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":1194654151},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":10.839,"15min":5.5960000000000001},"min":{"1min":0.439,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":3.125,"5min":343.02800000000002,"15min":343.02800000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.98599999999999999,"5min":11.129,"15min":5.423},"min":{"1min":0.49299999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":3.2109999999999999,"5min":370.00099999999998,"15min":370.00099999999998},"last":0.77700000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":7.9480000000000004,"15min":6.101},"min":{"1min":0.48699999999999999,"5min":0.317,"15min":0.26900000000000002},"max":{"1min":3.2799999999999998,"5min":236.12100000000001,"15min":236.12100000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":9.6120000000000001,"15min":7.25},"min":{"1min":0.58099999999999996,"5min":0.35099999999999998,"15min":0.32300000000000001},"max":{"1min":3.343,"5min":274.46800000000002,"15min":274.46800000000002},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":5.7990000000000004,"15min":3.625},"min":{"1min":0.59699999999999998,"5min":0.35099999999999998,"15min":0.311},"max":{"1min":0.94899999999999995,"5min":249.75700000000001,"15min":249.75700000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.091,"5min":6.6619999999999999,"15min":4.0389999999999997},"min":{"1min":0.74199999999999999,"5min":0.36899999999999999,"15min":0.30299999999999999},"max":{"1min":3.0990000000000002,"5min":283.36700000000002,"15min":283.36700000000002},"last":0.97399999999999998}]},{"osd":3,"last update":"Fri Sep 13 15:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":6.0700000000000003,"15min":4.4690000000000003},"min":{"1min":0.60799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.373,"5min":239.05099999999999,"15min":239.05099999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.0509999999999999,"5min":11.765000000000001,"15min":6.3630000000000004},"min":{"1min":0.68100000000000005,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":2.9359999999999999,"5min":352.03800000000001,"15min":352.03800000000001},"last":0.82199999999999995}]},{"osd":4,"last update":"Fri Sep 13 15:17:15 2024","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":3.3940000000000001,"15min":2.1909999999999998},"min":{"1min":0.80800000000000005,"5min":0.25700000000000001,"15min":0.23300000000000001},"max":{"1min":3.0760000000000001,"5min":37.261000000000003,"15min":91.054000000000002},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.1990000000000001,"5min":3.766,"15min":2.246},"min":{"1min":0.84599999999999997,"5min":0.312,"15min":0.254},"max":{"1min":3.1499999999999999,"5min":52.167000000000002,"15min":99.084000000000003},"last":1.052}]},{"osd":5,"last update":"Fri Sep 13 15:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":1.216,"15min":1.0309999999999999},"min":{"1min":0.40300000000000002,"5min":0.28699999999999998,"15min":0.253},"max":{"1min":2.456,"5min":15.196,"15min":15.196},"last":1.032},{"interface":"front","average":{"1min":1.319,"5min":1.669,"15min":1.204},"min":{"1min":0.93300000000000005,"5min":0.317,"15min":0.26000000000000001},"max":{"1min":3.1789999999999998,"5min":25.192,"15min":25.192},"last":1.127}]},{"osd":7,"last update":"Fri Sep 13 15:17:15 2024","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.623,"15min":1.3029999999999999},"min":{"1min":0.56699999999999995,"5min":0.33200000000000002,"15min":0.27800000000000002},"max":{"1min":2.0190000000000001,"5min":37.219999999999999,"15min":37.219999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.2430000000000001,"15min":1.139},"min":{"1min":0.88700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":4.5199999999999996,"5min":12.577,"15min":14.654},"last":1.0760000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542339,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":871448,"kb_used_data":20880,"kb_used_omap":1,"kb_used_meta":850558,"kb_avail":93500392,"statfs":{"total":96636764160,"available":95744401408,"internally_reserved":0,"allocated":21381120,"data_stored":21136948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":870971846},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":2.556,"15min":2.6600000000000001},"min":{"1min":0.38800000000000001,"5min":0.27600000000000002,"15min":0.26300000000000001},"max":{"1min":3.4020000000000001,"5min":67.037999999999997,"15min":94.078999999999994},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":2.0750000000000002,"15min":2.0390000000000001},"min":{"1min":0.38100000000000001,"5min":0.27800000000000002,"15min":0.27000000000000002},"max":{"1min":1.4890000000000001,"5min":67.555000000000007,"15min":76.866},"last":0.77600000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":2.7410000000000001,"15min":4.3150000000000004},"min":{"1min":0.47699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.123,"5min":65.730000000000004,"15min":214.21199999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.6319999999999999,"5min":2.556,"15min":6.6740000000000004},"min":{"1min":0.34799999999999998,"5min":0.31900000000000001,"15min":0.317},"max":{"1min":18.373999999999999,"5min":72.069000000000003,"15min":559.69500000000005},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":2.6880000000000002,"15min":2.306},"min":{"1min":0.38400000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.98099999999999998,"5min":67.366,"15min":67.366},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":2.3490000000000002,"15min":2.0579999999999998},"min":{"1min":0.44800000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.087,"5min":65.522000000000006,"15min":65.522000000000006},"last":1.2190000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":4.5979999999999999,"15min":3.1230000000000002},"min":{"1min":0.53900000000000003,"5min":0.40699999999999997,"15min":0.37},"max":{"1min":2.2349999999999999,"5min":169.30600000000001,"15min":169.30600000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":4.7009999999999996,"15min":4.1349999999999998},"min":{"1min":0.57699999999999996,"5min":0.437,"15min":0.40899999999999997},"max":{"1min":2.2519999999999998,"5min":169.33799999999999,"15min":169.33799999999999},"last":1.286}]},{"osd":4,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":2.2810000000000001,"15min":1.3979999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.223},"max":{"1min":1.2390000000000001,"5min":36.151000000000003,"15min":36.151000000000003},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.89100000000000001,"5min":2.431,"15min":1.4690000000000001},"min":{"1min":0.307,"5min":0.26300000000000001,"15min":0.25800000000000001},"max":{"1min":1.177,"5min":36.219000000000001,"15min":36.219000000000001},"last":1.0149999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":1.661,"15min":1.202},"min":{"1min":0.31,"5min":0.27300000000000002,"15min":0.25600000000000001},"max":{"1min":1.1899999999999999,"5min":25.734000000000002,"15min":25.734000000000002},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.91800000000000004,"5min":1.5349999999999999,"15min":1.157},"min":{"1min":0.375,"5min":0.28999999999999998,"15min":0.26200000000000001},"max":{"1min":1.2390000000000001,"5min":29.106999999999999,"15min":29.106999999999999},"last":1.2569999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":1.0029999999999999,"15min":0.97399999999999998},"min":{"1min":0.35799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.212,"5min":9.0329999999999995,"15min":10.798},"last":1.335},{"interface":"front","average":{"1min":0.98199999999999998,"5min":1.226,"15min":1.048},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.2350000000000001,"5min":12.874000000000001,"15min":12.874000000000001},"last":1.1259999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542338,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1128128,"kb_used_data":41336,"kb_used_omap":1,"kb_used_meta":1086782,"kb_avail":93243712,"statfs":{"total":96636764160,"available":95481561088,"internally_reserved":0,"allocated":42328064,"data_stored":42105374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1112865222},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":2.6059999999999999,"15min":1.6930000000000001},"min":{"1min":0.42999999999999999,"5min":0.308,"15min":0.27100000000000002},"max":{"1min":12.763999999999999,"5min":18.741,"15min":18.741},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":2.8559999999999999,"15min":1.96},"min":{"1min":0.46999999999999997,"5min":0.29699999999999999,"15min":0.28699999999999998},"max":{"1min":3.452,"5min":27.876999999999999,"15min":27.876999999999999},"last":0.50600000000000001}]},{"osd":1,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":1.8700000000000001,"5min":15.220000000000001,"15min":6.8360000000000003},"min":{"1min":0.48299999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":19.812000000000001,"5min":1296.6300000000001,"15min":1296.6300000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":1.4610000000000001,"5min":3.165,"15min":2.6579999999999999},"min":{"1min":0.55300000000000005,"5min":0.313,"15min":0.307},"max":{"1min":9.0589999999999993,"5min":25.800999999999998,"15min":47.923999999999999},"last":0.64000000000000001}]},{"osd":2,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":2.4329999999999998,"15min":1.857},"min":{"1min":0.52200000000000002,"5min":0.309,"15min":0.29999999999999999},"max":{"1min":6.3639999999999999,"5min":23.760999999999999,"15min":23.760999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.173,"5min":2.399,"15min":1.913},"min":{"1min":0.61399999999999999,"5min":0.34000000000000002,"15min":0.32500000000000001},"max":{"1min":6.3949999999999996,"5min":23.709,"15min":30.510000000000002},"last":0.81799999999999995}]},{"osd":3,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":4.577,"15min":2.9550000000000001},"min":{"1min":0.68200000000000005,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":4.7510000000000003,"5min":94.281000000000006,"15min":94.281000000000006},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.2749999999999999,"5min":4.6340000000000003,"15min":3.238},"min":{"1min":0.76300000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":4.798,"5min":94.319999999999993,"15min":94.319999999999993},"last":0.78600000000000003}]},{"osd":5,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.6419999999999999,"15min":1.177},"min":{"1min":0.55200000000000005,"5min":0.245,"15min":0.245},"max":{"1min":4.1749999999999998,"5min":18.623999999999999,"15min":18.623999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.208,"5min":1.3779999999999999,"15min":1.1459999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.246},"max":{"1min":7.9740000000000002,"5min":16.155999999999999,"15min":16.155999999999999},"last":0.89200000000000002}]},{"osd":6,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":2.0760000000000001,"15min":1.4950000000000001},"min":{"1min":0.30399999999999999,"5min":0.27000000000000002,"15min":0.24099999999999999},"max":{"1min":12.823,"5min":27.984000000000002,"15min":27.984000000000002},"last":0.753},{"interface":"front","average":{"1min":1.585,"5min":2.161,"15min":1.399},"min":{"1min":0.68200000000000005,"5min":0.28499999999999998,"15min":0.23799999999999999},"max":{"1min":12.941000000000001,"5min":28.077000000000002,"15min":28.077000000000002},"last":0.94099999999999995}]},{"osd":7,"last update":"Fri Sep 13 15:17:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.952,"15min":1.3899999999999999},"min":{"1min":0.89200000000000002,"5min":0.309,"15min":0.26200000000000001},"max":{"1min":3.339,"5min":25.266999999999999,"15min":25.266999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.3660000000000001,"5min":2.0430000000000001,"15min":1.486},"min":{"1min":0.98799999999999999,"5min":0.39400000000000002,"15min":0.32600000000000001},"max":{"1min":3.395,"5min":25.309999999999999,"15min":25.309999999999999},"last":1.0189999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542332,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1547308,"kb_used_data":24804,"kb_used_omap":1,"kb_used_meta":1522494,"kb_avail":92824532,"statfs":{"total":96636764160,"available":95052320768,"internally_reserved":0,"allocated":25399296,"data_stored":25168927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1559034312},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:17:20 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":6.3209999999999997,"15min":6.4589999999999996},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.97699999999999998,"5min":108.956,"15min":170.35599999999999},"last":0.317},{"interface":"front","average":{"1min":0.40999999999999998,"5min":4.4029999999999996,"15min":4.5030000000000001},"min":{"1min":0.33300000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59899999999999998,"5min":63.624000000000002,"15min":168.80699999999999},"last":0.34799999999999998}]},{"osd":1,"last update":"Fri Sep 13 15:17:20 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":5.3419999999999996,"15min":4.6609999999999996},"min":{"1min":0.33600000000000002,"5min":0.32500000000000001,"15min":0.28499999999999998},"max":{"1min":8.5640000000000001,"5min":75.087999999999994,"15min":92.722999999999999},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":7.024,"15min":6.2699999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26600000000000001},"max":{"1min":9.1180000000000003,"5min":78.585999999999999,"15min":104.51300000000001},"last":0.379}]},{"osd":2,"last update":"Fri Sep 13 15:17:20 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":3.8290000000000002,"15min":3.9060000000000001},"min":{"1min":0.33700000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":9.1560000000000006,"5min":26.239999999999998,"15min":74.825000000000003},"last":0.435},{"interface":"front","average":{"1min":0.91200000000000003,"5min":4.0369999999999999,"15min":3.891},"min":{"1min":0.42599999999999999,"5min":0.41599999999999998,"15min":0.36499999999999999},"max":{"1min":9.1859999999999999,"5min":28.556999999999999,"15min":74.870999999999995},"last":0.47299999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:17:20 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":4.5659999999999998,"15min":3.0449999999999999},"min":{"1min":0.56200000000000006,"5min":0.38800000000000001,"15min":0.36699999999999999},"max":{"1min":1.032,"5min":85.710999999999999,"15min":85.710999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.80700000000000005,"5min":5.6950000000000003,"15min":3.944},"min":{"1min":0.58999999999999997,"5min":0.499,"15min":0.377},"max":{"1min":2.258,"5min":105.875,"15min":105.875},"last":0.66900000000000004}]},{"osd":5,"last update":"Fri Sep 13 15:17:20 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":4.5209999999999999,"15min":3.3730000000000002},"min":{"1min":0.629,"5min":0.46700000000000003,"15min":0.40400000000000003},"max":{"1min":2.597,"5min":95.748999999999995,"15min":95.748999999999995},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.044,"5min":5.3540000000000001,"15min":4.3520000000000003},"min":{"1min":0.55800000000000005,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":8.9190000000000005,"5min":100.325,"15min":100.325},"last":0.75}]},{"osd":6,"last update":"Fri Sep 13 15:17:20 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":3.5470000000000002,"15min":2.7589999999999999},"min":{"1min":0.52700000000000002,"5min":0.433,"15min":0.432},"max":{"1min":1.853,"5min":85.492999999999995,"15min":85.492999999999995},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.86799999999999999,"5min":4.7430000000000003,"15min":3.2389999999999999},"min":{"1min":0.66300000000000003,"5min":0.54100000000000004,"15min":0.501},"max":{"1min":1.887,"5min":100.376,"15min":100.376},"last":0.61399999999999999}]},{"osd":7,"last update":"Fri Sep 13 15:17:20 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":4.2320000000000002,"15min":3.073},"min":{"1min":0.52900000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.6319999999999999,"5min":97.268000000000001,"15min":97.268000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":4.6769999999999996,"15min":3.5329999999999999},"min":{"1min":0.60199999999999998,"5min":0.51000000000000001,"15min":0.48599999999999999},"max":{"1min":1.5760000000000001,"5min":100.583,"15min":100.583},"last":0.90000000000000002}]}]},{"osd":2,"up_from":14,"seq":60129542339,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":814544,"kb_used_data":4552,"kb_used_omap":1,"kb_used_meta":809982,"kb_avail":93557296,"statfs":{"total":96636764160,"available":95802671104,"internally_reserved":0,"allocated":4661248,"data_stored":4427070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":829422022},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:17:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":6.0439999999999996,"15min":3.7759999999999998},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":9.1750000000000007,"5min":170.77199999999999,"15min":170.77199999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":1.109,"5min":9.6739999999999995,"15min":5.4130000000000003},"min":{"1min":0.27700000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":9.1449999999999996,"5min":237.53800000000001,"15min":237.53800000000001},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Sep 13 15:17:14 2024","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":3.9260000000000002,"15min":3.7919999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28899999999999998},"max":{"1min":3.637,"5min":109.104,"15min":109.104},"last":0.315},{"interface":"front","average":{"1min":1.0029999999999999,"5min":10.397,"15min":5.8819999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.30499999999999999},"max":{"1min":9.2040000000000006,"5min":295.73500000000001,"15min":295.73500000000001},"last":0.30599999999999999}]},{"osd":3,"last update":"Fri Sep 13 15:17:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":4.7539999999999996,"15min":3.7429999999999999},"min":{"1min":0.36599999999999999,"5min":0.35999999999999999,"15min":0.27900000000000003},"max":{"1min":8.9570000000000007,"5min":109.152,"15min":109.152},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":7.0780000000000003,"15min":4.8259999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":3.5600000000000001,"5min":264.87599999999998,"15min":264.87599999999998},"last":0.41099999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:17:14 2024","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":6.4580000000000002,"15min":3.9049999999999998},"min":{"1min":0.41999999999999998,"5min":0.41599999999999998,"15min":0.38100000000000001},"max":{"1min":11.708,"5min":251.97300000000001,"15min":251.97300000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.0529999999999999,"5min":3.891,"15min":2.5640000000000001},"min":{"1min":0.46899999999999997,"5min":0.42099999999999999,"15min":0.34899999999999998},"max":{"1min":9.1270000000000007,"5min":42.012,"15min":42.012},"last":0.74399999999999999}]},{"osd":5,"last update":"Fri Sep 13 15:17:14 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":2.8239999999999998,"15min":2.5209999999999999},"min":{"1min":0.54200000000000004,"5min":0.49099999999999999,"15min":0.46000000000000002},"max":{"1min":9.0229999999999997,"5min":41.942999999999998,"15min":41.942999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.177,"5min":5.2809999999999997,"15min":3.5179999999999998},"min":{"1min":0.58399999999999996,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":9.0909999999999993,"5min":237.58799999999999,"15min":237.58799999999999},"last":0.73999999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:17:14 2024","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":2.8300000000000001,"15min":2.456},"min":{"1min":0.57399999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":8.8460000000000001,"5min":41.981999999999999,"15min":41.981999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":3.1080000000000001,"15min":2.5699999999999998},"min":{"1min":0.64300000000000002,"5min":0.502,"15min":0.49099999999999999},"max":{"1min":8.9920000000000009,"5min":41.890999999999998,"15min":41.890999999999998},"last":0.76600000000000001}]},{"osd":7,"last update":"Fri Sep 13 15:17:14 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":5.3259999999999996,"15min":3.4089999999999998},"min":{"1min":0.47899999999999998,"5min":0.44,"15min":0.44},"max":{"1min":8.8970000000000002,"5min":237.626,"15min":237.626},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.879,"5min":5.3479999999999999,"15min":3.2480000000000002},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.39200000000000002},"max":{"1min":3.4620000000000002,"5min":252.005,"15min":252.005},"last":0.61799999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542333,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1493764,"kb_used_data":24956,"kb_used_omap":1,"kb_used_meta":1468798,"kb_avail":92878076,"statfs":{"total":96636764160,"available":95107149824,"internally_reserved":0,"allocated":25554944,"data_stored":25328384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":1504049606},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 15:17:13 2024","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":4.2000000000000002,"15min":4.1600000000000001},"min":{"1min":0.26700000000000002,"5min":0.23799999999999999,"15min":0.22500000000000001},"max":{"1min":15.843999999999999,"5min":104.246,"15min":104.246},"last":0.309},{"interface":"front","average":{"1min":0.69199999999999995,"5min":4.5720000000000001,"15min":4.0419999999999998},"min":{"1min":0.29199999999999998,"5min":0.28999999999999998,"15min":0.28599999999999998},"max":{"1min":4.6609999999999996,"5min":103.157,"15min":103.157},"last":0.41899999999999998}]},{"osd":2,"last update":"Fri Sep 13 15:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":6.21,"15min":5.1689999999999996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.4299999999999997,"5min":113.79600000000001,"15min":191.00899999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":3.6080000000000001,"15min":3.3929999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.318},"max":{"1min":0.61399999999999999,"5min":30.704999999999998,"15min":47.537999999999997},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri Sep 13 15:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":4.9299999999999997,"15min":4.0410000000000004},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.577,"5min":52.975000000000001,"15min":52.975000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.754,"5min":5.8949999999999996,"15min":4},"min":{"1min":0.39800000000000002,"5min":0.36299999999999999,"15min":0.33100000000000002},"max":{"1min":4.7519999999999998,"5min":104.319,"15min":104.319},"last":0.57699999999999996}]},{"osd":4,"last update":"Fri Sep 13 15:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":3.9510000000000001,"15min":3.9180000000000001},"min":{"1min":0.53400000000000003,"5min":0.45400000000000001,"15min":0.38700000000000001},"max":{"1min":0.93700000000000006,"5min":29.739000000000001,"15min":125.44799999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":5.859,"15min":4.1959999999999997},"min":{"1min":0.499,"5min":0.499,"15min":0.38800000000000001},"max":{"1min":0.96999999999999997,"5min":102.962,"15min":117.842},"last":0.82799999999999996}]},{"osd":5,"last update":"Fri Sep 13 15:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":4.0519999999999996,"15min":3.9369999999999998},"min":{"1min":0.57699999999999996,"5min":0.51600000000000001,"15min":0.40000000000000002},"max":{"1min":1.0449999999999999,"5min":104.19,"15min":154.875},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.012,"5min":4.2729999999999997,"15min":4.0659999999999998},"min":{"1min":0.53300000000000003,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":4.3899999999999997,"5min":45.369999999999997,"15min":126.485},"last":0.71599999999999997}]},{"osd":6,"last update":"Fri Sep 13 15:17:13 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":4.4720000000000004,"15min":3.5990000000000002},"min":{"1min":0.56799999999999995,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0069999999999999,"5min":103.191,"15min":103.191},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":3.9399999999999999,"15min":3.1619999999999999},"min":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.42399999999999999},"max":{"1min":1.006,"5min":104.28400000000001,"15min":104.28400000000001},"last":0.79600000000000004}]},{"osd":7,"last update":"Fri Sep 13 15:17:13 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":4.1340000000000003,"15min":3.536},"min":{"1min":0.629,"5min":0.53700000000000003,"15min":0.438},"max":{"1min":3.5489999999999999,"5min":45.472999999999999,"15min":77.366},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":4.681,"15min":3.839},"min":{"1min":0.59599999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.98499999999999999,"5min":112.69499999999999,"15min":112.69499999999999},"last":0.86399999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542337,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":970504,"kb_used_data":25536,"kb_used_omap":1,"kb_used_meta":944958,"kb_avail":93401336,"statfs":{"total":96636764160,"available":95642968064,"internally_reserved":0,"allocated":26148864,"data_stored":25917602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":967637446},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 15:17:08 2024","interfaces":[{"interface":"back","average":{"1min":1.5669999999999999,"5min":3.875,"15min":4.375},"min":{"1min":0.248,"5min":0.248,"15min":0.22900000000000001},"max":{"1min":16.885999999999999,"5min":43.508000000000003,"15min":279.90600000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":1.177,"5min":4.2640000000000002,"15min":6.2679999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.28100000000000003},"max":{"1min":8.7650000000000006,"5min":58.280000000000001,"15min":510.15699999999998},"last":0.435}]},{"osd":2,"last update":"Fri Sep 13 15:17:08 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":5.0460000000000003,"15min":3.3170000000000002},"min":{"1min":0.27300000000000002,"5min":0.26400000000000001,"15min":0.26000000000000001},"max":{"1min":4.9470000000000001,"5min":101.73399999999999,"15min":101.73399999999999},"last":0.316},{"interface":"front","average":{"1min":1.0700000000000001,"5min":3.6699999999999999,"15min":2.77},"min":{"1min":0.39500000000000002,"5min":0.39400000000000002,"15min":0.34200000000000003},"max":{"1min":7.0940000000000003,"5min":35.527999999999999,"15min":35.527999999999999},"last":0.44900000000000001}]},{"osd":3,"last update":"Fri Sep 13 15:17:08 2024","interfaces":[{"interface":"back","average":{"1min":9.8650000000000002,"5min":7.1369999999999996,"15min":5.2750000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.28699999999999998},"max":{"1min":142.06200000000001,"5min":142.06200000000001,"15min":142.06200000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":10.363,"5min":5.8460000000000001,"15min":5.032},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":141.85300000000001,"5min":141.85300000000001,"15min":141.85300000000001},"last":0.48299999999999998}]},{"osd":4,"last update":"Fri Sep 13 15:17:19 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":3.7509999999999999,"15min":2.7400000000000002},"min":{"1min":0.52200000000000002,"5min":0.505,"15min":0.34200000000000003},"max":{"1min":3.23,"5min":30.207999999999998,"15min":30.207999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.90000000000000002,"5min":3.379,"15min":2.5539999999999998},"min":{"1min":0.59599999999999997,"5min":0.46999999999999997,"15min":0.38500000000000001},"max":{"1min":3.2749999999999999,"5min":30.135000000000002,"15min":30.135000000000002},"last":0.64800000000000002}]},{"osd":5,"last update":"Fri Sep 13 15:17:19 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":4.3659999999999997,"15min":2.8679999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.377},"max":{"1min":3.2989999999999999,"5min":101.702,"15min":101.702},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":3.1080000000000001,"15min":2.3130000000000002},"min":{"1min":0.54100000000000004,"5min":0.434,"15min":0.379},"max":{"1min":3.149,"5min":43.249000000000002,"15min":43.249000000000002},"last":0.60899999999999999}]},{"osd":6,"last update":"Fri Sep 13 15:17:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":4.048,"15min":2.6600000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.40000000000000002},"max":{"1min":5.1760000000000002,"5min":45.140000000000001,"15min":45.140000000000001},"last":0.749},{"interface":"front","average":{"1min":1.4490000000000001,"5min":3.9430000000000001,"15min":2.7770000000000001},"min":{"1min":0.59699999999999998,"5min":0.52500000000000002,"15min":0.50600000000000001},"max":{"1min":8.7070000000000007,"5min":44.737000000000002,"15min":44.737000000000002},"last":0.755}]},{"osd":7,"last update":"Fri Sep 13 15:17:08 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":4.5519999999999996,"15min":3.0209999999999999},"min":{"1min":0.60199999999999998,"5min":0.44700000000000001,"15min":0.42499999999999999},"max":{"1min":5.25,"5min":101.655,"15min":101.655},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.4279999999999999,"5min":3.6509999999999998,"15min":2.6629999999999998},"min":{"1min":0.63,"5min":0.51500000000000001,"15min":0.434},"max":{"1min":6.6559999999999997,"5min":46.649000000000001,"15min":46.649000000000001},"last":0.79800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25194496,"data_stored":25166698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":25194496,"data_stored":25167848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4300800,"data_stored":4266534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":25038848,"data_stored":25008391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":41967616,"data_stored":41944838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21020672,"data_stored":20976412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":29155328,"data_stored":29132361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":46174208,"data_stored":46139912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T15:17:44.571 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T15:17:44.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.739+0000 7f9cece00640 1 Processor -- start 2024-09-13T15:17:44.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.739+0000 7f9cece00640 1 -- start start 2024-09-13T15:17:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.743+0000 7f9cece00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ce80cba20 0x7f9ce80c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.743+0000 7f9cece00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9ce80cbe00 0x7f9ce80c7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.743+0000 7f9cece00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce806ad30 con 0x7f9ce8159c40 2024-09-13T15:17:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.743+0000 7f9cece00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce806b010 con 0x7f9ce80cbe00 2024-09-13T15:17:44.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.743+0000 7f9cece00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce806b2f0 con 0x7f9ce80cba20 2024-09-13T15:17:44.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.743+0000 7f9ce7400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ce80cba20 0x7f9ce80c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:44.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.743+0000 7f9cdfe00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9ce80cbe00 0x7f9ce80c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:44.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.743+0000 7f9ce7400640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ce80cba20 0x7f9ce80c52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3301/0 says I am v2:172.21.15.7:55606/0 (socket says 172.21.15.7:55606) 2024-09-13T15:17:44.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.743+0000 7f9ce7400640 1 -- 172.21.15.7:0/2278920983 learned_addr learned my addr 172.21.15.7:0/2278920983 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:44.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.743+0000 7f9ce7400640 1 -- 172.21.15.7:0/2278920983 >> v2:172.21.15.77:3300/0 conn(0x7f9ce80cbe00 msgr2=0x7f9ce80c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:17:44.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.743+0000 7f9ce7400640 1 --2- 172.21.15.7:0/2278920983 >> v2:172.21.15.77:3300/0 conn(0x7f9ce80cbe00 0x7f9ce80c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.743+0000 7f9ce7400640 1 -- 172.21.15.7:0/2278920983 >> v1:172.21.15.77:6789/0 conn(0x7f9ce8159c40 legacy=0x7f9ce80c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:44.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.743+0000 7f9ce7400640 1 -- 172.21.15.7:0/2278920983 --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce806b5d0 con 0x7f9ce80cba20 2024-09-13T15:17:44.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.747+0000 7f9ce7400640 1 --2- 172.21.15.7:0/2278920983 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ce80cba20 0x7f9ce80c52e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009870 tx=0x7f9cd801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9fbb992d2bd4da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:44.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.747+0000 7f9ce6a00640 1 -- 172.21.15.7:0/2278920983 <== mon.2 v2:172.21.15.77:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd80aa610 con 0x7f9ce80cba20 2024-09-13T15:17:44.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.747+0000 7f9ce6a00640 1 -- 172.21.15.7:0/2278920983 <== mon.2 v2:172.21.15.77:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd80a6040 con 0x7f9ce80cba20 2024-09-13T15:17:44.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.747+0000 7f9ce6a00640 1 -- 172.21.15.7:0/2278920983 <== mon.2 v2:172.21.15.77:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd80aa990 con 0x7f9ce80cba20 2024-09-13T15:17:44.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.747+0000 7f9cece00640 1 -- 172.21.15.7:0/2278920983 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ce80cba20 msgr2=0x7f9ce80c52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:44.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.747+0000 7f9cece00640 1 --2- 172.21.15.7:0/2278920983 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ce80cba20 0x7f9ce80c52e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009870 tx=0x7f9cd801c4d0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.747+0000 7f9cece00640 1 -- 172.21.15.7:0/2278920983 shutdown_connections 2024-09-13T15:17:44.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.747+0000 7f9cece00640 1 --2- 172.21.15.7:0/2278920983 >> v2:172.21.15.77:3300/0 conn(0x7f9ce80cbe00 0x7f9ce80c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.747+0000 7f9cece00640 1 --2- 172.21.15.7:0/2278920983 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ce80cba20 0x7f9ce80c52e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.747+0000 7f9cece00640 1 -- 172.21.15.7:0/2278920983 >> 172.21.15.7:0/2278920983 conn(0x7f9ce8071520 msgr2=0x7f9ce8071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:44.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.747+0000 7f9cece00640 1 -- 172.21.15.7:0/2278920983 shutdown_connections 2024-09-13T15:17:44.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.747+0000 7f9cece00640 1 -- 172.21.15.7:0/2278920983 wait complete. 2024-09-13T15:17:44.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.747+0000 7f9cece00640 1 Processor -- start 2024-09-13T15:17:44.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.747+0000 7f9cece00640 1 -- start start 2024-09-13T15:17:44.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9cece00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce80cba20 0x7f9ce8152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:44.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9cece00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ce80cbe00 0x7f9ce814efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:44.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9cece00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ce8159c40 0x7f9ce814f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:44.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9cece00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce815a700 con 0x7f9ce8159c40 2024-09-13T15:17:44.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9cece00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce81f4f20 con 0x7f9ce80cba20 2024-09-13T15:17:44.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9cece00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce81f5200 con 0x7f9ce80cbe00 2024-09-13T15:17:44.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9ce7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ce8159c40 0x7f9ce814f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:44.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9ce7e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ce8159c40 0x7f9ce814f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40938/0 (socket says 172.21.15.7:40938) 2024-09-13T15:17:44.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9ce7e00640 1 -- 172.21.15.7:0/178466441 learned_addr learned my addr 172.21.15.7:0/178466441 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:44.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9ce7400640 1 --2- 172.21.15.7:0/178466441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce80cba20 0x7f9ce8152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:44.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9cdfe00640 1 --2- 172.21.15.7:0/178466441 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ce80cbe00 0x7f9ce814efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:44.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9ce7e00640 1 -- 172.21.15.7:0/178466441 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ce80cbe00 msgr2=0x7f9ce814efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:44.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9ce7e00640 1 --2- 172.21.15.7:0/178466441 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ce80cbe00 0x7f9ce814efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9ce7e00640 1 -- 172.21.15.7:0/178466441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce80cba20 msgr2=0x7f9ce8152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:44.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9ce7e00640 1 --2- 172.21.15.7:0/178466441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce80cba20 0x7f9ce8152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9ce7e00640 1 -- 172.21.15.7:0/178466441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd80094d0 con 0x7f9ce8159c40 2024-09-13T15:17:44.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9ce7e00640 1 --2- 172.21.15.7:0/178466441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ce8159c40 0x7f9ce814f510 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000c770 tx=0x7f9ce000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:44.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9cdf400640 1 -- 172.21.15.7:0/178466441 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce0003b80 con 0x7f9ce8159c40 2024-09-13T15:17:44.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9cdf400640 1 -- 172.21.15.7:0/178466441 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce0003ce0 con 0x7f9ce8159c40 2024-09-13T15:17:44.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9cdf400640 1 -- 172.21.15.7:0/178466441 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce000aa90 con 0x7f9ce8159c40 2024-09-13T15:17:44.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9cece00640 1 -- 172.21.15.7:0/178466441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce81f54e0 con 0x7f9ce8159c40 2024-09-13T15:17:44.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9cece00640 1 -- 172.21.15.7:0/178466441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce81f5aa0 con 0x7f9ce8159c40 2024-09-13T15:17:44.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9cece00640 1 -- 172.21.15.7:0/178466441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce80c52e0 con 0x7f9ce8159c40 2024-09-13T15:17:44.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.751+0000 7f9cdf400640 1 -- 172.21.15.7:0/178466441 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ce000abf0 con 0x7f9ce8159c40 2024-09-13T15:17:44.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.755+0000 7f9cdf400640 1 --2- 172.21.15.7:0/178466441 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9cc4066690 0x7f9cc4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:44.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.755+0000 7f9cdf400640 1 -- 172.21.15.7:0/178466441 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f9ce00844f0 con 0x7f9ce8159c40 2024-09-13T15:17:44.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.755+0000 7f9ce7400640 1 --2- 172.21.15.7:0/178466441 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9cc4066690 0x7f9cc4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:44.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.755+0000 7f9ce7400640 1 --2- 172.21.15.7:0/178466441 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9cc4066690 0x7f9cc4068b50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80ae000 tx=0x7f9cd80b5040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:44.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.759+0000 7f9cdf400640 1 -- 172.21.15.7:0/178466441 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9ce00512b0 con 0x7f9ce8159c40 2024-09-13T15:17:44.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.923+0000 7f9cece00640 1 -- 172.21.15.7:0/178466441 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f9ce80c97f0 con 0x7f9ce8159c40 2024-09-13T15:17:44.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.927+0000 7f9cdf400640 1 -- 172.21.15.7:0/178466441 <== mon.0 v2:172.21.15.7:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9ce000ce80 con 0x7f9ce8159c40 2024-09-13T15:17:44.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.927+0000 7f9cdf400640 1 -- 172.21.15.7:0/178466441 <== mon.0 v2:172.21.15.7:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f9ce00548d0 con 0x7f9ce8159c40 2024-09-13T15:17:44.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.931+0000 7f9cece00640 1 -- 172.21.15.7:0/178466441 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9cc4066690 msgr2=0x7f9cc4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:44.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.931+0000 7f9cece00640 1 --2- 172.21.15.7:0/178466441 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9cc4066690 0x7f9cc4068b50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80ae000 tx=0x7f9cd80b5040 comp rx=0 tx=0).stop 2024-09-13T15:17:44.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.931+0000 7f9cece00640 1 -- 172.21.15.7:0/178466441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ce8159c40 msgr2=0x7f9ce814f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:44.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.931+0000 7f9cece00640 1 --2- 172.21.15.7:0/178466441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ce8159c40 0x7f9ce814f510 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9ce000c770 tx=0x7f9ce000cc30 comp rx=0 tx=0).stop 2024-09-13T15:17:44.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.931+0000 7f9cece00640 1 -- 172.21.15.7:0/178466441 shutdown_connections 2024-09-13T15:17:44.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.931+0000 7f9cece00640 1 --2- 172.21.15.7:0/178466441 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f9cc4066690 0x7f9cc4068b50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.931+0000 7f9cece00640 1 --2- 172.21.15.7:0/178466441 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ce8159c40 0x7f9ce814f510 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.931+0000 7f9cece00640 1 --2- 172.21.15.7:0/178466441 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f9ce80cbe00 0x7f9ce814efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.931+0000 7f9cece00640 1 --2- 172.21.15.7:0/178466441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce80cba20 0x7f9ce8152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:44.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.931+0000 7f9cece00640 1 -- 172.21.15.7:0/178466441 >> 172.21.15.7:0/178466441 conn(0x7f9ce8071520 msgr2=0x7f9ce80c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:44.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.931+0000 7f9cece00640 1 -- 172.21.15.7:0/178466441 shutdown_connections 2024-09-13T15:17:44.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:44.931+0000 7f9cece00640 1 -- 172.21.15.7:0/178466441 wait complete. 2024-09-13T15:17:44.955 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T15:17:44.955 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:17:45.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.095+0000 7fc7d5e00640 1 Processor -- start 2024-09-13T15:17:45.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.095+0000 7fc7d5e00640 1 -- start start 2024-09-13T15:17:45.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.095+0000 7fc7d5e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc7d015c810 0x7fc7d00c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.095+0000 7fc7d5e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d015cd50 con 0x7fc7d00c9e50 2024-09-13T15:17:45.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.095+0000 7fc7d5e00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d015d030 con 0x7fc7d00cae60 2024-09-13T15:17:45.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.095+0000 7fc7d5e00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d015a220 con 0x7fc7d015c810 2024-09-13T15:17:45.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.095+0000 7fc7cf400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7fc7d00c9e50 0x7fc7d00cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59126/0 (socket says 172.21.15.7:59126) 2024-09-13T15:17:45.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.095+0000 7fc7cf400640 1 -- 172.21.15.7:0/2464048396 learned_addr learned my addr 172.21.15.7:0/2464048396 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:17:45.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.095+0000 7fc7c6000640 1 --2- 172.21.15.7:0/2464048396 >> v2:172.21.15.77:3300/0 conn(0x7fc7d015c810 0x7fc7d00c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.099+0000 7fc7ce000640 1 -- 172.21.15.7:0/2464048396 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437453627 0 0) 0x7fc7d015cd50 con 0x7fc7d00c9e50 2024-09-13T15:17:45.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.099+0000 7fc7ce000640 1 -- 172.21.15.7:0/2464048396 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7b4003530 con 0x7fc7d00c9e50 2024-09-13T15:17:45.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.099+0000 7fc7ce000640 1 -- 172.21.15.7:0/2464048396 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 84331194 0 0) 0x7fc7b4003530 con 0x7fc7d00c9e50 2024-09-13T15:17:45.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.099+0000 7fc7c6000640 1 -- 172.21.15.7:0/2464048396 >> v1:172.21.15.77:6789/0 conn(0x7fc7d00cae60 legacy=0x7fc7d0159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:45.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.099+0000 7fc7c6000640 1 -- 172.21.15.7:0/2464048396 >> v1:172.21.15.7:6789/0 conn(0x7fc7d00c9e50 legacy=0x7fc7d00cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:45.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.099+0000 7fc7c6000640 1 -- 172.21.15.7:0/2464048396 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d015d310 con 0x7fc7d015c810 2024-09-13T15:17:45.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.099+0000 7fc7c6000640 1 --2- 172.21.15.7:0/2464048396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7d015c810 0x7fc7d00c9820 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80097c0 tx=0x7fc7b801c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9000a79bf5f7a659 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:45.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.099+0000 7fc7ce000640 1 -- 172.21.15.7:0/2464048396 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8001a00 con 0x7fc7d015c810 2024-09-13T15:17:45.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.099+0000 7fc7ce000640 1 -- 172.21.15.7:0/2464048396 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc7b80a7050 con 0x7fc7d015c810 2024-09-13T15:17:45.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.099+0000 7fc7ce000640 1 -- 172.21.15.7:0/2464048396 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b80ab600 con 0x7fc7d015c810 2024-09-13T15:17:45.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7d5e00640 1 -- 172.21.15.7:0/2464048396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7d015c810 msgr2=0x7fc7d00c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:45.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7d5e00640 1 --2- 172.21.15.7:0/2464048396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7d015c810 0x7fc7d00c9820 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80097c0 tx=0x7fc7b801c300 comp rx=0 tx=0).stop 2024-09-13T15:17:45.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7d5e00640 1 -- 172.21.15.7:0/2464048396 shutdown_connections 2024-09-13T15:17:45.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7d5e00640 1 --2- 172.21.15.7:0/2464048396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7d015c810 0x7fc7d00c9820 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7d5e00640 1 -- 172.21.15.7:0/2464048396 >> 172.21.15.7:0/2464048396 conn(0x7fc7d0065f10 msgr2=0x7fc7d0066320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:45.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7d5e00640 1 -- 172.21.15.7:0/2464048396 shutdown_connections 2024-09-13T15:17:45.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7d5e00640 1 -- 172.21.15.7:0/2464048396 wait complete. 2024-09-13T15:17:45.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7d5e00640 1 Processor -- start 2024-09-13T15:17:45.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7d5e00640 1 -- start start 2024-09-13T15:17:45.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7d5e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7d00c9e50 0x7fc7d0156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7d5e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7d00cae60 0x7fc7d00c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7d5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7d015c810 0x7fc7d00c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7d5e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d00c3020 con 0x7fc7d015c810 2024-09-13T15:17:45.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7d5e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d01f1cc0 con 0x7fc7d00cae60 2024-09-13T15:17:45.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7d5e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d01f1f80 con 0x7fc7d00c9e50 2024-09-13T15:17:45.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7cf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7d015c810 0x7fc7d00c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7cf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7d015c810 0x7fc7d00c5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40950/0 (socket says 172.21.15.7:40950) 2024-09-13T15:17:45.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7cf400640 1 -- 172.21.15.7:0/1353135658 learned_addr learned my addr 172.21.15.7:0/1353135658 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:45.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7c6000640 1 --2- 172.21.15.7:0/1353135658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7d00cae60 0x7fc7d00c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7cea00640 1 --2- 172.21.15.7:0/1353135658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7d00c9e50 0x7fc7d0156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7cf400640 1 -- 172.21.15.7:0/1353135658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7d00c9e50 msgr2=0x7fc7d0156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:45.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7cf400640 1 --2- 172.21.15.7:0/1353135658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7d00c9e50 0x7fc7d0156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7cf400640 1 -- 172.21.15.7:0/1353135658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7d00cae60 msgr2=0x7fc7d00c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:45.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.103+0000 7fc7cf400640 1 --2- 172.21.15.7:0/1353135658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7d00cae60 0x7fc7d00c4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.107+0000 7fc7cf400640 1 -- 172.21.15.7:0/1353135658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b8009420 con 0x7fc7d015c810 2024-09-13T15:17:45.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.107+0000 7fc7cf400640 1 --2- 172.21.15.7:0/1353135658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7d015c810 0x7fc7d00c5000 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800cbf0 tx=0x7fc7c800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:45.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.107+0000 7fc7c7e00640 1 -- 172.21.15.7:0/1353135658 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c800ad50 con 0x7fc7d015c810 2024-09-13T15:17:45.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.107+0000 7fc7c7e00640 1 -- 172.21.15.7:0/1353135658 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc7c8012400 con 0x7fc7d015c810 2024-09-13T15:17:45.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.107+0000 7fc7d5e00640 1 -- 172.21.15.7:0/1353135658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d00c26f0 con 0x7fc7d015c810 2024-09-13T15:17:45.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.107+0000 7fc7c7e00640 1 -- 172.21.15.7:0/1353135658 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8012810 con 0x7fc7d015c810 2024-09-13T15:17:45.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.107+0000 7fc7d5e00640 1 -- 172.21.15.7:0/1353135658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d00c2cb0 con 0x7fc7d015c810 2024-09-13T15:17:45.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.107+0000 7fc7d5e00640 1 -- 172.21.15.7:0/1353135658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d0067650 con 0x7fc7d015c810 2024-09-13T15:17:45.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.107+0000 7fc7c7e00640 1 -- 172.21.15.7:0/1353135658 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc7c8012970 con 0x7fc7d015c810 2024-09-13T15:17:45.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.111+0000 7fc7c7e00640 1 --2- 172.21.15.7:0/1353135658 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc7ac066690 0x7fc7ac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.111+0000 7fc7c7e00640 1 -- 172.21.15.7:0/1353135658 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7fc7c8084e50 con 0x7fc7d015c810 2024-09-13T15:17:45.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.111+0000 7fc7cea00640 1 --2- 172.21.15.7:0/1353135658 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc7ac066690 0x7fc7ac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.111+0000 7fc7cea00640 1 --2- 172.21.15.7:0/1353135658 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc7ac066690 0x7fc7ac068b50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0007fd0 tx=0x7fc7c0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:45.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.115+0000 7fc7c7e00640 1 -- 172.21.15.7:0/1353135658 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc7c8051b90 con 0x7fc7d015c810 2024-09-13T15:17:45.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.311+0000 7fc7d5e00640 1 -- 172.21.15.7:0/1353135658 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7d00c9820 con 0x7fc7d015c810 2024-09-13T15:17:45.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.311+0000 7fc7c7e00640 1 -- 172.21.15.7:0/1353135658 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+6284 (secure 0 0 0) 0x7fc7c80551b0 con 0x7fc7d015c810 2024-09-13T15:17:45.314 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:17:45.314 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/118107059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":118107059},{"type":"v1","addr":"172.21.15.7:6836","nonce":118107059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:15:52.066397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":5710,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5710":{"gid":5710,"name":"f","rank":0,"incarnation":53,"state":"up:active","state_seq":26,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:17:45.314 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 58 2024-09-13T15:17:45.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.315+0000 7fc7d5e00640 1 -- 172.21.15.7:0/1353135658 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc7ac066690 msgr2=0x7fc7ac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:45.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.315+0000 7fc7d5e00640 1 --2- 172.21.15.7:0/1353135658 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc7ac066690 0x7fc7ac068b50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0007fd0 tx=0x7fc7c0009040 comp rx=0 tx=0).stop 2024-09-13T15:17:45.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.315+0000 7fc7d5e00640 1 -- 172.21.15.7:0/1353135658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7d015c810 msgr2=0x7fc7d00c5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:45.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.315+0000 7fc7d5e00640 1 --2- 172.21.15.7:0/1353135658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7d015c810 0x7fc7d00c5000 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc7c800cbf0 tx=0x7fc7c800a430 comp rx=0 tx=0).stop 2024-09-13T15:17:45.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.315+0000 7fc7d5e00640 1 -- 172.21.15.7:0/1353135658 shutdown_connections 2024-09-13T15:17:45.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.315+0000 7fc7d5e00640 1 --2- 172.21.15.7:0/1353135658 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7fc7ac066690 0x7fc7ac068b50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.315+0000 7fc7d5e00640 1 --2- 172.21.15.7:0/1353135658 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7d015c810 0x7fc7d00c5000 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.315+0000 7fc7d5e00640 1 --2- 172.21.15.7:0/1353135658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7d00cae60 0x7fc7d00c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.315+0000 7fc7d5e00640 1 --2- 172.21.15.7:0/1353135658 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7fc7d00c9e50 0x7fc7d0156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.315+0000 7fc7d5e00640 1 -- 172.21.15.7:0/1353135658 >> 172.21.15.7:0/1353135658 conn(0x7fc7d0065f10 msgr2=0x7fc7d00cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:45.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.315+0000 7fc7d5e00640 1 -- 172.21.15.7:0/1353135658 shutdown_connections 2024-09-13T15:17:45.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.315+0000 7fc7d5e00640 1 -- 172.21.15.7:0/1353135658 wait complete. 2024-09-13T15:17:45.337 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T15:17:45.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.475+0000 7f4bd5e00640 1 Processor -- start 2024-09-13T15:17:45.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.475+0000 7f4bd5e00640 1 -- start start 2024-09-13T15:17:45.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.475+0000 7f4bd5e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd00cae60 0x7f4bd00c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.475+0000 7f4bd5e00640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4bd015c810 0x7f4bd0159b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.475+0000 7f4bd5e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4bd00c9e50 0x7f4bd00cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.475+0000 7f4bd5e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd015cd50 con 0x7f4bd00c9e50 2024-09-13T15:17:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.475+0000 7f4bd5e00640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd015d030 con 0x7f4bd015c810 2024-09-13T15:17:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.475+0000 7f4bd5e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd015d310 con 0x7f4bd00cae60 2024-09-13T15:17:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.479+0000 7f4bcf400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4bd00c9e50 0x7f4bd00cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.479+0000 7f4bcf400640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f4bd00c9e50 0x7f4bd00cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40962/0 (socket says 172.21.15.7:40962) 2024-09-13T15:17:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.479+0000 7f4bcf400640 1 -- 172.21.15.7:0/3658612110 learned_addr learned my addr 172.21.15.7:0/3658612110 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.479+0000 7f4bc7e00640 1 --2- 172.21.15.7:0/3658612110 >> v2:172.21.15.77:3300/0 conn(0x7f4bd015c810 0x7f4bd0159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.479+0000 7f4bcea00640 1 --2- 172.21.15.7:0/3658612110 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd00cae60 0x7f4bd00c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.479+0000 7f4bcf400640 1 -- 172.21.15.7:0/3658612110 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd00cae60 msgr2=0x7f4bd00c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:17:45.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.479+0000 7f4bcf400640 1 --2- 172.21.15.7:0/3658612110 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd00cae60 0x7f4bd00c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.479+0000 7f4bcf400640 1 -- 172.21.15.7:0/3658612110 >> v2:172.21.15.77:3300/0 conn(0x7f4bd015c810 msgr2=0x7f4bd0159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:17:45.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.479+0000 7f4bcf400640 1 --2- 172.21.15.7:0/3658612110 >> v2:172.21.15.77:3300/0 conn(0x7f4bd015c810 0x7f4bd0159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.479+0000 7f4bcf400640 1 -- 172.21.15.7:0/3658612110 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd015d5f0 con 0x7f4bd00c9e50 2024-09-13T15:17:45.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.479+0000 7f4bcf400640 1 --2- 172.21.15.7:0/3658612110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd00c9e50 0x7f4bd00cefb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8009e50 tx=0x7f4bc801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0392df41319604 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:45.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.479+0000 7f4bce000640 1 -- 172.21.15.7:0/3658612110 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc80a56c0 con 0x7f4bd00c9e50 2024-09-13T15:17:45.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.479+0000 7f4bce000640 1 -- 172.21.15.7:0/3658612110 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4bc80a5820 con 0x7f4bd00c9e50 2024-09-13T15:17:45.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.479+0000 7f4bce000640 1 -- 172.21.15.7:0/3658612110 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc80a5bd0 con 0x7f4bd00c9e50 2024-09-13T15:17:45.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bd5e00640 1 -- 172.21.15.7:0/3658612110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd00c9e50 msgr2=0x7f4bd00cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:45.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bd5e00640 1 --2- 172.21.15.7:0/3658612110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd00c9e50 0x7f4bd00cefb0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8009e50 tx=0x7f4bc801c930 comp rx=0 tx=0).stop 2024-09-13T15:17:45.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bd5e00640 1 -- 172.21.15.7:0/3658612110 shutdown_connections 2024-09-13T15:17:45.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bd5e00640 1 --2- 172.21.15.7:0/3658612110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd00c9e50 0x7f4bd00cefb0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bd5e00640 1 --2- 172.21.15.7:0/3658612110 >> v2:172.21.15.77:3300/0 conn(0x7f4bd015c810 0x7f4bd0159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bd5e00640 1 --2- 172.21.15.7:0/3658612110 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd00cae60 0x7f4bd00c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bd5e00640 1 -- 172.21.15.7:0/3658612110 >> 172.21.15.7:0/3658612110 conn(0x7f4bd0065f10 msgr2=0x7f4bd0066320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:45.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bd5e00640 1 -- 172.21.15.7:0/3658612110 shutdown_connections 2024-09-13T15:17:45.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bd5e00640 1 -- 172.21.15.7:0/3658612110 wait complete. 2024-09-13T15:17:45.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bd5e00640 1 Processor -- start 2024-09-13T15:17:45.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bd5e00640 1 -- start start 2024-09-13T15:17:45.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bd5e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd00c9e50 0x7f4bd00c7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bd5e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd00cae60 0x7f4bd014ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bd5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd015c810 0x7f4bd00c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bd5e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd0156080 con 0x7f4bd015c810 2024-09-13T15:17:45.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bd5e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd00c8020 con 0x7f4bd00c9e50 2024-09-13T15:17:45.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bd5e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd00c8300 con 0x7f4bd00cae60 2024-09-13T15:17:45.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bcf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd015c810 0x7f4bd00c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bcf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd015c810 0x7f4bd00c5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40974/0 (socket says 172.21.15.7:40974) 2024-09-13T15:17:45.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bcf400640 1 -- 172.21.15.7:0/1876821462 learned_addr learned my addr 172.21.15.7:0/1876821462 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:45.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bc7e00640 1 --2- 172.21.15.7:0/1876821462 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd00cae60 0x7f4bd014ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.483+0000 7f4bcea00640 1 --2- 172.21.15.7:0/1876821462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd00c9e50 0x7f4bd00c7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.487+0000 7f4bcf400640 1 -- 172.21.15.7:0/1876821462 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd00cae60 msgr2=0x7f4bd014ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:45.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.487+0000 7f4bcf400640 1 --2- 172.21.15.7:0/1876821462 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd00cae60 0x7f4bd014ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.487+0000 7f4bcf400640 1 -- 172.21.15.7:0/1876821462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd00c9e50 msgr2=0x7f4bd00c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:45.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.487+0000 7f4bcf400640 1 --2- 172.21.15.7:0/1876821462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd00c9e50 0x7f4bd00c7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.487+0000 7f4bcf400640 1 -- 172.21.15.7:0/1876821462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc8009b30 con 0x7f4bd015c810 2024-09-13T15:17:45.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.487+0000 7f4bc7e00640 1 --2- 172.21.15.7:0/1876821462 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd00cae60 0x7f4bd014ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:17:45.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.487+0000 7f4bcf400640 1 --2- 172.21.15.7:0/1876821462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd015c810 0x7f4bd00c5fd0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4bc801afe0 tx=0x7f4bc80196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:45.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.487+0000 7f4bc7400640 1 -- 172.21.15.7:0/1876821462 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8009510 con 0x7f4bd015c810 2024-09-13T15:17:45.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.487+0000 7f4bc7400640 1 -- 172.21.15.7:0/1876821462 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4bc80b8470 con 0x7f4bd015c810 2024-09-13T15:17:45.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.487+0000 7f4bc7400640 1 -- 172.21.15.7:0/1876821462 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc80b8840 con 0x7f4bd015c810 2024-09-13T15:17:45.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.487+0000 7f4bd5e00640 1 -- 172.21.15.7:0/1876821462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd00c7130 con 0x7f4bd015c810 2024-09-13T15:17:45.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.487+0000 7f4bd5e00640 1 -- 172.21.15.7:0/1876821462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd01f2450 con 0x7f4bd015c810 2024-09-13T15:17:45.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.487+0000 7f4bd5e00640 1 -- 172.21.15.7:0/1876821462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd0067650 con 0x7f4bd015c810 2024-09-13T15:17:45.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.487+0000 7f4bc7400640 1 -- 172.21.15.7:0/1876821462 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4bc80b89a0 con 0x7f4bd015c810 2024-09-13T15:17:45.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.491+0000 7f4bc7400640 1 --2- 172.21.15.7:0/1876821462 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bac0666c0 0x7f4bac068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.491+0000 7f4bc7400640 1 -- 172.21.15.7:0/1876821462 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f4bc811fa60 con 0x7f4bd015c810 2024-09-13T15:17:45.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.491+0000 7f4bcea00640 1 --2- 172.21.15.7:0/1876821462 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bac0666c0 0x7f4bac068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.491+0000 7f4bcea00640 1 --2- 172.21.15.7:0/1876821462 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bac0666c0 0x7f4bac068b80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009b60 tx=0x7f4bc0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:45.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.495+0000 7f4bc7400640 1 -- 172.21.15.7:0/1876821462 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4bc80ec6e0 con 0x7f4bd015c810 2024-09-13T15:17:45.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.691+0000 7f4bd5e00640 1 -- 172.21.15.7:0/1876821462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4bd00cefb0 con 0x7f4bd015c810 2024-09-13T15:17:45.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.691+0000 7f4bc7400640 1 -- 172.21.15.7:0/1876821462 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+6284 (secure 0 0 0) 0x7f4bc80efd00 con 0x7f4bd015c810 2024-09-13T15:17:45.693 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:17:45.693 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":58,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5156,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/3708232086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6835","nonce":3708232086},{"type":"v1","addr":"172.21.15.7:6837","nonce":3708232086}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36},{"gid":5697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6836/118107059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":118107059},{"type":"v1","addr":"172.21.15.7:6836","nonce":118107059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T15:01:44.789559+0000","modified":"2024-09-13T15:15:52.066397+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":4,"in":[0,1,2,3],"up":{"mds_0":5710,"mds_1":5569,"mds_2":5198,"mds_3":5069},"failed":[],"damaged":[],"stopped":[4],"info":{"gid_5069":{"gid":5069,"name":"b","rank":3,"incarnation":31,"state":"up:active","state_seq":43,"addr":"172.21.15.77:6838/877425259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":877425259},{"type":"v1","addr":"172.21.15.77:6838","nonce":877425259}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5198":{"gid":5198,"name":"e","rank":2,"incarnation":41,"state":"up:active","state_seq":14,"addr":"172.21.15.7:6833/1355774527","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":1355774527},{"type":"v1","addr":"172.21.15.7:6833","nonce":1355774527}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5569":{"gid":5569,"name":"d","rank":1,"incarnation":47,"state":"up:active","state_seq":30,"addr":"172.21.15.77:6835/1536067351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":1536067351},{"type":"v1","addr":"172.21.15.77:6835","nonce":1536067351}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_5710":{"gid":5710,"name":"f","rank":0,"incarnation":53,"state":"up:active","state_seq":26,"addr":"172.21.15.77:6839/3948947951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6837","nonce":3948947951},{"type":"v1","addr":"172.21.15.77:6839","nonce":3948947951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T15:17:45.694 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 58 2024-09-13T15:17:45.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.691+0000 7f4bd5e00640 1 -- 172.21.15.7:0/1876821462 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bac0666c0 msgr2=0x7f4bac068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:45.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.691+0000 7f4bd5e00640 1 --2- 172.21.15.7:0/1876821462 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bac0666c0 0x7f4bac068b80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0009b60 tx=0x7f4bc0009190 comp rx=0 tx=0).stop 2024-09-13T15:17:45.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.691+0000 7f4bd5e00640 1 -- 172.21.15.7:0/1876821462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd015c810 msgr2=0x7f4bd00c5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:45.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.691+0000 7f4bd5e00640 1 --2- 172.21.15.7:0/1876821462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd015c810 0x7f4bd00c5fd0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4bc801afe0 tx=0x7f4bc80196d0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.691+0000 7f4bd5e00640 1 -- 172.21.15.7:0/1876821462 shutdown_connections 2024-09-13T15:17:45.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.691+0000 7f4bd5e00640 1 --2- 172.21.15.7:0/1876821462 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f4bac0666c0 0x7f4bac068b80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.691+0000 7f4bd5e00640 1 --2- 172.21.15.7:0/1876821462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd015c810 0x7f4bd00c5fd0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.691+0000 7f4bd5e00640 1 --2- 172.21.15.7:0/1876821462 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f4bd00cae60 0x7f4bd014ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.691+0000 7f4bd5e00640 1 --2- 172.21.15.7:0/1876821462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4bd00c9e50 0x7f4bd00c7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.691+0000 7f4bd5e00640 1 -- 172.21.15.7:0/1876821462 >> 172.21.15.7:0/1876821462 conn(0x7f4bd0065f10 msgr2=0x7f4bd00662f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:45.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.695+0000 7f4bd5e00640 1 -- 172.21.15.7:0/1876821462 shutdown_connections 2024-09-13T15:17:45.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.695+0000 7f4bd5e00640 1 -- 172.21.15.7:0/1876821462 wait complete. 2024-09-13T15:17:45.715 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T15:17:45.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.855+0000 7f26e3200640 1 Processor -- start 2024-09-13T15:17:45.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.855+0000 7f26e3200640 1 -- start start 2024-09-13T15:17:45.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.855+0000 7f26e3200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f26e4156500 0x7f26e415c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.855+0000 7f26e3200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26e4159a90 0x7f26e40712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.855+0000 7f26e3200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f26e40717f0 0x7f26e40b2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.855+0000 7f26e3200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e40c92e0 con 0x7f26e40717f0 2024-09-13T15:17:45.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.855+0000 7f26e3200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e415cbc0 con 0x7f26e4156500 2024-09-13T15:17:45.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.855+0000 7f26e3200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e415cea0 con 0x7f26e4159a90 2024-09-13T15:17:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.855+0000 7f26e2800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f26e40717f0 0x7f26e40b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.859+0000 7f26e2800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f26e40717f0 0x7f26e40b2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40984/0 (socket says 172.21.15.7:40984) 2024-09-13T15:17:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.859+0000 7f26e2800640 1 -- 172.21.15.7:0/2133657141 learned_addr learned my addr 172.21.15.7:0/2133657141 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.859+0000 7f26e1e00640 1 --2- 172.21.15.7:0/2133657141 >> v2:172.21.15.77:3300/0 conn(0x7f26e4156500 0x7f26e415c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.859+0000 7f26dbe00640 1 --2- 172.21.15.7:0/2133657141 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26e4159a90 0x7f26e40712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.859+0000 7f26e2800640 1 -- 172.21.15.7:0/2133657141 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26e4159a90 msgr2=0x7f26e40712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:17:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.859+0000 7f26e2800640 1 --2- 172.21.15.7:0/2133657141 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26e4159a90 0x7f26e40712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.859+0000 7f26e2800640 1 -- 172.21.15.7:0/2133657141 >> v2:172.21.15.77:3300/0 conn(0x7f26e4156500 msgr2=0x7f26e415c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:17:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.859+0000 7f26e2800640 1 --2- 172.21.15.7:0/2133657141 >> v2:172.21.15.77:3300/0 conn(0x7f26e4156500 0x7f26e415c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.859+0000 7f26e2800640 1 -- 172.21.15.7:0/2133657141 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e415d180 con 0x7f26e40717f0 2024-09-13T15:17:45.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.859+0000 7f26e1e00640 1 --2- 172.21.15.7:0/2133657141 >> v2:172.21.15.77:3300/0 conn(0x7f26e4156500 0x7f26e415c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:17:45.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.859+0000 7f26e2800640 1 --2- 172.21.15.7:0/2133657141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e40717f0 0x7f26e40b2410 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f26e406bd80 tx=0x7f26dc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91badbeabe8f33f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:45.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.859+0000 7f26e1400640 1 -- 172.21.15.7:0/2133657141 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc0a55e0 con 0x7f26e40717f0 2024-09-13T15:17:45.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.859+0000 7f26e1400640 1 -- 172.21.15.7:0/2133657141 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f26dc0a5740 con 0x7f26e40717f0 2024-09-13T15:17:45.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.859+0000 7f26e1400640 1 -- 172.21.15.7:0/2133657141 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc0a5af0 con 0x7f26e40717f0 2024-09-13T15:17:45.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e3200640 1 -- 172.21.15.7:0/2133657141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e40717f0 msgr2=0x7f26e40b2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:45.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e3200640 1 --2- 172.21.15.7:0/2133657141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e40717f0 0x7f26e40b2410 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f26e406bd80 tx=0x7f26dc01c960 comp rx=0 tx=0).stop 2024-09-13T15:17:45.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e3200640 1 -- 172.21.15.7:0/2133657141 shutdown_connections 2024-09-13T15:17:45.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e3200640 1 --2- 172.21.15.7:0/2133657141 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e40717f0 0x7f26e40b2410 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e3200640 1 --2- 172.21.15.7:0/2133657141 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26e4159a90 0x7f26e40712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e3200640 1 --2- 172.21.15.7:0/2133657141 >> v2:172.21.15.77:3300/0 conn(0x7f26e4156500 0x7f26e415c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e3200640 1 -- 172.21.15.7:0/2133657141 >> 172.21.15.7:0/2133657141 conn(0x7f26e40739a0 msgr2=0x7f26e406b220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:45.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e3200640 1 -- 172.21.15.7:0/2133657141 shutdown_connections 2024-09-13T15:17:45.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e3200640 1 -- 172.21.15.7:0/2133657141 wait complete. 2024-09-13T15:17:45.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e3200640 1 Processor -- start 2024-09-13T15:17:45.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e3200640 1 -- start start 2024-09-13T15:17:45.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e3200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26e40717f0 0x7f26e40c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e3200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26e4156500 0x7f26e415b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e3200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e4159a90 0x7f26e41f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e3200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e41f1e40 con 0x7f26e4159a90 2024-09-13T15:17:45.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e3200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e415a210 con 0x7f26e4156500 2024-09-13T15:17:45.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e3200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e41f1810 con 0x7f26e40717f0 2024-09-13T15:17:45.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e4159a90 0x7f26e41f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e2800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e4159a90 0x7f26e41f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41000/0 (socket says 172.21.15.7:41000) 2024-09-13T15:17:45.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e2800640 1 -- 172.21.15.7:0/2440778150 learned_addr learned my addr 172.21.15.7:0/2440778150 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:45.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26dbe00640 1 --2- 172.21.15.7:0/2440778150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26e4156500 0x7f26e415b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e1e00640 1 --2- 172.21.15.7:0/2440778150 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26e40717f0 0x7f26e40c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e2800640 1 -- 172.21.15.7:0/2440778150 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26e40717f0 msgr2=0x7f26e40c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:45.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e2800640 1 --2- 172.21.15.7:0/2440778150 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26e40717f0 0x7f26e40c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e2800640 1 -- 172.21.15.7:0/2440778150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26e4156500 msgr2=0x7f26e415b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:45.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e2800640 1 --2- 172.21.15.7:0/2440778150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26e4156500 0x7f26e415b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:45.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.863+0000 7f26e2800640 1 -- 172.21.15.7:0/2440778150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc009b30 con 0x7f26e4159a90 2024-09-13T15:17:45.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.867+0000 7f26e2800640 1 --2- 172.21.15.7:0/2440778150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e4159a90 0x7f26e41f22d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0af040 tx=0x7f26dc019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:45.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.867+0000 7f26da000640 1 -- 172.21.15.7:0/2440778150 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc0b8670 con 0x7f26e4159a90 2024-09-13T15:17:45.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.867+0000 7f26da000640 1 -- 172.21.15.7:0/2440778150 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f26dc0b87f0 con 0x7f26e4159a90 2024-09-13T15:17:45.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.867+0000 7f26da000640 1 -- 172.21.15.7:0/2440778150 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc0b8bc0 con 0x7f26e4159a90 2024-09-13T15:17:45.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.867+0000 7f26e3200640 1 -- 172.21.15.7:0/2440778150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e415a4b0 con 0x7f26e4159a90 2024-09-13T15:17:45.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.867+0000 7f26e3200640 1 -- 172.21.15.7:0/2440778150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e41f1ad0 con 0x7f26e4159a90 2024-09-13T15:17:45.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.867+0000 7f26e3200640 1 -- 172.21.15.7:0/2440778150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e41f1fb0 con 0x7f26e4159a90 2024-09-13T15:17:45.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.867+0000 7f26da000640 1 -- 172.21.15.7:0/2440778150 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f26dc0b8d20 con 0x7f26e4159a90 2024-09-13T15:17:45.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.867+0000 7f26da000640 1 --2- 172.21.15.7:0/2440778150 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f26c00666c0 0x7f26c0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:45.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.867+0000 7f26da000640 1 -- 172.21.15.7:0/2440778150 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f26dc11fd10 con 0x7f26e4159a90 2024-09-13T15:17:45.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.867+0000 7f26e1e00640 1 --2- 172.21.15.7:0/2440778150 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f26c00666c0 0x7f26c0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:45.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.871+0000 7f26e1e00640 1 --2- 172.21.15.7:0/2440778150 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f26c00666c0 0x7f26c0068b80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f26d400c880 tx=0x7f26d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:45.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:45.871+0000 7f26da000640 1 -- 172.21.15.7:0/2440778150 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f26dc125020 con 0x7f26e4159a90 2024-09-13T15:17:46.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.067+0000 7f26e3200640 1 -- 172.21.15.7:0/2440778150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26e40cc1f0 con 0x7f26e4159a90 2024-09-13T15:17:46.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.071+0000 7f26da000640 1 -- 172.21.15.7:0/2440778150 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+19389 (secure 0 0 0) 0x7f26dc0eccb0 con 0x7f26e4159a90 2024-09-13T15:17:46.072 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-13T15:17:46.072 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":33,"fsid":"92e6844f-41e8-44ce-a6e6-13b9cf520744","created":"2024-09-13T15:01:27.819030+0000","modified":"2024-09-13T15:15:27.857916+0000","last_up_change":"2024-09-13T15:01:38.262262+0000","last_in_change":"2024-09-13T15:01:30.114559+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T15:01:38.710958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T15:01:43.178724+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T15:01:43.774877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-13T15:01:46.843203+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"060d28f6-42eb-4748-b9a9-8855924cf8ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6801","nonce":834888081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6803","nonce":834888081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6807","nonce":834888081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":834888081},{"type":"v1","addr":"172.21.15.7:6805","nonce":834888081}]},"public_addr":"172.21.15.7:6801/834888081","cluster_addr":"172.21.15.7:6803/834888081","heartbeat_back_addr":"172.21.15.7:6807/834888081","heartbeat_front_addr":"172.21.15.7:6805/834888081","state":["exists","up"]},{"osd":1,"uuid":"349eb66a-9c21-4e17-b6e0-ebd0741b1813","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6809","nonce":436262321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6811","nonce":436262321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6815","nonce":436262321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":436262321},{"type":"v1","addr":"172.21.15.7:6813","nonce":436262321}]},"public_addr":"172.21.15.7:6809/436262321","cluster_addr":"172.21.15.7:6811/436262321","heartbeat_back_addr":"172.21.15.7:6815/436262321","heartbeat_front_addr":"172.21.15.7:6813/436262321","state":["exists","up"]},{"osd":2,"uuid":"e8f63b8d-dfc8-4419-bc70-9af51b5ad1cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6817","nonce":1539771714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6819","nonce":1539771714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6823","nonce":1539771714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":1539771714},{"type":"v1","addr":"172.21.15.7:6821","nonce":1539771714}]},"public_addr":"172.21.15.7:6817/1539771714","cluster_addr":"172.21.15.7:6819/1539771714","heartbeat_back_addr":"172.21.15.7:6823/1539771714","heartbeat_front_addr":"172.21.15.7:6821/1539771714","state":["exists","up"]},{"osd":3,"uuid":"62a53e35-fdf1-4244-877a-5b751d689d3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6825","nonce":3381512335}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6827","nonce":3381512335}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6831","nonce":3381512335}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":3381512335},{"type":"v1","addr":"172.21.15.7:6829","nonce":3381512335}]},"public_addr":"172.21.15.7:6825/3381512335","cluster_addr":"172.21.15.7:6827/3381512335","heartbeat_back_addr":"172.21.15.7:6831/3381512335","heartbeat_front_addr":"172.21.15.7:6829/3381512335","state":["exists","up"]},{"osd":4,"uuid":"edba7b1c-b326-4dfa-af20-8b7c4cb576a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6801","nonce":2910694434}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6803","nonce":2910694434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6808","nonce":2910694434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":2910694434},{"type":"v1","addr":"172.21.15.77:6805","nonce":2910694434}]},"public_addr":"172.21.15.77:6801/2910694434","cluster_addr":"172.21.15.77:6803/2910694434","heartbeat_back_addr":"172.21.15.77:6808/2910694434","heartbeat_front_addr":"172.21.15.77:6805/2910694434","state":["exists","up"]},{"osd":5,"uuid":"0915849d-f8c3-4966-afd5-0ef25772528a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6817","nonce":2210594384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6819","nonce":2210594384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6823","nonce":2210594384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2210594384},{"type":"v1","addr":"172.21.15.77:6821","nonce":2210594384}]},"public_addr":"172.21.15.77:6817/2210594384","cluster_addr":"172.21.15.77:6819/2210594384","heartbeat_back_addr":"172.21.15.77:6823/2210594384","heartbeat_front_addr":"172.21.15.77:6821/2210594384","state":["exists","up"]},{"osd":6,"uuid":"705b7938-2616-4ce7-862e-6c1f8f3236f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6807","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6809","nonce":1578568057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6811","nonce":1578568057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6815","nonce":1578568057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1578568057},{"type":"v1","addr":"172.21.15.77:6813","nonce":1578568057}]},"public_addr":"172.21.15.77:6809/1578568057","cluster_addr":"172.21.15.77:6811/1578568057","heartbeat_back_addr":"172.21.15.77:6815/1578568057","heartbeat_front_addr":"172.21.15.77:6813/1578568057","state":["exists","up"]},{"osd":7,"uuid":"ceb01c37-fe33-4ee2-b11f-07fadc39a96b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6825","nonce":328054321}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6827","nonce":328054321}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6831","nonce":328054321}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":328054321},{"type":"v1","addr":"172.21.15.77:6829","nonce":328054321}]},"public_addr":"172.21.15.77:6825/328054321","cluster_addr":"172.21.15.77:6827/328054321","heartbeat_back_addr":"172.21.15.77:6831/328054321","heartbeat_front_addr":"172.21.15.77:6829/328054321","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.766097+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.781996+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.805076+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.943240+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.427528+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.541810+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.615978+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T15:01:35.445610+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.1e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:6836/2396967179":"2024-09-14T15:15:27.857855+0000","172.21.15.7:6834/2396967179":"2024-09-14T15:15:27.857855+0000","172.21.15.77:6839/2233000674":"2024-09-14T15:13:27.782565+0000","172.21.15.77:6837/2233000674":"2024-09-14T15:13:27.782565+0000","172.21.15.77:6835/2367107997":"2024-09-14T15:11:57.741130+0000","172.21.15.7:6837/3369648543":"2024-09-14T15:09:52.666380+0000","172.21.15.7:6835/3369648543":"2024-09-14T15:09:52.666380+0000","172.21.15.77:6838/3330080895":"2024-09-14T15:07:12.613134+0000","172.21.15.77:6836/3330080895":"2024-09-14T15:07:12.613134+0000","172.21.15.77:6834/2367107997":"2024-09-14T15:11:57.741130+0000","172.21.15.7:6833/2907495549":"2024-09-14T15:05:07.589499+0000","172.21.15.7:6832/2907495549":"2024-09-14T15:05:07.589499+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T15:17:46.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.071+0000 7f26e3200640 1 -- 172.21.15.7:0/2440778150 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f26c00666c0 msgr2=0x7f26c0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:46.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.071+0000 7f26e3200640 1 --2- 172.21.15.7:0/2440778150 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f26c00666c0 0x7f26c0068b80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f26d400c880 tx=0x7f26d4008040 comp rx=0 tx=0).stop 2024-09-13T15:17:46.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.071+0000 7f26e3200640 1 -- 172.21.15.7:0/2440778150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e4159a90 msgr2=0x7f26e41f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:46.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.071+0000 7f26e3200640 1 --2- 172.21.15.7:0/2440778150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e4159a90 0x7f26e41f22d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0af040 tx=0x7f26dc019700 comp rx=0 tx=0).stop 2024-09-13T15:17:46.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.071+0000 7f26e3200640 1 -- 172.21.15.7:0/2440778150 shutdown_connections 2024-09-13T15:17:46.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.071+0000 7f26e3200640 1 --2- 172.21.15.7:0/2440778150 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f26c00666c0 0x7f26c0068b80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:46.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.071+0000 7f26e3200640 1 --2- 172.21.15.7:0/2440778150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e4159a90 0x7f26e41f22d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:46.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.071+0000 7f26e3200640 1 --2- 172.21.15.7:0/2440778150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f26e4156500 0x7f26e415b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:46.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.071+0000 7f26e3200640 1 --2- 172.21.15.7:0/2440778150 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f26e40717f0 0x7f26e40c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:46.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.071+0000 7f26e3200640 1 -- 172.21.15.7:0/2440778150 >> 172.21.15.7:0/2440778150 conn(0x7f26e40739a0 msgr2=0x7f26e40cf400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:46.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.071+0000 7f26e3200640 1 -- 172.21.15.7:0/2440778150 shutdown_connections 2024-09-13T15:17:46.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.071+0000 7f26e3200640 1 -- 172.21.15.7:0/2440778150 wait complete. 2024-09-13T15:17:46.096 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T15:17:46.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.239+0000 7f2bb4200640 1 Processor -- start 2024-09-13T15:17:46.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.239+0000 7f2bb4200640 1 -- start start 2024-09-13T15:17:46.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.239+0000 7f2bb4200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2bac0cb180 0x7f2bac159830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:46.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.239+0000 7f2bb4200640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bac15d5d0 con 0x7f2bac1533a0 2024-09-13T15:17:46.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.239+0000 7f2bb4200640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bac0ca1e0 con 0x7f2bac159d70 2024-09-13T15:17:46.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.239+0000 7f2bb4200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bac15ca50 con 0x7f2bac0cb180 2024-09-13T15:17:46.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.239+0000 7f2bb1800640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f2bac1533a0 0x7f2bac0c9ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59128/0 (socket says 172.21.15.7:59128) 2024-09-13T15:17:46.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.239+0000 7f2bb1800640 1 -- 172.21.15.7:0/4206420761 learned_addr learned my addr 172.21.15.7:0/4206420761 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:17:46.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.239+0000 7f2bb0e00640 1 --2- 172.21.15.7:0/4206420761 >> v2:172.21.15.77:3300/0 conn(0x7f2bac0cb180 0x7f2bac159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.239+0000 7f2babe00640 1 -- 172.21.15.7:0/4206420761 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568982796 0 0) 0x7f2bac15d5d0 con 0x7f2bac1533a0 2024-09-13T15:17:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.239+0000 7f2babe00640 1 -- 172.21.15.7:0/4206420761 --> v1:172.21.15.7:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b94003530 con 0x7f2bac1533a0 2024-09-13T15:17:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.239+0000 7f2bb0e00640 1 -- 172.21.15.7:0/4206420761 >> v1:172.21.15.77:6789/0 conn(0x7f2bac159d70 legacy=0x7f2bac0ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.239+0000 7f2babe00640 1 -- 172.21.15.7:0/4206420761 <== mon.0 v1:172.21.15.7:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 738099593 0 0) 0x7f2b94003530 con 0x7f2bac1533a0 2024-09-13T15:17:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.239+0000 7f2bb0e00640 1 -- 172.21.15.7:0/4206420761 >> v1:172.21.15.7:6789/0 conn(0x7f2bac1533a0 legacy=0x7f2bac0c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:46.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.239+0000 7f2bb0e00640 1 -- 172.21.15.7:0/4206420761 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac15cd30 con 0x7f2bac0cb180 2024-09-13T15:17:46.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.243+0000 7f2bb0e00640 1 --2- 172.21.15.7:0/4206420761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac0cb180 0x7f2bac159830 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2b980097c0 tx=0x7f2b9801ebb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dd1b74c2f6d2ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:46.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.243+0000 7f2babe00640 1 -- 172.21.15.7:0/4206420761 <== mon.1 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0001680 con 0x7f2bac0cb180 2024-09-13T15:17:46.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.243+0000 7f2babe00640 1 -- 172.21.15.7:0/4206420761 <== mon.1 v2:172.21.15.77:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2b980a8630 con 0x7f2bac0cb180 2024-09-13T15:17:46.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.243+0000 7f2babe00640 1 -- 172.21.15.7:0/4206420761 <== mon.1 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b980a89a0 con 0x7f2bac0cb180 2024-09-13T15:17:46.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.243+0000 7f2bb4200640 1 -- 172.21.15.7:0/4206420761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac0cb180 msgr2=0x7f2bac159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:46.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.243+0000 7f2bb4200640 1 --2- 172.21.15.7:0/4206420761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac0cb180 0x7f2bac159830 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2b980097c0 tx=0x7f2b9801ebb0 comp rx=0 tx=0).stop 2024-09-13T15:17:46.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.243+0000 7f2bb4200640 1 -- 172.21.15.7:0/4206420761 shutdown_connections 2024-09-13T15:17:46.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.243+0000 7f2bb4200640 1 --2- 172.21.15.7:0/4206420761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac0cb180 0x7f2bac159830 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:46.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.243+0000 7f2bb4200640 1 -- 172.21.15.7:0/4206420761 >> 172.21.15.7:0/4206420761 conn(0x7f2bac06b940 msgr2=0x7f2bac065d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:46.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.243+0000 7f2bb4200640 1 -- 172.21.15.7:0/4206420761 shutdown_connections 2024-09-13T15:17:46.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.243+0000 7f2bb4200640 1 -- 172.21.15.7:0/4206420761 wait complete. 2024-09-13T15:17:46.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb4200640 1 Processor -- start 2024-09-13T15:17:46.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb4200640 1 -- start start 2024-09-13T15:17:46.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb4200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac0cb180 0x7f2bac1f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:46.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb4200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac1533a0 0x7f2bac1e3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:46.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb4200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac159d70 0x7f2bac1e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb4200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac1f2d00 con 0x7f2bac1533a0 2024-09-13T15:17:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb4200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac1e43d0 con 0x7f2bac159d70 2024-09-13T15:17:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb4200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac1e4650 con 0x7f2bac0cb180 2024-09-13T15:17:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac1533a0 0x7f2bac1e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb0e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac1533a0 0x7f2bac1e3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41008/0 (socket says 172.21.15.7:41008) 2024-09-13T15:17:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb2200640 1 --2- 172.21.15.7:0/2965375494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac159d70 0x7f2bac1e3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb0e00640 1 -- 172.21.15.7:0/2965375494 learned_addr learned my addr 172.21.15.7:0/2965375494 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb1800640 1 --2- 172.21.15.7:0/2965375494 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac0cb180 0x7f2bac1f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb0e00640 1 -- 172.21.15.7:0/2965375494 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac0cb180 msgr2=0x7f2bac1f1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb0e00640 1 --2- 172.21.15.7:0/2965375494 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac0cb180 0x7f2bac1f1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb0e00640 1 -- 172.21.15.7:0/2965375494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac159d70 msgr2=0x7f2bac1e3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb0e00640 1 --2- 172.21.15.7:0/2965375494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac159d70 0x7f2bac1e3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb0e00640 1 -- 172.21.15.7:0/2965375494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b98009420 con 0x7f2bac1533a0 2024-09-13T15:17:46.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb0e00640 1 --2- 172.21.15.7:0/2965375494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac1533a0 0x7f2bac1e3560 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2b98000c10 tx=0x7f2b9801b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:46.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2ba9600640 1 -- 172.21.15.7:0/2965375494 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b980a9dc0 con 0x7f2bac1533a0 2024-09-13T15:17:46.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2ba9600640 1 -- 172.21.15.7:0/2965375494 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2b98003620 con 0x7f2bac1533a0 2024-09-13T15:17:46.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb4200640 1 -- 172.21.15.7:0/2965375494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bac1f2a20 con 0x7f2bac1533a0 2024-09-13T15:17:46.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2ba9600640 1 -- 172.21.15.7:0/2965375494 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b98003990 con 0x7f2bac1533a0 2024-09-13T15:17:46.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.247+0000 7f2bb4200640 1 -- 172.21.15.7:0/2965375494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac0c3b40 con 0x7f2bac1533a0 2024-09-13T15:17:46.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.251+0000 7f2bb4200640 1 -- 172.21.15.7:0/2965375494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bac1e2ea0 con 0x7f2bac1533a0 2024-09-13T15:17:46.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.251+0000 7f2ba9600640 1 -- 172.21.15.7:0/2965375494 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2b980b7040 con 0x7f2bac1533a0 2024-09-13T15:17:46.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.251+0000 7f2ba9600640 1 --2- 172.21.15.7:0/2965375494 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b8c0666c0 0x7f2b8c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:46.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.251+0000 7f2ba9600640 1 -- 172.21.15.7:0/2965375494 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 7179+0+0 (secure 0 0 0) 0x7f2b98121da0 con 0x7f2bac1533a0 2024-09-13T15:17:46.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.251+0000 7f2bb1800640 1 --2- 172.21.15.7:0/2965375494 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b8c0666c0 0x7f2b8c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:46.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.251+0000 7f2bb1800640 1 --2- 172.21.15.7:0/2965375494 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b8c0666c0 0x7f2b8c068b80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0001ec0 tx=0x7f2ba0001a60 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:46.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.259+0000 7f2ba9600640 1 -- 172.21.15.7:0/2965375494 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2bac1e2ea0 con 0x7f2bac1533a0 2024-09-13T15:17:46.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.455+0000 7f2bb4200640 1 -- 172.21.15.7:0/2965375494 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2bac1e2ea0 con 0x7f2bac1533a0 2024-09-13T15:17:46.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.467+0000 7f2ba9600640 1 -- 172.21.15.7:0/2965375494 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2bac1e2ea0 con 0x7f2bac1533a0 2024-09-13T15:17:46.471 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T15:17:46.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.471+0000 7f2bb4200640 1 -- 172.21.15.7:0/2965375494 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b8c0666c0 msgr2=0x7f2b8c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:46.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.471+0000 7f2bb4200640 1 --2- 172.21.15.7:0/2965375494 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b8c0666c0 0x7f2b8c068b80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0001ec0 tx=0x7f2ba0001a60 comp rx=0 tx=0).stop 2024-09-13T15:17:46.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.471+0000 7f2bb4200640 1 -- 172.21.15.7:0/2965375494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac1533a0 msgr2=0x7f2bac1e3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:46.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.471+0000 7f2bb4200640 1 --2- 172.21.15.7:0/2965375494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac1533a0 0x7f2bac1e3560 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2b98000c10 tx=0x7f2b9801b950 comp rx=0 tx=0).stop 2024-09-13T15:17:46.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.471+0000 7f2bb4200640 1 -- 172.21.15.7:0/2965375494 shutdown_connections 2024-09-13T15:17:46.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.471+0000 7f2bb4200640 1 --2- 172.21.15.7:0/2965375494 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f2b8c0666c0 0x7f2b8c068b80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:46.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.471+0000 7f2bb4200640 1 --2- 172.21.15.7:0/2965375494 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bac159d70 0x7f2bac1e3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:46.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.471+0000 7f2bb4200640 1 --2- 172.21.15.7:0/2965375494 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2bac1533a0 0x7f2bac1e3560 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:46.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.471+0000 7f2bb4200640 1 --2- 172.21.15.7:0/2965375494 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f2bac0cb180 0x7f2bac1f1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:46.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.471+0000 7f2bb4200640 1 -- 172.21.15.7:0/2965375494 >> 172.21.15.7:0/2965375494 conn(0x7f2bac06b940 msgr2=0x7f2bac1521f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:46.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.471+0000 7f2bb4200640 1 -- 172.21.15.7:0/2965375494 shutdown_connections 2024-09-13T15:17:46.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.471+0000 7f2bb4200640 1 -- 172.21.15.7:0/2965375494 wait complete. 2024-09-13T15:17:46.497 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T15:17:46.541 INFO:tasks.ceph.mds.e.smithi007.stdout:starting mds.e at 2024-09-13T15:17:46.555 INFO:tasks.ceph.mds.d.smithi077.stdout:starting mds.d at 2024-09-13T15:17:46.555 INFO:tasks.ceph.mds.b.smithi077.stdout:starting mds.b at 2024-09-13T15:17:46.556 INFO:tasks.ceph.mds.f.smithi077.stdout:starting mds.f at 2024-09-13T15:17:46.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.643+0000 7f5e76e00640 1 Processor -- start 2024-09-13T15:17:46.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.643+0000 7f5e76e00640 1 -- start start 2024-09-13T15:17:46.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.647+0000 7f5e76e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5e700cae60 0x7f5e700c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:46.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.647+0000 7f5e76e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7015cd50 con 0x7f5e7015c810 2024-09-13T15:17:46.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.647+0000 7f5e76e00640 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7015d030 con 0x7f5e700c9e50 2024-09-13T15:17:46.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.647+0000 7f5e76e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7015a220 con 0x7f5e700cae60 2024-09-13T15:17:46.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.647+0000 7f5e6fe00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f5e700cae60 0x7f5e700c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:46.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.647+0000 7f5e6f400640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f5e7015c810 0x7f5e70159b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:59140/0 (socket says 172.21.15.7:59140) 2024-09-13T15:17:46.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.647+0000 7f5e6f400640 1 -- 172.21.15.7:0/2639759462 learned_addr learned my addr 172.21.15.7:0/2639759462 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:17:46.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.647+0000 7f5e6fe00640 1 -- 172.21.15.7:0/2639759462 >> v1:172.21.15.77:6789/0 conn(0x7f5e700c9e50 legacy=0x7f5e700cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:46.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.647+0000 7f5e6fe00640 1 -- 172.21.15.7:0/2639759462 >> v1:172.21.15.7:6789/0 conn(0x7f5e7015c810 legacy=0x7f5e70159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:46.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.647+0000 7f5e6fe00640 1 -- 172.21.15.7:0/2639759462 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7015d310 con 0x7f5e700cae60 2024-09-13T15:17:46.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e6fe00640 1 --2- 172.21.15.7:0/2639759462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e700cae60 0x7f5e700c9820 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5e600097c0 tx=0x7f5e6001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a5072bb662ad38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:46.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e6ea00640 1 -- 172.21.15.7:0/2639759462 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e600ac640 con 0x7f5e700cae60 2024-09-13T15:17:46.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e6ea00640 1 -- 172.21.15.7:0/2639759462 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5e600ac7a0 con 0x7f5e700cae60 2024-09-13T15:17:46.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e6ea00640 1 -- 172.21.15.7:0/2639759462 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e600acb50 con 0x7f5e700cae60 2024-09-13T15:17:46.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e76e00640 1 -- 172.21.15.7:0/2639759462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e700cae60 msgr2=0x7f5e700c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:46.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e76e00640 1 --2- 172.21.15.7:0/2639759462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e700cae60 0x7f5e700c9820 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f5e600097c0 tx=0x7f5e6001c3e0 comp rx=0 tx=0).stop 2024-09-13T15:17:46.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e76e00640 1 -- 172.21.15.7:0/2639759462 shutdown_connections 2024-09-13T15:17:46.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e76e00640 1 --2- 172.21.15.7:0/2639759462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e700cae60 0x7f5e700c9820 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:46.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e76e00640 1 -- 172.21.15.7:0/2639759462 >> 172.21.15.7:0/2639759462 conn(0x7f5e70065f10 msgr2=0x7f5e70066320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:46.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e76e00640 1 -- 172.21.15.7:0/2639759462 shutdown_connections 2024-09-13T15:17:46.653 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e76e00640 1 -- 172.21.15.7:0/2639759462 wait complete. 2024-09-13T15:17:46.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e76e00640 1 Processor -- start 2024-09-13T15:17:46.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e76e00640 1 -- start start 2024-09-13T15:17:46.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e76e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e700c9e50 0x7f5e70149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:46.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e76e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e700cae60 0x7f5e700c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:46.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e76e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e7015c810 0x7f5e70145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:46.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e76e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700c6b70 con 0x7f5e7015c810 2024-09-13T15:17:46.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e76e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700c7bc0 con 0x7f5e700c9e50 2024-09-13T15:17:46.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.651+0000 7f5e76e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700c6820 con 0x7f5e700cae60 2024-09-13T15:17:46.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e74e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e7015c810 0x7f5e70145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:46.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e74e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e7015c810 0x7f5e70145c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41032/0 (socket says 172.21.15.7:41032) 2024-09-13T15:17:46.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e74e00640 1 -- 172.21.15.7:0/1052780298 learned_addr learned my addr 172.21.15.7:0/1052780298 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:46.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e6f400640 1 --2- 172.21.15.7:0/1052780298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e700cae60 0x7f5e700c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:46.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e6fe00640 1 --2- 172.21.15.7:0/1052780298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e700c9e50 0x7f5e70149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:46.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e74e00640 1 -- 172.21.15.7:0/1052780298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e700cae60 msgr2=0x7f5e700c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:46.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e74e00640 1 --2- 172.21.15.7:0/1052780298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e700cae60 0x7f5e700c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e74e00640 1 -- 172.21.15.7:0/1052780298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e700c9e50 msgr2=0x7f5e70149460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e74e00640 1 --2- 172.21.15.7:0/1052780298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e700c9e50 0x7f5e70149460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e74e00640 1 -- 172.21.15.7:0/1052780298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e60009420 con 0x7f5e7015c810 2024-09-13T15:17:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e74e00640 1 --2- 172.21.15.7:0/1052780298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e7015c810 0x7f5e70145c70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800c6c0 tx=0x7f5e6800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e67e00640 1 -- 172.21.15.7:0/1052780298 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68003b80 con 0x7f5e7015c810 2024-09-13T15:17:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e67e00640 1 -- 172.21.15.7:0/1052780298 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5e68003ce0 con 0x7f5e7015c810 2024-09-13T15:17:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e67e00640 1 -- 172.21.15.7:0/1052780298 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68005310 con 0x7f5e7015c810 2024-09-13T15:17:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e76e00640 1 -- 172.21.15.7:0/1052780298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e700c2650 con 0x7f5e7015c810 2024-09-13T15:17:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e76e00640 1 -- 172.21.15.7:0/1052780298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7014c2b0 con 0x7f5e7015c810 2024-09-13T15:17:46.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e76e00640 1 -- 172.21.15.7:0/1052780298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e70067650 con 0x7f5e7015c810 2024-09-13T15:17:46.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.655+0000 7f5e67e00640 1 -- 172.21.15.7:0/1052780298 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5e68005470 con 0x7f5e7015c810 2024-09-13T15:17:46.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.659+0000 7f5e67e00640 1 --2- 172.21.15.7:0/1052780298 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5e50066690 0x7f5e50068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:46.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.659+0000 7f5e67e00640 1 -- 172.21.15.7:0/1052780298 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 7523+0+0 (secure 0 0 0) 0x7f5e68084640 con 0x7f5e7015c810 2024-09-13T15:17:46.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.659+0000 7f5e6fe00640 1 --2- 172.21.15.7:0/1052780298 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5e50066690 0x7f5e50068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:46.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.659+0000 7f5e6fe00640 1 --2- 172.21.15.7:0/1052780298 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5e50066690 0x7f5e50068b50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5e600ae000 tx=0x7f5e60008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:46.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.667+0000 7f5e67e00640 1 -- 172.21.15.7:0/1052780298 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5e680512a0 con 0x7f5e7015c810 2024-09-13T15:17:46.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:46.863+0000 7f5e76e00640 1 -- 172.21.15.7:0/1052780298 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5e700c6cb0 con 0x7f5e7015c810 2024-09-13T15:17:47.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.471+0000 7f5e67e00640 1 -- 172.21.15.7:0/1052780298 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5e700c6cb0 con 0x7f5e7015c810 2024-09-13T15:17:47.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.471+0000 7f5e76e00640 1 -- 172.21.15.7:0/1052780298 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5e50066690 msgr2=0x7f5e50068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:47.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.471+0000 7f5e76e00640 1 --2- 172.21.15.7:0/1052780298 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5e50066690 0x7f5e50068b50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5e600ae000 tx=0x7f5e60008040 comp rx=0 tx=0).stop 2024-09-13T15:17:47.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.471+0000 7f5e76e00640 1 -- 172.21.15.7:0/1052780298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e7015c810 msgr2=0x7f5e70145c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:47.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.471+0000 7f5e76e00640 1 --2- 172.21.15.7:0/1052780298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e7015c810 0x7f5e70145c70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800c6c0 tx=0x7f5e6800cb80 comp rx=0 tx=0).stop 2024-09-13T15:17:47.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.475+0000 7f5e76e00640 1 -- 172.21.15.7:0/1052780298 shutdown_connections 2024-09-13T15:17:47.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.475+0000 7f5e76e00640 1 --2- 172.21.15.7:0/1052780298 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f5e50066690 0x7f5e50068b50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:47.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.475+0000 7f5e76e00640 1 --2- 172.21.15.7:0/1052780298 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5e7015c810 0x7f5e70145c70 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:47.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.475+0000 7f5e76e00640 1 --2- 172.21.15.7:0/1052780298 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f5e700cae60 0x7f5e700c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:47.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.475+0000 7f5e76e00640 1 --2- 172.21.15.7:0/1052780298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e700c9e50 0x7f5e70149460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:47.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.475+0000 7f5e76e00640 1 -- 172.21.15.7:0/1052780298 >> 172.21.15.7:0/1052780298 conn(0x7f5e70065f10 msgr2=0x7f5e700cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:47.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.475+0000 7f5e76e00640 1 -- 172.21.15.7:0/1052780298 shutdown_connections 2024-09-13T15:17:47.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.475+0000 7f5e76e00640 1 -- 172.21.15.7:0/1052780298 wait complete. 2024-09-13T15:17:47.497 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T15:17:47.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ef200640 1 Processor -- start 2024-09-13T15:17:47.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ef200640 1 -- start start 2024-09-13T15:17:47.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ef200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07f00c7580 0x7f07f00c5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ef200640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f07f006b3e0 0x7f07f00cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ef200640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07f00cbd40 0x7f07f015c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ef200640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f0158e10 con 0x7f07f00cbd40 2024-09-13T15:17:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ef200640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f00c58b0 con 0x7f07f006b3e0 2024-09-13T15:17:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ef200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f00c7960 con 0x7f07f00c7580 2024-09-13T15:17:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ee800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07f00cbd40 0x7f07f015c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ee800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07f00cbd40 0x7f07f015c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41034/0 (socket says 172.21.15.7:41034) 2024-09-13T15:17:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ee800640 1 -- 172.21.15.7:0/788411818 learned_addr learned my addr 172.21.15.7:0/788411818 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ede00640 1 --2- 172.21.15.7:0/788411818 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07f00c7580 0x7f07f00c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ed400640 1 --2- 172.21.15.7:0/788411818 >> v2:172.21.15.77:3300/0 conn(0x7f07f006b3e0 0x7f07f00cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ee800640 1 -- 172.21.15.7:0/788411818 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07f00c7580 msgr2=0x7f07f00c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:17:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ee800640 1 --2- 172.21.15.7:0/788411818 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07f00c7580 0x7f07f00c5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:47.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ee800640 1 -- 172.21.15.7:0/788411818 >> v2:172.21.15.77:3300/0 conn(0x7f07f006b3e0 msgr2=0x7f07f00cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:17:47.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ee800640 1 --2- 172.21.15.7:0/788411818 >> v2:172.21.15.77:3300/0 conn(0x7f07f006b3e0 0x7f07f00cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:47.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.683+0000 7f07ee800640 1 -- 172.21.15.7:0/788411818 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f0159020 con 0x7f07f00cbd40 2024-09-13T15:17:47.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.687+0000 7f07ee800640 1 --2- 172.21.15.7:0/788411818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f00cbd40 0x7f07f015c500 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f07f008c7b0 tx=0x7f07e801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a277cef8c58db12c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.687+0000 7f07eca00640 1 -- 172.21.15.7:0/788411818 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e80af400 con 0x7f07f00cbd40 2024-09-13T15:17:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.687+0000 7f07eca00640 1 -- 172.21.15.7:0/788411818 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f07e80ab050 con 0x7f07f00cbd40 2024-09-13T15:17:47.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.687+0000 7f07eca00640 1 -- 172.21.15.7:0/788411818 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e80af7a0 con 0x7f07f00cbd40 2024-09-13T15:17:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.687+0000 7f07ef200640 1 -- 172.21.15.7:0/788411818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f00cbd40 msgr2=0x7f07f015c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.687+0000 7f07ef200640 1 --2- 172.21.15.7:0/788411818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f00cbd40 0x7f07f015c500 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f07f008c7b0 tx=0x7f07e801f1e0 comp rx=0 tx=0).stop 2024-09-13T15:17:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.687+0000 7f07ef200640 1 -- 172.21.15.7:0/788411818 shutdown_connections 2024-09-13T15:17:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.687+0000 7f07ef200640 1 --2- 172.21.15.7:0/788411818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f00cbd40 0x7f07f015c500 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.687+0000 7f07ef200640 1 --2- 172.21.15.7:0/788411818 >> v2:172.21.15.77:3300/0 conn(0x7f07f006b3e0 0x7f07f00cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.687+0000 7f07ef200640 1 --2- 172.21.15.7:0/788411818 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07f00c7580 0x7f07f00c5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.687+0000 7f07ef200640 1 -- 172.21.15.7:0/788411818 >> 172.21.15.7:0/788411818 conn(0x7f07f0071520 msgr2=0x7f07f0071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.687+0000 7f07ef200640 1 -- 172.21.15.7:0/788411818 shutdown_connections 2024-09-13T15:17:47.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.687+0000 7f07ef200640 1 -- 172.21.15.7:0/788411818 wait complete. 2024-09-13T15:17:47.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.687+0000 7f07ef200640 1 Processor -- start 2024-09-13T15:17:47.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ef200640 1 -- start start 2024-09-13T15:17:47.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ef200640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07f006b3e0 0x7f07f00cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:47.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ef200640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f00c7580 0x7f07f01ef310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:47.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ef200640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07f00cbd40 0x7f07f014cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:47.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ef200640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f01eeb30 con 0x7f07f00c7580 2024-09-13T15:17:47.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ef200640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f0155490 con 0x7f07f006b3e0 2024-09-13T15:17:47.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ef200640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f00cf7b0 con 0x7f07f00cbd40 2024-09-13T15:17:47.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ed400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f00c7580 0x7f07f01ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:47.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ed400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f00c7580 0x7f07f01ef310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41036/0 (socket says 172.21.15.7:41036) 2024-09-13T15:17:47.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ed400640 1 -- 172.21.15.7:0/2590313412 learned_addr learned my addr 172.21.15.7:0/2590313412 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ede00640 1 --2- 172.21.15.7:0/2590313412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07f006b3e0 0x7f07f00cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ee800640 1 --2- 172.21.15.7:0/2590313412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07f00cbd40 0x7f07f014cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ed400640 1 -- 172.21.15.7:0/2590313412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07f00cbd40 msgr2=0x7f07f014cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ed400640 1 --2- 172.21.15.7:0/2590313412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07f00cbd40 0x7f07f014cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ed400640 1 -- 172.21.15.7:0/2590313412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07f006b3e0 msgr2=0x7f07f00cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ed400640 1 --2- 172.21.15.7:0/2590313412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07f006b3e0 0x7f07f00cd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:47.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ed400640 1 -- 172.21.15.7:0/2590313412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e8009b30 con 0x7f07f00c7580 2024-09-13T15:17:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ed400640 1 --2- 172.21.15.7:0/2590313412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f00c7580 0x7f07f01ef310 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00e840 tx=0x7f07dc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07e6000640 1 -- 172.21.15.7:0/2590313412 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc004020 con 0x7f07f00c7580 2024-09-13T15:17:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07e6000640 1 -- 172.21.15.7:0/2590313412 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f07dc004180 con 0x7f07f00c7580 2024-09-13T15:17:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07e6000640 1 -- 172.21.15.7:0/2590313412 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07dc00c730 con 0x7f07f00c7580 2024-09-13T15:17:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ef200640 1 -- 172.21.15.7:0/2590313412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f0153750 con 0x7f07f00c7580 2024-09-13T15:17:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ef200640 1 -- 172.21.15.7:0/2590313412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f0153d10 con 0x7f07f00c7580 2024-09-13T15:17:47.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.691+0000 7f07ef200640 1 -- 172.21.15.7:0/2590313412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f006b7e0 con 0x7f07f00c7580 2024-09-13T15:17:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.695+0000 7f07e6000640 1 -- 172.21.15.7:0/2590313412 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f07dc00c890 con 0x7f07f00c7580 2024-09-13T15:17:47.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.695+0000 7f07e6000640 1 --2- 172.21.15.7:0/2590313412 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f07d0066690 0x7f07d0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.695+0000 7f07e6000640 1 -- 172.21.15.7:0/2590313412 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 7523+0+0 (secure 0 0 0) 0x7f07dc084df0 con 0x7f07f00c7580 2024-09-13T15:17:47.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.695+0000 7f07ede00640 1 --2- 172.21.15.7:0/2590313412 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f07d0066690 0x7f07d0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:47.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.695+0000 7f07ede00640 1 --2- 172.21.15.7:0/2590313412 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f07d0066690 0x7f07d0068b50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f07e0009b60 tx=0x7f07e0009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:47.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.699+0000 7f07e6000640 1 -- 172.21.15.7:0/2590313412 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f07dc0519b0 con 0x7f07f00c7580 2024-09-13T15:17:47.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:47.863+0000 7f07ef200640 1 -- 172.21.15.7:0/2590313412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f07f0071970 con 0x7f07f00c7580 2024-09-13T15:17:48.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.471+0000 7f07e6000640 1 -- 172.21.15.7:0/2590313412 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) v1 ==== 181+0+0 (secure 0 0 0) 0x7f07dc020020 con 0x7f07f00c7580 2024-09-13T15:17:48.475 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-09-13T15:17:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.475+0000 7f07ef200640 1 -- 172.21.15.7:0/2590313412 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f07d0066690 msgr2=0x7f07d0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.475+0000 7f07ef200640 1 --2- 172.21.15.7:0/2590313412 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f07d0066690 0x7f07d0068b50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f07e0009b60 tx=0x7f07e0009190 comp rx=0 tx=0).stop 2024-09-13T15:17:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.475+0000 7f07ef200640 1 -- 172.21.15.7:0/2590313412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f00c7580 msgr2=0x7f07f01ef310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.475+0000 7f07ef200640 1 --2- 172.21.15.7:0/2590313412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f00c7580 0x7f07f01ef310 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f07dc00e840 tx=0x7f07dc00ed00 comp rx=0 tx=0).stop 2024-09-13T15:17:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.475+0000 7f07ef200640 1 -- 172.21.15.7:0/2590313412 shutdown_connections 2024-09-13T15:17:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.475+0000 7f07ef200640 1 --2- 172.21.15.7:0/2590313412 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f07d0066690 0x7f07d0068b50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.475+0000 7f07ef200640 1 --2- 172.21.15.7:0/2590313412 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07f00cbd40 0x7f07f014cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.475+0000 7f07ef200640 1 --2- 172.21.15.7:0/2590313412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07f00c7580 0x7f07f01ef310 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.475+0000 7f07ef200640 1 --2- 172.21.15.7:0/2590313412 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07f006b3e0 0x7f07f00cd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.475+0000 7f07ef200640 1 -- 172.21.15.7:0/2590313412 >> 172.21.15.7:0/2590313412 conn(0x7f07f0071520 msgr2=0x7f07f01573b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.475+0000 7f07ef200640 1 -- 172.21.15.7:0/2590313412 shutdown_connections 2024-09-13T15:17:48.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.475+0000 7f07ef200640 1 -- 172.21.15.7:0/2590313412 wait complete. 2024-09-13T15:17:48.498 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T15:17:48.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.647+0000 7f07c5e00640 1 Processor -- start 2024-09-13T15:17:48.649 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.647+0000 7f07c5e00640 1 -- start start 2024-09-13T15:17:48.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.647+0000 7f07c5e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07c0153510 0x7f07c00cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:48.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.647+0000 7f07c5e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f07c00cb150 0x7f07c00ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:48.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.647+0000 7f07c5e00640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c01595f0 con 0x7f07c00c9840 2024-09-13T15:17:48.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.647+0000 7f07c5e00640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c00cc550 con 0x7f07c00cb150 2024-09-13T15:17:48.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.647+0000 7f07c5e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c01538f0 con 0x7f07c0153510 2024-09-13T15:17:48.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.647+0000 7f07b7e00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f07c00c9840 0x7f07c0159a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53044/0 (socket says 172.21.15.7:53044) 2024-09-13T15:17:48.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.647+0000 7f07b7e00640 1 -- 172.21.15.7:0/839704392 learned_addr learned my addr 172.21.15.7:0/839704392 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:17:48.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.647+0000 7f07bf400640 1 --2- 172.21.15.7:0/839704392 >> v2:172.21.15.7:3300/0 conn(0x7f07c00cb150 0x7f07c00ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:48.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.647+0000 7f07bea00640 1 --2- 172.21.15.7:0/839704392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07c0153510 0x7f07c00cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:48.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.647+0000 7f07bf400640 1 -- 172.21.15.7:0/839704392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07c0153510 msgr2=0x7f07c00cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:17:48.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.647+0000 7f07bf400640 1 --2- 172.21.15.7:0/839704392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07c0153510 0x7f07c00cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:48.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.647+0000 7f07bf400640 1 -- 172.21.15.7:0/839704392 >> v1:172.21.15.7:6789/0 conn(0x7f07c00c9840 legacy=0x7f07c0159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:48.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.647+0000 7f07bf400640 1 -- 172.21.15.7:0/839704392 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c00cf0b0 con 0x7f07c00cb150 2024-09-13T15:17:48.652 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.647+0000 7f07be000640 1 -- 172.21.15.7:0/839704392 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209319593 0 0) 0x7f07c01595f0 con 0x7f07c00c9840 2024-09-13T15:17:48.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.651+0000 7f07bf400640 1 --2- 172.21.15.7:0/839704392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07c00cb150 0x7f07c00ca610 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009d90 tx=0x7f07b801f170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe818e94dd6d4d44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:48.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.651+0000 7f07be000640 1 -- 172.21.15.7:0/839704392 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b80af600 con 0x7f07c00cb150 2024-09-13T15:17:48.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.651+0000 7f07be000640 1 -- 172.21.15.7:0/839704392 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f07b80ab050 con 0x7f07c00cb150 2024-09-13T15:17:48.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.651+0000 7f07be000640 1 -- 172.21.15.7:0/839704392 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b80af9a0 con 0x7f07c00cb150 2024-09-13T15:17:48.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.651+0000 7f07c5e00640 1 -- 172.21.15.7:0/839704392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07c00cb150 msgr2=0x7f07c00ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:48.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.651+0000 7f07c5e00640 1 --2- 172.21.15.7:0/839704392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07c00cb150 0x7f07c00ca610 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009d90 tx=0x7f07b801f170 comp rx=0 tx=0).stop 2024-09-13T15:17:48.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.651+0000 7f07c5e00640 1 -- 172.21.15.7:0/839704392 shutdown_connections 2024-09-13T15:17:48.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.651+0000 7f07c5e00640 1 --2- 172.21.15.7:0/839704392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07c00cb150 0x7f07c00ca610 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:48.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.651+0000 7f07c5e00640 1 --2- 172.21.15.7:0/839704392 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07c0153510 0x7f07c00cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:48.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.651+0000 7f07c5e00640 1 -- 172.21.15.7:0/839704392 >> 172.21.15.7:0/839704392 conn(0x7f07c0065f10 msgr2=0x7f07c0066320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:48.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.651+0000 7f07c5e00640 1 -- 172.21.15.7:0/839704392 shutdown_connections 2024-09-13T15:17:48.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.651+0000 7f07c5e00640 1 -- 172.21.15.7:0/839704392 wait complete. 2024-09-13T15:17:48.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07c5e00640 1 Processor -- start 2024-09-13T15:17:48.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07c5e00640 1 -- start start 2024-09-13T15:17:48.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07c5e00640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07c00cb150 0x7f07c01ef5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:48.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07c5e00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07c0153510 0x7f07c00b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:48.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07c5e00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07c00cdb40 0x7f07c0151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:48.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07c5e00640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c01efaf0 con 0x7f07c00cdb40 2024-09-13T15:17:48.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07c5e00640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00cce10 con 0x7f07c0153510 2024-09-13T15:17:48.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07c5e00640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c00cd6b0 con 0x7f07c00cb150 2024-09-13T15:17:48.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07c00cdb40 0x7f07c0151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:48.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07bf400640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07c00cdb40 0x7f07c0151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55344/0 (socket says 172.21.15.7:55344) 2024-09-13T15:17:48.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07bf400640 1 -- 172.21.15.7:0/331858894 learned_addr learned my addr 172.21.15.7:0/331858894 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:48.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07b7e00640 1 --2- 172.21.15.7:0/331858894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07c0153510 0x7f07c00b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:48.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07bea00640 1 --2- 172.21.15.7:0/331858894 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07c00cb150 0x7f07c01ef5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:48.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07bf400640 1 -- 172.21.15.7:0/331858894 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07c00cb150 msgr2=0x7f07c01ef5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:48.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07bf400640 1 --2- 172.21.15.7:0/331858894 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07c00cb150 0x7f07c01ef5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:48.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07bf400640 1 -- 172.21.15.7:0/331858894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07c0153510 msgr2=0x7f07c00b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:48.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07bf400640 1 --2- 172.21.15.7:0/331858894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07c0153510 0x7f07c00b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:48.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07bf400640 1 -- 172.21.15.7:0/331858894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b8009a70 con 0x7f07c00cdb40 2024-09-13T15:17:48.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07b7e00640 1 --2- 172.21.15.7:0/331858894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07c0153510 0x7f07c00b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:17:48.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07bf400640 1 --2- 172.21.15.7:0/331858894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07c00cdb40 0x7f07c0151ff0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f07b801d820 tx=0x7f07b801bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:48.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07b7400640 1 -- 172.21.15.7:0/331858894 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b80c1070 con 0x7f07c00cdb40 2024-09-13T15:17:48.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07b7400640 1 -- 172.21.15.7:0/331858894 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f07b8009410 con 0x7f07c00cdb40 2024-09-13T15:17:48.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07b7400640 1 -- 172.21.15.7:0/331858894 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b80b9650 con 0x7f07c00cdb40 2024-09-13T15:17:48.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07c5e00640 1 -- 172.21.15.7:0/331858894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c00ce470 con 0x7f07c00cdb40 2024-09-13T15:17:48.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.655+0000 7f07c5e00640 1 -- 172.21.15.7:0/331858894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c00cd060 con 0x7f07c00cdb40 2024-09-13T15:17:48.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.659+0000 7f07c5e00640 1 -- 172.21.15.7:0/331858894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c0067620 con 0x7f07c00cdb40 2024-09-13T15:17:48.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.659+0000 7f07b7400640 1 -- 172.21.15.7:0/331858894 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f07b80b6050 con 0x7f07c00cdb40 2024-09-13T15:17:48.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.659+0000 7f07b7400640 1 --2- 172.21.15.7:0/331858894 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f079c066690 0x7f079c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:48.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.659+0000 7f07b7400640 1 -- 172.21.15.7:0/331858894 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 7085+0+0 (secure 0 0 0) 0x7f07b8122600 con 0x7f07c00cdb40 2024-09-13T15:17:48.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.659+0000 7f07bea00640 1 --2- 172.21.15.7:0/331858894 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f079c066690 0x7f079c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:48.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.663+0000 7f07bea00640 1 --2- 172.21.15.7:0/331858894 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f079c066690 0x7f079c068b50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f07b000b930 tx=0x7f07b0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:48.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.663+0000 7f07b7400640 1 -- 172.21.15.7:0/331858894 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f07b80f2d70 con 0x7f07c00cdb40 2024-09-13T15:17:48.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:48.839+0000 7f07c5e00640 1 -- 172.21.15.7:0/331858894 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f07c00b1bc0 con 0x7f07c00cdb40 2024-09-13T15:17:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.479+0000 7f07b7400640 1 -- 172.21.15.7:0/331858894 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) v1 ==== 169+0+0 (secure 0 0 0) 0x7f07b80b40d0 con 0x7f07c00cdb40 2024-09-13T15:17:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-09-13T15:17:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.483+0000 7f07c5e00640 1 -- 172.21.15.7:0/331858894 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f079c066690 msgr2=0x7f079c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.483+0000 7f07c5e00640 1 --2- 172.21.15.7:0/331858894 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f079c066690 0x7f079c068b50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f07b000b930 tx=0x7f07b0008040 comp rx=0 tx=0).stop 2024-09-13T15:17:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.483+0000 7f07c5e00640 1 -- 172.21.15.7:0/331858894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07c00cdb40 msgr2=0x7f07c0151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:49.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.483+0000 7f07c5e00640 1 --2- 172.21.15.7:0/331858894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07c00cdb40 0x7f07c0151ff0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f07b801d820 tx=0x7f07b801bf10 comp rx=0 tx=0).stop 2024-09-13T15:17:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.483+0000 7f07c5e00640 1 -- 172.21.15.7:0/331858894 shutdown_connections 2024-09-13T15:17:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.483+0000 7f07c5e00640 1 --2- 172.21.15.7:0/331858894 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f079c066690 0x7f079c068b50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.483+0000 7f07c5e00640 1 --2- 172.21.15.7:0/331858894 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07c00cdb40 0x7f07c0151ff0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.483+0000 7f07c5e00640 1 --2- 172.21.15.7:0/331858894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f07c0153510 0x7f07c00b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.483+0000 7f07c5e00640 1 --2- 172.21.15.7:0/331858894 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f07c00cb150 0x7f07c01ef5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.483+0000 7f07c5e00640 1 -- 172.21.15.7:0/331858894 >> 172.21.15.7:0/331858894 conn(0x7f07c0065f10 msgr2=0x7f07c00662f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.483+0000 7f07c5e00640 1 -- 172.21.15.7:0/331858894 shutdown_connections 2024-09-13T15:17:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.483+0000 7f07c5e00640 1 -- 172.21.15.7:0/331858894 wait complete. 2024-09-13T15:17:49.512 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-13T15:17:49.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.655+0000 7f1753800640 1 Processor -- start 2024-09-13T15:17:49.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.655+0000 7f1753800640 1 -- start start 2024-09-13T15:17:49.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.659+0000 7f1753800640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f174c0c4c00 0x7f174c0c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:49.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.659+0000 7f1753800640 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f174c0c5520 0x7f174c06b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:49.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.659+0000 7f1753800640 1 -- --> v1:172.21.15.7:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f174c159220 con 0x7f174c0c3ac0 2024-09-13T15:17:49.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.659+0000 7f1753800640 1 -- --> v2:172.21.15.7:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c06b080 con 0x7f174c0c4c00 2024-09-13T15:17:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.659+0000 7f1753800640 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174c0b1ce0 con 0x7f174c0c5520 2024-09-13T15:17:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.659+0000 7f1750e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f174c0c4c00 0x7f174c0c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.659+0000 7f174be00640 1 --1- >> v1:172.21.15.7:6789/0 conn(0x7f174c0c3ac0 0x7f174c153030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.7:6789/0 says I am v1:172.21.15.7:53050/0 (socket says 172.21.15.7:53050) 2024-09-13T15:17:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.659+0000 7f1750e00640 1 --2- >> v2:172.21.15.7:3300/0 conn(0x7f174c0c4c00 0x7f174c0c4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55354/0 (socket says 172.21.15.7:55354) 2024-09-13T15:17:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.659+0000 7f174be00640 1 -- 172.21.15.7:0/3363933068 learned_addr learned my addr 172.21.15.7:0/3363933068 (peer_addr_for_me v1:172.21.15.7:0/0) 2024-09-13T15:17:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.659+0000 7f1751800640 1 --2- 172.21.15.7:0/3363933068 >> v2:172.21.15.77:3300/0 conn(0x7f174c0c5520 0x7f174c06b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.659+0000 7f1750e00640 1 -- 172.21.15.7:0/3363933068 >> v2:172.21.15.77:3300/0 conn(0x7f174c0c5520 msgr2=0x7f174c06b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T15:17:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.659+0000 7f1750e00640 1 --2- 172.21.15.7:0/3363933068 >> v2:172.21.15.77:3300/0 conn(0x7f174c0c5520 0x7f174c06b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.659+0000 7f1750e00640 1 -- 172.21.15.7:0/3363933068 >> v1:172.21.15.7:6789/0 conn(0x7f174c0c3ac0 legacy=0x7f174c153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.659+0000 7f1750e00640 1 -- 172.21.15.7:0/3363933068 --> v2:172.21.15.7:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174c1594e0 con 0x7f174c0c4c00 2024-09-13T15:17:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.659+0000 7f1751800640 1 --2- 172.21.15.7:0/3363933068 >> v2:172.21.15.77:3300/0 conn(0x7f174c0c5520 0x7f174c06b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:17:49.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.659+0000 7f174b400640 1 -- 172.21.15.7:0/3363933068 <== mon.0 v1:172.21.15.7:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397309064 0 0) 0x7f174c159220 con 0x7f174c0c3ac0 2024-09-13T15:17:49.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.659+0000 7f1750e00640 1 --2- 172.21.15.7:0/3363933068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f174c0c4c00 0x7f174c0c4fe0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f174c08ce40 tx=0x7f174001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9836fee1a455bb02 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:49.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f174b400640 1 -- 172.21.15.7:0/3363933068 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400a8970 con 0x7f174c0c4c00 2024-09-13T15:17:49.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f174b400640 1 -- 172.21.15.7:0/3363933068 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f17400a8ad0 con 0x7f174c0c4c00 2024-09-13T15:17:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f174b400640 1 -- 172.21.15.7:0/3363933068 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400a8e80 con 0x7f174c0c4c00 2024-09-13T15:17:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1753800640 1 -- 172.21.15.7:0/3363933068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f174c0c4c00 msgr2=0x7f174c0c4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:49.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1753800640 1 --2- 172.21.15.7:0/3363933068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f174c0c4c00 0x7f174c0c4fe0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f174c08ce40 tx=0x7f174001ec70 comp rx=0 tx=0).stop 2024-09-13T15:17:49.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1753800640 1 -- 172.21.15.7:0/3363933068 shutdown_connections 2024-09-13T15:17:49.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1753800640 1 --2- 172.21.15.7:0/3363933068 >> v2:172.21.15.77:3300/0 conn(0x7f174c0c5520 0x7f174c06b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:49.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1753800640 1 --2- 172.21.15.7:0/3363933068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f174c0c4c00 0x7f174c0c4fe0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:49.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1753800640 1 -- 172.21.15.7:0/3363933068 >> 172.21.15.7:0/3363933068 conn(0x7f174c0cefc0 msgr2=0x7f174c0cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:49.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1753800640 1 -- 172.21.15.7:0/3363933068 shutdown_connections 2024-09-13T15:17:49.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1753800640 1 -- 172.21.15.7:0/3363933068 wait complete. 2024-09-13T15:17:49.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1753800640 1 Processor -- start 2024-09-13T15:17:49.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1753800640 1 -- start start 2024-09-13T15:17:49.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1753800640 1 --2- >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f174c0c4c00 0x7f174c148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:49.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1753800640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f174c0c5520 0x7f174c0c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:49.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1753800640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f174c157f70 0x7f174c0c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:49.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1753800640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c158a30 con 0x7f174c0c5520 2024-09-13T15:17:49.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1753800640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0c5e60 con 0x7f174c157f70 2024-09-13T15:17:49.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1753800640 1 -- --> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174c0c60d0 con 0x7f174c0c4c00 2024-09-13T15:17:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f174be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f174c0c5520 0x7f174c0c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f174be00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f174c0c5520 0x7f174c0c7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55368/0 (socket says 172.21.15.7:55368) 2024-09-13T15:17:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f174be00640 1 -- 172.21.15.7:0/3005251675 learned_addr learned my addr 172.21.15.7:0/3005251675 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-13T15:17:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1750e00640 1 --2- 172.21.15.7:0/3005251675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f174c0c4c00 0x7f174c148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.663+0000 7f1751800640 1 --2- 172.21.15.7:0/3005251675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f174c157f70 0x7f174c0c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.667+0000 7f174be00640 1 -- 172.21.15.7:0/3005251675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f174c0c4c00 msgr2=0x7f174c148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.667+0000 7f174be00640 1 --2- 172.21.15.7:0/3005251675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f174c0c4c00 0x7f174c148600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.667+0000 7f174be00640 1 -- 172.21.15.7:0/3005251675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f174c157f70 msgr2=0x7f174c0c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.667+0000 7f174be00640 1 --2- 172.21.15.7:0/3005251675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f174c157f70 0x7f174c0c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.667+0000 7f174be00640 1 -- 172.21.15.7:0/3005251675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1740009420 con 0x7f174c0c5520 2024-09-13T15:17:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.667+0000 7f1750e00640 1 --2- 172.21.15.7:0/3005251675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f174c0c4c00 0x7f174c148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T15:17:49.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.667+0000 7f174be00640 1 --2- 172.21.15.7:0/3005251675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f174c0c5520 0x7f174c0c7c30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f17380011f0 tx=0x7f173800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.667+0000 7f1748c00640 1 -- 172.21.15.7:0/3005251675 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17380074e0 con 0x7f174c0c5520 2024-09-13T15:17:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.667+0000 7f1748c00640 1 -- 172.21.15.7:0/3005251675 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1738007640 con 0x7f174c0c5520 2024-09-13T15:17:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.667+0000 7f1748c00640 1 -- 172.21.15.7:0/3005251675 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1738004a30 con 0x7f174c0c5520 2024-09-13T15:17:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.667+0000 7f1753800640 1 -- 172.21.15.7:0/3005251675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174c0c63b0 con 0x7f174c0c5520 2024-09-13T15:17:49.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.667+0000 7f1753800640 1 -- 172.21.15.7:0/3005251675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174c158f60 con 0x7f174c0c5520 2024-09-13T15:17:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.667+0000 7f1753800640 1 -- 172.21.15.7:0/3005251675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174c0cb1c0 con 0x7f174c0c5520 2024-09-13T15:17:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.667+0000 7f1748c00640 1 -- 172.21.15.7:0/3005251675 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1738004b90 con 0x7f174c0c5520 2024-09-13T15:17:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.667+0000 7f1748c00640 1 --2- 172.21.15.7:0/3005251675 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f172c0666c0 0x7f172c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T15:17:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.667+0000 7f1748c00640 1 -- 172.21.15.7:0/3005251675 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6555+0+0 (secure 0 0 0) 0x7f1738083710 con 0x7f174c0c5520 2024-09-13T15:17:49.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.671+0000 7f1750e00640 1 --2- 172.21.15.7:0/3005251675 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f172c0666c0 0x7f172c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T15:17:49.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.671+0000 7f1750e00640 1 --2- 172.21.15.7:0/3005251675 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f172c0666c0 0x7f172c068b80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f17400b2000 tx=0x7f1740008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T15:17:49.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.675+0000 7f1748c00640 1 -- 172.21.15.7:0/3005251675 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1738050690 con 0x7f174c0c5520 2024-09-13T15:17:49.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:49.855+0000 7f1753800640 1 -- 172.21.15.7:0/3005251675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f174c15a010 con 0x7f174c0c5520 2024-09-13T15:17:50.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:50.491+0000 7f1748c00640 1 -- 172.21.15.7:0/3005251675 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v37) v1 ==== 178+0+0 (secure 0 0 0) 0x7f1738053cb0 con 0x7f174c0c5520 2024-09-13T15:17:50.493 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data_ec' removed 2024-09-13T15:17:50.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:50.491+0000 7f1753800640 1 -- 172.21.15.7:0/3005251675 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f172c0666c0 msgr2=0x7f172c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:50.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:50.491+0000 7f1753800640 1 --2- 172.21.15.7:0/3005251675 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f172c0666c0 0x7f172c068b80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f17400b2000 tx=0x7f1740008040 comp rx=0 tx=0).stop 2024-09-13T15:17:50.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:50.491+0000 7f1753800640 1 -- 172.21.15.7:0/3005251675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f174c0c5520 msgr2=0x7f174c0c7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T15:17:50.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:50.491+0000 7f1753800640 1 --2- 172.21.15.7:0/3005251675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f174c0c5520 0x7f174c0c7c30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f17380011f0 tx=0x7f173800c9b0 comp rx=0 tx=0).stop 2024-09-13T15:17:50.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:50.491+0000 7f1753800640 1 -- 172.21.15.7:0/3005251675 shutdown_connections 2024-09-13T15:17:50.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:50.491+0000 7f1753800640 1 --2- 172.21.15.7:0/3005251675 >> [v2:172.21.15.77:6832/1464925128,v1:172.21.15.77:6833/1464925128] conn(0x7f172c0666c0 0x7f172c068b80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:50.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:50.491+0000 7f1753800640 1 --2- 172.21.15.7:0/3005251675 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f174c157f70 0x7f174c0c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:50.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:50.491+0000 7f1753800640 1 --2- 172.21.15.7:0/3005251675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f174c0c5520 0x7f174c0c7c30 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:50.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:50.491+0000 7f1753800640 1 --2- 172.21.15.7:0/3005251675 >> [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] conn(0x7f174c0c4c00 0x7f174c148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T15:17:50.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:50.491+0000 7f1753800640 1 -- 172.21.15.7:0/3005251675 >> 172.21.15.7:0/3005251675 conn(0x7f174c0cefc0 msgr2=0x7f174c0ca870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T15:17:50.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:50.491+0000 7f1753800640 1 -- 172.21.15.7:0/3005251675 shutdown_connections 2024-09-13T15:17:50.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-13T15:17:50.491+0000 7f1753800640 1 -- 172.21.15.7:0/3005251675 wait complete. 2024-09-13T15:17:50.523 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T15:17:50.524 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T15:17:50.524 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:17:50.543 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T15:17:50.543 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T15:17:50.543 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:17:50.617 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T15:17:50.617 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-09-13T15:17:50.617 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:17:50.690 INFO:tasks.ceph.mds.e:Stopped 2024-09-13T15:17:50.690 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T15:17:50.690 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:17:50.728 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T15:17:50.729 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T15:17:50.729 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:17:50.794 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T15:17:50.794 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-09-13T15:17:50.794 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:17:50.851 INFO:tasks.ceph.mds.f:Stopped 2024-09-13T15:17:50.851 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T15:17:50.851 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T15:17:50.851 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:17:56.562 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-13T15:17:56.953 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T15:17:56.954 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T15:17:56.954 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:18:02.672 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-13T15:18:02.673 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-13T15:18:03.055 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T15:18:03.056 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T15:18:03.056 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:18:08.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-13T15:18:08.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-13T15:18:09.158 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T15:18:09.158 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T15:18:09.158 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:18:14.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-13T15:18:14.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-13T15:18:15.260 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T15:18:15.260 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T15:18:15.260 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:18:20.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-13T15:18:20.396 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-13T15:18:21.362 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T15:18:21.363 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T15:18:21.363 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:18:21.453 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T15:18:21.453 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T15:18:21.454 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:18:26.000 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-13T15:18:26.001 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-13T15:18:27.555 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T15:18:27.555 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T15:18:27.556 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:18:31.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-13T15:18:31.512 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-13T15:18:33.658 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T15:18:33.658 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T15:18:33.659 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T15:18:33.659 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:18:33.729 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T15:18:33.730 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T15:18:33.730 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:18:33.760 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T15:18:33.760 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T15:18:33.760 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T15:18:33.760 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:18:33.779 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T15:18:33.779 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T15:18:33.779 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:18:33.815 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T15:18:33.815 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T15:18:33.815 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T15:18:33.876 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T15:18:33.876 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T15:18:33.877 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v 'Replacing daemon mds' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-13T15:18:34.058 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T15:18:34.059 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T15:18:34.977 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T15:18:34.978 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T15:18:35.231 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T15:18:35.231 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T15:18:35.493 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T15:18:35.493 DEBUG:teuthology.orchestra.run.smithi007:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T15:18:35.782 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-13T15:18:35.782 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T15:18:36.060 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-13T15:18:36.060 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T15:18:36.332 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-13T15:18:36.332 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T15:18:36.513 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-13T15:18:36.515 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-13T15:18:36.516 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T15:18:36.708 INFO:tasks.ceph:Archiving mon data... 2024-09-13T15:18:36.709 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903700/data/mon.a.tgz 2024-09-13T15:18:36.709 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-09-13T15:18:36.757 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.PgBCPHJy8y 2024-09-13T15:18:36.758 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.PgBCPHJy8y 2024-09-13T15:18:36.878 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.PgBCPHJy8y 2024-09-13T15:18:37.018 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.PgBCPHJy8y is 321KB 2024-09-13T15:18:37.081 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.PgBCPHJy8y 2024-09-13T15:18:37.119 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903700/data/mon.b.tgz 2024-09-13T15:18:37.120 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-09-13T15:18:37.135 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.EOHv4f2HpC 2024-09-13T15:18:37.135 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.EOHv4f2HpC 2024-09-13T15:18:37.264 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.EOHv4f2HpC 2024-09-13T15:18:37.360 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.EOHv4f2HpC is 322KB 2024-09-13T15:18:37.460 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.EOHv4f2HpC 2024-09-13T15:18:37.489 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903700/data/mon.c.tgz 2024-09-13T15:18:37.489 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-09-13T15:18:37.535 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.kSjAqbkcln 2024-09-13T15:18:37.535 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.kSjAqbkcln 2024-09-13T15:18:37.650 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.kSjAqbkcln 2024-09-13T15:18:37.714 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.kSjAqbkcln is 322KB 2024-09-13T15:18:37.776 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.kSjAqbkcln 2024-09-13T15:18:37.781 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T15:18:37.781 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T15:18:37.785 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T15:18:37.865 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T15:18:37.865 DEBUG:teuthology.orchestra.run.smithi007:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T15:18:37.869 DEBUG:teuthology.orchestra.run.smithi077:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T15:18:37.915 INFO:teuthology.orchestra.run.smithi007.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T15:18:37.932 INFO:teuthology.orchestra.run.smithi077.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T15:18:37.936 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T15:18:37.938 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903700/remote/smithi007/crash 2024-09-13T15:18:37.939 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T15:18:37.959 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903700/remote/smithi077/crash 2024-09-13T15:18:37.960 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T15:18:37.987 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T15:21:26.996 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T15:21:27.017 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T15:21:27.055 INFO:tasks.ceph:Compressing logs... 2024-09-13T15:21:27.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T15:21:27.062 DEBUG:teuthology.orchestra.run.smithi077:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T15:32:46.767 INFO:tasks.ceph:Archiving logs... 2024-09-13T15:32:46.792 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903700/remote/smithi007/log 2024-09-13T15:32:46.793 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T15:33:56.632 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903700/remote/smithi077/log 2024-09-13T15:33:56.633 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T15:34:59.675 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T15:34:59.690 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T15:34:59.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T15:34:59.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T15:34:59.793 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T15:34:59.802 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T15:34:59.802 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T15:34:59.805 DEBUG:teuthology.orchestra.run.smithi077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T15:34:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T15:34:59.846 INFO:teuthology.orchestra.run.smithi007.stdout:============================================================================== 2024-09-13T15:34:59.846 INFO:teuthology.orchestra.run.smithi007.stdout:*hv01.front.sepi 67.205.162.81 3 u 45 64 377 0.082 -1.621 0.120 2024-09-13T15:34:59.847 INFO:teuthology.orchestra.run.smithi007.stdout:+hv02.front.sepi 63.231.80.2 3 u 59 64 377 0.088 -0.345 0.211 2024-09-13T15:34:59.847 INFO:teuthology.orchestra.run.smithi007.stdout:+hv03.front.sepi 74.6.168.72 3 u 43 64 377 0.096 -1.873 0.139 2024-09-13T15:34:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-13T15:34:59.953 INFO:teuthology.orchestra.run.smithi077.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T15:34:59.953 INFO:teuthology.orchestra.run.smithi077.stdout:============================================================================== 2024-09-13T15:34:59.954 INFO:teuthology.orchestra.run.smithi077.stdout:*hv01.front.sepi 67.205.162.81 3 u 110 128 377 0.065 -3.487 0.732 2024-09-13T15:34:59.954 INFO:teuthology.orchestra.run.smithi077.stdout:+hv02.front.sepi 63.231.80.2 3 u 108 128 377 0.107 -2.725 0.459 2024-09-13T15:34:59.954 INFO:teuthology.orchestra.run.smithi077.stdout:+hv03.front.sepi 74.6.168.72 3 u 31 128 377 0.094 -4.657 0.549 2024-09-13T15:34:59.954 INFO:teuthology.orchestra.run.smithi077.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-13T15:34:59.954 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T15:34:59.964 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T15:34:59.964 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T15:34:59.984 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T15:35:00.002 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T15:35:00.035 INFO:teuthology.task.internal:Duration was 2721.355791 seconds 2024-09-13T15:35:00.035 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T15:35:00.063 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T15:35:00.063 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T15:35:00.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T15:35:00.355 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T15:35:00.356 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2024-09-13T15:35:00.356 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T15:35:00.378 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi077.front.sepia.ceph.com 2024-09-13T15:35:00.378 DEBUG:teuthology.orchestra.run.smithi077:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T15:35:00.389 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T15:35:00.389 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T15:35:00.427 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T15:35:00.514 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T15:35:00.515 DEBUG:teuthology.orchestra.run.smithi007:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T15:35:00.518 DEBUG:teuthology.orchestra.run.smithi077:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T15:35:00.789 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T15:35:00.802 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T15:35:00.803 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T15:35:00.842 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T15:35:00.881 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T15:35:00.894 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T15:35:00.897 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T15:35:00.931 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2024-09-13T15:35:00.950 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = core 2024-09-13T15:35:00.981 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T15:35:00.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:35:00.999 DEBUG:teuthology.orchestra.run.smithi077:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T15:35:01.029 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T15:35:01.029 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T15:35:01.039 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T15:35:01.041 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903700/remote/smithi007 2024-09-13T15:35:01.041 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T15:35:01.070 DEBUG:teuthology.misc:Transferring archived files from smithi077:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:36:41-fs-wip-rishabh-testing-20240910.095512-reef-distro-default-smithi/7903700/remote/smithi077 2024-09-13T15:35:01.070 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T15:35:01.093 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T15:35:01.093 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T15:35:01.111 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T15:35:01.141 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T15:35:01.152 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T15:35:01.153 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T15:35:01.178 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T15:35:01.178 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T15:35:01.181 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T15:35:01.187 INFO:teuthology.orchestra.run.smithi007.stdout: 655467 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 15:35 /home/ubuntu/cephtest 2024-09-13T15:35:01.190 INFO:teuthology.orchestra.run.smithi077.stdout: 524291 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 15:35 /home/ubuntu/cephtest 2024-09-13T15:35:01.205 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T15:35:01.217 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T15:35:01.279 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/mds 2-workunit/suites/ffsb}} duration: 2721.3557908535004 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T15:35:01.280 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T15:35:01.388 INFO:teuthology.run:pass